You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 22:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Jun 13, 2026 12:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3485887994742,4cyclictest335557-21systemd-journal09:05:000
3485898994440,3cyclictest3432849-21kworker/u8:1+flush-259:007:35:003
3485887994134,5cyclictest3757605-21ntpq11:25:200
3485898994034,4cyclictest3543040-21apt-get08:05:013
3485891994021,14cyclictest3800228-21latency_hist12:10:001
3485895993936,2cyclictest3553404-21kworker/u8:1+events_unbound09:00:242
3485898993731,4cyclictest3616908-21cp09:14:593
3485887993731,4cyclictest335557-21systemd-journal07:32:330
3485898993631,3cyclictest3701368-21kworker/u8:0+flush-259:011:20:153
3485895993630,4cyclictest3623045-21kworker/u8:1+flush-259:010:40:172
3485887993530,4cyclictest3727176-21apt-get11:00:000
3485898993429,3cyclictest3643639-21kworker/u8:2+flush-259:009:40:163
3485895993329,3cyclictest3643639-21kworker/u8:2+flush-259:009:40:132
3485895993327,4cyclictest3622545-21cat09:20:002
3485887993328,4cyclictest3543044-21latency_hist08:05:010
3485898993226,4cyclictest335557-21systemd-journal10:45:253
3485895993229,2cyclictest3805414-21kworker/u8:2+flush-259:012:35:012
3485895993229,2cyclictest3432849-21kworker/u8:1+flush-259:007:35:172
3485898993125,4cyclictest3616809-21apt-get09:15:003
3485891993124,5cyclictest3820416-21ntpq12:25:211
3485887993126,4cyclictest3799318-21ntpq12:05:200
3485887993126,4cyclictest3663084-21ntpq09:55:200
3485895993024,4cyclictest3758528-21apt-get11:29:592
3485891993022,7cyclictest3685767-21apt-get10:20:121
3485898992922,5cyclictest3810558-21latency_hist12:20:013
3485898992823,3cyclictest3553404-21kworker/u8:1+flush-259:008:50:013
3485895992824,3cyclictest3686059-21kworker/u8:2+events_unbound10:25:022
3485891992824,3cyclictest3485734-21kworker/u8:2+flush-259:007:25:001
3485891992824,3cyclictest3485734-21kworker/u8:2+flush-259:007:25:001
3485891992822,4cyclictest335557-21systemd-journal12:00:521
3485898992721,4cyclictest3601237-21latency_hist09:00:003
3485895992723,3cyclictest3517210-21kworker/u8:3+flush-259:007:45:002
3485895992721,4cyclictest335557-21systemd-journal08:10:192
3485891992721,4cyclictest335557-21systemd-journal07:16:321
3485891992720,5cyclictest3590606-21cp08:50:011
3485887992723,3cyclictest3768887-21kworker/u8:2+flush-259:011:45:260
3485887992723,3cyclictest3691272-21base6410:25:010
3485895992623,2cyclictest3701576-21kworker/u8:4+events_unbound11:05:012
3485895992622,3cyclictest3537916-21kworker/u8:3+events_unbound08:25:232
3485891992620,4cyclictest3769522-21apt-get11:40:121
3485887992623,2cyclictest3606389-21kworker/u8:2+flush-259:009:10:000
3485898992520,4cyclictest3432849-21kworker/u8:1+flush-259:007:15:003
3485895992519,4cyclictest3784785-21latency_hist11:55:012
3485891992521,3cyclictest3653939-21kworker/u8:3+flush-259:010:25:211
3485887992522,2cyclictest3606390-21kworker/u8:4+flush-259:009:25:240
3485887992521,3cyclictest3485734-21kworker/u8:2+flush-259:007:24:380
3485887992521,3cyclictest3485734-21kworker/u8:2+flush-259:007:24:370
3485898992418,4cyclictest3575152-21apt-get08:35:113
3485895992419,4cyclictest3606390-21kworker/u8:4+flush-259:010:05:172
3485891992419,3cyclictest3769260-21latency_hist11:40:011
3485887992420,3cyclictest335557-21systemd-journal07:43:320
3485887992418,4cyclictest3623084-21apt-get09:20:120
3485887992418,4cyclictest335557-21systemd-journal12:27:330
3485898992319,3cyclictest3758548-21kworker/u8:1+flush-259:011:49:593
3485898992317,4cyclictest3685508-21latency_hist10:20:013
3485895992319,3cyclictest3553404-21kworker/u8:1+events_unbound08:23:342
3485895992318,4cyclictest3606639-21apt-get09:05:132
3485891992317,4cyclictest3674729-21apt-get10:10:001
3485887992320,2cyclictest3653939-21kworker/u8:3+events_unbound10:30:120
3485887992320,2cyclictest3606390-21kworker/u8:4+flush-259:009:50:010
3485887992320,2cyclictest3432849-21kworker/u8:1+flush-259:007:10:230
3485887992320,2cyclictest1-21systemd09:36:320
3485887992319,3cyclictest3606390-21kworker/u8:4+events_unbound10:10:210
3485887992318,3cyclictest335557-21systemd-journal11:15:000
3485898992218,3cyclictest3717119-21apt-get10:50:123
3485895992219,3cyclictest3432849-21kworker/u8:1+events_unbound07:34:592
3485895992219,2cyclictest3653939-21kworker/u8:3+flush-259:010:15:212
3485895992218,3cyclictest3779669-21kworker/u8:0+events_unbound12:28:322
3485895992218,3cyclictest3606390-21kworker/u8:4+events_unbound09:30:102
3485895992217,4cyclictest335557-21systemd-journal07:25:322
3485891992216,4cyclictest3675419-21apt-get10:10:111
3485887992219,2cyclictest3805621-21kworker/u8:3+events_unbound12:15:200
3485887992219,2cyclictest3805414-21kworker/u8:2+flush-259:012:35:230
3485887992219,2cyclictest3758548-21kworker/u8:1+events_unbound11:30:220
3485887992218,2cyclictest335557-21systemd-journal08:40:000
3485898992117,3cyclictest3701576-21kworker/u8:4+flush-259:010:40:243
3485898992117,3cyclictest3653939-21kworker/u8:3+flush-259:010:20:253
3485895992118,3cyclictest3758548-21kworker/u8:1+events_unbound11:58:322
3485895992117,3cyclictest3701576-21kworker/u8:4+events_unbound10:46:342
3485895992117,3cyclictest3585242-21kworker/u8:0+events_unbound08:45:222
3485895992117,3cyclictest3544135-21kworker/u8:0+events_unbound08:15:222
3485895992117,3cyclictest3485734-21kworker/u8:2+events_unbound08:01:332
3485895992115,4cyclictest335557-21systemd-journal11:21:322
3485895992115,4cyclictest335557-21systemd-journal08:05:182
3485891992118,2cyclictest3800492-21apt-get12:10:121
3485891992118,2cyclictest3800492-21apt-get12:10:111
3485891992115,4cyclictest3554064-21apt-get08:15:111
3485887992118,2cyclictest3553404-21kworker/u8:1+flush-259:008:55:210
3485887992117,3cyclictest3805621-21kworker/u8:3+events_unbound12:20:200
3485887992117,3cyclictest3748262-21kworker/u8:2+flush-259:011:20:520
3485887992117,3cyclictest3553404-21kworker/u8:1+events_unbound08:40:260
3485887992115,5cyclictest3727176-21apt-get11:00:010
3485898992015,3cyclictest335557-21systemd-journal11:55:513
3485898992013,4cyclictest3815242-21ntpq12:20:203
3485895992017,2cyclictest3795297-21kworker/u8:4+flush-259:012:15:532
3485895992017,2cyclictest3779669-21kworker/u8:0+flush-259:012:35:202
3485895992016,3cyclictest3701368-21kworker/u8:0+flush-259:011:15:332
3485895992016,3cyclictest3653939-21kworker/u8:3+flush-259:010:20:152
3485895992016,3cyclictest3643639-21kworker/u8:2+events_unbound09:45:232
3485895992016,3cyclictest3506536-21kworker/u8:0+events_unbound07:45:032
3485895992015,4cyclictest335557-21systemd-journal09:36:322
3485891992017,2cyclictest3758534-21idleruntime-cro11:29:591
3485891992014,4cyclictest3537916-21kworker/u8:3+flush-259:009:35:161
3485891992013,5cyclictest335557-21systemd-journal11:30:301
3485887992017,2cyclictest3758548-21kworker/u8:1+events_unbound12:00:160
3485887992017,2cyclictest3506536-21kworker/u8:0+events_unbound07:45:220
3485887992016,3cyclictest3758548-21kworker/u8:1+events_unbound11:54:320
3485887992016,3cyclictest3623045-21kworker/u8:1+events_unbound10:45:270
3485887992016,3cyclictest3623045-21kworker/u8:1+events_unbound10:40:170
3485887992016,3cyclictest3606390-21kworker/u8:4+flush-259:009:50:100
3485887992016,3cyclictest3606390-21kworker/u8:4+flush-259:009:50:100
3485887992016,3cyclictest3448365-21kworker/u8:3+flush-259:007:15:250
3485887992015,4cyclictest3758548-21kworker/u8:1+events_unbound11:36:340
3485887992015,3cyclictest3553404-21kworker/u8:1+events_unbound08:50:200
3485887992014,5cyclictest3505651-21ntpq07:25:220
3485898991913,4cyclictest3448365-21kworker/u8:3+flush-259:007:15:263
3485895991916,2cyclictest3701368-21kworker/u8:0+events_unbound11:35:242
3485895991916,2cyclictest3623045-21kworker/u8:1+events_unbound09:25:072
3485895991916,2cyclictest3606390-21kworker/u8:4+events_unbound09:55:202
3485895991915,3cyclictest3768887-21kworker/u8:2+events_unbound11:47:332
3485895991915,3cyclictest3701576-21kworker/u8:4+events_unbound10:55:232
3485895991915,3cyclictest3653939-21kworker/u8:3+events_unbound10:00:032
3485895991915,3cyclictest3585242-21kworker/u8:0+events_unbound09:21:342
3485895991915,3cyclictest3553404-21kworker/u8:1+events_unbound08:41:332
3485895991915,3cyclictest3432849-21kworker/u8:1+events_unbound07:10:202
3485895991914,4cyclictest3574986-21base6408:35:012
3485891991913,4cyclictest3831606-21latency_hist12:40:001
3485887991916,2cyclictest3701576-21kworker/u8:4+flush-259:011:05:250
3485887991915,3cyclictest3544135-21kworker/u8:0+flush-259:008:05:240
3485887991915,3cyclictest3544135-21kworker/u8:0+events_unbound08:12:320
3485887991915,3cyclictest3537916-21kworker/u8:3+events_unbound08:25:190
3485887991913,4cyclictest3800652-21diskstats12:10:140
3485887991913,4cyclictest3800652-21diskstats12:10:130
3485887991913,4cyclictest3664701-21apt-get10:00:120
3485898991812,4cyclictest3569288-21latency_hist08:30:013
3485895991815,2cyclictest3701368-21kworker/u8:0+events_unbound11:12:332
3485895991813,4cyclictest509-21rs:main2
3485891991816,1cyclictest0-21swapper/111:10:001
3485891991811,5cyclictest3510762-21ntpq07:30:201
3485887991814,3cyclictest3789558-21kworker/u8:3+events_unbound11:59:330
3485895991714,2cyclictest3779669-21kworker/u8:0+events_unbound12:05:182
3485895991713,3cyclictest3448365-21kworker/u8:3+events_unbound07:15:342
3485895991712,4cyclictest3537916-21kworker/u8:3+events_unbound08:34:582
3485895991712,4cyclictest3485734-21kworker/u8:2+events_unbound07:24:362
3485895991712,4cyclictest3485734-21kworker/u8:2+events_unbound07:24:362
348589199174,3cyclictest3631164-21cut09:25:181
348589199173,3cyclictest3664159-21awk10:00:001
348589199172,5cyclictest335557-21systemd-journal07:50:001
348589199171,4cyclictest3580100-21awk08:40:011
348589199171,4cyclictest3574459-21idleruntime-cro08:35:001
348589199170,8cyclictest3601444-21cat09:00:001
3485887991714,2cyclictest3623045-21kworker/u8:1+events_unbound11:16:320
3485887991714,2cyclictest3606390-21kworker/u8:4+events_unbound09:30:180
3485887991713,3cyclictest3653939-21kworker/u8:3+events_unbound10:20:190
3485895991613,2cyclictest3532450-21kworker/u8:1+flush-259:007:55:152
3485895991612,3cyclictest3758548-21kworker/u8:1+events_unbound12:10:142
3485895991612,3cyclictest3758548-21kworker/u8:1+events_unbound12:10:142
3485895991612,3cyclictest3701576-21kworker/u8:4+flush-259:010:50:322
348589199161,3cyclictest3621962-21head09:15:241
348589199161,3cyclictest3606356-21idleruntime-cro09:05:001
348589199161,3cyclictest3486522-21grep07:10:171
3485891991610,4cyclictest3722252-21apt-get10:55:111
348589199160,4cyclictest3543060-21awk08:05:001
348589199160,3cyclictest335557-21systemd-journal08:55:011
348589199160,14cyclictest3559932-21irqcore08:20:171
3485887991612,3cyclictest3701576-21kworker/u8:4+flush-259:010:50:270
3485887991612,3cyclictest3537916-21kworker/u8:3+events_unbound09:10:020
3485887991612,3cyclictest3506536-21kworker/u8:0+flush-259:007:50:210
3485898991513,1cyclictest3727207-21sh11:00:003
3485898991513,1cyclictest3580762-21irqcore08:40:183
3485898991513,1cyclictest0-21swapper/310:10:013
3485898991512,2cyclictest0-21swapper/307:55:003
3485898991510,4cyclictest335557-21systemd-journal10:00:013
3485895991511,3cyclictest3810554-21apt-get12:20:022
3485895991511,3cyclictest3653939-21kworker/u8:3+events_unbound09:50:182
3485895991511,3cyclictest3653939-21kworker/u8:3+events_unbound09:50:172
348589199155,1cyclictest0-21swapper/109:25:001
348589199151,4cyclictest3569282-21ls08:29:591
348589199151,3cyclictest513-21gdbus10:35:001
348589199151,3cyclictest3752937-21grep11:20:241
348589199151,3cyclictest3506049-21sed07:25:261
3485891991512,2cyclictest3778800-21ntp_offset11:45:221
348589199150,6cyclictest3732767-21munin-run11:05:001
348589199150,5cyclictest3811205-21apt-get12:20:021
348589199150,5cyclictest3610699-21ntpq09:05:221
348589199150,4cyclictest3823839-21ps12:30:181
348589199150,4cyclictest3648553-21cron09:45:001
348589199150,3cyclictest3669618-21systemd-run10:05:001
348589199150,3cyclictest3653704-21cron09:50:001
348589199150,3cyclictest3638267-21dump-pmu-power09:35:001
348589199150,3cyclictest3584760-21grep08:40:271
348588799158,5cyclictest335557-21systemd-journal09:45:000
3485887991513,1cyclictest60350irq/132-enp0s29f1:rx-009:15:240
3485887991513,1cyclictest60350irq/132-enp0s29f1:rx-008:20:130
3485887991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:190
3485887991511,3cyclictest3553404-21kworker/u8:1+events_unbound08:30:150
348589899148,4cyclictest335557-21systemd-journal08:20:213
3485898991412,1cyclictest3605509-21ntp_kernel_pll_09:00:213
3485898991412,1cyclictest0-21swapper/311:10:213
3485898991411,2cyclictest3633799-21irqcore09:30:163
3485898991411,2cyclictest3536291-21kthreadcore07:55:193
3485898991410,3cyclictest3664006-21latency_hist10:00:003
3485898991410,3cyclictest3537916-21kworker/u8:3+flush-259:009:05:373
348589599149,4cyclictest3701576-21kworker/u8:4+events_unbound11:06:332
3485895991411,2cyclictest3537916-21kworker/u8:3+events_unbound09:10:162
3485895991411,2cyclictest3532704-21cron07:55:002
3485895991410,3cyclictest3758548-21kworker/u8:1+flush-259:012:00:232
3485895991410,3cyclictest3653939-21kworker/u8:3+events_unbound10:38:322
348589199142,2cyclictest3548865-21apt-get08:10:111
3485891991410,3cyclictest3768887-21kworker/u8:2+flush-259:011:51:211
3485891991410,3cyclictest3716843-21cron10:50:001
348589199140,3cyclictest3745643-21sed11:15:171
348589199140,2cyclictest3532710-21apt07:55:001
348588799148,4cyclictest3680766-21diskstats10:15:130
3485887991413,1cyclictest60350irq/132-enp0s29f1:rx-010:06:440
3485887991412,1cyclictest60350irq/132-enp0s29f1:rx-010:35:150
3485887991412,1cyclictest60350irq/132-enp0s29f1:rx-007:38:030
3485887991411,2cyclictest3758548-21kworker/u8:1+flush-259:011:40:200
3485887991410,3cyclictest3585242-21kworker/u8:0+events_unbound08:45:200
3485887991410,3cyclictest3485734-21kworker/u8:2+events_unbound07:55:160
348589899139,3cyclictest3516858-21sshd07:35:313
348589899137,4cyclictest3701347-21latency_hist10:35:023
3485898991310,2cyclictest3606390-21kworker/u8:4+flush-259:009:28:373
3485898991310,2cyclictest3595620-21unixbench_singl08:50:233
3485898991310,2cyclictest3574925-21apt-config08:35:003
3485898991310,2cyclictest0-21swapper/311:25:263
3485895991310,2cyclictest3758548-21kworker/u8:1+events_unbound11:40:212
3485895991310,2cyclictest0-21swapper/211:30:152
348589199133,1cyclictest0-21swapper/111:10:141
3485891991310,2cyclictest3517910-21irqcore07:40:171
348589199130,4cyclictest3657647-21kthreadcore09:50:181
348589199130,4cyclictest3657647-21kthreadcore09:50:181
348589899129,2cyclictest3537916-21kworker/u8:3+flush-259:009:35:133
348589599129,2cyclictest3679932-21unixbench_singl10:10:242
3485887991211,1cyclictest60350irq/132-enp0s29f1:rx-012:30:260
348589899118,2cyclictest3764784-21irqcore11:35:163
348589899117,3cyclictest3701576-21kworker/u8:4+flush-259:011:00:053
348589599118,2cyclictest3585242-21kworker/u8:0+flush-259:008:55:252
348589899106,3cyclictest3758548-21kworker/u8:1+flush-259:011:30:233
348589899105,3cyclictest3800215-21cron12:10:013
34858989997,1cyclictest0-21swapper/312:25:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional