You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 14:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue May 05, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6185322130,2sleep375-21kworker/3:1+events10:31:093
4068682995748,6cyclictest47231-21latency_hist10:15:000
4068690995649,5cyclictest4068555-21kworker/u8:3+flush-8:007:26:131
4068690995549,4cyclictest4022006-21kworker/u8:1+flush-8:007:36:141
4068690995349,3cyclictest4110524-21kworker/u8:0+flush-8:008:56:141
4068690995349,3cyclictest4068555-21kworker/u8:3+flush-8:009:51:141
4068690995348,4cyclictest4110524-21kworker/u8:0+flush-8:008:06:141
4068690995345,6cyclictest3715636-21kworker/u8:2+flush-8:007:41:161
4068693995246,4cyclictest151848-21kworker/u8:0+flush-8:012:21:142
4068682995243,6cyclictest67935-21latency_hist10:40:010
4068690995146,3cyclictest68417-21kworker/u8:0+flush-8:010:51:111
4068690995145,4cyclictest280-21systemd-journal10:26:121
4068690995143,6cyclictest151848-21kworker/u8:0+flush-8:012:36:151
4068690995142,6cyclictest280-21systemd-journal09:26:111
4068690995043,5cyclictest4068555-21kworker/u8:3+flush-8:007:15:051
4068690995041,5cyclictest102003-21kworker/u8:2+flush-8:012:06:151
4068690994941,6cyclictest4068555-21kworker/u8:3+flush-8:009:31:121
4068690994842,4cyclictest4169828-21kworker/u8:1+flush-8:009:36:171
4068690994841,4cyclictest108023-21kworker/u8:3+events_unbound11:21:181
4068690994743,3cyclictest4068555-21kworker/u8:3+events_unbound09:16:011
4068690994742,4cyclictest4068555-21kworker/u8:3+flush-8:008:51:141
4068690994740,5cyclictest53319-21kworker/u8:1+events_unbound10:36:131
4068690994639,5cyclictest4110524-21kworker/u8:0+events_unbound08:31:131
4068682994642,3cyclictest30720-21kworker/u8:0+flush-8:010:26:000
4068690994541,3cyclictest68417-21kworker/u8:0+flush-8:011:01:141
4068690994539,4cyclictest4068905-21apt-get07:10:581
4068690994537,5cyclictest167217-21kworker/u8:3+flush-8:012:26:111
4068690994438,4cyclictest68417-21kworker/u8:0+events_unbound11:39:591
4068690994437,6cyclictest4110524-21kworker/u8:0+flush-8:008:16:131
4068690994338,3cyclictest4110524-21kworker/u8:0+events_unbound08:36:121
4068682994336,6cyclictest4022006-21kworker/u8:1+flush-8:007:31:190
4068682994332,9cyclictest280-21systemd-journal08:06:120
4068693994233,7cyclictest280-21systemd-journal12:30:002
4068693994232,7cyclictest280-21systemd-journal11:09:592
4068693994230,9cyclictest161370-21ntpq12:11:102
4068690994237,3cyclictest20596-21kworker/u8:2+flush-8:010:46:051
4068690994236,4cyclictest4068555-21kworker/u8:3+events_unbound09:01:111
4068690994234,6cyclictest108023-21kworker/u8:3+flush-8:011:51:121
4068682994233,7cyclictest4159014-21ntpq08:36:100
4068682994233,6cyclictest4125354-21latency_hist08:05:010
4068693994131,8cyclictest280-21systemd-journal07:40:002
4068690994135,4cyclictest4110524-21kworker/u8:0+events_unbound08:41:091
4068690994135,3cyclictest4068555-21kworker/u8:3+flush-8:007:46:161
4068690994134,5cyclictest58367-21apt-get10:30:571
4068690994131,8cyclictest166279-21ntpq12:16:101
4068690994129,9cyclictest117690-21cat11:30:001
4068682994135,4cyclictest102003-21kworker/u8:2+flush-8:011:41:150
4068682994133,6cyclictest108023-21kworker/u8:3+flush-8:011:21:130
4068682994131,8cyclictest280-21systemd-journal12:40:010
4068690994034,4cyclictest4115789-21apt-get07:55:571
4068690994034,4cyclictest4115789-21apt-get07:55:571
4068682994034,4cyclictest280-21systemd-journal07:30:000
4068682994033,5cyclictest3715636-21kworker/u8:2+flush-8:008:26:150
4068682994033,5cyclictest107781-21latency_hist11:20:000
4068682994033,5cyclictest102003-21kworker/u8:2+flush-8:012:11:020
4068682994032,7cyclictest4110524-21kworker/u8:0+flush-8:008:51:070
406868299401,37cyclictest1-21systemd11:28:120
4068693993931,6cyclictest280-21systemd-journal09:45:002
4068690993934,4cyclictest68417-21kworker/u8:0+events_unbound11:06:141
4068682993931,6cyclictest280-21systemd-journal11:05:000
4068690993833,4cyclictest4110524-21kworker/u8:0+events_unbound09:21:001
4068690993832,5cyclictest4068555-21kworker/u8:3+events_unbound10:01:171
4068690993832,4cyclictest4068555-21kworker/u8:3+events_unbound08:21:171
4068690993832,4cyclictest20596-21kworker/u8:2+flush-8:010:41:131
4068690993828,6cyclictest280-21systemd-journal12:31:201
406840523822,10sleep10-21swapper/107:08:461
4068693993730,5cyclictest98224-21apt-get11:10:582
4068690993731,4cyclictest4068555-21kworker/u8:3+events_unbound07:21:021
4068690993731,4cyclictest3715636-21kworker/u8:2+events_unbound07:31:051
4068690993730,6cyclictest102003-21kworker/u8:2+flush-8:011:31:161
4068690993729,6cyclictest102003-21kworker/u8:2+flush-8:011:41:141
4068690993727,8cyclictest52006-21ntpq10:21:071
4068682993731,4cyclictest4068555-21kworker/u8:3+events_unbound07:16:110
4068693993626,7cyclictest280-21systemd-journal07:30:002
4068690993631,4cyclictest4068555-21kworker/u8:3+events_unbound10:11:201
4068690993630,4cyclictest68417-21kworker/u8:0+flush-8:011:11:031
4068690993628,6cyclictest3715636-21kworker/u8:2+flush-8:008:26:121
4068682993631,4cyclictest137538-21kworker/u8:1+flush-8:012:16:110
4068693993527,5cyclictest280-21systemd-journal10:50:002
4068690993530,3cyclictest137538-21kworker/u8:1+events_unbound12:21:061
4068690993529,4cyclictest102003-21kworker/u8:2+flush-8:011:46:061
4068690993529,4cyclictest102003-21kworker/u8:2+flush-8:011:46:051
4068690993528,5cyclictest4110524-21kworker/u8:0+flush-8:008:11:171
4068690993527,5cyclictest4110524-21kworker/u8:0+flush-8:009:06:131
4068690993525,7cyclictest280-21systemd-journal09:40:421
4068690993429,3cyclictest36692-21ls10:00:001
4068682993429,4cyclictest4110524-21kworker/u8:0+flush-8:009:06:150
4068682993429,3cyclictest68417-21kworker/u8:0+flush-8:011:06:150
4068682993428,4cyclictest167217-21kworker/u8:3+flush-8:012:26:030
4068682993427,5cyclictest31106-21cron09:50:000
4068682993427,5cyclictest31106-21cron09:50:000
4068682993420,12cyclictest11381-21fschecks_time09:26:020
4068690993329,3cyclictest102003-21kworker/u8:2+events_unbound11:56:171
4068682993328,4cyclictest4110524-21kworker/u8:0+flush-8:009:11:160
4068682993326,5cyclictest52919-21apt-key10:25:010
4068682993322,9cyclictest280-21systemd-journal12:06:120
4068693993224,6cyclictest280-21systemd-journal10:42:122
4068690993227,4cyclictest4110524-21kworker/u8:0+flush-8:008:46:131
4068690993227,4cyclictest4068555-21kworker/u8:3+events_unbound08:01:191
4068682993224,6cyclictest4169828-21kworker/u8:1+events_unbound09:36:120
4068690993127,3cyclictest4068555-21kworker/u8:3+events_unbound07:51:131
4068682993126,4cyclictest4068555-21kworker/u8:3+flush-8:010:01:110
4068682993126,4cyclictest4068555-21kworker/u8:3+flush-8:007:56:140
4068682993126,4cyclictest4068555-21kworker/u8:3+flush-8:007:56:140
4068682993126,3cyclictest4068555-21kworker/u8:3+events_unbound09:45:000
4068682993125,4cyclictest4080993-21/usr/sbin/munin07:21:100
40683442314,9sleep20-21swapper/207:08:002
4068693993022,6cyclictest280-21systemd-journal07:35:002
4068682993026,3cyclictest108023-21kworker/u8:3+flush-8:012:01:020
4068682993025,4cyclictest68417-21kworker/u8:0+events_unbound10:51:150
4068682993024,5cyclictest58298-21kworker/u8:3+events_unbound10:31:100
4068682993024,4cyclictest4140553-21aten2_r5power_c08:20:590
4068682993021,6cyclictest73145-21latency_hist10:45:010
4068682993017,11cyclictest123257-21fschecks_time11:36:020
4068693992925,3cyclictest4068555-21kworker/u8:3+events_unbound10:11:092
4068693992925,2cyclictest4189568-21cron09:10:002
4068693992925,2cyclictest0-21swapper/208:20:012
4068690992925,3cyclictest53319-21kworker/u8:1+flush-8:010:55:311
4068682992925,2cyclictest4135243-21systemd-run08:15:010
4068682992924,3cyclictest4150587-21cpuspeed_turbos08:31:020
4068693992824,2cyclictest1251-21aten2_r5power_v09:15:592
4068690992822,4cyclictest4110524-21kworker/u8:0+flush-8:009:11:171
4068682992822,5cyclictest4110524-21kworker/u8:0+flush-8:008:56:120
4068682992822,4cyclictest4180327-21fschecks_count09:01:020
4068682992822,4cyclictest4110524-21kworker/u8:0+events_unbound08:18:550
4068682992822,4cyclictest4110504-21apt07:50:000
4068682992820,5cyclictest10704-21latency_hist09:25:010
41326242270,2sleep3471rcuc/308:11:073
4068693992722,4cyclictest102003-21kworker/u8:2+flush-8:012:01:082
4068693992717,8cyclictest52855-21apt-get10:25:002
4068690992723,3cyclictest30720-21kworker/u8:0+flush-8:010:08:431
4068690992720,5cyclictest103200-21cut11:15:591
4068682992721,4cyclictest138155-21fschecks_time11:51:020
4068682992719,6cyclictest68417-21kworker/u8:0+events_unbound11:11:110
4068682992719,6cyclictest280-21systemd-journal07:35:210
4068682992718,7cyclictest1429-21fschecks_count09:16:020
4068693992622,3cyclictest68417-21kworker/u8:0+flush-8:010:51:172
4068693992621,3cyclictest123167-21cpuspeed_turbos11:36:002
4068693992617,7cyclictest280-21systemd-journal07:20:002
4068690992622,3cyclictest31135-21systemd-run09:50:001
4068690992622,3cyclictest31135-21systemd-run09:49:591
4068682992620,5cyclictest4110524-21kworker/u8:0+flush-8:008:46:120
4068682992620,4cyclictest74187-21irqrtprio10:46:060
4068682992620,4cyclictest4160546-21fschecks_time08:41:000
4068682992619,5cyclictest3715636-21kworker/u8:2+flush-8:007:11:030
4068682992619,5cyclictest102003-21kworker/u8:2+flush-8:011:31:110
4068693992522,2cyclictest147390-21cat12:00:012
4068693992520,4cyclictest53319-21kworker/u8:1+flush-8:010:56:152
4068682992519,4cyclictest42258-21cron10:10:010
4068682992519,4cyclictest36683-21cron10:00:010
4068682992519,4cyclictest178120-21irqrtprio12:31:050
4068682992519,4cyclictest167800-21fschecks_count12:21:010
4068693992421,2cyclictest4116078-21fschecks_count07:56:022
4068693992421,2cyclictest4116078-21fschecks_count07:56:022
4068693992417,5cyclictest280-21systemd-journal10:05:002
4068690992417,6cyclictest157651-21aten2_r5power_c12:11:001
4068682992419,3cyclictest88020-21latency_hist11:00:000
4068682992418,4cyclictest4101230-21fschecks_count07:41:020
4068693992315,6cyclictest567-21apt-get09:15:002
4068693992314,6cyclictest280-21systemd-journal12:40:002
4068690992318,3cyclictest147948-21cpuspeed_turbos12:01:021
4068682992317,4cyclictest4111065-21cpuspeed_turbos07:51:000
4068682992317,4cyclictest20192-21unixbench_multi09:31:190
4068682992317,4cyclictest133140-21cpuspeed_turbos11:46:000
4068682992317,4cyclictest133140-21cpuspeed_turbos11:46:000
406869399228,10cyclictest58367-21apt-get10:30:592
4068693992218,3cyclictest58043-21ls10:30:002
4068693992218,3cyclictest4069194-21fschecks_count07:11:022
4068693992217,3cyclictest117291-21unixbench_multi11:26:162
4068682992218,3cyclictest30720-21kworker/u8:0+flush-8:010:16:170
4068682992218,2cyclictest0-21swapper/011:56:050
4068682992217,3cyclictest35694-21grep09:51:170
40639542223,13sleep00-21swapper/007:05:530
406869399212,14cyclictest4145433-21apt-get08:25:582
406869399212,13cyclictest132907-21apt-get11:45:592
406869399212,13cyclictest132907-21apt-get11:45:592
4068693992117,2cyclictest4106245-21fschecks_time07:46:012
4068693992117,2cyclictest128144-21cpuspeed_turbos11:40:592
4068693992116,3cyclictest4155568-21fschecks_count08:36:022
4068693992116,3cyclictest0-21swapper/210:40:012
4068693992115,4cyclictest47853-21idleruntime-cro10:20:002
4068693992114,5cyclictest103135-21apt-get11:15:572
1266512210,5sleep3451irq_work/311:36:093
406869399202,12cyclictest4170125-21apt-get08:50:592
4068693992017,2cyclictest4179683-21cron09:00:002
4068693992016,3cyclictest4130302-21sh08:10:012
4068693992016,3cyclictest0-21swapper/209:36:172
4068693992016,2cyclictest0-21swapper/208:21:022
4068693992015,3cyclictest4160497-21fschecks_count08:40:592
406869399192,16cyclictest0-21swapper/209:31:162
4068693991916,2cyclictest137928-21aten2_r5power_p11:51:002
4068693991915,3cyclictest0-21swapper/208:35:002
4068693991915,2cyclictest0-21swapper/207:41:042
4068693991914,4cyclictest68417-21kworker/u8:0+flush-8:011:01:072
4068693991912,5cyclictest9364-21tr09:21:072
4068693991911,6cyclictest4115130-21head07:51:182
4068693991910,7cyclictest108887-21sed11:21:022
4068690991916,1cyclictest0-21swapper/110:20:011
40677422193,9sleep30-21swapper/307:06:203
1093382190,3sleep375-21kworker/3:1+events11:21:043
4068693991815,2cyclictest4184308-21unixbench_singl09:01:182
4068693991815,2cyclictest162889-21fschecks_time12:16:022
4068693991814,2cyclictest31113-21latency_hist09:50:002
4068693991814,2cyclictest31113-21latency_hist09:50:002
40814092170,2sleep3481ktimers/307:21:043
406869399179,6cyclictest4169790-21cron08:50:002
4068693991713,2cyclictest0-21swapper/208:11:102
4068693991712,3cyclictest0-21swapper/212:06:012
406869399167,7cyclictest4120969-21sort08:01:032
4068693991613,2cyclictest0-21swapper/210:06:352
4068693991613,2cyclictest0-21swapper/209:25:362
4068693991613,2cyclictest0-21swapper/207:24:062
4068693991612,2cyclictest36692-21ls10:00:012
4068693991611,3cyclictest0-21swapper/212:31:022
406869399161,11cyclictest31438-21apt-get09:50:582
406869399161,11cyclictest120521-21kthreadcore11:31:082
542082141,9sleep30-21swapper/310:26:043
490852145,5sleep30-21swapper/310:21:023
41108062142,8sleep30-21swapper/307:50:583
980682132,6sleep30-21swapper/311:10:023
40959112132,7sleep30-21swapper/307:35:583
1721722132,6sleep30-21swapper/312:25:013
820092122,6sleep30-21swapper/310:51:073
778352123,5sleep30-21swapper/310:46:223
5982122,5sleep30-21swapper/309:15:013
434762122,6sleep30-21swapper/310:11:073
41857692122,6sleep30-21swapper/309:06:063
41789252122,6sleep30-21swapper/308:56:153
41697882122,5sleep30-21swapper/308:50:013
41600132122,5sleep30-21swapper/308:40:023
41598102122,6sleep30-21swapper/308:39:103
41506152122,6sleep30-21swapper/308:31:033
41490252122,6sleep30-21swapper/308:26:103
41428852122,6sleep30-21swapper/308:21:083
414172122,6sleep30-21swapper/310:02:123
41352452122,6sleep30-21swapper/308:15:023
41221342122,6sleep30-21swapper/308:01:103
41158132122,6sleep30-21swapper/307:56:003
41158132122,6sleep30-21swapper/307:55:593
41101012122,6sleep30-21swapper/307:46:173
41013122122,6sleep30-21swapper/307:41:033
40952552122,6sleep30-21swapper/307:31:203
40724062122,6sleep30-21swapper/307:11:093
313932122,6sleep30-21swapper/309:50:453
255822122,5sleep30-21swapper/309:40:013
213412122,6sleep30-21swapper/309:36:033
1777812122,6sleep30-21swapper/312:31:043
1670922123,6sleep30-21swapper/312:19:123
1474262122,6sleep30-21swapper/312:00:023
1432702122,6sleep30-21swapper/311:56:053
1424632122,6sleep30-21swapper/311:54:593
1284502122,6sleep30-21swapper/311:41:033
1058652122,6sleep30-21swapper/311:16:083
932062112,5sleep30-21swapper/311:05:123
887372112,5sleep30-21swapper/311:01:033
85062112,5sleep30-21swapper/309:21:073
838862112,6sleep30-21swapper/310:56:053
684242112,5sleep30-21swapper/310:40:123
636832112,5sleep30-21swapper/310:36:023
474602112,6sleep30-21swapper/310:15:123
419262112,5sleep30-21swapper/310:05:453
41898612112,6sleep30-21swapper/309:10:403
41799812112,6sleep30-21swapper/309:00:363
41651582112,6sleep30-21swapper/308:45:513
41260232112,5sleep30-21swapper/308:06:033
40858732112,5sleep30-21swapper/307:25:023
40738602112,5sleep30-21swapper/307:15:033
363042113,5sleep30-21swapper/309:55:103
309602112,6sleep30-21swapper/309:48:123
309602112,6sleep30-21swapper/309:48:113
1859702112,5sleep30-21swapper/312:36:093
1674832112,5sleep30-21swapper/312:20:573
158622112,5sleep30-21swapper/309:30:023
1581312112,5sleep30-21swapper/312:11:053
1530872112,5sleep30-21swapper/312:06:043
147882112,5sleep30-21swapper/309:26:133
1326122112,5sleep30-21swapper/311:45:013
1326122112,5sleep30-21swapper/311:45:013
1180132112,5sleep30-21swapper/311:31:013
1170202112,5sleep30-21swapper/311:26:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional