You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 23:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon May 25, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2399412710,2sleep3471rcuc/307:45:463
202631997058,9cyclictest1704890-21systemd-journal12:00:011
202629996659,5cyclictest187803-21kworker/u8:1+flush-8:009:30:580
202635996359,3cyclictest377299-21kworker/u8:2+flush-8:010:01:012
3520692610,1sleep1352072-21kthreadcore09:35:501
202629995955,3cyclictest3559123-21kworker/u8:2+flush-8:007:15:050
202631995750,5cyclictest239073-21apt-get07:41:371
202631995745,9cyclictest407818-21apt-get10:35:011
202629995748,7cyclictest392021-21ntpq10:15:540
202629995649,5cyclictest478310-21kworker/u8:0+flush-8:012:15:530
202635995549,4cyclictest407851-21kworker/u8:1+flush-8:011:45:582
202629995446,6cyclictest1704890-21systemd-journal12:40:000
202635995248,3cyclictest392608-21kworker/u8:0+flush-8:010:26:012
202635995246,4cyclictest398149-21kworker/u8:3+flush-8:011:10:482
202631995225,18cyclictest264100-21sh08:09:591
202629995245,5cyclictest398149-21kworker/u8:3+flush-8:011:10:550
202629995241,8cyclictest248394-21ntpq07:50:550
202635995147,3cyclictest478310-21kworker/u8:0+flush-8:012:15:592
202635995147,3cyclictest377299-21kworker/u8:2+events_unbound10:30:542
202635995146,4cyclictest187803-21kworker/u8:1+flush-8:010:16:002
202629995145,4cyclictest249535-21kworker/u8:0+flush-8:008:05:590
202629995139,10cyclictest518411-21diskstats12:25:460
202635995045,4cyclictest328289-21kworker/u8:0+flush-8:009:45:562
202635995045,4cyclictest209703-21kworker/u8:3+events_unbound07:20:592
202629995043,5cyclictest323305-21sed09:06:020
202635994945,3cyclictest303661-21kworker/u8:2+flush-8:009:05:542
202629994943,4cyclictest462400-21kworker/u8:2+flush-8:012:10:560
202635994845,2cyclictest427510-21kworker/u8:0+events_unbound11:25:502
202635994844,3cyclictest398149-21kworker/u8:3+flush-8:010:36:022
202631994825,12cyclictest433855-21apt-get11:00:401
202629994842,4cyclictest462400-21kworker/u8:2+flush-8:011:30:500
202629994842,4cyclictest377299-21kworker/u8:2+flush-8:010:40:570
202631994737,7cyclictest372383-21ntpq09:56:001
202629994740,4cyclictest521015-21kworker/u8:3+events_unbound12:35:000
202635994641,4cyclictest187803-21kworker/u8:1+events_unbound08:10:552
202635994538,5cyclictest427510-21kworker/u8:0+events_unbound11:05:582
202631994535,6cyclictest1704890-21systemd-journal10:55:461
202631994532,10cyclictest1704890-21systemd-journal08:10:481
202631994527,15cyclictest388300-21apt-get10:15:411
202629994539,4cyclictest187803-21kworker/u8:1+flush-8:010:11:010
4041092440,3sleep375-21kworker/3:1+events10:30:493
202635994440,3cyclictest427510-21kworker/u8:0+events_unbound10:51:012
202631994433,8cyclictest1704890-21systemd-journal11:11:091
202629994440,3cyclictest427510-21kworker/u8:0+flush-8:010:55:570
202629994437,5cyclictest3559123-21kworker/u8:2+flush-8:007:30:550
202629994433,9cyclictest439067-21diskstats11:05:460
2022562444,35sleep00-21swapper/007:07:200
202635994339,3cyclictest462400-21kworker/u8:2+flush-8:011:36:012
202635994339,3cyclictest263386-21kworker/u8:3+flush-8:009:11:032
202635994339,3cyclictest187803-21kworker/u8:1+flush-8:007:50:542
202629994336,5cyclictest407851-21kworker/u8:1+flush-8:010:45:570
202629994335,6cyclictest478310-21kworker/u8:0+events_unbound12:00:560
202629994335,6cyclictest462400-21kworker/u8:2+events_unbound11:45:490
202629994333,8cyclictest223399-21ntpq07:25:560
202635994238,3cyclictest187803-21kworker/u8:1+flush-8:009:55:472
202635994237,4cyclictest392608-21kworker/u8:0+flush-8:010:20:452
202635994236,5cyclictest187803-21kworker/u8:1+flush-8:008:41:002
202635994233,7cyclictest1704890-21systemd-journal09:44:592
202631994233,6cyclictest1704890-21systemd-journal11:53:481
202629994235,5cyclictest462400-21kworker/u8:2+flush-8:012:20:470
202629994233,7cyclictest263386-21kworker/u8:3+flush-8:008:20:560
202631994129,8cyclictest1704890-21systemd-journal08:58:471
202631994115,16cyclictest0-21swapper/112:30:001
202629994136,3cyclictest328289-21kworker/u8:0+events_unbound09:20:480
202629994135,5cyclictest407851-21kworker/u8:1+flush-8:011:00:560
202629994135,5cyclictest328289-21kworker/u8:0+flush-8:009:35:520
202629994135,4cyclictest3559123-21kworker/u8:2+events_unbound07:20:540
202635994029,9cyclictest238473-21ntpq07:40:552
202631994028,10cyclictest250299-21irqrtprio07:55:511
202629994033,6cyclictest462400-21kworker/u8:2+flush-8:012:05:560
202631993929,7cyclictest1704890-21systemd-journal10:10:461
202631993926,10cyclictest1704890-21systemd-journal09:25:471
202629993934,4cyclictest407851-21kworker/u8:1+flush-8:011:16:000
202629993932,5cyclictest303661-21kworker/u8:2+events_unbound08:55:570
202635993834,3cyclictest478310-21kworker/u8:0+events_unbound12:00:012
20263199386,23cyclictest589-21runrttasks09:10:201
202631993810,14cyclictest418728-21apt-get10:45:421
202629993832,4cyclictest263386-21kworker/u8:3+events_unbound08:45:440
202629993832,4cyclictest263386-21kworker/u8:3+events_unbound08:45:430
202629993831,5cyclictest263386-21kworker/u8:3+flush-8:008:25:480
202635993733,3cyclictest478310-21kworker/u8:0+flush-8:012:10:462
202631993728,6cyclictest517475-21grep12:21:021
202631993727,6cyclictest1704890-21systemd-journal08:35:461
202631993725,10cyclictest443466-21cron11:10:001
20263199371,24cyclictest244170-21taskset07:48:191
202629993733,3cyclictest268414-21kworker/u8:0+flush-8:008:15:590
202629993732,4cyclictest187803-21kworker/u8:1+flush-8:008:40:450
202629993732,3cyclictest187803-21kworker/u8:1+events_unbound09:41:000
202629993731,4cyclictest407851-21kworker/u8:1+events_unbound10:50:490
202629993730,5cyclictest478310-21kworker/u8:0+flush-8:011:55:550
202629993729,6cyclictest473336-21latency_hist11:40:010
202631993624,9cyclictest0-21swapper/110:35:591
20263199361,20cyclictest398167-21runrttasks10:25:191
20263199361,19cyclictest523023-21runrttasks12:30:031
20263199361,19cyclictest473341-21munin-run11:40:001
20263199360,17cyclictest256922-21kthreadcore08:00:491
202629993632,3cyclictest398149-21kworker/u8:3+events_unbound11:20:530
202629993631,4cyclictest328289-21kworker/u8:0+events_unbound09:15:490
202629993631,4cyclictest303661-21kworker/u8:2+events_unbound09:10:490
202629993630,4cyclictest328289-21kworker/u8:0+flush-8:010:00:520
202629993630,4cyclictest328289-21kworker/u8:0+flush-8:009:25:570
202631993529,4cyclictest314088-21apt-get09:00:411
202631993524,9cyclictest354016-21cut09:40:461
20263199352,27cyclictest0-21swapper/112:10:411
202631993516,17cyclictest468041-21unixbench_singl11:30:591
202631993512,15cyclictest0-21swapper/110:43:491
20263199350,21cyclictest473904-21/usr/sbin/munin11:40:441
20263199350,20cyclictest233996-21taskset07:37:551
202629993531,3cyclictest263386-21kworker/u8:3+events_unbound08:35:400
202629993529,4cyclictest249535-21kworker/u8:0+events_unbound07:55:540
202629993527,6cyclictest1704890-21systemd-journal09:03:460
1978272354,10sleep10-21swapper/107:05:201
2310242340,2sleep3451irq_work/307:35:503
202635993429,3cyclictest1704890-21systemd-journal11:35:002
202631993429,3cyclictest448975-21fschecks_count11:15:451
20263199341,23cyclictest381417-21kthreadcore10:05:521
20263199341,20cyclictest283600-21runrttasks08:26:311
20263199341,19cyclictest396877-21taskset10:20:521
20263199340,19cyclictest362971-21runrttasks09:46:161
20263199340,19cyclictest303397-21runrttasks08:46:571
20263199340,19cyclictest303397-21runrttasks08:46:571
20263199340,19cyclictest278707-21runrttasks08:21:441
202629993430,3cyclictest462400-21kworker/u8:2+events_unbound11:26:000
202629993429,4cyclictest187803-21kworker/u8:1+flush-8:010:05:570
202629993429,3cyclictest377299-21kworker/u8:2+events_unbound10:20:560
202629993428,5cyclictest187803-21kworker/u8:1+events_unbound09:56:010
202629993427,5cyclictest209703-21kworker/u8:3+flush-8:007:40:580
202629993427,5cyclictest207556-21latency_hist07:15:010
202635993327,4cyclictest274692-21cut08:20:482
202631993322,9cyclictest347784-21mailstats09:30:591
20263199331,18cyclictest483034-21runrttasks11:47:211
20263199331,18cyclictest458538-21runrttasks11:25:311
20263199331,18cyclictest323431-21runrttasks09:07:111
20263199331,17cyclictest288610-21runrttasks08:32:291
20263199331,16cyclictest304409-21if_enp4s0.308:50:471
20263199330,30cyclictest497991-21sshd12:03:461
20263199330,17cyclictest364003-21if_enp4s009:50:491
202629993328,4cyclictest3559123-21kworker/u8:2+flush-8:008:00:520
202629993328,3cyclictest328289-21kworker/u8:0+events_unbound09:45:510
2023302334,9sleep20-21swapper/207:08:182
202635993223,7cyclictest234285-21cp07:40:002
20263199325,17cyclictest0-21swapper/112:17:191
202631993221,9cyclictest298095-21mailstats08:41:011
202631993221,9cyclictest0-21swapper/109:15:451
202631993211,9cyclictest0-21swapper/107:27:241
20263199320,19cyclictest219077-21runrttasks07:21:501
20263199320,19cyclictest204476-21cut07:10:501
202629993226,4cyclictest263386-21kworker/u8:3+events_unbound08:15:010
202635993126,4cyclictest462400-21kworker/u8:2+events_unbound11:45:002
202635993122,7cyclictest378410-21apt-get10:05:422
202631993126,3cyclictest528881-21irqcore12:35:491
202631993126,3cyclictest453906-21cut11:20:461
202631993120,9cyclictest187803-21kworker/u8:1-ext4-rsv-conversion09:25:001
202631993113,16cyclictest273110-21ntpq08:15:541
202629993124,5cyclictest462400-21kworker/u8:2+flush-8:011:40:540
202635993025,4cyclictest521015-21kworker/u8:3+events_unbound12:25:592
20263199306,16cyclictest0-21swapper/110:54:131
20263199304,17cyclictest0-21swapper/112:09:251
20263199302,12cyclictest0-21swapper/107:51:011
202629993025,4cyclictest209703-21kworker/u8:3+flush-8:007:46:010
202629993024,4cyclictest263386-21kworker/u8:3+flush-8:009:50:520
202635992925,3cyclictest258766-21unixbench_multi08:00:592
202635992923,4cyclictest493438-21apt-get12:00:412
202631992914,12cyclictest209418-21grep07:15:031
20263199290,16cyclictest225646-21kthreadcore07:30:511
202629992925,3cyclictest263386-21kworker/u8:3+events_unbound08:30:500
202635992824,2cyclictest289472-21fschecks_time08:35:462
202629992824,3cyclictest3559123-21kworker/u8:2+events_unbound07:36:010
202629992821,6cyclictest377299-21kworker/u8:2+flush-8:010:31:000
202629992821,5cyclictest187803-21kworker/u8:1+flush-8:008:50:560
20263599278,3cyclictest3861882cut10:10:522
202635992723,2cyclictest418490-21cat10:45:012
202635992723,2cyclictest269604-21tr08:15:452
202629992716,9cyclictest0-21swapper/010:40:010
202635992621,4cyclictest457858-21unixbench_multi11:21:012
202635992621,3cyclictest304262-21fschecks_time08:50:452
202635992621,3cyclictest259838-21fschecks_time08:05:462
20263199261,20cyclictest373484-21apt-get10:00:441
202629992620,4cyclictest478310-21kworker/u8:0+flush-8:011:50:540
202629992619,5cyclictest392608-21kworker/u8:0+events_unbound10:30:010
202635992522,2cyclictest315021-21kthreadcore09:00:502
4296682240,3sleep375-21kworker/3:1+events10:55:503
202635992419,3cyclictest313924-21latency_hist09:00:022
20263599232,20cyclictest0-21swapper/207:16:002
202635992319,2cyclictest419042-21fschecks_time10:45:452
20263599222,15cyclictest437692-21ntpq11:00:542
202635992218,2cyclictest363659-21aten2_r5power_p09:50:452
202635992218,2cyclictest339749-21kthreadcore09:25:522
20263599220,11cyclictest4296722sed10:55:502
3540132210,2chrt75-21kworker/3:1-events09:40:463
20263599212,4cyclictest0-21swapper/209:15:472
20263599212,2cyclictest0-21swapper/209:20:482
202635992117,3cyclictest299064-21aten2_r5power_c08:45:432
202635992117,3cyclictest299064-21aten2_r5power_c08:45:432
202635992016,2cyclictest0-21swapper/207:45:532
20263599192,13cyclictest347674-21ntpq09:30:582
20263599192,12cyclictest224571-21apt-get07:30:432
202635991916,2cyclictest249634-21aten2_r5power_e07:55:452
202635991915,3cyclictest3559123-21kworker/u8:2+flush-8:007:10:082
20263599191,3cyclictest161rcu_preempt07:25:502
20263599190,5cyclictest488256-21sed11:55:002
2022292194,9sleep30-21swapper/307:06:573
202635991815,2cyclictest0-21swapper/212:35:012
202635991814,2cyclictest531977-21tr12:35:522
202635991810,6cyclictest517849-21cron12:24:592
20263599178,7cyclictest500855-21tr12:05:512
20263599170,2cyclictest161rcu_preempt11:16:012
20263599168,6cyclictest352382-21sed09:35:512
20263599167,7cyclictest288717-21seq08:33:502
3784082152,8sleep30-21swapper/310:05:433
3349392155,5sleep30-21swapper/309:20:533
202635991512,2cyclictest279383-21aten2_r5power_v08:25:422
4706342143,7sleep30-21swapper/311:35:503
2951232140,2sleep3471rcuc/308:40:513
5279862132,6sleep30-21swapper/312:35:023
4743142130,3sleep375-21kworker/3:1+mm_percpu_wq11:40:483
4224662132,7sleep30-21swapper/310:45:553
3634402132,6sleep30-21swapper/309:50:023
3385962132,6sleep30-21swapper/309:25:013
2242872132,6sleep30-21swapper/307:30:023
2217462131,7sleep30-21swapper/307:25:533
5234792122,6sleep30-21swapper/312:30:493
5227822120,8sleep30-21swapper/312:30:003
5082472122,6sleep30-21swapper/312:15:443
5030342122,6sleep30-21swapper/312:10:023
4788382122,6sleep30-21swapper/311:45:463
4633142122,5sleep30-21swapper/311:30:013
4624362122,6sleep30-21swapper/311:26:003
4535652122,5sleep30-21swapper/311:20:013
4473462122,6sleep30-21swapper/311:10:553
4385362122,5sleep30-21swapper/311:05:023
4130452122,5sleep30-21swapper/310:40:023
3891572122,6sleep30-21swapper/310:15:493
3833692122,6sleep30-21swapper/310:10:443
3726642122,7sleep30-21swapper/309:56:043
3591342122,6sleep30-21swapper/309:45:493
3442202122,6sleep30-21swapper/309:30:483
3194052122,6sleep30-21swapper/309:05:483
3183402122,6sleep30-21swapper/309:01:033
2902982121,7sleep30-21swapper/308:35:513
2634632122,6sleep30-21swapper/308:06:013
2492962122,5sleep30-21swapper/307:55:023
2093702122,6sleep30-21swapper/307:15:053
2032812122,6sleep30-21swapper/307:10:483
5172362112,5sleep30-21swapper/312:21:013
4983692112,6sleep30-21swapper/312:05:413
4938172112,5sleep30-21swapper/312:00:473
4887432112,5sleep30-21swapper/311:55:453
4881952112,6sleep30-21swapper/311:55:003
4526882112,5sleep30-21swapper/311:16:013
4340162112,6sleep30-21swapper/311:00:443
4283572112,5sleep30-21swapper/310:52:383
4082742112,5sleep30-21swapper/310:35:043
3982252112,5sleep30-21swapper/310:25:453
3937122112,5sleep30-21swapper/310:20:483
3731992112,5sleep30-21swapper/310:00:013
3291512111,6sleep30-21swapper/309:15:473
3279672112,5sleep30-21swapper/309:11:013
3093052112,5sleep30-21swapper/308:55:493
3039472112,5sleep30-21swapper/308:50:433
2992832112,5sleep30-21swapper/308:45:463
2992832112,5sleep30-21swapper/308:45:463
2887762112,5sleep30-21swapper/308:34:383
2795062112,5sleep30-21swapper/308:25:423
2740602112,5sleep30-21swapper/308:20:023
2693852112,5sleep30-21swapper/308:15:443
2643202112,5sleep30-21swapper/308:10:023
2547682110,7sleep30-21swapper/308:00:443
2474612112,6sleep30-21swapper/307:50:533
2352372112,5sleep30-21swapper/307:40:493
2156322112,5sleep30-21swapper/307:20:503
3490162102,4sleep30-21swapper/309:35:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional