You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 22:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu May 28, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
378973621820,2sleep3481ktimers/307:26:003
406134121090,3sleep375-21kworker/3:1-events12:00:473
3768592996861,5cyclictest3768448-21kworker/u8:2+flush-8:009:15:561
3768592996760,6cyclictest3820180-21kworker/u8:0+flush-8:008:00:581
3768592996660,5cyclictest3860185-21kworker/u8:1+flush-8:010:20:001
3768592996558,5cyclictest3835238-21kworker/u8:3+flush-8:008:15:571
3768592996457,5cyclictest3949181-21kworker/u8:2+flush-8:011:20:531
3768592996358,4cyclictest3914275-21kworker/u8:2+events_unbound09:40:511
3768592996258,3cyclictest4043662-21kworker/u8:1+events_unbound12:35:541
3768592996257,3cyclictest3860185-21kworker/u8:1+flush-8:010:10:571
3768592996156,4cyclictest3768448-21kworker/u8:2+flush-8:007:55:561
3768592996156,4cyclictest3410608-21kworker/u8:0+flush-8:007:10:561
3768592996055,4cyclictest4043662-21kworker/u8:1+flush-8:011:45:541
3768592996054,5cyclictest3768448-21kworker/u8:2+flush-8:009:20:511
3768592995953,5cyclictest4043662-21kworker/u8:1+flush-8:012:25:571
3768592995952,5cyclictest3949181-21kworker/u8:2+flush-8:011:00:551
3768592995853,4cyclictest4043662-21kworker/u8:1+flush-8:012:30:571
3768592995853,4cyclictest3983490-21kworker/u8:0+events_unbound11:35:511
3768592995853,3cyclictest3860185-21kworker/u8:1+events_unbound09:30:421
3768592995852,5cyclictest3909310-21kworker/u8:3+events_unbound11:30:541
3768592995651,4cyclictest3983490-21kworker/u8:0+flush-8:012:20:551
3768592995651,3cyclictest3909310-21kworker/u8:3+flush-8:009:35:571
3768592995650,4cyclictest3730869-21kworker/u8:1+events_unbound07:20:431
3768592995647,7cyclictest3948574-21ntpq10:05:521
38041052550,3chrt75-21kworker/3:1-events07:40:483
3768592995551,3cyclictest4043662-21kworker/u8:1+events_unbound12:05:411
3768589995545,7cyclictest4053715-21latency_hist11:55:010
3768592995449,4cyclictest3815001-21kworker/u8:1+events_unbound08:10:541
3768592995448,4cyclictest3949181-21kworker/u8:2+events_unbound10:30:451
3768592995447,5cyclictest3909310-21kworker/u8:3+flush-8:009:55:571
3768592995447,5cyclictest3795391-21kworker/u8:3+events_unbound07:40:481
3768592995348,4cyclictest3820180-21kworker/u8:0+events_unbound08:05:561
3768592995347,5cyclictest3860185-21kworker/u8:1+events_unbound09:45:561
3768592995347,5cyclictest3410608-21kworker/u8:0+events_unbound07:15:031
3768592995247,4cyclictest3983490-21kworker/u8:0+flush-8:012:15:571
3768592995246,4cyclictest3768448-21kworker/u8:2+events_unbound08:35:421
3768592995246,4cyclictest3768448-21kworker/u8:2+events_unbound08:35:421
3768589995247,4cyclictest3899751-21kworker/u8:0+flush-8:009:30:560
3768592995147,3cyclictest3860185-21kworker/u8:1+events_unbound10:20:431
3768592995146,4cyclictest3768448-21kworker/u8:2+events_unbound07:50:461
3768592995146,3cyclictest3835238-21kworker/u8:3+events_unbound08:45:451
3768592995145,5cyclictest3949181-21kworker/u8:2+events_unbound10:55:531
3768592995144,5cyclictest3949181-21kworker/u8:2+events_unbound11:40:421
3768589995140,8cyclictest3878855-21ntpq08:55:540
39530592500,5sleep3451irq_work/310:10:483
3768589995041,7cyclictest3989530-21/usr/sbin/munin10:50:560
3768589995041,7cyclictest3989530-21/usr/sbin/munin10:50:560
3768592994944,3cyclictest3909310-21kworker/u8:3+flush-8:010:35:521
3768592994943,5cyclictest3835238-21kworker/u8:3+events_unbound08:50:481
3768589994942,5cyclictest1704890-21systemd-journal10:00:500
3768592994843,4cyclictest3860185-21kworker/u8:1+events_unbound09:05:481
3768592994842,4cyclictest3835238-21kworker/u8:3+flush-8:008:20:421
3768592994841,5cyclictest3768448-21kworker/u8:2+flush-8:009:10:531
3768592994742,4cyclictest3949181-21kworker/u8:2+flush-8:010:25:471
3768592994742,4cyclictest3860185-21kworker/u8:1+flush-8:010:45:001
3768592994742,3cyclictest3949181-21kworker/u8:2+events_unbound11:15:591
3768592994740,5cyclictest3874777-21kworker/u8:0+flush-8:009:00:531
3768589994737,8cyclictest1704890-21systemd-journal09:10:010
3768592994642,3cyclictest3949181-21kworker/u8:2+events_unbound11:30:011
3768592994641,4cyclictest3768448-21kworker/u8:2+flush-8:008:40:551
3768589994632,10cyclictest1704890-21systemd-journal07:15:500
3768594994537,6cyclictest4043628-21apt-get11:45:002
3768592994540,4cyclictest4043662-21kworker/u8:1+events_unbound11:55:511
3768589994541,3cyclictest3410608-21kworker/u8:0+events_unbound07:10:400
40521712440,2sleep30-21swapper/311:50:473
3768592994439,4cyclictest3909310-21kworker/u8:3+flush-8:011:10:571
3768592994439,4cyclictest3768448-21kworker/u8:2+flush-8:009:25:581
3768592994438,4cyclictest3949181-21kworker/u8:2+events_unbound11:05:461
3768589994433,8cyclictest4008168-21ntpq11:05:520
3768589994338,4cyclictest3909310-21kworker/u8:3+flush-8:011:30:560
3768589994338,4cyclictest3768448-21kworker/u8:2+flush-8:009:20:570
3768589994337,4cyclictest3835238-21kworker/u8:3+events_unbound08:15:560
3768594994235,5cyclictest4068576-21apt-get12:10:032
3768592994239,2cyclictest3835238-21kworker/u8:3+flush-8:008:25:581
3768592994238,3cyclictest4043662-21kworker/u8:1+flush-8:011:50:561
3768592994235,5cyclictest3914275-21kworker/u8:2+flush-8:009:50:451
3768592994232,8cyclictest4062720-21ntpq12:00:491
3768589994238,3cyclictest3949181-21kworker/u8:2+flush-8:011:20:570
40494692410,5sleep20-21swapper/211:50:432
3768592994135,4cyclictest3983490-21kworker/u8:0+flush-8:010:50:471
3768592994135,4cyclictest3983490-21kworker/u8:0+flush-8:010:50:471
3768589994137,3cyclictest4043662-21kworker/u8:1+flush-8:012:35:550
3768589994135,4cyclictest3795391-21kworker/u8:3+events_unbound07:50:510
3768589994134,6cyclictest3835238-21kworker/u8:3+events_unbound08:25:530
3768589994132,7cyclictest3874758-21latency_hist08:55:020
3768592994036,3cyclictest3934438-21kworker/u8:0+flush-8:010:00:571
3768592994035,4cyclictest3768448-21kworker/u8:2+flush-8:008:30:491
3768592994035,4cyclictest3768448-21kworker/u8:2+flush-8:008:30:491
3768589994034,5cyclictest3768448-21kworker/u8:2+flush-8:008:35:550
3768589994034,5cyclictest3768448-21kworker/u8:2+flush-8:008:35:540
3768589994034,4cyclictest3983490-21kworker/u8:0+events_unbound12:20:520
3768589993929,7cyclictest1704890-21systemd-journal09:20:010
3768592993831,5cyclictest4043662-21kworker/u8:1+events_unbound12:10:011
3768589993833,3cyclictest3914275-21kworker/u8:2+events_unbound09:50:440
3768589993832,4cyclictest3949181-21kworker/u8:2+events_unbound10:25:410
40927382370,2sleep3481ktimers/312:30:573
3768589993632,3cyclictest3768448-21kworker/u8:2+events_unbound09:10:550
3768594993529,4cyclictest3884693-21gpgv09:05:012
3768594993525,8cyclictest1704890-21systemd-journal07:52:502
3768592993528,5cyclictest3810038-21latency_hist07:50:011
3768592993525,8cyclictest3984575-21/usr/sbin/munin10:45:521
3768589993530,3cyclictest1704890-21systemd-journal11:40:490
3768589993528,5cyclictest3835238-21kworker/u8:3+flush-8:008:45:510
3768589993525,7cyclictest3835006-21latency_hist08:15:010
3768589993524,9cyclictest3794263-21ntpq07:30:520
376819123521,9sleep10-21swapper/107:07:131
38967682340,2sleep3481ktimers/309:15:473
3768594993426,5cyclictest1704890-21systemd-journal08:20:002
3768592993427,5cyclictest3789834-21grep07:25:591
3768589993430,3cyclictest3860185-21kworker/u8:1+flush-8:010:20:590
3768589993428,4cyclictest3983490-21kworker/u8:0+flush-8:011:55:570
3768589993427,5cyclictest1704890-21systemd-journal12:31:000
3768589993424,8cyclictest3804187-21ntpq07:40:490
3768589993328,4cyclictest3820180-21kworker/u8:0+events_unbound08:05:540
3768589993328,4cyclictest3768448-21kworker/u8:2+flush-8:007:35:550
3768592993228,3cyclictest3874777-21kworker/u8:0+events_unbound08:55:511
3768592993228,2cyclictest3794180-21needreboot07:30:501
3768589993229,2cyclictest3983490-21kworker/u8:0+events_unbound12:05:580
3768589993228,3cyclictest3909310-21kworker/u8:3+events_unbound09:35:570
3768589993227,4cyclictest3909310-21kworker/u8:3+flush-8:011:10:430
3768589993222,3cyclictest3949181-21kworker/u8:2+events_unbound10:40:580
3768589993127,3cyclictest3860185-21kworker/u8:1+flush-8:009:45:590
3768589993127,3cyclictest3860185-21kworker/u8:1+events_unbound10:10:420
3768589993126,4cyclictest3410608-21kworker/u8:0+flush-8:007:25:590
3768592993017,9cyclictest1704890-21systemd-journal07:38:501
3768589993026,3cyclictest4043662-21kworker/u8:1+events_unbound12:10:530
3768589993026,3cyclictest3983490-21kworker/u8:0+flush-8:011:35:510
3768589993025,4cyclictest3983490-21kworker/u8:0+events_unbound11:45:510
3768589993024,4cyclictest3768448-21kworker/u8:2+flush-8:009:25:430
3768594992924,3cyclictest3958960-21unixbench_multi10:15:572
3768589992924,4cyclictest4043662-21kworker/u8:1+flush-8:012:25:490
3768589992924,4cyclictest3914275-21kworker/u8:2+events_unbound09:40:530
3768589992924,4cyclictest3410608-21kworker/u8:0+flush-8:007:21:200
3768589992924,3cyclictest3820180-21kworker/u8:0+events_unbound08:01:010
3768594992822,4cyclictest3949181-21kworker/u8:2+flush-8:011:15:552
3768589992824,3cyclictest3806124-21cut07:45:470
3768589992820,6cyclictest3768448-21kworker/u8:2+flush-8:008:40:530
3768589992819,6cyclictest3999154-21latency_hist11:00:010
3768589992817,9cyclictest3815523-21diskstats07:55:430
3768594992723,3cyclictest3915149-21fschecks_count09:35:442
3768594992718,7cyclictest3979123-21apt-get10:40:002
3768589992723,3cyclictest3949181-21kworker/u8:2+events_unbound11:25:500
3768589992722,3cyclictest3954969-21cpuspeed_turbos10:15:410
37674742276,13sleep03767520-21ntpq07:05:500
376859499269,8cyclictest0-21swapper/209:45:482
376859499264,6cyclictest3779495-21ntpq07:15:542
3768594992623,2cyclictest3979977-21fschecks_time10:40:422
3768594992622,3cyclictest3994602-21aten2_r5power_v10:55:412
3768594992621,3cyclictest4088162-21unixbench_multi12:25:592
3768594992621,3cyclictest4009624-21fschecks_count11:10:432
376859499260,8cyclictest3874760-21munin-plugin-st08:55:002
3768589992622,3cyclictest3909310-21kworker/u8:3+flush-8:009:55:540
3768589992621,3cyclictest3983490-21kworker/u8:0+events_unbound12:15:450
3768589992620,4cyclictest3909310-21kworker/u8:3+events_unbound10:35:450
3768589992619,5cyclictest4043662-21kworker/u8:1+flush-8:012:00:510
376859499258,3cyclictest37963702kthreadcore07:35:482
3768594992522,2cyclictest3820539-21fschecks_count08:00:442
3768594992521,3cyclictest3780889-21cpuspeed_turbos07:20:422
3768594992515,2cyclictest161rcu_preempt10:49:592
376859499250,15cyclictest3832781-21cut08:10:482
3768589992523,1cyclictest3835238-21kworker/u8:3+events_unbound08:30:510
3768589992523,1cyclictest3835238-21kworker/u8:3+events_unbound08:30:510
3768589992521,3cyclictest3949181-21kworker/u8:2+flush-8:010:30:510
3768589992521,3cyclictest3884802-21latency_hist09:05:000
38116082240,2sleep3471rcuc/307:50:483
376859499240,8cyclictest1-21systemd09:10:012
376859499240,14cyclictest3908644-21sed09:25:512
376859499233,6cyclictest39-21ksoftirqd/211:25:012
376859499232,5cyclictest0-21swapper/211:35:542
376859499232,4cyclictest0-21swapper/211:48:492
3768594992320,2cyclictest3989905-21fschecks_time10:50:432
3768594992320,2cyclictest3989905-21fschecks_time10:50:432
3768594992320,2cyclictest371rcuc/209:12:132
376859499231,12cyclictest3849976-21sed08:30:012
376859499230,13cyclictest3961291-21cut10:20:482
376859499230,11cyclictest3815707-21awk07:55:442
3768589992317,4cyclictest3843723-21kthreadcore08:20:490
376859499222,9cyclictest0-21swapper/207:25:472
3768594992219,2cyclictest3964663-21aten2_r5power_c10:25:412
3768594992219,2cyclictest3860107-21grep08:40:012
3768594992219,2cyclictest3860107-21grep08:40:002
3768594992219,2cyclictest371rcuc/211:31:572
3768594992219,2cyclictest371rcuc/207:48:112
3768589992216,4cyclictest3983490-21kworker/u8:0+events_unbound10:45:450
376858999220,21cyclictest3949386-21sshd10:08:500
376859499217,2cyclictest161rcu_preempt11:25:422
376859499212,4cyclictest0-21swapper/212:40:002
376859499212,4cyclictest0-21swapper/208:20:582
376859499212,4cyclictest0-21swapper/207:40:502
3768594992118,2cyclictest371rcuc/209:44:392
3768594992117,3cyclictest4059288-21tune2fs12:00:422
3768594992117,2cyclictest371rcuc/208:30:572
3768594992117,2cyclictest371rcuc/208:30:562
3768594992116,4cyclictest3866657-21kthreadcore08:45:482
3768594992116,3cyclictest3933266-21kthreadcore09:50:512
3768594992115,4cyclictest4068838-21gpgv12:10:012
376859499210,5cyclictest3790539-21apt-get07:30:402
3768589992117,3cyclictest3949181-21kworker/u8:2+flush-8:011:02:060
3768589992117,2cyclictest0-21swapper/011:15:590
376859499209,2cyclictest161rcu_preempt12:15:522
376859499205,3cyclictest161rcu_preempt10:10:002
376859499204,5cyclictest0-21swapper/207:10:432
376859499202,5cyclictest0-21swapper/209:15:462
3768594992017,2cyclictest3939900-21cpuspeed_turbos10:00:412
3768594992017,1cyclictest0-21swapper/208:45:002
3768594992016,3cyclictest4089068-21cpuspeed12:30:432
376859499201,10cyclictest39-21ksoftirqd/208:55:422
376859499200,5cyclictest3824887-21apt-get08:05:022
376859499200,10cyclictest4082664-21sed12:20:492
376859499197,2cyclictest161rcu_preempt09:20:572
376859499195,2cyclictest161rcu_preempt11:01:452
376859499192,8cyclictest0-21swapper/210:30:492
3768594991916,2cyclictest371rcuc/209:55:312
37642652194,9sleep20-21swapper/207:05:452
3768594991815,2cyclictest371rcuc/211:55:252
376859499181,4cyclictest0-21swapper/210:10:042
37635732182,8sleep30-21swapper/307:05:023
376859499172,7cyclictest0-21swapper/209:30:522
3768594991714,2cyclictest371rcuc/211:06:502
40232392155,6sleep30-21swapper/311:20:593
39650062144,6sleep30-21swapper/310:25:463
40288832132,6sleep30-21swapper/311:30:023
37734622132,5sleep30-21swapper/307:15:013
40882192122,6sleep30-21swapper/312:26:003
40762272122,6sleep30-21swapper/312:15:493
40733162122,6sleep30-21swapper/312:10:593
40636392122,5sleep30-21swapper/312:05:003
40573812122,6sleep30-21swapper/311:55:503
40478072122,6sleep30-21swapper/311:45:513
40390152122,6sleep30-21swapper/311:40:423
40255382122,6sleep30-21swapper/311:25:493
40167032122,6sleep30-21swapper/311:15:493
40093382122,6sleep30-21swapper/311:10:403
40041342122,6sleep30-21swapper/311:05:023
39983572122,6sleep30-21swapper/310:55:553
39928092122,6sleep30-21swapper/310:50:503
39928092122,6sleep30-21swapper/310:50:493
39846042122,6sleep30-21swapper/310:45:403
39833792122,6sleep30-21swapper/310:40:513
39489012122,6sleep30-21swapper/310:06:003
39394132122,5sleep30-21swapper/310:00:013
39146102122,5sleep30-21swapper/309:35:023
39138202122,6sleep30-21swapper/309:30:563
38898572122,5sleep30-21swapper/309:10:013
38860982122,6sleep30-21swapper/309:05:483
38356902122,6sleep30-21swapper/308:15:443
38202242122,6sleep30-21swapper/308:00:393
38190952122,6sleep30-21swapper/307:55:543
37992082122,6sleep30-21swapper/307:35:523
37903542122,5sleep30-21swapper/307:30:013
40938202112,5sleep30-21swapper/312:35:393
40789482112,5sleep30-21swapper/312:20:013
40339852113,5sleep30-21swapper/311:35:243
39994722112,5sleep30-21swapper/311:00:403
39747532112,5sleep30-21swapper/310:35:443
39699202112,5sleep30-21swapper/310:30:433
39606282112,5sleep30-21swapper/310:20:483
39546702112,5sleep30-21swapper/310:15:013
39384232112,5sleep30-21swapper/309:55:523
39297542113,5sleep30-21swapper/309:50:433
39252112112,5sleep30-21swapper/309:45:443
39201452112,5sleep30-21swapper/309:40:443
39095122112,6sleep30-21swapper/309:28:433
39016152113,5sleep30-21swapper/309:20:493
38799552112,5sleep30-21swapper/309:00:033
38750622112,5sleep30-21swapper/308:55:403
38732422112,6sleep30-21swapper/308:50:523
38651772112,5sleep30-21swapper/308:45:343
38602082112,5sleep30-21swapper/308:40:243
38557882112,5sleep30-21swapper/308:35:473
38557882112,5sleep30-21swapper/308:35:473
38498732112,5sleep30-21swapper/308:30:013
38498732112,5sleep30-21swapper/308:30:003
38451802112,5sleep30-21swapper/308:25:283
38403582112,5sleep30-21swapper/308:20:423
38303462112,5sleep30-21swapper/308:10:393
38249022111,5sleep30-21swapper/308:05:013
38094152112,5sleep30-21swapper/307:45:583
37842622112,5sleep30-21swapper/307:20:513
37756962112,5sleep30-21swapper/307:15:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional