You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 08:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Aug 21, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5913721000,2chrt575-21kworker/3:2+events23:22:463
41630752740,2sleep3471rcuc/321:52:453
41351922640,4chrt0-21swapper/121:22:541
3999803996140,18cyclictest4070987-21awk20:20:002
3999800996151,7cyclictest4185534-21latency_hist22:15:011
3999800995749,5cyclictest4070977-21latency_hist20:20:011
3999800995443,8cyclictest275-21systemd-journal00:20:001
3999796995448,4cyclictest3999516-21kworker/u8:1+flush-8:019:20:000
3999803995332,19cyclictest4145710-21awk21:35:002
3999800995141,8cyclictest4090777-21latency_hist20:40:011
3999803995041,7cyclictest36106-21apt-get23:00:002
3999803995041,7cyclictest36106-21apt-get23:00:002
3999796995045,4cyclictest2667878-21kworker/u8:3+flush-8:020:07:530
3999796994539,5cyclictest90304-21kworker/u8:0+events_unbound00:27:440
3999796994539,5cyclictest90304-21kworker/u8:0+events_unbound00:27:440
3999800994438,4cyclictest4007126-21apt-get19:17:351
3999796994436,6cyclictest4051607-21/usr/sbin/munin20:02:540
3999796994237,4cyclictest4080887-21kworker/u8:1+flush-8:020:57:400
3999803994124,14cyclictest131455-21aten2_r5power_e00:37:382
3999796994135,4cyclictest4091253-21kworker/u8:2+flush-8:020:42:400
3999796994133,6cyclictest4036770-21/usr/sbin/munin19:47:470
3999796994031,6cyclictest20621-21ntpq22:42:510
3999803993925,12cyclictest25951-21unixbench_multi22:47:552
3999800993933,4cyclictest4096240-21kworker/u8:0+flush-8:021:32:551
3999796993930,7cyclictest2667878-21kworker/u8:3+flush-8:020:37:560
3999796993929,8cyclictest4135067-21ntpq21:22:500
3999803993820,16cyclictest275-21systemd-journal23:53:192
3999800993833,4cyclictest90304-21kworker/u8:0+flush-8:000:27:451
3999800993833,4cyclictest90304-21kworker/u8:0+flush-8:000:27:451
3999800993831,4cyclictest4041730-21apt-get19:52:351
3999796993834,3cyclictest4096240-21kworker/u8:0+flush-8:021:52:540
3999796993834,3cyclictest36588-21kworker/u8:1+flush-8:023:02:520
3999796993833,3cyclictest4145535-21kworker/u8:2+flush-8:021:42:580
3999796993829,6cyclictest4135638-21kworker/u8:3+flush-8:023:22:530
3999803993731,4cyclictest120867-21gpgv00:25:002
3999803993723,12cyclictest4190437-21cron22:20:002
3999796993729,6cyclictest275-21systemd-journal20:49:420
3999803993629,5cyclictest275-21systemd-journal20:43:192
3999800993631,4cyclictest4080887-21kworker/u8:1+flush-8:020:47:441
3999796993631,4cyclictest4135638-21kworker/u8:3+flush-8:022:17:540
3999796993631,4cyclictest4091253-21kworker/u8:2+flush-8:021:02:460
3999796993630,4cyclictest4080887-21kworker/u8:1+events_unbound20:52:400
3999796993627,6cyclictest4021503-21latency_hist19:30:000
3999796993627,6cyclictest4021503-21latency_hist19:30:000
3999803993521,12cyclictest61848-21aten2_r5power_p23:27:382
3999803993511,11cyclictest0-21swapper/221:27:492
3999800993528,6cyclictest2667878-21kworker/u8:3+flush-8:019:32:551
3999800993526,7cyclictest120143-21ntpq00:22:521
3999796993531,3cyclictest4056349-21kworker/u8:0+flush-8:020:32:520
3999796993530,4cyclictest4096240-21kworker/u8:0+flush-8:021:27:400
3999796993528,5cyclictest4066037-21latency_hist20:15:010
3999796993528,5cyclictest101218-21kworker/u8:3+flush-8:000:35:000
3999796993526,7cyclictest4166441-21diskstats21:57:400
3999796993525,8cyclictest90276-21ntpq23:52:490
39994302353,9sleep10-21swapper/119:09:401
41318892340,6sleep3451irq_work/321:22:443
3999800993425,7cyclictest4085123-21ntpq20:32:491
3999796993430,3cyclictest4135638-21kworker/u8:3+flush-8:022:52:470
3999796993430,3cyclictest4135638-21kworker/u8:3+flush-8:022:52:470
3999796993424,9cyclictest4070979-21munin-plugin-st20:20:000
33642340,2sleep0201rcuc/022:27:460
399980399332,26cyclictest4077268-21ps20:27:432
399980399332,23cyclictest4176082-21apt-get22:07:362
399980399331,29cyclictest20660-21/usr/sbin/munin22:42:522
3999800993328,3cyclictest57318-21irqrtprio23:22:441
3999800993324,7cyclictest4120312-21ntpq21:07:501
3999800993324,7cyclictest4120312-21ntpq21:07:501
3999800993323,8cyclictest4030658-21ntpq19:37:471
3999796993330,1cyclictest51186-21latency_hist23:15:010
3999796993330,1cyclictest4096240-21kworker/u8:0+flush-8:021:33:010
3999796993329,3cyclictest4056349-21kworker/u8:0+flush-8:020:22:520
3999796993327,4cyclictest4056349-21kworker/u8:0+flush-8:020:27:450
3999796993327,4cyclictest36588-21kworker/u8:1+flush-8:023:27:550
3999796993327,4cyclictest101218-21kworker/u8:3+flush-8:000:22:460
3999796993325,6cyclictest4121743-21fschecks_time21:12:400
3999796993323,7cyclictest275-21systemd-journal19:35:000
399980399324,22cyclictest4126368-21apt-get21:17:362
3999803993215,15cyclictest4085594-21unixbench_multi20:32:552
399980399321,23cyclictest4031884-21apt-get19:42:342
3999800993226,4cyclictest90304-21kworker/u8:0+flush-8:023:52:551
3999800993224,6cyclictest45517-21ntpq23:07:501
3999796993227,3cyclictest4146866-21irqrtprio21:37:440
3999796993225,5cyclictest4156583-21grep21:47:400
3999796993224,6cyclictest26213-21latency_hist22:50:000
399979699320,29cyclictest56172-21munin-run23:20:010
399980399313,20cyclictest4101363-21apt-get20:52:372
3999803993116,12cyclictest108556-21kthreadcore00:12:482
3999803993111,18cyclictest4150778-21cp21:40:012
399980399310,26cyclictest4150662-21apt-get21:40:032
3999796993125,4cyclictest4025960-21kworker/u8:0+events_unbound19:37:410
3999796993124,4cyclictest4096240-21kworker/u8:0+flush-8:021:17:430
3999796993123,6cyclictest4000190-21munin-node19:12:360
3999803993026,2cyclictest4007212-21aten2_r5power_p19:17:372
399980399302,21cyclictest4181028-21apt-get22:12:382
3999803993018,10cyclictest46946-21fschecks_count23:12:402
3999803993014,14cyclictest275-21systemd-journal23:23:192
399980399300,28cyclictest4170723-21seq22:00:012
3999800993026,2cyclictest35311-21needreboot22:57:471
3999800993026,2cyclictest35311-21needreboot22:57:471
3999800993025,3cyclictest4091253-21kworker/u8:2+flush-8:021:02:451
3999800993024,4cyclictest4000215-21apt-get19:12:361
3999800993024,4cyclictest2667878-21kworker/u8:3+flush-8:020:07:461
3999800993021,6cyclictest76218-21latency_hist23:40:011
3999800993020,8cyclictest80448-21ntpq23:42:521
3999800993020,8cyclictest275-21systemd-journal00:00:001
3999796993025,4cyclictest4175652-21kworker/u8:1+flush-8:022:32:440
3999796993025,4cyclictest4135638-21kworker/u8:3+flush-8:022:07:540
3999796993025,3cyclictest101218-21kworker/u8:3+flush-8:000:37:460
3999796993024,4cyclictest71487-21kworker/u8:3+events_unbound23:50:000
3999796993024,4cyclictest4096240-21kworker/u8:0+events_unbound22:02:420
3999796993024,4cyclictest1675-21kworker/u8:2+flush-8:023:07:530
399979699302,26cyclictest4165766-21kworker/0:2+events23:57:340
3999796993017,9cyclictest36321-21base6423:00:000
3999796993017,9cyclictest36321-21base6423:00:000
399980399293,20cyclictest4056568-21apt-get20:07:382
3999803992924,3cyclictest2245-21fschecks_time22:27:412
3999803992915,12cyclictest4175367-21unixbench_multi22:02:552
3999803992914,13cyclictest0-21swapper/221:50:002
399980399290,25cyclictest91656-21/usr/sbin/munin23:57:412
399980399290,24cyclictest3999471-21apt-get19:10:032
3999800992926,2cyclictest4125915-21turbostat.cron21:15:001
3999800992925,3cyclictest401-21dbus-daemon21:30:011
3999800992924,4cyclictest36588-21kworker/u8:1+flush-8:000:37:391
3999800992924,3cyclictest38969-21kthreadcore23:02:441
3999800992923,5cyclictest2667878-21kworker/u8:3+flush-8:019:47:391
3999800992923,4cyclictest275-21systemd-journal22:18:191
3999800992922,5cyclictest61739-21/usr/sbin/munin23:27:471
3999796992925,2cyclictest115870-21ls00:20:000
3999796992925,2cyclictest106910-21irqcore00:12:450
3999796992923,4cyclictest90304-21kworker/u8:0+events_unbound00:07:390
3999796992922,5cyclictest36588-21kworker/u8:1+events_unbound00:02:540
3999796992921,6cyclictest71487-21kworker/u8:3+flush-8:023:37:430
39948332294,19sleep00-21swapper/019:05:130
399980399282,22cyclictest4045526-21ntpq19:52:502
399980399281,24cyclictest70640-21/usr/sbin/munin23:32:512
399980399281,23cyclictest4111619-21/usr/sbin/munin21:02:382
399980399280,24cyclictest96444-21/usr/sbin/munin00:02:372
3999800992825,2cyclictest4148320-21kthreadcore21:37:471
3999800992823,4cyclictest4135638-21kworker/u8:3+events_unbound23:20:011
3999800992822,5cyclictest4096240-21kworker/u8:0+flush-8:022:02:401
3999800992822,4cyclictest2667878-21kworker/u8:3+events_unbound19:57:431
3999800992819,5cyclictest4150698-21http21:40:011
3999796992823,4cyclictest2605377-21kworker/u8:2+flush-8:019:55:500
3999796992821,5cyclictest2667878-21kworker/u8:3+events_unbound19:22:530
399980399272,21cyclictest4110391-21ntpq20:57:512
3999803992713,12cyclictest0-21swapper/222:22:452
3999803992713,12cyclictest0-21swapper/221:15:002
399980399271,24cyclictest105433-21/usr/sbin/munin00:07:542
399980399271,23cyclictest42335-21grep23:07:432
399980399271,22cyclictest51897-21/usr/sbin/munin23:17:392
399980399271,22cyclictest4071467-21/usr/sbin/munin20:22:372
399980399271,22cyclictest4061954-21/usr/sbin/munin20:12:422
399980399271,21cyclictest81644-21apt-get23:47:372
3999803992710,14cyclictest122742-21tr00:27:452
3999803992710,14cyclictest122742-21tr00:27:452
399980399270,25cyclictest15705-21uname22:37:532
399980399270,25cyclictest115377-21/usr/sbin/munin00:17:552
399980399270,24cyclictest4164973-21/usr/sbin/munin21:52:492
399980399270,23cyclictest4131589-21/usr/sbin/munin21:22:402
399980399270,23cyclictest4026675-21seq19:35:102
399980399270,23cyclictest4012460-21/usr/sbin/munin19:22:422
3999800992723,3cyclictest7386-21sort22:32:441
3999800992722,4cyclictest4135638-21kworker/u8:3+flush-8:022:52:421
3999800992722,4cyclictest4135638-21kworker/u8:3+flush-8:022:52:421
3999800992721,5cyclictest90304-21kworker/u8:0+flush-8:000:12:531
3999800992721,4cyclictest275-21systemd-journal20:57:191
3999796992720,5cyclictest2667878-21kworker/u8:3+events_unbound19:42:360
399980399265,19cyclictest4100505-21cat20:47:552
399980399262,19cyclictest4120233-21ntpq21:07:482
399980399262,19cyclictest4120233-21ntpq21:07:482
399980399262,19cyclictest26665-21apt-get22:52:392
399980399262,19cyclictest26665-21apt-get22:52:392
399980399261,23cyclictest130182-21/usr/sbin/munin00:32:502
399980399261,22cyclictest4052672-21cut20:02:442
399980399261,22cyclictest4050430-21ntpq19:57:502
3999803992611,12cyclictest0-21swapper/219:10:012
399980399260,23cyclictest81305-21grep23:45:012
399980399260,23cyclictest4016893-21seq19:26:192
399980399260,23cyclictest4016893-21seq19:26:192
399980399260,22cyclictest4086323-21/usr/sbin/munin20:37:382
3999800992622,2cyclictest98643-21kthreadcore00:02:471
3999800992618,6cyclictest4190893-21/usr/sbin/munin22:22:531
3999800992616,8cyclictest126415-21/usr/sbin/munin00:32:491
3999800992616,7cyclictest4105948-21cp20:55:001
399980399259,14cyclictest4039857-21tr19:47:452
399980399253,16cyclictest40597-21ntpq23:02:492
399980399252,20cyclictest0-21swapper/222:31:102
3999803992521,2cyclictest4022064-21aten2_r5power_v19:32:392
399980399250,23cyclictest76192-21taskset23:39:512
3999800992514,8cyclictest275-21systemd-journal22:48:191
3999796992520,4cyclictest9140-21kworker/u8:0+flush-8:022:35:210
3999796992520,3cyclictest70457-21needreboot23:32:460
3999796992520,3cyclictest4046223-21latency_hist19:55:010
3999800992421,2cyclictest4035546-21needreboot19:42:451
3999800992421,2cyclictest16972-21cpuspeed_turbos22:42:381
3999800992420,3cyclictest4135638-21kworker/u8:3+flush-8:021:57:551
3999800992420,2cyclictest0-21swapper/122:40:001
3999800992420,2cyclictest0-21swapper/100:07:551
3999800992415,7cyclictest4076348-21apt-get20:27:351
3999796992420,3cyclictest4175652-21kworker/u8:1+events_unbound22:20:020
399979699240,23cyclictest4090830-21kworker/0:2+events21:07:500
399979699240,23cyclictest4090830-21kworker/0:2+events21:07:500
3999800992319,3cyclictest4096240-21kworker/u8:0+flush-8:021:47:541
3999800992319,3cyclictest4066019-21cron20:15:001
3999800992319,2cyclictest0-21swapper/120:22:451
3999800992318,4cyclictest4096003-21sh20:45:001
3999800992318,3cyclictest2487-21irqcore22:27:441
3999800992318,3cyclictest0-21swapper/120:02:561
3999796992319,3cyclictest71487-21kworker/u8:3+events_unbound23:43:010
3999796992315,6cyclictest4175652-21kworker/u8:1+events_unbound22:12:520
3999800992218,3cyclictest4165732-21cron21:55:001
3999800992218,2cyclictest0-21swapper/123:12:531
3999800992218,2cyclictest0-21swapper/121:17:501
3999800992216,5cyclictest4096240-21kworker/u8:0+flush-8:022:07:411
40852202210,2sleep3575-21kworker/3:2+events20:32:523
399980099210,9cyclictest676232kernelversion23:32:421
3999800992016,3cyclictest82564-21kthreadcore23:47:441
3999800992014,4cyclictest0-21swapper/119:27:391
3999800992014,4cyclictest0-21swapper/119:27:391
3999800992011,7cyclictest4013752-21cut19:22:461
40173132180,2sleep3481ktimers/319:27:393
40173132180,2sleep3481ktimers/319:27:393
39948482183,8sleep30-21swapper/319:05:243
40521262156,5sleep30-21swapper/320:02:433
39999902152,8sleep30-21swapper/319:10:023
911592132,6sleep30-21swapper/323:55:023
903712132,7sleep30-21swapper/323:52:533
771312133,6sleep30-21swapper/323:42:463
762032133,5sleep30-21swapper/323:40:013
41918332132,7sleep30-21swapper/322:22:443
41855612132,6sleep30-21swapper/322:15:023
41358242132,6sleep30-21swapper/321:25:023
40901522132,7sleep30-21swapper/320:37:543
40424582132,7sleep30-21swapper/319:52:443
321122132,7sleep30-21swapper/322:57:443
321122132,7sleep30-21swapper/322:57:433
164702132,6sleep30-21swapper/322:40:023
1311702136,4sleep30-21swapper/300:35:023
1035112132,7sleep30-21swapper/300:07:463
968442122,6sleep30-21swapper/300:02:443
520622122,6sleep30-21swapper/323:17:423
41850202122,6sleep30-21swapper/322:12:573
41758572123,5sleep30-21swapper/322:05:023
41666612122,6sleep30-21swapper/321:57:443
41522922123,5sleep30-21swapper/321:42:473
41411652122,6sleep30-21swapper/321:32:203
41299432122,6sleep30-21swapper/321:17:473
41163422122,6sleep30-21swapper/321:06:203
41163422122,6sleep30-21swapper/321:06:203
41115372122,6sleep30-21swapper/321:02:383
41075692122,6sleep30-21swapper/320:57:453
40967162122,6sleep30-21swapper/320:47:423
40923542122,6sleep30-21swapper/320:42:443
40740502122,6sleep30-21swapper/320:22:463
40611242122,5sleep30-21swapper/320:10:013
40363622122,5sleep30-21swapper/319:45:013
40256662122,6sleep30-21swapper/319:32:503
40130222122,6sleep30-21swapper/319:22:463
383652122,6sleep30-21swapper/323:02:453
253822122,7sleep30-21swapper/322:47:483
128182122,6sleep30-21swapper/322:37:453
1113612122,6sleep30-21swapper/300:17:373
1108902122,6sleep30-21swapper/300:15:003
814172112,5sleep30-21swapper/323:45:023
68982112,5sleep30-21swapper/322:32:393
669602112,5sleep30-21swapper/323:32:383
617682112,5sleep30-21swapper/323:27:373
505262112,5sleep30-21swapper/323:12:523
41711492110,7sleep30-21swapper/322:02:383
416032112,6sleep30-21swapper/323:06:063
41600412112,5sleep30-21swapper/321:47:493
41499942112,5sleep30-21swapper/321:37:543
41209972112,5sleep30-21swapper/321:10:013
41011392112,5sleep30-21swapper/320:50:023
40761242112,5sleep30-21swapper/320:25:023
40667312111,6sleep30-21swapper/320:17:403
40563662112,5sleep30-21swapper/320:05:203
40466692113,5sleep30-21swapper/319:57:373
40317692112,6sleep30-21swapper/319:41:243
40277722112,5sleep30-21swapper/319:37:433
40070522112,5sleep30-21swapper/319:17:003
262272112,5sleep30-21swapper/322:50:013
262272112,5sleep30-21swapper/322:50:013
21452112,6sleep30-21swapper/322:27:423
1260122112,5sleep30-21swapper/300:30:013
1214912112,6sleep30-21swapper/300:27:283
1214912112,6sleep30-21swapper/300:27:283
1161152102,5sleep30-21swapper/300:20:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional