You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 11:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed May 20, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
350990023230,5sleep3451irq_work/322:26:063
3309787997353,18cyclictest3425413-21cp21:05:012
3309783995951,6cyclictest3514852-21kworker/u8:2+flush-8:022:50:591
3309781995951,6cyclictest3499840-21kworker/u8:1+flush-8:023:01:040
3309783995551,3cyclictest2477739-21kworker/u8:1+flush-8:020:16:071
3309783995547,6cyclictest3621050-21/usr/sbin/munin00:21:031
3309783995448,5cyclictest3322186-21kworker/u8:3+flush-8:021:20:521
3309783995448,5cyclictest3322186-21kworker/u8:3+events_unbound20:06:051
3309783995348,4cyclictest3575104-21kworker/u8:1+events_unbound00:15:011
3309783995344,6cyclictest3356439-21/usr/sbin/munin19:56:051
3309781995347,4cyclictest3430193-21kworker/u8:1+events_unbound21:51:060
3309783995246,4cyclictest3322186-21kworker/u8:3+flush-8:021:26:031
3309783995147,3cyclictest3322186-21kworker/u8:3+events_unbound20:21:051
3309781995146,3cyclictest3399947-21kworker/u8:2+events_unbound21:01:050
3309781995145,5cyclictest3454446-21kworker/u8:2+flush-8:022:01:040
3309783995046,3cyclictest3399947-21kworker/u8:2+events_unbound20:36:061
3309783995045,4cyclictest2477739-21kworker/u8:1+flush-8:019:26:031
3309783995045,3cyclictest3399947-21kworker/u8:2+flush-8:020:51:031
3309783995044,5cyclictest3399947-21kworker/u8:2+flush-8:021:10:521
3309781995045,3cyclictest3492973-21kworker/u8:3+events_unbound00:31:040
3309781995045,3cyclictest3440130-21kworker/u8:0+flush-8:022:25:520
3309783994945,3cyclictest3575104-21kworker/u8:1+events_unbound23:50:501
3309783994944,4cyclictest3454446-21kworker/u8:2+events_unbound21:45:501
3309783994944,3cyclictest3514852-21kworker/u8:2+events_unbound22:36:021
3309783994943,4cyclictest3492973-21kworker/u8:3+flush-8:000:06:021
3309781994945,3cyclictest2477739-21kworker/u8:1+flush-8:020:31:050
3309781994944,4cyclictest3399947-21kworker/u8:2+flush-8:020:46:030
3309781994942,5cyclictest3492973-21kworker/u8:3+events_unbound00:26:050
3309783994844,3cyclictest3575104-21kworker/u8:1+events_unbound00:16:041
3309783994843,4cyclictest3399947-21kworker/u8:2+flush-8:021:16:051
3309783994843,4cyclictest2477739-21kworker/u8:1+flush-8:019:31:041
3309781994844,3cyclictest3499840-21kworker/u8:1+events_unbound23:06:010
3309781994843,4cyclictest3430193-21kworker/u8:1+flush-8:021:55:520
3309781994839,7cyclictest3515163-21latency_hist22:35:010
3309781994835,11cyclictest3322186-21kworker/u8:3+flush-8:021:30:590
3309781994835,11cyclictest3322186-21kworker/u8:3+flush-8:021:30:580
3309783994743,3cyclictest3492973-21kworker/u8:3+flush-8:022:55:481
3309783994743,3cyclictest3430193-21kworker/u8:1+flush-8:021:30:481
3309783994743,3cyclictest3430193-21kworker/u8:1+flush-8:021:30:481
3309783994742,4cyclictest3499840-21kworker/u8:1+flush-8:023:05:581
3309783994742,4cyclictest3492973-21kworker/u8:3+flush-8:023:10:581
3309783994741,5cyclictest3399947-21kworker/u8:2+flush-8:021:00:521
3309783994741,5cyclictest1948685-21kworker/u8:0+flush-8:019:16:051
3309781994743,3cyclictest3575104-21kworker/u8:1+flush-8:000:36:040
3309781994743,3cyclictest3399947-21kworker/u8:2+flush-8:020:41:050
3309781994742,4cyclictest3549995-21kworker/u8:2+flush-8:023:10:500
3309781994742,3cyclictest3399947-21kworker/u8:2+events_unbound21:15:010
3309781994737,8cyclictest3445689-21/usr/sbin/munin21:25:580
34504112460,1chrt3450415-21latency_hist21:30:002
3309783994642,3cyclictest3492973-21kworker/u8:3+flush-8:022:15:511
3309783994642,3cyclictest2477739-21kworker/u8:1+events_unbound19:51:021
3309783994642,3cyclictest2477739-21kworker/u8:1+events_unbound19:51:021
3309783994642,3cyclictest1948685-21kworker/u8:0+events_unbound20:31:021
3309783994641,4cyclictest3499840-21kworker/u8:1+flush-8:023:00:501
3309783994641,4cyclictest3492973-21kworker/u8:3+flush-8:000:00:591
3309783994641,4cyclictest3322186-21kworker/u8:3+events_unbound20:41:001
3309783994641,3cyclictest3549995-21kworker/u8:2+flush-8:023:25:521
3309783994640,4cyclictest3430193-21kworker/u8:1+flush-8:022:06:041
3309781994642,3cyclictest3499840-21kworker/u8:1+flush-8:022:41:050
3309781994641,3cyclictest3454446-21kworker/u8:2+flush-8:021:36:010
3309781994639,5cyclictest2477739-21kworker/u8:1+flush-8:019:51:010
3309781994639,5cyclictest2477739-21kworker/u8:1+flush-8:019:51:000
3309783994540,4cyclictest3584860-21kworker/u8:2+flush-8:023:45:591
3309783994540,3cyclictest3454446-21kworker/u8:2+events_unbound21:40:531
3309783994535,4cyclictest3549995-21kworker/u8:2+flush-8:023:21:091
3309783994535,4cyclictest3549995-21kworker/u8:2+flush-8:023:21:081
3309781994540,4cyclictest2477739-21kworker/u8:1+events_unbound20:16:050
3309781994538,5cyclictest3575104-21kworker/u8:1+flush-8:023:41:000
3309781994536,7cyclictest1704890-21systemd-journal23:40:000
3309783994439,4cyclictest3549995-21kworker/u8:2+flush-8:023:16:001
3309783994439,4cyclictest3399947-21kworker/u8:2+events_unbound21:05:501
3309783994438,4cyclictest2477739-21kworker/u8:1+flush-8:019:45:591
3309781994440,3cyclictest3549995-21kworker/u8:2+events_unbound23:20:520
3309781994440,3cyclictest3549995-21kworker/u8:2+events_unbound23:20:520
3309781994439,4cyclictest3575104-21kworker/u8:1+events_unbound23:50:510
330978199440,42cyclictest1-21systemd00:00:010
3309783994339,3cyclictest3454446-21kworker/u8:2+events_unbound22:00:011
3309783994334,6cyclictest3313814-21ntpq19:11:011
3309781994339,3cyclictest3454446-21kworker/u8:2+events_unbound21:45:520
3309781994337,4cyclictest3514852-21kworker/u8:2+events_unbound22:56:060
3309783994238,3cyclictest3440130-21kworker/u8:0+events_unbound22:25:001
3309783994237,4cyclictest3549995-21kworker/u8:2+flush-8:023:31:001
3309783994237,4cyclictest3499840-21kworker/u8:1+flush-8:022:45:541
3309783994237,4cyclictest3322186-21kworker/u8:3+flush-8:020:56:001
3309783994237,3cyclictest3440130-21kworker/u8:0+flush-8:021:50:521
3309783994236,5cyclictest1948685-21kworker/u8:0+events_unbound19:20:491
3309783994235,5cyclictest3440130-21kworker/u8:0+events_unbound22:31:031
3309781994238,3cyclictest1948685-21kworker/u8:0+events_unbound20:36:010
3309781994237,4cyclictest3430193-21kworker/u8:1+flush-8:022:06:010
3309787994130,8cyclictest3475939-21diskstats21:55:512
3309783994137,3cyclictest3322186-21kworker/u8:3+events_unbound20:10:511
3309783994136,4cyclictest3492973-21kworker/u8:3+flush-8:000:30:511
3309781994136,4cyclictest3399947-21kworker/u8:2+flush-8:021:06:000
3309781994135,4cyclictest3549995-21kworker/u8:2+flush-8:023:30:510
3309781994134,5cyclictest3399947-21kworker/u8:2+flush-8:020:51:010
3309783994034,4cyclictest3575104-21kworker/u8:1+flush-8:023:35:491
3309781994036,2cyclictest3492973-21kworker/u8:3+events_unbound22:50:000
3309781994035,4cyclictest3360286-21ntpq19:56:030
3309781994034,4cyclictest2477739-21kworker/u8:1+flush-8:019:30:590
3309783993934,4cyclictest2477739-21kworker/u8:1+flush-8:020:01:041
3309783993934,3cyclictest3459394-21ntpq21:36:001
3309783993933,5cyclictest3399947-21kworker/u8:2+flush-8:020:46:011
3309781993934,3cyclictest3430193-21kworker/u8:1+flush-8:022:10:560
3309783993836,1cyclictest3440130-21kworker/u8:0+events_unbound22:26:051
3309783993832,4cyclictest3575104-21kworker/u8:1+events_unbound23:40:481
3309781993832,4cyclictest3549995-21kworker/u8:2+flush-8:023:26:000
3309781993831,5cyclictest3419554-21ntpq20:56:010
3309783993733,3cyclictest3322186-21kworker/u8:3+events_unbound19:39:391
3309781993733,3cyclictest3492973-21kworker/u8:3+flush-8:000:06:070
3309781993732,4cyclictest3322186-21kworker/u8:3+flush-8:020:21:010
3309781993731,4cyclictest2477739-21kworker/u8:1+events_unbound19:25:580
3309783993632,3cyclictest3492973-21kworker/u8:3+events_unbound00:26:031
3309783993632,3cyclictest3322186-21kworker/u8:3+events_unbound19:40:521
3309783993631,3cyclictest3584860-21kworker/u8:2+events_unbound23:55:531
3309781993632,3cyclictest3322186-21kworker/u8:3+events_unbound19:40:540
3309781993631,3cyclictest3549995-21kworker/u8:2+flush-8:023:15:500
3309781993630,5cyclictest2477739-21kworker/u8:1+flush-8:019:35:580
3309781993630,4cyclictest3514852-21kworker/u8:2+flush-8:022:35:500
3309783993531,3cyclictest3454446-21kworker/u8:2+flush-8:022:00:511
3309783993531,3cyclictest3430193-21kworker/u8:1+flush-8:022:10:531
3309781993530,4cyclictest3492973-21kworker/u8:3+events_unbound22:16:010
3309781993530,4cyclictest1948685-21kworker/u8:0+events_unbound19:11:000
3309781993430,3cyclictest3399947-21kworker/u8:2+events_unbound21:16:060
3309781993429,4cyclictest3575104-21kworker/u8:1+events_unbound00:11:120
3309781993426,6cyclictest3321510-21latency_hist19:20:010
3309781993328,4cyclictest3454446-21kworker/u8:2+flush-8:021:41:000
3309781993229,2cyclictest3625754-21systemctl00:25:000
3309781993228,3cyclictest3492973-21kworker/u8:3+flush-8:000:01:020
3309781993224,6cyclictest3620959-21cp00:20:010
3309781993224,6cyclictest3326485-21latency_hist19:25:000
3309781993223,3cyclictest2477739-21kworker/u8:1+events_unbound19:49:380
3309783993127,3cyclictest3575104-21kworker/u8:1+flush-8:000:36:001
3309783993126,3cyclictest3499840-21kworker/u8:1+flush-8:022:41:061
3309781993127,3cyclictest2477739-21kworker/u8:1+events_unbound20:00:480
3309783993026,3cyclictest3322186-21kworker/u8:3+flush-8:020:25:521
3309781993026,3cyclictest2477739-21kworker/u8:1+flush-8:020:26:050
3309781993023,5cyclictest2477739-21kworker/u8:1+events_unbound20:15:010
3309787992924,3cyclictest3605900-21aten2_r5power_v00:05:502
3309787992924,3cyclictest3435133-21unixbench_singl21:11:052
3309787992923,4cyclictest3610958-21apt-get00:10:512
3309787992920,7cyclictest1704890-21systemd-journal20:59:592
34866902280,6sleep3451irq_work/322:05:573
3309787992824,2cyclictest3580868-21fschecks_time23:40:502
3309781992823,4cyclictest3514852-21kworker/u8:2+flush-8:022:51:070
3309781992820,7cyclictest3440130-21kworker/u8:0+flush-8:021:21:060
33093622282,5sleep00-21swapper/019:07:020
3309787992723,2cyclictest3470790-21aten2_r5power_c21:50:512
3309787992721,4cyclictest3500081-21sendmail22:20:002
3309787992716,8cyclictest1704890-21systemd-journal19:50:002
3309781992722,3cyclictest3590209-21gpgv23:50:010
3309787992623,2cyclictest3351587-21aten2_r5power_e19:50:482
3309787992623,2cyclictest3351587-21aten2_r5power_e19:50:472
3309787992621,3cyclictest3534770-21unixbench_multi22:51:062
3309781992622,3cyclictest3492973-21kworker/u8:3+flush-8:022:20:100
3309787992522,2cyclictest3375553-21unixbench_singl20:11:072
3309787992521,3cyclictest3590997-21fschecks_time23:50:522
3309787992521,2cyclictest3622003-21kthreadcore00:20:532
3309787992521,2cyclictest3332041-21fschecks_count19:30:502
3309787992521,2cyclictest0-21swapper/223:40:012
3309787992520,4cyclictest3340923-21unixbench_multi19:36:052
3309787992520,3cyclictest3561022-21fschecks_count23:20:532
3309787992520,3cyclictest3561022-21fschecks_count23:20:532
33088032255,13sleep10-21swapper/119:06:021
3309787992421,2cyclictest3450962-21fschecks_time21:30:502
3309787992421,2cyclictest3450962-21fschecks_time21:30:502
3309787992421,2cyclictest3436017-21cpuspeed_turbos21:15:492
3309787992421,2cyclictest3396284-21fschecks_time20:35:522
330978799232,9cyclictest34443432grep21:21:002
3309787992319,2cyclictest3536003-21fschecks_count22:55:502
3309787992219,2cyclictest3570309-21cron23:30:002
3309787992218,3cyclictest3560384-21apt-key23:20:002
3309787992218,3cyclictest3480861-21cpuspeed_turbos22:00:492
3309787992217,4cyclictest3321516-21systemctl19:20:002
3309787992217,3cyclictest3590300-21apt-key23:50:012
3309787992212,2cyclictest0-21swapper/219:55:522
3309781992217,3cyclictest3368903-21kthreadcore20:05:560
3309787992117,2cyclictest0-21swapper/223:05:002
3309787992110,9cyclictest3469303-21tr21:45:572
330978799202,13cyclictest3525398-21apt-get22:45:482
330978799202,13cyclictest3386084-21apt-get20:25:482
3309787992017,2cyclictest3500854-21cpuspeed_turbos22:20:502
3309787992017,2cyclictest3494127-21needreboot22:10:582
3309787992016,2cyclictest3631560-21fschecks_time00:30:512
3309787992016,2cyclictest0-21swapper/223:35:012
3309787992016,2cyclictest0-21swapper/221:45:022
3309787992016,2cyclictest0-21swapper/200:26:002
3309787992015,4cyclictest3490176-21idleruntime-cro22:10:002
3309787992015,3cyclictest885-21mta-sts-daemon19:41:042
3309787992013,5cyclictest1704890-21systemd-journal20:25:002
33092842204,9sleep20-21swapper/219:06:082
33053582203,9sleep30-21swapper/319:05:533
330978799192,12cyclictest3410822-21apt-get20:50:482
3309787991916,2cyclictest3426120-21fschecks_count21:05:502
3309787991915,3cyclictest3520684-21cpuspeed_turbos22:40:492
3309787991914,3cyclictest0-21swapper/200:05:012
3309787991814,3cyclictest3600225-21idleruntime-cro00:00:002
3309787991814,3cyclictest0-21swapper/220:20:012
3309787991814,3cyclictest0-21swapper/200:40:002
3309787991814,2cyclictest0-21swapper/220:31:032
3309787991812,4cyclictest3520140-21idleruntime-cro22:40:002
3309787991812,3cyclictest3361416-21apt-get20:00:482
330978799179,6cyclictest3330094-21tr19:25:552
330978799175,2cyclictest161rcu_preempt19:15:002
3309787991713,2cyclictest0-21swapper/222:30:552
3309787991712,3cyclictest0-21swapper/222:25:562
3309787991711,4cyclictest0-21swapper/220:40:542
33601862160,2sleep3471rcuc/319:55:593
330978799164,8cyclictest3367916-21tr20:05:552
3309787991613,2cyclictest0-21swapper/223:05:022
3309787991613,2cyclictest0-21swapper/219:21:002
3309787991612,3cyclictest0-21swapper/221:35:492
3309787991611,3cyclictest0-21swapper/220:45:552
330978799159,4cyclictest0-21swapper/223:10:532
330978799151,11cyclictest3615887-21apt-get00:15:492
35607592142,8sleep30-21swapper/323:20:503
35607592142,8sleep30-21swapper/323:20:503
33860582142,8sleep30-21swapper/320:25:453
36205032132,7sleep30-21swapper/300:20:013
35752812132,6sleep30-21swapper/323:35:023
35703032132,6sleep30-21swapper/323:30:003
34992122135,5sleep30-21swapper/322:16:013
34755782132,6sleep30-21swapper/321:55:013
34543682134,5sleep30-21swapper/321:30:593
34543682134,5sleep30-21swapper/321:30:583
34105782132,6sleep30-21swapper/320:50:023
33947262133,6sleep30-21swapper/320:31:003
36358482122,5sleep30-21swapper/300:35:013
36312122123,5sleep30-21swapper/300:30:483
36262582122,6sleep30-21swapper/300:25:503
36113332122,6sleep30-21swapper/300:10:583
36095262122,6sleep30-21swapper/300:06:043
36045382122,6sleep30-21swapper/300:01:023
35861402122,6sleep30-21swapper/323:45:543
35808882122,6sleep30-21swapper/323:40:513
35580042122,6sleep30-21swapper/323:15:553
35456192122,6sleep30-21swapper/323:05:453
35352822122,5sleep30-21swapper/322:55:023
35309482122,6sleep30-21swapper/322:50:523
35208432122,6sleep30-21swapper/322:40:533
35193782122,6sleep30-21swapper/322:36:043
35102682122,5sleep30-21swapper/322:30:023
34904612122,6sleep30-21swapper/322:10:463
34831422122,6sleep30-21swapper/322:00:563
34612972122,6sleep30-21swapper/321:40:533
34599712122,6sleep30-21swapper/321:36:293
34453932122,5sleep30-21swapper/321:25:013
34433242122,6sleep30-21swapper/321:21:003
34347442122,6sleep30-21swapper/321:11:053
34231452122,6sleep30-21swapper/321:00:573
34160202122,6sleep30-21swapper/320:55:513
33963082122,6sleep30-21swapper/320:35:533
33815232123,6sleep30-21swapper/320:20:533
33712432122,6sleep30-21swapper/320:10:363
33679122122,6sleep30-21swapper/320:05:563
33654942122,6sleep30-21swapper/320:01:063
33471172122,6sleep30-21swapper/319:45:543
33405432123,6sleep30-21swapper/319:36:023
33215402122,5sleep30-21swapper/319:20:013
36250972112,5sleep30-21swapper/300:21:053
35955592112,6sleep30-21swapper/323:55:173
35906192112,5sleep30-21swapper/323:50:473
35705542112,6sleep30-21swapper/323:30:133
35508542112,5sleep30-21swapper/323:10:513
35406922112,5sleep30-21swapper/323:00:463
35253152112,5sleep30-21swapper/322:45:013
35005502112,5sleep30-21swapper/322:20:023
34707332112,5sleep30-21swapper/321:50:493
34660502112,6sleep30-21swapper/321:45:523
34356162112,5sleep30-21swapper/321:15:023
34257832112,6sleep30-21swapper/321:05:113
34062762112,6sleep30-21swapper/320:45:533
34013022112,5sleep30-21swapper/320:40:503
33786742112,5sleep30-21swapper/320:15:593
33524142112,5sleep30-21swapper/319:50:553
33524142112,5sleep30-21swapper/319:50:553
33416192112,6sleep30-21swapper/319:40:363
33363732112,6sleep30-21swapper/319:34:503
33306832112,5sleep30-21swapper/319:26:033
33169072112,6sleep30-21swapper/319:15:523
33098832112,5sleep30-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional