You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 04:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue Jul 21, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10249221720,2sleep239-21ksoftirqd/219:07:422
107053995849,6cyclictest267401-21latency_hist21:50:001
107053995546,6cyclictest222879-21latency_hist21:05:011
107053995143,5cyclictest278-21systemd-journal23:27:421
107053995142,7cyclictest252401-21kworker/u8:0+flush-8:021:37:571
107053995041,6cyclictest381425-21kworker/u8:1+flush-8:023:47:561
107053994942,5cyclictest354558-21kworker/u8:3+events_unbound23:42:511
107053994942,5cyclictest354558-21kworker/u8:3+events_unbound23:42:511
107057994843,4cyclictest68045-21kworker/u8:2+flush-8:019:15:052
107053994741,4cyclictest267251-21kworker/u8:2+events_unbound22:15:011
107053994733,9cyclictest111902-21latency_hist19:15:011
107051994233,6cyclictest376456-21latency_hist23:40:000
107053994134,5cyclictest129079-21/usr/sbin/munin19:32:591
107053994133,5cyclictest98-21kworker/u8:4+flush-8:019:37:581
107053994131,7cyclictest325159-21kworker/u8:3+flush-8:022:47:581
107053994033,6cyclictest316698-21kworker/u8:0+flush-8:023:08:001
107051994031,7cyclictest277327-21latency_hist22:00:010
107057993924,4cyclictest98-21kworker/u8:4+flush-8:019:50:112
107051993931,6cyclictest431178-21latency_hist00:35:020
107053993832,4cyclictest396252-21kworker/u8:0+events_unbound00:17:461
107053993830,6cyclictest222901-21kworker/u8:2+flush-8:021:22:531
107053993631,3cyclictest193406-21kworker/u8:0+flush-8:020:55:121
107053993629,5cyclictest405979-21kworker/u8:3+flush-8:000:27:551
107053993629,5cyclictest222901-21kworker/u8:2+flush-8:021:07:561
107053993628,6cyclictest411159-21kworker/u8:2+flush-8:000:37:521
107053993628,6cyclictest347170-21/usr/sbin/munin23:12:521
107053993628,6cyclictest267251-21kworker/u8:2+flush-8:022:17:581
107051993631,3cyclictest128918-21kworker/u8:1+events_unbound20:10:010
107053993530,3cyclictest98-21kworker/u8:4+flush-8:019:17:431
107053993530,3cyclictest258710-21irqrtprio21:42:471
107053993529,4cyclictest272363-21kworker/u8:1+flush-8:022:27:521
107053993529,4cyclictest128918-21kworker/u8:1+flush-8:020:22:541
107053993528,5cyclictest282707-21apt-get22:07:391
107053993527,6cyclictest252401-21kworker/u8:0+flush-8:021:52:541
107053993525,7cyclictest278-21systemd-journal22:37:411
107051993531,3cyclictest193406-21kworker/u8:0+events_unbound20:55:000
4132322340,2sleep3481ktimers/300:17:473
107053993429,4cyclictest222901-21kworker/u8:2+events_unbound21:32:511
107053993428,4cyclictest68045-21kworker/u8:2+events_unbound19:27:421
107053993424,6cyclictest128918-21kworker/u8:1+flush-8:020:37:461
107051993424,8cyclictest154096-21diskstats19:57:440
107053993329,3cyclictest325159-21kworker/u8:3+flush-8:022:55:011
107053993328,4cyclictest316698-21kworker/u8:0+flush-8:022:42:571
107053993326,5cyclictest267251-21kworker/u8:2+flush-8:022:32:571
107053993326,5cyclictest153844-21apt-get19:57:401
107051993328,4cyclictest128918-21kworker/u8:1+flush-8:021:43:010
107051993326,5cyclictest327424-21apt-get22:52:390
107051993325,6cyclictest396216-21latency_hist00:00:010
107051993324,6cyclictest381410-21latency_hist23:45:000
107051993324,6cyclictest381410-21latency_hist23:45:000
107057993226,4cyclictest316978-21gpgv22:40:002
107053993225,4cyclictest341642-21kworker/u8:2+flush-8:023:22:541
107051993227,3cyclictest361616-21cron23:25:000
107051993225,6cyclictest98-21kworker/u8:4+flush-8:019:32:490
107057993127,2cyclictest169043-21fschecks_time20:12:442
107053993126,3cyclictest356611-21sh23:20:001
107053993125,4cyclictest193406-21kworker/u8:0+events_unbound20:42:551
107053993124,5cyclictest381425-21kworker/u8:1+flush-8:000:07:561
107053993124,5cyclictest222901-21kworker/u8:2+events_unbound21:12:571
107053993124,5cyclictest106904-21latency_hist19:10:011
107051993127,3cyclictest208021-21systemd-run20:50:000
107051993127,3cyclictest208021-21systemd-run20:50:000
107053993025,3cyclictest149222-21cut19:52:441
107053993024,4cyclictest128918-21kworker/u8:1+flush-8:019:42:541
107053993022,4cyclictest0-21swapper/122:02:471
10705199306,23cyclictest62500-21kworker/0:1+events00:07:430
10705199300,28cyclictest411711-21sshd00:17:420
107057992925,3cyclictest280645-21kworker/u8:0+flush-8:022:02:552
107057992924,3cyclictest128918-21kworker/u8:1+events_unbound20:50:002
107057992924,3cyclictest128918-21kworker/u8:1+events_unbound20:50:002
107057992923,4cyclictest410919-21unixbench_singl00:12:572
107053992924,4cyclictest396252-21kworker/u8:0+events_unbound00:02:551
107053992924,3cyclictest243452-21cut21:27:441
107053992924,3cyclictest168263-21systemd-run20:10:021
107053992923,4cyclictest98-21kworker/u8:4+flush-8:019:47:461
107053992923,4cyclictest21170-21cron00:35:001
107051992924,3cyclictest139369-21fschecks_time19:42:440
107051992923,4cyclictest267222-21unixbench_singl21:48:020
107051992923,4cyclictest222901-21kworker/u8:2+flush-8:021:17:430
107051992923,4cyclictest213407-21apt-get20:57:390
107051992923,4cyclictest118472-21unixbench_multi19:17:570
107051992920,7cyclictest192945-21apt-get20:35:000
107053992824,3cyclictest128918-21kworker/u8:1+flush-8:020:12:481
107053992822,4cyclictest325159-21kworker/u8:3+events_unbound23:02:481
107053992820,6cyclictest416484-21cat00:20:021
107051992825,2cyclictest138550-21munin-run19:40:000
107051992822,4cyclictest401192-21cron00:05:000
107051992820,6cyclictest243137-21apt-get21:27:390
107057992724,2cyclictest341642-21kworker/u8:2+flush-8:023:52:492
107057992723,3cyclictest98-21kworker/u8:4+flush-8:019:25:012
107057992723,3cyclictest317612-21aten2_r5power_e22:42:402
107057992722,4cyclictest98-21kworker/u8:4+flush-8:020:17:462
107057992722,4cyclictest354558-21kworker/u8:3+events_unbound23:37:512
107057992722,3cyclictest282928-21cpuspeed_turbos22:07:422
107057992722,3cyclictest183870-21fschecks_time20:27:432
107053992721,4cyclictest273031-21cpuspeed_turbos21:57:421
107053992720,5cyclictest68045-21kworker/u8:2+flush-8:020:32:461
107053992718,7cyclictest301336-21ntpq22:22:511
10705199277,19cyclictest62500-21kworker/0:1+events21:30:440
10705199272,23cyclictest62500-21kworker/0:1+events22:32:430
107051992722,3cyclictest153399-21idleruntime-cro19:54:590
107051992721,4cyclictest322748-21cpuspeed_turbos22:47:430
107057992622,3cyclictest337375-21aten2_r5power_e23:02:422
107057992622,3cyclictest332439-21aten2_r5power_e22:57:402
107057992622,2cyclictest218585-21cpuspeed_turbos21:02:422
107053992621,3cyclictest128918-21kworker/u8:1+flush-8:020:02:461
107053992619,5cyclictest396358-21sort00:00:011
107053992619,5cyclictest376623-21sort23:40:011
107053992619,3cyclictest0-21swapper/123:52:581
10705199266,19cyclictest62500-21kworker/0:1+events20:27:470
107051992623,2cyclictest316852-21systemctl22:40:000
107051992614,2cyclictest0-21swapper/022:57:560
10705799257,3cyclictest2410552kthreadcore21:22:492
107057992520,4cyclictest341642-21kworker/u8:2-ext4-rsv-conversion23:45:002
107057992520,4cyclictest341642-21kworker/u8:2-ext4-rsv-conversion23:45:002
107057992520,3cyclictest357316-21cpuspeed_turbos23:22:422
107057992515,9cyclictest411159-21kworker/u8:2+flush-8:000:23:152
107053992521,2cyclictest0-21swapper/119:22:431
107053992519,4cyclictest869-21mta-sts-daemon20:49:461
107053992519,4cyclictest869-21mta-sts-daemon20:49:461
10705199252,22cyclictest62500-21kworker/0:1+events23:07:470
107051992521,3cyclictest178700-21aten2_r5power_v20:22:420
107051992520,4cyclictest391089-21unixbench_singl23:52:590
107051992520,4cyclictest301822-21unixbench_multi22:22:580
107051992520,3cyclictest197870-21unixbench_multi20:37:570
107051992519,4cyclictest316698-21kworker/u8:0+events_unbound23:17:470
107051992519,4cyclictest162566-21ntp_kernel_pll_20:02:520
10705199251,23cyclictest62500-21kworker/0:1+events23:12:430
10705199251,23cyclictest62500-21kworker/0:1+events22:02:470
10705799247,3cyclictest2993792kthreadcore22:22:472
107057992420,3cyclictest411816-21cpuspeed_turbos00:17:422
107057992415,7cyclictest352789-21irqcore23:17:462
107053992419,3cyclictest128918-21kworker/u8:1+flush-8:020:15:111
107053992419,2cyclictest0-21swapper/121:17:491
107053992419,2cyclictest0-21swapper/100:12:441
107053992417,5cyclictest354558-21kworker/u8:3+flush-8:023:32:471
107053992417,5cyclictest208447-21apt-get20:52:371
10705199247,16cyclictest62500-21kworker/0:1+events21:22:430
10705199246,17cyclictest62500-21kworker/0:1+events23:27:470
10705199246,17cyclictest62500-21kworker/0:1+events19:27:390
10705199245,18cyclictest62500-21kworker/0:1+events22:27:390
10705199242,21cyclictest62500-21kworker/0:1+events00:22:390
107051992418,4cyclictest177870-21unixbench_multi20:17:580
107051992418,4cyclictest172884-21unixbench_multi20:12:590
107051992414,7cyclictest278-21systemd-journal21:55:010
10705199241,22cyclictest62500-21kworker/0:1+events21:12:430
107057992319,3cyclictest98-21kworker/u8:4+events_unbound21:48:022
107057992319,3cyclictest253362-21fschecks_time21:37:452
107053992319,2cyclictest0-21swapper/122:57:461
10705199236,16cyclictest62500-21kworker/0:1+events22:42:470
10705199232,20cyclictest0-21swapper/019:47:580
107051992313,8cyclictest371491-21latency_hist23:35:010
10705199231,2cyclictest107414-21apt-get19:12:400
10705199230,18cyclictest62500-21kworker/0:1+events20:40:270
10705799226,4cyclictest0-21swapper/220:37:582
107057992217,4cyclictest411159-21kworker/u8:2+flush-8:000:32:542
107057992217,3cyclictest396252-21kworker/u8:0+flush-8:000:00:022
107053992217,3cyclictest183756-21sh20:27:411
10705199222,19cyclictest62500-21kworker/0:1+events23:04:110
10705199222,19cyclictest0-21swapper/000:27:590
107051992219,2cyclictest292174-21turbostat.cron22:15:000
107051992217,4cyclictest257248-21unixbench_multi21:37:580
107051992216,4cyclictest858-21mta-sts-daemon00:37:480
107051992215,5cyclictest409653-21tr00:12:470
107051992215,5cyclictest386071-21unixbench_multi23:47:560
10705199221,20cyclictest62500-21kworker/0:1+events22:07:550
107057992118,2cyclictest311655-21unixbench_multi22:32:582
107057992117,3cyclictest422009-21fschecks_count00:27:442
107057992117,2cyclictest327538-21aten2_r5power_v22:52:412
107057992116,4cyclictest128918-21kworker/u8:1+flush-8:020:07:572
107057992115,4cyclictest381425-21kworker/u8:1+flush-8:023:57:472
107051992117,2cyclictest0-21swapper/022:17:000
107051992117,2cyclictest0-21swapper/021:07:470
107051992111,8cyclictest123018-21ntpq19:22:540
1024592212,10sleep0102484-21apt-get19:07:410
10705799202,16cyclictest0-21swapper/223:32:492
107057992015,4cyclictest128918-21kworker/u8:1+events_unbound20:22:062
107057992015,3cyclictest232604-21unixbench_singl21:12:592
107057992015,3cyclictest108318-21sed19:12:472
107057992015,3cyclictest0-21swapper/221:00:002
107057992013,5cyclictest434670-21kthreadcore00:37:502
107051992016,2cyclictest0-21swapper/021:02:420
3310502190,6sleep30-21swapper/322:52:503
107057991916,2cyclictest139045-21aten2_r5power_c19:42:412
107057991915,3cyclictest381913-21aten2_r5power_e23:47:392
107057991915,2cyclictest0-21swapper/222:30:002
107057991915,2cyclictest0-21swapper/220:55:002
107057991914,4cyclictest405979-21kworker/u8:3+flush-8:000:08:172
107057991914,3cyclictest0-21swapper/220:35:002
107057991911,5cyclictest262645-21sed21:45:002
107057991910,8cyclictest245779-21cut21:27:492
107057991814,2cyclictest159040-21cpuspeed_turbos20:02:412
107057991814,2cyclictest0-21swapper/223:12:482
10705799177,2cyclictest0-21swapper/219:37:442
107057991714,2cyclictest124385-21cpuspeed_turbos19:27:422
107057991713,3cyclictest273719-21kthreadcore21:57:472
107057991713,3cyclictest0-21swapper/222:48:002
107057991713,2cyclictest293291-21irqcore22:17:472
107057991713,2cyclictest0-21swapper/223:27:572
107057991713,2cyclictest0-21swapper/219:57:492
107057991712,4cyclictest287233-21kworker/u8:3+events_unbound22:12:492
107057991711,4cyclictest0-21swapper/221:32:512
2282902162,9sleep30-21swapper/321:12:413
10705799167,7cyclictest223669-21perl21:07:432
10705799162,13cyclictest0-21swapper/221:17:412
10705799162,13cyclictest0-21swapper/220:41:192
107057991613,2cyclictest0-21swapper/223:05:512
107057991611,3cyclictest129371-21fschecks_count19:32:452
4257502150,2sleep3481ktimers/300:27:583
107057991511,2cyclictest0-21swapper/221:52:482
107057991510,3cyclictest0-21swapper/219:47:472
1671832140,2sleep3471rcuc/320:07:493
3427302132,7sleep30-21swapper/323:07:473
3368262133,6sleep30-21swapper/323:00:013
3220452132,6sleep30-21swapper/322:45:013
2575612132,6sleep30-21swapper/321:40:013
1576412132,8sleep30-21swapper/319:57:563
1061022135,4sleep30-21swapper/319:07:523
4165802122,6sleep30-21swapper/300:20:053
4014432122,6sleep30-21swapper/300:05:173
3990022123,6sleep30-21swapper/300:02:483
3818592122,6sleep30-21swapper/323:47:393
3764942122,6sleep30-21swapper/323:40:023
3764942122,6sleep30-21swapper/323:40:013
3757062123,6sleep30-21swapper/323:37:523
3705962122,6sleep30-21swapper/323:32:513
3624512122,6sleep30-21swapper/323:27:463
3561522122,6sleep30-21swapper/323:17:583
3179012122,6sleep30-21swapper/322:42:443
3129022122,6sleep30-21swapper/322:37:463
2971462122,6sleep30-21swapper/322:20:013
2933412122,6sleep30-21swapper/322:17:483
2914052122,6sleep30-21swapper/322:12:513
2825292122,6sleep30-21swapper/322:05:413
2678602122,6sleep30-21swapper/321:52:413
2521522122,6sleep30-21swapper/321:32:593
2430152122,6sleep30-21swapper/321:26:253
2340542122,6sleep30-21swapper/321:17:463
2087592122,6sleep30-21swapper/320:52:433
1939972122,6sleep30-21swapper/320:37:433
1912482123,6sleep30-21swapper/320:32:493
1781482122,6sleep30-21swapper/320:20:013
1607602122,6sleep30-21swapper/320:02:483
1484432122,5sleep30-21swapper/319:50:003
1386022122,5sleep30-21swapper/319:40:023
1377972122,6sleep30-21swapper/319:37:533
1330732122,6sleep30-21swapper/319:32:593
1241822122,6sleep30-21swapper/319:27:433
1200922122,6sleep30-21swapper/319:22:483
1144982122,6sleep30-21swapper/319:17:433
1089352122,6sleep30-21swapper/319:12:503
4316772112,5sleep30-21swapper/300:37:423
4285832113,5sleep30-21swapper/300:32:493
4065352112,6sleep30-21swapper/300:11:423
3867022112,6sleep30-21swapper/323:51:483
3573372112,5sleep30-21swapper/323:22:443
3481162112,5sleep30-21swapper/323:12:503
3371342112,6sleep30-21swapper/323:00:413
3073692112,6sleep30-21swapper/322:32:133
3027602112,5sleep30-21swapper/322:27:443
2813962112,5sleep30-21swapper/322:02:523
2728142112,5sleep30-21swapper/321:57:423
2627122112,6sleep30-21swapper/321:45:153
2533572112,6sleep30-21swapper/321:37:443
2379962112,5sleep30-21swapper/321:20:193
2248212112,5sleep30-21swapper/321:07:483
2223142112,5sleep30-21swapper/321:02:583
2133672112,6sleep30-21swapper/320:57:283
2030792112,5sleep30-21swapper/320:45:013
2030792112,5sleep30-21swapper/320:45:013
2026242112,5sleep30-21swapper/320:43:013
1833552112,6sleep30-21swapper/320:25:513
1735402112,5sleep30-21swapper/320:17:083
1685652112,6sleep30-21swapper/320:11:243
1488622112,6sleep30-21swapper/319:52:253
3921672102,5sleep30-21swapper/323:57:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional