You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 04:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Jul 22, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17363522120,2sleep3481ktimers/323:37:473
4099849996354,6cyclictest4099699-21latency_hist19:10:011
4099847995142,6cyclictest56408-21latency_hist21:40:010
4099847995044,4cyclictest66116-21kworker/u8:0+events_unbound21:55:010
4099849994939,7cyclictest278-21systemd-journal21:05:021
4099849994436,6cyclictest66298-21latency_hist21:50:011
4099849994436,6cyclictest278-21systemd-journal21:07:441
4099847994438,4cyclictest66116-21kworker/u8:0+flush-8:000:05:010
4099847994434,8cyclictest4175930-21apt-get20:25:000
4099847994432,5cyclictest76238-21kworker/u8:2+events_unbound22:32:570
4099849994236,5cyclictest4099724-21kworker/u8:2+flush-8:020:12:431
4099849994133,6cyclictest278-21systemd-journal19:42:441
4099849994132,6cyclictest195132-21latency_hist00:00:011
1908302410,3chrt577-21kworker/3:2-events23:57:413
4099849994032,6cyclictest169885-21kworker/u8:1+flush-8:000:37:521
4099849993834,3cyclictest3272820-21kworker/u8:3+flush-8:019:37:431
4099849993833,4cyclictest4085034-21kworker/u8:1+flush-8:019:47:431
4099849993829,6cyclictest278-21systemd-journal20:52:441
4099847993833,4cyclictest3272820-21kworker/u8:3+flush-8:020:07:420
4099847993830,6cyclictest17271-21apt-get21:02:390
4099847993829,7cyclictest4121953-21/usr/sbin/munin19:32:500
4099849993732,4cyclictest4085034-21kworker/u8:1+flush-8:019:32:581
4099849993732,3cyclictest102337-21irqrtprio22:27:451
4099847993732,3cyclictest26537-21kworker/u8:2+events_unbound21:17:420
2312832370,9sleep239-21ksoftirqd/200:37:442
4099852993627,7cyclictest224819-21apt-get00:30:002
4099849993630,4cyclictest4171416-21apt-get20:22:391
4099847993629,5cyclictest170862-21apt-get23:37:370
4099849993526,6cyclictest4146253-21latency_hist19:55:011
4099847993531,3cyclictest3272820-21kworker/u8:3+flush-8:020:42:460
4099847993531,3cyclictest3272820-21kworker/u8:3+flush-8:020:42:460
4099847993525,9cyclictest86150-21systemd-run22:10:000
4099849993430,2cyclictest170401-21cron23:35:001
4099849993427,5cyclictest96469-21apt-get22:22:381
4099849993427,5cyclictest4085034-21kworker/u8:1+events_unbound19:27:521
4099849993425,7cyclictest44897-21kworker/u8:1+events_unbound21:52:571
4099847993430,3cyclictest4099724-21kworker/u8:2+flush-8:020:12:550
4099849993327,5cyclictest44897-21kworker/u8:1+flush-8:021:42:441
4099849993326,5cyclictest4151209-21latency_hist20:00:011
4099849993325,6cyclictest86579-21apt-get22:12:411
4099849993325,6cyclictest86579-21apt-get22:12:411
4099849993325,6cyclictest44897-21kworker/u8:1+flush-8:022:37:541
4099849993228,3cyclictest4146096-21kworker/u8:0+flush-8:020:57:581
4099849993226,5cyclictest155403-21kworker/u8:3+flush-8:023:22:581
4099849993226,4cyclictest169885-21kworker/u8:1+events_unbound00:12:561
4099849993222,8cyclictest4185377-21ntpq20:32:551
4099847993226,4cyclictest61926-21aten2_r5power_v21:47:410
4099847993225,5cyclictest135868-21kworker/u8:1+flush-8:023:02:440
409984799322,25cyclictest140800-21kworker/0:2+events00:10:230
4099852993127,3cyclictest4131442-21sendmail19:40:002
4099849993127,3cyclictest395-21dbus-daemon23:40:001
4099849993126,4cyclictest21170-21cron00:25:001
4099849993126,3cyclictest199894-21unixbench_multi00:02:571
4099847993126,4cyclictest278-21systemd-journal19:45:000
4099847993123,6cyclictest7828-21sshd20:52:440
409984799312,24cyclictest6930-21kworker/0:1+events22:51:000
409984799311,25cyclictest140800-21kworker/0:2+events23:31:070
409984799311,25cyclictest140800-21kworker/0:2+events00:25:030
4099849993026,3cyclictest66116-21kworker/u8:0+events_unbound23:12:411
4099849993025,4cyclictest26537-21kworker/u8:2+events_unbound21:17:531
4099849993025,3cyclictest0-21swapper/100:30:011
4099849993024,4cyclictest155403-21kworker/u8:3+events_unbound00:17:451
409984999301,27cyclictest1-21systemd20:50:011
409984999301,27cyclictest1-21systemd20:50:001
4099847993026,3cyclictest155403-21kworker/u8:3+events_unbound00:25:000
409984799301,24cyclictest4094831-21kworker/0:2+events19:20:070
409984799300,25cyclictest6930-21kworker/0:1+events21:31:270
4099849992925,2cyclictest0-21swapper/120:40:001
4099849992924,3cyclictest400-21mta-sts-daemon23:52:451
4099849992924,3cyclictest145496-21unixbench_multi23:08:001
4099849992924,3cyclictest139709-21kthreadcore23:02:501
4099849992922,5cyclictest51465-21cron21:35:001
4099849992921,6cyclictest76196-21latency_hist22:00:001
4099847992924,4cyclictest155403-21kworker/u8:3+events_unbound23:20:000
4099847992924,3cyclictest124470-21kworker/u8:3+events_unbound22:50:010
4099847992923,4cyclictest229990-21latency_hist00:35:010
409984799292,26cyclictest4094831-21kworker/0:2+events19:45:030
409985299280,9cyclictest146830-21irqcore23:12:442
409984999289,5cyclictest0-21swapper/120:44:281
409984999289,5cyclictest0-21swapper/120:44:271
4099849992824,2cyclictest0-21swapper/119:12:441
4099847992824,3cyclictest101150-21awk22:25:010
4099847992824,2cyclictest81193-21systemd-run22:05:000
4099847992820,6cyclictest278-21systemd-journal19:30:000
409984799280,27cyclictest22594-21sshd21:07:440
4099852992724,2cyclictest166261-21fschecks_time23:32:422
4099849992723,3cyclictest3272820-21kworker/u8:3+flush-8:021:13:011
4099849992723,2cyclictest111133-21systemd-run22:35:011
4099849992722,4cyclictest3272820-21kworker/u8:3+flush-8:020:17:541
4099849992721,4cyclictest95791-21unixbench_singl22:17:581
4099849992721,4cyclictest95791-21unixbench_singl22:17:581
409984799272,24cyclictest140800-21kworker/0:2+events23:56:030
409984799272,24cyclictest140800-21kworker/0:2+events23:05:150
4099847992722,3cyclictest4190984-21cron20:40:000
4099847992721,4cyclictest190383-21latency_hist23:55:000
4099847992718,6cyclictest205080-21latency_hist00:10:010
409984799271,25cyclictest140800-21kworker/0:2+events23:44:550
4099852992622,2cyclictest200945-21fschecks_time00:07:432
4099852992620,4cyclictest76238-21kworker/u8:2+flush-8:022:05:002
4099849992622,3cyclictest44897-21kworker/u8:1+events_unbound22:47:461
4099849992622,3cyclictest4146096-21kworker/u8:0+flush-8:020:28:011
4099849992622,2cyclictest4152396-21irqrtprio20:02:461
4099849992621,3cyclictest165294-21unixbench_singl23:27:591
4099849992620,4cyclictest66116-21kworker/u8:0+flush-8:022:57:461
4099849992618,6cyclictest4116598-21latency_hist19:25:011
409984799267,18cyclictest6930-21kworker/0:1+events21:59:070
409984799266,19cyclictest4094831-21kworker/0:2+events19:57:350
409984799262,19cyclictest4094831-21kworker/0:2+events19:50:080
4099847992621,4cyclictest3272820-21kworker/u8:3+events_unbound19:15:030
4099852992516,7cyclictest4156900-21fschecks_time20:07:422
409984999258,5cyclictest0-21swapper/100:09:171
409984999257,5cyclictest0-21swapper/121:39:311
4099849992520,4cyclictest4085034-21kworker/u8:1+events_unbound19:17:571
4099849992517,6cyclictest44897-21kworker/u8:1+events_unbound22:02:521
409984799256,18cyclictest6930-21kworker/0:1+events22:37:360
409984799254,20cyclictest6930-21kworker/0:1+events22:27:110
409984799252,21cyclictest4094831-21kworker/0:2+events20:47:470
409984799252,21cyclictest4094831-21kworker/0:2+events20:47:470
4099847992521,3cyclictest96043-21systemd-run22:20:000
4099847992521,3cyclictest96043-21systemd-run22:20:000
4099847992521,3cyclictest3272820-21kworker/u8:3+flush-8:020:19:490
4099847992520,4cyclictest4146096-21kworker/u8:0+flush-8:021:27:450
4099847992520,4cyclictest124470-21kworker/u8:3+flush-8:022:57:550
4099847992520,3cyclictest6587-21kworker/u8:1+events_unbound20:55:530
4099847992519,4cyclictest4186035-21latency_hist20:35:000
4099847992513,5cyclictest0-21swapper/021:42:490
409985299242,9cyclictest0-21swapper/222:16:072
409985299242,9cyclictest0-21swapper/222:16:062
4099852992421,2cyclictest371rcuc/220:41:142
4099852992421,2cyclictest371rcuc/220:41:142
4099852992421,2cyclictest215639-21cpuspeed_turbos00:22:412
4099852992419,3cyclictest91036-21cron22:15:002
4099852992419,3cyclictest91036-21cron22:15:002
4099852992414,5cyclictest4176607-21apt-get20:27:392
4099849992421,2cyclictest81849-21cpuspeed_turbos22:07:411
4099849992420,2cyclictest126578-21cpuspeed_turbos22:52:411
4099849992419,4cyclictest3272820-21kworker/u8:3+flush-8:021:22:521
4099849992416,6cyclictest175862-21apt-get23:42:381
4099849992414,7cyclictest278-21systemd-journal21:28:441
409984799246,17cyclictest140800-21kworker/0:2+events00:37:230
409984799245,18cyclictest6930-21kworker/0:1+events22:11:590
409984799245,18cyclictest6930-21kworker/0:1+events22:11:590
409984799245,18cyclictest4094831-21kworker/0:2+events20:26:030
4099847992419,4cyclictest155403-21kworker/u8:3+events_unbound23:27:430
4099847992419,3cyclictest185095-21unixbench_singl23:48:110
4099847992419,3cyclictest185095-21unixbench_singl23:48:110
4099847992413,8cyclictest278-21systemd-journal21:12:440
586382230,2sleep3577-21kworker/3:2+events21:42:483
409985299236,5cyclictest0-21swapper/200:17:442
4099852992320,2cyclictest371rcuc/221:06:452
4099852992320,2cyclictest133221-21kthreadcore22:57:472
4099852992318,3cyclictest190878-21cpuspeed_turbos23:57:412
409985299231,6cyclictest4104271-21/usr/sbin/munin19:12:552
4099852992312,6cyclictest4125990-21/usr/sbin/munin19:32:572
409985299230,6cyclictest4185556-21/usr/sbin/munin20:32:582
409985299230,11cyclictest111242-21sed22:35:012
409984999235,5cyclictest0-21swapper/123:19:091
4099849992319,2cyclictest0-21swapper/120:07:421
4099849992310,2cyclictest0-21swapper/122:40:181
409984799232,20cyclictest4094831-21kworker/0:2+events19:35:040
409984799231,21cyclictest4094831-21kworker/0:2+events20:02:430
409984799231,21cyclictest4094831-21kworker/0:2+events19:10:230
409985299226,5cyclictest0-21swapper/200:32:562
409985299223,9cyclictest0-21swapper/223:01:482
409985299223,8cyclictest0-21swapper/222:52:322
4099852992219,2cyclictest371rcuc/221:53:282
4099852992219,2cyclictest371rcuc/221:48:582
4099852992219,2cyclictest371rcuc/221:30:492
4099852992219,2cyclictest371rcuc/219:41:092
4099852992219,2cyclictest371rcuc/219:21:302
4099849992217,3cyclictest185062-21unixbench_multi23:48:101
4099849992217,3cyclictest185062-21unixbench_multi23:48:101
4099849992214,6cyclictest229326-21ntpq00:32:551
4099847992217,4cyclictest40381-21kthreadcore21:22:480
409984799221,20cyclictest6930-21kworker/0:1+events22:40:150
409984799221,20cyclictest140800-21kworker/0:2+events23:23:070
409984799221,20cyclictest140800-21kworker/0:2+events23:13:070
40951562222,2sleep00-21swapper/019:06:390
409985299214,9cyclictest0-21swapper/219:15:552
409985299213,9cyclictest0-21swapper/220:57:502
409985299213,5cyclictest0-21swapper/219:57:552
4099852992118,2cyclictest371rcuc/222:20:402
4099852992118,2cyclictest371rcuc/220:46:112
4099852992118,2cyclictest371rcuc/220:46:112
4099852992118,2cyclictest115844-21head22:38:002
4099852992117,3cyclictest57146-21fschecks_count21:42:442
4099852992117,3cyclictest106138-21cron22:30:002
4099852992116,3cyclictest72018-21fschecks_time21:57:422
409985299211,11cyclictest185057-21tail23:48:102
409985299211,11cyclictest185057-21tail23:48:102
409985299210,11cyclictest1-21systemd21:25:002
409984799213,17cyclictest140800-21kworker/0:2+events00:17:110
409985299207,8cyclictest4151674-21apt-get20:02:402
409985299206,6cyclictest0-21swapper/223:10:012
409985299205,4cyclictest0-21swapper/221:03:062
409985299204,4cyclictest0-21swapper/222:07:252
409985299202,13cyclictest156056-21apt-get23:22:412
4099852992017,2cyclictest371rcuc/219:50:512
4099852992017,2cyclictest371rcuc/200:11:452
4099852992016,2cyclictest0-21swapper/200:02:452
4099852992012,2cyclictest161rcu_preempt20:53:062
4099852992011,4cyclictest27154-21apt-get21:12:422
409985299199,7cyclictest186341-21sed23:52:462
409985299192,8cyclictest0-21swapper/219:46:532
409985299192,5cyclictest0-21swapper/223:42:462
4099852991916,2cyclictest371rcuc/221:35:222
4099852991916,2cyclictest371rcuc/221:17:092
4099852991916,2cyclictest371rcuc/220:35:162
4099852991916,2cyclictest371rcuc/220:16:102
40950512193,10sleep20-21swapper/219:05:162
40950472193,9sleep30-21swapper/319:05:133
409985299189,7cyclictest4164055-21tr20:12:482
409985299185,2cyclictest0-21swapper/222:47:512
409985299184,4cyclictest0-21swapper/219:26:182
409985299182,8cyclictest0-21swapper/223:27:492
4099852991814,2cyclictest170947-21aten2_r5power_p23:37:402
409985299177,2cyclictest161rcu_preempt23:15:222
409985299173,5cyclictest0-21swapper/220:21:222
4099852991714,2cyclictest371rcuc/221:28:242
409985299170,4cyclictest39-21ksoftirqd/222:40:472
41765902162,9sleep30-21swapper/320:27:393
712812132,6sleep30-21swapper/321:55:013
624512130,2sleep3471rcuc/321:47:463
41860502132,6sleep30-21swapper/320:35:013
41377382132,7sleep30-21swapper/319:47:473
41215432132,6sleep30-21swapper/319:30:013
2033402132,6sleep30-21swapper/300:07:493
1956162133,7sleep30-21swapper/300:02:403
1754242132,6sleep30-21swapper/323:40:013
1499542133,6sleep30-21swapper/323:12:533
904062122,6sleep30-21swapper/322:12:583
904062122,6sleep30-21swapper/322:12:583
816242122,6sleep30-21swapper/322:07:413
60182122,7sleep30-21swapper/320:47:533
60182122,7sleep30-21swapper/320:47:533
428922122,6sleep30-21swapper/321:27:493
41823782122,6sleep30-21swapper/320:32:493
41717742122,6sleep30-21swapper/320:22:453
41709302122,5sleep30-21swapper/320:20:003
41611412122,6sleep30-21swapper/320:10:013
41561222123,5sleep30-21swapper/320:05:003
41462342122,6sleep30-21swapper/319:55:013
41306852123,5sleep30-21swapper/319:37:523
41170122122,6sleep30-21swapper/319:27:373
374372122,6sleep30-21swapper/321:22:443
316472122,6sleep30-21swapper/321:15:013
2300052122,6sleep30-21swapper/300:35:013
2293562122,6sleep30-21swapper/300:32:573
221232122,6sleep30-21swapper/321:06:513
2207052122,6sleep30-21swapper/300:27:433
2064142122,6sleep30-21swapper/300:12:473
192802122,6sleep30-21swapper/321:02:493
1857362122,6sleep30-21swapper/323:52:413
1811762122,6sleep30-21swapper/323:47:433
1811762122,6sleep30-21swapper/323:47:433
1697952122,6sleep30-21swapper/323:32:563
1506712122,6sleep30-21swapper/323:15:023
14932122,6sleep30-21swapper/320:42:563
14932122,6sleep30-21swapper/320:42:553
1419412122,6sleep30-21swapper/323:07:473
1265992122,6sleep30-21swapper/322:52:423
123182122,6sleep30-21swapper/320:57:403
1119362122,6sleep30-21swapper/322:37:463
960342112,5sleep30-21swapper/322:20:013
952462112,5sleep30-21swapper/322:17:523
952462112,5sleep30-21swapper/322:17:523
769712112,6sleep30-21swapper/322:02:433
671262112,5sleep30-21swapper/321:52:443
518822112,5sleep30-21swapper/321:37:283
495042112,5sleep30-21swapper/321:32:503
41566452112,5sleep30-21swapper/320:07:413
41416872112,5sleep30-21swapper/319:51:443
41317432112,5sleep30-21swapper/319:41:013
41119922112,5sleep30-21swapper/319:21:473
41070192113,5sleep30-21swapper/319:16:533
41001812112,5sleep30-21swapper/319:12:363
358842112,5sleep30-21swapper/321:17:543
2152332112,6sleep30-21swapper/300:20:333
2144702112,5sleep30-21swapper/300:17:563
1608442112,6sleep30-21swapper/323:26:043
1605252112,5sleep30-21swapper/323:25:003
1360782113,5sleep30-21swapper/323:00:133
1311462112,6sleep30-21swapper/322:55:473
1213042112,6sleep30-21swapper/322:46:293
1164722112,6sleep30-21swapper/322:42:313
111712112,5sleep30-21swapper/320:52:553
1069092112,5sleep30-21swapper/322:32:443
1053992112,6sleep30-21swapper/322:27:513
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional