You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 01:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat Aug 08, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114747921480,2chrt575-21kworker/3:2+events08:53:063
10474742890,4chrt30-21ksoftirqd/107:15:031
11635442870,0sleep0201rcuc/009:12:540
10491782830,4sleep30-21swapper/307:17:533
10993262750,2chrt281rcuc/108:07:541
1041313995143,6cyclictest275-21systemd-journal08:50:011
1041313995143,6cyclictest275-21systemd-journal08:50:001
10900242490,2chrt471rcuc/307:57:533
1041313994942,5cyclictest1207588-21/usr/sbin/munin09:58:041
1041310994637,7cyclictest1301828-21apt-get11:30:000
1041313994434,7cyclictest275-21systemd-journal07:57:491
1041310994434,7cyclictest275-21systemd-journal10:45:010
1041317994236,4cyclictest1132608-21gpgv08:40:002
1041313994131,7cyclictest275-21systemd-journal11:23:111
1041310994132,7cyclictest275-21systemd-journal08:30:000
1041310994032,6cyclictest1366110-21grep12:33:060
1041310993931,6cyclictest1307748-21diskstats11:37:520
1041317993820,16cyclictest1251866-21unixbench_multi10:38:062
1041313993832,4cyclictest275-21systemd-journal07:48:101
1041313993827,8cyclictest275-21systemd-journal12:26:401
13692622370,3sleep30-21swapper/312:37:563
1041317993713,8cyclictest1070540-21seq07:37:562
1041313993728,6cyclictest1301824-21latency_hist11:30:011
1041310993727,7cyclictest275-21systemd-journal12:10:000
1041313993631,4cyclictest1327024-21kworker/u8:1+events_unbound12:00:011
1041313993626,8cyclictest275-21systemd-journal09:24:121
1041310993627,7cyclictest1350736-21ntpq12:17:580
1041310993627,6cyclictest1082899-21sshd07:48:100
1041317993523,11cyclictest1282712-21cpuspeed_turbos11:12:502
1041317993516,2cyclictest0-21swapper/207:45:012
1041313993529,4cyclictest275-21systemd-journal10:08:121
1041313993526,6cyclictest1226498-21ntpq10:13:011
1041310993526,7cyclictest1227904-21diskstats10:17:490
1041310993525,8cyclictest1048833-21diskstats07:17:500
1041317993421,12cyclictest1171633-21tail09:17:582
1041317993419,13cyclictest1218000-21cpuspeed_turbos10:07:472
1041317993418,2cyclictest1148374-21cpuspeed_turbos08:57:482
1041313993430,3cyclictest1339317-21kthreadcore12:07:561
1041310993421,10cyclictest275-21systemd-journal11:45:000
10410202343,6sleep10-21swapper/107:08:171
1041317993317,2cyclictest0-21swapper/210:45:002
1041317993311,7cyclictest1247248-21date10:35:012
1041313993224,6cyclictest1351946-21/usr/sbin/munin12:22:591
1041313993224,6cyclictest1053562-21apt-get07:22:461
1041313993223,7cyclictest1336711-21latency_hist12:05:011
1041310993228,3cyclictest1152478-21kworker/u8:2+events_unbound12:25:480
1041310993226,4cyclictest1152478-21kworker/u8:2+events_unbound11:00:000
1041310993224,5cyclictest1083296-21kworker/u8:1+flush-8:008:18:060
1041310993218,10cyclictest275-21systemd-journal07:44:100
1041317993115,3cyclictest1083571-21aten2_r5power_e07:52:472
1041317993115,2cyclictest0-21swapper/207:15:002
1041317993114,3cyclictest1192016-21unixbench_multi09:38:062
1041313993128,2cyclictest1043851-21kthreadcore07:12:501
1041313993126,4cyclictest1083296-21kworker/u8:1+flush-8:008:52:511
1041310993127,2cyclictest1062208-21needreboot07:27:580
1041310993127,2cyclictest1062208-21needreboot07:27:580
1041310993125,4cyclictest1148156-21apt-get08:57:450
1041310993125,3cyclictest1192973-21cpuspeed_turbos09:42:480
1041310993124,5cyclictest1053537-21/usr/sbin/munin07:23:040
1041310993122,7cyclictest1286236-21ntpq11:12:590
1041310993122,6cyclictest1282036-21latency_hist11:10:000
104131799303,8cyclictest1182842-21apt-get09:32:452
104131799302,8cyclictest1351972-21apt-get12:22:492
1041317993010,7cyclictest1202729-21cut09:52:472
1041310993024,4cyclictest1366778-21apt-get12:37:460
1041310993024,4cyclictest1197721-21apt-get09:47:460
1041310993024,4cyclictest1197721-21apt-get09:47:460
1041310993021,7cyclictest1345825-21ntpq12:13:000
1041310993020,7cyclictest1291930-21latency_hist11:20:010
104131099300,28cyclictest1247021-21unin-run10:35:000
1041317992915,2cyclictest1098420-21aten2_r5power_e08:07:482
1041313992926,2cyclictest1168669-21irqrtprio09:17:541
1041313992925,3cyclictest1317692-21fschecks_count11:47:491
1041313992923,5cyclictest993669-21kworker/u8:2+flush-8:007:52:501
1041313992923,4cyclictest1361843-21apt-get12:32:471
1041313992922,5cyclictest1132568-21latency_hist08:40:001
1041313992920,6cyclictest1127659-21latency_hist08:35:011
1041313992918,9cyclictest1326047-21ntpq11:52:591
1041310992923,4cyclictest1208536-21kthreadcore09:57:540
1041310992922,5cyclictest1067161-21needreboot07:32:570
1041317992822,4cyclictest1217075-21unixbench_multi10:03:052
1041317992815,2cyclictest0-21swapper/208:43:042
1041313992823,3cyclictest1152478-21kworker/u8:2+flush-8:011:38:051
1041310992823,3cyclictest1072119-21needreboot07:37:580
1041317992724,2cyclictest1177945-21aten2_r5power_e09:27:482
1041317992724,2cyclictest1147491-21unixbench_singl08:53:062
1041313992722,4cyclictest1058063-21kworker/u8:1+flush-8:007:32:501
1041313992721,4cyclictest1242483-21apt-get10:32:471
1041313992720,5cyclictest1192060-21grep09:38:061
1041313992718,7cyclictest275-21systemd-journal09:53:121
1041310992723,2cyclictest0-21swapper/009:30:000
1041310992722,4cyclictest1083296-21kworker/u8:1+flush-8:008:02:510
1041310992722,3cyclictest1327522-21fschecks_count11:57:510
1041310992722,3cyclictest1084045-21irqcore07:52:520
1041310992719,5cyclictest1045435-21ntpq07:12:530
10409982273,8sleep20-21swapper/207:08:022
1041317992623,2cyclictest1052821-21unixbench_multi07:18:052
1041317992614,2cyclictest0-21swapper/208:20:232
1041313992623,2cyclictest1272116-21sendmail11:00:001
1041313992621,3cyclictest0-21swapper/109:27:591
1041313992616,6cyclictest0-21swapper/110:35:031
1041310992622,3cyclictest1122689-21kworker/u8:3+flush-8:008:32:510
1041310992621,3cyclictest1232838-21cpuspeed_turbos10:22:520
1041310992620,3cyclictest1277092-21sh11:05:000
1041310992620,3cyclictest1277092-21sh11:05:000
1041310992619,5cyclictest20823-21cron10:40:000
1041310992617,7cyclictest1098337-21/usr/sbin/munin08:07:580
1041310992616,8cyclictest1306281-21ntpq11:32:580
1041317992522,2cyclictest1297480-21aten2_r5power_v11:27:502
1041317992520,3cyclictest1227970-21fschecks_time10:17:502
1041317992510,2cyclictest0-21swapper/210:47:502
1041313992520,3cyclictest0-21swapper/111:42:581
1041313992519,4cyclictest1073403-21apt-get07:42:461
1041313992519,3cyclictest0-21swapper/110:27:481
1041313992518,5cyclictest1252608-21apt-get10:42:481
1041313992517,6cyclictest1062256-21ntpq07:27:591
1041313992517,6cyclictest1062256-21ntpq07:27:591
1041310992520,4cyclictest1217558-21kworker/u8:0+events_unbound10:27:490
1041310992520,3cyclictest401-21dbus-daemon12:25:000
1041310992520,3cyclictest1267206-21systemd-run10:55:000
1041310992520,3cyclictest1222249-21cron10:10:000
1041310992518,5cyclictest1224439-21kthreadcore10:12:550
1041313992420,2cyclictest0-21swapper/111:20:001
1041313992420,2cyclictest0-21swapper/111:02:551
1041313992420,2cyclictest0-21swapper/111:02:551
1041313992420,2cyclictest0-21swapper/110:22:551
1041313992420,2cyclictest0-21swapper/110:17:531
1041313992420,2cyclictest0-21swapper/109:08:051
1041313992418,4cyclictest1148269-21aten2_r5power_v08:57:481
1041313992416,6cyclictest275-21systemd-journal08:44:121
1041313992415,7cyclictest275-21systemd-journal08:20:011
104131099242,16cyclictest1321257-21chrt11:48:010
1041310992419,4cyclictest1083296-21kworker/u8:1+events_unbound09:23:030
1041310992419,3cyclictest1162311-21unixbench_multi09:08:060
1041310992419,2cyclictest1213115-21cut10:02:500
1041310992416,6cyclictest1207147-21latency_hist09:55:010
1041317992320,2cyclictest1138554-21fschecks_time08:47:492
1041317992320,2cyclictest1138554-21fschecks_time08:47:492
1041317992317,4cyclictest275-21systemd-journal12:17:232
1041313992319,2cyclictest0-21swapper/108:13:041
1041313992318,3cyclictest1262021-21unixbench_multi10:48:061
1041313992318,3cyclictest1111970-21needreboot08:17:591
1041313992317,4cyclictest1291811-21kworker/u8:3+flush-8:011:32:171
1041313992315,6cyclictest1152478-21kworker/u8:2+flush-8:012:18:051
1041313992313,7cyclictest1197263-21latency_hist09:45:001
104131099236,3cyclictest11381712sshd08:47:120
104131099236,3cyclictest11381712sshd08:47:120
104131099232,14cyclictest571-21snmpd09:37:480
1041310992318,3cyclictest0-21swapper/010:43:010
1041310992318,3cyclictest0-21swapper/009:17:500
1041310992317,4cyclictest1117524-21grep08:23:080
1041310992312,8cyclictest275-21systemd-journal08:54:590
104131099231,10cyclictest1092233-21ntpq07:57:590
1041317992219,2cyclictest1118545-21fschecks_time08:27:502
1041317992218,3cyclictest1326372-21switchtime11:53:052
1041317992218,3cyclictest1158360-21fschecks_count09:07:512
1041313992219,2cyclictest1-21systemd07:40:011
1041313992218,2cyclictest0-21swapper/112:37:461
1041313992218,2cyclictest0-21swapper/109:03:041
1041313992218,2cyclictest0-21swapper/108:27:541
1041313992217,4cyclictest0-21swapper/108:05:001
1041313992217,3cyclictest0-21swapper/111:12:581
1041313992216,5cyclictest1213026-21cpuspeed_turbos10:02:481
1041313992213,7cyclictest1281381-21ntpq11:08:021
104131099222,14cyclictest571-21snmpd09:32:570
1041310992218,2cyclictest1128228-21aten2_r5power_v08:37:480
1041310992217,3cyclictest414-21systemd-logind08:15:000
1041310992213,6cyclictest275-21systemd-journal09:05:010
12963982210,3sleep3575-21kworker/3:2+events11:23:053
104131799212,14cyclictest1337168-21apt-get12:07:482
1041317992118,2cyclictest1312825-21fschecks_time11:42:512
1041317992118,2cyclictest1263060-21fschecks_time10:52:522
1041317992117,3cyclictest1318334-21kthreadcore11:47:532
1041317992116,3cyclictest1062744-21unixbench_multi07:28:062
1041317992116,3cyclictest1062744-21unixbench_multi07:28:062
104131799210,9cyclictest11059982kthreadcore08:12:562
1041313992117,2cyclictest0-21swapper/112:12:541
1041313992116,4cyclictest1183858-21kthreadcore09:32:521
1041313992116,3cyclictest0-21swapper/109:13:051
1041313992111,7cyclictest1202195-21latency_hist09:50:001
1041313992111,7cyclictest1202195-21latency_hist09:50:001
104131099219,9cyclictest1326809-21awk11:55:000
1041310992116,4cyclictest1083296-21kworker/u8:1+events_unbound08:42:480
1041317992017,2cyclictest1108374-21aten2_r5power_v08:17:492
1041317992016,3cyclictest1058031-21cron07:25:002
1041317992016,2cyclictest0-21swapper/212:03:002
1041313992016,2cyclictest0-21swapper/110:52:491
1041310992015,3cyclictest0-21swapper/012:03:040
1041310992012,6cyclictest1296229-21ntpq11:23:030
10411012203,11sleep00-21swapper/007:09:200
10406442203,8sleep30-21swapper/307:05:023
104131799192,12cyclictest1192738-21apt-get09:42:472
1041317991916,2cyclictest1123165-21aten2_r5power_c08:32:482
1041317991916,2cyclictest1097690-21unixbench_singl08:03:072
1041317991915,2cyclictest0-21swapper/210:00:012
1041317991913,3cyclictest1092941-21sh08:00:002
104131799191,13cyclictest1-21systemd09:25:002
104131799189,7cyclictest275-21systemd-journal12:15:002
104131799188,8cyclictest1222728-21cut10:12:482
1041317991815,2cyclictest1327316-21aten2_r5power_e11:57:492
1041317991814,2cyclictest0-21swapper/210:30:002
1041317991813,3cyclictest0-21swapper/207:48:082
104131799181,12cyclictest1163010-21apt-get09:12:472
104131799178,7cyclictest1367520-21sed12:37:542
104131799178,7cyclictest1312173-21sed11:40:012
1041317991714,2cyclictest0-21swapper/211:20:002
1041317991713,2cyclictest0-21swapper/211:07:502
104131799170,7cyclictest1276127-21tr11:02:592
104131799170,7cyclictest1276127-21tr11:02:592
104131799169,4cyclictest1066430-21cut07:32:552
104131799162,13cyclictest0-21swapper/212:26:102
1041317991612,2cyclictest0-21swapper/209:48:042
1041317991612,2cyclictest0-21swapper/209:48:032
1041317991611,3cyclictest0-21swapper/211:33:042
1041317991611,3cyclictest0-21swapper/210:22:582
104131799161,11cyclictest1294985-21kthreadcore11:22:572
104131799161,11cyclictest1267642-21apt-get10:57:472
13469912152,8sleep30-21swapper/312:17:483
13134452155,6sleep30-21swapper/311:42:563
104131799152,12cyclictest0-21swapper/212:33:052
11634642144,6sleep30-21swapper/309:12:543
104131799148,2cyclictest0-21swapper/209:00:312
12761242133,6sleep30-21swapper/311:03:003
12761242133,6sleep30-21swapper/311:03:003
12586612133,6sleep30-21swapper/310:47:553
12164332133,6sleep30-21swapper/310:02:573
11526682132,6sleep30-21swapper/309:00:023
11384902133,6sleep30-21swapper/308:47:513
11384902133,6sleep30-21swapper/308:47:503
11023682132,7sleep30-21swapper/308:08:053
10632592135,5sleep30-21swapper/307:30:343
10574072132,7sleep30-21swapper/307:23:053
13572902122,6sleep30-21swapper/312:27:543
13558092122,6sleep30-21swapper/312:23:043
13443312123,5sleep30-21swapper/312:12:573
13416062122,6sleep30-21swapper/312:10:003
13317992122,5sleep30-21swapper/312:00:013
13070612122,6sleep30-21swapper/311:35:013
13010362122,6sleep30-21swapper/311:27:593
12878312123,5sleep30-21swapper/311:17:523
12480242122,6sleep30-21swapper/310:37:523
12420472122,5sleep30-21swapper/310:30:013
12323742122,5sleep30-21swapper/310:20:023
12173442122,6sleep30-21swapper/310:05:023
12114732122,6sleep30-21swapper/309:58:033
12029042122,6sleep30-21swapper/309:52:503
11994362122,6sleep30-21swapper/309:47:563
11994362122,6sleep30-21swapper/309:47:563
11966322123,5sleep30-21swapper/309:43:033
11917492122,6sleep30-21swapper/309:38:053
11828162122,6sleep30-21swapper/309:32:443
11579212122,6sleep30-21swapper/309:06:113
11486262122,6sleep30-21swapper/308:57:533
11336612122,6sleep30-21swapper/308:42:523
11290012122,6sleep30-21swapper/308:37:563
11185732122,6sleep30-21swapper/308:27:523
11128022122,5sleep30-21swapper/308:20:013
11081692122,6sleep30-21swapper/308:17:003
11075792122,6sleep30-21swapper/308:13:073
10973142122,6sleep30-21swapper/308:03:043
10721572122,6sleep30-21swapper/307:38:003
10451042122,6sleep30-21swapper/307:12:523
13655372112,6sleep30-21swapper/312:32:593
13271652112,6sleep30-21swapper/311:56:563
13221062112,5sleep30-21swapper/311:50:023
13180712112,6sleep30-21swapper/311:47:533
13023662112,6sleep30-21swapper/311:31:123
12823072112,5sleep30-21swapper/311:10:423
12773282112,6sleep30-21swapper/311:05:083
12672082112,5sleep30-21swapper/310:55:013
12626372112,6sleep30-21swapper/310:52:123
12569082112,5sleep30-21swapper/310:43:093
12373332112,6sleep30-21swapper/310:25:203
12275882112,6sleep30-21swapper/310:17:143
12226462112,6sleep30-21swapper/310:12:123
11774492112,5sleep30-21swapper/309:25:013
11727202112,6sleep30-21swapper/309:20:243
11677092113,5sleep30-21swapper/309:15:023
11275502112,6sleep30-21swapper/308:33:493
10833732112,6sleep30-21swapper/307:51:163
10783752112,5sleep30-21swapper/307:45:023
10739032112,5sleep30-21swapper/307:42:543
10582612112,6sleep30-21swapper/307:25:043
10582612112,6sleep30-21swapper/307:25:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional