You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 22:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Sep 23, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
111131521860,4sleep3481ktimers/308:59:033
1003962996656,7cyclictest1154583-21latency_hist09:40:010
1003962996051,6cyclictest1134808-21latency_hist09:20:010
1003962995849,6cyclictest1253668-21latency_hist11:20:010
1003962995747,7cyclictest278-21systemd-journal12:10:010
1003964995344,6cyclictest1025601-21latency_hist07:30:011
1003962995139,9cyclictest278-21systemd-journal10:35:000
1003964994944,3cyclictest974891-21kworker/u8:3+flush-8:008:53:581
1003964994738,7cyclictest1283927-21/usr/sbin/munin11:54:061
1003962994741,4cyclictest1008984-21kworker/u8:1+events_unbound07:15:030
1003964994638,6cyclictest1318579-21/usr/sbin/munin12:29:121
1003964994638,6cyclictest1026128-21/usr/sbin/munin07:34:121
1003964994637,6cyclictest1164448-21latency_hist09:50:011
1003962994639,5cyclictest278-21systemd-journal08:35:000
1003964994537,6cyclictest1229502-21apt-get10:58:571
1003964994537,6cyclictest1129893-21latency_hist09:15:021
1003964994535,8cyclictest1178701-21ntpq10:04:101
1003962994535,8cyclictest1332321-21ntpq12:39:130
1003964994437,5cyclictest974891-21kworker/u8:3+flush-8:009:09:121
1003964994337,4cyclictest1050655-21kworker/u8:1+flush-8:008:28:581
1003964994235,5cyclictest1203914-21grep10:29:161
1003964994235,5cyclictest1015692-21latency_hist07:20:001
1003964994234,6cyclictest1303207-21latency_hist12:10:011
1003962994236,4cyclictest1204504-21kworker/u8:3+flush-8:011:33:580
1003964994136,3cyclictest1323242-21kworker/u8:1+flush-8:012:39:041
1003964994134,5cyclictest278-21systemd-journal11:09:251
1003968994031,7cyclictest1293865-21apt-get12:03:542
1003964994033,5cyclictest1199099-21latency_hist10:25:011
1003964994031,7cyclictest1140305-21/usr/sbin/munin09:29:071
1003962994029,9cyclictest1209792-21diskstats10:39:030
1003964993935,3cyclictest3843455-21kworker/u8:2+flush-8:008:24:041
1003964993932,5cyclictest1050943-21apt-get07:58:541
1003964993931,6cyclictest1044854-21ntpq07:49:081
1003962993935,3cyclictest1089973-21kworker/u8:0+flush-8:011:44:160
1003962993933,4cyclictest1204504-21kworker/u8:3+flush-8:011:02:250
1003962993932,5cyclictest278-21systemd-journal09:06:570
11988032380,9sleep3451irq_work/310:24:143
1003964993829,6cyclictest1248729-21latency_hist11:15:011
1003964993733,3cyclictest1089973-21kworker/u8:0+flush-8:008:48:591
1003964993630,4cyclictest974891-21kworker/u8:3+flush-8:007:39:091
1003964993628,6cyclictest1089973-21kworker/u8:0+flush-8:009:34:131
1003962993631,3cyclictest1194968-21fschecks_count10:23:580
1003964993530,4cyclictest1253614-21kworker/u8:4+flush-8:011:39:051
1003964993530,4cyclictest1253614-21kworker/u8:4+flush-8:011:39:051
1003964993530,4cyclictest1204504-21kworker/u8:3+flush-8:011:28:301
1003964993529,5cyclictest1089973-21kworker/u8:0+events_unbound08:44:001
1003964993529,5cyclictest1089973-21kworker/u8:0+events_unbound08:44:001
1003964993528,5cyclictest1089973-21kworker/u8:0+flush-8:008:39:141
1003964993525,8cyclictest1223389-21ntpq10:49:071
1003962993527,6cyclictest278-21systemd-journal08:30:000
1003962993524,9cyclictest1322406-21ntpq12:29:080
1003968993426,6cyclictest1081132-21cut08:28:582
1003964993429,3cyclictest1066228-21cpuspeed_turbos08:14:011
1003962993429,4cyclictest1089973-21kworker/u8:0+flush-8:008:44:180
1003962993429,4cyclictest1089973-21kworker/u8:0+flush-8:008:44:180
1003968993328,4cyclictest278-21systemd-journal09:20:002
1003968993326,5cyclictest278-21systemd-journal07:35:012
1003964993329,2cyclictest1254956-21irqrtprio11:24:041
1003964993328,3cyclictest1204504-21kworker/u8:3+events_unbound11:59:081
1003964993328,3cyclictest1120026-21latency_hist09:05:011
1003964993327,5cyclictest1089973-21kworker/u8:0+flush-8:010:19:121
1003964993327,4cyclictest1204504-21kworker/u8:3+flush-8:011:19:091
1003962993326,5cyclictest1288366-21kworker/u8:2+flush-8:012:24:000
1003962993326,5cyclictest1050655-21kworker/u8:1+events_unbound08:03:580
1003962993323,7cyclictest1233915-21latency_hist11:00:010
1003964993227,4cyclictest961004-21kworker/u8:0+flush-8:007:24:141
1003964993227,4cyclictest1050655-21kworker/u8:1+events_unbound10:09:161
1003964993226,4cyclictest1293550-21kworker/u8:0+flush-8:012:14:071
1003964993226,3cyclictest1131166-21irqrtprio09:19:041
1003964993225,6cyclictest1050655-21kworker/u8:1+events_unbound10:13:561
1003964993224,6cyclictest1169961-21apt-get09:58:581
1003962993227,4cyclictest974891-21kworker/u8:3+flush-8:008:59:000
1003962993224,6cyclictest1219630-21apt-get10:48:530
1003962993222,7cyclictest1169412-21latency_hist09:55:010
1003964993125,5cyclictest1050655-21kworker/u8:1+events_unbound10:44:131
1003964993125,4cyclictest974891-21kworker/u8:3+flush-8:008:34:071
1003964993125,4cyclictest1089973-21kworker/u8:0+events_unbound11:43:591
1003964993124,5cyclictest1204504-21kworker/u8:3+flush-8:010:34:031
1003964993124,5cyclictest1135088-21kworker/u8:2+flush-8:009:53:301
1003964993123,6cyclictest1288366-21kworker/u8:2+flush-8:012:24:101
100396299316,23cyclictest1164486-21kworker/0:1+events11:48:550
1003962993121,8cyclictest1109546-21ntpq08:54:090
1003968993021,7cyclictest1095230-21gpgv08:40:002
1003964993024,4cyclictest1110686-21apt-get08:58:561
1003962993025,3cyclictest1089973-21kworker/u8:0+events_unbound08:39:150
1003962993024,4cyclictest3843455-21kworker/u8:2+events_unbound07:45:010
1003962993021,7cyclictest1204027-21latency_hist10:30:010
1003964992924,3cyclictest3843455-21kworker/u8:2+flush-8:008:19:031
1003964992923,4cyclictest1050655-21kworker/u8:1+events_unbound09:39:081
1003964992922,5cyclictest1209543-21apt-get10:38:591
1003962992926,2cyclictest1184255-21latency_hist10:10:000
1003962992926,2cyclictest1070404-21systemd-run08:15:000
1003962992922,5cyclictest1065214-21apt-get08:10:010
1003962992921,6cyclictest1080269-21latency_hist08:25:010
1003968992824,2cyclictest1263452-21unixbench_multi11:29:142
1003964992823,3cyclictest1264893-21irqrtprio11:34:011
1003964992822,4cyclictest1298536-21kworker/u8:1+events_unbound12:19:111
1003964992821,5cyclictest1278974-21/usr/sbin/munin11:49:071
1003962992824,2cyclictest1101545-21irqrtprio08:49:030
1003962992823,4cyclictest1288366-21kworker/u8:2+events_unbound12:20:010
1003962992823,4cyclictest1050655-21kworker/u8:1+flush-8:009:47:350
1003962992818,8cyclictest1149077-21ntpq09:34:090
1003968992723,2cyclictest1312920-21unixbench_multi12:19:182
1003968992723,2cyclictest1224828-21fschecks_count10:53:592
1003964992722,3cyclictest1060322-21systemd-run08:05:001
1003964992719,6cyclictest961004-21kworker/u8:0+events_unbound07:54:081
1003962992724,2cyclictest1003956-21cyclictest11:15:000
1003962992723,2cyclictest1045482-21systemd-run07:50:010
100396299272,24cyclictest1164486-21kworker/0:1+events10:04:310
100396299272,24cyclictest1164486-21kworker/0:1+events09:57:390
1003962992717,8cyclictest1029952-21ntpq07:34:080
1003968992622,2cyclictest1313961-21fschecks_time12:24:002
1003968992622,2cyclictest1274414-21fschecks_time11:44:002
1003968992621,4cyclictest974891-21kworker/u8:3+flush-8:008:33:592
1003968992620,4cyclictest1050222-21unixbench_multi07:54:142
1003968992619,6cyclictest1323004-21cron12:30:002
1003968992618,6cyclictest278-21systemd-journal07:40:002
1003964992620,4cyclictest1050655-21kworker/u8:1+events_unbound10:53:591
1003962992619,4cyclictest0-21swapper/009:03:590
100396299260,25cyclictest993780-21kworker/0:2+events07:35:230
1003968992522,2cyclictest1066057-21aten2_r5power_e08:13:592
1003968992521,2cyclictest1279084-21aten2_r5power_p11:48:582
1003968992521,2cyclictest1125571-21aten2_r5power_p09:13:582
1003964992520,3cyclictest1293839-21/usr/sbin/munin12:04:111
1003964992514,8cyclictest278-21systemd-journal08:10:001
1003964992513,8cyclictest278-21systemd-journal12:35:001
1003962992521,3cyclictest0-21swapper/011:25:010
1003962992520,4cyclictest1204504-21kworker/u8:3+flush-8:011:27:290
1003962992520,4cyclictest1129882-21cron09:15:000
1003962992520,3cyclictest0-21swapper/010:45:010
1003962992519,4cyclictest1204504-21kworker/u8:3+flush-8:011:59:290
1003962992519,3cyclictest0-21swapper/007:53:560
1003962992516,7cyclictest1328000-21latency_hist12:35:010
1003962992516,7cyclictest1144720-21latency_hist09:30:010
100396299251,23cyclictest993780-21kworker/0:2+events07:58:550
1003968992421,2cyclictest1050973-21aten2_r5power_c07:58:562
1003968992420,2cyclictest1150260-21aten2_r5power_e09:38:592
1003968992420,2cyclictest1110952-21fschecks_count08:59:002
1003968992420,2cyclictest0-21swapper/210:30:002
1003968992418,4cyclictest1243624-21unixbench_multi11:09:142
100396299242,21cyclictest1164486-21kworker/0:1+events11:09:030
1003962992420,2cyclictest1224594-21aten2_r5power_c10:53:570
100396299240,23cyclictest993780-21kworker/0:2+events07:13:550
1003968992320,2cyclictest1041083-21aten2_r5power_c07:48:562
1003968992319,2cyclictest1175128-21cpuspeed_turbos10:03:582
1003964992318,3cyclictest0-21swapper/109:25:011
1003964992318,2cyclictest0-21swapper/109:44:081
1003964992317,4cyclictest1050655-21kworker/u8:1+flush-8:011:00:311
1003962992319,2cyclictest0-21swapper/011:40:000
1003962992319,2cyclictest0-21swapper/011:40:000
1003962992319,2cyclictest0-21swapper/009:43:550
1003968992219,2cyclictest1284170-21cpuspeed_turbos11:53:572
1003968992219,2cyclictest1096222-21fschecks_time08:44:012
1003968992219,2cyclictest1096222-21fschecks_time08:44:002
1003968992218,3cyclictest1060196-21unixbench_singl08:04:152
1003968992218,2cyclictest1071018-21aten2_r5power_p08:18:572
1003968992217,3cyclictest1233901-21sh11:00:002
1003968992213,2cyclictest0-21swapper/210:34:132
100396299227,14cyclictest1164486-21kworker/0:1+events12:03:590
100396299225,16cyclictest993780-21kworker/0:2+events07:29:030
100396299225,16cyclictest1164486-21kworker/0:1+events10:14:030
1003962992220,1cyclictest0-21swapper/008:19:130
1003962992216,4cyclictest1050655-21kworker/u8:1+flush-8:010:19:030
9992542214,11sleep10-21swapper/107:06:501
9992542214,11sleep10-21swapper/107:06:501
100396899212,13cyclictest1169961-21apt-get09:59:002
1003968992118,2cyclictest1008699-21unixbench_singl07:14:152
1003968992116,4cyclictest974891-21kworker/u8:3+flush-8:007:44:002
1003968992116,3cyclictest1025485-21unixbench_singl07:29:152
1003964992113,5cyclictest974891-21kworker/u8:3+flush-8:007:14:131
100396299216,14cyclictest1164486-21kworker/0:1+events12:10:590
1003968992017,2cyclictest1268396-21unixbench_multi11:34:142
1003968992016,3cyclictest1258487-21unixbench_multi11:24:162
1003968992016,3cyclictest0-21swapper/209:55:002
1003968992016,2cyclictest1209894-21fschecks_time10:39:042
1003968992016,2cyclictest0-21swapper/208:24:142
1003968992012,6cyclictest1014532-21tr07:19:052
1003968992011,6cyclictest1219291-21cp10:45:012
1003968992010,3cyclictest0-21swapper/208:45:062
1003964992014,3cyclictest0-21swapper/107:44:061
100396299205,14cyclictest1164486-21kworker/0:1+events11:52:240
1003962992016,2cyclictest0-21swapper/009:25:010
10031882203,10sleep01003221-21ntp_states07:09:100
10031882203,10sleep01003221-21ntp_states07:09:100
11061802190,6chrt0-21swapper/208:54:002
100396899199,8cyclictest1161169-21tr09:49:032
1003968991915,2cyclictest0-21swapper/209:44:092
1003968991915,2cyclictest0-21swapper/209:29:082
1003968991911,6cyclictest1198933-21unixbench_multi10:24:142
1003962991915,2cyclictest0-21swapper/007:23:580
10032492194,8sleep20-21swapper/207:09:122
10032492194,8sleep20-21swapper/207:09:122
100396899189,7cyclictest1245727-21tr11:14:022
1003968991814,2cyclictest0-21swapper/211:04:152
1003968991814,2cyclictest0-21swapper/209:35:012
1003968991814,2cyclictest0-21swapper/208:10:012
9993282173,8sleep30-21swapper/307:07:493
9993282173,8sleep30-21swapper/307:07:493
11545692177,5sleep30-21swapper/309:40:013
100396899179,6cyclictest1306694-21tr12:14:042
100396899179,6cyclictest1253554-21unixbench_singl11:19:192
100396899177,8cyclictest1222379-21cut10:49:032
100396899172,11cyclictest1188512-21ntpq10:14:052
1003968991713,3cyclictest1269344-21tr11:39:002
1003968991713,3cyclictest1269344-21tr11:39:002
1003968991713,2cyclictest0-21swapper/209:08:552
1003968991713,2cyclictest0-21swapper/207:23:572
1003968991712,3cyclictest0-21swapper/211:59:072
100396899170,15cyclictest1-21systemd12:32:252
100396899162,13cyclictest0-21swapper/209:23:252
1003968991613,2cyclictest0-21swapper/212:37:542
1003968991613,2cyclictest0-21swapper/210:06:372
1003968991612,2cyclictest0-21swapper/209:04:002
1003968991611,4cyclictest0-21swapper/212:08:572
12299922153,8sleep30-21swapper/310:59:063
1003968991512,2cyclictest0-21swapper/210:18:012
12679462142,8sleep30-21swapper/311:34:093
13274452132,7sleep30-21swapper/312:34:123
13128692132,7sleep30-21swapper/312:19:193
12974732134,5sleep30-21swapper/312:04:063
12438072132,6sleep30-21swapper/311:10:013
12188542132,6sleep30-21swapper/310:45:013
11941042132,6sleep30-21swapper/310:20:013
11695042132,6sleep30-21swapper/309:55:013
10894902132,7sleep30-21swapper/308:34:083
10547142132,7sleep30-21swapper/307:59:093
10305632132,6sleep30-21swapper/307:35:013
10157232132,6sleep30-21swapper/307:20:013
13289242122,6sleep30-21swapper/312:39:053
13179672122,6sleep30-21swapper/312:24:163
12888972123,6sleep30-21swapper/311:59:013
12876652122,6sleep30-21swapper/311:54:073
12790032122,6sleep30-21swapper/311:48:573
12685842122,5sleep30-21swapper/311:35:013
12685842122,5sleep30-21swapper/311:35:013
12635342122,6sleep30-21swapper/311:29:153
12579802123,5sleep30-21swapper/311:24:113
12384812122,6sleep30-21swapper/311:04:153
12282842123,5sleep30-21swapper/310:54:093
12148382122,6sleep30-21swapper/310:44:013
12043112123,6sleep30-21swapper/310:30:493
11869352122,6sleep30-21swapper/310:14:033
11746312123,6sleep30-21swapper/310:00:393
11654862122,6sleep30-21swapper/309:54:013
11403342124,5sleep30-21swapper/309:28:573
11389892123,5sleep30-21swapper/309:24:083
11264662122,6sleep30-21swapper/309:14:053
11211562122,7sleep30-21swapper/309:09:033
11156152122,6sleep30-21swapper/309:03:573
11052252122,5sleep30-21swapper/308:50:013
11011922122,6sleep30-21swapper/308:49:013
10964632122,6sleep30-21swapper/308:44:033
10964632122,6sleep30-21swapper/308:44:033
10944512123,6sleep30-21swapper/308:39:103
10802962122,6sleep30-21swapper/308:25:013
10662482123,6sleep30-21swapper/308:14:023
10553612122,6sleep30-21swapper/308:00:013
10458702123,6sleep30-21swapper/307:52:273
10399582122,6sleep30-21swapper/307:44:123
10265932122,6sleep30-21swapper/307:34:013
10222582122,6sleep30-21swapper/307:29:033
10128402122,6sleep30-21swapper/307:19:043
10049912122,6sleep30-21swapper/307:14:033
13183192112,6sleep30-21swapper/312:25:333
13036452112,6sleep30-21swapper/312:12:493
12985942112,5sleep30-21swapper/312:06:193
12738502112,6sleep30-21swapper/311:41:313
12490282112,6sleep30-21swapper/311:16:033
12393532112,6sleep30-21swapper/311:08:503
12093082112,6sleep30-21swapper/310:36:193
11993242112,6sleep30-21swapper/310:25:073
11795642112,6sleep30-21swapper/310:05:253
11598092112,6sleep30-21swapper/309:45:383
11549532112,6sleep30-21swapper/309:41:413
11451562112,6sleep30-21swapper/309:32:503
11301802112,6sleep30-21swapper/309:15:533
10757982112,6sleep30-21swapper/308:23:253
10707632112,6sleep30-21swapper/308:17:033
10606902113,5sleep30-21swapper/308:07:073
10407392112,6sleep30-21swapper/307:45:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional