You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 15:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Apr 08, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117111121040,6chrt0-21swapper/207:46:372
1129996997151,17cyclictest280-21systemd-journal08:01:330
1129998995652,3cyclictest1305940-21kworker/u8:0+events_unbound10:11:341
1129998995349,3cyclictest1295696-21kworker/u8:1+events_unbound10:31:361
1129998995248,3cyclictest1271168-21kworker/u8:3+flush-8:010:16:221
1129996995235,15cyclictest1265795-21base6409:25:000
1129996995229,20cyclictest1359565-21ntpq10:56:290
13435852510,4chrt0-21swapper/010:41:280
1129998995147,3cyclictest1271168-21kworker/u8:3+events_unbound09:31:201
1129998995147,3cyclictest1271168-21kworker/u8:3+events_unbound09:31:201
1129996995140,8cyclictest1400916-21diskstats11:41:210
1129998995046,3cyclictest1166549-21kworker/u8:2+events_unbound09:51:331
1129998994945,3cyclictest1420315-21kworker/u8:1+events_unbound12:11:351
1129998994844,3cyclictest1320764-21kworker/u8:2+events_unbound10:21:321
1129998994844,3cyclictest1271168-21kworker/u8:3+events_unbound09:46:331
1129996994826,19cyclictest1381059-21diskstats11:21:200
1129996994825,20cyclictest280-21systemd-journal11:56:330
1129998994743,3cyclictest1434616-21kworker/u8:2+flush-8:012:21:211
1129998994741,5cyclictest302282-21kworker/u8:3+events_unbound07:51:191
1129998994641,4cyclictest1420315-21kworker/u8:1+flush-8:012:06:201
1129998994541,3cyclictest1166549-21kworker/u8:2+events_unbound09:16:361
1129998994440,3cyclictest1420315-21kworker/u8:1+events_unbound12:31:201
1129998994440,3cyclictest1320764-21kworker/u8:2+events_unbound10:36:211
1129998994440,3cyclictest1166549-21kworker/u8:2+events_unbound08:06:361
1129996994433,9cyclictest1424176-21ntpq12:01:290
1129998994339,3cyclictest1375213-21kworker/u8:0+flush-8:011:21:211
1129998994339,3cyclictest1320764-21kworker/u8:2+flush-8:011:01:211
1129998994339,3cyclictest1320764-21kworker/u8:2+events_unbound10:41:341
1129998994339,3cyclictest1241230-21kworker/u8:3+events_unbound09:21:331
1129998994238,3cyclictest1360168-21kworker/u8:1+flush-8:011:06:211
1129998994238,3cyclictest1320764-21kworker/u8:2+events_unbound10:51:201
1129998994238,3cyclictest1305940-21kworker/u8:0+flush-8:010:06:211
1129998994137,3cyclictest302282-21kworker/u8:3+events_unbound07:56:351
1129998994137,3cyclictest1390401-21kworker/u8:1+flush-8:011:31:371
1129998994137,3cyclictest1390401-21kworker/u8:1+flush-8:011:31:371
1129998994137,3cyclictest1166549-21kworker/u8:2+flush-8:010:01:221
1129996994121,17cyclictest280-21systemd-journal12:15:010
1129998994036,3cyclictest1420315-21kworker/u8:1+events_unbound12:26:331
1129998994036,3cyclictest1385167-21kworker/u8:3+events_unbound11:26:191
1129998994036,3cyclictest1166549-21kworker/u8:2+events_unbound09:06:201
1129996994020,18cyclictest1301338-21diskstats10:01:210
1129996994020,17cyclictest1369729-21ntpq11:06:290
1129998993935,3cyclictest1201430-21kworker/u8:1+flush-8:008:31:331
1129998993934,4cyclictest1166549-21kworker/u8:2+events_unbound08:46:361
1129998993933,4cyclictest1345839-21kworker/u8:3+events_unbound11:11:301
1129996993821,15cyclictest1171477-21turbostat.cron07:50:000
1129996993820,16cyclictest1300765-21sh10:00:010
1129996993819,16cyclictest280-21systemd-journal10:50:000
1129996993814,22cyclictest1-21systemd08:08:530
1129998993733,3cyclictest302282-21kworker/u8:3+events_unbound07:31:211
1129998993733,3cyclictest1420315-21kworker/u8:1+flush-8:012:01:311
1129998993733,3cyclictest1295696-21kworker/u8:1+events_unbound09:56:201
1129998993729,6cyclictest1415130-21latency_hist11:55:011
1129998993729,6cyclictest1254950-21ntpq09:11:301
1129998993727,8cyclictest280-21systemd-journal07:40:011
1129996993727,8cyclictest1334842-21ntpq10:31:320
1129996993726,8cyclictest280-21systemd-journal08:15:010
1129996993720,15cyclictest1429657-21unixbench_singl12:06:350
1129996993719,16cyclictest1336314-21cut10:36:210
1129998993632,3cyclictest302282-21kworker/u8:3+events_unbound08:21:211
1129998993632,3cyclictest1375213-21kworker/u8:0+flush-8:011:36:221
1129998993632,3cyclictest1375213-21kworker/u8:0+flush-8:011:36:221
1129998993632,3cyclictest1181909-21kworker/u8:0+events_unbound08:01:221
1129998993632,3cyclictest1156318-21kworker/u8:0+events_unbound07:41:171
1129998993632,3cyclictest1072621-21kworker/u8:2+events_unbound07:21:211
1129998993632,3cyclictest1072621-21kworker/u8:2+events_unbound07:21:211
112999699363,3cyclictest0-21swapper/009:31:180
112999699363,3cyclictest0-21swapper/009:31:170
112999699363,3cyclictest0-21swapper/007:21:180
112999699363,3cyclictest0-21swapper/007:21:180
1129996993619,15cyclictest1380128-21unixbench_singl11:16:370
1129996993614,19cyclictest0-21swapper/009:01:330
1129998993531,3cyclictest302282-21kworker/u8:3+events_unbound07:46:191
1129998993531,3cyclictest1385167-21kworker/u8:3+flush-8:011:46:301
1129998993531,3cyclictest1166549-21kworker/u8:2+events_unbound08:56:191
1129998993531,3cyclictest1166549-21kworker/u8:2+events_unbound08:36:201
1129998993530,4cyclictest1320764-21kworker/u8:2+events_unbound11:16:221
112999699354,3cyclictest0-21swapper/011:01:170
112999699353,4cyclictest0-21swapper/011:31:180
112999699353,4cyclictest0-21swapper/011:31:180
112999699353,4cyclictest0-21swapper/007:51:170
112999699352,12cyclictest583-21snmpd12:16:170
1129996993519,14cyclictest1161154-21unixbench_multi07:36:370
14330402340,0chrt371rcuc/212:11:272
1130003993426,6cyclictest1191547-21cat08:10:002
1129998993429,4cyclictest302282-21kworker/u8:3+flush-8:008:26:381
112999699343,3cyclictest0-21swapper/011:36:180
112999699343,3cyclictest0-21swapper/011:36:180
112999699343,3cyclictest0-21swapper/010:51:170
112999699343,3cyclictest0-21swapper/009:41:190
1129996993424,7cyclictest280-21systemd-journal12:26:320
112999699341,8cyclictest1454467-21sshd12:32:330
1129996993418,14cyclictest882-21mta-sts-daemon11:51:290
112999699341,6cyclictest1176967-21/usr/sbin/munin07:56:190
1129996993415,17cyclictest1216232-21cron08:34:590
1129996993412,19cyclictest1140952-21ntpq07:16:320
112999699341,10cyclictest1197346-21/usr/sbin/munin08:16:240
1129998993329,3cyclictest1414863-21kworker/u8:2+flush-8:011:56:251
1129998993329,3cyclictest1320764-21kworker/u8:2+events_unbound10:47:341
1129998993329,3cyclictest1024476-21kworker/u8:1+events_unbound07:18:441
1129998993328,4cyclictest1024476-21kworker/u8:1+flush-8:007:10:111
112999699334,2cyclictest0-21swapper/009:11:180
112999699331,9cyclictest1280245-21/usr/sbin/munin09:36:350
112999699331,9cyclictest1280245-21/usr/sbin/munin09:36:350
1129996993315,15cyclictest0-21swapper/011:26:180
112999699329,6cyclictest1204635-21kthreadcore08:21:270
112999699323,7cyclictest1314753-21ntpq10:11:300
112999699323,24cyclictest583-21snmpd08:51:170
112999699322,5cyclictest1291147-21apt-get09:51:190
112999699321,8cyclictest1326332-21/usr/sbin/munin10:26:240
112999699321,8cyclictest1259838-21/usr/sbin/munin09:16:280
1129996993217,13cyclictest1457188-21sed12:36:260
1129996993214,15cyclictest280-21systemd-journal10:10:010
112999699321,12cyclictest1250157-21ntpq09:06:340
112999699320,9cyclictest1130227-21/usr/sbin/munin07:11:160
1129998993127,3cyclictest1271168-21kworker/u8:3+events_unbound09:36:211
1129998993127,3cyclictest1271168-21kworker/u8:3+events_unbound09:36:211
1129998993127,3cyclictest1181909-21kworker/u8:0+events_unbound08:11:351
1129998993127,3cyclictest1166549-21kworker/u8:2+events_unbound08:41:241
1129998993127,2cyclictest1434616-21kworker/u8:2-ext4-rsv-conversion12:20:001
112999699312,7cyclictest583-21snmpd12:21:180
112999699312,5cyclictest1150868-21ntpq07:26:320
112999699311,9cyclictest1225286-21/usr/sbin/munin08:41:300
112999699311,8cyclictest1290060-21ntpq09:46:330
112999699311,8cyclictest1236679-21/usr/sbin/munin08:56:210
112999699311,8cyclictest1152206-21/usr/sbin/munin07:31:200
1129996993115,14cyclictest0-21swapper/010:16:280
1129996993115,14cyclictest0-21swapper/007:45:010
112999699310,8cyclictest1405888-21/usr/sbin/munin11:46:210
112999699310,8cyclictest1266572-21/usr/sbin/munin09:26:210
112999699310,8cyclictest1206908-21/usr/sbin/munin08:26:190
1129998993026,3cyclictest1454257-21kworker/u8:0+events_unbound12:36:181
112999699301,9cyclictest1371823-21/usr/sbin/munin11:11:240
112999699301,8cyclictest1321758-21/usr/sbin/munin10:21:240
112999699301,8cyclictest1220405-21ntpq08:36:310
1129996993015,13cyclictest0-21swapper/008:46:290
1130003992921,6cyclictest1176825-21cat07:55:012
14539652280,6sleep3451irq_work/312:31:343
1129998992825,2cyclictest1404351-21needreboot11:41:281
11251742283,8sleep20-21swapper/207:05:082
1130003992724,2cyclictest1420511-21aten2_r5power_p12:01:192
1129998992723,3cyclictest1181909-21kworker/u8:0+flush-8:008:16:381
1129998992723,3cyclictest1166549-21kworker/u8:2+events_unbound09:02:291
1129998992721,4cyclictest1281231-21apt-get09:41:181
112999699271,7cyclictest1129987-21cyclictest07:10:000
1130003992622,2cyclictest1301307-21cpuspeed_turbos10:01:202
1130003992622,2cyclictest1202023-21fschecks_count08:21:212
1130003992622,2cyclictest1157012-21aten2_r5power_v07:36:192
1130003992619,5cyclictest1330146-21grep10:26:382
113000399260,24cyclictest1201438-21systemd08:20:012
1129998992622,3cyclictest302282-21kworker/u8:3+events_unbound07:28:371
1129998992622,3cyclictest1325737-21kworker/u8:0+events_unbound10:55:341
1130003992522,2cyclictest1451009-21kthreadcore12:31:252
1129998992521,3cyclictest1271168-21kworker/u8:3+events_unbound10:25:041
1129998992521,3cyclictest1265436-21kworker/u8:0+events_unbound09:26:411
112955522410,9sleep10-21swapper/107:06:481
1130003992320,2cyclictest1356122-21fschecks_count10:56:202
1130003992319,2cyclictest1405824-21cpuspeed_turbos11:46:202
1130003992319,2cyclictest1291235-21aten2_r5power_p09:51:202
1130003992318,4cyclictest20977-21cron09:15:002
1130003992318,4cyclictest1325493-21munin-run10:25:002
1129998992319,3cyclictest1211534-21kworker/u8:0+flush-8:008:52:051
1130003992218,3cyclictest1181643-21idleruntime-cro08:00:002
1130003992218,2cyclictest1192177-21fschecks_count08:11:212
1130003992218,2cyclictest0-21swapper/208:56:322
1130003992213,6cyclictest1266080-21cat09:25:012
1130003992210,4cyclictest0-21swapper/208:51:352
113000399219,4cyclictest0-21swapper/211:11:202
1130003992118,2cyclictest1246600-21fschecks_time09:06:222
1130003992118,2cyclictest1147089-21aten2_r5power_e07:26:192
1130003992116,4cyclictest1225816-21unixbench_multi08:41:382
1130003992116,3cyclictest1276566-21tune2fs09:36:212
1130003992116,3cyclictest1276566-21tune2fs09:36:212
113000399202,3cyclictest13479042cat10:46:252
113000399202,13cyclictest1181995-21apt-get08:01:172
1130003992016,2cyclictest0-21swapper/210:31:352
1130003992015,3cyclictest1273332-21kthreadcore09:31:262
1130003992015,3cyclictest1273332-21kthreadcore09:31:262
1130003992014,4cyclictest1221230-21sendmail08:40:002
1130003992014,4cyclictest0-21swapper/209:41:182
11249682203,8sleep30-21swapper/307:05:003
1130003991916,2cyclictest1152022-21aten2_r5power_e07:31:192
1130003991915,2cyclictest1241613-21fschecks_count09:01:202
1130003991915,2cyclictest0-21swapper/212:06:172
1130003991915,2cyclictest0-21swapper/211:26:322
1130003991915,2cyclictest0-21swapper/210:06:362
1130003991915,2cyclictest0-21swapper/207:41:202
1130003991911,6cyclictest1215078-21tr08:31:292
1130003991910,7cyclictest1390992-21grep11:31:222
1130003991910,7cyclictest1390992-21grep11:31:222
1130003991815,2cyclictest0-21swapper/209:16:302
1130003991814,2cyclictest0-21swapper/212:26:322
1130003991814,2cyclictest0-21swapper/211:41:292
1130003991813,3cyclictest0-21swapper/207:15:002
1130003991810,6cyclictest1376485-21sed11:16:242
13103752173,3sleep30-21swapper/310:06:493
13056212172,4sleep30-21swapper/310:04:283
113000399178,7cyclictest1436014-21sed12:16:242
1130003991714,2cyclictest1296704-21sed09:56:252
1130003991712,3cyclictest0-21swapper/207:16:372
113000399171,12cyclictest1440212-21apt-get12:21:162
14595912162,4sleep30-21swapper/312:39:423
12954912162,4sleep30-21swapper/309:51:433
12444692160,5chrt481ktimers/309:01:263
12264692163,4sleep30-21swapper/308:45:543
12017602162,9sleep30-21swapper/308:21:183
113000399167,7cyclictest1416082-21sed11:56:242
113000399165,4cyclictest0-21swapper/212:36:242
113000399164,7cyclictest1206715-21apt-get08:26:182
113000399163,1cyclictest0-21swapper/210:41:282
113000399162,2cyclictest0-21swapper/211:08:062
113000399162,13cyclictest0-21swapper/211:51:072
113000399162,13cyclictest0-21swapper/209:45:492
113000399162,13cyclictest0-21swapper/208:49:042
1130003991613,2cyclictest1395930-21fschecks_count11:36:212
1130003991613,2cyclictest1395930-21fschecks_count11:36:212
1130003991612,2cyclictest1361092-21aten2_r5power_e11:01:182
1130003991612,2cyclictest0-21swapper/210:36:262
1130003991612,2cyclictest0-21swapper/210:16:212
1130003991612,2cyclictest0-21swapper/207:23:422
1130003991612,2cyclictest0-21swapper/207:23:422
1130003991611,3cyclictest0-21swapper/210:51:262
113000399161,11cyclictest1311509-21ps10:11:232
12566542155,6sleep30-21swapper/309:16:243
113000399157,6cyclictest1383487-21tr11:21:272
1130003991510,3cyclictest0-21swapper/209:26:312
13356632132,6sleep30-21swapper/310:35:023
13198832132,7sleep30-21swapper/310:16:363
12702592132,7sleep30-21swapper/309:26:363
12557972131,8sleep30-21swapper/309:15:003
12498132132,7sleep30-21swapper/309:06:293
14448402122,5sleep30-21swapper/312:25:013
14407232122,6sleep30-21swapper/312:21:243
14350612122,6sleep30-21swapper/312:15:023
14338852123,5sleep30-21swapper/312:11:293
14215802122,6sleep30-21swapper/312:01:263
14159652122,6sleep30-21swapper/311:56:243
14102152122,5sleep30-21swapper/311:50:023
14052412120,6sleep30-21swapper/311:45:003
13995472122,6sleep30-21swapper/311:36:343
13995472122,6sleep30-21swapper/311:36:343
13861152123,6sleep30-21swapper/311:26:223
13804302124,5sleep30-21swapper/311:20:003
13705972122,5sleep30-21swapper/311:10:013
13661282122,6sleep30-21swapper/311:06:203
13608312122,5sleep30-21swapper/311:00:023
13565782122,6sleep30-21swapper/310:56:243
13425722122,6sleep30-21swapper/310:41:283
13123472122,6sleep30-21swapper/310:11:263
12873102122,6sleep30-21swapper/309:46:263
12812352122,6sleep30-21swapper/309:41:203
12783262122,6sleep30-21swapper/309:36:273
12783262122,6sleep30-21swapper/309:36:273
12360732122,5sleep30-21swapper/308:55:013
12354692122,6sleep30-21swapper/308:51:363
12105122122,6sleep30-21swapper/308:26:323
11878392122,6sleep30-21swapper/308:06:263
11824902122,6sleep30-21swapper/308:01:243
11809122120,8sleep30-21swapper/307:56:343
11717612122,6sleep30-21swapper/307:50:493
11573532122,6sleep30-21swapper/307:36:243
11562022122,6sleep30-21swapper/307:31:383
11378602122,6sleep30-21swapper/307:16:253
14256272112,5sleep30-21swapper/312:06:193
14061522112,5sleep30-21swapper/311:46:253
13907332112,5sleep30-21swapper/311:31:203
13907332112,5sleep30-21swapper/311:31:203
13813942112,5sleep30-21swapper/311:21:253
13548162112,5sleep30-21swapper/310:51:353
13458342112,5sleep30-21swapper/310:45:333
13309492112,6sleep30-21swapper/310:30:363
13257122112,5sleep30-21swapper/310:25:023
13246052112,5sleep30-21swapper/310:21:293
13001332112,5sleep30-21swapper/309:56:373
12751132112,5sleep30-21swapper/309:31:333
12751132112,5sleep30-21swapper/309:31:333
12608722112,5sleep30-21swapper/309:20:013
12242012112,5sleep30-21swapper/308:41:293
12203892112,5sleep30-21swapper/308:36:313
12113202111,5sleep30-21swapper/308:30:013
11967942112,5sleep30-21swapper/308:16:173
11918922112,5sleep30-21swapper/308:11:193
11672382112,5sleep30-21swapper/307:46:233
11618232112,5sleep30-21swapper/307:40:333
11476162110,5sleep3481ktimers/307:26:243
11424692112,6sleep30-21swapper/307:21:233
11424692112,6sleep30-21swapper/307:21:233
11334242112,5sleep30-21swapper/307:11:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional