You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 09:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sat Jun 20, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1074358998360,20cyclictest1129699-21ntpq20:00:340
1074362997568,5cyclictest1120724-21kworker/u8:3+flush-8:020:35:391
1074362997566,6cyclictest1136195-21kworker/u8:0+events_unbound20:45:381
1074362997164,5cyclictest1280114-21kworker/u8:0+flush-8:023:10:351
1074362997163,6cyclictest1136195-21kworker/u8:0+events_unbound20:55:351
1074362997062,6cyclictest1224946-21kworker/u8:2+flush-8:022:20:351
1074362996861,5cyclictest1086355-21kworker/u8:0+events_unbound19:30:401
1074362996757,7cyclictest1095288-21kworker/u8:2+events_unbound20:20:411
1074358996654,9cyclictest1085155-21ntpq19:15:310
1074362996454,8cyclictest1289381-21ntpq22:40:351
1074362996355,6cyclictest1329071-21kworker/u8:1+flush-8:000:30:361
1074358996354,6cyclictest1079247-21latency_hist19:15:010
1074362996256,4cyclictest1064632-21kworker/u8:1+flush-8:019:10:251
1074362996254,6cyclictest1188518-21kworker/u8:2+flush-8:021:05:361
1074362996251,8cyclictest1244435-21ntpq21:55:341
1074362996249,10cyclictest1353876-21ntpq23:45:351
1074362996249,10cyclictest1353876-21ntpq23:45:341
1074358996250,9cyclictest1219373-21ntpq21:30:320
1074362996153,6cyclictest1319895-21kworker/u8:2+flush-8:023:25:361
1074358996152,7cyclictest1254612-21ntpq22:05:330
13186082600,3chrt75-21kworker/3:1-events23:10:313
1074362995953,4cyclictest1348946-21kworker/u8:2+events_unbound23:55:361
1074362995953,4cyclictest1348946-21kworker/u8:2+events_unbound23:55:361
1074362995953,4cyclictest1136195-21kworker/u8:0+events_unbound20:50:411
1074362995952,5cyclictest1151264-21kworker/u8:1+events_unbound22:55:371
1074362995951,6cyclictest1335168-21kworker/u8:3+events_unbound00:35:391
1074362995951,6cyclictest1255120-21kworker/u8:3+flush-8:022:25:361
1074362995948,8cyclictest1119881-21ntpq19:50:361
1074358995948,8cyclictest1264520-21ntpq22:15:340
1074358995938,5cyclictest1704890-21systemd-journal23:40:000
1074362995853,3cyclictest1348946-21kworker/u8:2+events_unbound00:05:341
1074362995852,4cyclictest1151264-21kworker/u8:1+flush-8:022:35:301
1074362995851,5cyclictest1383705-21kworker/u8:0+events_unbound00:30:011
1074358995847,8cyclictest1348893-21ntpq23:40:330
13603872570,3sleep375-21kworker/3:1-events23:55:253
13603872570,3sleep375-21kworker/3:1-events23:55:243
1074362995751,4cyclictest1095288-21kworker/u8:2+events_unbound19:55:241
12273182560,5sleep30-21swapper/321:40:293
11406322560,2sleep3481ktimers/320:15:003
1074362995649,5cyclictest1159714-21ntpq20:30:381
1074362995649,4cyclictest1255120-21kworker/u8:3+flush-8:022:15:261
1074362995646,7cyclictest1704890-21systemd-journal19:25:401
1074362995645,8cyclictest1388681-21ntpq00:20:371
1074362995549,4cyclictest1329071-21kworker/u8:1+flush-8:000:10:361
1074362995549,3cyclictest1329071-21kworker/u8:1+events_unbound23:40:241
1074358995544,9cyclictest1274425-21ntpq22:25:340
1074358995533,8cyclictest1239513-21ntpq21:50:350
1074362995449,3cyclictest1095288-21kworker/u8:2+events_unbound19:40:221
1074362995448,4cyclictest1151264-21kworker/u8:1+flush-8:021:40:401
1074362995448,4cyclictest1064632-21kworker/u8:1+events_unbound19:35:421
1074362995448,4cyclictest1064632-21kworker/u8:1+events_unbound19:35:421
1074362995446,6cyclictest1188518-21kworker/u8:2+flush-8:021:10:421
1074362995443,8cyclictest1255120-21kworker/u8:3+events_unbound23:20:201
1074362995347,4cyclictest1280114-21kworker/u8:0+flush-8:023:15:321
1074362995345,6cyclictest1209540-21ntpq21:20:361
1074358995346,5cyclictest1304119-21ntpq22:55:330
1074358995342,8cyclictest1096537-21diskstats19:30:250
1074362995248,3cyclictest1120724-21kworker/u8:3+events_unbound21:30:341
1074362995245,5cyclictest1329071-21kworker/u8:1+flush-8:023:35:351
1074362995147,3cyclictest1151264-21kworker/u8:1+flush-8:021:45:241
1074362995145,4cyclictest1095288-21kworker/u8:2+events_unbound20:00:371
11432192500,2chrt0-21swapper/020:15:310
1074362995046,3cyclictest1348946-21kworker/u8:2+events_unbound00:00:391
1074362995046,3cyclictest1348946-21kworker/u8:2+events_unbound00:00:381
1074358995042,6cyclictest1294180-21ntpq22:45:330
1074358995041,7cyclictest1704890-21systemd-journal19:49:590
1074358995040,8cyclictest1160540-21apt-get20:35:010
1074362994943,4cyclictest1240639-21kworker/u8:0+events_unbound22:05:231
1074362994943,4cyclictest1120724-21kworker/u8:3+events_unbound21:15:341
1074358994941,6cyclictest1124771-21ntpq19:55:350
11858842480,2chrt481ktimers/321:00:233
1074362994842,5cyclictest1255120-21kworker/u8:3+events_unbound22:10:251
1074362994841,5cyclictest1335168-21kworker/u8:3+events_unbound23:50:391
1074362994841,5cyclictest1335168-21kworker/u8:3+events_unbound23:50:381
1074362994839,6cyclictest1064632-21kworker/u8:1+flush-8:019:20:351
1074362994741,4cyclictest1329071-21kworker/u8:1+events_unbound00:15:251
1074362994741,3cyclictest1136195-21kworker/u8:0+events_unbound20:40:381
1074358994737,8cyclictest1204539-21ntpq21:15:340
1074358994737,8cyclictest1139657-21ntpq20:10:390
1074362994639,5cyclictest1280114-21kworker/u8:0+flush-8:022:50:371
1074362994635,8cyclictest1210670-21/usr/sbin/munin21:25:381
1074358994639,5cyclictest1355037-21apt-get23:50:200
1074358994639,5cyclictest1355037-21apt-get23:50:190
1074358994639,5cyclictest1090128-21ntpq19:20:330
1074358994636,8cyclictest1398475-21ntpq00:30:340
1074358994636,7cyclictest1165706-21latency_hist20:40:010
1074358994635,8cyclictest1334023-21ntpq23:25:330
1074358994634,9cyclictest1704890-21systemd-journal21:50:000
1074362994539,5cyclictest1151264-21kworker/u8:1+flush-8:021:50:361
1074362994538,5cyclictest1151264-21kworker/u8:1+flush-8:022:45:351
1074358994539,4cyclictest1318965-21ntpq23:10:330
1074358994538,5cyclictest1151264-21kworker/u8:1+events_unbound21:40:010
107435899452,40cyclictest272130-21kworker/0:0+events19:40:370
1074362994438,4cyclictest1280114-21kworker/u8:0+events_unbound23:00:251
1074358994434,8cyclictest1403455-21ntpq00:35:330
107435899442,36cyclictest1210467-21kworker/0:1+events22:00:220
12507212430,21sleep375-21kworker/3:1+events22:05:013
1074364994337,4cyclictest1086355-21kworker/u8:0+flush-8:019:25:472
1074362994339,3cyclictest1151264-21kworker/u8:1+flush-8:023:05:441
1074362994336,5cyclictest1188518-21kworker/u8:2+flush-8:021:00:381
1074358994333,8cyclictest1174687-21ntpq20:45:340
1074364994237,3cyclictest1151264-21kworker/u8:1+flush-8:020:25:302
1074364994220,20cyclictest1374289-21unixbench_singl00:05:422
1074362994234,6cyclictest1280266-21latency_hist22:35:011
1074358994230,9cyclictest1259546-21ntpq22:10:340
1074362994137,3cyclictest1120724-21kworker/u8:3+events_unbound20:15:251
1074362994035,4cyclictest1240639-21kworker/u8:0+events_unbound22:00:281
1074362994033,5cyclictest1111135-21apt-get19:45:221
1074358994031,7cyclictest1186036-21diskstats21:00:260
11293642390,7sleep239-21ksoftirqd/220:00:322
1074362993933,4cyclictest1095288-21kworker/u8:2+events_unbound20:05:231
1074362993833,3cyclictest1224346-21ntpq21:35:321
1074358993828,8cyclictest1329107-21ntpq23:20:350
1074358993730,5cyclictest1188518-21kworker/u8:2+events_unbound21:05:410
1074358993729,6cyclictest1120724-21kworker/u8:3+flush-8:021:25:350
1074364993620,13cyclictest1078809-21unixbench_multi19:10:422
1074362993630,4cyclictest1120724-21kworker/u8:3+events_unbound20:25:291
1074358993613,20cyclictest1210467-21kworker/0:1+events22:20:210
1074358993526,7cyclictest1184559-21ntpq20:55:310
1074358993525,8cyclictest1179686-21ntpq20:50:360
1074358993511,22cyclictest1295148-21kworker/0:0+events23:05:410
10740772354,10sleep10-21swapper/119:08:381
13944832340,3sleep375-21kworker/3:1+mm_percpu_wq00:30:013
1074364993426,6cyclictest1160540-21apt-get20:35:012
1074364993315,5cyclictest1704890-21systemd-journal22:05:012
1074362993327,4cyclictest1064632-21kworker/u8:1+events_unbound19:20:001
107435899333,28cyclictest272130-21kworker/0:0+events19:50:350
1074358993326,5cyclictest1150891-21/usr/sbin/munin20:25:340
1074364993226,4cyclictest1344402-21unixbench_multi23:35:412
1074364993211,7cyclictest1200442-21mktemp21:15:012
1074362993226,4cyclictest1095288-21kworker/u8:2+flush-8:020:10:421
1074362993224,6cyclictest1335168-21kworker/u8:3+events_unbound23:30:231
1074358993223,7cyclictest1101221-21/usr/sbin/munin19:35:350
1074358993223,7cyclictest1101221-21/usr/sbin/munin19:35:340
107435899321,29cyclictest1210467-21kworker/0:1+events21:40:250
1074364993126,3cyclictest1105906-21idleruntime-cro19:40:002
1074364993126,3cyclictest1105906-21idleruntime-cro19:39:592
1074364993118,11cyclictest1315252-21aten2_r5power_e23:10:222
1074364993116,3cyclictest1141020-21cpuspeed_turbos20:15:242
107436499311,11cyclictest1319858-21apt-get23:15:022
107435899317,23cyclictest1295148-21kworker/0:0+events23:55:290
107435899317,23cyclictest1295148-21kworker/0:0+events23:55:280
1074358993127,3cyclictest1188518-21kworker/u8:2+events_unbound21:20:400
1074358993125,4cyclictest1299633-21grep22:50:400
1074358993125,4cyclictest1120724-21kworker/u8:3+flush-8:020:20:260
1074358993123,6cyclictest1245480-21cp22:00:010
107435899312,27cyclictest1295148-21kworker/0:0+events00:21:030
1074358993115,14cyclictest1210467-21kworker/0:1+events22:40:310
107435899310,29cyclictest1295148-21kworker/0:0+events00:15:000
107435899305,23cyclictest272130-21kworker/0:0+events19:25:250
1074358993023,5cyclictest1335168-21kworker/u8:3+flush-8:023:45:260
1074358993023,5cyclictest1335168-21kworker/u8:3+flush-8:023:45:260
107435899302,26cyclictest1295148-21kworker/0:0+events00:15:310
1074358993021,7cyclictest1170658-21latency_hist20:45:020
107435899299,15cyclictest1295148-21kworker/0:0+events00:05:210
107435899298,15cyclictest1155645-21kworker/0:2+events21:10:220
1074358992924,4cyclictest1383705-21kworker/u8:0+flush-8:000:26:320
1074358992918,9cyclictest0-21swapper/022:39:590
1074364992823,3cyclictest1146012-21aten2_r5power_c20:20:242
1074364992812,4cyclictest1229384-21ntpq21:40:342
107435899289,17cyclictest1295148-21kworker/0:0+events00:00:310
107435899289,17cyclictest1295148-21kworker/0:0+events00:00:300
107435899285,17cyclictest1295148-21kworker/0:0+events23:35:010
1074358992811,16cyclictest1210467-21kworker/0:1+events22:30:230
1074364992723,3cyclictest1359322-21unixbench_singl23:50:402
1074364992723,3cyclictest1359322-21unixbench_singl23:50:392
1074364992720,5cyclictest1704890-21systemd-journal20:10:012
1074364992720,5cyclictest1704890-21systemd-journal00:13:492
1074364992717,8cyclictest1704890-21systemd-journal21:10:012
1074364992711,3cyclictest0-21swapper/219:15:232
1074358992621,3cyclictest0-21swapper/020:10:000
1074358992620,4cyclictest1309579-21unixbench_multi23:00:410
10695702263,15sleep01069573-21apt-get19:05:200
1074364992522,2cyclictest1270890-21cpuspeed_turbos22:25:232
1074364992521,2cyclictest1209978-21unixbench_multi21:20:412
107436499250,9cyclictest11625282cut20:35:302
107436499248,4cyclictest1395097-21fschecks_time00:30:252
107436499248,3cyclictest13474612tr23:40:312
1074364992421,2cyclictest1384164-21unixbench_singl00:15:412
1074364992421,2cyclictest1215762-21aten2_r5power_v21:30:202
1074364992419,4cyclictest1224826-21unixbench_multi21:35:382
1074364992418,4cyclictest1334928-21cron23:30:002
107435899247,15cyclictest1295148-21kworker/0:0+events23:15:290
12243292230,3sleep375-21kworker/3:1+events21:35:313
1074364992320,2cyclictest1270394-21idleruntime-cro22:24:592
1074364992320,2cyclictest1230772-21cpuspeed_turbos21:45:242
1074364992316,5cyclictest1704890-21systemd-journal22:55:002
1074364992218,2cyclictest1176095-21cpuspeed_turbos20:50:252
1074364992212,8cyclictest1277953-21tr22:30:312
1074364992118,2cyclictest1256020-21cpuspeed_turbos22:10:242
1074364992117,2cyclictest1360104-21aten2_r5power_v23:55:222
1074364992117,2cyclictest1360104-21aten2_r5power_v23:55:222
1074364992116,3cyclictest1175601-21idleruntime-cro20:50:012
1074364992017,2cyclictest1314531-21unixbench_singl23:05:462
1074364992016,3cyclictest0-21swapper/200:25:412
1074364992016,2cyclictest1290826-21fschecks_time22:45:242
1074364992016,2cyclictest0-21swapper/219:50:082
107436499201,14cyclictest1204565-21ntpq21:15:332
1074364991915,2cyclictest0-21swapper/223:20:352
1074364991913,4cyclictest1399745-21aten2_r5power_e00:35:222
10731352194,9sleep20-21swapper/219:05:372
11956682180,4sleep375-21kworker/3:1-events21:10:243
107436499188,8cyclictest1305643-21fschecks_time23:00:252
107436499188,8cyclictest1285809-21fschecks_count22:40:232
107436499182,11cyclictest1109986-21ntpq19:40:362
1074364991815,2cyclictest1335245-21aten2_r5power_c23:30:232
1074364991815,2cyclictest1180917-21aten2_r5power_p20:55:222
1074364991814,2cyclictest0-21swapper/223:45:282
1074364991814,2cyclictest0-21swapper/223:45:272
1074364991810,6cyclictest1214802-21sshd21:25:402
1074364991810,6cyclictest1125009-21sshd19:55:382
10700962183,8sleep30-21swapper/319:05:273
107436499179,7cyclictest1111400-21fschecks_count19:45:262
1074364991714,2cyclictest1365335-21fschecks_time00:00:262
1074364991714,2cyclictest1365335-21fschecks_time00:00:252
1074364991713,2cyclictest0-21swapper/221:55:412
1074364991713,2cyclictest0-21swapper/221:55:002
1074364991711,4cyclictest0-21swapper/221:00:312
107436499171,11cyclictest1300340-21apt-get22:55:192
107436499169,5cyclictest1263391-21tr22:15:312
107436499167,7cyclictest1137360-21cut20:10:292
107436499167,7cyclictest1086559-21ls19:20:232
1074364991611,3cyclictest0-21swapper/222:05:252
1074364991611,3cyclictest0-21swapper/219:30:292
107436499161,11cyclictest1388602-21ntpq00:20:352
107436499152,12cyclictest0-21swapper/220:40:382
1074364991511,2cyclictest0-21swapper/222:35:382
13050222142,8sleep30-21swapper/323:00:003
13687972132,7sleep30-21swapper/300:00:363
13687972132,7sleep30-21swapper/300:00:353
13547522132,6sleep30-21swapper/323:50:013
13547522132,6sleep30-21swapper/323:50:003
12661972132,6sleep30-21swapper/322:20:273
11659122132,6sleep30-21swapper/320:40:033
13984362122,6sleep30-21swapper/300:30:343
13851182122,6sleep30-21swapper/300:20:263
13406552122,6sleep30-21swapper/323:35:273
13302282122,6sleep30-21swapper/323:25:213
13289072122,6sleep30-21swapper/323:20:313
13106082122,6sleep30-21swapper/323:05:263
13091092122,6sleep30-21swapper/323:00:363
12989992122,6sleep30-21swapper/322:50:333
12807902122,6sleep30-21swapper/322:35:243
12714002122,6sleep30-21swapper/322:25:283
12558172122,6sleep30-21swapper/322:10:233
12512272123,6sleep30-21swapper/322:05:263
12366222123,5sleep30-21swapper/321:50:293
12352202121,6sleep30-21swapper/321:50:013
12121072122,6sleep30-21swapper/321:25:293
12061622122,6sleep30-21swapper/321:20:273
12004242121,6sleep30-21swapper/321:15:023
11794902122,6sleep30-21swapper/320:50:343
11710732122,6sleep30-21swapper/320:45:233
11514952122,6sleep30-21swapper/320:25:303
11463642122,6sleep30-21swapper/320:20:283
11406322122,6sleep30-21swapper/320:15:013
11346502122,7sleep30-21swapper/320:05:353
11261982122,6sleep30-21swapper/320:00:263
11250022122,6sleep30-21swapper/319:55:393
11203532122,6sleep30-21swapper/319:50:423
11066812122,6sleep30-21swapper/319:40:263
10962922122,6sleep30-21swapper/319:30:243
10912842122,6sleep30-21swapper/319:25:053
10868772122,6sleep30-21swapper/319:20:293
10819192122,6sleep30-21swapper/319:15:273
10791192123,6sleep30-21swapper/319:13:293
13997742112,5sleep30-21swapper/300:35:223
13803802111,6sleep30-21swapper/300:15:283
13752142112,5sleep30-21swapper/300:10:273
13708822112,5sleep30-21swapper/300:05:303
13550062113,5sleep30-21swapper/323:50:173
13550062113,5sleep30-21swapper/323:50:173
13492622112,5sleep30-21swapper/323:40:423
13392492112,6sleep30-21swapper/323:30:413
13203662112,5sleep30-21swapper/323:15:203
12904492112,5sleep30-21swapper/322:45:193
12852722112,5sleep30-21swapper/322:40:013
12793232112,5sleep30-21swapper/322:30:353
12648392112,5sleep30-21swapper/322:15:423
12410522112,5sleep30-21swapper/321:55:273
12196442112,5sleep30-21swapper/321:30:393
11906492112,5sleep30-21swapper/321:05:023
11808052112,6sleep30-21swapper/320:55:203
11650522112,5sleep30-21swapper/320:35:413
11558782112,5sleep30-21swapper/320:30:223
11111822112,6sleep30-21swapper/319:45:253
11014872113,5sleep30-21swapper/319:35:253
11014872113,5sleep30-21swapper/319:35:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional