You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 08:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Jul 17, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124729221050,3chrt584-21kworker/3:2+events21:37:593
1096371996655,8cyclictest1257690-21latency_hist21:50:000
1096371995749,6cyclictest1187617-21cp20:40:010
1096372995548,5cyclictest1072020-21kworker/u8:1+flush-8:019:27:421
1096372995548,5cyclictest1072020-21kworker/u8:1+flush-8:019:27:411
1096371995545,7cyclictest1377359-21latency_hist23:50:010
1096371995446,5cyclictest1108095-21latency_hist19:20:000
1096371995346,5cyclictest1273385-21/usr/sbin/munin22:07:420
13985432520,4chrt0-21swapper/300:12:353
1096371995140,8cyclictest1182566-21latency_hist20:35:000
1096371995042,6cyclictest1147935-21latency_hist20:00:020
1096372994943,4cyclictest1327875-21kworker/u8:2+flush-8:023:17:321
1096372994941,6cyclictest1287629-21kworker/u8:1+flush-8:022:37:431
1096372994742,4cyclictest1072020-21kworker/u8:1+flush-8:019:37:421
1096372994642,3cyclictest1172191-21kworker/u8:3+flush-8:020:47:271
1096372994541,3cyclictest733430-21kworker/u8:0+flush-8:019:22:281
1096372994539,5cyclictest1172191-21kworker/u8:3+flush-8:020:42:281
1096377994435,6cyclictest281-21systemd-journal00:30:012
1096372994439,4cyclictest1072020-21kworker/u8:1+flush-8:019:42:271
1096372994437,5cyclictest1218324-21apt-get21:12:241
1096372994338,4cyclictest733430-21kworker/u8:0+flush-8:019:47:401
1096371994337,4cyclictest733430-21kworker/u8:0+flush-8:019:37:320
1096372994237,4cyclictest1072020-21kworker/u8:1+events_unbound19:15:021
1096372994136,4cyclictest733430-21kworker/u8:0+flush-8:020:37:291
1096372994135,4cyclictest1366690-21kworker/u8:1+flush-8:000:22:431
1096372994135,4cyclictest1352812-21apt-get23:27:211
1096372994130,8cyclictest281-21systemd-journal00:35:011
1096371994137,3cyclictest1217913-21kworker/u8:2+flush-8:021:32:390
1096371994135,4cyclictest1361021-21kworker/u8:2+flush-8:000:27:280
1096377994034,4cyclictest1322489-21kworker/u8:0+events_unbound23:57:412
1096377994034,4cyclictest1322489-21kworker/u8:0+events_unbound23:57:412
1096372994035,4cyclictest733430-21kworker/u8:0+flush-8:020:22:451
1096371994034,5cyclictest1208228-21kworker/u8:0+events_unbound21:22:460
1096371994030,8cyclictest1122229-21ntpq19:32:360
1096372993935,3cyclictest1192946-21kworker/u8:1+flush-8:020:52:411
1096372993934,4cyclictest1118373-21kworker/u8:3+flush-8:019:52:291
1096371993931,6cyclictest1198070-21/usr/sbin/munin20:52:350
1096371993931,5cyclictest281-21systemd-journal23:40:000
1096377993833,4cyclictest1208228-21kworker/u8:0+flush-8:022:00:012
1096372993833,4cyclictest1118373-21kworker/u8:3+flush-8:019:57:271
1096372993832,4cyclictest1387215-21apt-get00:00:001
1096372993832,4cyclictest1387215-21apt-get00:00:001
1096372993832,4cyclictest1258120-21apt-get21:52:241
1096372993830,5cyclictest281-21systemd-journal23:10:401
1096371993831,5cyclictest1342292-21kworker/u8:1+events_unbound23:22:270
1096372993730,5cyclictest1203240-21apt-get20:57:231
1096372993729,6cyclictest1172191-21kworker/u8:3+events_unbound21:02:261
1096371993732,4cyclictest1138023-21kworker/u8:2+flush-8:020:02:450
1096371993732,3cyclictest0-21swapper/000:00:000
1096371993732,3cyclictest0-21swapper/000:00:000
1096377993632,3cyclictest1217913-21kworker/u8:2+flush-8:021:27:432
1096372993632,3cyclictest1152909-21kworker/u8:1+flush-8:020:27:411
1096372993630,4cyclictest1361021-21kworker/u8:2+events_unbound00:27:281
1096372993625,9cyclictest281-21systemd-journal22:55:001
1096371993629,5cyclictest733430-21kworker/u8:0+flush-8:020:22:460
1096371993628,6cyclictest1357344-21apt-get23:30:000
1096371993625,8cyclictest1262601-21latency_hist21:55:010
1096377993524,8cyclictest1133322-21cp19:45:012
1096372993531,3cyclictest733430-21kworker/u8:0+flush-8:019:32:301
1096372993528,5cyclictest1322489-21kworker/u8:0+events_unbound00:02:421
1096372993528,5cyclictest1213361-21apt-get21:07:221
1096371993528,5cyclictest1361021-21kworker/u8:2+events_unbound00:37:260
1096371993524,8cyclictest1137257-21ntpq19:47:350
1096372993429,4cyclictest1152909-21kworker/u8:1+events_unbound20:12:271
1096372993429,3cyclictest1152909-21kworker/u8:1+events_unbound20:20:001
1096372993427,5cyclictest1208228-21kworker/u8:0+events_unbound22:17:421
1096371993430,3cyclictest1297757-21kworker/u8:3+events_unbound23:02:420
10916372344,9sleep10-21swapper/119:06:321
1096377993323,7cyclictest1242885-21cat21:35:002
1096372993329,3cyclictest1287629-21kworker/u8:1+events_unbound22:42:231
1096372993329,3cyclictest1267301-21kworker/u8:2+flush-8:022:27:421
1096372993326,5cyclictest1332634-21latency_hist23:05:011
1096372993326,5cyclictest1313253-21apt-get22:47:241
1096372993326,5cyclictest1287629-21kworker/u8:1+events_unbound22:22:271
1096372993325,5cyclictest281-21systemd-journal23:49:411
1096371993328,4cyclictest1152909-21kworker/u8:1+flush-8:020:12:290
1096371993327,4cyclictest1361021-21kworker/u8:2+flush-8:000:17:320
1096371993327,4cyclictest1172191-21kworker/u8:3+events_unbound21:05:470
1096372993226,5cyclictest1342292-21kworker/u8:1+events_unbound23:30:021
1096372993223,7cyclictest1366670-21ntpq23:37:381
1096372993222,1cyclictest161rcu_preempt22:05:021
1096371993227,4cyclictest1192946-21kworker/u8:1+flush-8:020:47:400
1096371993226,5cyclictest1366690-21kworker/u8:1+events_unbound00:07:490
109637199321,27cyclictest1222846-21true21:15:000
109637199321,27cyclictest1-21systemd00:35:010
1096377993126,4cyclictest1207752-21sendmail21:00:002
1096372993121,7cyclictest1337539-21latency_hist23:10:011
1096371993126,4cyclictest733430-21kworker/u8:0+events_unbound19:12:250
1096371993124,5cyclictest281-21systemd-journal19:29:200
1096371993124,5cyclictest281-21systemd-journal19:29:200
1096371993123,6cyclictest1293421-21/usr/sbin/munin22:27:350
1096371993123,6cyclictest1243228-21/usr/sbin/munin21:37:580
1096377993025,4cyclictest1192946-21kworker/u8:1+flush-8:021:00:062
1096377993025,4cyclictest1152909-21kworker/u8:1+flush-8:020:27:372
1096377993021,7cyclictest281-21systemd-journal20:07:412
1096377993021,7cyclictest1096953-21fschecks_count19:12:262
1096372993026,2cyclictest1237657-21latency_hist21:30:001
1096372993025,4cyclictest1138023-21kworker/u8:2+flush-8:020:02:391
1096372993025,3cyclictest1097278-21irqcore19:12:291
1096372993024,4cyclictest1287629-21kworker/u8:1+flush-8:022:57:291
1096371993027,2cyclictest1327661-21systemd-run23:00:010
1096371993025,4cyclictest1192946-21kworker/u8:1+flush-8:020:57:280
1096371993024,4cyclictest1287629-21kworker/u8:1+events_unbound22:52:290
1096371993022,6cyclictest1208228-21kworker/u8:0+events_unbound22:20:010
1096371993020,8cyclictest1287811-21apt-get22:20:000
1096377992924,3cyclictest1322489-21kworker/u8:0+events_unbound00:02:282
1096377992920,7cyclictest1338315-21fschecks_time23:12:292
1096372992924,4cyclictest1247594-21kworker/u8:3+events_unbound21:57:271
1096372992924,3cyclictest1399973-21kthreadcore00:12:371
1096372992924,3cyclictest1322489-21kworker/u8:0-flush-8:023:22:381
1096372992923,5cyclictest1208228-21kworker/u8:0+flush-8:021:42:281
1096372992923,5cyclictest1208228-21kworker/u8:0+flush-8:021:42:281
1096372992923,5cyclictest1208228-21kworker/u8:0+events_unbound22:35:011
1096372992923,4cyclictest1366690-21kworker/u8:1+flush-8:023:52:321
1096372992923,4cyclictest1208228-21kworker/u8:0+flush-8:021:47:321
1096372992923,4cyclictest1208228-21kworker/u8:0+flush-8:021:22:371
1096372992922,5cyclictest1223234-21/usr/sbin/munin21:17:351
1096372992921,6cyclictest1402747-21apt-get00:17:241
1096372992920,7cyclictest281-21systemd-journal21:35:011
1096372992919,8cyclictest281-21systemd-journal22:15:001
1096371992926,2cyclictest1177595-21cron20:30:000
1096371992923,5cyclictest1118373-21kworker/u8:3+flush-8:019:52:380
1096371992922,5cyclictest1282619-21unixbench_multi22:12:450
10916582292,6sleep00-21swapper/019:06:470
1096377992824,3cyclictest1426720-21unixbench_multi00:37:442
1096377992823,3cyclictest1228589-21fschecks_time21:22:292
1096377992822,4cyclictest1323413-21fschecks_time22:57:292
1096377992820,6cyclictest1353127-21fschecks_time23:27:262
1096377992819,7cyclictest1368209-21fschecks_time23:42:282
1096372992823,3cyclictest1366690-21kworker/u8:1+flush-8:000:07:341
1096372992821,5cyclictest1372153-21unixbench_multi23:42:441
1096371992824,3cyclictest1361021-21kworker/u8:2+flush-8:023:32:450
1096371992824,3cyclictest1192946-21kworker/u8:1+flush-8:021:17:320
1096371992824,3cyclictest1167435-21unixbench_multi20:17:440
1096371992824,3cyclictest1072020-21kworker/u8:1+events_unbound19:42:380
1096371992824,2cyclictest1317778-21systemd-run22:50:000
1096371992823,4cyclictest1308093-21kworker/u8:2+flush-8:022:42:410
1096371992823,3cyclictest0-21swapper/022:02:400
1096371992822,4cyclictest1322489-21kworker/u8:0+flush-8:000:12:460
1096377992724,2cyclictest1328106-21aten2_r5power_c23:02:252
1096377992722,3cyclictest1278397-21aten2_r5power_c22:12:262
1096377992721,4cyclictest1272753-21apt-get22:05:002
1096377992721,4cyclictest1187544-21apt-config20:40:012
1096372992723,2cyclictest0-21swapper/120:07:371
1096372992721,5cyclictest1192946-21kworker/u8:1+flush-8:022:02:311
1096371992719,6cyclictest1368144-21diskstats23:42:270
1096377992622,3cyclictest1346588-21grep23:17:362
1096372992621,3cyclictest1242585-21turbostat.cron21:35:001
1096371992622,3cyclictest1322489-21kworker/u8:0+flush-8:023:07:290
1096371992621,4cyclictest1212715-21unixbench_singl21:02:440
1096371992621,3cyclictest1208228-21kworker/u8:0+flush-8:021:42:340
1096371992621,3cyclictest1208228-21kworker/u8:0+flush-8:021:42:330
1096371992620,5cyclictest1361021-21kworker/u8:2+flush-8:000:22:390
1096371992618,6cyclictest1187804-21apt-key20:40:010
1096377992522,2cyclictest1193358-21cpuspeed_turbos20:47:252
1096377992522,2cyclictest1117692-21unixbench_multi19:27:422
1096377992522,2cyclictest1117692-21unixbench_multi19:27:422
1096377992521,3cyclictest1363268-21fschecks_time23:37:292
1096377992521,3cyclictest1258338-21cpuspeed_turbos21:52:272
1096377992521,3cyclictest1257462-21unixbench_singl21:47:442
1096377992521,2cyclictest1417630-21aten2_r5power_p00:32:252
1096377992520,3cyclictest1318536-21fschecks_time22:52:302
1096371992521,2cyclictest1307888-21systemd-run22:40:000
1096371992520,4cyclictest1322489-21kworker/u8:0+events_unbound00:02:400
1096371992518,5cyclictest1208228-21kworker/u8:0+flush-8:021:55:030
109637799246,10cyclictest0-21swapper/223:54:322
1096377992420,3cyclictest1118373-21kworker/u8:3+flush-8:019:57:332
1096377992420,2cyclictest0-21swapper/219:34:592
1096377992419,3cyclictest1227520-21unixbench_multi21:17:432
1096372992411,7cyclictest0-21swapper/120:34:031
1096371992420,3cyclictest1233440-21fschecks_count21:27:280
109637799236,9cyclictest0-21swapper/222:05:192
109637799235,11cyclictest0-21swapper/222:45:312
1096377992320,2cyclictest1393143-21fschecks_count00:07:282
1096377992319,2cyclictest1333274-21cpuspeed_turbos23:07:272
1096377992318,3cyclictest0-21swapper/221:12:422
1096371992319,3cyclictest1138023-21kworker/u8:2+events_unbound20:07:270
1096371992317,5cyclictest733430-21kworker/u8:0+flush-8:019:22:390
109637799225,10cyclictest0-21swapper/223:47:062
109637799224,4cyclictest0-21swapper/221:37:282
1096377992219,2cyclictest1213627-21fschecks_count21:07:272
1096377992219,2cyclictest1168174-21aten2_r5power_c20:22:272
1096377992219,2cyclictest1148600-21cpuspeed_turbos20:02:262
1096377992219,2cyclictest1132885-21munin-plugin-st19:45:002
1096377992218,3cyclictest1407895-21cpuspeed_turbos00:22:262
1096377992218,2cyclictest0-21swapper/200:12:422
1096377992217,4cyclictest1361021-21kworker/u8:2+flush-8:000:17:372
1096377992217,4cyclictest1182557-21cron20:34:592
1096371992218,3cyclictest1287629-21kworker/u8:1+flush-8:022:32:460
109637799215,10cyclictest0-21swapper/222:24:532
1096377992117,3cyclictest1167702-21munin-run20:20:002
1096377992117,3cyclictest1162770-21cron20:15:002
1096377992117,2cyclictest1107852-21unixbench_singl19:17:432
1096377992117,2cyclictest0-21swapper/220:55:012
1096377992116,4cyclictest1297757-21kworker/u8:3+flush-8:022:37:332
1096372992113,6cyclictest1422524-21apt-get00:37:221
109637799202,3cyclictest0-21swapper/222:33:572
109637799202,13cyclictest1192045-21ntpq20:42:392
1096377992017,2cyclictest1308380-21aten2_r5power_p22:42:252
1096377992015,4cyclictest1342292-21kworker/u8:1+events_unbound23:22:362
109637799200,18cyclictest1361845-21sshd23:32:412
109637199202,5cyclictest0-21swapper/023:13:000
1096371992016,2cyclictest0-21swapper/023:17:340
10913142202,9sleep30-21swapper/319:05:013
1096377991915,2cyclictest0-21swapper/222:17:362
1096377991912,5cyclictest1248498-21sort21:42:282
1096377991912,5cyclictest1248498-21sort21:42:282
1096371991915,2cyclictest0-21swapper/023:52:260
1096377991815,2cyclictest1138530-21aten2_r5power_e19:52:272
1096377991810,6cyclictest1293669-21cpuspeed_turbos22:27:262
109637799172,7cyclictest0-21swapper/219:37:222
10915312174,9sleep20-21swapper/219:05:082
1096377991613,2cyclictest0-21swapper/219:20:222
12618652142,8sleep30-21swapper/321:52:413
11686282145,6sleep30-21swapper/320:22:333
14093932132,7sleep30-21swapper/300:22:353
13928822132,7sleep30-21swapper/300:07:273
13773632132,6sleep30-21swapper/323:50:013
13673212132,6sleep30-21swapper/323:38:373
13388492132,7sleep30-21swapper/323:12:333
13236102132,7sleep30-21swapper/322:57:333
12228472132,6sleep30-21swapper/321:15:013
11825892132,6sleep30-21swapper/320:35:023
14227742122,6sleep30-21swapper/300:37:273
14027502122,6sleep30-21swapper/300:17:253
13858972122,6sleep30-21swapper/323:57:353
13858972122,6sleep30-21swapper/323:57:353
13773352122,6sleep30-21swapper/323:49:573
13584612122,6sleep30-21swapper/323:32:313
13523752122,6sleep30-21swapper/323:25:013
13429082122,6sleep30-21swapper/323:17:273
13220252122,6sleep30-21swapper/322:52:433
13128382122,6sleep30-21swapper/322:45:013
13032902122,6sleep30-21swapper/322:37:233
12878422122,5sleep30-21swapper/322:20:023
12787612122,6sleep30-21swapper/322:12:313
12734142123,6sleep30-21swapper/322:07:253
12573002122,6sleep30-21swapper/321:47:433
12385842122,6sleep30-21swapper/321:32:313
12327052122,6sleep30-21swapper/321:25:003
12173962122,6sleep30-21swapper/321:07:433
12088082122,6sleep30-21swapper/321:02:293
11931442122,6sleep30-21swapper/320:47:253
11887432122,6sleep30-21swapper/320:42:313
11758982122,6sleep30-21swapper/320:27:353
11637342122,6sleep30-21swapper/320:17:323
11492652122,6sleep30-21swapper/320:02:313
11429622122,6sleep30-21swapper/319:55:013
11368902122,6sleep30-21swapper/319:47:343
11283742122,6sleep30-21swapper/319:42:253
11236782122,6sleep30-21swapper/319:37:273
11180082122,5sleep30-21swapper/319:30:013
11116462122,6sleep30-21swapper/319:22:363
11035702122,6sleep30-21swapper/319:17:253
11012112122,5sleep30-21swapper/319:15:003
14174302112,6sleep30-21swapper/300:31:133
14128842112,6sleep30-21swapper/300:27:283
13881542111,6sleep30-21swapper/300:02:293
13723042112,6sleep30-21swapper/323:43:433
13522322112,6sleep30-21swapper/323:23:173
13328552112,5sleep30-21swapper/323:05:073
13318682112,5sleep30-21swapper/323:02:383
13085422112,5sleep30-21swapper/322:42:283
12982422112,6sleep30-21swapper/322:31:133
12933282112,6sleep30-21swapper/322:26:113
12832672112,6sleep30-21swapper/322:17:003
12681032112,5sleep30-21swapper/322:00:553
12670352112,5sleep30-21swapper/321:57:383
12478002112,5sleep30-21swapper/321:40:013
12478002112,5sleep30-21swapper/321:40:013
12329982112,6sleep30-21swapper/321:25:453
12182932112,6sleep30-21swapper/321:12:203
12030872112,6sleep30-21swapper/320:55:433
11981542112,6sleep30-21swapper/320:52:263
11782732112,5sleep30-21swapper/320:32:283
11578692112,5sleep30-21swapper/320:10:013
11536372112,6sleep30-21swapper/320:07:293
11432912112,6sleep30-21swapper/319:56:133
11173662112,6sleep30-21swapper/319:27:403
11173662112,6sleep30-21swapper/319:27:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional