You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 10:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Jul 31, 2026 00:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
145077121830,2sleep3575-21kworker/3:2+events22:33:033
12786272810,2sleep3575-21kworker/3:2+events19:38:063
13544862760,6chrt451irq_work/320:57:543
14589072650,4sleep10-21swapper/122:42:561
13363502570,2chrt575-21kworker/3:2+events20:38:003
14912542550,4sleep10-21swapper/123:13:061
1247889995544,8cyclictest1363714-21latency_hist21:05:010
1247889995042,6cyclictest1279463-21latency_hist19:40:010
1247892994837,9cyclictest275-21systemd-journal21:35:001
1247892994637,6cyclictest1543077-21apt-get00:07:531
1247889994638,6cyclictest1304841-21apt-get20:07:520
12529202450,4sleep00-21swapper/019:15:010
1247892994537,6cyclictest1537576-21latency_hist00:00:011
1247892994439,4cyclictest161772-21kworker/u8:0+flush-8:019:15:061
1247892994439,3cyclictest1329317-21kworker/u8:0+events_unbound20:57:561
1247892994437,5cyclictest1324150-21kworker/u8:3+events_unbound20:37:551
1247892994137,3cyclictest1324150-21kworker/u8:3+events_unbound21:03:011
1247892994136,4cyclictest1388457-21kworker/u8:0+events_unbound22:27:541
1247892994136,4cyclictest1388457-21kworker/u8:0+events_unbound22:27:541
1247892994134,5cyclictest1538075-21apt-get00:02:531
1247892994134,5cyclictest1512724-21kworker/u8:3+flush-8:023:37:581
1247892994036,3cyclictest1453078-21kworker/u8:2+flush-8:023:23:111
1247892994031,7cyclictest275-21systemd-journal20:55:001
1247889994034,4cyclictest1324150-21kworker/u8:3+flush-8:020:33:090
1247892993934,3cyclictest1101863-21kworker/u8:1+flush-8:019:28:001
1247892993834,3cyclictest1216255-21kworker/u8:3+flush-8:019:43:071
1247889993832,4cyclictest1285128-21apt-get19:47:510
1247892993732,4cyclictest1270024-21kworker/u8:2+events_unbound19:57:551
1247892993725,9cyclictest275-21systemd-journal22:08:541
1247892993632,3cyclictest1453078-21kworker/u8:2+events_unbound23:16:531
1247892993632,3cyclictest1388457-21kworker/u8:0+events_unbound22:03:071
1247892993630,4cyclictest1423302-21kworker/u8:3+events_unbound22:33:031
1247892993630,4cyclictest1349118-21kworker/u8:2+events_unbound21:07:581
1247892993630,4cyclictest1324150-21kworker/u8:3+events_unbound20:33:101
1247892993623,6cyclictest1507734-21kworker/u8:0+events_unbound23:48:041
12431022363,9sleep10-21swapper/119:06:121
1247892993531,3cyclictest1507734-21kworker/u8:0+flush-8:023:43:101
1247892993531,3cyclictest1388457-21kworker/u8:0+flush-8:022:13:111
124788999350,33cyclictest1423309-21munin-run22:05:000
1247892993430,3cyclictest1270024-21kworker/u8:2+events_unbound20:02:581
1247892993429,4cyclictest1537846-21kworker/u8:2+flush-8:000:13:031
1247892993429,3cyclictest1467578-21kworker/u8:3+flush-8:023:08:061
1247892993429,3cyclictest1276554-21kthreadcore19:38:041
1247889993429,4cyclictest1512724-21kworker/u8:3+flush-8:023:42:580
1247892993329,3cyclictest1270024-21kworker/u8:2+events_unbound20:05:071
1247892993328,4cyclictest1324150-21kworker/u8:3+events_unbound21:28:111
1247892993327,5cyclictest1388457-21kworker/u8:0+events_unbound21:52:591
1247892993326,5cyclictest1368675-21kworker/u8:1+events_unbound22:23:001
1247889993329,3cyclictest1270024-21kworker/u8:2+flush-8:019:52:570
1247892993226,5cyclictest1216255-21kworker/u8:3+events_unbound19:13:061
1247895993126,4cyclictest1537853-21kworker/u8:4+flush-8:000:37:592
1247892993127,2cyclictest1329089-21apt20:30:001
1247892993127,2cyclictest1329089-21apt20:30:001
1247892993126,4cyclictest1388457-21kworker/u8:0+events_unbound22:18:091
1247892993126,3cyclictest1532646-21cron23:55:001
1247889993124,5cyclictest1348871-21latency_hist20:50:010
1247889993123,6cyclictest1314040-21grep20:13:130
1247889993123,3cyclictest1403608-21latency_hist21:45:020
1247889993118,10cyclictest275-21systemd-journal19:17:520
1247895993026,3cyclictest1269524-21cron19:29:592
1247895993024,4cyclictest1552281-21unixbench_multi00:13:152
1247895993022,6cyclictest1378554-21awk21:20:012
1247895993022,6cyclictest1334021-21turbostat.cron20:35:002
1247892993026,3cyclictest1467578-21kworker/u8:3+flush-8:023:27:581
1247892993026,3cyclictest1368675-21kworker/u8:1+flush-8:021:38:161
1247892993025,4cyclictest1453078-21kworker/u8:2+events_unbound22:58:061
1247892993025,3cyclictest1418329-21cron22:00:001
1247892993025,3cyclictest1348888-21true20:50:001
12783282290,5sleep20-21swapper/219:38:052
1247895992924,3cyclictest1428735-21aten2_r5power_c22:12:552
124789599291,26cyclictest1419344-21irqcore22:03:002
1247892992925,3cyclictest1453078-21kworker/u8:2+flush-8:022:38:061
1247892992924,4cyclictest1537846-21kworker/u8:2+flush-8:000:18:001
1247889992924,4cyclictest1216255-21kworker/u8:3+flush-8:019:42:570
1247889992923,4cyclictest1512614-21grep23:33:140
1247889992919,8cyclictest1438106-21apt-get22:20:000
1247889992919,8cyclictest1408814-21sshd21:51:530
14118202280,5sleep3575-21kworker/3:2+mm_percpu_wq21:53:033
1247895992825,2cyclictest1433954-21fschecks_time22:17:572
1247895992824,3cyclictest1408257-21unixbench_singl21:48:142
1247895992824,3cyclictest1-21systemd00:00:002
1247895992824,2cyclictest1264622-21sh19:25:002
1247895992823,4cyclictest1368675-21kworker/u8:1+flush-8:021:53:132
1247895992823,3cyclictest1388233-21unixbench_singl21:28:132
1247892992824,3cyclictest1368675-21kworker/u8:1+events_unbound21:48:311
1247892992824,3cyclictest1270024-21kworker/u8:2+events_unbound20:20:321
1247892992823,4cyclictest1453078-21kworker/u8:2+flush-8:023:33:021
1247892992823,4cyclictest1270024-21kworker/u8:2+events_unbound19:47:541
1247892992823,3cyclictest1329317-21kworker/u8:0+flush-8:020:43:271
1247892992823,3cyclictest1270024-21kworker/u8:2+events_unbound19:33:071
1247892992818,8cyclictest1472251-21ntpq22:53:061
1247889992824,3cyclictest1427459-21needreboot22:08:060
1247889992823,3cyclictest0-21swapper/000:00:000
1247889992822,4cyclictest1507702-21unixbench_singl23:28:120
1247889992822,4cyclictest1358557-21unixbench_singl20:58:120
1247889992817,9cyclictest275-21systemd-journal21:30:490
1247895992724,2cyclictest1453897-21cpuspeed_turbos22:37:562
1247895992722,3cyclictest1304360-21cron20:05:002
1247892992723,3cyclictest1507734-21kworker/u8:0+flush-8:000:23:111
1247892992723,3cyclictest1388457-21kworker/u8:0+flush-8:022:48:111
1247892992723,3cyclictest1270024-21kworker/u8:2+events_unbound19:52:491
1247892992722,3cyclictest1403108-21unixbench_singl21:43:141
1247892992721,5cyclictest1567279-21kworker/u8:1+events_unbound00:33:131
1247892992721,5cyclictest1216255-21kworker/u8:3+events_unbound19:23:011
1247889992722,4cyclictest1432991-21unixbench_singl22:13:140
124788999272,24cyclictest1242830-21kworker/0:0+events21:58:130
1247889992718,7cyclictest1546895-21ntpq00:08:080
1247889992718,7cyclictest1314959-21diskstats20:17:570
1247889992718,6cyclictest1497737-21latency_hist23:20:010
1247889992715,3cyclictest0-21swapper/000:33:070
12431802273,5sleep20-21swapper/219:07:132
1247895992622,3cyclictest1543305-21cpuspeed_turbos00:07:562
1247895992622,3cyclictest1458745-21aten2_r5power_v22:42:542
1247895992622,2cyclictest1478658-21cpuspeed_turbos23:02:562
1247895992622,2cyclictest1304872-21aten2_r5power_c20:07:552
1247895992622,2cyclictest1280407-21tr19:42:552
1247895992620,5cyclictest0-21swapper/219:57:532
1247895992620,4cyclictest1403541-21gpgv21:45:012
1247892992622,3cyclictest1453078-21kworker/u8:2+events_unbound23:03:121
1247892992622,3cyclictest1349118-21kworker/u8:2+events_unbound21:13:091
1247892992621,4cyclictest1537853-21kworker/u8:4+flush-8:000:38:171
1247889992622,3cyclictest401-21dbus-daemon21:15:010
1247889992622,2cyclictest0-21swapper/023:40:000
1247889992620,4cyclictest1388457-21kworker/u8:0+flush-8:022:47:580
1247889992619,5cyclictest275-21systemd-journal22:35:000
1247889992616,8cyclictest1482167-21ntpq23:03:070
1247895992522,2cyclictest1389128-21cpuspeed_turbos21:32:572
1247895992521,3cyclictest1497487-21unixbench_multi23:18:132
1247895992521,3cyclictest1444074-21fschecks_count22:27:572
1247895992521,3cyclictest1444074-21fschecks_count22:27:562
1247895992521,2cyclictest1553362-21cut00:18:032
1247895992521,2cyclictest1523528-21fschecks_count23:47:572
1247895992521,2cyclictest1488516-21cpuspeed_turbos23:12:582
1247895992520,3cyclictest1424280-21irqcore22:08:012
1247895992520,3cyclictest1344714-21fschecks_time20:47:572
1247889992521,3cyclictest1553640-21irqcore00:18:060
1247889992521,3cyclictest1502474-21unixbench_multi23:23:130
1247889992521,3cyclictest1483580-21cut23:07:590
1247889992521,3cyclictest1472989-21awk22:55:000
1247889992521,3cyclictest1324150-21kworker/u8:3+flush-8:020:37:560
1247889992520,4cyclictest1542367-21unixbench_multi00:03:140
12432182252,6sleep00-21swapper/019:07:430
13420212240,2sleep3481ktimers/320:43:023
1247895992421,2cyclictest1334716-21cpuspeed_turbos20:37:552
1247895992421,2cyclictest1290071-21aten2_r5power_c19:52:542
1247895992420,3cyclictest1473772-21fschecks_time22:57:562
1247895992420,3cyclictest1467578-21kworker/u8:3+flush-8:023:20:242
1247895992420,2cyclictest1379331-21fschecks_count21:22:592
1247895992418,4cyclictest1343730-21unixbench_singl20:43:122
1247895992416,6cyclictest1472996-21cat22:55:002
1247895992414,8cyclictest1468036-21awk22:50:002
1247892992421,2cyclictest1537846-21kworker/u8:2+events_unbound00:26:361
1247892992420,3cyclictest1270024-21kworker/u8:2+flush-8:020:13:131
1247892992420,3cyclictest1270024-21kworker/u8:2+events_unbound20:15:351
1247889992420,2cyclictest0-21swapper/019:57:520
1247889992419,4cyclictest1454600-21kthreadcore22:38:030
1247889992413,6cyclictest573-21runrttasks20:02:550
1247895992320,2cyclictest1393951-21aten2_r5power_p21:37:552
1247895992318,3cyclictest1251938-21grep19:13:032
1247892992319,3cyclictest1324150-21kworker/u8:3+events_unbound21:22:591
1247889992318,4cyclictest1527526-21unixbench_singl23:48:130
1247889992318,4cyclictest1441238-21kthreadcore22:23:010
1247889992318,4cyclictest1323903-21unixbench_multi20:23:110
1247895992219,2cyclictest1354325-21aten2_r5power_c20:57:542
1247892992218,3cyclictest1324150-21kworker/u8:3+events_unbound21:18:511
1247889992218,3cyclictest1349118-21kworker/u8:2+flush-8:021:16:240
1247889992217,4cyclictest1537853-21kworker/u8:4+flush-8:000:36:580
1247889992217,4cyclictest1488875-21tr23:13:020
1247889992217,4cyclictest1216255-21kworker/u8:3+flush-8:019:22:590
1247889992217,3cyclictest0-21swapper/020:43:010
1247889992216,5cyclictest1329317-21kworker/u8:0+events_unbound20:53:090
124789599210,8cyclictest13673382cut21:08:032
124788999219,2cyclictest0-21swapper/022:43:030
1247889992118,2cyclictest0-21swapper/021:38:130
1247889992117,2cyclictest0-21swapper/019:35:010
1247889992112,7cyclictest1325127-21ps20:28:010
1247889992112,7cyclictest1325127-21ps20:28:000
15390562200,2sleep3481ktimers/300:03:033
124789599208,4cyclictest0-21swapper/223:38:022
124789599208,10cyclictest1506392-21tr23:28:022
124789599202,12cyclictest1518302-21apt-get23:42:542
1247895992016,2cyclictest1558328-21fschecks_count00:22:572
1247895992016,2cyclictest1314012-21grep20:13:132
1247889992016,3cyclictest600-21sshd22:55:530
1247889992016,3cyclictest1386124-21kthreadcore21:28:040
1247889992016,3cyclictest1324150-21kworker/u8:3+flush-8:021:07:580
1247889992016,2cyclictest0-21swapper/022:28:030
1247889992016,2cyclictest0-21swapper/022:28:020
1247889992016,2cyclictest0-21swapper/000:22:550
1247889992016,2cyclictest0-21swapper/000:13:050
1247889992014,5cyclictest1507734-21kworker/u8:0+flush-8:023:53:060
1247889992012,6cyclictest1566723-21ntpq00:28:070
1247895991915,2cyclictest0-21swapper/220:55:012
1247895991913,4cyclictest1531876-21needreboot23:53:042
1247895991911,6cyclictest1511872-21tr23:33:042
1247889991916,2cyclictest0-21swapper/021:23:100
1247889991913,3cyclictest0-21swapper/021:47:540
12432612192,10sleep30-21swapper/319:07:553
124789599189,7cyclictest1452260-21tr22:33:042
124789599182,11cyclictest1324598-21apt-get20:27:542
124789599182,11cyclictest1324598-21apt-get20:27:542
1247895991814,2cyclictest1439142-21fschecks_time22:22:562
1247895991814,2cyclictest0-21swapper/220:18:002
1247895991812,4cyclictest1485530-21kthreadcore23:08:062
124789599180,3cyclictest12863432cut19:47:592
124788999189,7cyclictest1267518-21cut19:28:020
1247895991713,2cyclictest1255224-21aten2_r5power_p19:17:542
1247895991713,2cyclictest0-21swapper/220:23:002
1247895991712,4cyclictest1216255-21kworker/u8:3+flush-8:019:33:072
124789599162,13cyclictest0-21swapper/221:57:092
1247895991612,2cyclictest0-21swapper/200:27:542
1247895991512,2cyclictest0-21swapper/221:00:042
1247895991511,2cyclictest0-21swapper/221:12:532
124789599151,10cyclictest1568234-21/usr/sbin/munin00:32:592
15518462144,6sleep30-21swapper/300:13:103
12801472142,8sleep30-21swapper/319:42:533
124789599145,7cyclictest1538118-21cut00:02:552
15374142133,6sleep30-21swapper/323:58:133
15227862132,6sleep30-21swapper/323:45:013
15033792132,7sleep30-21swapper/323:27:523
14582292132,6sleep30-21swapper/322:40:023
14374032132,7sleep30-21swapper/322:18:073
14282512132,6sleep30-21swapper/322:10:013
14138462132,7sleep30-21swapper/321:57:533
14033152132,6sleep30-21swapper/321:45:013
13300572132,7sleep30-21swapper/320:33:003
12846892132,6sleep30-21swapper/319:45:023
15682332122,6sleep30-21swapper/300:33:013
15626372122,6sleep30-21swapper/300:25:013
15583062122,6sleep30-21swapper/300:22:573
15568122122,6sleep30-21swapper/300:18:123
15454812122,6sleep30-21swapper/300:08:043
15083182122,6sleep30-21swapper/323:32:553
14976432122,6sleep30-21swapper/323:19:073
14920002122,6sleep30-21swapper/323:13:083
14829042122,5sleep30-21swapper/323:05:013
14723602122,6sleep30-21swapper/322:53:103
14680212122,5sleep30-21swapper/322:50:013
14536792122,6sleep30-21swapper/322:37:533
14463512122,6sleep30-21swapper/322:28:023
14463512122,6sleep30-21swapper/322:28:023
14397462122,6sleep30-21swapper/322:23:013
14257292122,6sleep30-21swapper/322:08:043
14225462122,7sleep30-21swapper/322:03:073
13938712122,6sleep30-21swapper/321:37:553
13884642122,6sleep30-21swapper/321:30:013
13780952122,6sleep30-21swapper/321:18:133
13700072122,6sleep30-21swapper/321:13:003
13639832122,6sleep30-21swapper/321:05:383
13493422122,6sleep30-21swapper/320:52:543
13443262123,5sleep30-21swapper/320:47:123
13151792122,6sleep30-21swapper/320:17:593
12949782122,6sleep30-21swapper/319:57:533
12571052122,6sleep30-21swapper/319:18:013
15730912111,6sleep30-21swapper/300:37:573
15280722112,5sleep30-21swapper/323:51:553
15191862112,5sleep30-21swapper/323:43:013
15133322112,5sleep30-21swapper/323:37:553
14979732112,5sleep30-21swapper/323:20:023
14789532112,5sleep30-21swapper/323:03:023
14734292112,5sleep30-21swapper/322:57:513
14019292112,5sleep30-21swapper/321:43:053
13837442112,6sleep30-21swapper/321:25:163
13787932112,5sleep30-21swapper/321:20:023
13593152112,5sleep30-21swapper/321:02:573
13243592113,5sleep30-21swapper/320:25:063
13243592113,5sleep30-21swapper/320:25:063
13199652112,5sleep30-21swapper/320:22:573
13093442112,5sleep30-21swapper/320:10:013
13046032113,5sleep30-21swapper/320:05:083
12996842112,5sleep30-21swapper/320:00:023
12899302112,6sleep30-21swapper/319:51:483
12695742112,5sleep30-21swapper/319:30:013
12649222112,6sleep30-21swapper/319:26:003
12598692112,5sleep30-21swapper/319:20:033
12481202112,6sleep30-21swapper/319:11:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional