You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-15 - 08:12
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Mon Sep 15, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
120891921010,1sleep21208922-21cut20:30:192
1104177992721,5cyclictest1523700-21systemd-run00:00:000
1104185992623,2cyclictest0-21swapper/200:00:002
1104185992622,3cyclictest522-21in:imuxsock21:30:012
1104177992619,6cyclictest1124662-21cron19:25:010
1104185992520,3cyclictest1370413-21sort22:25:002
1104181992522,2cyclictest1329633-21sendmail22:00:001
1104177992519,5cyclictest1588192-21systemd-run00:39:590
1104177992518,5cyclictest0-21swapper/000:10:000
1104177992516,2cyclictest0-21swapper/023:25:010
1104187992320,1cyclictest0-21swapper/300:35:003
1104185992319,3cyclictest501-21dbus-daemon22:55:002
1104177992316,2cyclictest1476086-21irqcore23:30:150
1104187992219,1cyclictest0-21swapper/320:25:003
1104181992219,2cyclictest1167970-21sh20:00:011
1104177992216,1cyclictest0-21swapper/022:20:000
1104177992215,2cyclictest1545743-21unixbench_singl00:10:270
1104177992213,4cyclictest508-21polkitd00:30:220
1104187992119,1cyclictest0-21swapper/300:00:003
1104187992118,1cyclictest0-21swapper/322:45:003
1104185992118,2cyclictest1230248-21cron20:55:002
1104185992117,3cyclictest1501200-21kthreadcore23:45:192
1104181992118,2cyclictest1410525-21systemd-run22:50:001
1104181992118,2cyclictest1410525-21systemd-run22:50:001
1104181992118,2cyclictest1136971-21sh19:35:011
1104177992115,2cyclictest1104167-21cyclictest22:00:000
1104187992017,1cyclictest0-21swapper/323:55:003
1104187992017,1cyclictest0-21swapper/320:05:003
1104187992017,1cyclictest0-21swapper/300:40:003
1104181992017,2cyclictest0-21swapper/100:00:001
1104187991916,1cyclictest0-21swapper/321:40:013
1104185991915,2cyclictest0-21swapper/222:45:012
1104185991914,3cyclictest1131557-21irqcore19:30:172
1104181991916,2cyclictest1508118-21fschecks_count23:50:161
1104177991911,7cyclictest1180866-21kworker/0:2+kacpid21:50:190
1104187991815,1cyclictest0-21swapper/323:50:013
1104185991815,2cyclictest1588201-21latency_hist00:40:002
1104185991815,2cyclictest1549512-21irqrtprio00:15:182
1104185991815,2cyclictest1331375-21grep22:00:182
1104185991814,3cyclictest500-21avahi-daemon00:15:002
1104185991814,2cyclictest0-21swapper/221:35:012
1104181991815,2cyclictest1118605-21latency_hist19:20:011
1104181991814,3cyclictest1234463-21kthreadcore20:55:201
1104181991814,3cyclictest1149583-21systemd-run19:45:011
1104177991815,2cyclictest1305427-21cut21:45:010
1104177991813,4cyclictest0-21swapper/021:20:000
1104187991714,1cyclictest0-21swapper/323:15:003
1104187991714,1cyclictest0-21swapper/322:50:223
1104187991714,1cyclictest0-21swapper/322:35:203
1104187991714,1cyclictest0-21swapper/319:35:003
1104187991714,1cyclictest0-21swapper/319:25:213
1104185991714,2cyclictest1443534-21cpuspeed_turbos23:10:142
1104185991714,2cyclictest0-21swapper/220:05:002
1104185991713,3cyclictest1491816-21cpuspeed_turbos23:40:132
1104185991713,3cyclictest1262261-21ntp_kernel_pll_21:15:222
1104185991713,3cyclictest1140451-21kthreadcore19:35:212
1104185991713,3cyclictest0-21swapper/219:15:012
1104185991713,2cyclictest1510209-21kthreadcore23:50:192
1104185991713,2cyclictest1181022-21sed20:10:192
1104185991712,3cyclictest514-21systemd-logind23:25:012
1104185991712,3cyclictest1130339-21unixbench-2d19:25:252
1104185991710,5cyclictest1167968-21cron20:00:012
1104181991714,2cyclictest1250652-21kthreadcore21:10:191
1104181991714,2cyclictest0-21swapper/119:14:591
1104181991713,2cyclictest1257630-21grep21:15:181
1104181991712,4cyclictest1331228-21irqrtprio22:00:171
1104181991711,5cyclictest0-21swapper/120:15:001
110417799176,9cyclictest547-21gdbus21:00:000
1104177991715,1cyclictest1368040-21unixbench_multi22:20:250
1104177991715,1cyclictest1137039-21apt-config19:35:010
1104177991714,2cyclictest500-21avahi-daemon21:15:010
1104177991714,2cyclictest0-21swapper/022:55:240
1104177991714,2cyclictest0-21swapper/022:30:000
1104177991713,3cyclictest1561216-21missed_timers00:20:210
1104187991614,1cyclictest0-21swapper/319:15:023
1104187991613,1cyclictest0-21swapper/323:35:173
1104187991613,1cyclictest0-21swapper/322:20:003
1104187991613,1cyclictest0-21swapper/319:40:013
1104187991613,1cyclictest0-21swapper/300:15:183
1104187991613,1cyclictest0-21swapper/300:05:173
110418599169,5cyclictest3818356-21systemd-journal22:36:192
1104185991613,2cyclictest1564513-21fschecks_count00:25:152
1104185991613,2cyclictest0-21swapper/223:15:232
1104185991612,3cyclictest1560170-21kthreadcore00:20:202
1104185991612,3cyclictest1306007-21cut21:45:152
1104185991612,3cyclictest1294408-21needreboot21:35:202
1104185991612,3cyclictest1-21systemd19:22:072
1104185991612,3cyclictest1202034-21kthreadcore20:25:192
1104185991612,2cyclictest0-21swapper/220:35:152
1104185991612,2cyclictest0-21swapper/219:45:142
1104185991612,2cyclictest0-21swapper/219:40:172
1104185991612,2cyclictest0-21swapper/200:00:152
1104181991613,2cyclictest508-21polkitd19:50:011
1104181991613,2cyclictest1394435-21latency_hist22:40:001
1104181991612,3cyclictest1-21systemd20:37:191
1104177991613,2cyclictest1502816-21kthreadcore23:45:200
1104177991613,2cyclictest1488689-21head23:35:200
1104177991612,3cyclictest1154722-21head19:45:200
1104177991612,2cyclictest0-21swapper/022:55:010
1104187991513,1cyclictest0-21swapper/322:25:003
1104187991512,1cyclictest0-21swapper/323:40:223
1104187991512,1cyclictest0-21swapper/323:20:183
1104187991512,1cyclictest0-21swapper/323:05:213
1104187991512,1cyclictest0-21swapper/322:31:193
1104187991512,1cyclictest0-21swapper/322:00:193
1104187991512,1cyclictest0-21swapper/321:30:013
1104187991512,1cyclictest0-21swapper/320:30:143
1104187991512,1cyclictest0-21swapper/320:30:003
1104187991512,1cyclictest0-21swapper/320:05:173
1104187991512,1cyclictest0-21swapper/300:30:003
110418599159,4cyclictest1272607-21sshd21:24:182
110418599158,5cyclictest501-21dbus-daemon19:20:002
1104185991512,2cyclictest1577648-21mailstats00:30:222
1104185991512,2cyclictest1475708-21tr23:30:122
1104185991512,2cyclictest0-21swapper/222:15:002
1104185991511,3cyclictest1436595-21irqrtprio23:05:162
1104185991511,3cyclictest1374175-21kthreadcore22:25:192
1104185991511,3cyclictest1338151-21cpuspeed_turbos22:05:132
1104185991511,3cyclictest1325835-21kthreadcore21:55:192
1104185991511,3cyclictest1319397-21unixbench_singl21:50:262
1104185991511,3cyclictest1242139-21unixbench-2d21:00:262
1104185991511,2cyclictest1248768-21diskmemload23:00:152
1104185991511,2cyclictest0-21swapper/223:00:002
110418199159,5cyclictest0-21swapper/123:15:201
110418199159,4cyclictest501-21dbus-daemon21:55:011
110418199159,4cyclictest1488871-21systemctl23:35:221
1104181991512,2cyclictest500-21avahi-daemon00:15:241
1104181991512,2cyclictest1427625-21gltestperf23:00:161
1104181991512,2cyclictest1341062-21kthreadcore22:05:191
1104181991512,2cyclictest1285202-21kthreadcore21:30:201
1104181991512,2cyclictest1230375-21latency_hist20:55:011
1104181991512,2cyclictest1193286-21gltestperf20:20:161
1104181991512,2cyclictest0-21swapper/123:25:001
1104181991512,2cyclictest0-21swapper/122:55:001
1104181991511,3cyclictest1179338-21needreboot20:05:201
1104181991511,2cyclictest0-21swapper/121:45:131
110418199150,14cyclictest1470273-21kthreadcore23:25:191
110418199150,12cyclictest0-21swapper/121:05:131
110417799158,5cyclictest547-21gdbus20:25:000
110417799154,3cyclictest0-21swapper/020:25:200
1104177991512,2cyclictest1377864-21kworker/u8:0-nfsiod22:30:160
1104177991512,2cyclictest1313614-21latency_hist21:50:000
1104177991512,2cyclictest1279882-21kworker/u8:2-xprtiod21:35:010
1104177991512,2cyclictest1248768-21diskmemload22:05:190
1104177991512,2cyclictest1248284-21unixbench-2d21:05:260
1104177991512,2cyclictest1181009-21irqcore20:10:190
1104177991512,2cyclictest1137853-21gltestperf19:35:180
1104177991512,2cyclictest1113991-21kernelversion19:15:190
1104177991512,2cyclictest0-21swapper/021:40:010
1104177991511,3cyclictest1467907-21gltestperf23:25:160
1104177991511,3cyclictest1394983-21cut22:40:140
1104187991412,1cyclictest0-21swapper/321:53:193
1104187991411,1cyclictest0-21swapper/323:04:393
1104187991411,1cyclictest0-21swapper/322:05:173
1104187991411,1cyclictest0-21swapper/321:45:163
1104187991411,1cyclictest0-21swapper/321:31:503
1104187991411,1cyclictest0-21swapper/321:25:013
1104187991411,1cyclictest0-21swapper/321:15:203
1104187991411,1cyclictest0-21swapper/321:10:223
1104187991411,1cyclictest0-21swapper/321:10:013
1104187991411,1cyclictest0-21swapper/320:44:203
1104187991411,1cyclictest0-21swapper/319:45:103
110418799140,3cyclictest14675542sleep323:25:133
110418599148,5cyclictest0-21swapper/221:40:172
1104185991411,2cyclictest1532330-21fschecks_time00:05:172
1104185991411,2cyclictest1354168-21sh22:15:112
1104185991411,2cyclictest1244888-21kthreadcore21:05:182
1104185991411,2cyclictest1193401-21irqcore20:20:172
1104185991411,2cyclictest0-21swapper/220:55:212
1104185991410,3cyclictest1473093-21unixbench-2d23:25:252
1104185991410,2cyclictest0-21swapper/222:30:162
1104181991412,1cyclictest0-21swapper/123:10:001
1104181991411,2cyclictest508-21polkitd19:25:011
1104181991411,2cyclictest1477652-21kthreadcore23:30:171
1104181991411,2cyclictest1382643-21kthreadcore22:30:191
1104181991411,2cyclictest1378329-21latency_hist22:30:001
1104181991411,2cyclictest1347038-21irqrtprio22:10:191
1104181991411,2cyclictest1271569-21kworker/u8:3-ext4-rsv-conversion21:40:011
1104181991411,2cyclictest1242119-21unixbench-2d21:00:261
1104181991411,2cyclictest0-21swapper/100:30:001
1104181991411,2cyclictest0-21swapper/100:15:001
1104181991410,2cyclictest0-21swapper/100:20:151
110417799147,5cyclictest0-21swapper/000:15:200
110417799144,2cyclictest1180866-21kworker/0:2+kacpid23:08:210
1104177991411,2cyclictest1443682-21gltestperf23:10:160
1104177991411,2cyclictest1346619-21irqcore22:10:190
1104177991411,2cyclictest1205484-21cut20:30:160
1104177991411,2cyclictest1180866-21kworker/0:2+kacpid23:20:010
1104177991411,2cyclictest1180866-21kworker/0:2+kacpid22:39:360
1104177991411,2cyclictest1125147-21cut19:25:150
1104177991411,2cyclictest1109831-21unixbench_multi19:10:260
1104177991411,2cyclictest0-21swapper/020:50:010
1104177991410,3cyclictest1564924-21irqcore00:25:170
1104177991410,2cyclictest1271569-21kworker/u8:3-events_unbound21:25:170
1104187991311,1cyclictest0-21swapper/321:40:143
1104187991311,1cyclictest0-21swapper/320:10:223
1104187991310,1cyclictest0-21swapper/323:15:183
1104187991310,1cyclictest0-21swapper/322:55:193
1104187991310,1cyclictest0-21swapper/322:25:193
1104187991310,1cyclictest0-21swapper/322:10:173
1104187991310,1cyclictest0-21swapper/321:55:203
1104187991310,1cyclictest0-21swapper/320:55:203
1104187991310,1cyclictest0-21swapper/320:16:103
1104187991310,1cyclictest0-21swapper/319:55:173
1104187991310,1cyclictest0-21swapper/319:53:033
1104187991310,1cyclictest0-21swapper/319:41:013
1104187991310,1cyclictest0-21swapper/319:20:173
1104187991310,1cyclictest0-21swapper/300:10:143
1104187991310,1cyclictest0-21swapper/300:00:143
110418599139,2cyclictest0-21swapper/221:10:152
110418599131,9cyclictest3818356-21systemd-journal20:19:592
1104185991310,2cyclictest1403119-21fschecks_time22:45:152
1104185991310,2cyclictest1403119-21fschecks_time22:45:152
110418199139,3cyclictest1525312-21irqrtprio00:00:181
110418199139,2cyclictest0-21swapper/120:20:001
110418199139,2cyclictest0-21swapper/100:10:001
110418199138,4cyclictest1173909-21sshd20:02:201
110418199137,4cyclictest1125174-21grep19:25:151
1104181991310,2cyclictest1580761-21gltestperf00:35:161
1104181991310,2cyclictest1572493-21cpuspeed_turbos00:30:131
1104181991310,2cyclictest1354264-21cpuspeed_turbos22:15:121
1104181991310,2cyclictest1248768-21diskmemload22:40:171
1104181991310,2cyclictest1204402-21timerwakeupswit20:25:241
1104181991310,2cyclictest1161335-21unixbench-2d19:50:251
1104181991310,2cyclictest1142384-21needreboot19:35:231
1104181991310,2cyclictest0-21swapper/123:40:181
1104181991310,2cyclictest0-21swapper/121:25:001
1104181991310,2cyclictest0-21swapper/119:10:011
1104181991310,1cyclictest0-21swapper/123:45:181
110418199130,1cyclictest0-21swapper/121:25:131
110418199130,12cyclictest1426877-21cron22:59:591
110418199130,12cyclictest0-21swapper/122:20:261
110417799139,3cyclictest1079749-21kworker/0:0+kacpi_notify20:00:140
110417799137,4cyclictest3818356-21systemd-journal20:54:590
110417799134,7cyclictest0-21swapper/023:00:200
110417799131,2cyclictest1155959-21apt-get19:50:140
1104177991311,1cyclictest1180866-21kworker/0:2+kacpid22:45:140
1104177991311,1cyclictest1180866-21kworker/0:2+kacpid22:45:140
1104177991311,1cyclictest1165591-21kthreadcore19:55:160
1104177991310,2cyclictest769-21runrttasks00:02:450
1104177991310,2cyclictest1510895-21kthreadcore23:50:200
1104177991310,2cyclictest1330286-21gltestperf22:00:160
1104177991310,2cyclictest1266643-21sed21:20:170
1104177991310,2cyclictest1248768-21diskmemload23:40:230
1104177991310,2cyclictest1180866-21kworker/0:2+kacpid20:19:540
10982192131,5sleep01098252-21apt-get19:05:140
110418799129,1cyclictest0-21swapper/323:30:143
110418799129,1cyclictest0-21swapper/319:10:203
1104187991210,1cyclictest0-21swapper/322:45:163
1104187991210,1cyclictest0-21swapper/322:45:163
1104187991210,1cyclictest0-21swapper/300:20:183
110418599129,2cyclictest0-21swapper/220:05:212
110418599129,1cyclictest0-21swapper/219:50:182
110418599128,3cyclictest1219591-21kthreadcore20:45:122
110418199129,2cyclictest1300684-21sh21:40:171
110418199129,2cyclictest1219586-21kthreadcore20:45:131
110418199121,2cyclictest1217940-21latency_hist20:45:011
110418199120,2cyclictest12089222cut20:30:191
110418199120,11cyclictest0-21swapper/123:11:121
110417799127,4cyclictest501-21dbus-daemon20:45:000
110417799127,4cyclictest1174587-21fschecks_count20:05:160
110417799121,3cyclictest1236698-21/usr/sbin/munin21:00:240
1104177991210,1cyclictest1079749-21kworker/0:0+kacpid19:40:180
110418799119,1cyclictest0-21swapper/320:35:163
110418799118,1cyclictest0-21swapper/321:00:233
110418799118,1cyclictest0-21swapper/320:45:083
110418599116,3cyclictest0-21swapper/220:45:002
110418599113,3cyclictest1486239-21cut23:35:182
110417799118,2cyclictest1211653-21fschecks_time20:35:140
110418799108,1cyclictest0-21swapper/320:50:173
11041879997,1cyclictest0-21swapper/319:10:013
1100864280,4sleep21102946-21grep19:05:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional