You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-15 - 06:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Wed Jan 15, 2025 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
138702303274,18sleep20-21swapper/219:08:022
140012271236,23sleep30-21swapper/319:09:443
139552269236,20sleep00-21swapper/019:09:090
139662263206,19sleep10-21swapper/119:09:181
263542590,0sleep30-21swapper/322:17:123
213312580,0sleep10-21swapper/122:13:521
159392580,0sleep30-21swapper/321:17:563
113102560,0sleep10-21swapper/122:30:501
112192530,0sleep00-21swapper/022:30:460
186652520,0sleep20-21swapper/221:45:462
105182200,0sleep20-21swapper/222:04:492
224082190,0sleep00-21swapper/022:15:000
285682160,1sleep10-21swapper/121:53:431
124402160,0sleep20-21swapper/200:10:342
238192150,1sleep323816-21turbostat00:20:003
178502150,1sleep00-21swapper/021:45:010
113402150,0sleep30-21swapper/322:55:193
230062130,0sleep20-21swapper/223:54:522
132682120,0chrt0-21swapper/322:32:413
287312110,0sleep10-21swapper/120:50:161
248882100,0sleep00-21swapper/023:55:190
1413899109,1cyclictest22-21ksoftirqd/123:10:011
1413399104,3cyclictest30384-21dump-pmu-power19:45:010
7942290,0sleep10-21swapper/121:11:291
141469994,3cyclictest20523-21systemd-udevd23:42:203
141429994,3cyclictest502-21systemd-logind23:25:112
141389990,0cyclictest141rcu_preempt00:00:011
6527280,1sleep228-21ksoftirqd/221:10:232
141469984,3cyclictest19982-21systemd-journal23:46:033
141469983,3cyclictest19982-21systemd-journal21:11:093
141469980,2cyclictest19982-21systemd-journal21:28:463
141429985,2cyclictest8914-21munin-run00:35:012
141429984,3cyclictest19982-21systemd-journal21:07:552
141429983,4cyclictest30191-21latency_hist00:00:002
141429981,4cyclictest11331-21dump-pmu-power20:15:012
141389986,1cyclictest22-21ksoftirqd/123:20:001
141389986,1cyclictest22-21ksoftirqd/122:40:001
141389983,3cyclictest19982-21systemd-journal23:26:351
141389983,3cyclictest19982-21systemd-journal00:00:391
141389982,4cyclictest19982-21systemd-journal20:58:441
141389982,4cyclictest19982-21systemd-journal20:58:441
141339985,2cyclictest12-21ksoftirqd/021:00:000
141339985,2cyclictest12-21ksoftirqd/021:00:000
141339983,3cyclictest19982-21systemd-journal20:50:190
141339980,1cyclictest12821-21cat20:15:180
9952270,1sleep20-21swapper/223:19:532
141469974,2cyclictest28528-21dump-pmu-power23:10:013
141469974,2cyclictest2049-21users21:00:213
141469974,2cyclictest11736-21in:imuxsock22:43:283
141469973,3cyclictest7661-21lldpd22:37:243
141469973,3cyclictest508-21dbus-daemon19:15:163
141469973,3cyclictest4899-21apt-get20:00:133
141469973,3cyclictest0-21swapper/321:31:263
141469973,2cyclictest19982-21systemd-journal19:53:193
141469973,1cyclictest0-21swapper/321:49:163
141469972,3cyclictest19982-21systemd-journal00:30:413
141469970,3cyclictest19982-21systemd-journal23:20:003
141429974,2cyclictest508-21dbus-daemon20:35:002
141429974,2cyclictest30654-21snmpd00:37:082
141429973,3cyclictest508-21dbus-daemon22:37:362
141429973,3cyclictest25120-21smart_sda19:30:222
141429973,3cyclictest19982-21systemd-journal23:22:202
141429973,3cyclictest19982-21systemd-journal19:41:572
141429973,3cyclictest19982-21systemd-journal19:20:472
141429973,3cyclictest0-21swapper/221:55:182
141429973,1cyclictest0-21swapper/221:42:292
141429973,1cyclictest0-21swapper/221:33:372
141429973,1cyclictest0-21swapper/200:17:202
141429972,3cyclictest19982-21systemd-journal00:23:102
141429972,3cyclictest19982-21systemd-journal00:00:132
141429971,5cyclictest271rcuc/219:25:102
141389974,2cyclictest11736-21in:imuxsock23:25:001
141389973,3cyclictest7661-21lldpd21:26:121
141389973,3cyclictest508-21dbus-daemon21:45:011
141389973,3cyclictest29741-11brltty23:51:521
141389973,3cyclictest24655-21cron21:24:591
141389973,3cyclictest19982-21systemd-journal23:00:201
141389973,3cyclictest19982-21systemd-journal19:32:471
141389973,3cyclictest0-21swapper/123:31:421
141389973,1cyclictest0-21swapper/123:37:591
141389972,3cyclictest19982-21systemd-journal00:34:181
141389972,3cyclictest19982-21systemd-journal00:27:461
141389971,3cyclictest16343-21rm21:18:201
141389970,4cyclictest2462-21munin-run21:05:001
141389970,3cyclictest19982-21systemd-journal21:48:241
141339975,1cyclictest6719-21ssh00:32:210
141339974,2cyclictest502-21systemd-logind21:37:570
141339973,3cyclictest30654-21snmpd21:27:050
141339973,3cyclictest19982-21systemd-journal23:29:540
141339973,3cyclictest19982-21systemd-journal21:14:090
141339973,3cyclictest19982-21systemd-journal00:23:090
141339973,3cyclictest14070-21ssh22:57:510
141339973,3cyclictest0-21swapper/021:45:240
141339972,3cyclictest19982-21systemd-journal20:49:590
141339972,3cyclictest19982-21systemd-journal00:17:190
141339970,7cyclictest0-21swapper/023:41:150
141339970,3cyclictest3065450snmpd00:29:420
6545260,0sleep10-21swapper/121:35:241
22672260,1sleep20-21swapper/222:15:032
141469963,2cyclictest9553-21sh00:35:093
141469963,2cyclictest422-21sshd21:56:153
141469963,2cyclictest4126-21ssh22:25:283
141469963,2cyclictest2949-21sh00:03:173
141469963,2cyclictest19013-21sh22:11:303
141469963,2cyclictest18352-21rm23:00:203
141469963,2cyclictest18117-21rm23:25:473
141469963,2cyclictest16931-21cpuspeed_turbos23:50:083
141469962,3cyclictest508-21dbus-daemon22:05:293
141469962,3cyclictest508-21dbus-daemon20:50:003
141469962,3cyclictest3323-21cat19:55:163
141469962,3cyclictest30654-21snmpd22:22:193
141469962,3cyclictest30654-21snmpd20:35:363
141469962,3cyclictest30654-21snmpd20:26:103
141469962,3cyclictest30654-21snmpd20:24:283
141469962,3cyclictest30654-21snmpd20:10:423
141469962,3cyclictest23683-21cat21:50:083
141469962,3cyclictest23151-21expr23:30:103
141469962,3cyclictest11988-21tune2fs21:40:133
141469962,2cyclictest19982-21systemd-journal23:23:203
141469962,1cyclictest0-21swapper/321:39:243
141469962,1cyclictest0-21swapper/321:21:103
141469962,1cyclictest0-21swapper/300:11:253
141469961,4cyclictest0-21swapper/322:00:193
141469961,3cyclictest19982-21systemd-journal23:10:103
141469961,3cyclictest19982-21systemd-journal22:50:073
141469961,3cyclictest19982-21systemd-journal22:50:073
141469961,3cyclictest19982-21systemd-journal00:26:463
141469961,2cyclictest27695-21ssh00:22:003
141469961,1cyclictest30677-21apt-get20:55:153
141469961,1cyclictest30677-21apt-get20:55:143
141469960,6cyclictest0-21swapper/323:57:303
141469960,6cyclictest0-21swapper/323:35:013
141469960,5cyclictest508-21dbus-daemon00:06:033
141469960,5cyclictest30602-21/usr/sbin/munin19:45:123
141469960,4cyclictest19982-21systemd-journal22:45:073
141469960,4cyclictest19982-21systemd-journal20:09:203
141469960,2cyclictest3401-21irqstats21:05:143
141469960,0cyclictest0-21swapper/320:30:293
141429966,0cyclictest0-21swapper/221:50:552
141429966,0cyclictest0-21swapper/220:29:072
141429964,1cyclictest32591-21cron19:50:002
141429963,2cyclictest668-21runrttasks19:59:512
141429963,2cyclictest4807-21sh22:50:202
141429963,2cyclictest4807-21sh22:50:202
141429963,2cyclictest25906-21ssh22:41:052
141429963,2cyclictest19982-21systemd-journal22:31:182
141429963,2cyclictest19982-21systemd-journal20:53:192
141429963,2cyclictest1998-21taskset19:50:242
141429963,2cyclictest14695-21expr19:10:132
141429963,2cyclictest11736-21in:imuxsock21:27:302
141429963,2cyclictest11736-21in:imuxsock21:02:302
141429963,1cyclictest0-21swapper/222:08:302
141429962,3cyclictest30654-21snmpd23:35:202
141429962,3cyclictest30654-21snmpd23:31:452
141429962,3cyclictest30654-21snmpd22:55:052
141429962,3cyclictest30654-21snmpd22:45:402
141429962,3cyclictest30654-21snmpd20:44:032
141429962,3cyclictest30654-21snmpd00:26:502
141429962,3cyclictest17008-21ls22:10:132
141429962,3cyclictest14514-21cat20:20:152
141429962,3cyclictest12255-21cat20:15:152
141429962,3cyclictest12051-21expr21:15:112
141429962,3cyclictest0-21swapper/223:46:252
141429962,1cyclictest0-21swapper/223:11:282
141429962,1cyclictest0-21swapper/222:27:172
141429962,1cyclictest0-21swapper/222:20:112
141429962,1cyclictest0-21swapper/221:21:302
141429962,1cyclictest0-21swapper/200:06:372
141429961,3cyclictest19982-21systemd-journal20:38:172
141429960,6cyclictest0-21swapper/223:40:152
141429960,4cyclictest19982-21systemd-journal20:05:202
141429960,2cyclictest19982-21systemd-journal19:35:462
141429960,0cyclictest24047-21ssh23:05:302
141429960,0cyclictest0-21swapper/223:02:012
141429960,0cyclictest0-21swapper/221:36:142
141389966,0cyclictest0-21swapper/122:25:171
141389965,1cyclictest22-21ksoftirqd/119:15:011
141389963,2cyclictest31042-21taskset22:45:521
141389963,2cyclictest30654-21snmpd19:12:261
141389963,2cyclictest20057-21hwlatdetect19:20:141
141389963,2cyclictest12721-21sh22:56:311
141389963,2cyclictest12183-21sshd22:06:181
141389963,2cyclictest11712-21cut20:15:111
141389963,2cyclictest10994-21switchtime00:35:211
141389962,3cyclictest3119-21grep21:05:111
141389962,3cyclictest30654-21snmpd20:48:221
141389962,3cyclictest30654-21snmpd20:40:491
141389962,3cyclictest30654-21snmpd20:32:571
141389962,3cyclictest30654-21snmpd20:05:381
141389962,3cyclictest30654-21snmpd19:45:421
141389962,3cyclictest29847-21ls22:20:111
141389962,3cyclictest28688-21expr19:40:141
141389962,3cyclictest19982-21systemd-journal22:00:301
141389962,3cyclictest14537-21cut20:20:161
141389962,3cyclictest1-21systemd20:05:011
141389962,3cyclictest11159-21cat00:10:111
141389962,3cyclictest0-21swapper/121:30:501
141389962,2cyclictest19982-21systemd-journal22:40:321
141389962,1cyclictest0-21swapper/121:57:211
141389962,1cyclictest0-21swapper/100:20:041
141389961,3cyclictest19982-21systemd-journal23:41:381
141389961,3cyclictest19982-21systemd-journal19:54:291
141389961,3cyclictest19982-21systemd-journal19:27:461
141389961,3cyclictest19982-21systemd-journal00:15:151
141389960,6cyclictest0-21swapper/123:45:531
141389960,6cyclictest0-21swapper/119:55:181
141389960,5cyclictest28837-21/usr/sbin/munin23:10:161
141389960,4cyclictest19982-21systemd-journal20:39:331
141389960,4cyclictest19982-21systemd-journal20:12:251
141389960,3cyclictest7344-21ssh00:07:221
141389960,3cyclictest3026-21/usr/sbin/munin22:50:141
141389960,3cyclictest3026-21/usr/sbin/munin22:50:141
141389960,3cyclictest23607-21rm22:15:161
141339963,2cyclictest7091-21ssh00:07:080
141339963,2cyclictest670-21ssh21:56:290
141339963,2cyclictest508-21dbus-daemon20:06:340
141339963,2cyclictest32153-21sh23:36:000
141339963,2cyclictest30654-21snmpd22:25:040
141339963,2cyclictest30654-21snmpd19:45:030
141339963,2cyclictest30486-21ssh00:00:030
141339963,2cyclictest2630-21sh22:24:090
141339963,2cyclictest20856-21cron20:35:010
141339963,2cyclictest19963-21grep19:20:140
141339963,2cyclictest19447-21ssh23:01:230
141339963,2cyclictest16168-21taskset19:13:210
141339963,2cyclictest14490-21if_enp4s020:20:160
141339963,2cyclictest13541-21ssh00:11:400
141339963,2cyclictest1-21systemd21:30:050
141339963,2cyclictest11736-21in:imuxsock23:16:330
141339963,2cyclictest11736-21in:imuxsock22:36:210
141339963,2cyclictest11736-21in:imuxsock22:16:190
141339963,2cyclictest11736-21in:imuxsock21:50:040
141339963,2cyclictest11736-21in:imuxsock21:02:040
141339963,2cyclictest10947-21smart_sda00:35:200
141339963,1cyclictest0-21swapper/022:48:120
141339962,3cyclictest5257-21basename22:00:150
141339962,3cyclictest5179-21ssh22:50:440
141339962,3cyclictest5179-21ssh22:50:440
141339962,3cyclictest30654-21snmpd22:40:320
141339962,3cyclictest30654-21snmpd21:20:110
141339962,3cyclictest30654-21snmpd20:28:100
141339962,3cyclictest30654-21snmpd20:12:470
141339962,3cyclictest30654-21snmpd20:00:410
141339962,3cyclictest30654-21snmpd19:31:540
141339962,3cyclictest30654-21snmpd19:18:310
141339962,3cyclictest2986-21expr19:55:140
141339962,3cyclictest2981-21expr21:05:100
141339962,3cyclictest23833-21expr20:40:140
141339962,3cyclictest21406-21find20:35:120
141339962,3cyclictest11896-21grep21:15:120
141339962,3cyclictest11178-21which23:20:150
141339962,3cyclictest0-21swapper/023:06:400
141339962,1cyclictest0-21swapper/023:53:050
141339962,1cyclictest0-21swapper/023:48:100
141339962,1cyclictest0-21swapper/023:31:370
141339962,1cyclictest0-21swapper/022:05:070
141339961,3cyclictest19982-21systemd-journal19:36:080
141339961,3cyclictest19982-21systemd-journal19:25:170
141339960,0cyclictest0-21swapper/019:50:180
141469953,1cyclictest20204-21latency19:20:163
141469952,2cyclictest28633-21cat19:40:133
141469952,2cyclictest28631-21cstates20:50:153
141469952,2cyclictest26297-21cpuspeed_turbos19:35:153
141469952,2cyclictest24622-21grep20:40:173
141469952,2cyclictest24013-21cat19:30:173
141469951,3cyclictest22336-21cat19:25:143
141469951,3cyclictest14349-21apt-get19:10:123
141469951,3cyclictest12091-21grep20:15:143
141429952,2cyclictest4858-21seq20:00:022
141429952,2cyclictest31055-21/usr/sbin/munin20:55:162
141429952,2cyclictest31055-21/usr/sbin/munin20:55:162
141429952,2cyclictest26193-21acpi20:45:112
141429952,2cyclictest16647-21cat19:15:022
141389953,1cyclictest668-21runrttasks19:35:071
141389951,3cyclictest15801-21apt-get20:25:001
141339952,2cyclictest30654-21snmpd23:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional