You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 05:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Tue Nov 25, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194732299271,17sleep20-21swapper/219:06:532
196382278244,22sleep10-21swapper/119:08:411
196942275243,20sleep00-21swapper/019:09:240
196852260226,21sleep30-21swapper/319:09:193
51402650,0sleep30-21swapper/300:06:543
71252600,0sleep17128-21unixbench_multi21:00:191
182592570,0sleep30-21swapper/322:21:513
213832550,1sleep10-21swapper/121:40:041
277052190,0sleep10-21swapper/122:05:471
97142180,0sleep30-21swapper/322:39:093
219672180,0sleep30-21swapper/322:25:033
303082160,0sleep10-21swapper/121:45:211
104202150,0sleep20-21swapper/223:25:172
169222130,0sleep00-21swapper/021:36:140
117932130,0sleep30-21swapper/321:33:133
271482120,0sleep20-21swapper/222:05:202
258002120,0sleep30-21swapper/323:35:273
19855991210,1cyclictest34-21ksoftirqd/319:15:013
1984699105,3cyclictest19982-21systemd-journal22:35:181
1984299105,3cyclictest19982-21systemd-journal00:22:070
9692290,0sleep00-21swapper/023:01:520
4947290,1sleep10-21swapper/121:50:181
24824290,0sleep20-21swapper/223:58:112
198509994,3cyclictest19982-21systemd-journal21:33:082
5157280,0sleep20-21swapper/222:13:092
28256280,1sleep20-21swapper/222:51:572
198559984,2cyclictest19982-21systemd-journal22:16:073
198559984,2cyclictest19982-21systemd-journal19:52:433
198559983,3cyclictest19982-21systemd-journal21:07:273
198559983,3cyclictest19982-21systemd-journal20:17:393
198559983,2cyclictest508-21dbus-daemon00:40:003
198559982,4cyclictest34-21ksoftirqd/322:04:303
198509984,3cyclictest508-21dbus-daemon21:54:512
198509984,3cyclictest19116-21gdbus19:20:012
198509983,3cyclictest19982-21systemd-journal21:45:202
198469985,2cyclictest22-21ksoftirqd/121:25:121
198469984,3cyclictest9645-21ntpq19:55:171
198469984,3cyclictest508-21dbus-daemon20:33:541
198469984,3cyclictest21691-21latency_hist22:25:001
198469983,3cyclictest19982-21systemd-journal23:05:211
198469983,3cyclictest19982-21systemd-journal19:31:441
198429984,3cyclictest508-21dbus-daemon19:45:050
198429983,1cyclictest8434-21dump-pmu-power19:55:010
11834280,0sleep20-21swapper/221:10:212
6284270,1sleep30-21swapper/323:00:073
23565270,1sleep10-21swapper/122:49:001
198559974,2cyclictest11736-21in:imuxsock20:40:593
198559973,3cyclictest3694-21sshd21:27:303
198559973,3cyclictest19982-21systemd-journal22:49:303
198559973,3cyclictest0-21swapper/321:45:303
198559973,1cyclictest0-21swapper/323:50:363
198559973,1cyclictest0-21swapper/321:21:563
198559972,4cyclictest51850irq/136-enp4s0-22:10:133
198559972,4cyclictest0-21swapper/300:25:123
198509974,2cyclictest508-21dbus-daemon22:47:252
198509973,3cyclictest24582-21packagekitd20:35:052
198509973,3cyclictest21010-21ntpq19:10:182
198509973,3cyclictest19982-21systemd-journal23:22:022
198509973,3cyclictest19982-21systemd-journal20:52:152
198509973,3cyclictest19982-21systemd-journal19:56:462
198509973,3cyclictest19982-21systemd-journal19:47:422
198509973,3cyclictest0-21swapper/200:16:142
198509973,1cyclictest0-21swapper/222:33:232
198509973,1cyclictest0-21swapper/222:00:072
198509973,1cyclictest0-21swapper/200:11:102
198509972,3cyclictest7661-21lldpd22:20:112
198509972,3cyclictest19982-21systemd-journal19:27:412
198509970,3cyclictest10945-21/usr/sbin/munin21:55:202
198469974,2cyclictest28841-21idleruntime-cro20:40:001
198469974,2cyclictest22-21ksoftirqd/121:35:121
198469974,2cyclictest17444-21cron22:45:001
198469973,3cyclictest5149-21ntpq19:45:161
198469973,3cyclictest508-21dbus-daemon20:28:281
198469973,3cyclictest30654-21snmpd23:26:441
198469973,3cyclictest21266-21cat23:10:151
198469973,3cyclictest19982-21systemd-journal23:33:431
198469973,3cyclictest18728-21cut22:00:141
198469973,3cyclictest0-21swapper/123:59:061
198469973,3cyclictest0-21swapper/100:06:191
198469973,2cyclictest19982-21systemd-journal20:13:521
198469973,1cyclictest0-21swapper/123:37:371
198469973,1cyclictest0-21swapper/123:16:421
198469973,1cyclictest0-21swapper/121:31:311
198469972,4cyclictest30654-21snmpd23:04:341
198469972,3cyclictest7661-21lldpd00:10:121
198469972,3cyclictest19982-21systemd-journal22:12:511
198469970,3cyclictest7661-21lldpd20:04:391
198429974,2cyclictest11736-21in:imuxsock20:09:420
198429973,3cyclictest7661-21lldpd23:36:280
198429973,3cyclictest508-21dbus-daemon00:05:260
198429973,3cyclictest30654-21snmpd20:45:540
198429973,3cyclictest16328-21ntpq20:10:170
198429973,3cyclictest1-21systemd21:06:510
198429973,3cyclictest0-21swapper/023:58:510
198429973,3cyclictest0-21swapper/022:21:140
198429973,3cyclictest0-21swapper/022:14:200
198429973,3cyclictest0-21swapper/021:27:460
198429973,2cyclictest19982-21systemd-journal19:19:200
198429973,2cyclictest19982-21systemd-journal00:36:190
198429972,3cyclictest7661-21lldpd23:07:570
198429972,3cyclictest23559-21turbostat23:35:010
198429972,3cyclictest19982-21systemd-journal20:34:190
198429972,3cyclictest19982-21systemd-journal00:11:160
198429971,3cyclictest29078-21rm22:07:020
198429970,7cyclictest0-21swapper/021:43:100
198429970,4cyclictest31633-21dump-pmu-power21:24:590
7727260,5sleep28073-21df_inode22:15:142
29220260,0sleep10-21swapper/120:40:131
198559964,2cyclictest15042-21sshd23:05:203
198559964,1cyclictest23310-21smart_sda20:25:193
198559963,2cyclictest5814-21taskset19:45:373
198559963,2cyclictest508-21dbus-daemon22:05:163
198559963,2cyclictest29741-11brltty19:41:453
198559963,2cyclictest29132-21cupsd00:00:383
198559963,2cyclictest27833-21sort23:15:143
198559963,2cyclictest22558-21ssh23:10:403
198559963,2cyclictest19982-21systemd-journal20:13:023
198559963,2cyclictest1953-21sh22:56:103
198559963,2cyclictest19146-21awk21:15:233
198559963,2cyclictest11736-21in:imuxsock19:20:293
198559963,2cyclictest11736-21in:imuxsock00:14:363
198559963,2cyclictest0-21swapper/323:26:003
198559962,3cyclictest6303-21cat21:00:143
198559962,3cyclictest508-21dbus-daemon20:45:353
198559962,3cyclictest3981-21expr21:50:123
198559962,3cyclictest362-21ntpq19:35:203
198559962,3cyclictest30654-21snmpd23:41:053
198559962,3cyclictest30654-21snmpd23:22:143
198559962,3cyclictest30654-21snmpd21:41:143
198559962,3cyclictest30654-21snmpd21:35:193
198559962,3cyclictest30355-21sensors_temp22:30:183
198559962,3cyclictest25707-21cat22:50:153
198559962,3cyclictest2389-21cat00:30:193
198559962,3cyclictest20545-21cat20:20:173
198559962,3cyclictest19982-21systemd-journal20:35:343
198559962,3cyclictest15210-21expr00:15:133
198559962,3cyclictest11373-21expr22:40:133
198559962,3cyclictest0-21swapper/300:24:223
198559962,2cyclictest19982-21systemd-journal19:27:293
198559962,1cyclictest0-21swapper/323:30:523
198559962,1cyclictest0-21swapper/321:11:123
198559961,3cyclictest19982-21systemd-journal23:45:013
198559961,3cyclictest19982-21systemd-journal23:45:013
198559960,5cyclictest21670-21cat23:55:213
198559960,5cyclictest11185-21cat21:55:143
198559960,4cyclictest19982-21systemd-journal20:30:333
198559960,4cyclictest19982-21systemd-journal20:05:063
198509966,0cyclictest0-21swapper/223:00:342
198509966,0cyclictest0-21swapper/220:10:142
198509963,2cyclictest3419-21sed00:05:212
198509963,2cyclictest31969-21rm21:25:062
198509963,2cyclictest30654-21snmpd20:21:112
198509963,2cyclictest30654-21snmpd19:40:192
198509963,2cyclictest28002-21sh23:37:272
198509963,2cyclictest24321-21rm22:25:472
198509963,2cyclictest17664-21cpuspeed20:15:152
198509962,3cyclictest6344-21expr23:45:122
198509962,3cyclictest6344-21expr23:45:122
198509962,3cyclictest31874-21apt-get19:35:152
198509962,3cyclictest30654-21snmpd23:31:142
198509962,3cyclictest30654-21snmpd22:59:252
198509962,3cyclictest30654-21snmpd22:40:162
198509962,3cyclictest30654-21snmpd20:25:142
198509962,3cyclictest30654-21snmpd20:05:082
198509962,3cyclictest30654-21snmpd19:24:372
198509962,3cyclictest30654-21snmpd00:30:402
198509962,3cyclictest30654-21snmpd00:25:372
198509962,3cyclictest14184-21cat23:05:152
198509962,3cyclictest0-21swapper/223:41:142
198509962,2cyclictest19982-21systemd-journal20:55:102
198509962,1cyclictest0-21swapper/223:16:492
198509962,1cyclictest0-21swapper/223:10:272
198509962,1cyclictest0-21swapper/221:36:302
198509962,1cyclictest0-21swapper/221:24:412
198509962,1cyclictest0-21swapper/200:35:032
198509962,1cyclictest0-21swapper/200:01:422
198509961,3cyclictest19982-21systemd-journal23:53:002
198509961,3cyclictest19982-21systemd-journal21:40:402
198509961,3cyclictest19982-21systemd-journal21:00:112
198509960,6cyclictest0-21swapper/219:50:012
198509960,6cyclictest0-21swapper/200:20:182
198509960,5cyclictest4791-21interrupts22:35:162
198509960,4cyclictest19982-21systemd-journal21:18:572
198469963,2cyclictest508-21dbus-daemon19:40:301
198469963,2cyclictest30654-21snmpd20:56:001
198469963,2cyclictest29141-21sshd19:27:281
198469963,2cyclictest28000-21cat00:25:131
198469963,2cyclictest25008-21sh22:26:261
198469963,2cyclictest21076-21cut19:10:191
198469963,2cyclictest15837-21rm23:51:231
198469963,2cyclictest11736-21in:imuxsock19:22:341
198469962,3cyclictest508-21dbus-daemon23:23:421
198469962,3cyclictest32662-21grep22:55:161
198469962,3cyclictest30654-21snmpd20:45:031
198469962,3cyclictest30654-21snmpd20:15:081
198469962,3cyclictest25538-21grep22:50:141
198469962,3cyclictest24926-21cat21:20:131
198469962,3cyclictest19991-21grep20:20:141
198469962,3cyclictest19982-21systemd-journal21:07:511
198469962,3cyclictest15675-21cat00:15:161
198469962,3cyclictest0-21swapper/122:30:091
198469962,3cyclictest0-21swapper/121:10:121
198469962,1cyclictest0-21swapper/122:16:331
198469962,1cyclictest0-21swapper/121:55:511
198469962,1cyclictest0-21swapper/100:20:081
198469961,4cyclictest0-21swapper/100:35:191
198469961,3cyclictest19982-21systemd-journal20:50:001
198469961,3cyclictest19982-21systemd-journal00:30:521
198469960,6cyclictest0-21swapper/123:45:171
198469960,6cyclictest0-21swapper/123:45:171
198469960,5cyclictest31182-21dpkg23:40:121
198469960,2cyclictest18477-21ntp_states21:15:181
198469960,0cyclictest0-21swapper/100:00:331
198429963,2cyclictest9926-21expr23:25:140
198429963,2cyclictest7217-21expr21:30:140
198429963,2cyclictest23013-21sh23:11:050
198429963,2cyclictest19982-21systemd-journal20:56:250
198429963,2cyclictest19225-21netstat22:45:180
198429963,2cyclictest19103-21grep21:15:210
198429963,2cyclictest15904-21tail00:15:170
198429963,2cyclictest12-21ksoftirqd/019:27:090
198429963,2cyclictest11111-21tr20:00:140
198429963,2cyclictest0-21swapper/000:00:030
198429962,3cyclictest7661-21lldpd23:22:120
198429962,3cyclictest6180-21grep21:00:130
198429962,3cyclictest31875-21if_enp4s023:40:150
198429962,3cyclictest30654-21snmpd22:51:220
198429962,3cyclictest30654-21snmpd20:40:570
198429962,3cyclictest30654-21snmpd20:20:110
198429962,3cyclictest30654-21snmpd00:26:160
198429962,3cyclictest29927-21expr19:30:150
198429962,3cyclictest28007-21ls23:15:150
198429962,3cyclictest27120-21cat20:35:130
198429962,3cyclictest25619-21tune2fs19:20:150
198429962,3cyclictest21054-21pluginstate19:10:190
198429962,3cyclictest19982-21systemd-journal23:46:390
198429962,3cyclictest19982-21systemd-journal23:46:390
198429962,3cyclictest19982-21systemd-journal19:55:060
198429962,3cyclictest18895-21cat20:15:220
198429962,3cyclictest1735-21cat00:30:150
198429962,3cyclictest13762-21cat23:50:160
198429962,3cyclictest11502-21df22:40:130
198429962,3cyclictest0-21swapper/022:35:170
198429962,3cyclictest0-21swapper/022:25:130
198429962,3cyclictest0-21swapper/022:00:260
198429962,3cyclictest0-21swapper/021:50:550
198429962,3cyclictest0-21swapper/021:46:360
198429961,3cyclictest19982-21systemd-journal21:55:200
198429961,3cyclictest19982-21systemd-journal20:26:220
198429960,6cyclictest0-21swapper/022:15:170
198429960,6cyclictest0-21swapper/021:12:000
198429960,5cyclictest32550-21idleruntime22:55:150
198429960,3cyclictest31841-21sh22:31:250
198559953,1cyclictest34-21ksoftirqd/319:15:013
198559952,2cyclictest8653-21taskset19:55:063
198559952,2cyclictest3347-21taskset20:55:083
198559952,2cyclictest29696-21cat19:30:143
198559951,3cyclictest2076-21/usr/sbin/munin20:50:173
198559951,3cyclictest11194-21expr20:00:143
198509952,2cyclictest8122-21cat21:05:132
198509952,2cyclictest24745-21tr20:30:132
198509952,2cyclictest11227-21expr20:00:142
198509951,3cyclictest31727-21df20:45:142
198509951,3cyclictest29714-21/usr/sbin/munin19:30:152
198509951,3cyclictest29094-21/usr/sbin/munin20:40:122
198469952,2cyclictest6662-21cstates19:50:141
198469952,2cyclictest22563-21open_inodes19:15:011
198469952,2cyclictest13234-21cat20:05:121
198469951,3cyclictest30654-21snmpd19:35:061
198429952,2cyclictest30654-21snmpd20:50:090
198429952,2cyclictest1796-21cpuspeed_turbos19:40:140
198429951,3cyclictest31849-21/usr/sbin/munin19:35:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional