You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 14:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Mon Nov 03, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
177122327295,20sleep20-21swapper/219:05:112
195682296261,23sleep10-21swapper/119:08:241
196542265229,22sleep00-21swapper/019:09:310
195652264230,21sleep30-21swapper/319:08:213
7602670,0sleep00-21swapper/023:11:280
83352600,0sleep10-21swapper/123:16:221
202302570,0sleep30-21swapper/321:37:193
57162540,0sleep30-21swapper/323:15:153
269802220,0sleep20-21swapper/221:41:372
120112220,0sleep20-21swapper/200:03:042
266112180,0sleep30-21swapper/319:20:233
231152180,0sleep30-21swapper/319:15:143
183492160,0sleep00-21swapper/023:44:390
62972150,0sleep10-21swapper/100:24:401
290582130,0sleep10-21swapper/123:09:281
260612130,0sleep30-21swapper/321:40:493
1978599133,1cyclictest0-21swapper/123:29:251
1978599132,3cyclictest0-21swapper/123:11:211
1978599131,2cyclictest19982-21systemd-journal21:32:541
142352130,0sleep20-21swapper/222:37:142
1978599121,3cyclictest19982-21systemd-journal22:25:281
1978599121,2cyclictest502-21systemd-logind21:17:021
1978599120,3cyclictest19982-21systemd-journal23:40:011
1978599120,3cyclictest19982-21systemd-journal00:19:021
1978599120,2cyclictest502-21systemd-logind19:27:461
1978599120,2cyclictest10085-21diskmemload23:45:151
1978599112,3cyclictest30654-21snmpd19:30:131
1978599112,2cyclictest20935-21grep22:20:191
1978599112,2cyclictest11736-21in:imuxsock00:36:291
1978599112,1cyclictest0-21swapper/123:30:161
1978599112,1cyclictest0-21swapper/123:21:561
1978599112,1cyclictest0-21swapper/121:54:231
1978599111,3cyclictest2338-21ntpq20:50:171
1978599111,3cyclictest16448-21threads23:00:201
1978599110,5cyclictest4068-21latency_hist22:10:001
1978599110,3cyclictest30910-21perf21:45:011
1978599110,3cyclictest19982-21systemd-journal20:00:001
1978599110,3cyclictest19982-21systemd-journal00:00:001
1978599110,2cyclictest19982-21systemd-journal00:06:001
1978599102,2cyclictest5663-21ssh22:31:281
1978599102,2cyclictest26170-21ssh00:14:081
1978599102,2cyclictest22056-21apt-get20:25:121
1978599102,2cyclictest0-21swapper/121:24:341
1978599102,1cyclictest21989-21latency_hist19:15:021
1978599102,1cyclictest21989-21latency_hist19:15:011
1978599101,3cyclictest25635-21cpuspeed_turbos22:45:131
1978599101,3cyclictest24960-21/usr/sbin/munin20:30:151
1978599101,3cyclictest10875-21expr21:10:121
1978599100,3cyclictest555-21sed21:45:231
1978599100,3cyclictest19982-21systemd-journal23:54:401
1978599100,3cyclictest19982-21systemd-journal20:40:461
1978599100,3cyclictest19582-21lockfile-remove20:20:001
1978599100,3cyclictest18533-21ssh23:44:491
1978599100,3cyclictest17326-21ssh22:39:561
1978599100,2cyclictest19982-21systemd-journal22:52:211
1978599100,2cyclictest19982-21systemd-journal21:57:121
1978599100,2cyclictest19982-21systemd-journal21:07:011
1978599100,2cyclictest19982-21systemd-journal00:03:461
197949994,3cyclictest19982-21systemd-journal22:48:253
197859993,2cyclictest10659-21cat20:00:131
197859992,2cyclictest350-21sensors20:45:231
197859992,2cyclictest30654-21snmpd21:27:531
197859992,2cyclictest30654-21snmpd19:52:051
197859991,2cyclictest30654-21snmpd22:55:071
197859990,3cyclictest5199-21hddtemp_smartct22:10:161
197859990,3cyclictest28252-21/usr/sbin/munin20:35:201
197859990,3cyclictest21121-21/usr/sbin/munin20:20:221
197859990,3cyclictest17482-21rm21:35:201
197859990,3cyclictest17393-21sh00:32:381
197859990,3cyclictest13493-21/usr/sbin/munin20:05:151
197859990,3cyclictest12683-21ssh00:29:341
197859990,3cyclictest12186-21ssh22:15:141
197849993,2cyclictest141rcu_preempt00:02:400
197949985,2cyclictest508-21dbus-daemon23:51:003
197949985,2cyclictest14765-21cron20:10:013
197949984,3cyclictest508-21dbus-daemon21:30:483
197949984,3cyclictest19116-21gdbus19:40:003
197899986,1cyclictest28-21ksoftirqd/220:15:012
197899985,2cyclictest11736-21in:imuxsock21:52:072
197899983,3cyclictest19982-21systemd-journal22:20:532
197899983,3cyclictest19982-21systemd-journal20:42:512
197899980,7cyclictest1369-21ssh21:45:582
197899980,5cyclictest7235-21awk22:55:012
197859982,3cyclictest27097-21dump-pmu-power19:25:011
197859982,2cyclictest30654-21snmpd19:48:501
197859980,3cyclictest5987-21cat21:00:131
197859980,3cyclictest24831-21taskset22:01:351
197859980,3cyclictest19982-21systemd-journal19:37:461
197859980,3cyclictest17858-21ssh22:40:111
197859980,3cyclictest16888-21users20:10:201
197849985,2cyclictest30654-21snmpd00:10:140
197849984,3cyclictest19982-21systemd-journal23:08:020
197849984,3cyclictest19982-21systemd-journal21:05:000
197849983,3cyclictest19982-21systemd-journal23:20:020
197849982,3cyclictest19982-21systemd-journal19:31:440
197849981,4cyclictest26489-21cron00:40:010
31385270,0sleep20-21swapper/223:30:522
197949973,3cyclictest4833-21smart_sda20:55:193
197949973,3cyclictest30654-21snmpd21:18:193
197949973,3cyclictest19982-21systemd-journal23:22:293
197949973,3cyclictest19116-21gdbus23:30:003
197949973,3cyclictest19116-21gdbus19:55:003
197949973,1cyclictest0-21swapper/322:36:013
197949972,2cyclictest11675-21cat23:40:003
197949971,4cyclictest19982-21systemd-journal19:46:063
197899974,2cyclictest508-21dbus-daemon20:58:422
197899974,2cyclictest28-21ksoftirqd/220:30:002
197899974,2cyclictest28-21ksoftirqd/219:15:012
197899974,2cyclictest19982-21systemd-journal21:32:062
197899974,2cyclictest16372-21sh21:55:502
197899973,3cyclictest508-21dbus-daemon22:18:482
197899973,3cyclictest508-21dbus-daemon19:49:022
197899973,3cyclictest508-21dbus-daemon00:28:322
197899973,3cyclictest19982-21systemd-journal19:36:452
197899973,3cyclictest19982-21systemd-journal00:15:402
197899973,3cyclictest0-21swapper/222:45:372
197899971,4cyclictest19982-21systemd-journal22:13:472
197899971,3cyclictest26069-21munin-run23:50:012
197899971,3cyclictest22040-21rm00:10:232
197899971,3cyclictest19982-21systemd-journal19:26:432
197899970,7cyclictest0-21swapper/222:10:002
197899970,2cyclictest19982-21systemd-journal23:15:572
197859971,2cyclictest30654-21snmpd19:41:381
197849974,2cyclictest12-21ksoftirqd/020:30:010
197849974,2cyclictest12-21ksoftirqd/019:45:000
197849974,2cyclictest11736-21in:imuxsock21:59:360
197849973,3cyclictest5511-21apt-get23:15:150
197849973,3cyclictest508-21dbus-daemon23:00:000
197849973,3cyclictest508-21dbus-daemon20:44:550
197849973,3cyclictest508-21dbus-daemon20:00:420
197849973,3cyclictest508-21dbus-daemon00:15:120
197849973,3cyclictest23807-21ntpq19:15:180
197849973,3cyclictest19982-21systemd-journal21:25:410
197849973,3cyclictest19982-21systemd-journal20:23:410
197849973,3cyclictest1-21systemd00:07:150
197849973,3cyclictest11736-21in:imuxsock00:30:380
197849973,1cyclictest0-21swapper/022:55:000
197849972,3cyclictest19982-21systemd-journal21:20:010
197849970,7cyclictest0-21swapper/022:20:160
29312260,1sleep20-21swapper/222:25:332
28059260,0sleep30-21swapper/320:35:173
197949963,2cyclictest7597-21chrt21:02:053
197949963,2cyclictest6020-21ssh23:35:283
197949963,2cyclictest51850irq/136-enp4s0-22:10:143
197949963,2cyclictest31183-21seq19:30:403
197949963,2cyclictest30238-21sort23:10:143
197949963,2cyclictest26632-21cut21:20:213
197949963,2cyclictest24090-21grep23:05:253
197949963,2cyclictest21616-21missed_timers00:10:213
197949963,2cyclictest20661-21if_enp4s019:10:163
197949963,2cyclictest20661-21if_enp4s019:10:163
197949963,2cyclictest19982-21systemd-journal00:26:023
197949963,2cyclictest1316-21hddtemp_smartct00:20:143
197949963,2cyclictest10085-21diskmemload00:36:193
197949963,1cyclictest0-21swapper/322:17:063
197949962,3cyclictest8719-21df_inode19:55:183
197949962,3cyclictest8185-21cat22:55:183
197949962,3cyclictest7387-21memory21:50:173
197949962,3cyclictest508-21dbus-daemon22:25:223
197949962,3cyclictest508-21dbus-daemon20:45:213
197949962,3cyclictest30654-21snmpd23:46:063
197949962,3cyclictest30654-21snmpd22:21:583
197949962,3cyclictest30654-21snmpd20:10:203
197949962,3cyclictest30654-21snmpd00:19:283
197949962,3cyclictest22726-21cat20:25:153
197949962,3cyclictest22040-21expr22:00:153
197949962,3cyclictest19982-21systemd-journal22:50:313
197949962,3cyclictest18909-21cat20:15:203
197949962,3cyclictest18739-21sed22:40:173
197949962,3cyclictest1349-21cat21:25:163
197949962,3cyclictest12113-21awk20:00:213
197949962,1cyclictest0-21swapper/323:57:073
197949962,1cyclictest0-21swapper/322:30:113
197949962,1cyclictest0-21swapper/321:46:573
197949961,4cyclictest29801-21sort20:40:143
197949961,3cyclictest19982-21systemd-journal21:07:283
197949961,3cyclictest19982-21systemd-journal00:07:163
197949961,3cyclictest19982-21systemd-journal00:04:213
197949961,2cyclictest15767-21ssh00:30:543
197949961,2cyclictest15140-21ssh21:13:023
197949960,6cyclictest0-21swapper/323:02:543
197949960,4cyclictest19982-21systemd-journal20:51:373
197949960,3cyclictest24320-21ssh23:26:463
197949960,2cyclictest19982-21systemd-journal22:07:153
197949960,0cyclictest0-21swapper/321:55:403
197899964,1cyclictest21700-21irqstats23:25:182
197899963,2cyclictest508-21dbus-daemon23:05:232
197899963,2cyclictest29960-21ssh23:10:022
197899963,2cyclictest27154-21hwlatdetect23:50:172
197899963,2cyclictest2516-21sh21:25:312
197899963,2cyclictest23175-21xargs22:00:212
197899963,2cyclictest22352-21sh00:35:352
197899963,2cyclictest21313-21timerandwakeup19:10:202
197899963,2cyclictest21313-21timerandwakeup19:10:192
197899963,2cyclictest19982-21systemd-journal19:53:412
197899963,2cyclictest18214-21ssh23:23:122
197899963,1cyclictest0-21swapper/223:40:492
197899962,3cyclictest8854-21cat21:05:182
197899962,3cyclictest508-21dbus-daemon21:15:212
197899962,3cyclictest508-21dbus-daemon20:00:182
197899962,3cyclictest508-21dbus-daemon00:31:272
197899962,3cyclictest31606-21apt-get20:45:162
197899962,3cyclictest30654-21snmpd21:35:052
197899962,3cyclictest30654-21snmpd19:55:502
197899962,3cyclictest25713-21expr19:20:162
197899962,3cyclictest24535-21packagekitd20:30:002
197899962,3cyclictest19982-21systemd-journal23:57:162
197899962,3cyclictest19116-21gdbus22:30:012
197899962,3cyclictest18616-21cat22:40:172
197899962,1cyclictest0-21swapper/221:10:212
197899961,3cyclictest29741-11brltty22:58:012
197899961,3cyclictest19982-21systemd-journal21:22:282
197899961,3cyclictest19982-21systemd-journal00:20:362
197899960,6cyclictest0-21swapper/220:16:412
197899960,6cyclictest0-21swapper/200:05:082
197899960,3cyclictest508-21dbus-daemon23:40:012
197899960,0cyclictest281ksoftirqd/220:20:152
197899960,0cyclictest0-21swapper/220:50:232
197859963,2cyclictest24837-21cron19:20:011
197859962,3cyclictest4871-21cat20:55:191
197849966,0cyclictest0-21swapper/022:35:330
197849963,2cyclictest6947-21ssh22:32:340
197849963,2cyclictest6689-21ssh23:36:040
197849963,2cyclictest31220-21taskset21:45:050
197849963,2cyclictest30654-21snmpd20:50:090
197849963,2cyclictest30654-21snmpd00:26:400
197849963,2cyclictest26504-21ssh22:45:170
197849963,2cyclictest18633-21ps20:15:180
197849963,2cyclictest18474-21tune2fs22:40:160
197849963,2cyclictest11736-21in:imuxsock22:05:020
197849963,2cyclictest11076-21grep21:10:140
197849963,2cyclictest0-21swapper/021:05:170
197849962,3cyclictest7661-21lldpd23:50:540
197849962,3cyclictest7661-21lldpd23:49:390
197849962,3cyclictest508-21dbus-daemon23:30:000
197849962,3cyclictest30654-21snmpd20:47:080
197849962,3cyclictest30654-21snmpd20:39:270
197849962,3cyclictest30654-21snmpd20:34:570
197849962,3cyclictest30654-21snmpd19:38:460
197849962,3cyclictest22014-21expr22:00:140
197849962,3cyclictest19982-21systemd-journal21:18:430
197849962,3cyclictest19982-21systemd-journal20:55:410
197849962,3cyclictest1781-21cat23:55:170
197849962,3cyclictest16935-21cat21:35:160
197849962,3cyclictest13146-21cat20:05:130
197849962,3cyclictest12-21ksoftirqd/019:51:470
197849962,3cyclictest1-21systemd19:46:310
197849962,3cyclictest0-21swapper/023:25:170
197849962,2cyclictest19982-21systemd-journal19:59:020
197849962,1cyclictest0-21swapper/022:25:020
197849962,1cyclictest0-21swapper/022:16:500
197849962,1cyclictest0-21swapper/022:10:070
197849962,1cyclictest0-21swapper/021:52:150
197849962,1cyclictest0-21swapper/021:40:580
197849962,1cyclictest0-21swapper/021:30:180
197849960,6cyclictest0-21swapper/023:03:040
197849960,5cyclictest544-21sh00:20:030
197849960,4cyclictest27102-21turbostat19:25:020
197949952,2cyclictest27333-21taskset19:25:133
197949952,2cyclictest24936-21expr20:30:143
197949952,2cyclictest2188-21gltestperf19:40:153
197949951,3cyclictest20628-21memory20:20:203
197899953,1cyclictest27072-21gdbus20:35:002
197899952,2cyclictest29919-21expr19:30:132
197899952,2cyclictest2303-21cat19:40:172
197899952,2cyclictest13448-21cat20:05:162
197899952,2cyclictest0-21swapper/221:00:192
197899951,3cyclictest0-21swapper/223:00:092
197849953,1cyclictest20975-21ntp_states19:10:170
197849953,1cyclictest20975-21ntp_states19:10:170
197849952,2cyclictest15452-21sort20:10:120
197849951,3cyclictest29043-21sshd19:26:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional