You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 05:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackaslot8.osadl.org (updated Mon May 05, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
188312306279,17sleep20-21swapper/219:08:582
188142275241,22sleep00-21swapper/019:08:440
186712272234,22sleep30-21swapper/319:06:543
187142261227,22sleep10-21swapper/119:07:291
279512650,0sleep10-21swapper/122:34:311
169802640,0sleep00-21swapper/023:37:160
39972600,0sleep30-21swapper/322:16:473
288122580,1sleep00-21swapper/023:22:190
283942580,0sleep00-21swapper/000:38:190
316962570,0sleep30-21swapper/319:35:173
316962570,0sleep30-21swapper/319:35:173
313212570,0sleep30-21swapper/300:12:033
8812540,0sleep20-21swapper/200:14:182
34882530,0sleep03492-21cpuspeed_turbos22:40:140
221702200,1sleep00-21swapper/022:30:130
1903299160,3cyclictest28706-21ssh23:45:231
181832150,0sleep20-21swapper/221:16:222
1903299142,2cyclictest14636-40runlevel00:00:001
1903299130,3cyclictest30525-21rm23:24:031
1903299130,2cyclictest32240-21ssh00:13:051
41782120,0sleep30-21swapper/322:40:173
228702120,0sleep30-21swapper/322:30:173
1903299122,3cyclictest20968-21expr00:30:221
1903299122,1cyclictest0-21swapper/123:34:541
1903299121,1cyclictest13266-21apt-get23:35:121
1903299120,4cyclictest19982-21systemd-journal19:25:051
1903299120,3cyclictest29644-21sh21:49:091
1903299120,3cyclictest19755-21rm21:41:091
1903299120,2cyclictest20910-21ssh21:19:181
1903299120,2cyclictest19982-21systemd-journal23:55:001
1903299120,2cyclictest1930-21ssh22:39:031
1903299120,2cyclictest16236-21ssh23:13:231
1903299120,2cyclictest1118-21chrt23:01:421
1903299120,1cyclictest251312sleep120:32:411
1903299113,7cyclictest6524-21ntpq21:55:211
1903299112,3cyclictest20793-21grep23:40:141
1903299112,2cyclictest18410-21cups-browsed20:30:001
1903299111,3cyclictest30654-21snmpd21:10:121
1903299111,1cyclictest0-21swapper/119:22:351
1903299110,3cyclictest401-21apt-get19:40:031
1903299110,3cyclictest3661-21cut19:45:161
1903299110,3cyclictest19982-21systemd-journal19:55:321
1903299110,3cyclictest19982-21systemd-journal19:12:591
1903299110,3cyclictest15438-21ssh22:01:481
1903299110,2cyclictest2855-21turbostat21:30:001
1903299110,2cyclictest24337-21head22:55:191
1903299110,2cyclictest22986-21ssh22:54:431
1903299110,2cyclictest21002-21ssh23:16:201
1903299110,2cyclictest19982-21systemd-journal20:55:001
1903299110,2cyclictest14854-21/usr/sbin/munin22:25:161
1903299110,2cyclictest10406-21ssh00:21:171
1903299110,1cyclictest3449-21grep20:55:231
1903299110,1cyclictest29654-21ntp_states19:30:201
1903299110,1cyclictest28454-21ssh22:10:441
1903299110,1cyclictest21972-21apt19:15:021
1903299110,1cyclictest14554-21apt-get20:10:151
1903299110,1cyclictest13711-21ssh22:24:361
1903899105,3cyclictest19982-21systemd-journal23:37:553
1903299102,2cyclictest28372-21rm00:38:161
1903299102,2cyclictest22648-21sed21:20:161
1903299101,2cyclictest23513-21unixbench_multi00:05:251
1903299101,2cyclictest20325-21pmu-power22:05:191
1903299101,1cyclictest1-21systemd20:07:131
1903299100,4cyclictest19982-21systemd-journal21:50:171
1903299100,3cyclictest9816-21apt21:35:001
1903299100,3cyclictest893-21sed23:25:191
1903299100,3cyclictest7463-21awk21:05:191
1903299100,3cyclictest5166-21awk21:00:221
1903299100,3cyclictest3801-21grep22:40:151
1903299100,3cyclictest15217-21wc00:25:191
1903299100,3cyclictest11312-21grep20:00:231
1903299100,2cyclictest32606-21chrt19:37:001
1903299100,2cyclictest32606-21chrt19:36:591
1903299100,2cyclictest27541-21dump-pmu-power20:40:001
1903299100,2cyclictest2544-21smartctl00:15:141
1903299100,2cyclictest16507-21idleruntime-cro22:50:001
1903299100,2cyclictest15022-21apt00:00:131
1903299100,1cyclictest19982-21systemd-journal22:15:191
1903299100,1cyclictest19797-21expr20:20:201
1903299100,1cyclictest18694-21apt20:20:001
190329991,2cyclictest5895-21ntp_states23:05:191
190329990,3cyclictest5478-21cat19:50:131
190329990,3cyclictest30954-21awk20:45:181
190329990,3cyclictest28385-21tail20:40:181
190329990,2cyclictest10419-21tr21:35:131
190389985,2cyclictest34-21ksoftirqd/300:05:003
190389984,3cyclictest508-21dbus-daemon20:30:353
190389984,3cyclictest19982-21systemd-journal19:44:353
190389984,2cyclictest19982-21systemd-journal19:19:413
190349986,1cyclictest8475-21irqstats22:20:162
190349984,3cyclictest19982-21systemd-journal20:26:002
190349983,3cyclictest19982-21systemd-journal23:46:412
190349983,3cyclictest19982-21systemd-journal23:35:012
190349982,3cyclictest21298-21munin-run22:30:002
190279987,1cyclictest121ksoftirqd/022:00:000
190279984,3cyclictest508-21dbus-daemon22:49:570
190279984,2cyclictest19982-21systemd-journal21:50:010
190279982,5cyclictest28284-21turbostat21:25:000
190389974,2cyclictest18410-21cups-browsed20:10:053
190389973,3cyclictest5796-21diskstats19:50:143
190389973,3cyclictest30654-21snmpd22:28:313
190389973,3cyclictest30654-21snmpd19:22:463
190389973,3cyclictest29741-11brltty23:55:533
190389973,3cyclictest12856-21perl22:00:173
190389973,3cyclictest11736-21in:imuxsock23:07:533
190389973,3cyclictest0-21swapper/323:48:143
190389973,1cyclictest0-21swapper/321:50:563
190389972,3cyclictest7661-21lldpd20:04:413
190389972,3cyclictest19982-21systemd-journal23:55:013
190389972,3cyclictest19982-21systemd-journal00:33:343
190389971,5cyclictest29491-21latency_hist00:40:003
190389971,5cyclictest0-21swapper/321:10:123
190389970,3cyclictest11226-21ntp_states22:45:223
190349976,1cyclictest28-21ksoftirqd/221:40:012
190349973,3cyclictest30654-21snmpd20:22:232
190349973,3cyclictest26932-21sort22:10:182
190349973,3cyclictest19982-21systemd-journal19:29:162
190349973,3cyclictest19116-21gdbus19:45:062
190349973,2cyclictest0-21swapper/223:50:512
190349973,1cyclictest0-21swapper/223:23:372
190349973,1cyclictest0-21swapper/223:04:032
190349972,3cyclictest31974-21awk20:50:002
190349972,3cyclictest19982-21systemd-journal23:37:342
190349972,3cyclictest19982-21systemd-journal21:21:042
190349971,4cyclictest19982-21systemd-journal21:55:172
190349971,3cyclictest9588-21munin-run20:00:022
190349971,3cyclictest22682-21rm23:18:022
190279974,2cyclictest508-21dbus-daemon21:07:180
190279974,2cyclictest508-21dbus-daemon19:37:370
190279974,2cyclictest508-21dbus-daemon19:37:360
190279973,3cyclictest508-21dbus-daemon21:30:160
190279973,3cyclictest508-21dbus-daemon00:20:000
190279973,3cyclictest32235-21apt-get20:50:130
190279973,3cyclictest30654-21snmpd22:53:350
190279973,3cyclictest30654-21snmpd21:19:120
190279973,3cyclictest19982-21systemd-journal20:46:260
190279973,3cyclictest0-21swapper/023:59:240
190279973,3cyclictest0-21swapper/000:10:140
190279973,2cyclictest30654-21snmpd22:58:520
190279973,2cyclictest19982-21systemd-journal21:51:070
190279972,3cyclictest19982-21systemd-journal23:17:010
190279972,3cyclictest19982-21systemd-journal20:39:210
190279970,6cyclictest0-21swapper/000:10:000
190279970,4cyclictest5937-21awk23:30:010
190389966,0cyclictest0-21swapper/321:20:253
190389963,2cyclictest30843-21ssh21:25:443
190389963,2cyclictest27573-21sh22:57:383
190389963,2cyclictest26108-21sh21:45:353
190389963,2cyclictest25589-21ssh00:07:353
190389963,2cyclictest25142-21ssh23:43:343
190389963,2cyclictest19744-21wc20:20:203
190389963,2cyclictest19410-21ssh21:40:493
190389963,2cyclictest12357-21apt-get20:05:193
190389963,2cyclictest11821-21expr23:10:143
190389963,2cyclictest10590-21sh00:21:293
190389962,3cyclictest7838-21cat23:30:203
190389962,3cyclictest4835-21sed21:00:203
190389962,3cyclictest30950-21expr23:00:133
190389962,3cyclictest30654-21snmpd20:51:203
190389962,3cyclictest30654-21snmpd20:44:143
190389962,3cyclictest30654-21snmpd19:55:163
190389962,3cyclictest30654-21snmpd19:25:543
190389962,3cyclictest30654-21snmpd00:19:093
190389962,3cyclictest30026-21apt20:45:133
190389962,3cyclictest29367-21cat19:30:173
190389962,3cyclictest27128-21cat22:10:183
190389962,3cyclictest26225-21ntpq23:20:193
190389962,3cyclictest2508-21fw_packets20:55:173
190389962,3cyclictest20480-21cat22:05:203
190389962,3cyclictest19733-21tune2fs19:10:173
190389962,3cyclictest17538-21expr22:50:163
190389962,3cyclictest13951-21sh00:25:103
190389962,1cyclictest0-21swapper/323:25:473
190389962,1cyclictest0-21swapper/321:57:233
190389962,1cyclictest0-21swapper/321:17:123
190389960,6cyclictest0-21swapper/322:36:343
190389960,6cyclictest0-21swapper/320:16:263
190389960,5cyclictest9390-21sed22:20:223
190389960,5cyclictest3733-21sh21:30:163
190389960,4cyclictest19982-21systemd-journal19:49:423
190349966,0cyclictest0-21swapper/223:55:312
190349966,0cyclictest0-21swapper/200:34:302
190349963,2cyclictest880-21/usr/sbin/munin22:15:222
190349963,2cyclictest4781-21sh00:16:432
190349963,2cyclictest30654-21snmpd20:34:262
190349963,2cyclictest30654-21snmpd19:10:512
190349963,2cyclictest28468-21ssh22:58:362
190349963,2cyclictest26959-21cat20:35:212
190349963,2cyclictest25649-21timerwakeupswit19:20:232
190349963,2cyclictest25123-21cut00:35:122
190349963,2cyclictest24915-21interrupts21:45:152
190349963,2cyclictest23016-21awk22:30:172
190349963,2cyclictest22227-21expr00:05:182
190349963,2cyclictest21843-21ssh22:06:162
190349963,2cyclictest21230-21sh23:40:162
190349963,2cyclictest19085-21sh21:40:312
190349963,2cyclictest18298-21users20:15:262
190349963,2cyclictest1224-21unixbench-2d20:50:222
190349963,2cyclictest11736-21in:imuxsock19:40:012
190349963,2cyclictest11736-21in:imuxsock19:40:012
190349963,1cyclictest0-21swapper/221:11:192
190349962,3cyclictest6671-21cat21:05:142
190349962,3cyclictest5164-21ntpd22:49:072
190349962,3cyclictest508-21dbus-daemon20:10:342
190349962,3cyclictest508-21dbus-daemon20:05:002
190349962,3cyclictest4707-21cat21:30:222
190349962,3cyclictest30654-21snmpd23:26:242
190349962,3cyclictest30654-21snmpd22:00:062
190349962,3cyclictest30096-21which22:35:212
190349962,3cyclictest29196-21cat20:40:222
190349962,3cyclictest19982-21systemd-journal19:20:012
190349962,3cyclictest16788-21sh22:50:052
190349962,3cyclictest14765-21cups-browsed00:00:002
190349962,3cyclictest12901-21wc23:10:212
190349962,3cyclictest0-21swapper/223:06:442
190349962,3cyclictest0-21swapper/222:41:382
190349962,1cyclictest0-21swapper/200:22:142
190349961,3cyclictest30811-21rm21:50:062
190349960,6cyclictest0-21swapper/200:25:282
190349960,5cyclictest30378-21anacron19:31:462
190349960,5cyclictest1977-21/usr/sbin/munin20:55:242
190279966,0cyclictest0-21swapper/020:25:210
190279963,2cyclictest9517-21ssh22:20:270
190279963,2cyclictest668-21runrttasks23:10:150
190279963,2cyclictest4823-21/usr/sbin/munin23:05:160
190279963,2cyclictest31551-21rm23:48:210
190279963,2cyclictest30654-21snmpd20:13:010
190279963,2cyclictest27998-21expr20:40:150
190279963,2cyclictest26426-21apt22:10:150
190279963,2cyclictest22038-21ssh23:40:260
190279963,2cyclictest21015-21taskset19:13:050
190279963,2cyclictest12299-21packagekitd20:05:000
190279963,2cyclictest1-21systemd19:19:150
190279963,2cyclictest11736-21in:imuxsock19:25:550
190279963,2cyclictest0-21swapper/022:15:200
190279962,3cyclictest8594-21expr00:20:160
190279962,3cyclictest7086-21cat23:30:150
190279962,3cyclictest508-21dbus-daemon20:20:350
190279962,3cyclictest508-21dbus-daemon19:53:520
190279962,3cyclictest4730-21fw_packets21:00:200
190279962,3cyclictest30654-21snmpd23:51:080
190279962,3cyclictest30654-21snmpd20:55:120
190279962,3cyclictest29458-21cat21:25:160
190279962,3cyclictest24342-21ntpq20:30:210
190279962,3cyclictest2321-21cat19:40:200
190279962,3cyclictest20667-21ntpq00:30:200
190279962,3cyclictest19982-21systemd-journal20:15:090
190279962,3cyclictest19982-21systemd-journal19:30:310
190279962,3cyclictest1-21systemd22:25:010
190279962,3cyclictest11671-21expr21:35:200
190279962,3cyclictest0-21swapper/022:35:340
190279962,1cyclictest0-21swapper/023:00:250
190279962,1cyclictest0-21swapper/022:05:160
190279962,1cyclictest0-21swapper/021:40:190
190279962,1cyclictest0-21swapper/000:25:180
190279962,1cyclictest0-21swapper/000:02:210
190279961,3cyclictest19982-21systemd-journal21:12:430
190279961,3cyclictest19982-21systemd-journal20:03:280
190279960,4cyclictest19982-21systemd-journal19:55:580
190279960,2cyclictest12301-21/usr/sbin/munin22:00:160
190389952,2cyclictest6409-21cat21:05:143
190389952,2cyclictest25566-21chrt20:35:113
190389952,2cyclictest18295-21basename23:15:123
190389951,3cyclictest30654-21snmpd20:25:143
190389951,3cyclictest10064-21ssh21:35:023
190349952,2cyclictest851-21gpg-connect-age19:40:012
190349952,2cyclictest30654-21snmpd19:50:082
190349952,2cyclictest28621-21ssh21:25:072
190349952,2cyclictest10250-21grep20:00:172
190349951,3cyclictest29741-11brltty21:00:122
190279952,2cyclictest3687-21grep19:45:160
190279952,2cyclictest26204-21taskset19:24:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional