You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-19 - 09:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Fri Sep 19, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
68542302269,21sleep20-21swapper/219:08:062
66872279245,22sleep10-21swapper/119:06:151
68572276243,21sleep00-21swapper/019:08:070
68092269210,19sleep30-21swapper/319:07:333
26472570,1sleep00-21swapper/022:05:010
218012560,0sleep00-21swapper/020:50:130
59912190,0sleep00-21swapper/023:21:410
51042180,0sleep20-21swapper/223:45:432
35752180,0sleep10-21swapper/121:40:041
314152180,0sleep031420-21unixbench_singl21:35:210
225602160,0sleep00-21swapper/023:35:150
711799153,4cyclictest5831-21awk20:15:002
229992130,0sleep10-21swapper/121:29:581
208812120,0sleep10-21swapper/100:24:451
71179995,3cyclictest19982-21systemd-journal20:22:032
71179990,8cyclictest6076-21ssh23:21:462
71149997,1cyclictest22-21ksoftirqd/100:00:011
71109996,2cyclictest12-21ksoftirqd/019:15:010
71109994,3cyclictest19982-21systemd-journal19:57:400
71109993,3cyclictest14774-21idleruntime-cro20:35:000
71219984,3cyclictest508-21dbus-daemon20:24:083
71219984,2cyclictest19982-21systemd-journal22:52:523
71219983,3cyclictest19982-21systemd-journal23:10:113
71219983,3cyclictest19982-21systemd-journal22:07:483
71219983,3cyclictest19982-21systemd-journal20:45:003
71219983,3cyclictest19982-21systemd-journal19:24:543
71179984,3cyclictest508-21dbus-daemon19:45:202
71179984,3cyclictest23068-21munin-run21:30:002
71149984,3cyclictest19982-21systemd-journal20:38:201
71149984,2cyclictest19982-21systemd-journal20:24:591
71149983,3cyclictest19982-21systemd-journal21:09:311
71109987,1cyclictest12-21ksoftirqd/022:30:000
71109986,2cyclictest12-21ksoftirqd/000:00:010
71109985,2cyclictest12-21ksoftirqd/020:30:000
71109984,3cyclictest11426-21sshd23:25:310
71109980,7cyclictest9981-21latency_hist21:20:010
71219974,2cyclictest29580-21grep23:15:143
71219974,2cyclictest22776-21cups-browsed20:35:003
71219974,2cyclictest11736-21in:imuxsock21:16:423
71219974,2cyclictest11736-21in:imuxsock21:01:423
71219973,3cyclictest508-21dbus-daemon23:46:293
71219973,3cyclictest508-21dbus-daemon19:10:433
71219973,3cyclictest3073-21apt23:20:143
71219973,3cyclictest30478-21diskstats00:05:163
71219973,3cyclictest29042-21apt-get23:40:123
71219973,3cyclictest25768-21ntpq19:45:193
71219973,3cyclictest24339-21cron21:00:013
71219973,3cyclictest21462-21cron20:50:003
71219973,3cyclictest19982-21systemd-journal23:00:323
71219973,3cyclictest19982-21systemd-journal22:56:333
71219973,3cyclictest19982-21systemd-journal20:13:313
71219973,3cyclictest0-21swapper/323:52:223
71219973,3cyclictest0-21swapper/300:32:213
71219973,2cyclictest19982-21systemd-journal19:30:193
71219973,1cyclictest0-21swapper/321:54:393
71219973,1cyclictest0-21swapper/321:40:183
71219973,1cyclictest0-21swapper/321:23:163
71219972,3cyclictest7661-21lldpd23:31:433
71219972,3cyclictest502-21systemd-logind00:00:413
71219972,3cyclictest19982-21systemd-journal23:39:313
71219972,3cyclictest19982-21systemd-journal21:10:273
71219972,3cyclictest19982-21systemd-journal20:17:283
71219971,4cyclictest19982-21systemd-journal19:26:093
71219970,0cyclictest0-21swapper/321:39:563
71179974,2cyclictest508-21dbus-daemon00:31:072
71179974,2cyclictest19982-21systemd-journal00:26:312
71179973,3cyclictest508-21dbus-daemon19:20:182
71179973,3cyclictest30654-21snmpd21:51:292
71179973,3cyclictest30654-21snmpd19:53:022
71179973,3cyclictest30654-21snmpd19:29:242
71179973,3cyclictest19982-21systemd-journal20:47:312
71179973,3cyclictest19116-21gdbus19:17:012
71179973,3cyclictest15536-21perl20:35:192
71179973,3cyclictest0-21swapper/219:42:292
71179973,2cyclictest19982-21systemd-journal22:00:012
71179973,2cyclictest19982-21systemd-journal20:02:522
71179973,1cyclictest0-21swapper/223:09:412
71179973,1cyclictest0-21swapper/221:39:402
71179973,1cyclictest0-21swapper/221:13:222
71179973,1cyclictest0-21swapper/200:35:462
71179970,3cyclictest3278-21munin-plugin-st00:10:002
71149974,2cyclictest30654-21snmpd22:46:031
71149973,3cyclictest508-21dbus-daemon20:00:471
71149973,3cyclictest10588-21ntpq23:25:201
71149973,1cyclictest0-21swapper/122:30:351
71149973,1cyclictest0-21swapper/100:25:501
71149972,1cyclictest0-21swapper/123:49:241
71149971,3cyclictest6640-21ssh23:22:241
71149970,6cyclictest508-21dbus-daemon19:30:451
71149970,3cyclictest3272-21sh00:10:001
71149970,3cyclictest19982-21systemd-journal23:13:031
71109973,3cyclictest9678-21apt-get00:15:130
71109973,3cyclictest508-21dbus-daemon22:10:020
71109973,3cyclictest19982-21systemd-journal19:43:300
71109973,3cyclictest19982-21systemd-journal00:40:000
71109973,3cyclictest19982-21systemd-journal00:14:510
71109973,3cyclictest19507-21apt-get20:45:120
71109973,3cyclictest0-21swapper/023:48:200
71109973,3cyclictest0-21swapper/022:38:420
71109973,3cyclictest0-21swapper/021:59:490
71109973,3cyclictest0-21swapper/021:12:340
71109973,1cyclictest0-21swapper/023:53:280
71109973,1cyclictest0-21swapper/022:09:290
71109973,1cyclictest0-21swapper/021:40:590
71109973,1cyclictest0-21swapper/000:28:470
71109971,5cyclictest7104-21cyclictest19:25:140
71109971,3cyclictest17000-21turbostat20:40:000
71109970,6cyclictest31883-21ssh00:05:310
71109970,4cyclictest28979-21ssh23:15:120
5785270,0sleep30-21swapper/322:31:553
19284270,0sleep00-21swapper/021:51:440
71219966,0cyclictest0-21swapper/322:40:193
71219966,0cyclictest0-21swapper/322:35:373
71219966,0cyclictest0-21swapper/300:26:173
71219963,2cyclictest668-21runrttasks19:39:443
71219963,2cyclictest3255-21sh00:36:093
71219963,2cyclictest31966-21tune2fs20:00:163
71219963,2cyclictest28850-21diskmemload22:25:103
71219963,2cyclictest28074-21smart_sda21:05:203
71219963,2cyclictest20000-21ssh22:18:053
71219963,2cyclictest15693-21acpi00:20:153
71219963,2cyclictest14889-21ssh00:19:353
71219963,2cyclictest13294-21ssh21:47:093
71219963,2cyclictest0-21swapper/322:21:043
71219963,1cyclictest0-21swapper/323:07:083
71219962,3cyclictest30654-21snmpd23:26:043
71219962,3cyclictest30654-21snmpd21:55:423
71219962,3cyclictest30229-21cat19:55:203
71219962,3cyclictest28688-21seq19:51:273
71219962,3cyclictest1973-21expr20:05:163
71219962,3cyclictest10183-21basename22:10:173
71219962,2cyclictest19982-21systemd-journal20:27:453
71219962,1cyclictest0-21swapper/322:46:243
71219962,1cyclictest0-21swapper/322:01:393
71219962,1cyclictest0-21swapper/321:31:193
71219961,3cyclictest19982-21systemd-journal23:55:013
71219961,3cyclictest19982-21systemd-journal19:17:233
71219960,4cyclictest19982-21systemd-journal19:43:403
71219960,3cyclictest8960-21sort00:15:013
71219960,2cyclictest17074-21/usr/sbin/munin21:25:203
71179964,1cyclictest28850-21diskmemload23:40:132
71179964,1cyclictest23630-21strings21:55:172
71179963,2cyclictest9790-21sed22:35:182
71179963,2cyclictest508-21dbus-daemon22:05:062
71179963,2cyclictest508-21dbus-daemon21:00:002
71179963,2cyclictest4627-21uname21:15:202
71179963,2cyclictest3618-21grep22:55:152
71179963,2cyclictest28850-21diskmemload21:41:212
71179963,2cyclictest25075-21chrt23:11:142
71179963,2cyclictest17382-21cat23:55:192
71179963,2cyclictest16382-21expr23:30:132
71179963,2cyclictest14237-21sed20:30:212
71179963,2cyclictest11736-21in:imuxsock20:50:012
71179963,2cyclictest10948-21df20:25:132
71179963,2cyclictest0-21swapper/223:01:182
71179962,3cyclictest9729-21cat22:10:152
71179962,3cyclictest4337-21basename00:10:152
71179962,3cyclictest30654-21snmpd22:45:212
71179962,3cyclictest30654-21snmpd22:43:162
71179962,3cyclictest30654-21snmpd22:27:032
71179962,3cyclictest30654-21snmpd22:22:122
71179962,3cyclictest30654-21snmpd22:15:452
71179962,3cyclictest30654-21snmpd20:40:172
71179962,3cyclictest30654-21snmpd20:19:502
71179962,3cyclictest30654-21snmpd00:18:022
71179962,3cyclictest29644-21basename23:15:152
71179962,3cyclictest2821-21ls22:30:142
71179962,3cyclictest22892-21expr23:35:172
71179962,3cyclictest21443-21sshd19:37:162
71179962,3cyclictest1852-21ls20:05:162
71179962,3cyclictest18512-21pmu-power19:30:192
71179962,3cyclictest10670-21sed21:45:172
71179962,1cyclictest0-21swapper/223:50:512
71179962,1cyclictest0-21swapper/221:31:502
71179962,1cyclictest0-21swapper/221:20:382
71179962,1cyclictest0-21swapper/200:00:052
71179960,6cyclictest0-21swapper/223:26:052
71179960,4cyclictest19982-21systemd-journal22:51:502
71149966,0cyclictest0-21swapper/121:46:371
71149963,2cyclictest5771-1kworker/u9:122:06:141
71149963,2cyclictest4438-21sed20:10:151
71149963,2cyclictest30807-21sh22:00:221
71149963,2cyclictest30654-21snmpd20:51:441
71149963,2cyclictest30654-21snmpd00:35:161
71149963,2cyclictest30416-21sendmail_mailst19:55:211
71149963,2cyclictest28912-21expr22:50:141
71149963,2cyclictest25892-21cut19:45:201
71149963,2cyclictest14811-21apt-config19:25:011
71149963,2cyclictest12240-21ssh22:11:321
71149963,2cyclictest11736-21in:imuxsock20:05:471
71149963,2cyclictest10425-21tr21:20:131
71149963,1cyclictest0-21swapper/123:50:181
71149963,1cyclictest0-21swapper/123:35:511
71149962,3cyclictest4042-21cat22:55:171
71149962,3cyclictest30654-21snmpd23:16:431
71149962,3cyclictest30654-21snmpd21:10:211
71149962,3cyclictest30654-21snmpd20:56:331
71149962,3cyclictest30654-21snmpd20:41:051
71149962,3cyclictest30654-21snmpd20:19:561
71149962,3cyclictest30654-21snmpd19:16:331
71149962,3cyclictest30654-21snmpd00:10:441
71149962,3cyclictest29769-21basename21:35:131
71149962,3cyclictest27977-21ntp_kernel_pll_19:50:161
71149962,3cyclictest22802-21head19:40:181
71149962,3cyclictest19982-21systemd-journal20:32:461
71149962,3cyclictest16387-21cat23:05:141
71149962,3cyclictest0-21swapper/122:35:441
71149962,3cyclictest0-21swapper/100:00:381
71149962,1cyclictest0-21swapper/123:41:131
71149962,1cyclictest0-21swapper/123:30:361
71149962,1cyclictest0-21swapper/122:40:371
71149962,1cyclictest0-21swapper/122:20:031
71149962,1cyclictest0-21swapper/122:18:091
71149962,1cyclictest0-21swapper/121:30:031
71149962,1cyclictest0-21swapper/121:16:041
71149962,1cyclictest0-21swapper/100:15:381
71149961,3cyclictest7661-21lldpd19:37:201
71149961,1cyclictest0-21swapper/121:55:171
71149960,6cyclictest0-21swapper/123:00:071
71149960,6cyclictest0-21swapper/100:30:261
71149960,5cyclictest29371-21tail22:25:161
71109966,0cyclictest0-21swapper/021:25:100
71109964,1cyclictest32117-21tail20:00:160
71109964,1cyclictest15957-21grep22:40:150
71109963,2cyclictest668-21runrttasks20:11:300
71109963,2cyclictest508-21dbus-daemon23:01:010
71109963,2cyclictest30654-21snmpd00:20:060
71109963,2cyclictest16165-21/usr/sbin/munin23:30:130
71109963,2cyclictest15428-21rm21:49:270
71109962,3cyclictest7661-21lldpd23:44:440
71109962,3cyclictest30654-21snmpd23:05:170
71109962,3cyclictest30654-21snmpd20:20:410
71109962,3cyclictest30654-21snmpd19:45:550
71109962,3cyclictest28005-21cut00:30:160
71109962,3cyclictest2487-21date20:05:190
71109962,3cyclictest22858-21awk22:45:180
71109962,3cyclictest19982-21systemd-journal19:37:250
71109962,3cyclictest18247-21sh22:16:060
71109962,3cyclictest10998-21cat21:20:160
71109962,3cyclictest0-21swapper/023:12:090
71109962,1cyclictest0-21swapper/022:54:240
71109961,3cyclictest19982-21systemd-journal21:30:310
71109961,3cyclictest19982-21systemd-journal19:30:310
71109961,2cyclictest24355-21turbostat.cron21:00:000
71109960,4cyclictest23219-40systemctl00:00:010
71109960,3cyclictest5799-21rm22:56:180
71109960,3cyclictest24852-21rm22:21:260
71109960,0cyclictest0-21swapper/022:32:180
71109960,0cyclictest0-21swapper/020:45:000
71219951,3cyclictest30654-21snmpd20:50:083
71219950,4cyclictest15014-21/usr/sbin/munin20:35:203
71179955,0cyclictest0-21swapper/200:20:062
71179952,2cyclictest7653-21cat19:10:132
71179952,2cyclictest30654-21snmpd21:05:092
71179952,2cyclictest30654-21snmpd21:00:032
71179950,4cyclictest29635-21expr19:55:152
71149952,2cyclictest19786-21expr20:45:131
71149952,2cyclictest16164-21ssh21:50:011
71149952,2cyclictest10581-21grep20:25:141
71149951,3cyclictest7330-21apt-get19:10:131
71149951,3cyclictest25295-21cat21:00:101
71149951,3cyclictest15862-21hddtemp_smartct19:25:161
71109953,1cyclictest9653-21df19:15:020
71109953,1cyclictest12163-21apt-get19:20:020
71109952,2cyclictest6404-21expr20:15:130
71109952,2cyclictest27259-21entropy21:05:150
71109952,2cyclictest27158-21expr19:50:120
71109951,3cyclictest25459-21wc21:00:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional