You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 18:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Fri Nov 28, 2025 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
230852305234,22sleep30-21swapper/307:06:183
233182277244,21sleep10-21swapper/107:09:181
231302275208,20sleep00-21swapper/007:06:510
231792263226,22sleep20-21swapper/207:07:302
258772650,0sleep10-21swapper/109:46:381
45052190,0sleep00-21swapper/011:45:010
206962180,0sleep30-21swapper/311:57:503
215102150,0sleep30-21swapper/310:10:143
56632140,0sleep10-21swapper/112:37:591
261932140,0sleep30-21swapper/309:47:033
171372110,0sleep10-21swapper/110:05:471
45402100,0sleep00-21swapper/011:16:260
2352299109,1cyclictest28-21ksoftirqd/211:59:592
2352299108,1cyclictest28-21ksoftirqd/210:30:002
31620290,0sleep20-21swapper/212:05:452
235249994,3cyclictest19982-21systemd-journal09:37:583
235249994,3cyclictest19982-21systemd-journal09:37:583
235229994,3cyclictest19982-21systemd-journal08:51:242
235229994,3cyclictest19982-21systemd-journal08:41:392
235139994,3cyclictest19982-21systemd-journal08:34:090
235249986,1cyclictest34-21ksoftirqd/307:15:013
235249984,3cyclictest508-21dbus-daemon09:05:003
235249984,3cyclictest31572-21ssh12:33:133
235249983,4cyclictest0-21swapper/308:40:013
235249983,3cyclictest19982-21systemd-journal11:50:283
235249980,7cyclictest34-21ksoftirqd/310:50:103
235249980,4cyclictest29970-21taskset11:38:433
235229985,2cyclictest508-21dbus-daemon09:58:522
235229985,2cyclictest11736-21in:imuxsock10:13:522
235229984,3cyclictest508-21dbus-daemon09:40:542
235229983,4cyclictest0-21swapper/211:10:122
235229983,3cyclictest19982-21systemd-journal11:35:142
235229981,6cyclictest28-21ksoftirqd/212:20:152
235229980,5cyclictest141rcu_preempt10:35:162
235179984,3cyclictest19982-21systemd-journal07:12:241
235139984,3cyclictest508-21dbus-daemon08:40:010
235139984,3cyclictest19982-21systemd-journal11:10:240
235139984,2cyclictest19982-21systemd-journal07:19:250
235139983,3cyclictest19982-21systemd-journal08:24:580
18952280,0sleep10-21swapper/112:21:461
18166280,0sleep30-21swapper/309:13:233
13176280,3sleep3341ksoftirqd/312:17:033
235249975,1cyclictest34-21ksoftirqd/309:30:013
235249974,2cyclictest34-21ksoftirqd/307:30:003
235249973,3cyclictest7661-21lldpd12:39:113
235249973,3cyclictest508-21dbus-daemon10:46:253
235249973,3cyclictest508-21dbus-daemon07:34:043
235249973,3cyclictest4426-21sed08:50:003
235249973,3cyclictest30654-21snmpd10:00:273
235249973,3cyclictest19982-21systemd-journal07:48:413
235249973,3cyclictest19982-21systemd-journal07:24:423
235249973,3cyclictest0-21swapper/311:25:143
235249973,3cyclictest0-21swapper/311:11:523
235249973,3cyclictest0-21swapper/311:05:483
235249973,1cyclictest0-21swapper/312:22:303
235249973,1cyclictest0-21swapper/311:34:423
235249973,1cyclictest0-21swapper/311:34:413
235249973,1cyclictest0-21swapper/310:39:593
235249973,1cyclictest0-21swapper/310:34:573
235249972,4cyclictest19403-21taskset11:00:313
235249972,3cyclictest19982-21systemd-journal10:30:003
235249971,4cyclictest19982-21systemd-journal08:00:213
235249970,3cyclictest4241-21latency_hist11:45:013
235229974,2cyclictest28-21ksoftirqd/209:10:022
235229974,2cyclictest27285-21ntpq09:20:172
235229974,2cyclictest19982-21systemd-journal08:30:482
235229974,2cyclictest11736-21in:imuxsock09:20:012
235229973,3cyclictest7661-21lldpd08:47:462
235229973,3cyclictest508-21dbus-daemon10:17:372
235229973,3cyclictest508-21dbus-daemon07:39:552
235229973,3cyclictest30654-21snmpd10:55:572
235229973,3cyclictest19982-21systemd-journal11:30:282
235229973,3cyclictest19982-21systemd-journal11:30:282
235229971,5cyclictest0-21swapper/211:15:112
235229971,4cyclictest19982-21systemd-journal08:03:162
235229971,3cyclictest24992-21rm09:45:272
235229970,7cyclictest0-21swapper/210:20:212
235229970,1cyclictest12074-21diskstats09:35:142
235229970,1cyclictest12074-21diskstats09:35:142
235179974,2cyclictest19982-21systemd-journal09:40:021
235179974,2cyclictest19982-21systemd-journal09:40:021
235179974,2cyclictest12688-21pmu-power10:55:171
235179974,2cyclictest11736-21in:imuxsock12:00:291
235179973,3cyclictest737-21users11:40:211
235179973,3cyclictest508-21dbus-daemon11:40:001
235179973,3cyclictest30564-21ntpq12:05:191
235179973,3cyclictest19982-21systemd-journal09:02:241
235179973,3cyclictest19982-21systemd-journal08:55:261
235179973,3cyclictest15079-21cat10:30:221
235179973,3cyclictest12787-21expr07:55:121
235179973,2cyclictest19982-21systemd-journal12:17:471
235179973,2cyclictest19982-21systemd-journal07:40:191
235179973,2cyclictest19982-21systemd-journal07:40:191
235179973,1cyclictest0-21swapper/110:35:181
235179973,1cyclictest0-21swapper/109:20:591
235179973,1cyclictest0-21swapper/109:18:351
235179972,3cyclictest7661-21lldpd10:44:371
235179972,3cyclictest19982-21systemd-journal12:33:231
235179972,3cyclictest19982-21systemd-journal10:22:371
235179971,5cyclictest0-21swapper/112:14:021
235179971,4cyclictest19982-21systemd-journal09:50:311
235179971,4cyclictest19982-21systemd-journal07:20:191
235179970,4cyclictest2844-21munin-run07:35:011
235139974,2cyclictest26948-21turbostat10:15:010
235139974,2cyclictest14989-21sshd10:05:100
235139973,3cyclictest0-21swapper/011:53:070
235139973,3cyclictest0-21swapper/010:23:140
235139973,3cyclictest0-21swapper/009:41:460
235139973,1cyclictest0-21swapper/011:07:420
235139972,4cyclictest13120-21sshd09:08:240
235139972,3cyclictest7661-21lldpd11:35:080
235139972,3cyclictest19982-21systemd-journal10:25:150
235139972,3cyclictest19982-21systemd-journal09:45:050
235139972,3cyclictest19982-21systemd-journal09:25:020
235139971,5cyclictest28078-21rm10:41:210
235139971,5cyclictest16895-21ssh12:20:150
235139970,2cyclictest16893-21/usr/sbin/munin08:05:220
235139970,2cyclictest12191-21hddtemp_smartct10:55:130
235249963,2cyclictest668-21runrttasks09:30:013
235249963,2cyclictest5123-21sh12:10:213
235249963,2cyclictest508-21dbus-daemon10:56:513
235249963,2cyclictest32506-21ssh12:06:423
235249963,2cyclictest2899-21cat11:15:143
235249963,2cyclictest11736-21in:imuxsock09:55:313
235249962,3cyclictest5341-21expr11:45:163
235249962,3cyclictest5281-21cat08:50:143
235249962,3cyclictest508-21dbus-daemon10:42:393
235249962,3cyclictest508-21dbus-daemon08:17:273
235249962,3cyclictest508-21dbus-daemon08:15:003
235249962,3cyclictest4385-21threads07:35:203
235249962,3cyclictest30654-21snmpd11:20:043
235249962,3cyclictest30654-21snmpd09:21:343
235249962,3cyclictest30654-21snmpd08:08:423
235249962,3cyclictest29161-21expr09:50:143
235249962,3cyclictest27456-21cat10:15:123
235249962,3cyclictest19982-21systemd-journal07:19:403
235249962,3cyclictest10586-21cat07:50:163
235249962,3cyclictest0-21swapper/312:00:043
235249962,3cyclictest0-21swapper/308:34:543
235249962,2cyclictest19982-21systemd-journal09:40:293
235249962,1cyclictest0-21swapper/310:05:573
235249961,4cyclictest21996-21apt-get12:25:103
235249961,3cyclictest502-21systemd-logind08:22:293
235249961,2cyclictest4901-21ssh10:22:503
235249960,5cyclictest12275-21ntp_states09:05:183
235229963,2cyclictest9307-21ssh09:32:372
235229963,2cyclictest668-21runrttasks08:20:012
235229963,2cyclictest508-21dbus-daemon11:46:282
235229963,2cyclictest31556-21sh10:45:032
235229963,2cyclictest30654-21snmpd07:30:132
235229963,2cyclictest25893-21expr10:40:122
235229963,2cyclictest23992-21ls11:05:132
235229963,2cyclictest23326-21switchtime12:25:172
235229963,2cyclictest19982-21systemd-journal09:50:052
235229963,2cyclictest16900-21cat08:05:122
235229963,2cyclictest16697-21sed10:05:212
235229963,2cyclictest14083-21sshd10:30:162
235229963,2cyclictest1-21systemd10:50:352
235229963,2cyclictest0-21swapper/212:15:102
235229963,2cyclictest0-21swapper/207:25:142
235229963,1cyclictest0-21swapper/210:00:172
235229962,3cyclictest8997-21cat07:45:202
235229962,3cyclictest7925-21interrupts11:20:142
235229962,3cyclictest508-21dbus-daemon07:10:422
235229962,3cyclictest31779-21cat11:40:132
235229962,3cyclictest30654-21snmpd08:35:132
235229962,3cyclictest30654-21snmpd08:29:082
235229962,3cyclictest30654-21snmpd07:56:542
235229962,3cyclictest29170-21expr07:20:142
235229962,3cyclictest1392-21grep09:25:182
235229962,3cyclictest0-21swapper/212:39:052
235229962,1cyclictest0-21swapper/211:50:082
235229962,1cyclictest0-21swapper/211:25:512
235229962,1cyclictest0-21swapper/211:00:282
235229961,1cyclictest28-21ksoftirqd/207:50:122
235229960,5cyclictest22344-21awk08:15:172
235229960,5cyclictest13291-21munin-run09:10:012
235229960,4cyclictest19982-21systemd-journal08:58:462
235229960,1cyclictest271rcuc/212:10:112
235229960,0cyclictest0-21swapper/212:32:052
235179966,0cyclictest0-21swapper/108:00:021
235179964,1cyclictest9646-21cron07:50:001
235179963,2cyclictest7489-21expr11:20:131
235179963,2cyclictest508-21dbus-daemon11:25:381
235179963,2cyclictest508-21dbus-daemon10:25:091
235179963,2cyclictest5010-21fschecks_count08:50:141
235179963,2cyclictest4278-21systemctl07:35:181
235179963,2cyclictest30654-21snmpd09:25:271
235179963,2cyclictest21667-21df10:10:141
235179963,2cyclictest20154-21ntpq11:30:171
235179963,2cyclictest20154-21ntpq11:30:161
235179963,2cyclictest19332-21cstates08:10:111
235179963,2cyclictest19301-21ssh11:00:241
235179963,2cyclictest17542-21idleruntime08:05:151
235179963,2cyclictest17213-21expr11:55:111
235179963,2cyclictest13002-21sh11:51:011
235179962,3cyclictest523-21diskstats08:40:131
235179962,3cyclictest32024-21ntpq07:25:171
235179962,3cyclictest30963-21cat11:10:201
235179962,3cyclictest30654-21snmpd08:49:361
235179962,3cyclictest30654-21snmpd08:17:501
235179962,3cyclictest28041-21cat10:15:141
235179962,3cyclictest26166-21expr07:15:021
235179962,3cyclictest24837-21swap08:20:191
235179962,3cyclictest24238-21tail11:05:141
235179962,3cyclictest19982-21systemd-journal09:56:241
235179962,3cyclictest18236-21cat09:40:151
235179962,3cyclictest1-21systemd08:39:091
235179962,3cyclictest0-21swapper/111:49:211
235179962,1cyclictest141rcu_preempt09:30:111
235179962,1cyclictest0-21swapper/110:46:291
235179961,3cyclictest19982-21systemd-journal12:25:161
235179961,3cyclictest19982-21systemd-journal11:18:071
235179961,3cyclictest19982-21systemd-journal08:27:031
235179960,6cyclictest0-21swapper/109:10:241
235179960,5cyclictest5811-21grep10:50:151
235179960,3cyclictest11292-21/usr/sbin/munin09:05:131
235139964,1cyclictest5649-21/usr/sbin/munin09:30:120
235139963,2cyclictest28810-21missed_timers12:30:180
235139963,2cyclictest2648-21cstates09:55:140
235139963,2cyclictest26409-21cpuspeed_turbos09:20:110
235139963,2cyclictest2475-21cat08:45:120
235139963,2cyclictest14299-21rm09:36:300
235139963,2cyclictest14299-21rm09:36:300
235139963,2cyclictest13619-21sh09:10:060
235139963,2cyclictest12-21ksoftirqd/010:35:150
235139963,2cyclictest11736-21in:imuxsock07:57:520
235139962,3cyclictest9957-21ntpq10:00:170
235139962,3cyclictest502-21systemd-logind11:21:280
235139962,3cyclictest30654-21snmpd12:36:180
235139962,3cyclictest30654-21snmpd12:05:150
235139962,3cyclictest30654-21snmpd11:41:370
235139962,3cyclictest30654-21snmpd09:04:230
235139962,3cyclictest30654-21snmpd08:59:350
235139962,3cyclictest30654-21snmpd08:51:030
235139962,3cyclictest30654-21snmpd08:40:320
235139962,3cyclictest30654-21snmpd07:37:030
235139962,3cyclictest21374-21apt-get08:15:110
235139962,3cyclictest19116-21gdbus08:05:020
235139962,3cyclictest10575-21cat07:50:170
235139962,2cyclictest19982-21systemd-journal11:55:240
235139962,1cyclictest0-21swapper/012:00:150
235139962,1cyclictest0-21swapper/010:50:000
235139962,1cyclictest0-21swapper/010:16:230
235139962,1cyclictest0-21swapper/009:50:290
235139961,3cyclictest19982-21systemd-journal11:31:020
235139961,3cyclictest19982-21systemd-journal11:31:020
235139961,2cyclictest23833-21ssh12:25:290
235139960,5cyclictest1823-21ntp_states07:30:160
235139960,5cyclictest12153-21rm12:15:490
235139960,3cyclictest16264-21ssh10:31:270
235139960,2cyclictest7660-21/usr/sbin/munin07:45:170
235139960,2cyclictest31685-21/usr/sbin/munin10:45:130
235139960,2cyclictest29741-11brltty11:27:430
235139960,2cyclictest203612ssh11:01:390
235139960,2cyclictest19982-21systemd-journal09:15:020
235139960,1cyclictest27850-21perf08:30:000
235139960,0cyclictest0-21swapper/012:10:510
235249953,1cyclictest72632sleep308:55:143
235249953,1cyclictest322922sleep308:40:003
235249952,2cyclictest25840-21/usr/sbin/munin08:25:123
235249952,2cyclictest12571-21cpuspeed_turbos07:55:103
235249950,3cyclictest19982-21systemd-journal09:15:013
235249950,3cyclictest19982-21systemd-journal07:40:203
235249950,3cyclictest19982-21systemd-journal07:40:203
235229952,2cyclictest9281-21ls09:00:142
235229952,2cyclictest5507-21cpuspeed07:40:152
235229952,2cyclictest5507-21cpuspeed07:40:152
235229952,2cyclictest26168-21ls07:15:012
235229952,2cyclictest19419-21expr08:10:112
235229951,3cyclictest30654-21snmpd12:00:052
235179952,2cyclictest9919-21apt-get07:50:121
235179952,2cyclictest9326-21cat10:00:131
235179951,3cyclictest28311-21cat08:30:111
235139952,2cyclictest5423-21taskset07:40:080
235139952,2cyclictest5423-21taskset07:40:080
235139952,2cyclictest31128-21cat07:25:110
235139952,2cyclictest19265-21expr08:10:100
235139951,3cyclictest29724-21grep07:20:180
235139951,3cyclictest23825-21cat07:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional