You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 20:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Wed Nov 26, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
220472328296,20sleep20-21swapper/207:09:592
218862282221,48sleep30-21swapper/307:08:153
217732264232,20sleep00-21swapper/007:06:470
218592261215,35sleep10-21swapper/107:07:521
292772620,0sleep10-21swapper/109:51:261
292772620,0sleep10-21swapper/109:51:261
172992600,0sleep30-21swapper/309:13:353
88732590,0sleep20-21swapper/209:00:132
301392570,0sleep30-21swapper/308:35:153
110762570,0sleep20-21swapper/209:05:132
204932560,0sleep30-21swapper/311:03:043
98942540,0sleep00-21swapper/009:00:190
205422190,0sleep30-21swapper/310:11:503
217062160,0sleep20-21swapper/211:04:312
38822150,0sleep10-21swapper/112:29:111
310942150,0sleep20-21swapper/210:45:212
265782130,0sleep30-21swapper/310:16:513
286502120,0sleep30-21swapper/310:44:213
166502100,0sleep10-21swapper/109:40:291
221569996,2cyclictest28-21ksoftirqd/208:35:002
221569994,3cyclictest19982-21systemd-journal11:38:062
221569992,4cyclictest26197-21idleruntime-cro09:50:002
221519996,2cyclictest30654-21snmpd11:45:021
221489994,3cyclictest19982-21systemd-journal12:30:160
7033280,1sleep20-21swapper/212:08:422
417280,0sleep00-21swapper/009:55:140
221609984,3cyclictest508-21dbus-daemon09:39:143
221609984,3cyclictest508-21dbus-daemon07:11:063
221609983,3cyclictest19982-21systemd-journal12:14:443
221609983,3cyclictest19982-21systemd-journal11:51:483
221609983,3cyclictest19982-21systemd-journal09:00:003
221609980,7cyclictest11531-21ntp_states09:05:153
221569984,2cyclictest19982-21systemd-journal08:53:442
221569983,3cyclictest19982-21systemd-journal07:12:492
221519986,1cyclictest22-21ksoftirqd/108:55:001
221519983,3cyclictest19982-21systemd-journal08:29:081
221519983,3cyclictest19982-21systemd-journal07:43:131
221489984,3cyclictest508-21dbus-daemon09:05:010
221609974,2cyclictest30654-21snmpd10:52:513
221609973,3cyclictest508-21dbus-daemon12:01:543
221609973,3cyclictest1-21systemd10:55:343
221609973,3cyclictest0-21swapper/312:20:393
221609973,2cyclictest19982-21systemd-journal08:24:113
221609973,1cyclictest0-21swapper/311:58:043
221609973,1cyclictest0-21swapper/311:44:303
221609973,1cyclictest0-21swapper/311:35:373
221609972,3cyclictest19982-21systemd-journal12:19:553
221609972,3cyclictest19982-21systemd-journal10:39:333
221609972,3cyclictest19982-21systemd-journal08:51:143
221609971,2cyclictest19982-21systemd-journal12:39:513
221569975,1cyclictest9496-21latency_hist10:30:002
221569974,2cyclictest508-21dbus-daemon08:07:262
221569974,2cyclictest508-21dbus-daemon07:34:292
221569973,3cyclictest7257-21wc10:00:192
221569973,3cyclictest508-21dbus-daemon12:30:152
221569973,3cyclictest19982-21systemd-journal12:27:202
221569973,1cyclictest0-21swapper/212:11:312
221569973,1cyclictest0-21swapper/211:18:512
221569973,1cyclictest0-21swapper/211:06:232
221569973,1cyclictest0-21swapper/210:34:362
221569972,3cyclictest19982-21systemd-journal12:24:522
221569972,3cyclictest19982-21systemd-journal11:24:212
221569972,3cyclictest19982-21systemd-journal10:39:302
221569970,4cyclictest508-21dbus-daemon10:45:012
221569970,2cyclictest5738-21taskset07:41:192
221519974,2cyclictest508-21dbus-daemon11:08:551
221519974,2cyclictest508-21dbus-daemon07:37:481
221519974,2cyclictest4530-21head09:30:141
221519974,2cyclictest19982-21systemd-journal12:33:361
221519974,2cyclictest11736-21in:imuxsock09:55:301
221519973,3cyclictest508-21dbus-daemon10:37:381
221519973,3cyclictest30654-21snmpd11:22:581
221519973,3cyclictest0-21swapper/110:05:141
221519973,2cyclictest508-21dbus-daemon09:50:011
221519973,1cyclictest0-21swapper/111:58:571
221519973,1cyclictest0-21swapper/111:44:361
221519971,5cyclictest0-21swapper/107:30:011
221519971,2cyclictest7661-21lldpd12:19:021
221519970,4cyclictest11688-21dump-pmu-power10:05:021
221519970,2cyclictest7661-21lldpd10:35:011
221519970,2cyclictest28362-21ssh12:23:221
221489975,1cyclictest1994-21ssh12:27:250
221489974,2cyclictest508-21dbus-daemon11:41:280
221489974,2cyclictest11736-21in:imuxsock07:40:190
221489973,3cyclictest9828-21df11:20:130
221489973,3cyclictest5169-21awk10:50:200
221489973,3cyclictest508-21dbus-daemon10:24:420
221489973,3cyclictest508-21dbus-daemon09:25:270
221489973,3cyclictest30220-21sed09:24:590
221489973,3cyclictest29741-11brltty10:05:300
221489973,3cyclictest19982-21systemd-journal12:09:450
221489973,3cyclictest19982-21systemd-journal11:08:540
221489973,3cyclictest19982-21systemd-journal07:11:490
221489973,3cyclictest0-21swapper/011:35:440
221489973,3cyclictest0-21swapper/010:49:050
221489973,3cyclictest0-21swapper/010:28:440
221489973,2cyclictest19982-21systemd-journal10:34:560
221489973,2cyclictest19982-21systemd-journal09:49:140
221489973,1cyclictest13066-21turbostat08:00:010
221489973,1cyclictest0-21swapper/010:04:330
221489972,3cyclictest19982-21systemd-journal12:12:190
221489972,3cyclictest19982-21systemd-journal10:55:340
221489972,3cyclictest19982-21systemd-journal08:03:160
221609963,2cyclictest34-21ksoftirqd/311:25:173
221609963,2cyclictest30654-21snmpd12:26:123
221609963,2cyclictest30654-21snmpd09:59:513
221609963,2cyclictest30654-21snmpd08:13:523
221609963,2cyclictest29741-11brltty09:02:043
221609963,2cyclictest21673-21gltestperf09:45:173
221609963,2cyclictest1618-21cat08:45:143
221609963,2cyclictest1-21systemd11:10:353
221609963,2cyclictest11295-21ssh11:20:383
221609962,3cyclictest9476-21hostname07:50:153
221609962,3cyclictest3852-21cat11:15:153
221609962,3cyclictest31516-21grep09:25:203
221609962,3cyclictest30654-21snmpd11:30:263
221609962,3cyclictest30654-21snmpd10:34:523
221609962,3cyclictest30654-21snmpd09:32:553
221609962,3cyclictest30654-21snmpd08:44:303
221609962,3cyclictest30654-21snmpd08:34:033
221609962,3cyclictest30654-21snmpd08:27:593
221609962,3cyclictest30654-21snmpd07:56:053
221609962,3cyclictest30654-21snmpd07:41:463
221609962,3cyclictest30125-21df10:45:133
221609962,3cyclictest25399-21fschecks_count09:20:133
221609962,3cyclictest2519-21cat12:05:153
221609962,3cyclictest19982-21systemd-journal08:00:193
221609962,3cyclictest1970-21expr07:35:133
221609962,3cyclictest12731-21sed10:05:153
221609962,3cyclictest1-21systemd07:31:083
221609962,3cyclictest11736-21in:imuxsock07:47:003
221609962,3cyclictest0-21swapper/311:46:313
221609962,3cyclictest0-21swapper/310:00:153
221609962,2cyclictest19982-21systemd-journal10:22:123
221609962,2cyclictest19982-21systemd-journal07:26:583
221609962,1cyclictest0-21swapper/309:16:593
221609961,4cyclictest4081-21grep10:25:153
221609961,4cyclictest0-21swapper/312:30:183
221609961,3cyclictest19982-21systemd-journal07:23:383
221609961,2cyclictest29614-21ssh09:52:053
221609961,2cyclictest29614-21ssh09:52:053
221609961,2cyclictest19982-21systemd-journal09:41:443
221569964,1cyclictest12556-21diskmemload09:55:182
221569963,2cyclictest4913-21ntpq09:30:172
221569963,2cyclictest30654-21snmpd10:56:142
221569963,2cyclictest30654-21snmpd09:50:422
221569963,2cyclictest30654-21snmpd09:50:422
221569963,2cyclictest30654-21snmpd08:18:082
221569963,2cyclictest28606-21rt-features07:20:202
221569963,2cyclictest28-21ksoftirqd/210:15:142
221569963,2cyclictest28-21ksoftirqd/209:20:172
221569963,2cyclictest19879-21head09:15:152
221569963,2cyclictest16767-21sh09:40:392
221569963,2cyclictest13351-21systemctl10:05:192
221569963,1cyclictest0-21swapper/211:30:042
221569962,3cyclictest6920-21expr07:45:142
221569962,3cyclictest6317-21cat08:55:122
221569962,3cyclictest508-21dbus-daemon09:10:202
221569962,3cyclictest508-21dbus-daemon07:38:392
221569962,3cyclictest31085-21basename10:20:212
221569962,3cyclictest30654-21snmpd11:10:412
221569962,3cyclictest30654-21snmpd08:21:592
221569962,3cyclictest29937-21cat08:35:142
221569962,3cyclictest21479-21expr11:55:152
221569962,3cyclictest18706-21ntpq10:10:192
221569962,3cyclictest14804-21expr11:50:142
221569962,3cyclictest1-21systemd09:35:172
221569962,3cyclictest1-21systemd07:58:142
221569962,2cyclictest7661-21lldpd08:49:262
221569962,1cyclictest0-21swapper/212:15:022
221569962,1cyclictest0-21swapper/211:40:432
221569962,1cyclictest0-21swapper/211:28:142
221569961,2cyclictest3522-21ssh10:50:112
221569961,2cyclictest27192-21ssh12:00:112
221569961,2cyclictest1001-21ssh09:27:042
221519964,1cyclictest11738-21rs:main1
221519964,1cyclictest11243-21cpuspeed_turbos07:55:131
221519963,2cyclictest578-21sh09:26:351
221519963,2cyclictest30654-21snmpd11:10:351
221519963,2cyclictest30654-21snmpd07:31:161
221519963,2cyclictest27968-21fschecks_time07:20:161
221519963,2cyclictest2582-21wc12:05:161
221519963,2cyclictest24929-21load07:15:011
221519963,2cyclictest15763-21sh11:50:201
221519963,2cyclictest15527-21sh09:11:221
221519963,2cyclictest10995-21ssh10:55:181
221519962,3cyclictest5863-21apt-config08:55:001
221519962,3cyclictest31069-21cat10:45:211
221519962,3cyclictest30654-21snmpd10:21:041
221519962,3cyclictest30654-21snmpd09:24:371
221519962,3cyclictest30654-21snmpd09:06:011
221519962,3cyclictest30654-21snmpd08:33:241
221519962,3cyclictest30654-21snmpd08:17:381
221519962,3cyclictest30654-21snmpd08:09:411
221519962,3cyclictest30129-21cat08:35:141
221519962,3cyclictest24902-21tr10:15:181
221519962,3cyclictest22611-21expr07:10:151
221519962,3cyclictest1989-21cat08:45:161
221519962,3cyclictest18412-21kernelversion10:10:161
221519962,3cyclictest15496-21/usr/sbin/munin11:25:141
221519962,3cyclictest10071-21sensors_temp07:50:201
221519962,3cyclictest0-21swapper/111:15:181
221519962,1cyclictest0-21swapper/112:12:241
221519962,1cyclictest0-21swapper/112:00:031
221519962,1cyclictest0-21swapper/111:37:401
221519962,1cyclictest0-21swapper/111:00:191
221519962,1cyclictest0-21swapper/109:37:421
221519961,3cyclictest19982-21systemd-journal09:01:401
221519961,3cyclictest19982-21systemd-journal08:41:131
221519961,3cyclictest19982-21systemd-journal08:12:481
221519961,2cyclictest14939-21ssh12:36:371
221519960,6cyclictest0-21swapper/109:15:011
221519960,3cyclictest6061-21cron07:49:561
221519960,2cyclictest3542-21/usr/sbin/munin10:50:131
221489963,2cyclictest7987-21sshd08:59:180
221489963,2cyclictest30654-21snmpd07:26:540
221489963,2cyclictest3031-21grep07:35:190
221489963,2cyclictest28295-21sh12:23:200
221489963,2cyclictest27606-21df_inode12:00:130
221489963,2cyclictest23606-21rm10:15:100
221489963,2cyclictest23191-21hostname08:20:150
221489963,2cyclictest16809-21ssh10:35:070
221489963,2cyclictest16495-21awk11:25:180
221489963,2cyclictest1571-21expr08:45:140
221489963,2cyclictest11736-21in:imuxsock08:54:270
221489963,1cyclictest12556-21diskmemload11:45:270
221489962,3cyclictest7795-21basename07:45:200
221489962,3cyclictest3868-21cat11:15:160
221489962,3cyclictest30654-21snmpd11:12:280
221489962,3cyclictest30654-21snmpd09:33:250
221489962,3cyclictest30654-21snmpd09:15:060
221489962,3cyclictest30654-21snmpd09:13:430
221489962,3cyclictest30654-21snmpd08:44:510
221489962,3cyclictest30654-21snmpd08:36:480
221489962,3cyclictest29741-11brltty07:18:370
221489962,3cyclictest25492-21diskmemload10:41:000
221489962,3cyclictest25006-21cat08:25:120
221489962,3cyclictest19982-21systemd-journal09:40:290
221489962,3cyclictest18769-21cat08:10:150
221489962,3cyclictest16608-21cat11:00:120
221489962,3cyclictest13212-21date12:35:190
221489962,3cyclictest0-21swapper/012:15:240
221489962,1cyclictest0-21swapper/011:55:270
221489962,1cyclictest0-21swapper/011:50:340
221489961,3cyclictest19982-21systemd-journal08:06:110
221489961,3cyclictest19982-21systemd-journal07:50:070
221489960,5cyclictest9490-21/usr/sbin/munin09:35:120
221489960,5cyclictest27223-21sed09:50:160
221489960,5cyclictest27223-21sed09:50:160
221489960,5cyclictest27023-21/usr/sbin/munin08:30:130
21837260,1sleep0131rcuc/011:30:120
221609954,1cyclictest34-21ksoftirqd/311:05:013
221609952,2cyclictest20654-21expr08:15:133
221609951,3cyclictest25187-21df07:15:033
221609951,2cyclictest29741-11brltty08:05:203
221569953,1cyclictest32143-21hwlatdetect08:40:172
221569952,2cyclictest9543-21/usr/sbin/munin07:50:152
221569952,2cyclictest25446-21basename08:25:152
221569952,2cyclictest25184-21chrt07:15:022
221569952,2cyclictest18453-21expr08:10:132
221569952,2cyclictest11578-21sh12:35:052
221569951,3cyclictest8681-21/usr/sbin/munin11:45:122
221569951,3cyclictest13061-21apt-get08:00:032
221569950,3cyclictest19982-21systemd-journal07:26:082
221519951,3cyclictest23246-21cat08:20:171
221519951,3cyclictest13596-21packagekitd08:00:021
221519951,3cyclictest0-21swapper/111:30:021
221519951,3cyclictest0-21swapper/110:25:081
221489953,1cyclictest0-21swapper/007:30:110
221489952,2cyclictest30654-21snmpd10:10:060
221489952,2cyclictest28233-21cat07:20:180
221489952,2cyclictest20510-21expr08:15:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional