You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-10 - 18:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Thu Jul 10, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39182310276,21sleep20-21swapper/207:05:132
58572279247,20sleep00-21swapper/007:09:500
58532273210,23sleep10-21swapper/107:09:461
55742267233,21sleep30-21swapper/307:06:103
42772630,0sleep30-21swapper/310:10:183
40342580,0sleep00-21swapper/009:43:450
312822570,0sleep30-21swapper/311:54:373
247332550,0sleep10-21swapper/110:55:011
124562550,0sleep10-21swapper/110:17:461
209392540,0sleep20-21swapper/210:50:492
62992190,0sleep00-21swapper/010:12:190
75082170,0sleep10-21swapper/112:00:041
11202160,0sleep20-21swapper/210:07:362
270812150,0sleep10-21swapper/109:35:151
256122140,0sleep10-21swapper/110:00:241
197092100,0sleep20-21swapper/209:55:432
60019994,3cyclictest19982-21systemd-journal08:24:473
59929997,1cyclictest22-21ksoftirqd/108:40:011
59929996,2cyclictest30654-21snmpd12:19:061
59929992,5cyclictest22-21ksoftirqd/111:59:511
59929992,4cyclictest22-21ksoftirqd/112:26:151
59929991,4cyclictest22-21ksoftirqd/110:48:321
59929991,4cyclictest22-21ksoftirqd/109:11:371
60019986,2cyclictest34-21ksoftirqd/309:20:003
60019986,2cyclictest34-21ksoftirqd/309:20:003
60019984,3cyclictest508-21dbus-daemon09:27:233
60019984,3cyclictest19982-21systemd-journal09:07:453
60019983,3cyclictest19982-21systemd-journal09:34:283
60019983,3cyclictest19982-21systemd-journal08:07:343
60019983,3cyclictest19982-21systemd-journal07:52:153
60019980,7cyclictest15733-21ntp_states12:25:173
59979984,3cyclictest508-21dbus-daemon11:15:022
59979984,3cyclictest508-21dbus-daemon07:16:222
59979983,3cyclictest19982-21systemd-journal10:17:332
59979983,3cyclictest19982-21systemd-journal09:26:582
59979982,3cyclictest26476-21munin-run10:30:012
59979980,2cyclictest14105-21sh11:39:522
59929987,1cyclictest22-21ksoftirqd/112:20:011
59929987,1cyclictest22-21ksoftirqd/107:40:021
59929987,1cyclictest211rcuc/112:07:351
59929987,1cyclictest211rcuc/111:35:281
59929985,2cyclictest22-21ksoftirqd/108:10:001
59929983,3cyclictest19982-21systemd-journal08:48:591
59929983,3cyclictest19982-21systemd-journal08:14:211
59929982,4cyclictest32416-21taskset12:35:271
59929982,4cyclictest22-21ksoftirqd/112:13:421
59929982,4cyclictest22-21ksoftirqd/111:52:331
59929982,4cyclictest22-21ksoftirqd/111:46:371
59929982,4cyclictest22-21ksoftirqd/111:31:141
59929982,4cyclictest22-21ksoftirqd/111:29:361
59929982,4cyclictest22-21ksoftirqd/111:15:111
59929982,4cyclictest22-21ksoftirqd/110:37:531
59929982,4cyclictest22-21ksoftirqd/109:41:041
59929982,4cyclictest22-21ksoftirqd/109:28:221
59929982,4cyclictest22-21ksoftirqd/109:23:011
59929982,4cyclictest22-21ksoftirqd/108:40:011
59929982,4cyclictest0-21swapper/111:12:201
59929982,4cyclictest0-21swapper/109:50:251
59929981,5cyclictest22-21ksoftirqd/110:22:421
59929981,5cyclictest22-21ksoftirqd/109:46:271
59929981,5cyclictest211rcuc/110:15:001
59929981,4cyclictest27017-21perf07:55:001
59929981,4cyclictest22-21ksoftirqd/111:42:111
59929981,4cyclictest22-21ksoftirqd/111:24:421
59929981,4cyclictest0-21swapper/110:05:171
59929981,2cyclictest22-21ksoftirqd/110:25:131
59929980,4cyclictest22-21ksoftirqd/111:08:381
59929980,4cyclictest0-21swapper/110:30:531
59899984,3cyclictest19982-21systemd-journal12:05:000
59899984,2cyclictest508-21dbus-daemon10:22:270
59899983,3cyclictest19982-21systemd-journal07:56:320
60019974,2cyclictest19982-21systemd-journal07:40:593
60019973,3cyclictest508-21dbus-daemon07:10:333
60019973,3cyclictest31898-21sshd10:05:333
60019973,3cyclictest30654-21snmpd09:22:483
60019973,3cyclictest30654-21snmpd08:15:313
60019973,3cyclictest30654-21snmpd07:46:043
60019973,3cyclictest2819-21ntpq08:10:193
60019973,3cyclictest23668-21ntpq12:30:193
60019973,3cyclictest19982-21systemd-journal12:25:003
60019973,3cyclictest0-21swapper/310:44:163
60019973,3cyclictest0-21swapper/310:18:113
60019973,2cyclictest502-21systemd-logind09:11:053
60019973,2cyclictest19982-21systemd-journal11:45:333
60019973,1cyclictest0-21swapper/311:37:003
60019973,1cyclictest0-21swapper/311:20:073
60019972,3cyclictest19982-21systemd-journal11:10:503
60019972,3cyclictest19982-21systemd-journal09:05:003
60019971,5cyclictest0-21swapper/311:00:113
59979973,3cyclictest19982-21systemd-journal09:14:322
59979973,1cyclictest0-21swapper/210:21:542
59979973,1cyclictest0-21swapper/209:35:502
59979972,3cyclictest19982-21systemd-journal11:26:422
59979971,5cyclictest14201-21cron12:25:012
59979971,4cyclictest19982-21systemd-journal10:55:242
59979970,7cyclictest0-21swapper/211:20:022
59979970,3cyclictest19982-21systemd-journal07:23:282
59929976,1cyclictest22-21ksoftirqd/111:00:021
59929976,1cyclictest22-21ksoftirqd/108:30:011
59929973,3cyclictest8460-21memory07:15:011
59929973,3cyclictest5186-21sshd08:15:171
59929973,3cyclictest508-21dbus-daemon09:15:421
59929973,3cyclictest508-21dbus-daemon09:15:421
59929973,3cyclictest19982-21systemd-journal07:32:141
59929973,1cyclictest141rcu_preempt12:30:081
59929972,3cyclictest22-21ksoftirqd/109:05:161
59929972,3cyclictest22-21ksoftirqd/109:00:141
59929972,3cyclictest22-21ksoftirqd/108:30:151
59929972,3cyclictest0-21swapper/108:55:141
59929971,4cyclictest28943-21diskmemload10:56:161
59929971,4cyclictest22-21ksoftirqd/109:30:171
59929971,4cyclictest22-21ksoftirqd/107:35:111
59929971,4cyclictest22-21ksoftirqd/107:20:221
59929971,4cyclictest0-21swapper/110:40:011
59929971,4cyclictest0-21swapper/109:55:451
59929971,4cyclictest0-21swapper/108:03:451
59899973,3cyclictest508-21dbus-daemon09:38:120
59899973,3cyclictest508-21dbus-daemon08:56:050
59899973,3cyclictest30654-21snmpd11:52:380
59899973,3cyclictest30654-21snmpd08:40:010
59899973,3cyclictest29741-11brltty07:16:230
59899973,3cyclictest19982-21systemd-journal08:22:330
59899973,3cyclictest15737-21ntpq09:25:180
59899973,3cyclictest14251-21cron10:20:000
59899973,3cyclictest0-21swapper/011:41:560
59899973,1cyclictest0-21swapper/012:32:280
59899973,1cyclictest0-21swapper/011:45:550
59899973,1cyclictest0-21swapper/010:47:520
59899973,1cyclictest0-21swapper/010:05:180
59899972,4cyclictest16067-21fw_packets12:05:150
59899970,4cyclictest4155-21munin-run11:05:000
29554270,0sleep30-21swapper/309:37:103
60019964,1cyclictest30217-21df_inode08:00:123
60019963,2cyclictest7590-21ssh12:00:073
60019963,2cyclictest30654-21snmpd09:45:413
60019963,2cyclictest27809-21needreboot10:30:193
60019963,2cyclictest27297-21ssh10:56:033
60019963,2cyclictest18453-21fschecks_time07:35:153
60019963,2cyclictest18231-21fw_packets09:55:153
60019963,2cyclictest14739-21smart_sda07:25:203
60019963,2cyclictest14365-21cat10:45:213
60019963,2cyclictest12685-21cut09:50:203
60019963,2cyclictest11736-21in:imuxsock10:20:323
60019963,1cyclictest0-21swapper/312:36:293
60019963,1cyclictest0-21swapper/312:10:083
60019962,3cyclictest9531-21fschecks_time07:15:173
60019962,3cyclictest508-21dbus-daemon10:00:203
60019962,3cyclictest508-21dbus-daemon08:26:273
60019962,3cyclictest32394-21sed12:15:173
60019962,3cyclictest30654-21snmpd11:55:373
60019962,3cyclictest30654-21snmpd11:31:173
60019962,3cyclictest30654-21snmpd10:25:093
60019962,3cyclictest30654-21snmpd08:30:403
60019962,3cyclictest30654-21snmpd07:23:453
60019962,3cyclictest27972-21df07:55:163
60019962,3cyclictest19982-21systemd-journal11:07:053
60019962,3cyclictest1366-21basename10:35:153
60019962,3cyclictest0-21swapper/311:17:243
60019962,1cyclictest0-21swapper/311:25:393
60019961,4cyclictest15517-21apt-get12:05:123
60019961,3cyclictest19982-21systemd-journal08:55:153
60019961,1cyclictest32038-21apt-get09:40:153
60019960,6cyclictest0-21swapper/311:42:283
60019960,3cyclictest19904-21ntp_states10:50:183
60019960,2cyclictest18033-21/usr/sbin/munin08:45:183
60019960,2cyclictest16535-21awk08:40:163
59979966,0cyclictest0-21swapper/208:01:252
59979964,1cyclictest4586-21ssh11:05:132
59979964,1cyclictest31606-21ntp_states12:35:182
59979963,2cyclictest7114-21fschecks_time08:20:142
59979963,2cyclictest508-21dbus-daemon10:40:482
59979963,2cyclictest30654-21snmpd12:30:452
59979963,2cyclictest28-21ksoftirqd/212:00:202
59979963,2cyclictest27416-21grep10:30:172
59979963,2cyclictest19982-21systemd-journal11:00:432
59979963,2cyclictest16705-21ssh12:25:352
59979963,2cyclictest1567-21cron08:10:002
59979963,2cyclictest11642-21cut11:10:202
59979963,1cyclictest0-21swapper/209:15:182
59979963,1cyclictest0-21swapper/209:15:182
59979962,3cyclictest508-21dbus-daemon07:40:192
59979962,3cyclictest30654-21snmpd12:05:232
59979962,3cyclictest30654-21snmpd11:40:102
59979962,3cyclictest30654-21snmpd10:13:392
59979962,3cyclictest30654-21snmpd08:52:382
59979962,3cyclictest30654-21snmpd07:31:032
59979962,3cyclictest27941-21ntpq09:05:172
59979962,3cyclictest25026-21sshd07:50:122
59979962,3cyclictest23028-21grep08:55:162
59979962,3cyclictest19982-21systemd-journal08:10:112
59979962,3cyclictest15620-21apt-config08:40:012
59979962,3cyclictest12108-21sed08:30:192
59979962,3cyclictest0-21swapper/211:55:452
59979962,3cyclictest0-21swapper/209:52:592
59979962,3cyclictest0-21swapper/209:40:152
59979962,3cyclictest0-21swapper/209:23:062
59979962,2cyclictest19982-21systemd-journal07:45:102
59979962,1cyclictest141rcu_preempt12:10:182
59979961,4cyclictest2360-21ssh11:30:032
59979961,4cyclictest0-21swapper/210:35:022
59979961,3cyclictest502-21systemd-logind07:58:052
59979961,3cyclictest19982-21systemd-journal12:15:012
59979961,3cyclictest19982-21systemd-journal11:50:532
59979961,3cyclictest19982-21systemd-journal11:45:032
59979961,3cyclictest19982-21systemd-journal09:46:342
59979961,3cyclictest19982-21systemd-journal07:39:452
59979960,0cyclictest0-21swapper/209:31:462
59929965,1cyclictest22-21ksoftirqd/107:55:001
59929965,1cyclictest211rcuc/107:25:201
59929963,2cyclictest7438-21switchtime07:10:201
59929960,4cyclictest22-21ksoftirqd/108:50:011
59929960,4cyclictest22-21ksoftirqd/108:23:161
59929960,2cyclictest22-21ksoftirqd/107:45:131
59899963,2cyclictest7661-21lldpd07:34:580
59899963,2cyclictest32481-21cut12:15:180
59899963,2cyclictest28943-21diskmemload12:36:470
59899963,2cyclictest28943-21diskmemload10:40:020
59899963,2cyclictest25799-21wc07:50:150
59899963,2cyclictest21858-21ssh11:20:050
59899963,2cyclictest18958-21sh11:16:100
59899963,2cyclictest18911-21ntpq07:35:170
59899963,2cyclictest11736-21in:imuxsock11:35:000
59899963,2cyclictest0-21swapper/009:46:240
59899963,1cyclictest0-21swapper/012:20:270
59899962,3cyclictest7661-21lldpd09:08:450
59899962,3cyclictest4114-21ntpq09:15:160
59899962,3cyclictest4114-21ntpq09:15:160
59899962,3cyclictest30654-21snmpd10:55:070
59899962,3cyclictest30654-21snmpd10:00:410
59899962,3cyclictest30654-21snmpd09:30:150
59899962,3cyclictest30654-21snmpd09:11:000
59899962,3cyclictest30654-21snmpd08:17:560
59899962,3cyclictest30654-21snmpd08:10:380
59899962,3cyclictest30654-21snmpd07:40:570
59899962,3cyclictest30654-21snmpd07:24:520
59899962,3cyclictest30654-21snmpd07:12:200
59899962,3cyclictest30508-21cat08:00:130
59899962,3cyclictest27598-21cat10:30:160
59899962,3cyclictest25480-21expr09:00:170
59899962,3cyclictest21236-21ntpq08:50:180
59899962,3cyclictest19982-21systemd-journal08:45:270
59899962,3cyclictest14817-21awk08:35:200
59899962,3cyclictest13805-21expr07:25:150
59899962,3cyclictest12678-21sshd08:30:320
59899962,3cyclictest0-21swapper/012:25:110
59899962,3cyclictest0-21swapper/011:26:040
59899962,3cyclictest0-21swapper/010:28:300
59899962,1cyclictest0-21swapper/012:12:310
59899962,1cyclictest0-21swapper/010:50:200
59899962,1cyclictest0-21swapper/010:36:010
59899962,1cyclictest0-21swapper/009:53:570
59899961,3cyclictest19982-21systemd-journal09:20:160
59899960,4cyclictest502-21systemd-logind11:56:450
59899960,4cyclictest19982-21systemd-journal09:56:110
59899960,4cyclictest19982-21systemd-journal08:26:030
59899960,2cyclictest4549-21/usr/sbin/munin11:05:180
20285260,0sleep30-21swapper/308:50:133
60019952,2cyclictest13425-21cut08:35:133
60019951,3cyclictest16181-21grep07:30:153
59979952,2cyclictest9028-21cpuspeed_turbos08:25:152
59979952,2cyclictest4266-21cat08:15:002
59979952,2cyclictest24912-21expr09:00:132
59979952,2cyclictest13496-21sshd07:25:092
59979952,2cyclictest0-21swapper/210:00:022
59979951,3cyclictest13653-21expr08:35:142
59979951,1cyclictest0-21swapper/210:45:052
59979950,3cyclictest19982-21systemd-journal07:10:072
59979950,1cyclictest0-21swapper/208:45:132
59899952,2cyclictest9070-21sed11:35:150
59899952,2cyclictest23110-21expr07:45:120
59899952,2cyclictest10543-21cut11:10:130
59899951,3cyclictest32755-21irqstats08:05:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional