You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 08:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Sat Jul 12, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
145302315282,21sleep20-21swapper/219:06:122
146062261227,22sleep10-21swapper/119:06:561
126312261225,21sleep00-21swapper/019:05:030
147932259227,20sleep30-21swapper/319:09:233
266142600,0sleep10-21swapper/120:45:141
25172590,0sleep00-21swapper/023:47:130
314392550,1sleep30-21swapper/321:50:243
114452500,0sleep20-21swapper/223:54:072
91922390,0sleep10-21swapper/121:12:171
320022220,0sleep00-21swapper/000:09:160
314672200,0sleep10-21swapper/120:55:151
102152180,1sleep00-21swapper/021:35:220
1494999173,9cyclictest29772-21sh00:06:531
201022160,0sleep20-21swapper/221:42:542
162602150,0sleep10-21swapper/123:57:071
1494999150,2cyclictest16388-21ssh22:48:511
1494999143,6cyclictest29741-11brltty21:05:541
14958991311,1cyclictest34-21ksoftirqd/319:15:023
1494999132,6cyclictest4701-21cat19:55:181
1494999132,6cyclictest30654-21snmpd21:45:541
1494999131,9cyclictest30654-21snmpd00:37:291
1494999131,9cyclictest19397-21perf20:30:011
1494999131,9cyclictest0-21swapper/123:05:411
277442120,0sleep10-21swapper/100:32:511
1495899129,2cyclictest34-21ksoftirqd/300:20:003
1494999122,6cyclictest32645-21sh21:51:181
1494999122,5cyclictest17483-21ssh22:25:511
1494999120,3cyclictest7833-21ssh23:50:381
1494999120,3cyclictest3016-21ssh23:02:061
1494999120,3cyclictest27849-21ssh22:34:031
1494999120,3cyclictest22148-21chrt22:52:441
1494999120,3cyclictest20874-21ssh22:05:291
1494999120,2cyclictest2995-21ssh22:39:261
1494999120,2cyclictest2663-21rm23:47:211
1495899119,1cyclictest34-21ksoftirqd/320:00:003
1495899118,2cyclictest34-21ksoftirqd/323:20:003
1495899118,2cyclictest34-21ksoftirqd/322:20:013
1495899118,2cyclictest34-21ksoftirqd/322:10:013
1495899118,2cyclictest34-21ksoftirqd/300:00:003
1495899110,3cyclictest19982-21systemd-journal00:29:293
1494999113,6cyclictest19982-21systemd-journal19:47:001
1494999111,8cyclictest19982-21systemd-journal23:10:391
1494999110,7cyclictest6002-21ssh23:26:361
1494999110,7cyclictest5094-21diskmemload22:10:231
1494999110,7cyclictest15925-21expr20:20:191
1494999110,6cyclictest18209-21ssh21:19:071
1494999110,3cyclictest31666-21taskset21:28:201
1494999110,3cyclictest23306-21expr19:25:151
1494999110,3cyclictest19455-21ssh21:20:041
1494999110,2cyclictest869-21sh23:23:321
1494999110,2cyclictest5937-21ssh22:40:281
1494999110,2cyclictest22975-21ssh00:01:451
1494999110,2cyclictest11974-21ssh23:30:331
1494999110,1cyclictest4101-21ssh00:12:121
1495899109,1cyclictest34-21ksoftirqd/320:55:003
1495899109,1cyclictest34-21ksoftirqd/320:10:003
1495899109,1cyclictest34-21ksoftirqd/319:40:013
1495899107,2cyclictest34-21ksoftirqd/321:24:593
1495899107,2cyclictest34-21ksoftirqd/319:15:013
1494999103,6cyclictest0-21swapper/121:44:421
1494999102,7cyclictest8295-21head00:15:221
1494999101,8cyclictest21099-21apt-get23:15:141
1494999101,7cyclictest19982-21systemd-journal22:17:261
1494999100,9cyclictest29198-21apt-get19:40:001
1494999100,9cyclictest17120-21apt19:15:021
1494999100,6cyclictest30654-21snmpd21:57:561
1494999100,6cyclictest29754-21ssh22:58:161
1494999100,6cyclictest22173-21seq19:20:521
1494999100,6cyclictest20270-21chrt19:19:571
1494999100,3cyclictest3912-21ssh21:31:031
1494999100,3cyclictest2521-21chrt21:01:001
1494999100,3cyclictest12218-21ssh22:22:351
1494999100,2cyclictest30374-21chrt20:53:141
1494999100,2cyclictest14559-21ssh00:20:241
1494999100,2cyclictest10371-21ssh21:35:251
1494999100,1cyclictest23575-21apt-get23:40:011
1494999100,1cyclictest12287-21rm22:00:151
149589998,1cyclictest34-21ksoftirqd/322:45:023
149589998,1cyclictest34-21ksoftirqd/300:15:003
149589997,2cyclictest34-21ksoftirqd/323:50:163
149589997,2cyclictest34-21ksoftirqd/319:35:013
149589997,1cyclictest34-21ksoftirqd/321:00:003
149589994,3cyclictest19982-21systemd-journal22:54:233
149589993,4cyclictest34-21ksoftirqd/322:21:073
149589992,5cyclictest34-21ksoftirqd/323:38:103
149499992,6cyclictest30654-21snmpd20:13:011
149499990,2cyclictest29750-21apt-get19:40:011
149499990,2cyclictest25684-21cat19:30:151
149499990,2cyclictest21216-21taskset20:30:241
149499990,1cyclictest77-21kswapd000:25:131
149499990,0cyclictest0-21swapper/123:38:351
149459994,3cyclictest19982-21systemd-journal21:34:150
149459994,3cyclictest19982-21systemd-journal20:44:110
149459994,3cyclictest19982-21systemd-journal20:44:110
28633280,0sleep20-21swapper/221:25:282
28249280,0sleep00-21swapper/022:10:430
149589987,1cyclictest34-21ksoftirqd/322:50:023
149589987,1cyclictest34-21ksoftirqd/321:35:013
149589987,1cyclictest34-21ksoftirqd/300:00:003
149589987,1cyclictest331rcuc/320:40:013
149589986,2cyclictest34-21ksoftirqd/323:40:013
149589985,2cyclictest34-21ksoftirqd/321:30:003
149589985,2cyclictest331rcuc/320:24:103
149589983,3cyclictest34-21ksoftirqd/300:31:273
149589982,4cyclictest34-21ksoftirqd/323:11:043
149589982,4cyclictest34-21ksoftirqd/323:05:133
149589982,4cyclictest34-21ksoftirqd/322:33:503
149589982,4cyclictest34-21ksoftirqd/321:35:043
149589982,4cyclictest34-21ksoftirqd/321:15:313
149589981,5cyclictest34-21ksoftirqd/321:55:203
149589981,5cyclictest34-21ksoftirqd/319:50:143
149589981,4cyclictest19374-21cron20:34:553
149589981,4cyclictest0-21swapper/300:35:183
149589980,7cyclictest0-21swapper/321:45:173
149589980,5cyclictest34-21ksoftirqd/322:58:363
149539984,3cyclictest19982-21systemd-journal00:12:482
149499982,5cyclictest30654-21snmpd20:05:211
149499981,6cyclictest13348-21sort20:15:141
149499980,7cyclictest7099-21cat20:00:181
149499980,3cyclictest1811-21/usr/sbin/munin19:50:131
149499980,1cyclictest0-21swapper/120:40:141
149499980,1cyclictest0-21swapper/120:40:141
149499980,0cyclictest0-21swapper/120:35:131
149459986,1cyclictest23224-21df21:45:130
149459983,3cyclictest19982-21systemd-journal20:47:310
11572280,1sleep011573-21/usr/sbin/munin22:45:140
5419270,0sleep30-21swapper/321:10:063
29781270,0sleep20-21swapper/221:50:062
149589976,1cyclictest34-21ksoftirqd/321:00:013
149589976,1cyclictest34-21ksoftirqd/300:05:113
149589975,2cyclictest331rcuc/323:45:123
149589974,2cyclictest34-21ksoftirqd/319:50:013
149589973,2cyclictest19982-21systemd-journal21:05:013
149589973,1cyclictest0-21swapper/322:10:123
149589972,1cyclictest34-21ksoftirqd/321:40:233
149589971,4cyclictest34-21ksoftirqd/320:45:173
149589971,4cyclictest34-21ksoftirqd/320:15:153
149589971,4cyclictest0-21swapper/320:25:123
149589971,1cyclictest141rcu_preempt00:24:223
149589970,5cyclictest34-21ksoftirqd/323:25:533
149589970,5cyclictest34-21ksoftirqd/323:20:403
149589970,5cyclictest34-21ksoftirqd/322:35:293
149589970,5cyclictest34-21ksoftirqd/322:25:203
149589970,5cyclictest34-21ksoftirqd/322:01:143
149589970,5cyclictest34-21ksoftirqd/320:00:223
149589970,5cyclictest34-21ksoftirqd/319:20:143
149589970,5cyclictest1511-21runrttasks23:00:353
149589970,2cyclictest0-21swapper/323:30:143
149539974,2cyclictest508-21dbus-daemon22:00:332
149539974,2cyclictest508-21dbus-daemon21:04:382
149539974,2cyclictest508-21dbus-daemon20:02:532
149539974,2cyclictest19982-21systemd-journal22:17:142
149539973,3cyclictest7661-21lldpd22:40:242
149539973,3cyclictest30654-21snmpd23:18:002
149539973,3cyclictest30654-21snmpd22:05:402
149539973,3cyclictest19982-21systemd-journal22:26:502
149539973,3cyclictest0-21swapper/223:14:482
149539971,3cyclictest29215-21munin-plugin-st00:35:002
149539971,3cyclictest20299-21munin-run19:20:012
149539970,7cyclictest0-21swapper/220:50:122
149459974,2cyclictest19982-21systemd-journal22:34:200
149459974,2cyclictest12-21ksoftirqd/019:15:010
149459973,3cyclictest30654-21snmpd21:23:170
149459973,3cyclictest19982-21systemd-journal22:21:320
149459973,3cyclictest0-21swapper/023:52:460
149459973,3cyclictest0-21swapper/023:17:140
149459973,3cyclictest0-21swapper/000:33:540
149459973,2cyclictest19982-21systemd-journal00:00:010
149459973,1cyclictest0-21swapper/023:25:130
149459972,3cyclictest16597-21turbostat23:35:000
149459971,4cyclictest19982-21systemd-journal00:28:390
149459971,3cyclictest29265-21rm23:43:270
149459971,3cyclictest14921-21turbostat20:20:000
149459970,4cyclictest20624-21munin-plugin-st23:15:010
149459970,3cyclictest6787-21/usr/sbin/munin23:05:170
149459970,1cyclictest22263-21ssh23:38:460
3086260,1sleep0121ksoftirqd/022:15:480
22838260,0sleep20-21swapper/222:30:162
149589963,1cyclictest141rcu_preempt19:25:143
149589962,3cyclictest508-21dbus-daemon20:11:393
149589962,3cyclictest30654-21snmpd19:40:213
149589960,5cyclictest25060-21ntp_states20:40:203
149589960,5cyclictest25060-21ntp_states20:40:203
149539963,2cyclictest9349-21irqstats21:35:172
149539963,2cyclictest8627-21fschecks_time22:20:142
149539963,2cyclictest8019-21cat00:15:202
149539963,2cyclictest508-21dbus-daemon19:35:002
149539963,2cyclictest30654-21snmpd21:20:152
149539963,2cyclictest30654-21snmpd00:35:312
149539963,2cyclictest23240-21diskstats21:45:142
149539963,2cyclictest16837-21rm23:35:022
149539963,2cyclictest13866-21ssh00:20:162
149539963,2cyclictest11736-21in:imuxsock19:43:172
149539963,2cyclictest0-21swapper/222:37:572
149539962,3cyclictest8462-21seq20:05:012
149539962,3cyclictest7421-21sed23:05:132
149539962,3cyclictest6222-21cat21:10:152
149539962,3cyclictest5597-21cat21:55:202
149539962,3cyclictest30654-21snmpd23:33:312
149539962,3cyclictest30654-21snmpd22:50:082
149539962,3cyclictest30654-21snmpd20:35:192
149539962,3cyclictest30654-21snmpd20:20:272
149539962,3cyclictest30654-21snmpd19:47:412
149539962,3cyclictest30654-21snmpd19:29:052
149539962,3cyclictest30654-21snmpd19:10:112
149539962,3cyclictest27900-21cat19:35:162
149539962,3cyclictest26512-21grep20:45:132
149539962,3cyclictest2485-21cat19:50:162
149539962,3cyclictest19982-21systemd-journal20:40:272
149539962,3cyclictest19982-21systemd-journal20:40:262
149539962,3cyclictest19715-21cat00:25:162
149539962,3cyclictest17989-21tail20:25:152
149539962,3cyclictest0-21swapper/221:15:402
149539962,1cyclictest0-21swapper/223:56:412
149539962,1cyclictest0-21swapper/223:45:072
149539962,1cyclictest0-21swapper/223:40:082
149539962,1cyclictest0-21swapper/223:01:152
149539962,1cyclictest0-21swapper/221:30:272
149539962,1cyclictest0-21swapper/200:06:582
149539961,4cyclictest0-21swapper/200:00:172
149539961,3cyclictest19982-21systemd-journal23:26:302
149539961,3cyclictest19982-21systemd-journal21:08:232
149539961,3cyclictest19982-21systemd-journal20:55:022
149539961,3cyclictest19982-21systemd-journal19:24:572
149539961,2cyclictest13083-21ssh22:45:342
149539960,6cyclictest0-21swapper/222:56:452
149539960,6cyclictest0-21swapper/222:10:052
149539960,6cyclictest0-21swapper/219:55:212
149539960,5cyclictest28125-21ssh23:20:082
149459964,1cyclictest1560-21perf19:50:010
149459963,3cyclictest11736-21in:imuxsock21:03:240
149459963,2cyclictest7686-21ssh21:56:360
149459963,2cyclictest508-21dbus-daemon20:05:240
149459963,2cyclictest32556-21sh23:00:150
149459963,2cyclictest30654-21snmpd19:31:380
149459963,2cyclictest28971-21awk23:20:150
149459963,2cyclictest26469-21cat22:55:210
149459963,2cyclictest20355-21date19:20:000
149459963,2cyclictest15667-21apt-get21:40:130
149459963,2cyclictest11736-21in:imuxsock21:00:010
149459963,2cyclictest10452-21cron20:10:000
149459962,3cyclictest7308-21hddtemp_smartct00:15:160
149459962,3cyclictest30654-21snmpd22:00:170
149459962,3cyclictest30654-21snmpd21:06:400
149459962,3cyclictest30654-21snmpd20:31:180
149459962,3cyclictest30654-21snmpd19:57:120
149459962,3cyclictest2564-21wc19:50:180
149459962,3cyclictest23385-21smartctl19:25:160
149459962,3cyclictest21240-21cat19:20:140
149459962,3cyclictest19982-21systemd-journal22:27:250
149459962,3cyclictest17879-21cut20:25:140
149459962,3cyclictest14593-21sh00:20:260
149459962,3cyclictest0-21swapper/022:36:080
149459962,3cyclictest0-21swapper/021:10:040
149459962,3cyclictest0-21swapper/000:11:030
149459962,1cyclictest0-21swapper/022:51:040
149459962,1cyclictest0-21swapper/022:09:270
149459962,1cyclictest0-21swapper/021:25:200
149459961,3cyclictest19982-21systemd-journal21:15:030
149459961,2cyclictest19590-21rm00:00:030
149459960,6cyclictest0-21swapper/022:42:430
149459960,5cyclictest23830-21apt20:40:000
149459960,4cyclictest19982-21systemd-journal19:43:420
149459960,3cyclictest31733-21rm00:36:080
149459960,3cyclictest29200-21turbostat19:40:000
149459960,2cyclictest29956-21/usr/sbin/munin21:50:230
149539952,2cyclictest20507-21needreboot20:30:172
149539952,2cyclictest11067-21expr20:10:132
149539951,3cyclictest30654-21snmpd20:15:122
149459952,2cyclictest6297-21cpu20:00:140
149459952,2cyclictest28832-21expr20:50:140
149459952,2cyclictest15340-21cut20:20:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional