You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 23:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Mon Dec 01, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
43072316284,20sleep10-21swapper/107:07:241
43492269238,20sleep00-21swapper/007:07:550
44142265233,20sleep30-21swapper/307:08:463
41862264231,20sleep20-21swapper/207:05:482
90672630,0sleep00-21swapper/010:14:150
144892620,0sleep014490-21sendmail_mailqu12:00:180
76902600,0sleep00-21swapper/007:15:110
52132550,0sleep10-21swapper/111:26:431
112962540,0sleep20-21swapper/210:40:202
12792180,0sleep20-21swapper/211:49:552
6962160,0sleep00-21swapper/010:07:180
26752140,0sleep20-21swapper/210:33:512
461999138,4cyclictest12-21ksoftirqd/010:20:010
72922120,0sleep20-21swapper/210:12:202
462199119,1cyclictest22-21ksoftirqd/111:35:001
37692110,1sleep33774-21unixbench_multi11:25:213
462199108,1cyclictest22-21ksoftirqd/107:15:011
42792100,1sleep20-21swapper/211:00:172
42792100,1sleep20-21swapper/211:00:172
220062100,0sleep30-21swapper/310:48:373
46299994,3cyclictest19982-21systemd-journal10:01:253
46259995,3cyclictest508-21dbus-daemon09:10:002
46259994,3cyclictest19982-21systemd-journal08:04:112
46259993,3cyclictest2419-21apt12:15:002
46199997,1cyclictest121ksoftirqd/011:50:000
46199994,3cyclictest19982-21systemd-journal11:58:140
46299984,3cyclictest19982-21systemd-journal12:28:113
46299984,3cyclictest14106-21memory12:00:153
46299980,1cyclictest14871-21sh11:09:313
46259985,2cyclictest28-21ksoftirqd/212:20:002
46259984,3cyclictest19982-21systemd-journal11:14:112
46259984,3cyclictest19982-21systemd-journal10:05:012
46259983,3cyclictest19982-21systemd-journal12:21:132
46259983,3cyclictest19982-21systemd-journal08:59:142
46259983,3cyclictest19982-21systemd-journal07:28:432
46259982,3cyclictest25411-21ls07:55:002
46259980,4cyclictest19982-21systemd-journal12:35:002
46219984,3cyclictest6405-21cat09:20:151
46219983,3cyclictest19982-21systemd-journal09:50:081
46219982,3cyclictest32265-21munin-run12:35:001
46219982,3cyclictest2410-21munin-run12:15:011
46219982,3cyclictest10916-21apt-get08:35:001
46199985,2cyclictest11736-21in:imuxsock12:10:440
46199984,3cyclictest7051-21df_inode08:25:130
46199983,3cyclictest19982-21systemd-journal12:32:250
46199983,3cyclictest19982-21systemd-journal10:52:120
46199982,3cyclictest15330-21perf11:10:010
31324280,0sleep10-21swapper/109:40:201
16879280,0sleep10-21swapper/109:29:341
11522280,0sleep00-21swapper/011:31:310
46299976,1cyclictest51850irq/136-enp4s0-10:50:113
46299974,2cyclictest508-21dbus-daemon12:37:273
46299974,2cyclictest30654-21snmpd12:11:393
46299974,2cyclictest11078-21gunzip07:20:183
46299973,3cyclictest508-21dbus-daemon12:10:003
46299973,3cyclictest508-21dbus-daemon07:15:013
46299973,3cyclictest30904-21wc09:40:173
46299973,3cyclictest19982-21systemd-journal11:51:023
46299973,3cyclictest12598-21sshd10:16:043
46299973,1cyclictest0-21swapper/311:02:553
46299973,1cyclictest0-21swapper/311:02:553
46299973,1cyclictest0-21swapper/310:40:483
46299972,3cyclictest19982-21systemd-journal10:20:523
46299972,3cyclictest19982-21systemd-journal08:12:073
46299972,2cyclictest34-21ksoftirqd/307:50:003
46299970,5cyclictest19982-21systemd-journal10:55:543
46299970,1cyclictest30869-21ssh09:13:263
46259976,1cyclictest28-21ksoftirqd/210:10:012
46259976,1cyclictest28-21ksoftirqd/208:40:002
46259974,2cyclictest29741-11brltty12:05:192
46259974,2cyclictest28-21ksoftirqd/208:00:012
46259974,2cyclictest19982-21systemd-journal09:56:492
46259973,3cyclictest5203-21cron09:20:002
46259973,3cyclictest0-21swapper/209:22:372
46259973,1cyclictest0-21swapper/209:53:472
46259973,1cyclictest0-21swapper/209:36:332
46259972,3cyclictest19982-21systemd-journal10:51:012
46259972,3cyclictest19982-21systemd-journal09:29:582
46259971,4cyclictest19982-21systemd-journal11:25:172
46219976,1cyclictest22-21ksoftirqd/111:40:001
46219974,2cyclictest29878-21cron08:05:001
46219974,2cyclictest19119-21sshd10:20:491
46219974,2cyclictest1-21systemd11:44:021
46219974,2cyclictest11736-21in:imuxsock07:54:591
46219973,3cyclictest22-21ksoftirqd/112:15:001
46219973,3cyclictest19982-21systemd-journal11:17:461
46219973,3cyclictest19982-21systemd-journal08:15:001
46219973,2cyclictest19982-21systemd-journal08:55:371
46219973,2cyclictest19982-21systemd-journal08:53:241
46219973,1cyclictest0-21swapper/109:36:531
46219973,1cyclictest0-21swapper/109:31:231
46219972,4cyclictest22-21ksoftirqd/108:20:501
46219972,4cyclictest0-21swapper/110:29:221
46219972,3cyclictest7661-21lldpd08:25:061
46219972,3cyclictest19982-21systemd-journal10:10:041
46219972,2cyclictest25250-21perf12:30:001
46219971,1cyclictest141rcu_preempt07:30:131
46219970,4cyclictest27536-21expr09:10:121
46219970,1cyclictest141rcu_preempt08:35:151
46199976,1cyclictest12-21ksoftirqd/011:10:120
46199974,2cyclictest12-21ksoftirqd/009:30:000
46199973,3cyclictest508-21dbus-daemon11:44:520
46199973,3cyclictest508-21dbus-daemon10:38:320
46199973,3cyclictest4326-21df_inode09:45:150
46199973,3cyclictest30654-21snmpd07:48:140
46199973,3cyclictest30498-21tune2fs09:40:150
46199973,3cyclictest24031-21cat09:35:150
46199973,3cyclictest21505-21cat12:05:150
46199973,3cyclictest0-21swapper/011:28:220
46199973,3cyclictest0-21swapper/009:34:320
46199972,3cyclictest19982-21systemd-journal08:55:000
46199972,3cyclictest19982-21systemd-journal08:32:440
46199972,3cyclictest10304-21turbostat12:20:000
46199970,6cyclictest32144-21basename08:10:000
46199970,6cyclictest1626-21smartctl12:35:190
46199970,4cyclictest27727-21latency_hist11:20:010
46299966,0cyclictest0-21swapper/311:55:363
46299966,0cyclictest0-21swapper/309:20:323
46299963,2cyclictest508-21dbus-daemon08:25:023
46299963,2cyclictest34-21ksoftirqd/307:36:383
46299963,2cyclictest30654-21snmpd07:34:023
46299963,2cyclictest21608-21ssh11:15:033
46299963,2cyclictest20068-21taskset08:54:073
46299963,2cyclictest19982-21systemd-journal07:18:383
46299963,2cyclictest17627-21cat09:55:163
46299963,2cyclictest13469-21idleruntime-cro08:40:003
46299963,2cyclictest11736-21in:imuxsock09:50:573
46299963,2cyclictest11126-21cat12:20:123
46299963,1cyclictest0-21swapper/312:15:043
46299962,3cyclictest5117-21cat08:20:163
46299962,3cyclictest30654-21snmpd11:47:373
46299962,3cyclictest30654-21snmpd10:35:073
46299962,3cyclictest30654-21snmpd10:10:163
46299962,3cyclictest30654-21snmpd08:59:313
46299962,3cyclictest30654-21snmpd08:40:043
46299962,3cyclictest30343-21fw_packets10:05:173
46299962,3cyclictest2854-21cat08:15:163
46299962,3cyclictest28382-21cat11:20:123
46299962,3cyclictest24685-21ntpq10:25:183
46299962,3cyclictest15954-21cat11:35:143
46299962,3cyclictest10376-21unixbench_multi11:30:213
46299962,3cyclictest1010-21seq10:32:043
46299962,3cyclictest0-21swapper/309:45:183
46299962,1cyclictest0-21swapper/309:25:303
46299961,3cyclictest502-21systemd-logind09:32:113
46299961,3cyclictest19982-21systemd-journal09:04:153
46299961,3cyclictest19982-21systemd-journal07:41:133
46299961,1cyclictest25719-21apt-get12:30:123
46299960,6cyclictest0-21swapper/311:10:513
46299960,5cyclictest23023-21ntpq11:40:193
46299960,4cyclictest19982-21systemd-journal09:16:453
46299960,4cyclictest19982-21systemd-journal07:54:093
46299960,2cyclictest24054-21irqstats09:35:153
46259966,0cyclictest29741-11brltty11:32:472
46259966,0cyclictest0-21swapper/211:50:342
46259963,2cyclictest668-21runrttasks10:20:082
46259963,2cyclictest668-21runrttasks08:51:522
46259963,2cyclictest5600-21latency07:10:182
46259963,2cyclictest30762-21cut09:40:162
46259963,2cyclictest30654-21snmpd07:32:052
46259963,2cyclictest30139-21ssh11:20:372
46259963,2cyclictest24019-21ssh11:15:582
46259963,2cyclictest211912sleep207:45:132
46259963,2cyclictest18722-21fschecks_time12:25:152
46259963,2cyclictest17943-21sort09:30:132
46259963,2cyclictest13964-21cat12:00:142
46259962,3cyclictest9931-21cat11:05:152
46259962,3cyclictest5841-21cat08:20:212
46259962,3cyclictest5649-21cat10:35:212
46259962,3cyclictest4797-21cat09:45:192
46259962,3cyclictest30654-21snmpd08:43:402
46259962,3cyclictest30654-21snmpd07:18:352
46259962,3cyclictest19982-21systemd-journal08:09:102
46259962,3cyclictest16620-21cat08:45:182
46259962,3cyclictest10158-21cat10:15:122
46259962,1cyclictest0-21swapper/210:57:182
46259962,1cyclictest0-21swapper/209:12:592
46259961,4cyclictest0-21swapper/211:40:002
46259961,4cyclictest0-21swapper/210:25:542
46259961,2cyclictest16965-21ssh10:45:012
46259960,4cyclictest19982-21systemd-journal07:44:342
46259960,4cyclictest19982-21systemd-journal07:25:012
46259960,0cyclictest0-21swapper/212:35:122
46259960,0cyclictest0-21swapper/211:38:252
46259960,0cyclictest0-21swapper/209:00:072
46219965,1cyclictest22-21ksoftirqd/107:15:011
46219964,2cyclictest22-21ksoftirqd/110:35:511
46219963,2cyclictest52050irq/138-enp4s0-11:00:141
46219963,2cyclictest52050irq/138-enp4s0-11:00:141
46219963,2cyclictest4589-21if_enp4s009:45:171
46219963,2cyclictest31906-21rm11:22:271
46219963,2cyclictest30941-21ssh11:46:311
46219963,2cyclictest30654-21snmpd10:15:011
46219963,2cyclictest19016-21chrt10:45:351
46219963,2cyclictest18742-21awk07:40:001
46219963,2cyclictest13649-21df12:00:121
46219963,2cyclictest12321-21grep07:25:141
46219963,2cyclictest10066-21cat07:20:121
46219962,3cyclictest910-21sed12:35:141
46219962,3cyclictest7635-21cat11:55:101
46219962,3cyclictest30839-21cat10:30:181
46219962,3cyclictest30654-21snmpd11:50:301
46219962,3cyclictest30654-21snmpd08:41:371
46219962,3cyclictest30578-21cut08:05:181
46219962,3cyclictest27101-21sed07:55:221
46219962,3cyclictest24166-21tune2fs10:50:141
46219962,3cyclictest0-21swapper/112:06:091
46219962,3cyclictest0-21swapper/111:10:191
46219962,3cyclictest0-21swapper/109:55:021
46219962,3cyclictest0-21swapper/109:17:361
46219962,1cyclictest0-21swapper/112:21:071
46219962,1cyclictest0-21swapper/110:59:471
46219962,1cyclictest0-21swapper/110:40:221
46219962,1cyclictest0-21swapper/110:07:131
46219962,1cyclictest0-21swapper/110:01:031
46219960,2cyclictest23177-21munin-run07:50:011
46199965,1cyclictest12-21ksoftirqd/010:50:010
46199964,1cyclictest638-21irqstats08:10:150
46199964,1cyclictest12-21ksoftirqd/008:40:110
46199963,2cyclictest508-21dbus-daemon12:25:200
46199963,2cyclictest30654-21snmpd07:38:080
46199963,2cyclictest30654-21snmpd07:13:010
46199963,2cyclictest27356-21sshd07:56:370
46199963,2cyclictest2407-21sh09:16:130
46199963,2cyclictest12-21ksoftirqd/010:00:170
46199963,2cyclictest12-21ksoftirqd/009:20:130
46199963,2cyclictest11663-21chrt07:21:560
46199962,3cyclictest508-21dbus-daemon11:50:180
46199962,3cyclictest30654-21snmpd11:37:450
46199962,3cyclictest30654-21snmpd10:32:010
46199962,3cyclictest30654-21snmpd10:25:310
46199962,3cyclictest30654-21snmpd09:57:030
46199962,3cyclictest30654-21snmpd09:11:290
46199962,3cyclictest30654-21snmpd09:00:400
46199962,3cyclictest30654-21snmpd08:55:100
46199962,3cyclictest30654-21snmpd07:41:140
46199962,3cyclictest29099-21systemctl08:00:170
46199962,3cyclictest28545-21cat11:20:120
46199962,3cyclictest17321-21cat10:20:130
46199962,3cyclictest15481-21which07:30:200
46199962,3cyclictest0-21swapper/012:22:400
46199962,3cyclictest0-21swapper/010:43:380
46199961,3cyclictest19982-21systemd-journal08:35:270
46199961,3cyclictest19982-21systemd-journal07:25:130
46199960,6cyclictest0-21swapper/008:20:360
46199960,3cyclictest15927-21sshd08:45:080
46199960,2cyclictest30900-21ntp_states10:55:190
46199960,2cyclictest19982-21systemd-journal09:05:520
46199960,1cyclictest0-21swapper/011:01:310
46199960,1cyclictest0-21swapper/011:01:300
13376260,1sleep012-21ksoftirqd/009:51:240
46299953,1cyclictest25670-21apt-get07:55:143
46299952,2cyclictest30375-21seq08:05:173
46299952,2cyclictest28583-21cat08:00:133
46299952,2cyclictest12401-21expr07:25:143
46299951,3cyclictest15960-21/usr/sbin/munin08:45:153
46299951,2cyclictest19982-21systemd-journal09:05:013
46299950,3cyclictest19982-21systemd-journal08:30:023
46259953,1cyclictest30654-21snmpd07:35:112
46259952,2cyclictest8910-21chrt08:30:012
46259952,2cyclictest6844-21cut08:25:122
46259952,2cyclictest648-21cut08:10:152
46259952,2cyclictest2749-21gltestperf08:15:152
46259950,4cyclictest0-21swapper/211:55:032
46219952,2cyclictest2984-21wc08:15:171
46219952,2cyclictest19092-21ls07:40:121
46219951,3cyclictest25031-21cut09:05:151
46219950,3cyclictest9222-21sshd11:05:121
46219950,3cyclictest19982-21systemd-journal08:45:041
46219950,1cyclictest141rcu_preempt09:00:111
46199951,3cyclictest23842-21/usr/sbin/munin07:50:140
46199951,3cyclictest2166-21cat08:15:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional