You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 17:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack1slot1.osadl.org (updated Mon Dec 01, 2025 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
60052228157,23sleep30-21swapper/307:07:073
53122208157,24sleep00-21swapper/007:05:310
59622201160,27sleep20-21swapper/207:06:342
60082200161,26sleep10-21swapper/107:07:081
93152160,1sleep1631699cyclictest10:50:291
631099160,15cyclictest0-21swapper/012:10:190
6310991412,1cyclictest9-21ksoftirqd/008:00:010
37952140,0sleep121-21ksoftirqd/110:45:011
6310991310,1cyclictest9-21ksoftirqd/010:00:010
6310991210,1cyclictest9-21ksoftirqd/007:50:010
6330991110,1cyclictest35-21ksoftirqd/307:55:013
632399119,1cyclictest28-21ksoftirqd/207:25:002
6323991111,0cyclictest0-21swapper/211:46:042
6310991110,1cyclictest9-21ksoftirqd/010:10:010
633099100,6cyclictest0-21swapper/311:30:123
631099108,1cyclictest0-21swapper/009:05:000
631099102,7cyclictest26552-21ssh12:00:180
63169998,1cyclictest21-21ksoftirqd/108:50:111
63169990,8cyclictest0-21swapper/108:45:231
63109998,1cyclictest9-21ksoftirqd/012:35:000
63109998,1cyclictest9-21ksoftirqd/010:30:000
63109998,1cyclictest9-21ksoftirqd/009:20:000
63109996,2cyclictest21474-21perf11:55:010
27699290,1sleep10-21swapper/112:02:081
20839297,1sleep09-21ksoftirqd/010:22:180
63309982,3cyclictest6538-21sh09:20:023
63309981,2cyclictest0-21swapper/311:00:343
63309980,4cyclictest30087-21df09:50:133
63239988,0cyclictest0-21swapper/210:14:262
63239987,1cyclictest28-21ksoftirqd/211:42:252
63239987,1cyclictest28-21ksoftirqd/207:40:002
63239986,1cyclictest60950irq/123-eno111:20:212
63239986,1cyclictest60950irq/123-eno110:55:232
63239986,1cyclictest60950irq/123-eno110:35:152
63239986,1cyclictest60950irq/123-eno110:34:312
63239984,3cyclictest8671-21munin-node10:19:432
63239984,2cyclictest254-21systemd-journal10:05:202
63239983,2cyclictest254-21systemd-journal09:35:052
63239980,5cyclictest22109-21apt-get09:40:122
63169988,0cyclictest21-21ksoftirqd/112:31:191
63169988,0cyclictest21-21ksoftirqd/111:52:031
63169988,0cyclictest21-21ksoftirqd/111:42:491
63169988,0cyclictest21-21ksoftirqd/111:31:051
63169988,0cyclictest21-21ksoftirqd/111:20:131
63169988,0cyclictest21-21ksoftirqd/110:45:151
63169988,0cyclictest21-21ksoftirqd/110:34:421
63169988,0cyclictest21-21ksoftirqd/110:28:031
63169988,0cyclictest21-21ksoftirqd/110:19:251
63169988,0cyclictest21-21ksoftirqd/110:04:231
63169988,0cyclictest21-21ksoftirqd/110:04:231
63169988,0cyclictest21-21ksoftirqd/109:11:501
63169988,0cyclictest21-21ksoftirqd/108:35:151
63169987,1cyclictest21-21ksoftirqd/109:15:261
63169987,1cyclictest21-21ksoftirqd/107:20:131
63169986,2cyclictest111rcu_preempt08:10:191
63169980,8cyclictest0-21swapper/112:10:201
63169980,8cyclictest0-21swapper/111:04:501
63109983,2cyclictest254-21systemd-journal09:26:490
63109983,2cyclictest10825-21apt-get11:40:140
63109982,5cyclictest742-21runrttasks10:55:160
63109981,3cyclictest32285-21sed11:25:000
63109980,7cyclictest9829-21ssh10:52:070
63109980,7cyclictest24436-21sh11:12:590
63109980,7cyclictest2417-21ssh11:27:000
63109980,7cyclictest2416-21ssh10:41:100
63109980,7cyclictest21441-21ssh09:38:590
63109980,7cyclictest2013-21ssh09:13:110
63109980,5cyclictest8677-21kworker/0:107:30:140
63109980,2cyclictest12267-21ssh10:10:170
63109980,1cyclictest254-21systemd-journal10:19:590
17840280,1sleep217842-21cut12:34:592
63309976,1cyclictest31451-21diskmemload12:04:263
63309975,1cyclictest35-21ksoftirqd/308:35:003
63309972,2cyclictest31451-21diskmemload09:45:153
63309971,5cyclictest31451-21diskmemload10:32:273
63309971,4cyclictest924-21latency_hist08:05:003
63309971,2cyclictest12598-21users12:25:223
63309970,6cyclictest2373-21ssh11:26:523
63309970,4cyclictest31451-21diskmemload10:00:123
63309970,4cyclictest31451-21diskmemload10:00:123
63309970,4cyclictest0-21swapper/309:25:123
63309970,3cyclictest0-21swapper/312:06:033
63309970,3cyclictest0-21swapper/311:39:333
63309970,3cyclictest0-21swapper/310:49:503
63239976,1cyclictest60950irq/123-eno112:20:202
63239976,1cyclictest60950irq/123-eno111:55:142
63239976,1cyclictest60950irq/123-eno111:50:002
63239976,1cyclictest60950irq/123-eno111:13:222
63239976,1cyclictest60950irq/123-eno110:40:012
63239976,1cyclictest60950irq/123-eno110:20:132
63239976,1cyclictest60950irq/123-eno109:30:112
63239976,1cyclictest60950irq/123-eno109:26:152
63239976,1cyclictest60950irq/123-eno108:15:122
63239976,1cyclictest22992-21grep08:50:152
63239976,0cyclictest60950irq/123-eno110:01:182
63239976,0cyclictest60950irq/123-eno110:01:182
63239975,1cyclictest60950irq/123-eno112:10:192
63239975,1cyclictest60950irq/123-eno109:20:012
63239973,2cyclictest60950irq/123-eno111:17:022
63239972,2cyclictest254-21systemd-journal11:25:532
63239970,6cyclictest556-21rs:main2
63239970,6cyclictest0-21swapper/209:47:332
63239970,4cyclictest546-21irqbalance11:04:362
63169977,0cyclictest21-21ksoftirqd/111:39:081
63169977,0cyclictest21-21ksoftirqd/111:09:231
63169977,0cyclictest21-21ksoftirqd/110:24:261
63169977,0cyclictest21-21ksoftirqd/110:08:551
63169977,0cyclictest21-21ksoftirqd/109:43:051
63169977,0cyclictest21-21ksoftirqd/109:30:121
63169977,0cyclictest21-21ksoftirqd/109:23:021
63169976,1cyclictest21-21ksoftirqd/107:15:141
63169974,3cyclictest0-21swapper/108:15:211
63169970,7cyclictest0-21swapper/112:20:181
63169970,7cyclictest0-21swapper/110:57:441
63169970,7cyclictest0-21swapper/107:14:521
63169970,3cyclictest0-21swapper/112:25:211
63169970,0cyclictest0-21swapper/110:36:121
63109976,1cyclictest20754-21cat08:45:180
63109975,1cyclictest15586-21cat11:00:180
63109974,1cyclictest254-21systemd-journal09:00:000
63109973,3cyclictest31465-21ssh09:50:420
63109973,2cyclictest254-21systemd-journal08:25:000
63109972,2cyclictest254-21systemd-journal10:30:360
63109971,6cyclictest28326-1kworker/u9:010:35:550
63109971,5cyclictest3892-21ssh10:45:070
63109971,5cyclictest22637-21ssh09:40:140
63109971,1cyclictest27349-21ssh11:15:560
63109970,6cyclictest9049-21ssh09:20:570
63109970,6cyclictest5306-21ssh12:15:230
63109970,6cyclictest31451-21diskmemload12:20:120
63109970,6cyclictest279602sleep009:45:440
63109970,6cyclictest16317-21ssh11:45:520
63109970,6cyclictest16127-21sed09:30:210
63109970,6cyclictest10224-1kworker/u9:012:26:050
63109970,6cyclictest0-21swapper/012:35:000
63109970,6cyclictest0-21swapper/011:35:120
63109970,6cyclictest0-21swapper/011:30:060
63109970,6cyclictest0-21swapper/007:44:350
63109970,1cyclictest6167-21ssh10:00:440
63109970,1cyclictest6167-21ssh10:00:440
63109970,1cyclictest31451-21diskmemload11:55:180
63109970,1cyclictest30885-21ssh12:06:020
63109970,1cyclictest0-21swapper/007:50:210
63309966,0cyclictest0-21swapper/311:45:533
63309965,1cyclictest9626-21ssh10:51:283
63309965,1cyclictest30059-21ssh10:35:183
63309965,1cyclictest25151-21sensors07:45:203
63309965,1cyclictest23703-21ssh11:10:393
63309965,1cyclictest20110-21ssh11:50:553
63309965,1cyclictest15194-21cat07:25:163
63309965,1cyclictest13186-21ssh11:42:143
63309965,1cyclictest1301-21cat10:40:203
63309965,1cyclictest10166-21ssh12:23:503
63309964,1cyclictest8629-21munin-setwarn07:15:003
63309964,1cyclictest558-21dbus-daemon12:15:203
63309964,1cyclictest24521-21sshd09:42:063
63309964,1cyclictest15027-21head10:15:133
63309963,1cyclictest254-21systemd-journal11:06:223
63309963,0cyclictest31451-21diskmemload09:16:223
63309962,3cyclictest31451-21diskmemload09:35:123
63309962,0cyclictest31451-21diskmemload10:05:143
63309962,0cyclictest10428-21apt-get08:25:123
63309961,3cyclictest0-21swapper/310:14:263
63309961,3cyclictest0-21swapper/308:45:163
63309961,1cyclictest980-21unixbench_singl09:10:213
63309961,1cyclictest689-21sh09:55:043
63309960,4cyclictest31451-21diskmemload11:20:013
63309960,4cyclictest0-21swapper/312:11:493
63309960,4cyclictest0-21swapper/311:55:403
63309960,3cyclictest31451-21diskmemload10:25:173
63309960,3cyclictest0-21swapper/310:59:453
63309960,3cyclictest0-21swapper/310:24:323
63309960,2cyclictest19632-21timerandwakeup12:35:203
63309960,0cyclictest0-21swapper/312:31:313
63239966,0cyclictest60950irq/123-eno112:35:032
63239966,0cyclictest60950irq/123-eno112:16:222
63239966,0cyclictest60950irq/123-eno112:00:172
63239966,0cyclictest60950irq/123-eno109:15:122
63239966,0cyclictest60950irq/123-eno109:10:182
63239966,0cyclictest60950irq/123-eno108:46:172
63239966,0cyclictest60950irq/123-eno108:14:232
63239966,0cyclictest60950irq/123-eno108:07:032
63239966,0cyclictest60950irq/123-eno108:03:382
63239966,0cyclictest60950irq/123-eno107:52:292
63239966,0cyclictest60950irq/123-eno107:31:032
63239966,0cyclictest60950irq/123-eno107:18:542
63239965,1cyclictest60950irq/123-eno111:05:202
63239965,1cyclictest60950irq/123-eno109:50:122
63239965,1cyclictest60950irq/123-eno108:30:172
63239965,1cyclictest60950irq/123-eno107:55:222
63239965,1cyclictest2574-21ssh09:55:292
63239965,0cyclictest28-21ksoftirqd/212:05:132
63239964,1cyclictest60950irq/123-eno112:27:122
63239964,1cyclictest60950irq/123-eno111:35:152
63239964,1cyclictest60950irq/123-eno111:30:102
63239964,1cyclictest60950irq/123-eno109:05:202
63239964,1cyclictest60950irq/123-eno107:25:212
63239963,1cyclictest8593-21forks08:20:152
63239963,1cyclictest254-21systemd-journal08:40:002
63239962,2cyclictest254-21systemd-journal08:29:172
63239960,6cyclictest0-21swapper/207:48:262
63239960,3cyclictest0-21swapper/210:25:192
63239960,0cyclictest0-21swapper/210:50:212
63169966,0cyclictest21-21ksoftirqd/112:05:501
63169966,0cyclictest21-21ksoftirqd/111:55:111
63169966,0cyclictest21-21ksoftirqd/110:12:561
63169965,1cyclictest21-21ksoftirqd/112:15:201
63169965,1cyclictest21-21ksoftirqd/107:30:151
63169965,0cyclictest0-21swapper/109:05:141
63169961,3cyclictest21-21ksoftirqd/111:15:181
63169961,2cyclictest0-21swapper/107:50:151
63169960,6cyclictest0-21swapper/107:45:181
63169960,3cyclictest0-21swapper/109:50:141
63169960,2cyclictest0-21swapper/112:35:201
63169960,2cyclictest0-21swapper/111:11:271
63169960,1cyclictest0-21swapper/109:25:121
63109965,1cyclictest9-21ksoftirqd/008:52:050
63109965,1cyclictest9-21ksoftirqd/007:35:010
63109965,1cyclictest0-21swapper/008:05:200
63109963,2cyclictest11227-21tail08:25:140
63109963,1cyclictest254-21systemd-journal07:14:440
63109960,6cyclictest0-21swapper/008:14:370
63109960,6cyclictest0-21swapper/007:23:010
63109960,5cyclictest0-21swapper/007:25:130
63109960,3cyclictest0-21swapper/008:00:130
63109960,0cyclictest0-21swapper/011:07:350
63109960,0cyclictest0-21swapper/009:05:540
63109960,0cyclictest0-21swapper/008:42:180
63109960,0cyclictest0-21swapper/008:38:530
63109960,0cyclictest0-21swapper/008:30:120
63109960,0cyclictest0-21swapper/008:16:500
63109960,0cyclictest0-21swapper/007:18:200
17055260,0sleep30-21swapper/309:32:173
63309955,0cyclictest0-21swapper/308:15:033
63309954,1cyclictest23377-21ntpq08:50:173
63309954,1cyclictest17015-21taskset08:36:593
63309953,2cyclictest8671-21munin-node08:05:423
63309953,1cyclictest11914-21cat07:20:003
63309952,2cyclictest19022-21cat08:40:213
63309952,1cyclictest0-21swapper/311:20:003
63309951,1cyclictest0-21swapper/307:35:173
63309950,4cyclictest0-21swapper/307:55:143
63309950,3cyclictest0-21swapper/309:05:183
63309950,1cyclictest5457-21grep08:15:003
63239955,0cyclictest60950irq/123-eno110:45:022
63239955,0cyclictest60950irq/123-eno108:55:522
63239955,0cyclictest60950irq/123-eno108:41:182
63239953,1cyclictest28-21ksoftirqd/209:00:042
63169955,0cyclictest211ksoftirqd/108:20:141
63169955,0cyclictest21-21ksoftirqd/111:45:121
63169955,0cyclictest21-21ksoftirqd/109:35:111
63169955,0cyclictest21-21ksoftirqd/107:39:561
63169955,0cyclictest111rcu_preempt11:25:161
63169955,0cyclictest0-21swapper/108:30:191
63169954,1cyclictest21-21ksoftirqd/107:55:161
63169951,3cyclictest56-21kworker/1:109:02:071
63169951,2cyclictest0-21swapper/109:55:401
63169950,5cyclictest0-21swapper/108:57:101
63169950,5cyclictest0-21swapper/108:04:511
63169950,5cyclictest0-21swapper/107:25:171
63169950,4cyclictest0-21swapper/108:05:201
63169950,3cyclictest0-21swapper/107:40:201
63169950,2cyclictest0-21swapper/109:45:131
63169950,2cyclictest0-21swapper/108:40:101
63309942,1cyclictest22037-21fschecks_time07:40:143
63309942,1cyclictest17486-21wc07:30:163
63309942,1cyclictest13631-21grep07:20:203
63309941,1cyclictest24586-21apt-get08:55:123
63309940,3cyclictest26963-21apt-get09:00:113
63309940,1cyclictest254-21systemd-journal08:20:003
63239944,0cyclictest60950irq/123-eno107:40:082
63169940,4cyclictest0-21swapper/108:25:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional