You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 23:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Sun Nov 30, 2025 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
130842210158,26sleep00-21swapper/007:09:360
128062205165,27sleep20-21swapper/207:06:002
129592200161,26sleep10-21swapper/107:08:011
129492200161,24sleep30-21swapper/307:07:553
101212680,1sleep010126-21cut09:15:150
13197991513,1cyclictest9-21ksoftirqd/008:05:000
13197991411,1cyclictest17906-21/usr/sbin/munin12:25:150
13218991311,1cyclictest35-21ksoftirqd/311:50:003
13197991211,1cyclictest9-21ksoftirqd/011:35:010
1321099119,1cyclictest28-21ksoftirqd/208:35:012
13210991110,1cyclictest28-21ksoftirqd/211:10:002
1319799119,1cyclictest9-21ksoftirqd/012:05:150
1319799113,4cyclictest10495-21date10:45:010
1319799113,4cyclictest0-21swapper/012:19:590
13197991110,1cyclictest9-21ksoftirqd/011:45:160
13197991110,1cyclictest9-21ksoftirqd/010:55:010
13197991110,1cyclictest9-21ksoftirqd/010:39:500
13197991110,1cyclictest9-21ksoftirqd/010:25:010
1321899108,1cyclictest35-21ksoftirqd/309:36:063
1321099100,10cyclictest0-21swapper/209:28:202
1319799109,1cyclictest9-21ksoftirqd/010:45:130
1319799109,1cyclictest9-21ksoftirqd/010:10:160
1319799109,1cyclictest9-21ksoftirqd/010:10:150
1319799109,1cyclictest9-21ksoftirqd/010:05:180
1319799109,1cyclictest9-21ksoftirqd/009:50:120
1319799109,1cyclictest9-21ksoftirqd/009:25:010
1319799109,1cyclictest9-21ksoftirqd/007:25:000
1319799108,1cyclictest9-21ksoftirqd/010:25:130
1319799103,2cyclictest25688-21basename07:34:590
1319799102,4cyclictest17590-21perf11:39:590
132189997,1cyclictest5923-21diskmemload11:33:023
132109997,1cyclictest28-21ksoftirqd/210:12:292
132109997,1cyclictest28-21ksoftirqd/210:12:292
132109990,3cyclictest0-21swapper/209:58:252
132109990,1cyclictest0-21swapper/208:05:152
131979999,0cyclictest9-21ksoftirqd/010:00:230
131979998,1cyclictest9-21ksoftirqd/012:30:170
131979997,1cyclictest26150-21head09:35:190
131979991,5cyclictest0-21swapper/007:20:010
31032280,0sleep30-21swapper/310:27:323
17212280,0sleep30-21swapper/310:09:353
132189987,1cyclictest35-21ksoftirqd/311:00:223
132189987,1cyclictest35-21ksoftirqd/310:00:483
132189987,1cyclictest35-21ksoftirqd/309:50:013
132189987,1cyclictest35-21ksoftirqd/309:50:003
132189987,1cyclictest0-21swapper/310:30:053
132189982,3cyclictest5923-21diskmemload12:31:593
132189982,2cyclictest6778-21apt-get12:10:143
132189982,2cyclictest0-21swapper/308:10:123
132189981,5cyclictest15593-21munin-node10:55:113
132189980,5cyclictest16458-21apt-get07:15:143
132109987,0cyclictest0-21swapper/209:33:382
132109986,1cyclictest60950irq/123-eno112:30:162
132109986,1cyclictest60950irq/123-eno111:45:142
132109986,1cyclictest60950irq/123-eno110:55:122
132109986,1cyclictest60950irq/123-eno110:25:002
132109985,2cyclictest1387-21tail12:00:222
132109984,2cyclictest254-21systemd-journal11:54:272
132109980,6cyclictest1738-21users11:15:242
132109980,1cyclictest254-21systemd-journal07:30:012
132039988,0cyclictest0-21swapper/112:03:511
131979988,0cyclictest9-21ksoftirqd/011:55:160
131979988,0cyclictest9-21ksoftirqd/011:55:150
131979988,0cyclictest9-21ksoftirqd/011:05:130
131979988,0cyclictest9-21ksoftirqd/009:45:160
131979988,0cyclictest9-21ksoftirqd/009:45:150
131979987,1cyclictest9-21ksoftirqd/011:40:160
131979987,1cyclictest9-21ksoftirqd/010:30:170
131979987,1cyclictest9-21ksoftirqd/008:30:130
131979986,1cyclictest9-21ksoftirqd/007:44:590
131979980,8cyclictest0-21swapper/009:40:140
131979980,7cyclictest8564-21ssh09:12:260
131979980,7cyclictest8168-21mailstats12:10:210
131979980,7cyclictest26291-21ssh12:35:320
131979980,7cyclictest1769-21ssh11:15:270
131979980,7cyclictest16708-21ssh12:23:510
24676270,0sleep10-21swapper/112:35:151
132189977,0cyclictest35-21ksoftirqd/312:29:073
132189976,1cyclictest35-21ksoftirqd/309:25:133
132189975,1cyclictest8554-21cat08:05:173
132189975,1cyclictest4288-21missed_timers12:05:173
132189975,1cyclictest31525-21cat07:45:163
132189975,1cyclictest27926-21ssh10:23:563
132189975,1cyclictest25364-21cat12:35:173
132189975,1cyclictest19996-21ntp_offset07:20:233
132189975,1cyclictest10454-21sh10:45:003
132189975,0cyclictest5923-21diskmemload09:33:173
132189974,2cyclictest35-21ksoftirqd/310:46:483
132189974,1cyclictest13403-21/usr/sbin/munin07:10:193
132189972,2cyclictest254-21systemd-journal09:45:013
132189971,1cyclictest0-21swapper/311:06:413
132189970,3cyclictest0-21swapper/311:55:023
132189970,3cyclictest0-21swapper/311:55:013
132109976,1cyclictest60950irq/123-eno112:25:172
132109976,1cyclictest60950irq/123-eno112:13:262
132109976,1cyclictest60950irq/123-eno111:57:412
132109976,1cyclictest60950irq/123-eno111:57:412
132109976,1cyclictest60950irq/123-eno111:41:342
132109976,1cyclictest60950irq/123-eno111:31:522
132109976,1cyclictest60950irq/123-eno111:25:192
132109976,1cyclictest60950irq/123-eno111:12:012
132109976,1cyclictest60950irq/123-eno111:00:142
132109976,1cyclictest60950irq/123-eno110:40:012
132109976,1cyclictest60950irq/123-eno110:39:542
132109976,1cyclictest60950irq/123-eno110:33:402
132109976,1cyclictest60950irq/123-eno110:19:532
132109976,1cyclictest60950irq/123-eno110:05:222
132109976,1cyclictest60950irq/123-eno109:45:122
132109976,1cyclictest60950irq/123-eno109:45:112
132109976,1cyclictest60950irq/123-eno109:22:262
132109975,1cyclictest60950irq/123-eno110:45:162
132109975,1cyclictest60950irq/123-eno109:35:152
132109975,1cyclictest60950irq/123-eno108:10:142
132109975,1cyclictest10246-21ssh12:15:042
132109972,4cyclictest3235-21apt-get12:05:132
132109972,4cyclictest15203-21sendmail_mailqu12:20:192
132109970,5cyclictest18840-21apt-get07:20:172
132109970,0cyclictest0-21swapper/210:51:472
132039970,4cyclictest0-21swapper/110:42:381
131979977,0cyclictest5923-21diskmemload11:53:300
131979976,1cyclictest9-21ksoftirqd/011:25:160
131979976,1cyclictest9-21ksoftirqd/010:55:130
131979976,1cyclictest15593-21munin-node08:40:120
131979975,1cyclictest9-21ksoftirqd/008:20:140
131979975,1cyclictest5923-21diskmemload11:21:470
131979975,1cyclictest12140-21/usr/sbin/munin08:15:010
131979973,4cyclictest29054-21cpuspeed_turbos11:10:150
131979973,2cyclictest254-21systemd-journal07:55:000
131979972,1cyclictest0-21swapper/008:29:560
131979970,7cyclictest862-21ntpq12:00:190
131979970,6cyclictest9174-21ssh09:56:540
131979970,6cyclictest29575-21cstates08:50:130
131979970,6cyclictest23895-21ssh11:02:000
131979970,6cyclictest21581-21cstates10:15:120
131979970,6cyclictest0-21swapper/008:19:340
131979970,6cyclictest0-21swapper/007:10:180
131979970,5cyclictest21119-21apt-get09:30:120
131979970,1cyclictest0-21swapper/009:26:540
20036260,0sleep10-21swapper/110:56:221
132189966,0cyclictest5923-21diskmemload11:20:083
132189965,1cyclictest26883-21ssh11:51:053
132189965,1cyclictest2386-21ssh11:17:183
132189964,1cyclictest8019-21cat11:25:163
132189964,0cyclictest5923-21diskmemload10:53:303
132189963,2cyclictest5923-21diskmemload11:13:303
132189963,1cyclictest570-21systemd-logind09:10:203
132189963,1cyclictest35-21ksoftirqd/307:28:223
132189962,1cyclictest16314-21taskset11:36:163
132189961,3cyclictest5923-21diskmemload10:35:433
132189961,3cyclictest24912-21df08:40:153
132189961,3cyclictest0-21swapper/309:50:113
132189960,5cyclictest0-21swapper/312:20:083
132189960,4cyclictest30036-21uname08:50:153
132189960,4cyclictest19746-21diskmemload11:40:463
132189960,3cyclictest0-21swapper/312:02:143
132189960,3cyclictest0-21swapper/310:18:483
132189960,2cyclictest0-21swapper/309:55:393
132189960,2cyclictest0-21swapper/309:15:013
132189960,1cyclictest742-21runrttasks09:20:133
132189960,1cyclictest254-21systemd-journal08:17:533
132189960,1cyclictest12530-21sh12:16:503
132109966,0cyclictest60950irq/123-eno110:25:442
132109966,0cyclictest60950irq/123-eno110:00:232
132109966,0cyclictest60950irq/123-eno109:08:122
132109966,0cyclictest60950irq/123-eno109:02:362
132109966,0cyclictest60950irq/123-eno108:42:412
132109966,0cyclictest60950irq/123-eno108:25:202
132109966,0cyclictest60950irq/123-eno108:20:132
132109966,0cyclictest60950irq/123-eno108:00:122
132109966,0cyclictest60950irq/123-eno107:45:122
132109966,0cyclictest60950irq/123-eno107:35:162
132109966,0cyclictest60950irq/123-eno107:32:412
132109966,0cyclictest60950irq/123-eno107:15:202
132109966,0cyclictest60950irq/123-eno107:10:272
132109966,0cyclictest23435-21sensors08:35:202
132109965,1cyclictest60950irq/123-eno111:35:122
132109965,1cyclictest60950irq/123-eno109:10:142
132109965,1cyclictest60950irq/123-eno108:50:142
132109965,1cyclictest30444-21ssh09:40:222
132109964,1cyclictest60950irq/123-eno111:20:132
132109964,1cyclictest60950irq/123-eno107:55:182
132109964,1cyclictest28-21ksoftirqd/208:20:002
132109963,1cyclictest60950irq/123-eno107:40:202
132109963,1cyclictest3896-21diskstats09:50:142
132109961,3cyclictest5923-21diskmemload12:35:132
132109960,2cyclictest9828-21apt-get09:15:142
132039963,1cyclictest19454-21chrt12:26:181
132039963,0cyclictest0-21swapper/110:05:221
132039962,2cyclictest0-21swapper/111:57:311
132039962,2cyclictest0-21swapper/111:57:301
132039961,3cyclictest0-21swapper/111:48:381
132039961,2cyclictest0-21swapper/110:38:491
132039961,1cyclictest0-21swapper/109:05:131
132039960,6cyclictest0-21swapper/112:11:431
132039960,6cyclictest0-21swapper/111:19:251
132039960,4cyclictest0-21swapper/112:30:111
132039960,4cyclictest0-21swapper/111:51:501
132039960,4cyclictest0-21swapper/111:24:091
132039960,4cyclictest0-21swapper/109:55:061
132039960,3cyclictest0-21swapper/111:35:491
132039960,3cyclictest0-21swapper/111:30:201
132039960,3cyclictest0-21swapper/110:50:231
132039960,3cyclictest0-21swapper/109:50:121
132039960,2cyclictest0-21swapper/111:27:201
132039960,2cyclictest0-21swapper/110:29:591
132039960,2cyclictest0-21swapper/109:00:001
131979965,1cyclictest9-21ksoftirqd/008:35:140
131979964,1cyclictest9-21ksoftirqd/009:05:210
131979960,6cyclictest0-21swapper/008:45:380
131979960,6cyclictest0-21swapper/007:55:550
131979960,5cyclictest7657-21/usr/sbin/munin08:05:160
131979960,0cyclictest25905-21/usr/sbin/munin07:35:150
131979960,0cyclictest0-21swapper/007:25:070
132189955,0cyclictest0-21swapper/307:34:583
132189953,1cyclictest4088-21ntp_states07:55:193
132189953,1cyclictest31477-21apt-get08:55:133
132189953,1cyclictest17322-21sshd08:25:133
132189952,1cyclictest4437-21fschecks_time09:05:163
132189952,1cyclictest29649-21mailstats07:40:213
132189951,2cyclictest22438-21cstates08:35:143
132189950,5cyclictest0-21swapper/308:20:113
132189950,4cyclictest1663-21cpuspeed_turbos09:00:133
132189950,2cyclictest18747-21/usr/sbin/munin10:10:183
132189950,2cyclictest18747-21/usr/sbin/munin10:10:173
132109955,0cyclictest60950irq/123-eno107:50:112
132109950,1cyclictest0-21swapper/208:55:132
132109950,1cyclictest0-21swapper/208:45:132
132039955,0cyclictest0-21swapper/111:10:301
132039955,0cyclictest0-21swapper/111:05:141
132039955,0cyclictest0-21swapper/110:22:501
132039955,0cyclictest0-21swapper/108:35:141
132039955,0cyclictest0-21swapper/107:20:521
132039953,1cyclictest191742sleep109:25:261
132039951,3cyclictest0-21swapper/109:24:561
132039951,2cyclictest0-21swapper/112:22:451
132039951,2cyclictest0-21swapper/112:05:221
132039951,2cyclictest0-21swapper/109:11:211
132039951,2cyclictest0-21swapper/107:10:121
132039950,4cyclictest0-21swapper/110:49:481
132039950,4cyclictest0-21swapper/110:12:501
132039950,4cyclictest0-21swapper/110:12:491
132039950,4cyclictest0-21swapper/108:40:171
132039950,4cyclictest0-21swapper/107:51:251
132039950,2cyclictest0-21swapper/111:00:111
132039950,2cyclictest0-21swapper/110:30:101
132039950,2cyclictest0-21swapper/110:15:161
132039950,2cyclictest0-21swapper/110:03:111
132039950,2cyclictest0-21swapper/108:10:131
132039950,1cyclictest0-21swapper/109:40:111
132039950,0cyclictest0-21swapper/112:19:361
132039950,0cyclictest0-21swapper/108:46:261
132039950,0cyclictest0-21swapper/107:33:301
131979955,0cyclictest9-21ksoftirqd/009:00:130
131979950,5cyclictest0-21swapper/008:59:230
131979950,0cyclictest0-21swapper/007:48:070
132189942,1cyclictest742-21runrttasks07:50:013
132189942,1cyclictest26112-21cpu07:35:153
132189941,2cyclictest26767-21apt-get08:45:133
132189940,2cyclictest5303-21apt-get08:00:113
132189940,2cyclictest0-21swapper/308:30:113
132039944,0cyclictest0-21swapper/108:06:291
132039941,2cyclictest0-21swapper/108:50:181
132039940,4cyclictest4093-21chrt07:55:191
132039940,3cyclictest0-21swapper/109:35:061
132039940,3cyclictest0-21swapper/109:30:121
132039940,3cyclictest0-21swapper/109:16:131
132039940,3cyclictest0-21swapper/108:15:141
132039940,3cyclictest0-21swapper/108:00:171
132039940,3cyclictest0-21swapper/107:35:141
132039940,2cyclictest0-21swapper/111:40:141
132039940,2cyclictest0-21swapper/108:20:131
132039940,2cyclictest0-21swapper/107:40:171
132039940,2cyclictest0-21swapper/107:15:131
132039940,1cyclictest0-21swapper/109:45:141
132039940,1cyclictest0-21swapper/109:45:131
132039940,0cyclictest0-21swapper/107:45:201
132039931,1cyclictest0-21swapper/108:30:141
132039931,1cyclictest0-21swapper/107:25:141
132039930,2cyclictest0-21swapper/109:00:111
132039930,1cyclictest0-21swapper/108:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional