You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 18:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Thu Nov 20, 2025 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
272092208159,24sleep30-21swapper/307:06:393
271812200161,26sleep20-21swapper/207:06:182
271902199160,26sleep10-21swapper/107:06:251
271642196158,25sleep00-21swapper/007:06:030
54992770,0sleep10-21swapper/109:31:361
310022570,0sleep20-21swapper/210:51:422
289182510,0sleep10-21swapper/107:10:171
157642160,0sleep10-21swapper/107:50:151
27564991410,0cyclictest21-21ksoftirqd/109:15:451
101782140,0sleep10-21swapper/109:39:121
27564991313,0cyclictest21-21ksoftirqd/112:24:121
27555991311,1cyclictest9-21ksoftirqd/011:00:000
2755599130,12cyclictest20465-21diskmemload09:25:110
302142120,0sleep10-21swapper/110:50:221
27580991211,1cyclictest35-21ksoftirqd/310:00:163
2756999120,12cyclictest0-21swapper/210:40:122
27564991212,0cyclictest21-21ksoftirqd/112:02:241
27555991210,1cyclictest9-21ksoftirqd/009:25:010
2758099119,1cyclictest35-21ksoftirqd/312:36:043
27580991110,1cyclictest35-21ksoftirqd/310:05:013
2756999119,1cyclictest28-21ksoftirqd/208:34:592
27564991111,0cyclictest21-21ksoftirqd/110:22:551
2756499110,7cyclictest0-21swapper/109:42:081
27555991110,1cyclictest9-21ksoftirqd/012:20:000
27555991110,1cyclictest9-21ksoftirqd/011:40:010
27555991110,1cyclictest9-21ksoftirqd/009:55:010
2755599110,10cyclictest0-21swapper/010:05:140
2758099109,1cyclictest35-21ksoftirqd/311:20:173
2758099108,1cyclictest35-21ksoftirqd/312:20:143
2756999109,1cyclictest3212-21ssh09:30:022
2756999109,1cyclictest28-21ksoftirqd/212:28:292
2756999100,10cyclictest0-21swapper/212:38:032
2756499108,2cyclictest0-21swapper/110:05:111
2756499107,2cyclictest0-21swapper/112:25:111
2756499103,6cyclictest21-21ksoftirqd/109:46:541
2756499102,8cyclictest21-21ksoftirqd/111:22:121
2756499101,5cyclictest201rcuc/107:55:131
2756499100,6cyclictest21-21ksoftirqd/110:12:121
2756499100,10cyclictest0-21swapper/110:30:301
268802100,0sleep320465-21diskmemload12:16:313
275809999,0cyclictest35-21ksoftirqd/312:35:003
275809999,0cyclictest35-21ksoftirqd/312:05:123
275809999,0cyclictest35-21ksoftirqd/309:35:163
275809999,0cyclictest35-21ksoftirqd/309:30:143
275809998,1cyclictest35-21ksoftirqd/311:15:003
275809998,1cyclictest35-21ksoftirqd/310:15:143
275809998,1cyclictest35-21ksoftirqd/309:00:003
275809997,2cyclictest30317-21sh09:21:303
275809993,4cyclictest10659-21/usr/sbin/munin10:25:173
275809993,2cyclictest25501-21grep10:45:123
275809990,7cyclictest21247-21kworker/u8:112:14:573
275699999,0cyclictest0-21swapper/211:46:512
275699996,1cyclictest28-21ksoftirqd/207:45:002
275699990,9cyclictest0-21swapper/209:38:242
275699990,8cyclictest20465-21diskmemload09:55:112
275699990,5cyclictest254-21systemd-journal07:15:012
275699990,0cyclictest0-21swapper/209:10:182
275649999,0cyclictest21-21ksoftirqd/112:37:061
275649999,0cyclictest21-21ksoftirqd/111:56:011
275649999,0cyclictest21-21ksoftirqd/111:36:461
275649999,0cyclictest21-21ksoftirqd/111:25:011
275649999,0cyclictest21-21ksoftirqd/111:25:011
275649999,0cyclictest21-21ksoftirqd/111:05:501
275649999,0cyclictest21-21ksoftirqd/111:04:211
275649999,0cyclictest21-21ksoftirqd/110:42:171
275649999,0cyclictest21-21ksoftirqd/109:20:161
275649998,1cyclictest21-21ksoftirqd/111:10:231
275649998,1cyclictest21-21ksoftirqd/110:35:351
275649998,0cyclictest21-21ksoftirqd/112:30:061
275649998,0cyclictest21-21ksoftirqd/110:19:011
275649998,0cyclictest21-21ksoftirqd/110:04:521
275649998,0cyclictest21-21ksoftirqd/109:27:181
275649997,1cyclictest111rcu_preempt08:50:221
275649997,1cyclictest111rcu_preempt08:15:171
275649997,1cyclictest0-21swapper/107:30:201
275649996,2cyclictest13456-21chrt10:28:311
275649994,4cyclictest21-21ksoftirqd/111:40:161
275649993,4cyclictest111rcu_preempt11:34:331
275649991,8cyclictest111rcu_preempt12:13:291
275649990,8cyclictest21-21ksoftirqd/112:05:141
275649990,8cyclictest21-21ksoftirqd/109:55:181
275649990,8cyclictest0-21swapper/111:50:201
275649990,8cyclictest0-21swapper/111:46:041
275649990,8cyclictest0-21swapper/110:57:031
275649990,8cyclictest0-21swapper/108:41:431
275649990,1cyclictest21-21ksoftirqd/108:45:161
275559998,1cyclictest9-21ksoftirqd/012:29:590
275559998,1cyclictest9-21ksoftirqd/012:00:000
275559998,1cyclictest9-21ksoftirqd/009:56:200
275559997,1cyclictest9-21ksoftirqd/011:30:160
275559993,5cyclictest469-21latency_hist07:20:000
275559993,1cyclictest20465-21diskmemload09:36:160
275809988,0cyclictest35-21ksoftirqd/311:00:183
275809988,0cyclictest35-21ksoftirqd/309:15:113
275809988,0cyclictest35-21ksoftirqd/308:35:213
275809987,1cyclictest35-21ksoftirqd/311:10:003
275809987,1cyclictest35-21ksoftirqd/310:35:143
275809987,1cyclictest35-21ksoftirqd/307:25:013
275809987,1cyclictest20465-21diskmemload09:26:313
275809987,0cyclictest35-21ksoftirqd/310:50:233
275809985,2cyclictest30937-21aten_r1power_vo07:15:153
275809980,4cyclictest0-21swapper/312:00:123
275809980,4cyclictest0-21swapper/311:26:363
275809980,4cyclictest0-21swapper/311:26:353
275699987,1cyclictest28-21ksoftirqd/207:30:582
275699986,1cyclictest60950irq/123-eno112:30:152
275699986,1cyclictest60950irq/123-eno112:20:122
275699986,1cyclictest60950irq/123-eno111:05:192
275699986,1cyclictest60950irq/123-eno110:00:142
275699986,1cyclictest11681-21cat09:40:192
275699985,1cyclictest60950irq/123-eno112:10:002
275699983,2cyclictest254-21systemd-journal12:03:332
275699983,2cyclictest254-21systemd-journal10:12:002
275699983,2cyclictest254-21systemd-journal08:00:092
275699982,3cyclictest0-21swapper/207:45:132
275699980,8cyclictest0-21swapper/211:55:222
275699980,6cyclictest0-21swapper/209:27:362
275649988,0cyclictest21-21ksoftirqd/112:15:051
275649988,0cyclictest21-21ksoftirqd/111:15:061
275649988,0cyclictest21-21ksoftirqd/109:50:021
275649988,0cyclictest21-21ksoftirqd/109:10:261
275649988,0cyclictest21-21ksoftirqd/109:00:101
275649988,0cyclictest21-21ksoftirqd/107:25:011
275649988,0cyclictest21-21ksoftirqd/107:15:151
275649980,8cyclictest211ksoftirqd/107:35:301
275649980,8cyclictest111rcu_preempt08:20:361
275649980,8cyclictest0-21swapper/110:45:031
275649980,8cyclictest0-21swapper/108:55:321
275649980,8cyclictest0-21swapper/108:26:371
275649980,8cyclictest0-21swapper/108:11:521
275649980,8cyclictest0-21swapper/107:45:251
275649980,8cyclictest0-21swapper/107:40:221
275649980,8cyclictest0-21swapper/107:20:051
275649980,1cyclictest21-21ksoftirqd/108:05:111
275649980,0cyclictest21-21ksoftirqd/108:35:161
275649980,0cyclictest21-21ksoftirqd/108:00:341
275649980,0cyclictest0-21swapper/109:05:481
275649980,0cyclictest0-21swapper/108:31:121
275559987,1cyclictest9-21ksoftirqd/012:40:010
275559987,1cyclictest9-21ksoftirqd/012:15:010
275559987,1cyclictest9-21ksoftirqd/008:40:000
275559987,1cyclictest1050rcuc/011:44:590
275559986,1cyclictest9-21ksoftirqd/010:30:130
275559983,4cyclictest19296-21unixbench-2d12:05:200
275559981,4cyclictest9-21ksoftirqd/012:04:150
275559981,0cyclictest20465-21diskmemload10:52:300
275559980,8cyclictest17777-21ssh11:20:090
275559980,7cyclictest5748-21ssh11:47:060
275559980,5cyclictest31539-21kworker/0:007:40:000
275559980,5cyclictest14220-21ssh11:15:110
275809977,0cyclictest35-21ksoftirqd/308:05:133
275809976,1cyclictest35-21ksoftirqd/311:35:133
275809976,1cyclictest35-21ksoftirqd/311:15:143
275809976,1cyclictest35-21ksoftirqd/309:55:203
275809976,1cyclictest35-21ksoftirqd/309:45:183
275809972,2cyclictest6810-21cpuspeed_turbos08:40:113
275809971,3cyclictest0-21swapper/310:40:133
275809970,6cyclictest0-21swapper/311:57:133
275809970,4cyclictest20465-21diskmemload10:55:083
275809970,4cyclictest0-21swapper/311:46:273
275809970,4cyclictest0-21swapper/311:44:463
275809970,2cyclictest0-21swapper/310:20:113
275699977,0cyclictest0-21swapper/208:39:572
275699976,1cyclictest60950irq/123-eno112:13:012
275699976,1cyclictest60950irq/123-eno110:45:092
275699976,1cyclictest60950irq/123-eno110:37:372
275699976,1cyclictest60950irq/123-eno110:31:112
275699976,1cyclictest60950irq/123-eno110:20:072
275699976,1cyclictest60950irq/123-eno109:16:262
275699976,0cyclictest60950irq/123-eno111:25:102
275699976,0cyclictest60950irq/123-eno111:25:102
275699976,0cyclictest60950irq/123-eno110:15:132
275699975,1cyclictest60950irq/123-eno111:35:112
275699975,1cyclictest28-21ksoftirqd/207:21:352
275699974,2cyclictest17987-21/usr/sbin/munin09:50:132
275699971,5cyclictest13610-21apt-get08:55:122
275699971,3cyclictest0-21swapper/211:17:192
275699971,2cyclictest546-21irqbalance10:26:162
275699971,2cyclictest1160-21/usr/sbin/munin10:55:182
275699970,2cyclictest0-21swapper/209:47:092
275559976,1cyclictest5926-1kworker/u9:011:52:440
275559975,1cyclictest9-21ksoftirqd/012:20:130
275559975,1cyclictest9-21ksoftirqd/011:10:100
275559975,1cyclictest9-21ksoftirqd/008:55:000
275559975,1cyclictest9-21ksoftirqd/007:15:010
275559973,1cyclictest27915-21chrt10:48:130
275559972,1cyclictest10773-21/usr/sbin/munin09:40:150
275559971,6cyclictest5613-21ssh11:01:110
275559971,5cyclictest7839-21ssh11:05:150
275559971,2cyclictest20465-21diskmemload10:10:200
275559970,6cyclictest7101-21apt-get10:20:100
275559970,6cyclictest24061-21ssh10:42:510
275559970,6cyclictest21342-21ssh11:25:150
275559970,6cyclictest21342-21ssh11:25:140
275559970,6cyclictest20465-21diskmemload12:30:110
275559970,6cyclictest17623-21basename07:55:110
275559970,6cyclictest0-21swapper/009:47:190
275559970,6cyclictest0-21swapper/009:30:180
275559970,6cyclictest0-21swapper/009:15:570
275559970,1cyclictest3510-21ssh10:15:070
275559970,1cyclictest26166-21cut10:00:170
275559970,1cyclictest23092-21ssh09:12:160
275809966,0cyclictest35-21ksoftirqd/307:45:003
275809966,0cyclictest35-21ksoftirqd/307:30:123
275809966,0cyclictest20465-21diskmemload10:30:193
275809966,0cyclictest20465-21diskmemload09:43:083
275809965,1cyclictest35-21ksoftirqd/307:50:003
275809965,1cyclictest35-21ksoftirqd/307:35:133
275809965,1cyclictest35-21ksoftirqd/307:10:213
275809965,1cyclictest26040-21ntpq11:30:193
275809965,1cyclictest21890-21ntpq09:10:183
275809965,1cyclictest1953-21ssh12:27:423
275809965,1cyclictest1802-21ssh10:10:293
275809964,1cyclictest35-21ksoftirqd/309:50:173
275809964,1cyclictest35-21ksoftirqd/308:50:113
275809963,1cyclictest254-21systemd-journal08:20:013
275809960,0cyclictest20465-21diskmemload11:50:503
275809960,0cyclictest0-21swapper/308:25:083
275699966,0cyclictest60950irq/123-eno111:50:122
275699966,0cyclictest60950irq/123-eno111:14:292
275699966,0cyclictest60950irq/123-eno110:05:182
275699966,0cyclictest60950irq/123-eno109:20:162
275699966,0cyclictest60950irq/123-eno108:27:162
275699966,0cyclictest60950irq/123-eno108:06:002
275699966,0cyclictest60950irq/123-eno107:39:412
275699966,0cyclictest60950irq/123-eno107:10:552
275699965,1cyclictest60950irq/123-eno109:10:002
275699965,1cyclictest60950irq/123-eno107:25:152
275699965,1cyclictest24826-21ssh11:30:042
275699965,0cyclictest60950irq/123-eno111:22:112
275699964,1cyclictest60950irq/123-eno111:40:142
275699964,1cyclictest28-21ksoftirqd/208:40:092
275699964,1cyclictest16808-21wc09:00:152
275699960,5cyclictest11254-21apt-get08:50:132
275699960,4cyclictest26114-21systemctl12:15:202
275699960,1cyclictest0-21swapper/211:00:072
275559966,0cyclictest9-21ksoftirqd/010:25:130
275559965,1cyclictest9-21ksoftirqd/008:40:120
275559965,1cyclictest9-21ksoftirqd/008:25:000
275559965,1cyclictest9-21ksoftirqd/007:49:590
275559965,1cyclictest2762-21sshd07:23:350
275559965,1cyclictest14737-21ntpq08:55:180
275559962,2cyclictest570-21systemd-logind09:05:160
275559960,6cyclictest0-21swapper/008:30:110
275559960,6cyclictest0-21swapper/008:02:060
275559960,5cyclictest8894-21/usr/sbin/munin08:45:140
275559960,5cyclictest20118-21ssh10:36:590
275809954,1cyclictest35-21ksoftirqd/307:55:133
275809954,1cyclictest35-21ksoftirqd/307:25:143
275809954,0cyclictest35-21ksoftirqd/308:30:123
275809950,4cyclictest8897-21apt-get08:45:113
275809950,2cyclictest0-21swapper/309:00:123
275809950,1cyclictest20088-21aten2.4-expect08:00:123
275699955,0cyclictest60950irq/123-eno108:45:122
275699955,0cyclictest60950irq/123-eno108:15:022
275699954,1cyclictest60950irq/123-eno108:10:162
275699953,1cyclictest742-21runrttasks08:20:172
275699951,1cyclictest17733-21cpuspeed_turbos07:55:112
275699950,5cyclictest0-21swapper/207:50:032
275559953,1cyclictest12700-21basename07:45:140
275559952,2cyclictest17657-21unixbench_multi09:00:210
275559950,5cyclictest0-21swapper/008:25:150
275559950,5cyclictest0-21swapper/007:40:280
275559950,4cyclictest24766-21/usr/sbin/munin08:10:140
275559950,4cyclictest22411-21/usr/sbin/munin08:05:130
275559950,1cyclictest3117-21/usr/sbin/munin07:25:150
275559950,0cyclictest0-21swapper/008:15:350
275559950,0cyclictest0-21swapper/007:31:520
275809943,1cyclictest30739-21pmu-power08:20:213
275809943,1cyclictest19589-21grep09:05:163
275809942,1cyclictest0-21swapper/307:50:153
275809940,0cyclictest0-21swapper/308:10:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional