You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 18:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Nov 26, 2025 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
306642223153,23sleep30-21swapper/307:08:353
304452211130,25sleep00-21swapper/007:05:430
305282204148,21sleep10-21swapper/107:06:481
305862202162,26sleep20-21swapper/207:07:352
173132590,0sleep00-21swapper/011:13:430
30876992017,3cyclictest28-21ksoftirqd/209:48:182
30859991811,1cyclictest9-21ksoftirqd/007:19:590
200842180,0sleep20-21swapper/212:01:312
19092150,1sleep1111rcu_preempt10:50:211
30859991412,1cyclictest9-21ksoftirqd/007:30:110
30859991311,1cyclictest9-21ksoftirqd/009:00:000
30884991210,1cyclictest742-21runrttasks12:06:323
30876991211,1cyclictest28-21ksoftirqd/210:20:122
3085999123,4cyclictest32636-21perf08:20:000
3085999120,5cyclictest254-21systemd-journal07:54:550
3087699119,1cyclictest28-21ksoftirqd/211:10:152
3087699119,1cyclictest28-21ksoftirqd/210:10:212
30876991111,0cyclictest28-21ksoftirqd/209:35:032
30876991110,1cyclictest28-21ksoftirqd/211:20:162
30876991110,1cyclictest28-21ksoftirqd/210:38:402
3085999119,1cyclictest9-21ksoftirqd/008:40:000
30859991111,0cyclictest9-21ksoftirqd/011:05:180
30859991110,1cyclictest9-21ksoftirqd/010:25:200
30859991110,1cyclictest9-21ksoftirqd/009:54:340
30859991110,1cyclictest9-21ksoftirqd/009:30:130
3088499108,1cyclictest35-21ksoftirqd/307:51:483
3087699109,1cyclictest28-21ksoftirqd/212:25:152
3087699109,1cyclictest28-21ksoftirqd/212:10:122
3087699109,1cyclictest28-21ksoftirqd/211:30:172
3087699109,1cyclictest28-21ksoftirqd/211:25:222
3087699109,1cyclictest28-21ksoftirqd/211:07:002
3087699109,1cyclictest28-21ksoftirqd/210:40:152
3087699108,1cyclictest28-21ksoftirqd/211:54:262
3087699108,1cyclictest28-21ksoftirqd/211:38:482
30876991010,0cyclictest28-21ksoftirqd/212:17:462
30876991010,0cyclictest28-21ksoftirqd/212:17:452
30876991010,0cyclictest28-21ksoftirqd/211:15:132
30876991010,0cyclictest28-21ksoftirqd/210:30:252
30876991010,0cyclictest28-21ksoftirqd/210:25:172
30876991010,0cyclictest28-21ksoftirqd/209:57:322
30876991010,0cyclictest28-21ksoftirqd/209:40:152
3087699100,7cyclictest0-21swapper/209:31:202
3085999109,1cyclictest9-21ksoftirqd/011:45:200
3085999109,1cyclictest9-21ksoftirqd/011:45:200
3085999107,3cyclictest9-21ksoftirqd/011:15:180
3085999102,4cyclictest31892-21cut12:20:000
3085999102,4cyclictest31892-21cut12:20:000
3085999102,4cyclictest18256-21latency_hist07:50:000
30859991010,0cyclictest9-21ksoftirqd/010:35:120
3085999100,5cyclictest21193-21latency_hist12:05:000
9895290,0sleep10-21swapper/111:02:511
308849990,5cyclictest0-21swapper/312:30:103
308769999,0cyclictest28-21ksoftirqd/212:35:192
308769999,0cyclictest28-21ksoftirqd/212:24:502
308769999,0cyclictest28-21ksoftirqd/210:19:022
308769999,0cyclictest28-21ksoftirqd/209:25:032
308769999,0cyclictest28-21ksoftirqd/209:15:172
308769998,1cyclictest28-21ksoftirqd/211:55:142
308769998,1cyclictest28-21ksoftirqd/210:55:152
308769998,1cyclictest28-21ksoftirqd/210:45:152
308769998,1cyclictest28-21ksoftirqd/210:05:102
308769998,1cyclictest28-21ksoftirqd/209:22:142
308769998,1cyclictest28-21ksoftirqd/207:15:012
308769997,1cyclictest28-21ksoftirqd/208:45:152
308769995,3cyclictest28-21ksoftirqd/212:05:152
308769990,9cyclictest0-21swapper/209:10:402
308599999,0cyclictest9-21ksoftirqd/012:40:000
308599999,0cyclictest9-21ksoftirqd/011:20:120
308599998,1cyclictest9-21ksoftirqd/011:35:200
308599998,1cyclictest9-21ksoftirqd/010:45:150
308599998,1cyclictest9-21ksoftirqd/010:20:210
308599998,1cyclictest9-21ksoftirqd/009:40:160
308599998,1cyclictest9-21ksoftirqd/009:10:160
308599997,1cyclictest9-21ksoftirqd/010:59:590
308599997,1cyclictest9-21ksoftirqd/010:10:010
308599996,3cyclictest9-21ksoftirqd/011:25:360
308599995,3cyclictest742-21runrttasks09:59:570
308599990,3cyclictest0-21swapper/010:15:110
308849987,1cyclictest31239-1kworker/u9:110:03:173
308849981,4cyclictest0-21swapper/311:01:573
308849981,4cyclictest0-21swapper/309:15:193
308849980,6cyclictest0-21swapper/309:35:353
308849980,4cyclictest4432-21ntp_states12:25:173
308769988,0cyclictest28-21ksoftirqd/210:50:032
308769987,1cyclictest28-21ksoftirqd/212:33:352
308769987,1cyclictest28-21ksoftirqd/211:00:032
308769987,1cyclictest28-21ksoftirqd/209:50:162
308769987,1cyclictest28-21ksoftirqd/207:45:012
308769987,1cyclictest28-21ksoftirqd/207:10:222
308769986,1cyclictest28-21ksoftirqd/211:46:112
308769986,1cyclictest28-21ksoftirqd/211:46:102
308769986,1cyclictest28-21ksoftirqd/210:01:152
308769986,1cyclictest28-21ksoftirqd/209:00:142
308769986,1cyclictest23481-21kworker/2:008:20:242
308769986,1cyclictest23481-21kworker/2:008:05:162
308769985,1cyclictest0-21swapper/208:30:202
308689980,4cyclictest0-21swapper/109:52:081
308599988,0cyclictest9-21ksoftirqd/010:50:170
308599988,0cyclictest9-21ksoftirqd/008:05:190
308599987,1cyclictest9-21ksoftirqd/009:50:000
308599987,1cyclictest9-21ksoftirqd/009:20:190
308599987,1cyclictest31000-1kworker/u9:111:31:380
308599987,1cyclictest23932-1kworker/u9:012:20:120
308599984,1cyclictest23981-21diskmemload10:40:240
308599980,7cyclictest0-21swapper/010:00:110
308599980,4cyclictest805-21perf07:14:590
308599980,1cyclictest254-21systemd-journal11:02:330
308599980,1cyclictest0-21swapper/009:28:400
308599980,0cyclictest0-21swapper/007:35:190
30179280,0sleep10-21swapper/109:16:491
308849976,1cyclictest12060-21memory10:20:173
308849975,1cyclictest23997-21ssh10:36:533
308849975,1cyclictest21468-21ssh11:19:583
308849975,1cyclictest16855-21ssh11:57:363
308849975,1cyclictest11740-21cat11:50:173
308849973,2cyclictest254-21systemd-journal10:17:173
308849972,3cyclictest23981-21diskmemload12:11:523
308849971,4cyclictest23981-21diskmemload11:48:403
308849971,4cyclictest23981-21diskmemload11:48:403
308849971,1cyclictest0-21swapper/308:45:123
308849970,6cyclictest14536-21cpuspeed_turbos09:40:153
308849970,3cyclictest0-21swapper/310:27:063
308849970,2cyclictest0-21swapper/312:36:353
308849970,2cyclictest0-21swapper/311:20:203
308849970,2cyclictest0-21swapper/310:52:473
308849970,1cyclictest0-21swapper/308:20:003
308769976,1cyclictest28968-21cat08:10:152
308769976,1cyclictest28-21ksoftirqd/207:45:152
308769975,1cyclictest60950irq/123-eno111:40:152
308769975,1cyclictest28-21ksoftirqd/208:50:152
308769975,1cyclictest28-21ksoftirqd/208:25:142
308769970,4cyclictest22917-21apt-get08:00:012
308689970,5cyclictest0-21swapper/112:10:161
308689970,5cyclictest0-21swapper/109:10:391
308689970,4cyclictest0-21swapper/111:10:241
308689970,4cyclictest0-21swapper/109:45:171
308689970,4cyclictest0-21swapper/109:31:331
308689970,3cyclictest0-21swapper/112:33:121
308599976,1cyclictest9-21ksoftirqd/012:30:140
308599976,1cyclictest9-21ksoftirqd/012:10:160
308599976,1cyclictest9-21ksoftirqd/008:30:480
308599976,1cyclictest9-21ksoftirqd/007:55:140
308599976,1cyclictest32513-21telnet10:05:110
308599976,1cyclictest21505-21telnet12:05:120
308599975,1cyclictest9-21ksoftirqd/011:50:160
308599971,6cyclictest19539-21ssh10:30:220
308599970,6cyclictest24897-21cat08:00:200
308599970,6cyclictest13719-21/usr/sbin/munin07:40:160
308599970,6cyclictest12405-21/usr/sbin/munin08:45:190
308599970,6cyclictest0-21swapper/008:50:110
308599970,6cyclictest0-21swapper/008:40:170
308599970,6cyclictest0-21swapper/008:20:140
308599970,6cyclictest0-21swapper/007:25:170
308599970,1cyclictest4205-21df_inode11:40:140
308599970,1cyclictest3238-21/usr/sbin/munin12:25:140
308599970,1cyclictest23981-21diskmemload09:15:130
308599970,1cyclictest16385-21ssh11:56:080
308599970,1cyclictest0-21swapper/009:35:130
308849965,1cyclictest3861-21sendmail-msp07:19:593
308849965,1cyclictest27950-21ssh09:58:033
308849965,1cyclictest26029-21ssh09:10:253
308849965,1cyclictest23981-21diskmemload11:11:593
308849965,1cyclictest2031-21ssh11:35:483
308849965,1cyclictest20140-21ssh09:46:213
308849965,1cyclictest0-21swapper/311:08:303
308849964,1cyclictest834-21hddtemp_smartct10:05:143
308849964,1cyclictest35-21ksoftirqd/308:25:113
308849964,1cyclictest23981-21diskmemload10:12:043
308849964,1cyclictest17925-21/usr/sbin/munin12:00:183
308849964,1cyclictest10843-21sshd07:31:473
308849963,1cyclictest23981-21diskmemload09:32:433
308849962,2cyclictest6632-21apt-get07:25:103
308849962,2cyclictest23981-21diskmemload10:45:063
308849961,2cyclictest0-21swapper/311:30:103
308849960,4cyclictest3689-21apt-get11:40:123
308849960,4cyclictest23981-21diskmemload12:22:353
308849960,3cyclictest0-21swapper/311:25:083
308849960,3cyclictest0-21swapper/309:54:123
308849960,2cyclictest0-21swapper/309:21:323
308849960,1cyclictest0-21swapper/312:16:533
308849960,1cyclictest0-21swapper/312:16:523
308849960,1cyclictest0-21swapper/310:34:053
308849960,1cyclictest0-21swapper/309:00:113
308769966,0cyclictest60950irq/123-eno108:57:582
308769966,0cyclictest60950irq/123-eno108:40:152
308769966,0cyclictest60950irq/123-eno108:35:122
308769966,0cyclictest60950irq/123-eno107:35:182
308769966,0cyclictest60950irq/123-eno107:30:122
308769965,1cyclictest28-21ksoftirqd/208:15:142
308769965,1cyclictest28-21ksoftirqd/207:25:002
308769964,1cyclictest60950irq/123-eno109:05:182
308769964,1cyclictest28-21ksoftirqd/207:55:122
308769964,1cyclictest28-21ksoftirqd/207:25:092
308769960,1cyclictest0-21swapper/207:50:122
308689963,1cyclictest0-21swapper/111:52:431
308689961,3cyclictest0-21swapper/110:40:011
308689960,6cyclictest0-21swapper/111:40:161
308689960,5cyclictest0-21swapper/110:42:001
308689960,5cyclictest0-21swapper/107:50:151
308689960,4cyclictest0-21swapper/111:39:341
308689960,4cyclictest0-21swapper/109:00:121
308689960,3cyclictest0-21swapper/112:10:001
308689960,3cyclictest0-21swapper/109:44:011
308689960,3cyclictest0-21swapper/109:20:451
308689960,2cyclictest0-21swapper/111:32:301
308689960,2cyclictest0-21swapper/110:20:121
308689960,2cyclictest0-21swapper/110:05:331
308689960,2cyclictest0-21swapper/107:10:211
308599960,6cyclictest0-21swapper/009:05:160
308599960,6cyclictest0-21swapper/008:10:120
308599960,2cyclictest0-21swapper/007:20:150
308599960,0cyclictest0-21swapper/009:00:080
308599960,0cyclictest0-21swapper/008:25:150
27222260,0sleep30-21swapper/310:40:503
308849955,0cyclictest0-21swapper/307:38:123
308849953,1cyclictest35-21ksoftirqd/307:10:143
308849952,1cyclictest360-21/usr/sbin/munin08:20:163
308849952,1cyclictest254-21systemd-journal08:42:003
308849952,1cyclictest254-21systemd-journal08:40:003
308849951,2cyclictest28290-21cpuspeed_turbos08:10:123
308849951,1cyclictest4090-21needreboot09:25:203
308849951,1cyclictest0-21swapper/308:05:153
308849950,5cyclictest0-21swapper/308:59:383
308849950,2cyclictest23981-21diskmemload10:55:113
308849950,2cyclictest16471-21grep08:50:203
308689952,3cyclictest0-21swapper/108:15:191
308689952,1cyclictest3234-21chrt12:25:091
308689952,1cyclictest0-21swapper/111:27:041
308689952,1cyclictest0-21swapper/109:55:201
308689951,2cyclictest29962sleep109:25:151
308689951,2cyclictest0-21swapper/111:45:171
308689951,2cyclictest0-21swapper/111:45:161
308689951,2cyclictest0-21swapper/108:35:171
308689951,1cyclictest0-21swapper/111:15:021
308689950,3cyclictest0-21swapper/110:57:541
308689950,3cyclictest0-21swapper/110:30:121
308689950,3cyclictest0-21swapper/110:18:551
308689950,3cyclictest0-21swapper/108:25:141
308689950,3cyclictest0-21swapper/108:20:151
308689950,3cyclictest0-21swapper/108:10:131
308689950,2cyclictest0-21swapper/111:55:351
308689950,2cyclictest0-21swapper/110:46:231
308689950,2cyclictest0-21swapper/110:10:141
308689950,2cyclictest0-21swapper/110:05:001
308689950,2cyclictest0-21swapper/109:35:091
308689950,1cyclictest103092sleep112:35:021
308689950,1cyclictest0-21swapper/110:26:271
308689950,1cyclictest0-21swapper/108:05:201
308689950,0cyclictest0-21swapper/112:20:181
308849942,1cyclictest742-21runrttasks07:20:003
308849942,1cyclictest24077-21tune2fs08:00:153
308849942,1cyclictest22179-21cstates09:05:133
308849942,1cyclictest13856-21basename07:40:133
308849942,1cyclictest0-21swapper/307:45:203
308849940,2cyclictest0-21swapper/307:55:133
308849940,1cyclictest254-21systemd-journal08:30:463
308689942,1cyclictest0-21swapper/112:00:181
308689941,2cyclictest0-21swapper/111:20:181
308689941,2cyclictest0-21swapper/107:45:001
308689941,1cyclictest0-21swapper/107:45:161
308689941,1cyclictest0-21swapper/107:30:171
308689940,3cyclictest10359-21taskset08:40:161
308689940,3cyclictest0-21swapper/112:15:281
308689940,3cyclictest0-21swapper/112:15:281
308689940,2cyclictest0-21swapper/111:05:151
308689940,2cyclictest0-21swapper/109:09:591
308689940,1cyclictest0-21swapper/108:50:491
308689932,1cyclictest71312sleep107:25:121
308689932,1cyclictest0-21swapper/107:55:121
308689931,1cyclictest0-21swapper/108:55:121
308689931,1cyclictest0-21swapper/107:35:111
308689930,3cyclictest0-21swapper/108:00:011
308689930,1cyclictest0-21swapper/108:30:121
308689930,1cyclictest0-21swapper/107:20:171
308689930,1cyclictest0-21swapper/107:15:181
308689930,0cyclictest0-21swapper/108:45:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional