You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-14 - 23:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Mon Jul 14, 2025 12:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
252112221155,21sleep20-21swapper/207:08:222
252872211179,21sleep10-21swapper/107:09:211
250432210158,26sleep30-21swapper/307:06:103
250402208156,26sleep00-21swapper/007:06:070
2641921110,0sleep10-21swapper/109:20:011
58222700,0sleep10-21swapper/112:25:171
25842590,0sleep00-21swapper/009:30:170
25415991210,1cyclictest28-21ksoftirqd/212:00:002
2541399120,0cyclictest0-21swapper/007:15:160
2541399120,0cyclictest0-21swapper/007:15:150
2541599119,1cyclictest28-21ksoftirqd/210:15:002
2541599119,1cyclictest28-21ksoftirqd/208:35:152
2541599119,1cyclictest28-21ksoftirqd/207:25:012
25415991110,1cyclictest28-21ksoftirqd/210:30:252
25415991110,1cyclictest28-21ksoftirqd/209:30:182
2541599110,9cyclictest24787-21vmstat10:40:242
2541399112,4cyclictest13623-21sed09:45:000
95742100,0sleep10-21swapper/111:46:201
2541699105,3cyclictest0-21swapper/312:22:563
2541599108,1cyclictest2850ksoftirqd/207:25:142
2541599108,1cyclictest28-21ksoftirqd/211:00:162
2541399108,1cyclictest9-21ksoftirqd/011:15:180
2541399100,4cyclictest254-21systemd-journal10:06:100
254169990,4cyclictest0-21swapper/312:35:123
254159998,1cyclictest60950irq/123-eno109:15:132
254159998,1cyclictest28-21ksoftirqd/212:15:222
254159998,1cyclictest28-21ksoftirqd/212:13:532
254159998,1cyclictest28-21ksoftirqd/211:50:202
254159998,1cyclictest28-21ksoftirqd/210:20:122
254159998,1cyclictest28-21ksoftirqd/209:50:162
254159998,1cyclictest28-21ksoftirqd/209:40:162
254159998,1cyclictest28-21ksoftirqd/209:10:152
254159998,1cyclictest28-21ksoftirqd/208:05:002
254159997,1cyclictest28-21ksoftirqd/212:25:162
254159997,1cyclictest28-21ksoftirqd/211:05:222
254159997,1cyclictest28-21ksoftirqd/210:55:002
254159997,1cyclictest28-21ksoftirqd/210:50:162
254139997,1cyclictest9-21ksoftirqd/009:45:130
254139990,8cyclictest10980-21ssh12:32:150
254139990,7cyclictest0-21swapper/008:15:110
4148280,0sleep10-21swapper/108:40:001
254169986,1cyclictest18290-21diskmemload12:29:053
254169982,2cyclictest557-21nscd10:07:363
254169980,6cyclictest26207-21aten_r1power_po12:10:163
254159988,0cyclictest28-21ksoftirqd/210:35:162
254159987,1cyclictest28-21ksoftirqd/212:00:212
254159987,1cyclictest28-21ksoftirqd/211:35:162
254159987,1cyclictest28-21ksoftirqd/211:20:162
254159987,1cyclictest28-21ksoftirqd/211:20:162
254159987,1cyclictest28-21ksoftirqd/211:10:142
254159987,1cyclictest28-21ksoftirqd/210:00:152
254159987,1cyclictest28-21ksoftirqd/209:25:172
254159987,1cyclictest28-21ksoftirqd/208:40:182
254159986,1cyclictest60950irq/123-eno110:45:142
254159986,1cyclictest28-21ksoftirqd/212:20:192
254159986,1cyclictest28-21ksoftirqd/211:40:202
254159986,1cyclictest28-21ksoftirqd/211:30:152
254159982,3cyclictest18290-21diskmemload10:05:132
254149980,3cyclictest0-21swapper/111:44:371
254139987,1cyclictest9-21ksoftirqd/012:35:570
254139987,1cyclictest9-21ksoftirqd/010:40:000
254139987,1cyclictest9-21ksoftirqd/007:50:010
254139986,1cyclictest9-21ksoftirqd/008:40:150
254139986,1cyclictest1449-21ntpd11:25:020
254139986,1cyclictest1449-21ntpd09:00:020
254139985,1cyclictest30522-21/usr/sbin/munin10:50:110
254139984,2cyclictest254-21systemd-journal11:55:010
254139984,2cyclictest254-21systemd-journal09:00:010
254139981,4cyclictest18290-21diskmemload10:25:470
254139980,7cyclictest30723-21ssh11:31:220
254139980,3cyclictest556-21rs:main0
254139980,3cyclictest18626-21/usr/sbin/munin12:00:140
254139980,2cyclictest0-21swapper/010:40:130
11912280,1sleep30-21swapper/312:34:533
254169976,1cyclictest14778-21cat09:45:163
254169975,1cyclictest30486-21ssh11:30:413
254169975,1cyclictest25865-21cat08:15:153
254169975,1cyclictest20976-21ssh09:11:523
254169974,2cyclictest29178-21df07:15:173
254169974,2cyclictest29178-21df07:15:173
254169974,1cyclictest28723-21latency_hist10:05:003
254169973,2cyclictest254-21systemd-journal11:14:413
254169973,0cyclictest18290-21diskmemload12:17:173
254169971,4cyclictest72652sleep310:18:593
254169970,2cyclictest0-21swapper/310:25:143
254159977,0cyclictest28-21ksoftirqd/210:15:232
254159976,1cyclictest60950irq/123-eno111:26:032
254159976,1cyclictest60950irq/123-eno110:26:482
254159976,1cyclictest28-21ksoftirqd/212:39:402
254159976,1cyclictest28-21ksoftirqd/212:30:172
254159976,1cyclictest28-21ksoftirqd/212:06:272
254159976,1cyclictest28-21ksoftirqd/209:55:172
254159976,1cyclictest28-21ksoftirqd/209:55:162
254159976,1cyclictest28-21ksoftirqd/209:45:122
254159975,1cyclictest28-21ksoftirqd/209:35:142
254159970,7cyclictest0-21swapper/209:20:212
254159970,2cyclictest26129-21df07:10:122
254149973,0cyclictest0-21swapper/109:05:211
254149971,2cyclictest0-21swapper/111:55:381
254149970,6cyclictest0-21swapper/110:05:561
254149970,4cyclictest0-21swapper/110:52:311
254149970,4cyclictest0-21swapper/110:39:201
254139976,1cyclictest9-21ksoftirqd/008:39:590
254139976,1cyclictest23343-1kworker/u9:109:29:420
254139976,1cyclictest1449-21ntpd08:05:020
254139976,1cyclictest13109-1kworker/u9:111:12:460
254139975,1cyclictest1449-21ntpd09:10:020
254139975,1cyclictest1449-21ntpd07:35:030
254139975,1cyclictest1449-21ntpd07:10:020
254139974,1cyclictest9-21ksoftirqd/007:54:550
254139972,4cyclictest8857-21awk08:50:000
254139971,6cyclictest29342-21ssh10:47:350
254139970,7cyclictest0-21swapper/011:41:190
254139970,6cyclictest797-21ntp_states08:30:200
254139970,6cyclictest742-21runrttasks12:25:070
254139970,6cyclictest32396-21cut11:35:160
254139970,6cyclictest28361-21users09:20:230
254139970,6cyclictest22327-21ssh12:05:110
254139970,6cyclictest20326-21ssh09:52:590
254139970,6cyclictest0-21swapper/010:18:520
254139970,6cyclictest0-21swapper/009:37:350
254139970,1cyclictest9250-21ssh11:45:240
254139970,1cyclictest6912-21ntp_states11:00:190
254139970,1cyclictest4150-21ssh10:56:340
254139970,1cyclictest28297-21ssh12:11:370
254139970,1cyclictest26077-21ssh09:19:370
254139970,1cyclictest23209-21ssh09:55:270
254139970,1cyclictest23209-21ssh09:55:260
254139970,1cyclictest15460-21ssh10:30:130
254139970,1cyclictest0-21swapper/008:25:120
254169965,1cyclictest3732-21ssh11:40:133
254169965,1cyclictest35-21ksoftirqd/307:22:413
254169965,1cyclictest3367-21ssh10:13:323
254169965,1cyclictest28794-21ssh10:46:043
254169965,1cyclictest27775-21ntpq09:20:193
254169965,1cyclictest24408-21ssh12:06:093
254169965,1cyclictest23386-21ssh11:21:593
254169965,1cyclictest23386-21ssh11:21:583
254169965,1cyclictest22516-21ssh09:15:113
254169965,1cyclictest21553-21ssh10:36:513
254169965,1cyclictest19911-21ssh09:51:493
254169965,1cyclictest19139-21ssh12:00:153
254169965,1cyclictest1787-21ssh11:35:353
254169965,1cyclictest17207-21ssh11:15:033
254169965,1cyclictest13175-21ssh11:09:593
254169965,1cyclictest11378-21ssh10:24:593
254169965,0cyclictest18290-21diskmemload09:41:133
254169963,1cyclictest570-21systemd-logind07:15:003
254169963,1cyclictest4345-21ssh10:57:073
254169963,1cyclictest254-21systemd-journal08:41:073
254169963,1cyclictest254-21systemd-journal08:03:233
254169963,1cyclictest254-21systemd-journal07:29:563
254169962,3cyclictest32000-21sh09:25:233
254169962,2cyclictest18290-21diskmemload11:50:183
254169961,3cyclictest18290-21diskmemload10:51:253
254169961,2cyclictest6402-21/usr/sbin/munin07:35:183
254169961,2cyclictest0-21swapper/311:45:103
254169961,2cyclictest0-21swapper/310:41:253
254169960,5cyclictest0-21swapper/309:58:303
254169960,5cyclictest0-21swapper/309:58:293
254169960,4cyclictest0-21swapper/309:30:153
254169960,2cyclictest0-21swapper/311:02:523
254169960,2cyclictest0-21swapper/309:35:183
254169960,1cyclictest0-21swapper/307:45:143
254159966,0cyclictest60950irq/123-eno111:45:162
254159966,0cyclictest60950irq/123-eno109:06:412
254159966,0cyclictest60950irq/123-eno108:55:072
254159966,0cyclictest60950irq/123-eno108:50:322
254159966,0cyclictest60950irq/123-eno107:55:122
254159966,0cyclictest60950irq/123-eno107:44:062
254159966,0cyclictest60950irq/123-eno107:36:072
254159965,1cyclictest60950irq/123-eno111:15:182
254159965,1cyclictest28-21ksoftirqd/208:25:142
254159964,1cyclictest28-21ksoftirqd/208:20:002
254159964,1cyclictest28-21ksoftirqd/208:05:152
254159964,1cyclictest28-21ksoftirqd/207:50:112
254159964,1cyclictest28-21ksoftirqd/207:15:192
254159964,1cyclictest28-21ksoftirqd/207:15:182
254159960,6cyclictest0-21swapper/208:13:172
254159960,5cyclictest13810-21apt-get09:00:132
254149962,2cyclictest0-21swapper/112:36:001
254149961,3cyclictest0-21swapper/111:23:501
254149961,3cyclictest0-21swapper/111:23:491
254149960,6cyclictest0-21swapper/111:15:201
254149960,5cyclictest0-21swapper/111:06:331
254149960,4cyclictest0-21swapper/110:31:181
254149960,4cyclictest0-21swapper/110:17:181
254149960,4cyclictest0-21swapper/109:25:241
254149960,4cyclictest0-21swapper/107:45:141
254149960,3cyclictest0-21swapper/111:30:121
254149960,3cyclictest0-21swapper/109:55:061
254149960,3cyclictest0-21swapper/109:55:061
254149960,2cyclictest0-21swapper/109:10:551
254139965,1cyclictest30992-21ntpq12:15:230
254139964,1cyclictest1449-21ntpd08:50:020
254139964,1cyclictest1307-21aten2.4-expect07:25:160
254139961,0cyclictest1107-21ssh12:20:120
254139960,6cyclictest0-21swapper/010:20:170
254139960,6cyclictest0-21swapper/010:10:150
254139960,6cyclictest0-21swapper/009:05:170
254139960,5cyclictest18290-21diskmemload11:56:140
254139960,5cyclictest0-21swapper/008:00:120
254139960,0cyclictest18290-21diskmemload11:20:220
254139960,0cyclictest18290-21diskmemload11:20:210
254139960,0cyclictest0-21swapper/010:00:040
254139960,0cyclictest0-21swapper/008:23:240
254139960,0cyclictest0-21swapper/008:10:160
27454250,1sleep10-21swapper/110:01:441
254169953,1cyclictest35-21ksoftirqd/307:51:133
254169951,3cyclictest631-21/usr/sbin/munin08:30:193
254169951,3cyclictest29725-21aten_r1power_cu08:25:123
254169951,2cyclictest13810-21apt-get09:00:143
254169951,1cyclictest254-21systemd-journal07:55:373
254169950,4cyclictest10066-21taskset07:41:013
254169950,4cyclictest0-21swapper/311:55:153
254169950,3cyclictest0-21swapper/310:31:223
254169950,2cyclictest0-21swapper/311:26:193
254169950,1cyclictest0-21swapper/309:07:433
254169950,1cyclictest0-21swapper/308:39:323
254159955,0cyclictest60950irq/123-eno107:48:512
254159954,1cyclictest60950irq/123-eno108:30:132
254159954,1cyclictest28-21ksoftirqd/208:20:122
254159954,0cyclictest60950irq/123-eno107:30:132
254159950,1cyclictest0-21swapper/208:45:142
254149955,0cyclictest0-21swapper/107:42:151
254149954,1cyclictest0-21swapper/109:35:161
254149953,2cyclictest0-21swapper/112:30:181
254149953,1cyclictest102052sleep110:21:411
254149953,1cyclictest0-21swapper/112:05:571
254149952,2cyclictest0-21swapper/110:58:291
254149951,1cyclictest0-21swapper/107:55:121
254149950,5cyclictest0-21swapper/109:03:501
254149950,5cyclictest0-21swapper/108:43:121
254149950,4cyclictest0-21swapper/111:03:461
254149950,4cyclictest0-21swapper/110:45:491
254149950,3cyclictest0-21swapper/112:02:391
254149950,3cyclictest0-21swapper/110:40:131
254149950,3cyclictest0-21swapper/109:45:031
254149950,3cyclictest0-21swapper/109:20:551
254149950,3cyclictest0-21swapper/108:05:001
254149950,2cyclictest0-21swapper/111:10:051
254149950,2cyclictest0-21swapper/110:26:071
254149950,2cyclictest0-21swapper/108:20:011
254149950,1cyclictest0-21swapper/110:10:171
254149950,1cyclictest0-21swapper/108:51:061
254149950,0cyclictest0-21swapper/109:41:281
254149950,0cyclictest0-21swapper/109:32:031
254149950,0cyclictest0-21swapper/107:29:371
254149950,0cyclictest0-21swapper/107:23:181
254139950,5cyclictest0-21swapper/007:55:030
254139950,2cyclictest254-21systemd-journal07:44:590
254139950,1cyclictest0-21swapper/007:25:010
254139950,0cyclictest0-21swapper/007:30:120
254169943,1cyclictest27563-21cpuspeed_turbos08:20:133
254169943,1cyclictest11637-21cpu08:55:133
254169942,1cyclictest565-21nscd07:30:143
254169942,1cyclictest20580-21forks08:05:163
254169941,2cyclictest9082-21apt-get08:50:133
254169941,2cyclictest7232-21/usr/sbin/munin08:45:173
254169940,1cyclictest0-21swapper/308:10:013
254149944,0cyclictest0-21swapper/112:11:051
254149944,0cyclictest0-21swapper/111:36:481
254149944,0cyclictest0-21swapper/108:07:461
254149942,1cyclictest16232sleep108:33:231
254149941,1cyclictest0-21swapper/107:50:191
254149940,3cyclictest0-21swapper/112:22:271
254149940,3cyclictest0-21swapper/111:25:171
254149940,3cyclictest0-21swapper/109:52:091
254149940,2cyclictest0-21swapper/112:15:331
254149940,2cyclictest0-21swapper/111:50:031
254149940,2cyclictest0-21swapper/107:15:191
254149940,2cyclictest0-21swapper/107:15:181
254149940,1cyclictest0-21swapper/108:55:151
254149940,1cyclictest0-21swapper/108:20:141
254149940,1cyclictest0-21swapper/107:10:101
254149940,0cyclictest0-21swapper/107:30:191
254149931,1cyclictest0-21swapper/108:45:141
254149931,1cyclictest0-21swapper/108:10:151
254149931,1cyclictest0-21swapper/107:35:151
254149930,1cyclictest0-21swapper/108:25:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional