You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 17:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Tue Nov 25, 2025 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325252211168,18sleep30-21swapper/307:05:013
22452209158,25sleep20-21swapper/207:07:172
21512209159,25sleep00-21swapper/007:06:030
24542206150,21sleep10-21swapper/107:09:581
214792600,0sleep10-21swapper/111:15:001
257999130,3cyclictest18411-21cstates10:25:123
257999130,3cyclictest18411-21cstates10:25:123
257099130,1cyclictest0-21swapper/207:30:172
2546991311,1cyclictest9-21ksoftirqd/012:30:150
98892120,1sleep20-21swapper/209:28:522
98892120,1sleep20-21swapper/209:28:522
257999120,1cyclictest27672-21diskmemload09:50:593
2546991211,1cyclictest9-21ksoftirqd/009:15:190
2546991210,1cyclictest9-21ksoftirqd/011:50:230
2546991210,1cyclictest9-21ksoftirqd/011:05:010
2546991210,1cyclictest9-21ksoftirqd/010:40:150
2546991210,1cyclictest9-21ksoftirqd/007:55:000
257099114,3cyclictest23656-21ntp_kernel_err07:50:162
254699112,4cyclictest27085-21sed08:00:000
254699112,4cyclictest17373-21munin-run07:40:000
2546991111,0cyclictest9-21ksoftirqd/009:43:090
2546991110,1cyclictest9-21ksoftirqd/011:45:150
2546991110,1cyclictest9-21ksoftirqd/010:45:000
254699110,4cyclictest254-21systemd-journal08:30:190
257999105,4cyclictest28989-21ssh09:55:093
257999102,0cyclictest27672-21diskmemload09:29:513
257999102,0cyclictest27672-21diskmemload09:29:513
257999100,4cyclictest0-21swapper/311:45:003
257099109,1cyclictest8235-21irqstats10:10:162
257099108,1cyclictest28-21ksoftirqd/210:50:482
257099108,1cyclictest28-21ksoftirqd/210:30:152
254699109,1cyclictest9-21ksoftirqd/012:10:210
254699109,1cyclictest9-21ksoftirqd/011:35:010
254699109,1cyclictest9-21ksoftirqd/010:15:150
254699109,1cyclictest9-21ksoftirqd/009:50:150
254699109,1cyclictest9-21ksoftirqd/009:50:010
254699109,1cyclictest9-21ksoftirqd/009:35:120
254699109,1cyclictest9-21ksoftirqd/009:20:190
254699109,1cyclictest9-21ksoftirqd/008:10:000
254699108,1cyclictest9-21ksoftirqd/007:30:000
254699107,1cyclictest254-21systemd-journal09:55:200
2546991010,0cyclictest9-21ksoftirqd/011:25:230
254699100,8cyclictest0-21swapper/011:40:110
25799998,1cyclictest35-21ksoftirqd/309:09:593
25799995,4cyclictest19036-21ssh11:10:163
25799994,1cyclictest2141-21ssh11:31:353
25799994,1cyclictest2141-21ssh11:31:353
25799994,1cyclictest17053-21ssh11:53:323
25799994,0cyclictest27672-21diskmemload11:03:333
25799993,0cyclictest27672-21diskmemload11:37:063
25799992,1cyclictest254-21systemd-journal07:55:003
25799990,5cyclictest21522-21kworker/u8:212:08:493
25799990,2cyclictest0-21swapper/309:13:133
25799990,1cyclictest254-21systemd-journal07:15:003
25799990,1cyclictest0-21swapper/310:46:323
25799990,0cyclictest0-21swapper/310:56:523
25799990,0cyclictest0-21swapper/310:15:243
25799990,0cyclictest0-21swapper/308:20:163
25709998,1cyclictest28-21ksoftirqd/209:45:142
25709998,1cyclictest28-21ksoftirqd/208:45:002
25709998,1cyclictest28-21ksoftirqd/207:20:002
25709993,5cyclictest6947-21egrep12:25:152
25469999,0cyclictest9-21ksoftirqd/012:25:150
25469999,0cyclictest9-21ksoftirqd/012:24:520
25469999,0cyclictest9-21ksoftirqd/012:15:180
25469999,0cyclictest9-21ksoftirqd/010:57:330
25469999,0cyclictest9-21ksoftirqd/010:21:120
25469999,0cyclictest9-21ksoftirqd/009:33:300
25469998,1cyclictest9-21ksoftirqd/012:35:170
25469998,1cyclictest0-21swapper/009:05:120
25469997,1cyclictest9-21ksoftirqd/011:05:130
25469997,1cyclictest9-21ksoftirqd/010:11:290
25469997,1cyclictest9-21ksoftirqd/007:50:000
25469997,1cyclictest9-21ksoftirqd/007:10:110
25469996,1cyclictest21930-21ssh12:00:170
25469994,4cyclictest0-21swapper/007:40:140
25469992,5cyclictest9-21ksoftirqd/010:33:250
25799983,1cyclictest21034-21cat08:55:133
25799983,1cyclictest15884-21processes11:05:213
25799983,0cyclictest27672-21diskmemload10:37:363
25799982,5cyclictest12284-21sshd07:25:293
25799981,1cyclictest27672-21diskmemload12:19:543
25799981,1cyclictest21535-21/usr/sbin/munin10:30:133
25799981,1cyclictest0-21swapper/311:15:153
25799980,7cyclictest557-21nscd12:39:173
25799980,5cyclictest0-21swapper/309:46:113
25799980,2cyclictest0-21swapper/312:01:243
25799980,1cyclictest254-21systemd-journal11:47:523
25709987,1cyclictest28-21ksoftirqd/210:35:132
25709987,1cyclictest28-21ksoftirqd/208:00:002
25709986,1cyclictest60950irq/123-eno110:59:252
25709986,1cyclictest60950irq/123-eno109:40:142
25709986,1cyclictest60950irq/123-eno109:15:122
25709986,1cyclictest60950irq/123-eno108:05:142
25709986,1cyclictest28-21ksoftirqd/211:25:142
25709986,1cyclictest28-21ksoftirqd/208:45:112
25709984,2cyclictest254-21systemd-journal11:55:002
25709980,8cyclictest0-21swapper/211:49:362
25709980,6cyclictest0-21swapper/212:30:132
25709980,2cyclictest24987-21perf11:20:002
25579981,3cyclictest0-21swapper/110:46:041
25579980,4cyclictest12828-21chrt11:46:321
25579980,4cyclictest0-21swapper/110:05:001
25579980,4cyclictest0-21swapper/109:45:031
25579980,2cyclictest0-21swapper/110:10:111
25469988,0cyclictest9-21ksoftirqd/011:13:430
25469988,0cyclictest9-21ksoftirqd/009:10:170
25469987,1cyclictest9-21ksoftirqd/012:09:340
25469987,1cyclictest9-21ksoftirqd/010:35:210
25469987,1cyclictest9-21ksoftirqd/010:25:200
25469987,1cyclictest9-21ksoftirqd/010:25:190
25469987,1cyclictest9-21ksoftirqd/009:30:000
25469987,1cyclictest9-21ksoftirqd/009:30:000
25469984,1cyclictest0-21swapper/008:15:170
25469982,3cyclictest11368-21/usr/sbin/munin08:35:170
25469981,6cyclictest5681-21ssh10:51:240
25469980,7cyclictest24361-21ssh11:18:110
25469980,4cyclictest28615-21cat11:25:000
25799976,1cyclictest35-21ksoftirqd/308:09:363
25799974,1cyclictest35-21ksoftirqd/308:17:183
25799974,0cyclictest27672-21diskmemload11:58:053
25799972,2cyclictest3202-21apt-get12:20:153
25799972,1cyclictest20671-21df07:45:123
25799972,1cyclictest20136-21date07:45:003
25799971,5cyclictest0-21swapper/307:20:113
25799971,3cyclictest28849-21apt-get11:25:123
25799970,3cyclictest0-21swapper/309:18:423
25709977,0cyclictest28-21ksoftirqd/211:55:142
25709977,0cyclictest28-21ksoftirqd/211:20:222
25709977,0cyclictest0-21swapper/210:41:102
25709976,1cyclictest60950irq/123-eno112:15:162
25709976,1cyclictest60950irq/123-eno110:15:132
25709976,1cyclictest60950irq/123-eno109:51:252
25709976,1cyclictest28-21ksoftirqd/212:00:152
25709976,1cyclictest19347-21cat08:50:152
25709976,0cyclictest60950irq/123-eno111:40:512
25709976,0cyclictest60950irq/123-eno110:25:062
25709976,0cyclictest60950irq/123-eno110:25:062
25709975,1cyclictest60950irq/123-eno112:20:182
25709975,1cyclictest28-21ksoftirqd/210:05:142
25709975,1cyclictest28-21ksoftirqd/208:30:132
25709974,1cyclictest60950irq/123-eno109:24:202
25709970,1cyclictest254-21systemd-journal09:13:192
25709970,1cyclictest0-21swapper/211:04:242
25579971,3cyclictest0-21swapper/111:35:161
25579970,6cyclictest0-21swapper/111:20:181
25579970,4cyclictest0-21swapper/112:22:181
25579970,4cyclictest0-21swapper/109:57:341
25579970,1cyclictest0-21swapper/111:00:171
25579970,1cyclictest0-21swapper/107:35:161
25469976,1cyclictest9-21ksoftirqd/010:05:140
25469976,1cyclictest9-21ksoftirqd/010:00:140
25469976,1cyclictest9-21ksoftirqd/008:00:140
25469976,1cyclictest9-21ksoftirqd/007:30:140
25469975,1cyclictest9-21ksoftirqd/007:15:020
25469973,2cyclictest254-21systemd-journal09:05:000
25469970,6cyclictest32331-21ssh11:30:040
25469970,6cyclictest32331-21ssh11:30:030
25469970,1cyclictest0-21swapper/008:20:160
25799965,1cyclictest9281-21ssh12:27:413
25799965,1cyclictest707-21ntpq08:10:183
25799965,1cyclictest5953-21ssh10:06:463
25799965,1cyclictest30657-21ssh10:41:023
25799965,1cyclictest27642-21ssh11:22:103
25799965,1cyclictest26028-21ntpq07:55:183
25799965,1cyclictest2380-21ssh10:01:423
25799965,1cyclictest16987-21cat08:45:153
25799965,1cyclictest16828-21ssh10:22:143
25799965,1cyclictest15507-21ntpq09:35:183
25799963,2cyclictest27672-21diskmemload09:30:213
25799963,1cyclictest254-21systemd-journal08:37:193
25799962,3cyclictest6209-21runrttasks10:53:003
25799961,2cyclictest0-21swapper/309:44:393
25799960,3cyclictest0-21swapper/312:31:473
25799960,2cyclictest0-21swapper/310:11:103
25799960,2cyclictest0-21swapper/309:23:473
25799960,1cyclictest0-21swapper/307:15:153
25709966,0cyclictest60950irq/123-eno112:10:122
25709966,0cyclictest60950irq/123-eno112:05:022
25709966,0cyclictest60950irq/123-eno111:30:562
25709966,0cyclictest60950irq/123-eno111:30:562
25709966,0cyclictest60950irq/123-eno111:11:542
25709966,0cyclictest60950irq/123-eno111:05:212
25709966,0cyclictest60950irq/123-eno110:45:062
25709966,0cyclictest60950irq/123-eno109:05:182
25709966,0cyclictest60950irq/123-eno108:35:112
25709966,0cyclictest60950irq/123-eno108:18:052
25709966,0cyclictest60950irq/123-eno108:10:422
25709966,0cyclictest60950irq/123-eno108:03:342
25709966,0cyclictest60950irq/123-eno107:40:132
25709966,0cyclictest60950irq/123-eno107:36:572
25709966,0cyclictest60950irq/123-eno107:19:072
25709965,1cyclictest28-21ksoftirqd/210:20:132
25709965,1cyclictest28-21ksoftirqd/209:30:132
25709965,1cyclictest28-21ksoftirqd/207:25:152
25709965,1cyclictest24343-21ntpq09:00:202
25709965,1cyclictest1350-21ntpq10:00:192
25709965,0cyclictest60950irq/123-eno109:55:162
25709964,1cyclictest60950irq/123-eno111:35:162
25709964,1cyclictest28-21ksoftirqd/208:25:002
25709963,1cyclictest28-21ksoftirqd/208:25:032
25709962,1cyclictest15776-21/usr/sbin/munin09:35:202
25709960,5cyclictest0-21swapper/208:55:162
25579962,2cyclictest0-21swapper/112:38:511
25579962,2cyclictest0-21swapper/109:38:561
25579961,3cyclictest0-21swapper/112:18:311
25579961,3cyclictest0-21swapper/109:29:031
25579961,3cyclictest0-21swapper/109:29:031
25579961,2cyclictest0-21swapper/109:14:291
25579960,4cyclictest0-21swapper/112:30:111
25579960,4cyclictest0-21swapper/110:02:361
25579960,4cyclictest0-21swapper/109:52:571
25579960,4cyclictest0-21swapper/109:31:541
25579960,4cyclictest0-21swapper/108:05:161
25579960,4cyclictest0-21swapper/107:27:291
25579960,3cyclictest0-21swapper/112:12:171
25579960,3cyclictest0-21swapper/111:40:301
25579960,3cyclictest0-21swapper/110:40:201
25579960,3cyclictest0-21swapper/109:40:091
25579960,3cyclictest0-21swapper/108:45:111
25579960,2cyclictest0-21swapper/107:45:101
25579960,1cyclictest0-21swapper/111:05:181
25469966,0cyclictest9-21ksoftirqd/011:55:000
25469965,1cyclictest9-21ksoftirqd/007:20:140
25469965,1cyclictest14258-21diskstats08:40:160
25469964,1cyclictest9-21ksoftirqd/008:55:120
25469964,1cyclictest9-21ksoftirqd/008:50:130
25469964,1cyclictest9-21ksoftirqd/008:45:130
25469964,1cyclictest9-21ksoftirqd/008:14:590
13569260,0sleep20-21swapper/212:35:002
25799955,0cyclictest0-21swapper/308:32:283
25799955,0cyclictest0-21swapper/307:37:353
25799951,0cyclictest0-21swapper/312:10:123
25799950,5cyclictest25325-21perf09:05:013
25799950,5cyclictest0-21swapper/307:32:023
25709953,1cyclictest60950irq/123-eno107:45:132
25709952,1cyclictest254-21systemd-journal07:15:002
25579955,0cyclictest0-21swapper/111:15:431
25579955,0cyclictest0-21swapper/110:50:111
25579953,1cyclictest0-21swapper/109:24:301
25579952,2cyclictest0-21swapper/111:31:501
25579952,2cyclictest0-21swapper/111:31:491
25579951,2cyclictest0-21swapper/111:55:121
25579951,2cyclictest0-21swapper/110:30:191
25579951,1cyclictest0-21swapper/108:15:121
25579950,4cyclictest0-21swapper/112:28:071
25579950,4cyclictest0-21swapper/112:06:141
25579950,4cyclictest0-21swapper/110:57:531
25579950,4cyclictest0-21swapper/110:25:331
25579950,4cyclictest0-21swapper/110:25:321
25579950,4cyclictest0-21swapper/107:40:181
25579950,3cyclictest0-21swapper/112:00:211
25579950,3cyclictest0-21swapper/110:15:231
25579950,3cyclictest0-21swapper/107:10:111
25579950,2cyclictest0-21swapper/111:50:391
25579950,2cyclictest0-21swapper/109:16:201
25579950,2cyclictest0-21swapper/108:00:151
25579950,1cyclictest0-21swapper/110:35:121
25579950,1cyclictest0-21swapper/108:30:111
25469951,1cyclictest0-21swapper/008:25:120
16568250,0sleep10-21swapper/110:21:261
25799942,1cyclictest0-21swapper/308:00:193
25799940,1cyclictest254-21systemd-journal08:50:203
25799940,1cyclictest254-21systemd-journal08:40:043
25799940,1cyclictest0-21swapper/308:25:123
25579942,1cyclictest24874-21chrt07:55:021
25579942,1cyclictest22651-21chrt08:56:301
25579941,2cyclictest0-21swapper/108:50:101
25579941,2cyclictest0-21swapper/108:35:131
25579941,1cyclictest0-21swapper/107:30:121
25579940,4cyclictest0-21swapper/107:15:011
25579940,3cyclictest0-21swapper/111:25:011
25579940,1cyclictest0-21swapper/107:20:111
25579932,1cyclictest71572sleep108:25:151
25579931,1cyclictest0-21swapper/109:05:121
25579931,1cyclictest0-21swapper/108:40:131
25579931,1cyclictest0-21swapper/108:20:131
25579931,1cyclictest0-21swapper/108:10:111
25579931,1cyclictest0-21swapper/107:50:111
25579930,2cyclictest0-21swapper/109:00:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional