You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-10 - 21:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Mon Nov 10, 2025 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277772215153,22sleep00-21swapper/007:05:470
279332200161,26sleep20-21swapper/207:07:512
279342198159,26sleep30-21swapper/307:07:513
279632197159,25sleep10-21swapper/107:08:141
318962610,0sleep031895-21fschecks_count09:30:130
28193991512,1cyclictest28-21ksoftirqd/209:45:582
248162150,0sleep00-21swapper/008:10:000
2818299140,1cyclictest0-21swapper/012:20:150
257632140,0sleep00-21swapper/009:21:160
28193991311,1cyclictest28-21ksoftirqd/207:59:592
2818299130,1cyclictest0-21swapper/009:35:130
28193991212,0cyclictest28-21ksoftirqd/211:30:132
28193991211,1cyclictest28-21ksoftirqd/211:28:012
28193991211,1cyclictest28-21ksoftirqd/210:35:032
28182991211,1cyclictest9-21ksoftirqd/011:15:010
28182991211,1cyclictest9-21ksoftirqd/010:20:000
28182991210,1cyclictest9-21ksoftirqd/012:30:000
28182991210,1cyclictest9-21ksoftirqd/010:00:210
28182991210,1cyclictest9-21ksoftirqd/008:20:010
2820199118,1cyclictest35-21ksoftirqd/308:10:003
2819399119,1cyclictest28-21ksoftirqd/211:15:162
2819399119,1cyclictest28-21ksoftirqd/210:50:172
2819399119,1cyclictest28-21ksoftirqd/209:20:092
28193991111,0cyclictest28-21ksoftirqd/211:51:182
28193991111,0cyclictest28-21ksoftirqd/209:12:102
28193991110,1cyclictest28-21ksoftirqd/212:39:082
28193991110,1cyclictest28-21ksoftirqd/212:31:212
28193991110,1cyclictest28-21ksoftirqd/212:16:422
28193991110,1cyclictest28-21ksoftirqd/212:14:312
28193991110,1cyclictest28-21ksoftirqd/211:20:172
28193991110,1cyclictest28-21ksoftirqd/211:01:542
28193991110,1cyclictest28-21ksoftirqd/209:53:352
2819399110,10cyclictest0-21swapper/207:10:192
28182991110,1cyclictest9-21ksoftirqd/010:40:190
2818299110,10cyclictest0-21swapper/010:10:190
2818299110,10cyclictest0-21swapper/007:10:140
316812100,0sleep10-21swapper/112:28:231
2820199109,1cyclictest35-21ksoftirqd/312:35:133
2820199109,1cyclictest35-21ksoftirqd/310:40:173
2820199109,1cyclictest35-21ksoftirqd/310:15:193
28201991010,0cyclictest35-21ksoftirqd/311:50:133
2820199100,8cyclictest29840-21python10:10:213
2820199100,6cyclictest31470-21kworker/u8:109:39:253
2819399109,1cyclictest28-21ksoftirqd/211:56:482
2819399109,1cyclictest28-21ksoftirqd/211:45:582
2819399109,1cyclictest28-21ksoftirqd/211:11:402
2819399109,1cyclictest28-21ksoftirqd/211:07:442
2819399109,1cyclictest28-21ksoftirqd/211:07:432
2819399109,1cyclictest28-21ksoftirqd/210:25:162
2819399109,1cyclictest28-21ksoftirqd/210:18:502
2819399109,1cyclictest28-21ksoftirqd/210:10:162
2819399109,1cyclictest28-21ksoftirqd/210:08:012
2819399109,1cyclictest28-21ksoftirqd/210:00:182
2819399109,1cyclictest28-21ksoftirqd/209:59:402
2819399109,1cyclictest28-21ksoftirqd/209:40:212
2819399109,1cyclictest28-21ksoftirqd/209:25:122
2819399109,1cyclictest28-21ksoftirqd/208:15:012
2819399109,1cyclictest28-21ksoftirqd/207:35:152
2819399108,1cyclictest28-21ksoftirqd/210:33:022
2819399108,1cyclictest28-21ksoftirqd/207:20:012
28193991010,0cyclictest28-21ksoftirqd/212:05:132
28193991010,0cyclictest28-21ksoftirqd/209:34:242
2819399101,8cyclictest0-21swapper/212:25:132
2818299109,1cyclictest9-21ksoftirqd/012:05:000
2818299109,1cyclictest9-21ksoftirqd/010:54:590
2818299109,1cyclictest9-21ksoftirqd/010:30:140
2818299108,1cyclictest9-21ksoftirqd/012:10:150
2818299108,1cyclictest9-21ksoftirqd/009:25:140
2818299108,1cyclictest9-21ksoftirqd/009:20:010
2818299108,1cyclictest0-21swapper/009:40:130
2818299100,9cyclictest0-21swapper/009:10:160
282019998,1cyclictest35-21ksoftirqd/311:00:153
282019998,1cyclictest35-21ksoftirqd/310:25:133
282019998,1cyclictest35-21ksoftirqd/309:50:153
281939999,0cyclictest28-21ksoftirqd/210:49:462
281939998,1cyclictest28-21ksoftirqd/212:20:262
281939998,1cyclictest28-21ksoftirqd/212:01:312
281939998,1cyclictest28-21ksoftirqd/211:40:132
281939998,1cyclictest28-21ksoftirqd/211:38:092
281939998,1cyclictest28-21ksoftirqd/210:55:452
281939998,1cyclictest28-21ksoftirqd/210:20:072
281939998,1cyclictest28-21ksoftirqd/209:15:402
281939998,1cyclictest28-21ksoftirqd/208:25:212
281939998,1cyclictest28-21ksoftirqd/207:30:002
281939997,1cyclictest28-21ksoftirqd/208:20:012
281939997,1cyclictest28-21ksoftirqd/207:45:002
281939996,2cyclictest20584-21ssh10:42:512
281939995,3cyclictest11056-21kworker/2:008:05:152
281889990,5cyclictest0-21swapper/112:15:121
281829998,1cyclictest9-21ksoftirqd/011:59:580
281829998,1cyclictest9-21ksoftirqd/011:05:160
281829998,1cyclictest9-21ksoftirqd/011:05:150
281829998,1cyclictest9-21ksoftirqd/010:24:000
281829998,1cyclictest9-21ksoftirqd/009:00:000
282019988,0cyclictest35-21ksoftirqd/311:48:233
282019988,0cyclictest35-21ksoftirqd/310:35:373
282019988,0cyclictest35-21ksoftirqd/310:05:233
282019987,1cyclictest35-21ksoftirqd/312:10:183
282019987,1cyclictest35-21ksoftirqd/311:35:113
282019987,1cyclictest35-21ksoftirqd/310:55:003
282019987,1cyclictest35-21ksoftirqd/309:40:193
282019987,1cyclictest35-21ksoftirqd/309:15:223
282019987,1cyclictest35-21ksoftirqd/308:51:033
282019987,1cyclictest35-21ksoftirqd/308:40:003
282019986,1cyclictest35-21ksoftirqd/310:20:203
282019980,5cyclictest18698-21df_inode11:25:123
282019980,2cyclictest0-21swapper/308:35:133
281939988,0cyclictest28-21ksoftirqd/207:20:112
281939988,0cyclictest28-21ksoftirqd/207:20:102
281939987,1cyclictest28-21ksoftirqd/209:05:002
281939987,1cyclictest28-21ksoftirqd/208:40:012
281939987,1cyclictest28-21ksoftirqd/208:00:182
281939986,1cyclictest3451-21gltestperf09:35:152
281889984,0cyclictest0-21swapper/111:05:221
281889984,0cyclictest0-21swapper/111:05:211
281889980,6cyclictest0-21swapper/109:27:501
281889980,2cyclictest0-21swapper/109:45:131
281829987,1cyclictest9-21ksoftirqd/012:30:000
281829987,1cyclictest9-21ksoftirqd/011:45:150
281829987,1cyclictest9-21ksoftirqd/011:30:140
281829987,1cyclictest9-21ksoftirqd/011:25:120
281829987,1cyclictest9-21ksoftirqd/011:15:170
281829987,1cyclictest9-21ksoftirqd/008:55:000
281829987,1cyclictest9-21ksoftirqd/008:35:000
281829987,1cyclictest9-21ksoftirqd/008:15:000
281829986,1cyclictest9-21ksoftirqd/007:55:000
281829986,1cyclictest12727-21sendmail-msp09:00:000
281829985,3cyclictest9-21ksoftirqd/011:24:590
281829981,3cyclictest1207-21perf07:20:010
281829980,7cyclictest6775-21ssh11:54:020
281829980,7cyclictest16603-21ssh10:36:480
281829980,7cyclictest15888-21diskmemload12:15:150
2800280,0sleep10-21swapper/111:03:331
282019977,0cyclictest35-21ksoftirqd/309:49:483
282019977,0cyclictest35-21ksoftirqd/307:20:133
282019977,0cyclictest35-21ksoftirqd/307:20:123
282019976,1cyclictest35-21ksoftirqd/312:20:163
282019976,1cyclictest35-21ksoftirqd/310:45:163
282019976,1cyclictest35-21ksoftirqd/310:00:153
282019976,1cyclictest19110-21snmpd12:30:283
282019976,1cyclictest19110-21snmpd12:07:093
282019975,1cyclictest30080-21ssh09:27:193
282019974,1cyclictest15888-21diskmemload09:21:133
282019973,2cyclictest15888-21diskmemload10:33:113
282019972,2cyclictest15888-21diskmemload10:57:253
282019970,7cyclictest0-21swapper/311:20:093
282019970,3cyclictest19110-21snmpd11:18:023
282019970,3cyclictest0-21swapper/309:32:263
282019970,2cyclictest0-21swapper/309:55:133
281939976,0cyclictest60950irq/123-eno108:35:122
281939975,1cyclictest28-21ksoftirqd/208:25:002
281939975,1cyclictest28-21ksoftirqd/207:45:212
281939974,1cyclictest28-21ksoftirqd/208:30:012
281939972,4cyclictest6104-21apt-get07:30:112
281939971,2cyclictest15551-21apt-get07:50:122
281939970,3cyclictest10346-21perf08:55:002
281889977,0cyclictest21-21ksoftirqd/107:55:131
281889972,5cyclictest56-21kworker/1:109:13:301
281889971,3cyclictest0-21swapper/111:35:161
281889971,3cyclictest0-21swapper/107:45:131
281889970,7cyclictest0-21swapper/110:35:211
281889970,7cyclictest0-21swapper/108:16:491
281889970,6cyclictest0-21swapper/112:00:181
281889970,6cyclictest0-21swapper/110:24:121
281889970,6cyclictest0-21swapper/110:08:271
281889970,5cyclictest0-21swapper/111:18:011
281889970,5cyclictest0-21swapper/109:53:041
281889970,4cyclictest0-21swapper/109:40:241
281889970,0cyclictest0-21swapper/110:44:591
281889970,0cyclictest0-21swapper/109:22:501
281889970,0cyclictest0-21swapper/107:20:191
281889970,0cyclictest0-21swapper/107:20:181
281829977,0cyclictest9-21ksoftirqd/008:25:010
281829976,1cyclictest9-21ksoftirqd/008:05:000
281829976,1cyclictest9-21ksoftirqd/007:25:010
281829976,1cyclictest9-21ksoftirqd/007:25:000
281829976,1cyclictest19110-21snmpd08:36:300
281829975,1cyclictest9-21ksoftirqd/007:45:000
281829975,1cyclictest7272-21ntpq07:30:180
281829975,1cyclictest30634-21if_err_eno108:20:160
281829972,1cyclictest8461-21/usr/sbin/munin07:35:160
281829970,7cyclictest0-21swapper/011:40:240
281829970,7cyclictest0-21swapper/007:55:190
281829970,6cyclictest7582-21/usr/sbin/munin08:45:110
281829970,6cyclictest5693-21ssh12:35:350
281829970,6cyclictest22219-21fschecks_time10:45:170
281829970,6cyclictest17735-21ssh09:55:140
281829970,6cyclictest15780-21chrt09:08:480
281829970,6cyclictest0-21swapper/008:43:140
281829970,1cyclictest916-21irqstats11:00:170
281829970,1cyclictest27472-21ssh11:36:170
281829970,1cyclictest27032-21ssh10:06:480
281829970,1cyclictest15888-21diskmemload09:50:220
281829970,1cyclictest0-21swapper/012:05:380
281829970,1cyclictest0-21swapper/009:45:440
282019966,0cyclictest35-21ksoftirqd/312:25:143
282019965,1cyclictest9295-21ssh11:11:283
282019965,1cyclictest6980-21cat07:30:143
282019965,1cyclictest35-21ksoftirqd/312:00:163
282019965,1cyclictest35-21ksoftirqd/309:10:153
282019965,1cyclictest35-21ksoftirqd/308:10:163
282019965,1cyclictest35-21ksoftirqd/307:54:593
282019965,1cyclictest35-21ksoftirqd/307:40:173
282019965,1cyclictest35-21ksoftirqd/307:40:003
282019965,1cyclictest29276-21cat07:10:153
282019965,1cyclictest19110-21snmpd09:03:393
282019965,1cyclictest19110-21snmpd08:19:353
282019965,1cyclictest19110-21snmpd07:28:013
282019965,1cyclictest19110-21snmpd07:18:073
282019964,1cyclictest8346-21sed08:45:103
282019963,0cyclictest15888-21diskmemload11:08:493
282019963,0cyclictest15888-21diskmemload11:08:483
282019961,3cyclictest15888-21diskmemload11:56:013
282019961,1cyclictest0-21swapper/312:15:133
282019960,5cyclictest19110-21snmpd08:00:233
282019960,4cyclictest0-21swapper/308:25:123
282019960,1cyclictest0-21swapper/307:55:143
281939966,0cyclictest28-21ksoftirqd/208:45:122
281889966,0cyclictest21-21ksoftirqd/112:10:181
281889966,0cyclictest21-21ksoftirqd/108:45:171
281889966,0cyclictest21-21ksoftirqd/108:01:381
281889966,0cyclictest21-21ksoftirqd/107:25:151
281889962,3cyclictest10582sleep109:31:251
281889962,2cyclictest0-21swapper/110:12:361
281889961,3cyclictest0-21swapper/112:30:041
281889960,6cyclictest0-21swapper/111:45:141
281889960,6cyclictest0-21swapper/109:15:171
281889960,4cyclictest0-21swapper/112:37:391
281889960,4cyclictest0-21swapper/112:05:541
281889960,4cyclictest0-21swapper/111:41:231
281889960,4cyclictest0-21swapper/111:25:051
281889960,4cyclictest0-21swapper/111:12:341
281889960,4cyclictest0-21swapper/110:16:431
281889960,4cyclictest0-21swapper/110:01:031
281889960,4cyclictest0-21swapper/109:55:281
281889960,4cyclictest0-21swapper/109:37:241
281889960,4cyclictest0-21swapper/108:35:131
281889960,3cyclictest0-21swapper/110:25:531
281889960,2cyclictest0-21swapper/108:55:121
281889960,1cyclictest0-21swapper/107:30:211
281889960,0cyclictest0-21swapper/108:25:201
281829965,1cyclictest9-21ksoftirqd/010:25:010
281829965,1cyclictest19110-21snmpd07:47:560
281829960,0cyclictest0-21swapper/010:55:340
282019955,0cyclictest35-21ksoftirqd/311:40:173
282019954,1cyclictest35-21ksoftirqd/309:05:013
282019954,1cyclictest35-21ksoftirqd/308:55:143
282019954,1cyclictest35-21ksoftirqd/307:45:183
282019954,0cyclictest15888-21diskmemload11:30:463
282019952,2cyclictest30204-21cstates08:20:153
282019951,1cyclictest0-21swapper/308:30:153
281939954,1cyclictest28-21ksoftirqd/208:55:112
281939950,2cyclictest254-21systemd-journal09:05:002
281889955,0cyclictest21-21ksoftirqd/111:55:151
281889951,1cyclictest0-21swapper/110:55:121
281889951,1cyclictest0-21swapper/110:40:241
281889950,5cyclictest0-21swapper/108:33:451
281889950,5cyclictest0-21swapper/108:20:321
281889950,4cyclictest0-21swapper/108:11:201
281889950,3cyclictest0-21swapper/110:51:271
281889950,2cyclictest0-21swapper/112:20:151
281889950,2cyclictest0-21swapper/111:32:561
281889950,1cyclictest0-21swapper/111:20:261
281889950,1cyclictest0-21swapper/108:05:141
281889950,0cyclictest0-21swapper/110:31:311
281889950,0cyclictest0-21swapper/107:52:491
281829953,1cyclictest3999-21grep07:25:150
12588250,0sleep10-21swapper/107:40:261
281889943,1cyclictest10227-21chrt07:35:371
281889940,4cyclictest0-21swapper/111:50:161
281889940,3cyclictest30246-21taskset07:11:451
281889940,3cyclictest0-21swapper/109:05:201
281889940,1cyclictest0-21swapper/108:51:111
281889940,1cyclictest0-21swapper/107:15:011
281889931,1cyclictest0-21swapper/108:40:021
281889930,3cyclictest12954-21taskset09:00:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional