You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 02:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Tue Nov 25, 2025 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
154692215131,55sleep20-21swapper/219:07:392
153732206157,24sleep00-21swapper/019:06:250
154652200164,23sleep30-21swapper/319:07:363
154162197159,25sleep10-21swapper/119:06:581
56852740,0sleep10-21swapper/122:35:001
67252220,0sleep121-21ksoftirqd/122:35:161
1575499190,18cyclictest0-21swapper/119:15:111
133352170,0sleep00-21swapper/023:30:190
15761991612,1cyclictest28-21ksoftirqd/221:11:092
15761991511,1cyclictest28-21ksoftirqd/200:26:412
15761991311,1cyclictest28-21ksoftirqd/220:55:002
1575499130,12cyclictest0-21swapper/123:30:151
1574899130,12cyclictest0-21swapper/021:15:220
15761991211,1cyclictest28-21ksoftirqd/222:30:142
15761991211,1cyclictest28-21ksoftirqd/222:20:192
15761991210,1cyclictest28-21ksoftirqd/221:55:122
15761991210,1cyclictest28-21ksoftirqd/221:53:332
1574899120,12cyclictest0-21swapper/019:15:110
1576199119,1cyclictest28-21ksoftirqd/223:10:212
15761991110,1cyclictest28-21ksoftirqd/223:25:062
15761991110,1cyclictest28-21ksoftirqd/221:48:262
15761991110,1cyclictest28-21ksoftirqd/200:05:212
1574899119,1cyclictest9-21ksoftirqd/022:00:000
1574899119,1cyclictest9-21ksoftirqd/020:20:000
1574899119,1cyclictest9-21ksoftirqd/000:05:150
250222100,0sleep30-21swapper/323:00:223
1576999108,1cyclictest35-21ksoftirqd/321:10:003
1576199109,1cyclictest28-21ksoftirqd/223:46:492
1576199109,1cyclictest28-21ksoftirqd/223:40:212
1576199109,1cyclictest28-21ksoftirqd/223:37:532
1576199109,1cyclictest28-21ksoftirqd/223:31:332
1576199109,1cyclictest28-21ksoftirqd/222:56:442
1576199109,1cyclictest28-21ksoftirqd/219:45:112
1576199109,1cyclictest28-21ksoftirqd/219:15:002
1576199109,1cyclictest28-21ksoftirqd/200:14:162
1576199108,1cyclictest28-21ksoftirqd/223:09:062
1576199108,1cyclictest28-21ksoftirqd/222:25:152
1576199108,1cyclictest28-21ksoftirqd/222:05:152
1576199108,1cyclictest28-21ksoftirqd/220:40:012
1576199108,1cyclictest28-21ksoftirqd/200:20:162
1576199107,3cyclictest28-21ksoftirqd/221:15:112
15761991010,0cyclictest28-21ksoftirqd/222:50:142
15761991010,0cyclictest28-21ksoftirqd/222:40:132
15761991010,0cyclictest28-21ksoftirqd/221:20:082
1574899109,1cyclictest9-21ksoftirqd/000:15:000
1574899108,1cyclictest9-21ksoftirqd/023:15:460
157699997,1cyclictest35-21ksoftirqd/321:05:003
157619999,0cyclictest28-21ksoftirqd/223:55:212
157619999,0cyclictest28-21ksoftirqd/221:38:192
157619999,0cyclictest28-21ksoftirqd/221:38:182
157619999,0cyclictest28-21ksoftirqd/221:30:212
157619999,0cyclictest0-21swapper/200:31:542
157619998,1cyclictest28-21ksoftirqd/223:50:132
157619998,1cyclictest28-21ksoftirqd/222:00:152
157619998,1cyclictest28-21ksoftirqd/221:26:292
157619998,1cyclictest28-21ksoftirqd/200:39:572
157619998,1cyclictest28-21ksoftirqd/200:00:212
157619997,1cyclictest28-21ksoftirqd/221:40:212
157619997,1cyclictest28-21ksoftirqd/220:25:002
157619997,1cyclictest28-21ksoftirqd/220:10:112
157549990,8cyclictest0-21swapper/122:15:121
157489997,1cyclictest9-21ksoftirqd/019:40:000
157489993,3cyclictest17678-21ntp_states22:50:170
157489991,4cyclictest26137-21sort00:35:010
157699987,1cyclictest16210-21sh22:50:003
157699982,5cyclictest19226-21apt-get00:25:123
157699981,5cyclictest0-21swapper/322:24:043
157699981,4cyclictest254-21systemd-journal21:38:283
157699981,4cyclictest254-21systemd-journal21:38:283
157699980,4cyclictest1449-21ntpd21:20:193
157699980,3cyclictest13449-21/usr/sbin/munin00:15:203
157699980,3cyclictest0-21swapper/300:07:063
157619988,0cyclictest28-21ksoftirqd/222:35:162
157619988,0cyclictest28-21ksoftirqd/219:40:242
157619987,1cyclictest28-21ksoftirqd/223:15:172
157619987,1cyclictest28-21ksoftirqd/223:00:122
157619987,1cyclictest28-21ksoftirqd/222:49:402
157619987,1cyclictest28-21ksoftirqd/200:15:142
157619986,1cyclictest28-21ksoftirqd/220:05:002
157619984,2cyclictest60950irq/123-eno123:20:542
157619981,5cyclictest18159-21kworker/2:022:15:122
157549980,8cyclictest0-21swapper/123:20:191
157549980,4cyclictest0-21swapper/121:25:141
157489986,1cyclictest2190-21sort22:30:000
157489980,7cyclictest6382-21grep22:35:150
157489980,7cyclictest30384-21ssh22:23:300
157489980,7cyclictest26355-21ssh23:03:400
157489980,7cyclictest15660-21ssh22:48:200
157489980,7cyclictest12101-21ssh22:43:220
157489980,6cyclictest254-21systemd-journal21:05:120
157489980,4cyclictest25887-21latency_hist19:30:000
157489980,4cyclictest23580-21kworker/u8:121:30:550
157699977,0cyclictest35-21ksoftirqd/322:10:293
157699976,1cyclictest1983-21missed_timers19:45:173
157699975,1cyclictest28425-21cat20:40:163
157699975,1cyclictest27112-21ssh21:33:353
157699973,3cyclictest6414-21cpu21:50:113
157699972,1cyclictest0-21swapper/322:04:313
157699971,4cyclictest18643-21taskset22:05:243
157699971,4cyclictest0-21swapper/319:35:213
157699971,3cyclictest9256-21diskmemload23:40:093
157699970,4cyclictest10281-21ssh21:55:143
157699970,4cyclictest0-21swapper/323:29:463
157699970,3cyclictest0-21swapper/323:31:073
157699970,3cyclictest0-21swapper/323:19:433
157699970,3cyclictest0-21swapper/300:31:373
157699970,2cyclictest0-21swapper/323:08:103
157699970,2cyclictest0-21swapper/321:41:353
157619977,0cyclictest28-21ksoftirqd/222:10:172
157619976,1cyclictest60950irq/123-eno120:39:022
157619976,1cyclictest60950irq/123-eno119:50:182
157619976,1cyclictest28-21ksoftirqd/220:05:142
157619975,1cyclictest28-21ksoftirqd/221:05:142
157619975,1cyclictest18159-21kworker/2:020:15:192
157619973,2cyclictest24237-21/usr/sbin/munin19:25:142
157549971,5cyclictest0-21swapper/123:39:191
157549970,7cyclictest0-21swapper/121:31:021
157549970,1cyclictest0-21swapper/121:15:001
157489976,1cyclictest9256-21diskmemload23:45:570
157489975,1cyclictest9-21ksoftirqd/000:17:100
157489975,1cyclictest29349-21mailstats21:35:210
157489975,1cyclictest29349-21mailstats21:35:210
157489975,1cyclictest26396-21aten_r1power_en00:35:110
157489975,1cyclictest0-21swapper/022:15:100
157489972,4cyclictest0-21swapper/023:55:250
157489971,6cyclictest29467-21ssh23:07:210
157489971,2cyclictest0-21swapper/000:20:140
157489970,7cyclictest21166-21ntpq22:55:180
157489970,6cyclictest8105-21ssh21:50:360
157489970,6cyclictest7924-1kworker/u9:121:10:530
157489970,6cyclictest4477-21ssh22:31:400
157489970,6cyclictest398-21ssh21:40:200
157489970,6cyclictest3627-21ssh00:02:170
157489970,6cyclictest19223-21/usr/sbin/munin00:25:180
157489970,6cyclictest17812-21ssh23:36:060
157489970,6cyclictest0-21swapper/023:10:130
157489970,6cyclictest0-21swapper/021:20:140
157489970,6cyclictest0-21swapper/020:20:160
157489970,1cyclictest3904-21ssh21:45:190
157489970,1cyclictest29381-21ssh23:54:140
157489970,1cyclictest254-21systemd-journal23:30:000
157489970,1cyclictest19688-21ssh22:08:490
157489970,1cyclictest15719-21ssh22:02:240
157489970,1cyclictest0-21swapper/023:21:010
157489970,1cyclictest0-21swapper/021:28:540
157489970,1cyclictest0-21swapper/020:30:190
157699965,1cyclictest9322-21ssh22:40:063
157699965,1cyclictest9256-21diskmemload23:38:343
157699965,1cyclictest6014-21ssh22:35:133
157699965,1cyclictest31128-21ssh23:55:193
157699965,1cyclictest28895-21ssh00:37:433
157699965,1cyclictest18689-21ssh22:51:403
157699965,1cyclictest11708-21ssh21:11:503
157699964,1cyclictest26618-21ssh22:18:273
157699964,1cyclictest23186-21ssh21:27:473
157699964,1cyclictest15335-21ssh21:16:323
157699964,1cyclictest1449-21ntpd23:11:223
157699963,1cyclictest278-21systemd-udevd21:49:093
157699963,1cyclictest254-21systemd-journal19:30:003
157699962,2cyclictest0-21swapper/320:20:173
157699961,3cyclictest9256-21diskmemload23:47:293
157699961,3cyclictest0-21swapper/323:20:113
157699961,1cyclictest31261-21telnet22:25:133
157699961,1cyclictest26381-21/usr/sbin/munin23:50:183
157699961,1cyclictest0-21swapper/320:55:123
157699960,3cyclictest0-21swapper/322:56:473
157699960,3cyclictest0-21swapper/300:00:023
157699960,2cyclictest0-21swapper/322:30:103
157699960,2cyclictest0-21swapper/320:05:123
157699960,2cyclictest0-21swapper/300:11:183
157619966,0cyclictest60950irq/123-eno119:30:132
157619965,1cyclictest60950irq/123-eno119:35:142
157619965,1cyclictest2398-21apt-get20:55:122
157619965,1cyclictest18159-21kworker/2:019:20:172
157619964,1cyclictest60950irq/123-eno120:45:152
157619964,1cyclictest28-21ksoftirqd/220:30:152
157619964,1cyclictest28-21ksoftirqd/219:55:132
157619964,1cyclictest28-21ksoftirqd/219:10:122
157619962,2cyclictest254-21systemd-journal20:25:002
157549963,2cyclictest0-21swapper/120:10:161
157549961,2cyclictest0-21swapper/121:23:391
157549961,1cyclictest0-21swapper/122:47:361
157549960,6cyclictest0-21swapper/123:59:071
157549960,6cyclictest0-21swapper/123:25:291
157549960,6cyclictest0-21swapper/100:12:151
157549960,4cyclictest0-21swapper/123:40:181
157549960,4cyclictest0-21swapper/121:48:151
157549960,4cyclictest0-21swapper/121:18:481
157549960,4cyclictest0-21swapper/100:35:051
157549960,3cyclictest0-21swapper/100:30:131
157549960,2cyclictest0-21swapper/121:50:161
157489965,1cyclictest18085-1kworker/u9:223:40:110
157489964,1cyclictest26082-21/usr/sbin/munin19:30:180
157489962,2cyclictest0-21swapper/020:40:180
157489961,3cyclictest940-21/usr/sbin/munin19:45:140
157489961,2cyclictest254-21systemd-journal19:44:590
157489961,2cyclictest254-21systemd-journal19:15:000
157489961,0cyclictest22827-21ssh22:12:380
157489960,6cyclictest0-21swapper/020:00:140
157489960,6cyclictest0-21swapper/019:54:170
157489960,2cyclictest0-21swapper/020:25:130
157489960,0cyclictest4774-21dpkg21:00:110
157489960,0cyclictest0-21swapper/020:46:460
157489960,0cyclictest0-21swapper/020:35:300
157489960,0cyclictest0-21swapper/020:14:050
157699954,1cyclictest7028-21ntpq19:55:183
157699954,1cyclictest15009-21sshd20:14:213
157699953,1cyclictest32461-21apt-get20:50:113
157699953,1cyclictest24969-21/usr/sbin/munin20:35:123
157699953,1cyclictest20559-21df_inode20:25:143
157699953,1cyclictest0-21swapper/320:45:133
157699952,2cyclictest17457-21perf20:20:003
157699951,3cyclictest0-21swapper/319:50:133
157699951,1cyclictest0-21swapper/300:20:273
157699950,5cyclictest0-21swapper/320:30:563
157699950,5cyclictest0-21swapper/320:03:053
157699950,5cyclictest0-21swapper/319:41:103
157619951,0cyclictest4772-21apt-get21:00:102
157549955,0cyclictest0-21swapper/121:07:271
157549955,0cyclictest0-21swapper/119:45:221
157549955,0cyclictest0-21swapper/100:26:341
157549954,1cyclictest0-21swapper/119:55:191
157549953,1cyclictest154082sleep120:15:151
157549951,2cyclictest0-21swapper/120:05:001
157549951,1cyclictest0-21swapper/119:30:131
157549950,5cyclictest0-21swapper/123:50:171
157549950,5cyclictest0-21swapper/123:45:151
157549950,5cyclictest0-21swapper/119:35:221
157549950,4cyclictest0-21swapper/123:10:451
157549950,3cyclictest0-21swapper/122:50:111
157549950,3cyclictest0-21swapper/121:55:141
157549950,3cyclictest0-21swapper/121:40:051
157549950,3cyclictest0-21swapper/120:35:191
157549950,2cyclictest0-21swapper/123:15:131
157549950,2cyclictest0-21swapper/123:05:011
157549950,2cyclictest0-21swapper/122:56:181
157549950,2cyclictest0-21swapper/122:42:541
157549950,2cyclictest0-21swapper/122:22:331
157549950,2cyclictest0-21swapper/122:11:301
157549950,2cyclictest0-21swapper/100:05:011
157549950,2cyclictest0-21swapper/100:00:161
157549950,1cyclictest0-21swapper/122:06:181
157549950,1cyclictest0-21swapper/122:00:371
157549950,0cyclictest0-21swapper/119:40:161
157549950,0cyclictest0-21swapper/100:17:481
157489950,5cyclictest0-21swapper/019:55:110
157489950,4cyclictest32458-21/usr/sbin/munin20:50:150
157489950,4cyclictest2664-21cut20:55:140
157489950,4cyclictest10597-21dpkg20:05:110
157489950,2cyclictest254-21systemd-journal19:20:000
157699943,1cyclictest27053-21grep19:30:183
157699943,0cyclictest15941-21apt-get19:10:123
157699942,1cyclictest21358-21chrt19:20:063
157699940,1cyclictest254-21systemd-journal19:17:393
157549944,0cyclictest0-21swapper/120:07:161
157549943,1cyclictest293652sleep120:41:181
157549941,2cyclictest0-21swapper/120:30:121
157549941,1cyclictest0-21swapper/122:25:121
157549940,3cyclictest29761-21taskset21:35:321
157549940,3cyclictest29761-21taskset21:35:321
157549940,2cyclictest0-21swapper/123:00:131
157549940,2cyclictest0-21swapper/119:26:221
157549940,1cyclictest0-21swapper/121:00:121
157549940,1cyclictest0-21swapper/119:20:121
157549940,1cyclictest0-21swapper/119:10:121
157549940,1cyclictest0-21swapper/100:20:211
157549931,1cyclictest0-21swapper/120:45:031
157549931,1cyclictest0-21swapper/120:20:121
157549931,1cyclictest0-21swapper/119:50:131
157549930,3cyclictest0-21swapper/120:25:201
157549930,2cyclictest0-21swapper/120:50:001
157549930,1cyclictest0-21swapper/120:55:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional