You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 05:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Nov 26, 2025 00:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137592209158,26sleep00-21swapper/019:09:100
137132207170,24sleep10-21swapper/119:08:341
137312202162,27sleep20-21swapper/219:08:472
135942197158,26sleep30-21swapper/319:07:043
2698621080,0sleep00-21swapper/020:40:200
168672930,0sleep228-21ksoftirqd/222:05:212
258172670,0sleep00-21swapper/021:35:120
13906991918,1cyclictest9-21ksoftirqd/021:50:000
69142170,0sleep30-21swapper/320:00:143
240442150,0sleep30-21swapper/323:00:213
1392999130,7cyclictest570-21systemd-logind22:05:213
1392299130,1cyclictest0-21swapper/200:00:222
13906991312,1cyclictest9-21ksoftirqd/023:30:170
50022120,0sleep20-21swapper/221:50:152
13929991211,1cyclictest30548-21interrupts23:10:163
13906991211,1cyclictest9-21ksoftirqd/022:15:140
13906991211,1cyclictest9-21ksoftirqd/021:50:000
13906991211,1cyclictest9-21ksoftirqd/021:15:200
13906991210,1cyclictest9-21ksoftirqd/021:40:140
98642110,0sleep00-21swapper/000:12:010
253592110,0sleep07028-21diskmemload23:49:300
1392999119,1cyclictest35-21ksoftirqd/323:20:003
13906991110,0cyclictest262222sleep019:30:360
1390699110,2cyclictest7028-21diskmemload00:15:120
1392999109,1cyclictest35-21ksoftirqd/322:00:133
1392999109,1cyclictest35-21ksoftirqd/320:55:003
1392299109,1cyclictest28-21ksoftirqd/200:05:492
1392299108,1cyclictest28-21ksoftirqd/220:20:002
1392299108,1cyclictest28-21ksoftirqd/219:50:002
1390699109,1cyclictest9-21ksoftirqd/022:25:140
1390699109,1cyclictest9-21ksoftirqd/021:55:180
1390699109,1cyclictest9-21ksoftirqd/021:15:000
1390699109,1cyclictest15958-21sshd19:11:400
1390699109,0cyclictest9-21ksoftirqd/023:15:010
13906991010,0cyclictest9-21ksoftirqd/023:00:220
139299998,1cyclictest35-21ksoftirqd/321:00:013
139299998,1cyclictest35-21ksoftirqd/320:00:013
139299997,1cyclictest35-21ksoftirqd/319:25:003
139299990,4cyclictest0-21swapper/323:05:233
139229999,0cyclictest28-21ksoftirqd/222:42:192
139229998,1cyclictest28-21ksoftirqd/223:06:302
139229990,1cyclictest25016-21ssh23:02:372
139149998,1cyclictest21-21ksoftirqd/122:42:571
139069999,0cyclictest9-21ksoftirqd/023:20:210
139069998,1cyclictest9-21ksoftirqd/019:29:590
139069997,1cyclictest9-21ksoftirqd/021:25:120
139069997,1cyclictest9-21ksoftirqd/019:59:410
139069993,5cyclictest20385-21latency_hist20:29:590
139069990,4cyclictest7553-21apt-get23:25:010
139299988,0cyclictest35-21ksoftirqd/322:10:183
139299987,1cyclictest35-21ksoftirqd/323:35:003
139299987,1cyclictest35-21ksoftirqd/323:25:003
139299987,1cyclictest35-21ksoftirqd/321:25:003
139299986,1cyclictest35-21ksoftirqd/322:45:003
139299986,1cyclictest35-21ksoftirqd/320:40:003
139299983,4cyclictest819-21lldpd19:38:223
139229988,0cyclictest0-21swapper/223:45:262
139229987,1cyclictest28-21ksoftirqd/222:14:362
139229986,2cyclictest255142sleep220:40:082
139229986,1cyclictest8189-21cat21:10:182
139229986,1cyclictest60950irq/123-eno100:37:362
139229986,1cyclictest27060-21cat22:20:172
139229986,1cyclictest19546-21cut20:25:192
139229984,2cyclictest254-21systemd-journal20:55:002
139229980,8cyclictest0-21swapper/200:13:102
139229980,5cyclictest254-21systemd-journal20:15:012
139229980,0cyclictest0-21swapper/220:20:172
139149981,4cyclictest0-21swapper/122:15:281
139149980,8cyclictest0-21swapper/123:05:161
139149980,7cyclictest0-21swapper/122:45:101
139149980,4cyclictest0-21swapper/100:24:561
139069988,0cyclictest9-21ksoftirqd/000:20:180
139069987,1cyclictest9-21ksoftirqd/022:30:180
139069987,1cyclictest9-21ksoftirqd/021:10:000
139069982,5cyclictest26147-21/usr/sbin/munin22:20:160
139069982,4cyclictest11659-21apt-get22:45:100
139069981,4cyclictest18794-21cut22:10:000
139069980,7cyclictest7244-21ssh22:38:120
139069980,7cyclictest31256-21ssh23:55:440
139069980,7cyclictest27963-21ssh23:05:410
139069980,7cyclictest24035-21ssh21:30:450
139069980,7cyclictest19119-21aten_r1power_fr22:10:150
139069980,7cyclictest11726-21ssh22:00:070
139299976,1cyclictest557-21nscd00:19:003
139299975,1cyclictest7028-21diskmemload22:16:133
139299975,1cyclictest35-21ksoftirqd/320:35:003
139299975,1cyclictest32385-21ssh23:59:223
139299974,2cyclictest4554-21apt22:35:123
139299974,1cyclictest35-21ksoftirqd/319:52:363
139299974,1cyclictest35-21ksoftirqd/319:45:363
139299973,2cyclictest7292-21apt-get21:10:123
139299973,2cyclictest254-21systemd-journal19:30:353
139299971,5cyclictest8046-21apt-get23:25:123
139299970,5cyclictest0-21swapper/322:54:133
139299970,4cyclictest0-21swapper/323:39:143
139299970,3cyclictest0-21swapper/322:25:313
139299970,3cyclictest0-21swapper/300:05:123
139229977,0cyclictest28-21ksoftirqd/220:01:412
139229976,1cyclictest60950irq/123-eno123:55:122
139229976,1cyclictest60950irq/123-eno123:53:162
139229976,1cyclictest60950irq/123-eno123:42:542
139229976,1cyclictest60950irq/123-eno123:35:182
139229976,1cyclictest60950irq/123-eno123:20:172
139229976,1cyclictest60950irq/123-eno100:27:152
139229976,0cyclictest60950irq/123-eno121:55:082
139229976,0cyclictest60950irq/123-eno100:31:012
139229975,1cyclictest60950irq/123-eno123:30:122
139229975,1cyclictest60950irq/123-eno122:35:152
139229975,1cyclictest60950irq/123-eno121:25:142
139229975,1cyclictest60950irq/123-eno100:15:162
139229975,1cyclictest28-21ksoftirqd/220:40:002
139229975,1cyclictest19286-21run-parts19:20:002
139229974,1cyclictest60950irq/123-eno122:46:252
139229974,1cyclictest28-21ksoftirqd/221:22:532
139229971,3cyclictest0-21swapper/222:54:172
139229970,6cyclictest546-21irqbalance23:16:352
139229970,6cyclictest0-21swapper/200:20:172
139229970,5cyclictest0-21swapper/222:04:102
139229970,1cyclictest0-21swapper/219:50:112
139149970,6cyclictest0-21swapper/121:40:131
139149970,5cyclictest0-21swapper/119:15:091
139149970,4cyclictest0-21swapper/121:15:141
139149970,1cyclictest0-21swapper/123:49:191
139149970,1cyclictest0-21swapper/122:27:061
139149970,1cyclictest0-21swapper/122:13:421
139149970,1cyclictest0-21swapper/121:50:021
139149970,1cyclictest0-21swapper/121:25:141
139149970,1cyclictest0-21swapper/121:05:001
139149970,1cyclictest0-21swapper/120:10:171
139069977,0cyclictest9-21ksoftirqd/000:25:210
139069976,1cyclictest9-21ksoftirqd/023:50:120
139069976,1cyclictest9-21ksoftirqd/021:00:200
139069976,1cyclictest4198-21ssh00:05:140
139069975,1cyclictest9-21ksoftirqd/023:38:410
139069975,1cyclictest9-21ksoftirqd/020:50:150
139069975,1cyclictest9-21ksoftirqd/020:00:150
139069975,1cyclictest7028-21diskmemload23:42:280
139069975,1cyclictest31362-21latency_hist19:45:000
139069974,2cyclictest21818-21apt-get00:30:110
139069970,6cyclictest3282-21ssh23:17:420
139069970,6cyclictest18981-21basename22:55:120
139069970,6cyclictest15204-21ssh22:50:100
139069970,4cyclictest23149-21apt-get20:35:140
139069970,1cyclictest15166-21diskstats21:20:160
139069970,1cyclictest10400-21ssh22:41:550
139069970,1cyclictest1003-21df_inode00:00:160
139069970,1cyclictest0-21swapper/000:36:420
139299965,1cyclictest9960-21ssh22:40:293
139299965,1cyclictest35-21ksoftirqd/319:15:003
139299965,1cyclictest3268-21ssh21:47:123
139299965,1cyclictest2876-21ssh22:31:163
139299965,1cyclictest2543-21ssh00:01:123
139299965,1cyclictest25059-21ssh23:48:323
139299965,1cyclictest20998-21ssh22:56:133
139299965,1cyclictest20346-21ssh00:26:203
139299965,1cyclictest10819-21ssh21:15:043
139299964,1cyclictest6868-21ssh21:51:433
139299964,1cyclictest11253-21ssh21:59:233
139299964,0cyclictest7028-21diskmemload22:24:473
139299963,1cyclictest254-21systemd-journal21:28:543
139299961,3cyclictest7028-21diskmemload23:52:143
139299961,3cyclictest7028-21diskmemload00:35:103
139299961,3cyclictest21844-21aten_r1power_cu00:30:113
139299960,4cyclictest24913-21sh21:33:153
139299960,4cyclictest0-21swapper/320:20:173
139299960,3cyclictest0-21swapper/321:43:083
139299960,3cyclictest0-21swapper/321:35:113
139229966,0cyclictest60950irq/123-eno123:10:412
139229966,0cyclictest60950irq/123-eno122:30:182
139229966,0cyclictest60950irq/123-eno122:25:022
139229966,0cyclictest60950irq/123-eno121:40:122
139229966,0cyclictest60950irq/123-eno121:35:202
139229966,0cyclictest60950irq/123-eno121:15:032
139229966,0cyclictest60950irq/123-eno121:03:312
139229966,0cyclictest60950irq/123-eno120:30:222
139229966,0cyclictest60950irq/123-eno119:58:402
139229966,0cyclictest60950irq/123-eno119:43:562
139229966,0cyclictest60950irq/123-eno119:37:522
139229966,0cyclictest60950irq/123-eno119:25:142
139229964,1cyclictest60950irq/123-eno121:30:152
139229964,1cyclictest28-21ksoftirqd/219:15:002
139229964,1cyclictest26569-21cron19:35:002
139229962,2cyclictest0-21swapper/219:20:122
139229962,1cyclictest7028-21diskmemload22:15:122
139229961,4cyclictest19973-21missed_timers22:55:162
139229961,2cyclictest254-21systemd-journal21:45:022
139229960,5cyclictest0-21swapper/223:25:172
139149966,0cyclictest0-21swapper/121:47:191
139149963,2cyclictest31600-21taskset23:10:561
139149961,3cyclictest0-21swapper/122:10:001
139149961,0cyclictest0-21swapper/122:34:201
139149960,6cyclictest0-21swapper/123:53:211
139149960,6cyclictest0-21swapper/123:35:161
139149960,6cyclictest0-21swapper/119:25:211
139149960,4cyclictest0-21swapper/122:56:261
139149960,3cyclictest0-21swapper/123:56:121
139149960,3cyclictest0-21swapper/123:15:131
139149960,2cyclictest0-21swapper/121:30:131
139149960,2cyclictest0-21swapper/121:21:061
139149960,2cyclictest0-21swapper/121:05:111
139149960,1cyclictest0-21swapper/123:24:291
139149960,1cyclictest0-21swapper/122:21:071
139149960,1cyclictest0-21swapper/100:10:161
139149960,0cyclictest0-21swapper/100:25:151
139149960,0cyclictest0-21swapper/100:01:301
139069965,1cyclictest9-21ksoftirqd/020:30:150
139069964,1cyclictest9-21ksoftirqd/020:20:130
139069964,1cyclictest9-21ksoftirqd/019:15:010
139069962,3cyclictest11128-21/usr/sbin/munin20:10:170
139069961,2cyclictest0-21swapper/019:20:110
139069960,6cyclictest0-21swapper/020:05:180
139069960,6cyclictest0-21swapper/019:47:040
139069960,1cyclictest0-21swapper/019:35:130
139069960,0cyclictest0-21swapper/020:57:380
139069960,0cyclictest0-21swapper/019:50:120
139299954,1cyclictest13498-21aten_r1power_cu20:15:143
139299952,1cyclictest254-21systemd-journal19:28:213
139299951,1cyclictest15194-21df00:20:143
139299950,3cyclictest30733-21timerwakeupswit19:40:203
139299950,3cyclictest254-21systemd-journal20:50:003
139299950,2cyclictest0-21swapper/323:40:223
139299950,1cyclictest0-21swapper/321:05:103
139299950,1cyclictest0-21swapper/300:10:403
139229955,0cyclictest60950irq/123-eno121:05:162
139229955,0cyclictest60950irq/123-eno120:05:012
139229953,1cyclictest60950irq/123-eno120:55:162
139229951,3cyclictest29880-21taskset20:48:392
139149955,0cyclictest0-21swapper/120:48:101
139149953,1cyclictest25368-21chrt19:30:171
139149953,1cyclictest0-21swapper/119:15:001
139149952,1cyclictest0-21swapper/120:50:171
139149950,5cyclictest0-21swapper/120:30:001
139149950,5cyclictest0-21swapper/119:35:191
139149950,4cyclictest0-21swapper/122:00:321
139149950,4cyclictest0-21swapper/119:55:151
139149950,4cyclictest0-21swapper/100:35:151
139149950,3cyclictest0-21swapper/123:30:201
139149950,3cyclictest0-21swapper/123:27:231
139149950,3cyclictest0-21swapper/122:35:021
139149950,3cyclictest0-21swapper/100:30:111
139149950,3cyclictest0-21swapper/100:15:191
139149950,2cyclictest0-21swapper/121:11:371
139149950,2cyclictest0-21swapper/119:50:121
139149950,1cyclictest0-21swapper/123:00:161
139149950,1cyclictest0-21swapper/122:51:011
139149950,1cyclictest0-21swapper/121:55:331
139149950,1cyclictest0-21swapper/121:35:191
139149950,1cyclictest0-21swapper/119:45:151
139149950,1cyclictest0-21swapper/119:20:131
139149950,1cyclictest0-21swapper/100:05:241
139069951,1cyclictest13992-21df20:15:150
139299943,1cyclictest9446-21grep20:05:133
139299940,3cyclictest16988-21fschecks_time19:15:023
139299940,1cyclictest3361-21hwlatdetect21:00:163
139299940,1cyclictest26318-21grep20:40:153
139299940,1cyclictest0-21swapper/320:25:133
139299940,1cyclictest0-21swapper/320:10:153
139149943,1cyclictest0-21swapper/120:25:121
139149942,1cyclictest239632sleep120:35:161
139149941,2cyclictest0-21swapper/120:00:121
139149940,4cyclictest27381-21chrt20:41:491
139149940,4cyclictest0-21swapper/120:06:171
139149940,4cyclictest0-21swapper/119:40:191
139149940,3cyclictest0-21swapper/123:40:251
139149940,3cyclictest0-21swapper/120:55:111
139149940,2cyclictest0-21swapper/120:20:111
139069940,4cyclictest0-21swapper/020:45:030
139149931,0cyclictest0-21swapper/120:15:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional