You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 01:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Mon Nov 24, 2025 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
325842206156,24sleep00-21swapper/019:06:050
326592204156,23sleep30-21swapper/319:07:053
307672202162,26sleep20-21swapper/219:05:022
326522198145,41sleep10-21swapper/119:06:581
248412660,0sleep352899cyclictest21:05:153
326972650,0sleep20-21swapper/223:34:302
315222650,0sleep10-21swapper/100:17:391
234522550,0sleep20-21swapper/219:55:142
523992019,1cyclictest28-21ksoftirqd/222:50:122
528991818,0cyclictest35-21ksoftirqd/321:11:183
528991818,0cyclictest35-21ksoftirqd/300:11:053
523991818,0cyclictest28-21ksoftirqd/221:10:162
523991817,1cyclictest28-21ksoftirqd/220:15:172
514991816,1cyclictest200052sleep121:45:121
528991717,0cyclictest35-21ksoftirqd/322:45:443
523991717,0cyclictest28-21ksoftirqd/221:55:132
523991717,0cyclictest28-21ksoftirqd/221:44:092
523991717,0cyclictest28-21ksoftirqd/200:00:372
523991716,1cyclictest28-21ksoftirqd/220:40:142
523991716,1cyclictest28-21ksoftirqd/219:25:192
80382160,0sleep30-21swapper/323:45:123
528991616,0cyclictest35-21ksoftirqd/322:35:183
523991616,0cyclictest28-21ksoftirqd/223:36:322
523991615,1cyclictest28-21ksoftirqd/223:17:252
523991615,1cyclictest28-21ksoftirqd/222:42:512
523991615,1cyclictest28-21ksoftirqd/222:30:132
528991515,0cyclictest35-21ksoftirqd/323:09:503
528991515,0cyclictest35-21ksoftirqd/322:53:423
528991514,1cyclictest35-21ksoftirqd/321:20:063
523991515,0cyclictest28-21ksoftirqd/223:55:412
523991515,0cyclictest28-21ksoftirqd/223:10:142
523991515,0cyclictest28-21ksoftirqd/221:53:312
523991515,0cyclictest28-21ksoftirqd/221:23:482
523991514,1cyclictest28-21ksoftirqd/223:28:132
523991514,1cyclictest28-21ksoftirqd/220:36:542
523991514,0cyclictest28-21ksoftirqd/200:12:452
523991513,1cyclictest28-21ksoftirqd/219:25:002
523991511,4cyclictest28-21ksoftirqd/222:25:222
528991414,0cyclictest35-21ksoftirqd/323:24:313
528991414,0cyclictest35-21ksoftirqd/323:00:333
528991414,0cyclictest35-21ksoftirqd/322:32:403
528991414,0cyclictest35-21ksoftirqd/321:44:353
528991414,0cyclictest35-21ksoftirqd/300:30:413
528991414,0cyclictest35-21ksoftirqd/300:09:153
523991414,0cyclictest28-21ksoftirqd/221:30:192
523991414,0cyclictest28-21ksoftirqd/200:32:212
523991414,0cyclictest28-21ksoftirqd/200:19:582
523991413,1cyclictest28-21ksoftirqd/223:01:432
523991413,1cyclictest28-21ksoftirqd/222:10:002
528991313,0cyclictest35-21ksoftirqd/323:31:483
528991313,0cyclictest35-21ksoftirqd/323:10:063
528991313,0cyclictest35-21ksoftirqd/322:25:113
528991313,0cyclictest35-21ksoftirqd/322:15:483
528991313,0cyclictest35-21ksoftirqd/321:53:293
528991313,0cyclictest35-21ksoftirqd/321:39:103
528991313,0cyclictest35-21ksoftirqd/321:39:103
528991313,0cyclictest35-21ksoftirqd/321:17:573
528991312,1cyclictest35-21ksoftirqd/300:40:003
523991313,0cyclictest28-21ksoftirqd/223:48:092
523991313,0cyclictest28-21ksoftirqd/222:46:302
523991313,0cyclictest28-21ksoftirqd/222:38:042
523991313,0cyclictest28-21ksoftirqd/221:47:212
523991313,0cyclictest28-21ksoftirqd/221:29:122
523991313,0cyclictest0-21swapper/200:24:262
523991312,1cyclictest28-21ksoftirqd/222:55:122
523991312,1cyclictest28-21ksoftirqd/221:18:412
523991312,1cyclictest28-21ksoftirqd/219:50:012
523991312,1cyclictest28-21ksoftirqd/219:15:002
523991312,1cyclictest28-21ksoftirqd/200:35:172
523991311,2cyclictest28-21ksoftirqd/223:42:422
523991311,1cyclictest28-21ksoftirqd/223:25:002
523991311,1cyclictest28-21ksoftirqd/222:00:172
523991311,1cyclictest28-21ksoftirqd/221:35:172
523991311,1cyclictest28-21ksoftirqd/221:35:172
523991311,1cyclictest28-21ksoftirqd/219:20:002
523991311,1cyclictest28-21ksoftirqd/219:20:002
523991311,1cyclictest28-21ksoftirqd/200:25:172
51499130,12cyclictest0-21swapper/122:40:181
528991212,0cyclictest35-21ksoftirqd/323:59:133
528991212,0cyclictest35-21ksoftirqd/323:39:283
528991212,0cyclictest35-21ksoftirqd/322:42:153
528991212,0cyclictest35-21ksoftirqd/321:58:343
528991212,0cyclictest35-21ksoftirqd/321:27:293
528991212,0cyclictest35-21ksoftirqd/300:20:373
528991212,0cyclictest35-21ksoftirqd/300:01:203
528991211,1cyclictest35-21ksoftirqd/323:00:003
528991211,1cyclictest35-21ksoftirqd/300:25:203
523991212,0cyclictest28-21ksoftirqd/222:20:482
523991211,1cyclictest28-21ksoftirqd/223:05:192
523991211,1cyclictest28-21ksoftirqd/220:55:132
523991211,1cyclictest28-21ksoftirqd/220:15:002
523991211,1cyclictest28-21ksoftirqd/219:40:002
523991210,1cyclictest28-21ksoftirqd/223:55:002
523991210,1cyclictest28-21ksoftirqd/220:55:002
523991210,1cyclictest28-21ksoftirqd/220:35:002
523991210,1cyclictest28-21ksoftirqd/220:05:002
523991210,1cyclictest28-21ksoftirqd/219:50:002
523991210,1cyclictest28-21ksoftirqd/200:05:152
50999124,4cyclictest23119-21perf19:55:000
52899119,1cyclictest35-21ksoftirqd/320:35:143
52899119,1cyclictest35-21ksoftirqd/319:40:193
52899118,2cyclictest14856-21cat19:35:203
528991111,0cyclictest35-21ksoftirqd/323:40:103
528991111,0cyclictest35-21ksoftirqd/323:25:233
528991111,0cyclictest35-21ksoftirqd/322:10:163
528991110,1cyclictest35-21ksoftirqd/323:15:133
528991110,1cyclictest35-21ksoftirqd/322:20:223
528991110,1cyclictest35-21ksoftirqd/322:00:003
528991110,1cyclictest35-21ksoftirqd/321:45:123
528991110,1cyclictest35-21ksoftirqd/321:00:003
528991110,1cyclictest35-21ksoftirqd/319:55:003
528991110,1cyclictest35-21ksoftirqd/319:50:003
528991110,1cyclictest35-21ksoftirqd/319:25:003
528991110,1cyclictest35-21ksoftirqd/300:15:203
528991110,0cyclictest35-21ksoftirqd/322:05:043
52399117,4cyclictest28-21ksoftirqd/219:30:182
523991110,1cyclictest28-21ksoftirqd/222:15:122
523991110,1cyclictest28-21ksoftirqd/222:10:162
523991110,1cyclictest28-21ksoftirqd/221:10:002
523991110,1cyclictest28-21ksoftirqd/221:00:172
523991110,1cyclictest28-21ksoftirqd/220:50:002
523991110,1cyclictest28-21ksoftirqd/220:30:002
523991110,1cyclictest28-21ksoftirqd/220:25:002
523991110,1cyclictest28-21ksoftirqd/220:05:122
523991110,1cyclictest28-21ksoftirqd/219:40:002
50999113,4cyclictest4007-21/usr/sbin/munin23:40:000
50999112,4cyclictest101rcuc/020:15:000
509991110,1cyclictest9-21ksoftirqd/021:25:000
30572110,0sleep00-21swapper/020:20:150
52899109,1cyclictest35-21ksoftirqd/323:50:143
52899109,1cyclictest35-21ksoftirqd/321:00:163
52899109,1cyclictest35-21ksoftirqd/320:40:213
52899109,1cyclictest35-21ksoftirqd/320:30:193
52899109,1cyclictest35-21ksoftirqd/320:25:173
52899109,1cyclictest35-21ksoftirqd/320:20:163
52899109,1cyclictest35-21ksoftirqd/320:15:183
52899109,1cyclictest35-21ksoftirqd/320:10:213
52899109,1cyclictest35-21ksoftirqd/319:10:153
52899109,0cyclictest35-21ksoftirqd/321:30:123
52899109,0cyclictest35-21ksoftirqd/319:25:163
52899108,1cyclictest35-21ksoftirqd/320:05:143
52899108,1cyclictest35-21ksoftirqd/319:30:153
528991010,0cyclictest35-21ksoftirqd/320:00:143
50999108,1cyclictest23952-21tune2fs19:55:150
50999104,5cyclictest3273-21kworker/0:100:03:050
50999103,6cyclictest8552-21perf22:15:000
50999100,1cyclictest3710-21ssh00:25:130
5289999,0cyclictest35-21ksoftirqd/319:20:003
5289999,0cyclictest35-21ksoftirqd/319:20:003
5289998,1cyclictest35-21ksoftirqd/320:50:173
5289998,1cyclictest35-21ksoftirqd/320:45:173
5149990,5cyclictest0-21swapper/119:35:111
5099998,1cyclictest9-21ksoftirqd/022:28:350
5099996,1cyclictest254-21systemd-journal21:48:220
5099990,7cyclictest31497-21if_eno122:00:170
5289988,0cyclictest35-21ksoftirqd/319:55:063
5149981,4cyclictest0-21swapper/120:40:171
5149980,4cyclictest0-21swapper/120:05:121
5099982,3cyclictest26321-21diskmemload22:08:590
5099980,8cyclictest0-21swapper/023:40:180
5099980,7cyclictest26321-21diskmemload23:00:570
5099980,1cyclictest13686-21ssh23:52:090
5149971,4cyclictest0-21swapper/121:10:121
5149971,3cyclictest0-21swapper/123:40:121
5149970,7cyclictest0-21swapper/100:35:211
5149970,6cyclictest0-21swapper/121:24:411
5149970,4cyclictest0-21swapper/121:40:001
5149970,4cyclictest0-21swapper/121:40:001
5149970,4cyclictest0-21swapper/100:31:501
5149970,4cyclictest0-21swapper/100:05:151
5149970,2cyclictest0-21swapper/122:30:001
5149970,1cyclictest0-21swapper/121:50:121
5099976,1cyclictest9-21ksoftirqd/021:00:200
5099976,1cyclictest8973-21cpu22:15:130
5099975,1cyclictest803-21sshd20:33:540
5099975,1cyclictest29890-21hwlatdetect00:15:200
5099975,1cyclictest11787-21cat19:30:170
5099973,2cyclictest26321-21diskmemload21:50:160
5099973,1cyclictest254-21systemd-journal22:55:380
5099972,4cyclictest1132-21/usr/sbin/munin22:50:150
5099972,2cyclictest254-21systemd-journal22:40:080
5099971,6cyclictest24782-21ssh00:08:380
5099971,2cyclictest26321-21diskmemload23:45:190
5099970,6cyclictest7277-21grep20:30:000
5099970,6cyclictest32565-21apt-get00:20:110
5099970,6cyclictest26321-21diskmemload21:10:490
5099970,6cyclictest26045-21ssh23:25:080
5099970,6cyclictest25793-1kworker/u9:021:55:140
5099970,6cyclictest24276-21ssh23:20:530
5099970,6cyclictest19972-21ntp_states23:15:170
5099970,6cyclictest18182-21ssh23:13:590
5099970,6cyclictest16461-21ssh21:40:080
5099970,6cyclictest16039-21ssh23:55:180
5099970,6cyclictest14657-21ssh21:35:330
5099970,6cyclictest14657-21ssh21:35:330
5099970,6cyclictest14331-21sh22:21:010
5099970,6cyclictest11984-21ssh23:05:130
5099970,6cyclictest11954-21ssh21:33:240
5099970,6cyclictest11912-21ssh00:35:180
5099970,6cyclictest0-21swapper/021:15:180
5099970,6cyclictest0-21swapper/019:45:190
5099970,3cyclictest0-21swapper/022:34:590
5099970,3cyclictest0-21swapper/000:10:200
5099970,1cyclictest9699-21ssh00:32:330
5099970,1cyclictest26363-21grep20:00:150
5099970,1cyclictest26321-21diskmemload23:30:050
5099970,1cyclictest26321-21diskmemload22:38:050
5149966,0cyclictest0-21swapper/123:33:041
5149966,0cyclictest0-21swapper/122:38:021
5149966,0cyclictest0-21swapper/122:05:111
5149961,2cyclictest0-21swapper/100:00:441
5149961,1cyclictest0-21swapper/122:45:101
5149961,1cyclictest0-21swapper/121:15:111
5149960,6cyclictest0-21swapper/119:50:161
5149960,5cyclictest0-21swapper/123:35:151
5149960,4cyclictest0-21swapper/123:45:121
5149960,4cyclictest0-21swapper/123:06:051
5149960,4cyclictest0-21swapper/122:58:411
5149960,4cyclictest0-21swapper/122:20:041
5149960,4cyclictest0-21swapper/122:17:291
5149960,4cyclictest0-21swapper/100:25:131
5149960,3cyclictest0-21swapper/121:40:111
5149960,2cyclictest0-21swapper/123:58:151
5149960,0cyclictest0-21swapper/123:25:281
5099966,0cyclictest29415-1kworker/u9:022:45:460
5099963,1cyclictest254-21systemd-journal21:00:000
5099963,1cyclictest254-21systemd-journal19:14:550
5099960,6cyclictest0-21swapper/020:54:330
5099960,6cyclictest0-21swapper/020:35:560
5099960,6cyclictest0-21swapper/019:40:000
5099960,5cyclictest0-21swapper/019:15:260
5099960,5cyclictest0-21swapper/019:15:260
5099960,0cyclictest0-21swapper/021:28:430
5099960,0cyclictest0-21swapper/021:05:010
5099960,0cyclictest0-21swapper/020:19:010
11675260,1sleep10-21swapper/121:32:301
5149955,0cyclictest0-21swapper/122:54:401
5149955,0cyclictest0-21swapper/100:22:101
5149953,1cyclictest67882sleep122:10:221
5149951,3cyclictest0-21swapper/120:45:131
5149951,2cyclictest0-21swapper/119:10:141
5149950,5cyclictest0-21swapper/121:56:481
5149950,5cyclictest0-21swapper/120:25:101
5149950,3cyclictest0-21swapper/122:04:271
5149950,3cyclictest0-21swapper/119:20:161
5149950,3cyclictest0-21swapper/100:10:031
5149950,2cyclictest0-21swapper/123:10:131
5149950,2cyclictest0-21swapper/123:00:171
5149950,2cyclictest0-21swapper/121:27:521
5149950,1cyclictest0-21swapper/123:20:221
5149950,0cyclictest0-21swapper/123:52:161
5149950,0cyclictest0-21swapper/120:35:291
5099951,3cyclictest0-21swapper/020:45:180
5099950,4cyclictest13252-21/usr/sbin/munin19:35:200
5099950,4cyclictest12371-21/usr/sbin/munin20:40:130
5099950,2cyclictest254-21systemd-journal19:25:190
5099950,0cyclictest0-21swapper/020:05:180
5149944,0cyclictest0-21swapper/121:02:091
5149944,0cyclictest0-21swapper/119:58:371
5149941,1cyclictest0-21swapper/122:30:201
5149941,1cyclictest0-21swapper/120:00:121
5149941,1cyclictest0-21swapper/119:40:001
5149940,4cyclictest0-21swapper/119:34:011
5149940,2cyclictest0-21swapper/123:15:181
5149940,1cyclictest0-21swapper/119:45:181
5149940,0cyclictest0-21swapper/120:20:211
5099940,0cyclictest0-21swapper/019:20:130
5149931,1cyclictest0-21swapper/120:50:191
5149931,1cyclictest0-21swapper/120:15:131
5149930,2cyclictest0-21swapper/120:55:111
5149930,2cyclictest0-21swapper/119:15:101
5149930,2cyclictest0-21swapper/119:15:101
5149930,1cyclictest0-21swapper/120:10:151
5149930,1cyclictest0-21swapper/119:25:151
5149930,0cyclictest0-21swapper/120:30:111
24280230,1sleep10-21swapper/121:05:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional