You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-14 - 06:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Sun Sep 14, 2025 00:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
174392212148,21sleep00-21swapper/019:08:380
173842202164,25sleep20-21swapper/219:07:562
174902200163,24sleep10-21swapper/119:09:191
172812198159,25sleep30-21swapper/319:06:353
251212600,0sleep10-21swapper/122:55:191
287222200,1sleep228725-21grep23:00:202
101032190,1sleep0101rcuc/021:05:190
218762150,0sleep10-21swapper/122:50:231
17639991514,1cyclictest28-21ksoftirqd/223:05:202
17639991514,1cyclictest28-21ksoftirqd/221:55:172
17639991514,1cyclictest28-21ksoftirqd/200:15:232
17639991313,0cyclictest28-21ksoftirqd/200:25:182
1763999130,13cyclictest0-21swapper/221:29:542
17650991210,1cyclictest35-21ksoftirqd/323:20:003
1763999126,4cyclictest28-21ksoftirqd/222:10:192
17639991212,0cyclictest28-21ksoftirqd/200:34:592
17639991211,1cyclictest28-21ksoftirqd/222:50:202
17639991211,1cyclictest28-21ksoftirqd/222:42:042
17639991211,1cyclictest28-21ksoftirqd/221:05:002
17639991211,1cyclictest28-21ksoftirqd/219:40:132
17639991210,1cyclictest28-21ksoftirqd/223:55:002
17639991210,1cyclictest28-21ksoftirqd/223:35:172
17639991210,1cyclictest28-21ksoftirqd/222:05:172
17639991210,1cyclictest28-21ksoftirqd/221:45:222
17639991210,1cyclictest28-21ksoftirqd/219:50:002
1763099120,0cyclictest0-21swapper/120:10:101
1763999119,1cyclictest28-21ksoftirqd/223:30:182
1763999119,1cyclictest28-21ksoftirqd/222:33:022
1763999119,1cyclictest28-21ksoftirqd/220:45:162
17639991110,1cyclictest28-21ksoftirqd/223:25:142
17639991110,1cyclictest28-21ksoftirqd/223:12:492
17639991110,1cyclictest28-21ksoftirqd/221:40:202
17639991110,1cyclictest28-21ksoftirqd/221:30:192
17639991110,1cyclictest28-21ksoftirqd/221:15:002
17639991110,1cyclictest28-21ksoftirqd/200:35:162
1763999110,11cyclictest0-21swapper/222:59:312
1762299111,9cyclictest13125-21sh00:08:200
1765099104,3cyclictest35-21ksoftirqd/322:03:533
1763999109,1cyclictest28-21ksoftirqd/222:47:522
1763999109,1cyclictest28-21ksoftirqd/222:25:262
1763999109,1cyclictest28-21ksoftirqd/222:20:352
1763999109,1cyclictest28-21ksoftirqd/221:20:112
1763999109,1cyclictest28-21ksoftirqd/221:18:232
1763999109,1cyclictest28-21ksoftirqd/219:55:012
1763999109,1cyclictest28-21ksoftirqd/219:15:132
1763999109,1cyclictest28-21ksoftirqd/200:10:362
1763999108,1cyclictest28-21ksoftirqd/221:50:132
1763999108,1cyclictest28-21ksoftirqd/220:55:002
1763999108,1cyclictest28-21ksoftirqd/219:14:592
1763999108,1cyclictest28-21ksoftirqd/200:00:162
1763999107,1cyclictest28-21ksoftirqd/220:59:592
1763999105,3cyclictest28-21ksoftirqd/220:20:142
17639991010,0cyclictest28-21ksoftirqd/223:55:372
17639991010,0cyclictest28-21ksoftirqd/223:43:102
17639991010,0cyclictest28-21ksoftirqd/222:35:182
17639991010,0cyclictest28-21ksoftirqd/222:15:242
17639991010,0cyclictest28-21ksoftirqd/221:35:142
1762299108,1cyclictest27878-21expr23:00:150
1762299102,4cyclictest10121-21latency_hist20:00:000
17622991010,0cyclictest10894-21diskmemload21:52:030
176509998,1cyclictest35-21ksoftirqd/321:45:003
176509998,1cyclictest35-21ksoftirqd/319:15:003
176509997,1cyclictest35-21ksoftirqd/322:10:003
176509997,1cyclictest35-21ksoftirqd/320:35:333
176509996,1cyclictest0-21swapper/323:35:373
176509994,4cyclictest21746-21nscd23:55:123
176509990,8cyclictest269402sleep323:42:213
176509990,6cyclictest19987-21munin-node19:31:033
176399998,1cyclictest28-21ksoftirqd/223:15:562
176399998,1cyclictest28-21ksoftirqd/221:05:142
176399998,1cyclictest28-21ksoftirqd/219:35:172
176399998,1cyclictest28-21ksoftirqd/200:20:162
176399998,1cyclictest28-21ksoftirqd/200:05:332
176399997,2cyclictest28-21ksoftirqd/219:25:142
176399997,1cyclictest28-21ksoftirqd/222:00:152
176399997,1cyclictest28-21ksoftirqd/220:30:012
176399991,8cyclictest0-21swapper/223:21:512
176229999,0cyclictest9-21ksoftirqd/022:44:420
30845280,0sleep30-21swapper/300:31:263
176509987,1cyclictest35-21ksoftirqd/321:50:173
176509987,1cyclictest35-21ksoftirqd/321:34:593
176509987,1cyclictest35-21ksoftirqd/321:25:163
176509987,1cyclictest35-21ksoftirqd/320:15:003
176509987,1cyclictest35-21ksoftirqd/319:50:003
176509987,1cyclictest35-21ksoftirqd/300:25:003
176509986,1cyclictest5583-21/usr/sbin/munin22:30:173
176509983,4cyclictest0-21swapper/300:05:153
176509980,3cyclictest0-21swapper/322:35:143
176509980,2cyclictest0-21swapper/319:10:113
176399987,1cyclictest28-21ksoftirqd/223:45:142
176399987,1cyclictest28-21ksoftirqd/220:15:002
176399987,1cyclictest28-21ksoftirqd/220:05:252
176399987,1cyclictest28-21ksoftirqd/219:30:182
176399987,1cyclictest28-21ksoftirqd/219:25:012
176399986,1cyclictest28-21ksoftirqd/220:20:002
176309981,3cyclictest0-21swapper/100:20:131
176309980,4cyclictest0-21swapper/122:29:441
176229987,1cyclictest9-21ksoftirqd/022:32:400
176229987,1cyclictest9-21ksoftirqd/000:04:590
176229986,1cyclictest18578-21cat00:15:180
176229981,6cyclictest25696-21ssh00:25:160
176229981,6cyclictest16728-21wc23:30:010
176229981,4cyclictest0-21swapper/023:43:470
176229980,7cyclictest29239-21ssh21:33:500
20635270,1sleep30-21swapper/321:20:573
176509975,2cyclictest10894-21diskmemload23:21:213
176509975,1cyclictest574-21ssh23:50:213
176509975,1cyclictest27541-21ssh00:27:313
176509974,2cyclictest2090-21ssh00:36:193
176509974,0cyclictest10894-21diskmemload22:15:313
176509973,3cyclictest23352-21/usr/sbin/munin22:10:183
176509973,2cyclictest570-21systemd-logind21:14:093
176509973,2cyclictest10894-21diskmemload00:10:263
176509973,0cyclictest10894-21diskmemload23:28:203
176509972,2cyclictest10894-21diskmemload23:05:043
176509971,3cyclictest19253-21runrttasks23:31:483
176509970,5cyclictest0-21swapper/322:59:253
176509970,5cyclictest0-21swapper/322:24:563
176509970,3cyclictest0-21swapper/322:42:423
176399975,1cyclictest28-21ksoftirqd/220:40:012
176399975,1cyclictest28-21ksoftirqd/220:30:112
176399975,1cyclictest28-21ksoftirqd/219:55:002
176399974,3cyclictest0-21swapper/220:00:222
176309971,3cyclictest0-21swapper/122:02:001
176309970,4cyclictest0-21swapper/123:35:071
176309970,4cyclictest0-21swapper/123:10:131
176309970,4cyclictest0-21swapper/121:20:151
176309970,3cyclictest0-21swapper/100:15:561
176229977,0cyclictest10894-21diskmemload22:15:030
176229976,1cyclictest9-21ksoftirqd/019:11:320
176229976,1cyclictest15856-1kworker/u9:022:46:430
176229975,1cyclictest9-21ksoftirqd/020:04:320
176229975,1cyclictest0-21swapper/022:28:290
176229973,2cyclictest10894-21diskmemload21:55:140
176229972,5cyclictest0-21swapper/019:20:000
176229971,6cyclictest20521-1kworker/u9:021:25:130
176229971,2cyclictest18767-21aten_r1power_vo21:20:150
176229971,0cyclictest5791-21ssh23:58:180
176229970,7cyclictest0-21swapper/021:36:070
176229970,7cyclictest0-21swapper/000:35:170
176229970,6cyclictest714-21ssh23:06:030
176229970,6cyclictest714-21ssh22:22:210
176229970,6cyclictest2993-21ssh23:10:150
176229970,6cyclictest26806-1kworker/u9:123:46:200
176229970,6cyclictest23812-21/usr/sbin/munin22:55:180
176229970,6cyclictest23342-21ssh22:10:100
176229970,6cyclictest21539-21ssh22:05:300
176229970,6cyclictest21147-21diskstats23:35:140
176229970,6cyclictest16891-21sshd20:11:570
176229970,6cyclictest14163-21ssh21:14:050
176229970,6cyclictest0-21swapper/023:50:220
176229970,6cyclictest0-21swapper/022:00:200
176229970,3cyclictest17175-21chrt21:16:570
176229970,3cyclictest0-21swapper/021:41:520
176229970,1cyclictest9494-21cpuspeed_turbos22:35:130
176229970,1cyclictest28720-21unixbench_singl20:35:220
176229970,1cyclictest10894-21diskmemload23:16:250
176229970,1cyclictest10894-21diskmemload21:47:030
176229970,1cyclictest0-21swapper/023:33:310
176229970,1cyclictest0-21swapper/019:30:240
29998260,1sleep10-21swapper/122:18:561
176509965,1cyclictest5013-21ssh21:45:053
176509965,1cyclictest35-21ksoftirqd/322:28:053
176509965,1cyclictest35-21ksoftirqd/319:59:593
176509965,1cyclictest32287-21ssh21:36:213
176509965,1cyclictest19763-21ssh00:16:193
176509965,1cyclictest13566-21cat20:05:193
176509964,1cyclictest6158-21sh20:59:593
176509964,1cyclictest16591-21aten_r1power_fr22:45:113
176509963,2cyclictest10894-21diskmemload23:02:353
176509963,1cyclictest254-21systemd-journal20:55:003
176509963,1cyclictest254-21systemd-journal20:25:013
176509963,1cyclictest254-21systemd-journal19:45:003
176509963,1cyclictest10894-21diskmemload23:10:023
176509962,3cyclictest10894-21diskmemload21:56:273
176509961,2cyclictest10894-21diskmemload22:51:153
176509961,1cyclictest10894-21diskmemload23:48:523
176509961,1cyclictest0-21swapper/321:05:123
176509961,1cyclictest0-21swapper/319:50:123
176509960,6cyclictest15818-21memory21:15:173
176509960,1cyclictest0-21swapper/300:00:003
176399966,0cyclictest28-21ksoftirqd/220:40:162
176399966,0cyclictest28-21ksoftirqd/220:40:162
176309961,3cyclictest0-21swapper/122:07:141
176309961,3cyclictest0-21swapper/121:30:141
176309960,6cyclictest0-21swapper/122:34:361
176309960,5cyclictest0-21swapper/119:45:181
176309960,4cyclictest0-21swapper/123:50:021
176309960,3cyclictest0-21swapper/100:30:141
176309960,2cyclictest0-21swapper/122:10:051
176309960,2cyclictest0-21swapper/120:50:001
176309960,1cyclictest0-21swapper/123:55:131
176309960,1cyclictest0-21swapper/123:15:241
176309960,1cyclictest0-21swapper/121:15:131
176229965,1cyclictest9-21ksoftirqd/020:28:330
176229965,1cyclictest22000-21ssh22:50:270
176229965,0cyclictest10894-21diskmemload00:10:100
176229963,1cyclictest0-21swapper/019:45:130
176229962,1cyclictest254-21systemd-journal19:40:010
176229961,1cyclictest0-21swapper/020:20:140
176229960,6cyclictest31234-1kworker/u9:023:20:110
176229960,6cyclictest0-21swapper/020:50:170
176229960,6cyclictest0-21swapper/020:33:070
176229960,6cyclictest0-21swapper/020:05:490
176229960,6cyclictest0-21swapper/019:54:460
176229960,5cyclictest25814-21/usr/sbin/munin19:25:190
176229960,3cyclictest17715-21/usr/sbin/munin20:15:170
176229960,0cyclictest10894-21diskmemload00:30:060
176229960,0cyclictest0-21swapper/019:35:150
176229960,0cyclictest0-21swapper/019:20:190
176229960,0cyclictest0-21swapper/000:20:180
176509954,1cyclictest7262-21/usr/sbin/munin21:00:213
176509954,1cyclictest35-21ksoftirqd/320:50:003
176509954,1cyclictest35-21ksoftirqd/319:21:523
176509954,1cyclictest26984-21ntpq19:25:213
176509953,1cyclictest29665-21expr20:40:173
176509953,1cyclictest29665-21expr20:40:163
176509953,1cyclictest12530-21cut20:04:593
176509951,3cyclictest17382-21apt-get20:15:163
176509950,1cyclictest0-21swapper/319:35:223
176509950,0cyclictest24678-21/usr/sbin/munin20:30:123
176309955,0cyclictest0-21swapper/123:27:491
176309955,0cyclictest0-21swapper/123:21:471
176309955,0cyclictest0-21swapper/122:23:461
176309952,2cyclictest0-21swapper/121:50:141
176309951,2cyclictest0-21swapper/123:08:551
176309951,2cyclictest0-21swapper/120:00:191
176309950,5cyclictest0-21swapper/121:25:171
176309950,5cyclictest0-21swapper/120:35:011
176309950,5cyclictest0-21swapper/119:40:151
176309950,4cyclictest0-21swapper/119:55:171
176309950,3cyclictest0-21swapper/122:36:231
176309950,3cyclictest0-21swapper/121:55:041
176309950,3cyclictest0-21swapper/121:40:201
176309950,3cyclictest0-21swapper/120:25:121
176309950,3cyclictest0-21swapper/100:00:011
176309950,2cyclictest0-21swapper/123:45:051
176309950,2cyclictest0-21swapper/123:42:021
176309950,2cyclictest0-21swapper/123:31:401
176309950,2cyclictest0-21swapper/123:00:541
176309950,2cyclictest0-21swapper/122:44:461
176309950,2cyclictest0-21swapper/121:46:371
176309950,2cyclictest0-21swapper/121:37:171
176309950,2cyclictest0-21swapper/100:35:161
176309950,2cyclictest0-21swapper/100:10:231
176309950,2cyclictest0-21swapper/100:07:281
176309950,1cyclictest0-21swapper/121:10:161
176309950,1cyclictest0-21swapper/119:25:151
176309950,0cyclictest0-21swapper/120:50:371
176309950,0cyclictest0-21swapper/100:25:501
176229953,1cyclictest6423-21/usr/sbin/munin21:00:150
176229953,1cyclictest4047-21/usr/sbin/munin20:55:190
176229953,1cyclictest31760-21/usr/sbin/munin20:45:240
176229950,5cyclictest0-21swapper/020:40:210
176229950,5cyclictest0-21swapper/020:40:200
176509940,1cyclictest278-21systemd-udevd20:25:093
176309944,0cyclictest0-21swapper/120:56:011
176309944,0cyclictest0-21swapper/119:36:151
176309944,0cyclictest0-21swapper/119:12:401
176309941,2cyclictest0-21swapper/119:30:181
176309941,1cyclictest0-21swapper/120:40:151
176309941,1cyclictest0-21swapper/120:40:151
176309940,3cyclictest0-21swapper/119:50:191
176309940,3cyclictest0-21swapper/119:20:131
176309940,2cyclictest0-21swapper/122:45:331
176309940,2cyclictest0-21swapper/120:05:151
176309940,1cyclictest0-21swapper/120:15:241
176309940,0cyclictest0-21swapper/121:05:201
176309940,0cyclictest0-21swapper/121:01:501
176309940,0cyclictest0-21swapper/119:15:001
176309931,1cyclictest0-21swapper/120:30:111
176309930,2cyclictest0-21swapper/120:20:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional