You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 15:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Fri Nov 28, 2025 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
121572238161,26sleep20-21swapper/207:08:162
122832234160,25sleep00-21swapper/007:09:500
122252219148,24sleep30-21swapper/307:09:093
101812199160,26sleep10-21swapper/107:05:041
101521030,0sleep10-21swapper/107:50:201
238562580,0sleep20-21swapper/210:18:022
12405992018,2cyclictest28-21ksoftirqd/209:44:022
167002190,0sleep10-21swapper/111:37:211
300252150,0sleep10-21swapper/110:25:221
12405991512,1cyclictest28-21ksoftirqd/211:57:512
1238399151,13cyclictest0-21swapper/007:15:010
12405991211,1cyclictest28-21ksoftirqd/211:26:312
12405991210,1cyclictest28-21ksoftirqd/211:20:142
12405991210,1cyclictest28-21ksoftirqd/211:05:012
12405991210,1cyclictest28-21ksoftirqd/210:40:012
1238399120,11cyclictest0-21swapper/007:25:180
1240599119,1cyclictest28-21ksoftirqd/211:50:142
1240599119,1cyclictest28-21ksoftirqd/210:45:002
1240599119,1cyclictest28-21ksoftirqd/209:05:142
12405991110,1cyclictest28-21ksoftirqd/212:25:102
12405991110,1cyclictest28-21ksoftirqd/211:05:212
12405991110,1cyclictest28-21ksoftirqd/210:25:232
12405991110,1cyclictest28-21ksoftirqd/210:11:142
12405991110,1cyclictest28-21ksoftirqd/209:55:002
12405991110,1cyclictest28-21ksoftirqd/209:47:282
12405991110,1cyclictest28-21ksoftirqd/209:35:162
12405991110,1cyclictest28-21ksoftirqd/209:20:162
12405991110,1cyclictest28-21ksoftirqd/209:10:232
1238399112,4cyclictest0-21swapper/011:29:590
1238399110,10cyclictest5095-21diskmemload10:30:130
277862100,0sleep00-21swapper/012:39:080
167652100,0sleep20-21swapper/207:15:182
127422100,0sleep05095-21diskmemload10:02:230
1240599109,1cyclictest28-21ksoftirqd/212:35:162
1240599109,1cyclictest28-21ksoftirqd/212:30:182
1240599109,1cyclictest28-21ksoftirqd/212:30:172
1240599109,1cyclictest28-21ksoftirqd/212:20:052
1240599109,1cyclictest28-21ksoftirqd/212:15:122
1240599109,1cyclictest28-21ksoftirqd/212:05:232
1240599109,1cyclictest28-21ksoftirqd/212:00:172
1240599109,1cyclictest28-21ksoftirqd/211:15:172
1240599109,1cyclictest28-21ksoftirqd/210:55:152
1240599109,1cyclictest28-21ksoftirqd/210:45:162
1240599109,1cyclictest28-21ksoftirqd/210:02:132
1240599109,1cyclictest28-21ksoftirqd/209:30:152
1240599109,1cyclictest28-21ksoftirqd/209:15:202
1240599108,1cyclictest28-21ksoftirqd/210:30:172
1240599108,1cyclictest28-21ksoftirqd/208:25:142
1240599108,1cyclictest28-21ksoftirqd/208:20:002
1239899100,4cyclictest0-21swapper/107:35:111
1238399109,1cyclictest9-21ksoftirqd/010:28:580
1238399109,1cyclictest9-21ksoftirqd/009:17:030
1238399102,4cyclictest8733-21latency_hist09:15:000
22321290,0sleep30-21swapper/309:31:033
124119990,6cyclictest14751-21munin-node09:11:263
124059999,0cyclictest28-21ksoftirqd/210:05:142
124059998,1cyclictest28-21ksoftirqd/212:10:342
124059998,1cyclictest28-21ksoftirqd/211:45:182
124059998,1cyclictest28-21ksoftirqd/211:11:562
124059998,1cyclictest28-21ksoftirqd/209:25:172
124059998,1cyclictest28-21ksoftirqd/208:55:132
124059997,1cyclictest28-21ksoftirqd/211:44:422
124059997,1cyclictest28-21ksoftirqd/208:40:162
124059997,1cyclictest28-21ksoftirqd/208:40:152
124059995,3cyclictest28-21ksoftirqd/207:35:002
123989990,3cyclictest0-21swapper/109:15:141
123839997,1cyclictest9-21ksoftirqd/009:05:000
123839990,5cyclictest28138-21perf08:50:000
123839990,5cyclictest23744-21ssh11:46:480
124119986,1cyclictest35-21ksoftirqd/311:10:013
124119984,2cyclictest0-21swapper/309:48:253
124119980,4cyclictest3173-21runrttasks11:19:523
124059988,0cyclictest60950irq/123-eno109:55:232
124059988,0cyclictest28-21ksoftirqd/210:52:132
124059987,1cyclictest28-21ksoftirqd/211:35:142
124059987,1cyclictest28-21ksoftirqd/210:24:302
124059987,1cyclictest28-21ksoftirqd/210:24:292
124059986,1cyclictest60950irq/123-eno111:30:142
123989982,4cyclictest26997-21chrt10:21:391
123989982,4cyclictest26997-21chrt10:21:381
123839986,1cyclictest9-21ksoftirqd/007:25:000
123839981,6cyclictest3662-21ssh09:50:150
123839980,8cyclictest0-21swapper/010:22:560
123839980,8cyclictest0-21swapper/010:22:550
29890270,0sleep10-21swapper/109:40:591
18926270,1sleep218929-21kernelversion07:20:162
124119976,1cyclictest35-21ksoftirqd/307:41:233
124119975,1cyclictest566-21nscd10:37:233
124119975,1cyclictest35-21ksoftirqd/308:35:003
124119975,1cyclictest35-21ksoftirqd/308:05:103
124119975,1cyclictest35-21ksoftirqd/307:35:113
124119975,1cyclictest10671-21ssh11:30:063
124119972,3cyclictest5095-21diskmemload09:17:003
124119972,2cyclictest5095-21diskmemload09:58:013
124119971,3cyclictest742-21runrttasks11:42:273
124119971,3cyclictest5095-21diskmemload10:20:033
124119971,3cyclictest5095-21diskmemload10:20:023
124119971,1cyclictest5095-21diskmemload11:47:273
124119971,1cyclictest0-21swapper/312:20:143
124119971,1cyclictest0-21swapper/308:55:163
124119970,5cyclictest0-21swapper/310:40:223
124119970,3cyclictest20370-21apt-get07:25:103
124059977,0cyclictest28-21ksoftirqd/207:25:182
124059976,1cyclictest28-21ksoftirqd/207:35:182
124059976,1cyclictest28-21ksoftirqd/207:10:132
124059976,1cyclictest27644-21kworker/2:208:45:132
124059975,1cyclictest28-21ksoftirqd/208:50:112
124059975,1cyclictest28-21ksoftirqd/207:50:152
124059975,1cyclictest28-21ksoftirqd/207:40:132
124059973,2cyclictest254-21systemd-journal08:00:002
124059973,1cyclictest31271-21ls07:45:212
124059970,1cyclictest254-21systemd-journal08:35:002
123989971,3cyclictest0-21swapper/110:58:021
123989970,6cyclictest0-21swapper/111:50:221
123989970,4cyclictest0-21swapper/112:20:121
123989970,4cyclictest0-21swapper/111:09:311
123989970,4cyclictest0-21swapper/109:59:081
123839975,1cyclictest29191-21cat08:50:160
123839975,1cyclictest10763-21/usr/sbin/munin10:45:190
123839974,2cyclictest26278-21ntp_states11:05:190
123839974,1cyclictest254-21systemd-journal08:40:010
123839973,2cyclictest254-21systemd-journal10:00:000
123839973,2cyclictest254-21systemd-journal08:11:170
123839973,0cyclictest0-21swapper/012:25:130
123839973,0cyclictest0-21swapper/010:50:130
123839972,5cyclictest20958-21perf10:15:010
123839972,3cyclictest28726-21aten_r1power_en11:10:120
123839970,6cyclictest6331-21ssh12:09:080
123839970,6cyclictest5095-21diskmemload12:20:120
123839970,6cyclictest32173-21ssh12:00:040
123839970,6cyclictest2399-21ssh11:17:370
123839970,6cyclictest1115-21ssh09:45:300
123839970,6cyclictest0-21swapper/012:30:140
123839970,6cyclictest0-21swapper/012:30:140
123839970,6cyclictest0-21swapper/010:40:130
123839970,6cyclictest0-21swapper/009:20:140
123839970,6cyclictest0-21swapper/008:30:110
123839970,6cyclictest0-21swapper/007:50:200
123839970,5cyclictest5095-21diskmemload11:40:040
123839970,5cyclictest28811-21systemctl07:40:200
123839970,5cyclictest12147-21python11:30:200
123839970,4cyclictest378-21cut08:59:590
123839970,3cyclictest30004-21systemctl11:55:190
123839970,1cyclictest5936-21ssh10:38:210
123839970,1cyclictest24167-21ssh11:03:060
123839970,1cyclictest0-21swapper/011:50:180
123839970,1cyclictest0-21swapper/011:35:110
123839970,1cyclictest0-21swapper/010:05:170
123839970,1cyclictest0-21swapper/009:26:470
124119965,1cyclictest9920-21ssh12:14:143
124119965,1cyclictest5501-21ssh12:06:313
124119965,1cyclictest31301-21ssh11:12:543
124119965,1cyclictest31292-21ssh11:58:063
124119965,1cyclictest26234-21ntpq11:50:183
124119965,1cyclictest26065-21ssh09:35:573
124119965,1cyclictest23067-21ssh10:15:323
124119965,1cyclictest20802-21ssh10:14:373
124119965,1cyclictest20045-21ssh10:56:303
124119965,1cyclictest15544-21ntpq10:50:203
124119965,1cyclictest13476-21cat07:10:153
124119965,1cyclictest12559-21ssh12:16:193
124119963,3cyclictest5095-21diskmemload09:40:443
124119963,2cyclictest5095-21diskmemload12:02:153
124119963,1cyclictest254-21systemd-journal07:59:593
124119963,0cyclictest5095-21diskmemload11:22:033
124119961,4cyclictest25945-21apt-get08:45:113
124119961,2cyclictest5095-21diskmemload09:25:003
124119960,4cyclictest0-21swapper/311:36:123
124119960,3cyclictest0-21swapper/311:01:023
124119960,2cyclictest0-21swapper/312:31:143
124119960,2cyclictest0-21swapper/312:31:133
124119960,2cyclictest0-21swapper/312:25:183
124119960,2cyclictest0-21swapper/310:00:553
124119960,2cyclictest0-21swapper/309:21:253
124119960,1cyclictest0-21swapper/309:50:493
124119960,0cyclictest0-21swapper/310:45:403
124059966,0cyclictest27644-21kworker/2:208:05:172
124059965,1cyclictest27644-21kworker/2:208:15:152
124059961,4cyclictest0-21swapper/208:10:112
124059961,4cyclictest0-21swapper/208:00:112
124059960,6cyclictest0-21swapper/209:00:162
123989966,0cyclictest0-21swapper/110:05:051
123989964,1cyclictest0-21swapper/109:10:091
123989962,3cyclictest0-21swapper/107:30:191
123989961,3cyclictest0-21swapper/109:33:121
123989960,5cyclictest0-21swapper/111:24:011
123989960,5cyclictest0-21swapper/109:48:191
123989960,4cyclictest0-21swapper/112:38:291
123989960,4cyclictest0-21swapper/112:19:411
123989960,4cyclictest0-21swapper/111:58:091
123989960,4cyclictest0-21swapper/109:25:181
123989960,4cyclictest0-21swapper/108:40:111
123989960,4cyclictest0-21swapper/108:40:111
123989960,3cyclictest0-21swapper/112:32:231
123989960,3cyclictest0-21swapper/112:32:221
123989960,3cyclictest0-21swapper/111:30:111
123989960,3cyclictest0-21swapper/109:39:391
123989960,2cyclictest0-21swapper/112:26:571
123989960,2cyclictest0-21swapper/111:48:281
123989960,2cyclictest0-21swapper/110:51:071
123989960,0cyclictest0-21swapper/109:51:391
123839964,1cyclictest3091-21aten2.4-expect09:05:130
123839964,1cyclictest2103-21/usr/sbin/munin07:55:120
123839963,1cyclictest22740-21aten_r1power_cu07:30:110
123839960,6cyclictest7437-21ssh12:10:130
123839960,6cyclictest5095-21diskmemload11:22:490
123839960,6cyclictest22138-21ssh10:15:150
123839960,6cyclictest0-21swapper/010:55:070
123839960,6cyclictest0-21swapper/009:40:050
123839960,6cyclictest0-21swapper/009:35:440
123839960,6cyclictest0-21swapper/008:25:110
123839960,0cyclictest0-21swapper/012:15:200
123839960,0cyclictest0-21swapper/009:30:520
123839960,0cyclictest0-21swapper/008:20:120
123839960,0cyclictest0-21swapper/007:49:380
123839960,0cyclictest0-21swapper/007:10:400
124119954,1cyclictest18906-21cat07:20:173
124119954,1cyclictest17895-21sensors08:25:193
124119954,1cyclictest16195-21ssh10:06:233
124119952,1cyclictest692-21ntp_states10:30:203
124119952,1cyclictest5095-21diskmemload11:26:243
124119952,1cyclictest254-21systemd-journal07:48:463
124119950,5cyclictest0-21swapper/312:36:463
124119950,3cyclictest32168-21/usr/sbin/munin07:50:203
124119950,3cyclictest0-21swapper/310:25:133
124119950,1cyclictest254-21systemd-journal08:19:023
124059955,0cyclictest60950irq/123-eno108:35:352
123989955,0cyclictest0-21swapper/112:05:021
123989955,0cyclictest0-21swapper/111:00:051
123989955,0cyclictest0-21swapper/110:16:331
123989951,3cyclictest0-21swapper/111:10:111
123989951,3cyclictest0-21swapper/110:38:201
123989951,1cyclictest0-21swapper/112:02:491
123989950,5cyclictest0-21swapper/108:00:031
123989950,4cyclictest0-21swapper/112:10:221
123989950,4cyclictest0-21swapper/110:31:441
123989950,4cyclictest0-21swapper/110:12:041
123989950,4cyclictest0-21swapper/110:01:011
123989950,3cyclictest0-21swapper/111:25:141
123989950,3cyclictest0-21swapper/110:48:251
123989950,3cyclictest0-21swapper/109:23:291
123989950,3cyclictest0-21swapper/107:20:151
123989950,2cyclictest0-21swapper/111:40:331
123989950,2cyclictest0-21swapper/111:15:111
123989950,2cyclictest0-21swapper/110:42:141
123989950,2cyclictest0-21swapper/108:20:131
123989950,2cyclictest0-21swapper/107:55:131
123989950,0cyclictest0-21swapper/108:56:081
123989950,0cyclictest0-21swapper/108:25:191
123839953,1cyclictest4481-21/usr/sbin/munin08:00:160
123839951,3cyclictest24346-21gltestperf08:40:150
123839951,3cyclictest24346-21gltestperf08:40:140
123839950,5cyclictest0-21swapper/008:05:300
123839950,4cyclictest11693-21basename08:15:130
123839950,0cyclictest0-21swapper/007:35:120
11029250,0sleep30-21swapper/308:11:323
124119943,1cyclictest633-21aten_r1power_en09:00:123
124119943,1cyclictest35-21ksoftirqd/308:02:233
124119943,1cyclictest21285-21aten_r1power_fr08:35:103
124119942,1cyclictest24378-21sed08:40:153
124119942,1cyclictest24378-21sed08:40:143
124119941,1cyclictest254-21systemd-journal08:52:183
124119941,1cyclictest254-21systemd-journal07:15:003
124119940,3cyclictest0-21swapper/307:30:143
124119940,1cyclictest254-21systemd-journal09:05:343
124119940,1cyclictest14266-21aten2.4-expect08:20:143
123989944,0cyclictest0-21swapper/107:41:381
123989943,1cyclictest8717-21chrt08:07:051
123989943,1cyclictest0-21swapper/109:05:131
123989943,1cyclictest0-21swapper/109:00:121
123989941,2cyclictest0-21swapper/108:50:161
123989941,2cyclictest0-21swapper/108:45:101
123989940,3cyclictest0-21swapper/108:15:111
123989940,3cyclictest0-21swapper/107:30:001
123989940,2cyclictest0-21swapper/108:35:091
123989940,2cyclictest0-21swapper/107:45:121
123989931,1cyclictest0-21swapper/107:15:101
123989930,2cyclictest0-21swapper/107:10:121
123989930,1cyclictest0-21swapper/108:10:101
123989930,0cyclictest0-21swapper/108:30:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional