You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-04 - 17:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack1slot1.osadl.org (updated Fri Jul 04, 2025 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304892202164,25sleep00-21swapper/007:06:440
298242199160,26sleep30-21swapper/307:05:343
305932197157,27sleep20-21swapper/207:08:072
298272196160,23sleep10-21swapper/107:05:361
85962580,0sleep30-21swapper/311:38:423
30830991514,1cyclictest9-21ksoftirqd/011:30:000
3083799130,12cyclictest0-21swapper/108:35:121
30830991312,1cyclictest29598-21ssh10:40:170
30830991311,1cyclictest9-21ksoftirqd/007:20:000
3084599120,11cyclictest0-21swapper/212:19:032
3083799120,0cyclictest0-21swapper/112:20:131
30830991211,1cyclictest9-21ksoftirqd/011:30:130
30830991211,1cyclictest26026-21ssh11:19:350
30830991211,0cyclictest21621-21ssh09:46:410
30830991210,1cyclictest9-21ksoftirqd/011:25:000
3085299119,1cyclictest35-21ksoftirqd/308:10:003
3083799110,10cyclictest0-21swapper/110:30:221
3083099119,1cyclictest18764-21ssh11:50:350
30830991110,1cyclictest9-21ksoftirqd/010:35:000
30830991110,1cyclictest9-21ksoftirqd/009:20:000
30830991110,1cyclictest26650-21ssh09:54:590
3084599109,1cyclictest28-21ksoftirqd/207:35:002
3083099109,1cyclictest9-21ksoftirqd/012:35:150
3083099109,1cyclictest9-21ksoftirqd/011:40:140
3083099109,1cyclictest2634-21ssh12:14:310
3083099109,1cyclictest16929-21ssh10:24:490
3083099109,1cyclictest15915-21ssh11:48:070
3083099109,1cyclictest10541-21ssh09:33:010
3083099108,1cyclictest9-21ksoftirqd/009:40:140
3083099108,1cyclictest9-21ksoftirqd/009:20:010
3083099108,1cyclictest9-21ksoftirqd/007:40:000
3083099106,3cyclictest9-21ksoftirqd/011:55:200
3083099106,3cyclictest5603-21cron10:10:000
30830991010,0cyclictest9-21ksoftirqd/010:10:130
177832100,0sleep023487-21diskmemload12:34:590
308529990,6cyclictest0-21swapper/310:13:183
308459995,2cyclictest17740-21snmpd10:23:042
308459991,5cyclictest23487-21diskmemload11:40:122
308459990,9cyclictest0-21swapper/210:39:592
308459990,7cyclictest17740-21snmpd09:25:422
308309998,1cyclictest9-21ksoftirqd/011:35:170
308309998,1cyclictest9-21ksoftirqd/010:50:150
308309998,1cyclictest9-21ksoftirqd/010:00:110
308309998,1cyclictest9-21ksoftirqd/008:40:010
308309998,0cyclictest9-21ksoftirqd/009:55:160
308309997,1cyclictest9-21ksoftirqd/011:10:140
308309997,1cyclictest9-21ksoftirqd/010:25:150
308309997,1cyclictest9-21ksoftirqd/009:35:140
308309993,1cyclictest4032-21/usr/sbin/munin07:20:210
308309990,8cyclictest17740-21snmpd10:49:230
308309990,8cyclictest0-21swapper/007:30:110
308309990,5cyclictest15620-21wc07:45:010
308309990,5cyclictest0-21swapper/012:15:130
308529986,1cyclictest17740-21snmpd07:41:093
308529985,2cyclictest17740-21snmpd08:00:373
308529982,3cyclictest23051-21/usr/sbin/munin11:15:133
308529980,5cyclictest22564-21ssh11:55:393
308529980,2cyclictest0-21swapper/308:45:123
308459988,0cyclictest28-21ksoftirqd/212:25:152
308459986,1cyclictest60950irq/123-eno112:35:002
308459986,1cyclictest60950irq/123-eno112:20:142
308459986,1cyclictest60950irq/123-eno111:35:172
308459986,1cyclictest60950irq/123-eno111:08:582
308459986,1cyclictest60950irq/123-eno111:00:122
308459986,1cyclictest60950irq/123-eno109:56:532
308459986,1cyclictest60950irq/123-eno109:35:142
308459986,1cyclictest28-21ksoftirqd/209:35:002
308459986,1cyclictest17740-21snmpd11:30:242
308459986,1cyclictest17740-21snmpd09:06:382
308459986,1cyclictest17740-21snmpd08:52:352
308459986,1cyclictest10587-21cat10:15:182
308459981,2cyclictest0-21swapper/208:25:152
308459981,2cyclictest0-21swapper/208:25:152
308379980,7cyclictest0-21swapper/111:45:131
308309988,0cyclictest9-21ksoftirqd/011:00:130
308309988,0cyclictest9-21ksoftirqd/007:55:230
308309987,1cyclictest9-21ksoftirqd/009:10:130
308309986,1cyclictest9-21ksoftirqd/012:05:180
308309986,1cyclictest9-21ksoftirqd/010:35:150
308309980,7cyclictest9328-21ssh12:21:520
308529976,1cyclictest35-21ksoftirqd/309:30:003
308529976,1cyclictest35-21ksoftirqd/307:15:003
308529976,1cyclictest17740-21snmpd07:22:453
308529975,1cyclictest35-21ksoftirqd/309:00:003
308529975,1cyclictest27310-21ssh10:37:073
308529975,1cyclictest17740-21snmpd12:00:523
308529975,1cyclictest17740-21snmpd11:44:223
308529975,1cyclictest17740-21snmpd10:45:563
308529975,1cyclictest17740-21snmpd09:19:263
308529975,1cyclictest17740-21snmpd08:15:313
308529975,1cyclictest1449-21ntpd10:25:023
308529975,1cyclictest13768-21ssh09:36:143
308529975,0cyclictest23487-21diskmemload10:50:163
308529974,2cyclictest23487-21diskmemload12:32:363
308529972,1cyclictest23487-21diskmemload11:54:413
308529971,4cyclictest23487-21diskmemload10:00:103
308529971,3cyclictest23487-21diskmemload10:15:193
308529971,3cyclictest23487-21diskmemload09:32:453
308529971,1cyclictest23487-21diskmemload11:11:403
308529970,6cyclictest9474-21ssh12:22:163
308529970,6cyclictest0-21swapper/311:05:103
308529970,3cyclictest0-21swapper/312:27:273
308529970,3cyclictest0-21swapper/312:15:513
308529970,2cyclictest0-21swapper/311:25:483
308529970,0cyclictest0-21swapper/310:55:133
308459977,0cyclictest28-21ksoftirqd/209:41:562
308459976,1cyclictest60950irq/123-eno112:10:122
308459976,1cyclictest60950irq/123-eno111:25:412
308459976,1cyclictest60950irq/123-eno109:10:112
308459976,1cyclictest60950irq/123-eno108:41:172
308459976,1cyclictest557-21nscd11:20:022
308459976,1cyclictest17740-21snmpd07:37:482
308459976,0cyclictest60950irq/123-eno112:35:142
308459976,0cyclictest60950irq/123-eno110:14:132
308459976,0cyclictest60950irq/123-eno109:48:542
308459975,1cyclictest60950irq/123-eno112:00:242
308459975,1cyclictest60950irq/123-eno110:40:192
308459975,1cyclictest60950irq/123-eno109:25:012
308459975,1cyclictest60950irq/123-eno109:15:142
308459975,1cyclictest17740-21snmpd11:46:222
308459975,1cyclictest17740-21snmpd08:48:262
308459975,1cyclictest17740-21snmpd08:05:102
308459975,1cyclictest17740-21snmpd07:44:542
308459972,4cyclictest60950irq/123-eno110:50:222
308459972,2cyclictest22659-21sh08:00:002
308459970,6cyclictest4418-21apt-get08:30:012
308459970,6cyclictest23487-21diskmemload10:25:192
308459970,5cyclictest7581-21apt-get10:55:132
308459970,3cyclictest0-21swapper/209:52:592
308379971,4cyclictest0-21swapper/110:10:141
308379970,6cyclictest0-21swapper/109:58:361
308379970,5cyclictest0-21swapper/112:00:141
308379970,4cyclictest0-21swapper/110:48:421
308379970,3cyclictest0-21swapper/109:20:451
308379970,1cyclictest0-21swapper/112:31:591
308379970,1cyclictest0-21swapper/112:08:341
308379970,1cyclictest0-21swapper/109:29:331
308309976,1cyclictest9-21ksoftirqd/012:25:150
308309976,1cyclictest9-21ksoftirqd/009:25:150
308309976,1cyclictest9-21ksoftirqd/008:35:010
308309975,1cyclictest9-21ksoftirqd/010:15:150
308309975,1cyclictest9-21ksoftirqd/007:25:120
308309975,1cyclictest28600-21latency08:10:190
308309975,1cyclictest17740-21snmpd09:00:170
308309970,1cyclictest0-21swapper/012:01:270
308309970,1cyclictest0-21swapper/010:57:450
24995270,0sleep10-21swapper/111:16:461
308529965,1cyclictest35-21ksoftirqd/308:30:013
308529965,1cyclictest30882-21ssh10:41:273
308529965,1cyclictest29246-21ssh11:22:593
308529965,1cyclictest25769-21ssh09:10:513
308529965,1cyclictest22258-21ntpq10:30:183
308529965,1cyclictest19318-21ssh09:45:063
308529965,1cyclictest17476-21ssh09:40:403
308529965,1cyclictest15299-21ssh11:46:243
308529964,1cyclictest32642-21head09:20:163
308529964,1cyclictest17740-21snmpd08:53:443
308529964,1cyclictest17740-21snmpd07:36:423
308529964,1cyclictest17740-21snmpd07:26:033
308529963,1cyclictest278-21systemd-udevd08:42:093
308529963,1cyclictest254-21systemd-journal08:40:013
308529961,3cyclictest20283-21proc_pri09:00:203
308529961,2cyclictest23487-21diskmemload09:50:353
308529961,1cyclictest0-21swapper/312:10:113
308529960,6cyclictest14141-21ssh11:03:073
308529960,4cyclictest0-21swapper/310:05:173
308529960,4cyclictest0-21swapper/307:30:183
308529960,3cyclictest27618-21apt-get08:10:143
308529960,3cyclictest23487-21diskmemload12:06:483
308529960,3cyclictest0-21swapper/310:23:443
308529960,1cyclictest3933-21chrt11:31:173
308529960,0cyclictest0-21swapper/312:37:263
308459966,0cyclictest60950irq/123-eno111:50:122
308459966,0cyclictest60950irq/123-eno111:15:132
308459966,0cyclictest60950irq/123-eno111:10:122
308459966,0cyclictest60950irq/123-eno110:30:122
308459966,0cyclictest60950irq/123-eno110:00:052
308459966,0cyclictest60950irq/123-eno108:20:182
308459966,0cyclictest60950irq/123-eno108:10:102
308459966,0cyclictest60950irq/123-eno107:25:112
308459966,0cyclictest60950irq/123-eno107:20:182
308459965,1cyclictest60950irq/123-eno112:05:142
308459965,1cyclictest60950irq/123-eno110:45:502
308459965,1cyclictest60950irq/123-eno107:15:142
308459965,1cyclictest4061-21ssh10:05:422
308459965,1cyclictest21848-21ntpq11:55:172
308459965,1cyclictest17740-21snmpd08:15:252
308459964,1cyclictest60950irq/123-eno107:50:212
308459963,1cyclictest278-21systemd-udevd07:12:092
308459961,1cyclictest0-21swapper/208:55:112
308459960,4cyclictest7608-21cstates08:35:142
308379965,1cyclictest0-21swapper/110:06:101
308379961,5cyclictest0-21swapper/107:43:031
308379960,6cyclictest0-21swapper/112:27:351
308379960,6cyclictest0-21swapper/110:24:101
308379960,6cyclictest0-21swapper/108:43:531
308379960,5cyclictest0-21swapper/111:25:121
308379960,5cyclictest0-21swapper/111:00:021
308379960,5cyclictest0-21swapper/107:35:171
308379960,5cyclictest0-21swapper/107:16:111
308379960,4cyclictest0-21swapper/112:39:401
308379960,3cyclictest0-21swapper/112:16:251
308379960,3cyclictest0-21swapper/110:00:211
308379960,2cyclictest0-21swapper/108:10:141
308379960,1cyclictest0-21swapper/111:37:461
308379960,1cyclictest0-21swapper/108:45:121
308379960,0cyclictest0-21swapper/109:52:041
308379960,0cyclictest0-21swapper/109:45:531
308309966,0cyclictest0-21swapper/011:05:080
308309965,1cyclictest9-21ksoftirqd/008:05:190
308309965,1cyclictest17498-21if_eno108:55:150
308309964,1cyclictest9-21ksoftirqd/007:10:130
308309963,2cyclictest554-21in:imuxsock08:44:560
308309963,2cyclictest31384-21swap08:15:190
308309963,2cyclictest15539-21head08:50:200
308309961,1cyclictest22909-21apt-get08:00:100
308309960,6cyclictest0-21swapper/009:05:550
308309960,6cyclictest0-21swapper/008:20:250
308309960,6cyclictest0-21swapper/007:53:260
308309960,4cyclictest0-21swapper/008:49:550
308309960,0cyclictest0-21swapper/007:45:080
11788260,0sleep10-21swapper/110:16:181
308529954,1cyclictest22775-21python09:05:203
308529954,1cyclictest17740-21snmpd08:31:493
308529954,1cyclictest17740-21snmpd08:21:163
308529954,1cyclictest17740-21snmpd07:45:033
308529953,1cyclictest17740-21snmpd07:50:123
308529952,1cyclictest2712-21missed_timers07:15:173
308529950,3cyclictest0-21swapper/309:55:113
308529950,0cyclictest0-21swapper/307:56:073
308459955,0cyclictest60950irq/123-eno107:48:032
308459954,1cyclictest60950irq/123-eno109:00:202
308459950,5cyclictest0-21swapper/208:04:222
308379955,0cyclictest0-21swapper/112:11:461
308379955,0cyclictest0-21swapper/111:50:231
308379953,1cyclictest0-21swapper/110:42:531
308379952,3cyclictest0-21swapper/110:36:481
308379951,2cyclictest0-21swapper/109:15:191
308379951,2cyclictest0-21swapper/108:20:131
308379951,1cyclictest0-21swapper/111:30:131
308379950,5cyclictest0-21swapper/110:55:291
308379950,5cyclictest0-21swapper/110:26:011
308379950,5cyclictest0-21swapper/109:39:421
308379950,5cyclictest0-21swapper/108:52:081
308379950,5cyclictest0-21swapper/108:09:341
308379950,4cyclictest0-21swapper/111:40:121
308379950,4cyclictest0-21swapper/111:10:091
308379950,4cyclictest0-21swapper/109:05:161
308379950,3cyclictest0-21swapper/109:31:491
308379950,3cyclictest0-21swapper/109:11:491
308379950,2cyclictest0-21swapper/111:05:151
308379950,2cyclictest0-21swapper/109:42:051
308379950,2cyclictest0-21swapper/108:15:111
308379950,1cyclictest0-21swapper/111:22:091
308379950,1cyclictest0-21swapper/110:50:131
308379950,1cyclictest0-21swapper/107:10:131
308309951,3cyclictest0-21swapper/008:25:150
308309951,3cyclictest0-21swapper/008:25:150
308529942,1cyclictest17740-21snmpd08:29:223
308379943,1cyclictest20805-21chrt09:00:591
308379943,1cyclictest18605-21chrt08:58:151
308379943,1cyclictest177282sleep107:47:221
308379942,1cyclictest206332sleep111:55:071
308379941,1cyclictest0-21swapper/107:30:201
308379940,4cyclictest0-21swapper/108:00:141
308379940,2cyclictest0-21swapper/107:55:211
308379940,2cyclictest0-21swapper/107:25:181
308379940,0cyclictest0-21swapper/107:51:241
308379940,0cyclictest0-21swapper/107:21:201
308379931,1cyclictest0-21swapper/108:25:151
308379931,1cyclictest0-21swapper/108:25:151
308379930,1cyclictest0-21swapper/108:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional