You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-28 - 23:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Sat Jun 28, 2025 12:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1633799230,5cyclictest0-21swapper/208:55:422
16333992313,7cyclictest0-21swapper/109:15:191
1633199230,20cyclictest0-21swapper/012:06:110
1633799227,13cyclictest0-21swapper/208:53:372
16337992213,5cyclictest0-21swapper/210:00:002
1633799220,4cyclictest25607-21cpuspeed_turbos10:15:172
1633799220,21cyclictest4608-21cstates10:35:172
16333992212,9cyclictest18663-21nfsd411:55:191
1633399220,4cyclictest0-21swapper/109:06:061
1633399210,20cyclictest823-21systemd-network08:10:401
1633399210,20cyclictest6843-21ntp_kernel_pll_11:35:211
1633199212,16cyclictest0-21swapper/012:35:000
1633199210,4cyclictest0-21swapper/010:45:000
1633399203,16cyclictest998-21gmain10:15:001
1633399202,11cyclictest13814-21latency_hist11:50:011
1633199204,15cyclictest0-21swapper/011:16:530
16337991916,2cyclictest27453-21cat08:25:022
1633399190,17cyclictest414-20systemd-journal07:38:591
1633199193,15cyclictest0-21swapper/009:11:420
16331991917,1cyclictest4184-21uname09:35:260
16331991917,1cyclictest0-21swapper/007:42:200
16331991916,2cyclictest14075-21timerandwakeup08:55:230
16337991815,2cyclictest24346-21/usr/sbin/munin08:20:012
16337991812,3cyclictest0-21swapper/211:08:452
1633799181,1cyclictest6040-21timerwakeupswit08:40:272
1633799181,16cyclictest0-21swapper/211:40:012
1633799180,3cyclictest19425-21rm07:15:012
1633799180,17cyclictest4438-21snapd11:14:082
1633799180,15cyclictest4538-21H212:26:332
1633399182,15cyclictest0-21swapper/108:01:431
16333991815,2cyclictest4536-21H212:26:331
16333991814,3cyclictest3826-21pzem_power12:25:251
16333991814,3cyclictest3826-21pzem_power12:25:251
1633399181,0cyclictest0-21swapper/111:00:321
1633199182,15cyclictest0-21swapper/007:59:430
16331991816,1cyclictest8438-21fschecks_count12:35:170
16331991815,2cyclictest20337-21chrt11:03:190
16331991814,3cyclictest0-21swapper/008:38:340
16331991814,3cyclictest0-21swapper/008:38:340
16331991813,4cyclictest0-21swapper/012:12:270
1633799172,1cyclictest0-21swapper/210:11:032
16337991715,1cyclictest12422chrt12:20:412
16337991715,1cyclictest0-21swapper/211:20:182
16337991715,1cyclictest0-21swapper/209:45:002
16337991715,1cyclictest0-21swapper/207:19:152
16337991714,2cyclictest8563-21cut10:40:222
16337991714,2cyclictest5453-21/usr/sbin/munin11:35:242
16337991714,2cyclictest30620-21grep08:30:162
16337991714,2cyclictest27591-21cat11:15:232
16337991714,2cyclictest2728-21expr11:30:152
16337991714,2cyclictest26592-21apache_volume09:20:122
16337991714,2cyclictest25374-21cpuspeed_turbos07:25:162
16337991714,2cyclictest15120-21expr11:50:182
16337991714,2cyclictest13289-21df_inode10:50:192
16337991714,2cyclictest11753-21grep11:45:162
16337991714,1cyclictest0-21swapper/208:45:232
16337991713,3cyclictest4435-21snapd08:13:482
1633799171,15cyclictest1723-21taskset11:26:432
1633799171,15cyclictest1370-21grep10:30:142
1633799170,2cyclictest4427-21snapd09:11:282
1633799170,2cyclictest3850-21turbostat.cron07:45:002
1633799170,2cyclictest31351-21anvil09:26:282
1633799170,2cyclictest30576-21cut10:25:012
1633799170,2cyclictest28664-21cp12:15:012
1633799170,2cyclictest1402-21lxd07:37:012
1633799170,2cyclictest10505-21expr10:45:162
1633799170,16cyclictest454-21plymouthd09:00:212
1633799170,16cyclictest4536-21H212:26:332
1633799170,16cyclictest4528-21H212:26:332
1633799170,16cyclictest4528-21H212:26:332
1633799170,16cyclictest31017-21lxd07:51:012
1633799170,16cyclictest2466-21apache_volume09:35:152
1633799170,16cyclictest22252-21munin-run10:10:002
1633799170,16cyclictest2107-21ls12:25:192
1633799170,16cyclictest2107-21ls12:25:182
1633799170,16cyclictest19345-21munin-run10:05:022
1633799170,16cyclictest1356-21lxd12:03:012
1633799170,16cyclictest11139-21awk07:55:192
1633799170,16cyclictest1059-21cups-browsed08:00:252
16333991715,0cyclictest0-21swapper/107:56:431
16333991714,2cyclictest6309-21/usr/sbin/munin12:30:191
16333991714,2cyclictest4526-21H212:26:331
16333991714,2cyclictest28265-21expr10:20:161
16333991714,2cyclictest25558-21munin-plugin-st12:10:001
16333991714,2cyclictest16828-21cpuspeed_turbos07:10:201
16333991714,2cyclictest13033-21grep09:50:241
16333991714,2cyclictest1026-21smartctl11:25:251
16333991714,2cyclictest0-21swapper/110:55:011
16333991712,1cyclictest0-21swapper/109:35:141
1633399171,15cyclictest83032chrt09:43:421
1633399171,15cyclictest27234-21chrt07:25:511
1633399171,15cyclictest0-21swapper/111:15:231
1633399170,3cyclictest0-21swapper/108:25:011
1633399170,2cyclictest454-21plymouthd08:50:211
1633399170,2cyclictest24032-21expr11:10:171
1633399170,16cyclictest7834-21df_inode10:40:181
1633399170,16cyclictest454-21plymouthd12:10:201
1633399170,16cyclictest4534-21H212:26:331
1633399170,16cyclictest3692-21master07:30:171
1633399170,16cyclictest3079-21gmain08:45:051
1633399170,16cyclictest28138-21pzem_voltage09:20:211
1633399170,16cyclictest22625-21pzem_current09:10:231
1633399170,16cyclictest21022-21irqstats12:00:201
1633199172,1cyclictest9-21ksoftirqd/007:12:330
16331991714,2cyclictest6380-21irqstats11:35:190
16331991714,2cyclictest4776-21lxd08:49:010
16331991714,2cyclictest4698-21munin-run12:30:010
16331991714,2cyclictest4698-21munin-run12:30:000
16331991714,2cyclictest4532-21H212:26:330
16331991714,2cyclictest4528-21H212:26:330
16331991714,2cyclictest32188-21cpuspeed_turbos11:25:180
16331991714,2cyclictest30454-21apache_volume08:30:150
16331991714,2cyclictest29479-21cpuspeed_turbos09:25:160
16331991714,2cyclictest28809-21fschecks_time10:20:170
16331991714,2cyclictest28795-21if_enp1s007:30:170
16331991714,2cyclictest2681-21ntp_states10:30:200
16331991714,2cyclictest25371-21apache_accesses10:15:150
16331991714,2cyclictest19764-21apache_accesses10:05:140
16331991714,2cyclictest18844-21fschecks_time08:10:170
16331991714,2cyclictest1555-21lxd11:31:010
16331991714,2cyclictest14658-21apt-get11:50:170
16331991714,1cyclictest0-21swapper/008:05:100
1633199171,1cyclictest248782sleep010:14:170
1633199171,15cyclictest29809-21expr11:20:190
1633199171,15cyclictest136272chrt11:47:410
1633199171,15cyclictest0-21swapper/008:00:560
1633199170,3cyclictest25390-21awk09:15:230
1633199170,2cyclictest5060-21cat08:40:200
1633199170,2cyclictest4823-21cat07:45:170
1633199170,2cyclictest4431-21snapd07:26:480
1633199170,2cyclictest414-20systemd-journal12:05:000
1633199170,2cyclictest17670-21fschecks_count10:00:200
1633199170,2cyclictest12034-21cstates09:50:170
1633199170,16cyclictest8805-21sed07:50:320
1633199170,16cyclictest5811-21processes10:35:230
1633199170,16cyclictest4538-21H212:26:330
1633199170,16cyclictest29013-21nfsd408:25:220
1633199170,16cyclictest22597-21grep08:15:190
1633199170,16cyclictest20911-21apt-get11:05:180
1633199170,16cyclictest18448-21fschecks_count09:05:180
1633199170,16cyclictest17522-21grep11:55:140
1633199170,16cyclictest16418-21awk09:00:220
1633199170,16cyclictest14340-21ls10:50:270
1633199170,16cyclictest11090-21processes08:50:220
16337991614,1cyclictest8554-21http_loadtime12:35:172
16337991614,1cyclictest11545-21/usr/sbin/munin09:50:162
16337991614,1cyclictest0-21swapper/210:55:192
16337991614,1cyclictest0-21swapper/208:35:222
16337991614,1cyclictest0-21swapper/208:35:212
16337991614,1cyclictest0-21swapper/208:05:172
16337991614,1cyclictest0-21swapper/207:30:232
16337991613,2cyclictest26124-21expr12:10:172
1633799160,1cyclictest0-21swapper/212:05:142
1633799160,1cyclictest0-21swapper/211:55:152
1633799160,15cyclictest5566-21expr12:30:152
1633799160,15cyclictest4867-21expr07:45:172
1633799160,15cyclictest23833-21apache_processe09:15:132
1633799160,15cyclictest18268-21cpuspeed_turbos11:00:202
1633799160,15cyclictest0-21swapper/209:45:172
16333991614,1cyclictest0-21swapper/110:55:151
16333991614,1cyclictest0-21swapper/110:35:151
16333991614,1cyclictest0-21swapper/110:30:211
16333991614,1cyclictest0-21swapper/110:05:051
16333991614,1cyclictest0-21swapper/109:25:211
16333991614,1cyclictest0-21swapper/109:00:161
16333991614,1cyclictest0-21swapper/108:35:261
16333991614,1cyclictest0-21swapper/108:35:251
16333991614,1cyclictest0-21swapper/108:30:201
16333991614,1cyclictest0-21swapper/108:25:161
16333991614,1cyclictest0-21swapper/107:40:161
16333991613,2cyclictest2049-21systemd-journal09:55:011
1633399160,2cyclictest29852-21df11:20:181
1633399160,2cyclictest29586-21hddtemp_smartct12:15:191
1633399160,2cyclictest10556-21df_inode10:45:171
1633399160,1cyclictest0-21swapper/110:25:141
1633399160,15cyclictest9372-21df11:40:151
1633399160,15cyclictest7889-21cpuspeed_turbos12:35:151
1633399160,15cyclictest6916-21pluginstate07:50:011
1633399160,15cyclictest21722-21dpkg08:15:011
1633399160,15cyclictest20908-21apache_volume11:05:191
1633399160,15cyclictest19362chrt09:33:501
1633399160,15cyclictest15978-21fschecks_time08:05:191
1633399160,15cyclictest14809-21tr11:50:181
1633399160,15cyclictest12324-21/usr/sbin/munin08:55:171
1633399160,15cyclictest0-21swapper/111:30:121
1633399160,15cyclictest0-21swapper/109:45:151
1633399160,15cyclictest0-21swapper/108:45:011
1633399160,15cyclictest0-21swapper/107:20:171
1633399160,15cyclictest0-21swapper/107:19:121
16331991614,1cyclictest5278-21apt-get09:40:020
16331991614,1cyclictest32127-21expr12:20:160
16331991614,1cyclictest11536-21systemctl10:45:230
16331991614,1cyclictest0-21swapper/010:55:150
16331991614,1cyclictest0-21swapper/010:25:050
16331991614,1cyclictest0-21swapper/009:55:190
16331991614,1cyclictest0-21swapper/009:20:200
16331991613,2cyclictest32764-21smartctl09:30:210
16331991613,2cyclictest26269-21sendmail_mailtr08:20:240
1633199160,2cyclictest29459-21df_inode12:15:180
1633199160,1cyclictest0-21swapper/009:45:190
1633199160,1cyclictest0-21swapper/007:15:010
1633199160,15cyclictest8481-21apt-key11:40:010
16333991514,1cyclictest0-21swapper/107:50:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional