You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-25 - 03:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot0.osadl.org (updated Tue Mar 25, 2025 00:46:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
665599262,4cyclictest0-21swapper/122:25:011
6659992117,3cyclictest0-21swapper/219:56:182
6659992110,10cyclictest28838-21kworker/2:121:40:012
665999203,16cyclictest0-21swapper/219:29:192
6659992016,3cyclictest0-21swapper/221:30:102
665999193,2cyclictest10501-21awk20:10:212
6659991918,0cyclictest0-21swapper/222:26:352
6655991916,2cyclictest3562-21awk00:29:591
6655991914,4cyclictest0-21swapper/122:43:241
665599191,17cyclictest0-21swapper/120:10:211
665599190,3cyclictest0-21swapper/123:07:421
665599190,1cyclictest0-21swapper/100:38:491
665099193,15cyclictest0-21swapper/021:15:050
665099191,3cyclictest0-21swapper/021:20:190
665099191,3cyclictest0-21swapper/021:20:180
665099190,18cyclictest823-21systemd-network23:49:450
665999182,2cyclictest7319-21awk20:05:182
665999182,15cyclictest0-21swapper/220:17:162
6659991816,1cyclictest0-21swapper/223:55:192
665999180,2cyclictest32508-21nvmesmart_nvme023:10:172
665999180,17cyclictest32147-21sed00:20:002
665599182,15cyclictest7040-21ls20:05:191
665599182,15cyclictest0-21swapper/120:15:211
6655991816,1cyclictest0-21swapper/122:50:211
6655991816,1cyclictest0-21swapper/100:00:261
6655991815,2cyclictest28267-21seq19:46:511
6655991815,2cyclictest19384-21chrt23:52:471
6655991814,3cyclictest414-20systemd-journal20:27:571
6655991811,3cyclictest0-21swapper/119:59:461
665099182,15cyclictest0-21swapper/023:55:560
665099182,15cyclictest0-21swapper/021:46:050
6650991814,3cyclictest0-21swapper/019:43:340
6659991715,1cyclictest28-21ksoftirqd/200:05:002
6659991714,2cyclictest9197-21cron21:15:002
6659991714,2cyclictest4562-21chrt23:20:062
6659991713,3cyclictest29550-21nvmesmart_nvme021:55:202
665999170,2cyclictest9632-21/usr/sbin/munin19:15:162
665999170,2cyclictest5284-21nfsd400:30:142
665999170,2cyclictest27838-21expr20:50:122
665999170,2cyclictest27133-21latency_hist22:59:592
665999170,2cyclictest15668-21kernelversion20:20:172
665999170,2cyclictest15333-21grep23:40:222
665999170,2cyclictest1079-21gdbus22:40:202
665999170,16cyclictest3778-21awk22:10:142
665999170,16cyclictest25291-21sed00:05:012
665999170,16cyclictest20537-21chrt20:34:592
665999170,16cyclictest15320-21grep22:35:152
665999170,16cyclictest1504-21/usr/sbin/munin23:15:142
665999170,16cyclictest1271-21runrttasks20:30:012
665999170,16cyclictest1155-21snapd21:01:062
665999170,16cyclictest10834-21cron22:25:002
665999170,16cyclictest1079-21gdbus19:50:252
665999170,16cyclictest10599-21munin-run23:35:012
665999170,16cyclictest10599-21munin-run23:35:002
665999170,16cyclictest0-21swapper/219:20:152
6655991715,1cyclictest15275-21chrt21:27:441
6655991715,1cyclictest0-21swapper/119:51:321
6655991714,2cyclictest823-21systemd-network23:32:421
6655991714,2cyclictest823-21systemd-network23:32:421
6655991714,2cyclictest4593-21H212:26:331
6655991714,2cyclictest4593-21H212:26:331
6655991714,2cyclictest24895-21sshd21:48:521
6655991714,2cyclictest17953-21latency_hist22:40:011
6655991714,2cyclictest1664-21grep00:20:181
6655991714,2cyclictest1403-21lxd00:12:541
6655991714,2cyclictest1238-21snapd21:38:261
6655991714,2cyclictest12373-21find21:20:121
6655991714,2cyclictest12373-21find21:20:111
6655991714,2cyclictest10188-21expr19:15:151
6655991713,3cyclictest0-21swapper/120:50:151
665599171,15cyclictest21187-21cpuspeed_turbos20:35:131
665599171,15cyclictest0-21swapper/121:40:141
665599170,2cyclictest22103-21pzem_power19:35:181
665599170,2cyclictest20909-21kernelversion23:55:161
665599170,2cyclictest1155-21snapd20:48:421
665599170,16cyclictest7772-21sed22:20:011
665599170,16cyclictest5541-21cron20:05:011
665599170,16cyclictest31020-21awk00:15:181
665599170,16cyclictest25433-21http_loadtime22:55:161
665599170,16cyclictest24382-21cat20:40:181
665599170,16cyclictest2227-21fschecks_time23:15:151
665599170,16cyclictest17318-21sshd19:28:431
665599170,16cyclictest15929-21taskset23:43:341
665599170,16cyclictest1059-21cups-browsed21:50:161
6650991716,1cyclictest9-21ksoftirqd/019:28:360
6650991714,2cyclictest9805-21cut22:20:190
6650991714,2cyclictest881-21avahi-daemon22:15:220
6650991714,2cyclictest8169-21awk21:10:210
6650991714,2cyclictest4528-21H212:26:330
6650991714,2cyclictest4526-21H212:26:330
6650991714,2cyclictest3715-21cpuspeed_turbos21:05:150
6650991714,2cyclictest2829-21cut00:25:010
6650991714,2cyclictest25531-21ls20:40:260
6650991714,2cyclictest23535-21systemctl22:50:150
6650991714,2cyclictest23212-21ls00:00:130
665099171,15cyclictest128902sleep023:36:450
665099170,2cyclictest9191-21sshd00:39:270
665099170,2cyclictest4528-21H212:26:330
665099170,2cyclictest4526-21H212:26:330
665099170,2cyclictest4526-21H212:26:330
665099170,2cyclictest18434-21expr22:40:140
665099170,2cyclictest16054-21turbostat23:45:000
665099170,2cyclictest1472-21lxd20:08:550
665099170,1cyclictest0-21swapper/021:27:270
665099170,1cyclictest0-21swapper/020:16:270
665099170,16cyclictest9220-21dpkg20:10:020
665099170,16cyclictest31532-21fschecks_time22:00:150
665099170,16cyclictest2228-21/usr/sbin/munin22:10:170
665099170,16cyclictest1707-21sed21:00:180
665099170,16cyclictest14248-21proxymap20:21:030
665099170,16cyclictest1404-21lxd21:38:540
665099170,16cyclictest0-21swapper/022:35:150
6659991614,1cyclictest13270-21/usr/sbin/munin22:30:122
6659991614,1cyclictest0-21swapper/223:35:142
6659991614,1cyclictest0-21swapper/222:15:162
6659991614,1cyclictest0-21swapper/222:02:372
6659991614,1cyclictest0-21swapper/221:20:232
6659991614,1cyclictest0-21swapper/221:20:232
6659991614,1cyclictest0-21swapper/220:55:182
6659991614,1cyclictest0-21swapper/220:35:132
6659991614,1cyclictest0-21swapper/200:26:012
6659991614,1cyclictest0-21swapper/200:20:152
6659991613,2cyclictest454-21plymouthd00:10:092
6659991613,2cyclictest26594-21expr19:45:142
6659991613,2cyclictest20987-21find22:45:012
665999160,2cyclictest27426-21/usr/sbin/munin23:00:142
665999160,1cyclictest0-21swapper/223:06:292
665999160,1cyclictest0-21swapper/220:47:462
665999160,15cyclictest8036-21sed19:10:192
665999160,15cyclictest8036-21sed19:10:182
665999160,15cyclictest7067-21expr00:35:152
665999160,15cyclictest3721-21expr20:00:162
665999160,15cyclictest25999-21chrt21:50:112
665999160,15cyclictest22883-21sed21:40:172
665999160,15cyclictest20644-21grep19:35:132
665999160,15cyclictest17228-21/usr/sbin/munin23:50:112
665999160,15cyclictest151872chrt21:26:322
665999160,15cyclictest0-21swapper/221:46:072
665999160,15cyclictest0-21swapper/221:10:192
665999160,15cyclictest0-21swapper/221:05:162
665999160,15cyclictest0-21swapper/220:40:202
665999160,15cyclictest0-21swapper/219:40:172
6655991614,1cyclictest11175-21sendmail_mailqu21:15:221
6655991614,1cyclictest0-21swapper/123:20:171
6655991614,1cyclictest0-21swapper/123:00:151
6655991614,1cyclictest0-21swapper/122:10:101
6655991614,1cyclictest0-21swapper/122:09:261
6655991614,1cyclictest0-21swapper/120:55:151
6655991614,1cyclictest0-21swapper/119:40:151
6655991614,1cyclictest0-21swapper/119:20:121
6655991614,1cyclictest0-21swapper/100:30:131
6655991614,1cyclictest0-21swapper/100:10:011
6655991613,2cyclictest18062-21cpuspeed_turbos19:30:141
665599160,2cyclictest3910-21expr21:05:141
665599160,1cyclictest6087-21apt-get21:10:041
665599160,1cyclictest20190-21postgres20:30:201
665599160,15cyclictest468-21awk21:00:131
665599160,15cyclictest31703-21fschecks_count23:10:131
665599160,15cyclictest30889-21apt-get22:00:141
665599160,15cyclictest28140-21/usr/sbin/munin21:55:131
665599160,15cyclictest10823-21/usr/sbin/munin23:35:151
665599160,15cyclictest0-21swapper/120:20:151
6650991614,1cyclictest28325-21ls20:50:140
6650991614,1cyclictest0-21swapper/023:30:130
6650991614,1cyclictest0-21swapper/023:30:130
6650991614,1cyclictest0-21swapper/023:20:150
6650991614,1cyclictest0-21swapper/023:10:140
6650991614,1cyclictest0-21swapper/023:01:160
6650991614,1cyclictest0-21swapper/022:55:170
6650991614,1cyclictest0-21swapper/021:55:140
6650991614,1cyclictest0-21swapper/019:35:160
6650991614,1cyclictest0-21swapper/000:30:090
6650991614,1cyclictest0-21swapper/000:26:550
6650991613,2cyclictest21414-21expr20:35:130
6650991613,2cyclictest2128-21/usr/sbin/munin23:15:150
665099161,14cyclictest9-21ksoftirqd/023:28:050
6650991611,4cyclictest0-21swapper/020:26:090
665099160,2cyclictest25956-21ls21:50:110
665099160,1cyclictest0-21swapper/022:27:170
665099160,15cyclictest9660-21apt-get19:15:150
665099160,15cyclictest4530-21H212:26:330
665099160,15cyclictest4530-21H212:26:330
665099160,15cyclictest30283-21cat00:15:130
665099160,15cyclictest21924-21apt-get21:40:120
665099160,15cyclictest19222-21ntpq19:30:190
665099160,15cyclictest1411-21lxd23:06:540
665099160,15cyclictest0-21swapper/022:30:120
665099160,15cyclictest0-21swapper/021:30:100
665099160,15cyclictest0-21swapper/020:00:170
665099160,15cyclictest0-21swapper/000:10:180
665099160,15cyclictest0-21swapper/000:06:130
665099160,0cyclictest0-21swapper/019:45:070
6659991514,1cyclictest0-21swapper/222:06:192
6659991513,1cyclictest0-21swapper/223:29:402
665999150,1cyclictest21949-21/usr/sbin/munin22:50:102
665999150,1cyclictest0-21swapper/223:49:592
665999150,1cyclictest0-21swapper/219:30:132
6655991514,1cyclictest0-21swapper/122:45:221
665599150,1cyclictest0-21swapper/123:29:041
665599150,1cyclictest0-21swapper/122:29:591
665599150,0cyclictest0-21swapper/121:31:241
6650991514,1cyclictest0-21swapper/019:20:130
6650991513,1cyclictest0-21swapper/020:45:290
665099150,14cyclictest0-21swapper/022:47:360
665099150,14cyclictest0-21swapper/022:08:050
665599140,14cyclictest0-21swapper/123:45:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional