You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot0.osadl.org (updated Fri May 02, 2025 00:46:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26714992219,2cyclictest20719-21perf20:55:022
2670599220,6cyclictest0-21swapper/019:43:590
26714992119,1cyclictest28-21ksoftirqd/200:01:212
26714992110,10cyclictest0-21swapper/223:15:222
2671099216,14cyclictest0-21swapper/121:45:181
2670599217,13cyclictest0-21swapper/023:30:190
2671499202,3cyclictest0-21swapper/221:55:012
2671099203,11cyclictest17228-21cat21:45:011
2671099200,3cyclictest4593-21H212:26:331
2671099200,19cyclictest823-21systemd-network19:40:101
2670599203,16cyclictest7325-21expr22:20:190
26705992017,2cyclictest4523-21H212:26:330
26705992012,4cyclictest0-21swapper/019:18:440
2671499194,1cyclictest0-21swapper/221:45:182
26714991917,1cyclictest0-21swapper/221:15:182
2671499190,3cyclictest17173-21python321:45:012
2671499190,1cyclictest0-21swapper/221:00:232
26710991915,3cyclictest0-21swapper/123:05:011
2671099190,18cyclictest414-20systemd-journal23:55:001
2671099190,18cyclictest414-20systemd-journal23:55:001
2670599193,15cyclictest4534-21H212:26:330
26705991917,1cyclictest0-21swapper/023:28:570
2670599190,2cyclictest4593-21H212:26:330
2670599190,2cyclictest4534-21H212:26:330
2670599190,18cyclictest0-21swapper/023:43:050
2670599190,16cyclictest4593-21H212:26:330
2670599190,16cyclictest4530-21H212:26:330
2670599190,16cyclictest4523-21H212:26:330
2671499182,1cyclictest0-21swapper/222:42:292
26714991816,1cyclictest0-21swapper/222:15:152
26714991815,2cyclictest4534-21H212:26:332
26714991815,2cyclictest4530-21H212:26:332
26714991814,3cyclictest4523-21H212:26:332
26714991814,3cyclictest4523-21H212:26:332
26714991814,3cyclictest24903-21latency23:50:212
26714991814,3cyclictest24903-21latency23:50:202
26714991814,3cyclictest0-21swapper/200:37:062
2671499181,2cyclictest3707-21lxd20:22:532
2671499181,2cyclictest16117-21chrt22:36:012
2671499181,16cyclictest1086-21snmpd23:45:062
2671499180,17cyclictest5037-21cat20:25:162
2671499180,17cyclictest4995-21cut19:25:202
2671499180,16cyclictest4526-21H212:26:332
2671499180,16cyclictest0-21swapper/219:47:282
2671499180,15cyclictest4581-21H212:26:332
2671499180,15cyclictest4581-21H212:26:332
2671099183,1cyclictest21-21ksoftirqd/122:12:111
2671099182,1cyclictest21-21ksoftirqd/100:00:541
26710991816,1cyclictest0-21swapper/120:30:191
26710991814,3cyclictest4528-21H212:26:331
2671099181,16cyclictest18849-21proc_pri19:50:221
2671099180,3cyclictest4528-21H212:26:331
2671099180,2cyclictest4538-21H212:26:331
2671099180,2cyclictest4532-21H212:26:331
2671099180,2cyclictest4532-21H212:26:331
2671099180,17cyclictest4523-21H212:26:331
2671099180,17cyclictest4523-21H212:26:331
2671099180,17cyclictest4523-21H212:26:331
2671099180,17cyclictest4523-21H212:26:331
2671099180,17cyclictest4523-21H212:26:331
2671099180,15cyclictest4538-21H212:26:331
2671099180,15cyclictest4530-21H212:26:331
2671099180,15cyclictest4526-21H212:26:331
2670599182,15cyclictest4593-21H212:26:330
26705991816,1cyclictest7801-21timerandwakeup21:25:260
26705991816,1cyclictest0-21swapper/020:05:010
26705991816,1cyclictest0-21swapper/000:39:330
26705991814,3cyclictest4536-21H212:26:330
26705991814,2cyclictest25269-21nvmesmart_nvme021:00:250
2670599180,2cyclictest4534-21H212:26:330
2670599180,2cyclictest4526-21H212:26:330
2670599180,2cyclictest4523-21H212:26:330
2670599180,2cyclictest4523-21H212:26:330
2670599180,17cyclictest4532-21H212:26:330
2670599180,17cyclictest4532-21H212:26:330
2670599180,16cyclictest4581-21H212:26:330
2670599180,15cyclictest4526-21H212:26:330
26714991715,1cyclictest286372sleep223:56:102
26714991715,1cyclictest0-21swapper/220:11:482
26714991714,2cyclictest9238-21tune2fs00:20:172
26714991714,2cyclictest4536-21H212:26:332
26714991714,2cyclictest4536-21H212:26:332
26714991714,2cyclictest4534-21H212:26:332
26714991714,2cyclictest4526-21H212:26:332
26714991714,2cyclictest28393-21expr23:00:152
26714991714,2cyclictest2801-21/usr/sbin/munin00:10:122
26714991714,2cyclictest26878-21/usr/sbin/munin22:00:242
26714991714,2cyclictest26069-21ls20:05:182
26714991714,2cyclictest11559-21ntpq23:25:192
26714991713,3cyclictest4581-21H212:26:332
2671499171,15cyclictest6464-21cpuspeed_turbos19:30:152
2671499171,15cyclictest6464-21cpuspeed_turbos19:30:152
2671499171,15cyclictest0-21swapper/200:18:082
2671499170,2cyclictest4538-21H212:26:332
2671499170,2cyclictest4538-21H212:26:332
2671499170,2cyclictest4532-21H212:26:332
2671499170,2cyclictest31136-21proc_pri19:15:222
2671499170,2cyclictest31011-21ntpq22:05:212
2671499170,1cyclictest0-21swapper/220:02:432
2671499170,16cyclictest5637-21cron21:25:012
2671499170,16cyclictest4593-21H212:26:332
2671499170,16cyclictest4581-21H212:26:332
2671499170,16cyclictest4581-21H212:26:332
2671499170,16cyclictest4528-21H212:26:332
2671499170,16cyclictest3707-21lxd22:20:542
2671499170,16cyclictest28196-21nfsd421:05:202
2671499170,16cyclictest25756-21df22:55:152
2671499170,16cyclictest24877-21cut21:55:162
2671499170,16cyclictest20562-21expr19:55:192
2671499170,16cyclictest20562-21expr19:55:182
2671499170,16cyclictest20028-21cut19:55:012
2671499170,16cyclictest15796-21cut23:35:142
2671499170,16cyclictest14255-21nfsd420:40:242
2671499170,16cyclictest1402-21lxd22:32:532
2671499170,16cyclictest1402-21lxd22:32:532
2671499170,16cyclictest12452-21latency21:35:202
2671499170,16cyclictest1087-21idleruntime-cro20:20:002
2671499170,16cyclictest0-21swapper/219:35:122
2671099172,1cyclictest21-21ksoftirqd/120:07:391
26710991715,1cyclictest0-21swapper/120:00:191
26710991714,2cyclictest997-21thermald20:35:151
26710991714,2cyclictest6358-21expr00:15:141
26710991714,2cyclictest4581-21H212:26:331
26710991714,2cyclictest4538-21H212:26:331
26710991714,2cyclictest4532-21H212:26:331
26710991714,2cyclictest4530-21H212:26:331
26710991714,2cyclictest4528-21H212:26:331
26710991714,2cyclictest4528-21H212:26:331
26710991714,2cyclictest26796-21tr23:55:131
26710991714,2cyclictest11086-21perf21:35:011
26710991714,1cyclictest0-21swapper/121:35:211
26710991713,3cyclictest4593-21H212:26:331
26710991713,3cyclictest4538-21H212:26:331
2671099171,2cyclictest4528-21H212:26:331
2671099171,15cyclictest26697-21cyclictest23:20:191
2671099170,2cyclictest4523-21H212:26:331
2671099170,2cyclictest22603-21processes20:55:251
2671099170,2cyclictest16866-21latency_hist22:40:011
2671099170,1cyclictest0-21swapper/119:56:411
2671099170,1cyclictest0-21swapper/119:56:411
2671099170,16cyclictest9625-21sort00:20:201
2671099170,16cyclictest5487-21if_eno123:15:171
2671099170,16cyclictest4538-21H212:26:331
2671099170,16cyclictest4532-21H212:26:331
2671099170,16cyclictest4530-21H212:26:331
2671099170,16cyclictest4523-21H212:26:331
2671099170,16cyclictest3588-21expr00:10:141
2671099170,16cyclictest17728-21perl22:40:151
2671099170,16cyclictest11525-21cstates00:25:141
26705991714,2cyclictest7218-21ntp_states00:15:190
26705991714,2cyclictest6285-21sed19:30:010
26705991714,2cyclictest5440-21http_loadtime23:15:170
26705991714,2cyclictest4532-21H212:26:330
26705991714,2cyclictest4532-21H212:26:330
26705991714,2cyclictest4526-21H212:26:330
26705991714,2cyclictest4523-21H212:26:330
26705991714,2cyclictest32712-21fschecks_count00:05:160
26705991714,2cyclictest23245-21if_eno122:50:170
26705991714,2cyclictest21657-21expr23:45:160
26705991713,3cyclictest4523-21H212:26:330
2670599171,15cyclictest1163-21latency21:15:170
2670599171,15cyclictest0-21swapper/021:10:210
2670599170,2cyclictest7478-21expr20:30:150
2670599170,2cyclictest4593-21H212:26:330
2670599170,2cyclictest22309-21nfsd421:50:200
2670599170,2cyclictest1354-21lxd22:56:530
2670599170,2cyclictest11592-21grep22:30:160
2670599170,2cyclictest11592-21grep22:30:150
2670599170,16cyclictest881-21avahi-daemon19:30:220
2670599170,16cyclictest881-21avahi-daemon19:30:220
2670599170,16cyclictest4593-21H212:26:330
2670599170,16cyclictest4532-21H212:26:330
2670599170,16cyclictest4530-21H212:26:330
2670599170,16cyclictest4523-21H212:26:330
2670599170,16cyclictest4389-21grep22:15:190
2670599170,16cyclictest3707-21lxd23:10:530
2670599170,16cyclictest32742-21seq22:10:140
2670599170,16cyclictest27312-21expr22:00:150
2670599170,16cyclictest15512-21ntpq22:35:190
2670599170,16cyclictest15350-21cat21:40:160
2670599170,16cyclictest11812-21expr00:25:140
2670599170,15cyclictest4523-21H212:26:330
26714991614,1cyclictest9993-21nfsd421:30:232
26714991614,1cyclictest0-21swapper/221:25:182
2671499160,2cyclictest30853-21find23:05:012
26710991614,1cyclictest0-21swapper/123:40:181
26710991614,1cyclictest0-21swapper/122:00:151
26710991614,1cyclictest0-21swapper/120:15:171
26710991613,2cyclictest6906-21if_err_eno121:25:201
26710991613,2cyclictest4523-21H212:26:331
2671099160,1cyclictest23369-21kernelversion22:50:191
2671099160,15cyclictest4534-21H212:26:331
2671099160,15cyclictest4532-21H212:26:331
2671099160,15cyclictest3117-21/usr/sbin/munin21:20:191
2671099160,15cyclictest26759-21find21:05:021
2671099160,15cyclictest23979-21https21:55:021
2671099160,15cyclictest0-21swapper/120:40:191
2671099160,15cyclictest0-21swapper/120:20:161
2671099160,15cyclictest0-21swapper/119:35:171
26705991614,1cyclictest0-21swapper/020:45:220
26705991614,1cyclictest0-21swapper/019:10:160
26705991613,2cyclictest4534-21H212:26:330
2670599160,1cyclictest0-21swapper/022:40:140
2670599160,15cyclictest4538-21H212:26:330
2670599160,15cyclictest4536-21H212:26:330
2670599160,15cyclictest0-21swapper/021:55:020
2670599160,15cyclictest0-21swapper/020:15:200
2670599150,14cyclictest0-21swapper/021:30:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional