You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-04 - 15:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot0.osadl.org (updated Sun Jan 04, 2026 00:45:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23912992811,16cyclictest28505-21mii-tool21:10:172
2391299202,15cyclictest0-21swapper/221:15:162
2391299201,17cyclictest10533-21kernelversion19:40:212
2391299192,16cyclictest6427-21cut00:20:002
23912991916,2cyclictest2173-21processes00:10:182
23912991915,3cyclictest0-21swapper/220:44:472
23912991914,2cyclictest28321-21df19:15:152
2391299191,17cyclictest0-21swapper/223:12:322
2391299191,17cyclictest0-21swapper/220:56:412
2391299191,17cyclictest0-21swapper/220:56:412
2391299190,18cyclictest843-21systemd-network19:27:432
2391199193,15cyclictest20935-21awk22:50:191
2391199193,15cyclictest0-21swapper/100:13:101
23911991917,1cyclictest8186-21cat00:20:221
23911991917,1cyclictest0-21swapper/121:09:211
2390999194,1cyclictest0-21swapper/020:51:260
2390999193,15cyclictest15914-21cat19:50:170
23909991917,1cyclictest0-21swapper/022:59:160
23909991917,1cyclictest0-21swapper/020:43:090
23909991916,1cyclictest0-21swapper/023:34:000
2390999190,18cyclictest29762-20systemd-journal22:10:140
2390999190,18cyclictest0-21swapper/022:54:200
2390999190,17cyclictest29817-21nvmesmart_nvme023:05:190
2391299182,15cyclictest244412chrt23:55:052
2391299182,15cyclictest21227-21processes22:50:202
23912991816,1cyclictest0-21swapper/220:50:112
23912991815,2cyclictest32722-21missed_timers20:20:182
23912991815,2cyclictest1501-21tune2fs21:20:142
2391299180,16cyclictest0-21swapper/220:15:202
2391199189,0cyclictest0-21swapper/100:02:081
2391199189,0cyclictest0-21swapper/100:02:081
2391199182,15cyclictest22557-21chrt20:01:251
23911991816,1cyclictest0-21swapper/121:40:221
23911991815,2cyclictest25481-21sessionclean20:08:591
2391199181,3cyclictest0-21swapper/122:07:271
2391199180,2cyclictest4035-21H222:10:211
2391199180,17cyclictest0-21swapper/120:17:191
23909991815,2cyclictest1214-21nfsd422:15:180
23909991815,2cyclictest1214-21nfsd422:15:180
23909991814,3cyclictest27121-21dpkg19:15:000
23909991813,4cyclictest6278-21cron19:35:000
2390999180,16cyclictest1829-21systemd-journal23:39:010
23912991715,1cyclictest5712-21timerandwakeup19:30:212
23912991715,1cyclictest23960-21processes22:55:192
23912991715,1cyclictest17581-21switchtime23:40:212
23912991715,1cyclictest10992-21cat00:25:222
23912991715,1cyclictest0-21swapper/221:50:212
23912991714,2cyclictest8007-21tr20:35:142
23912991714,2cyclictest3324-21cstates22:20:152
23912991714,2cyclictest32404-21timerwakeupswit19:20:222
23912991714,2cyclictest32028-21munin-plugin-st22:15:002
23912991714,2cyclictest306-21latency_hist00:10:012
23912991714,2cyclictest28892-21cstates23:05:142
23912991714,2cyclictest25631-21find23:00:042
23912991714,2cyclictest25055-21expr19:10:152
23912991714,2cyclictest23348-21grep20:05:162
23912991714,2cyclictest21740-21nfsd420:00:182
23912991714,2cyclictest18402-21smartctl22:45:192
23912991712,3cyclictest14247-21munin-plugin-st00:35:002
2391299171,15cyclictest146302sleep219:49:572
23912991711,1cyclictest0-21swapper/222:00:232
2391299170,2cyclictest6848-21latency22:25:182
2391299170,2cyclictest4262-21expr21:25:142
2391299170,2cyclictest32321-21/usr/sbin/munin22:15:152
2391299170,2cyclictest32321-21/usr/sbin/munin22:15:152
2391299170,2cyclictest2686-21fschecks_count20:25:142
2391299170,2cyclictest15293-21fschecks_count00:35:152
2391299170,2cyclictest13694-21which23:35:142
2391299170,2cyclictest10147-21latency_hist23:30:002
2391299170,16cyclictest9211-21df22:30:162
2391299170,16cyclictest8993-21find19:39:012
2391299170,16cyclictest7673-21nfsd400:20:182
2391299170,16cyclictest7329-21cat23:25:002
2391299170,16cyclictest26987-21cstates22:05:152
2391299170,16cyclictest25778-21sed21:05:162
2391299170,16cyclictest22470-21http_loadtime23:50:162
2391299170,16cyclictest22075-21/usr/sbin/munin21:00:122
2391299170,16cyclictest22075-21grep21:55:162
2391299170,16cyclictest18694-21kernelversion19:55:162
2391299170,16cyclictest11541-21smtpd21:38:282
2391299170,16cyclictest10820-21cstates23:30:152
2391299170,15cyclictest0-21swapper/220:46:402
23911991715,1cyclictest0-21swapper/122:15:221
23911991715,1cyclictest0-21swapper/122:15:221
23911991714,2cyclictest8169-21/usr/sbin/munin21:30:211
23911991714,2cyclictest30386-21/usr/sbin/munin21:15:221
23911991714,2cyclictest11800-21ls22:35:131
23911991714,2cyclictest1100-21snmpd19:25:021
23911991714,2cyclictest10497-21latency_hist20:40:011
23911991714,2cyclictest10044-21fschecks_time21:35:181
23911991714,2cyclictest0-21swapper/122:55:221
2391199171,15cyclictest180912sleep123:43:501
2391199170,2cyclictest19920-21fschecks_count20:55:151
2391199170,2cyclictest19920-21fschecks_count20:55:141
2391199170,2cyclictest15919-21switchtime22:40:211
2391199170,2cyclictest13639-21awk19:45:191
2391199170,16cyclictest7688-21sed19:35:181
2391199170,16cyclictest3854-21pzem_voltage20:25:191
2391199170,16cyclictest32346-21sed23:10:171
2391199170,16cyclictest29044-21ntpq21:10:191
2391199170,16cyclictest28468-21perf20:15:011
2391199170,16cyclictest25139-21pzem22:00:221
2391199170,16cyclictest1516-21lxd22:12:321
2391199170,16cyclictest1481-21snapd19:30:091
2391199170,16cyclictest1284-21kerneloops23:22:261
2391199170,16cyclictest10508-21wc23:30:151
23909991715,1cyclictest0-21swapper/022:20:150
23909991714,2cyclictest32658-21taskset19:23:200
23909991714,2cyclictest32257-21fschecks_count20:20:150
23909991714,2cyclictest25802-21latency_hist20:10:000
23909991714,2cyclictest23682-21sensors21:00:210
23909991714,2cyclictest19626-21munin-plugin-st22:50:000
23909991714,2cyclictest17320-21munin-run21:50:000
23909991714,2cyclictest17245-21ntp_kernel_err23:40:180
23909991714,2cyclictest10004-21chrt20:38:250
23909991713,3cyclictest0-21swapper/019:50:020
2390999171,15cyclictest5203-21cpuspeed_turbos20:30:130
2390999171,15cyclictest25551-21idleruntime21:05:150
2390999171,15cyclictest11955-21basename19:45:010
2390999170,2cyclictest951-21grep19:25:140
2390999170,2cyclictest3979-21H222:10:210
2390999170,2cyclictest3149-21proxymap21:23:230
2390999170,16cyclictest5204-21cat23:20:140
2390999170,16cyclictest30002-21munin-plugin-st21:15:000
2390999170,16cyclictest24589-21cpuspeed_turbos23:55:150
2390999170,16cyclictest19027-21dpkg23:45:130
2390999170,16cyclictest17934-21cpuspeed_turbos21:50:120
2390999170,16cyclictest1787-21grep23:15:160
2390999170,16cyclictest1113-21expr00:10:120
23912991614,1cyclictest0-21swapper/223:15:162
23912991614,1cyclictest0-21swapper/221:40:152
23912991614,1cyclictest0-21swapper/219:50:182
23912991613,2cyclictest26724-21expr20:10:152
2391299160,2cyclictest5170-21cpuspeed_turbos20:30:132
2391299160,15cyclictest16082-21sed21:45:192
2391299160,15cyclictest11638-21cat22:35:142
2391299160,15cyclictest0-21swapper/223:45:152
2391299160,15cyclictest0-21swapper/222:41:452
2391299160,15cyclictest0-21swapper/221:30:122
23911991614,1cyclictest1195-21expr19:25:131
23911991614,1cyclictest0-21swapper/123:05:171
23911991614,1cyclictest0-21swapper/121:55:171
23911991614,1cyclictest0-21swapper/121:25:131
23911991614,1cyclictest0-21swapper/121:00:201
23911991614,1cyclictest0-21swapper/120:20:121
23911991614,1cyclictest0-21swapper/119:40:201
23911991614,1cyclictest0-21swapper/119:15:131
23911991614,1cyclictest0-21swapper/100:35:211
23911991614,1cyclictest0-21swapper/100:15:141
23911991614,1cyclictest0-21swapper/100:05:121
23911991614,0cyclictest0-21swapper/122:25:091
23911991613,2cyclictest1885-21tr23:15:161
2391199160,2cyclictest17002-21expr20:50:121
2391199160,2cyclictest10956-21cpuspeed_turbos20:40:171
2391199160,1cyclictest0-21swapper/123:45:141
2391199160,1cyclictest0-21swapper/123:35:151
2391199160,1cyclictest0-21swapper/119:50:161
2391199160,15cyclictest25633-21dirname23:00:031
2391199160,15cyclictest18852-21missed_timers19:55:171
2391199160,15cyclictest0-21swapper/123:55:191
2391199160,15cyclictest0-21swapper/123:54:591
2391199160,15cyclictest0-21swapper/122:45:111
2391199160,15cyclictest0-21swapper/122:30:181
2391199160,15cyclictest0-21swapper/122:20:191
2391199160,15cyclictest0-21swapper/120:45:141
2391199160,15cyclictest0-21swapper/120:30:131
2391199160,15cyclictest0-21swapper/119:10:151
2391199160,15cyclictest0-21swapper/100:30:151
23909991614,1cyclictest4348-21fschecks_count00:15:150
23909991614,1cyclictest32268-21latency23:10:180
23909991614,1cyclictest21703-21strings20:00:180
23909991614,1cyclictest0-21swapper/022:35:140
23909991614,1cyclictest0-21swapper/021:40:140
23909991614,1cyclictest0-21swapper/021:30:180
23909991614,1cyclictest0-21swapper/021:25:150
23909991614,1cyclictest0-21swapper/020:15:180
23909991614,1cyclictest0-21swapper/019:35:180
23909991613,1cyclictest0-21swapper/021:55:190
2390999160,1cyclictest15446-21mailstats20:45:210
2390999160,1cyclictest0-21swapper/000:05:150
2390999160,15cyclictest7649-21tr23:25:150
2390999160,15cyclictest6052-21expr22:25:140
2390999160,15cyclictest4035-21H222:10:210
2390999160,15cyclictest3991-21H222:10:210
2390999160,15cyclictest3450-21gsd-color00:35:170
2390999160,15cyclictest30894-21expr21:15:140
2390999160,15cyclictest28423-21fschecks_time19:15:160
2390999160,15cyclictest27851-21fschecks_count00:00:150
2390999160,15cyclictest27851-21fschecks_count00:00:150
2390999160,15cyclictest27040-21if_lxdbr020:10:180
2390999160,15cyclictest25480-21dpkg23:00:010
2390999160,15cyclictest23690-21cpuspeed_turbos22:00:150
2390999160,15cyclictest2065-21apache_processe20:25:100
2390999160,15cyclictest13609-21sed00:30:220
2390999160,15cyclictest0-21swapper/023:50:180
2390999160,15cyclictest0-21swapper/022:40:160
2390999160,15cyclictest0-21swapper/021:35:140
2390999160,15cyclictest0-21swapper/019:55:140
2390999160,15cyclictest0-21swapper/000:25:140
23911991514,1cyclictest0-21swapper/121:50:141
23911991513,1cyclictest10269-21cat00:25:161
23911991513,1cyclictest0-21swapper/123:25:131
2391199150,1cyclictest0-21swapper/121:20:351
2390999150,1cyclictest0-21swapper/020:55:140
2390999150,1cyclictest0-21swapper/020:55:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional