You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-26 - 16:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot0.osadl.org (updated Sun Oct 26, 2025 12:45:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16854992615,10cyclictest0-21swapper/208:53:142
1685499250,16cyclictest25698-21smartctl08:20:252
1685099254,1cyclictest0-21swapper/109:58:251
16850992515,9cyclictest0-21swapper/110:41:491
1685499240,23cyclictest25972-21munin-run11:15:012
1685099242,21cyclictest0-21swapper/112:30:111
1685099240,16cyclictest5137-21cat11:35:001
1685499232,20cyclictest13089-21chrt09:54:302
16854992314,5cyclictest0-21swapper/209:05:022
1685499230,22cyclictest22476-21awk11:05:232
1685499230,21cyclictest4526-21H212:26:332
1685499230,1cyclictest0-21swapper/208:14:052
16850992314,8cyclictest15568-21expr09:00:151
16850992314,8cyclictest0-21swapper/110:55:001
1685099230,2cyclictest27144-21latency_hist10:20:011
1685499222,19cyclictest0-21swapper/212:11:382
16854992214,7cyclictest28431-21/usr/sbin/munin07:30:152
16854992213,8cyclictest20598-21awk10:05:222
1685499221,20cyclictest0-21swapper/208:41:052
1685499221,15cyclictest26975-21sh10:20:012
1685499220,21cyclictest5534-21ntpq12:30:192
1685499220,21cyclictest115282sleep210:49:322
1685499220,1cyclictest0-21swapper/210:29:572
1685499220,1cyclictest0-21swapper/209:48:322
1685499220,16cyclictest4895-21taskset09:39:382
1685499220,16cyclictest1299-21lxd08:07:032
16850992215,6cyclictest28357-21grep08:25:231
16850992214,7cyclictest19446-21ls10:05:141
16850992214,6cyclictest4538-21H212:26:331
16850992214,6cyclictest4528-21H212:26:331
16850992214,6cyclictest2049-21systemd-journal10:26:581
16850992213,1cyclictest0-21swapper/111:36:501
1685099220,3cyclictest0-21swapper/107:39:041
1685099220,2cyclictest11567-21cron10:50:011
1685099220,21cyclictest20424-21awk12:00:181
1685099220,1cyclictest8134-21ls07:50:151
1685099220,1cyclictest0-21swapper/110:10:211
1685099220,1cyclictest0-21swapper/108:50:231
1685099220,16cyclictest967-21thermald10:35:251
1685099220,16cyclictest967-21thermald10:35:251
1685099220,16cyclictest9395-21perf12:40:001
1685099220,16cyclictest414-20systemd-journal11:17:001
1685099220,16cyclictest25499-21cut08:20:221
1685099220,16cyclictest23897-21grep07:20:191
1685099220,16cyclictest23786-21expr09:15:161
1685099220,16cyclictest23786-21expr09:15:151
1685099220,16cyclictest13033-21latency_hist08:00:001
16854992114,6cyclictest0-21swapper/211:15:162
16854992114,6cyclictest0-21swapper/211:00:152
16854992113,7cyclictest20406-21grep12:00:172
1685499210,2cyclictest19735-21latency_hist07:15:012
1685499210,20cyclictest29820-21grep08:30:152
1685499210,20cyclictest0-21swapper/212:18:222
1685499210,1cyclictest1923-21expr10:30:192
1685499210,1cyclictest0-21swapper/212:08:582
1685499210,1cyclictest0-21swapper/211:40:162
1685499210,16cyclictest30481-21awk11:20:202
1685499210,16cyclictest21271-21ntp_offset07:15:202
1685499210,15cyclictest4528-21H212:26:332
1685499210,15cyclictest0-21swapper/209:21:082
16850992115,5cyclictest0-21swapper/108:55:151
16850992114,6cyclictest8053-21latency_hist09:45:011
16850992114,6cyclictest5811-21taskset08:41:161
16850992114,6cyclictest4528-21H212:26:331
16850992114,6cyclictest32394-21grep09:30:151
16850992114,6cyclictest14691-21sed08:00:221
16850992114,6cyclictest0-21swapper/110:20:191
16850992114,6cyclictest0-21swapper/109:50:191
16850992114,6cyclictest0-21swapper/109:11:551
16850992114,5cyclictest0-21swapper/111:05:171
16850992113,7cyclictest16653-21cpuspeed_turbos11:55:141
16850992113,7cyclictest16653-21cpuspeed_turbos11:55:131
16850992112,1cyclictest0-21swapper/108:15:011
1685099210,2cyclictest4538-21H212:26:331
1685099210,2cyclictest2939-21perf10:35:011
1685099210,2cyclictest2707-21lxd08:07:041
1685099210,2cyclictest20273-21expr07:15:151
1685099210,20cyclictest29919-21cat11:20:171
1685099210,20cyclictest22166-21cat12:05:131
1685099210,20cyclictest0-21swapper/111:00:181
1685099210,20cyclictest0-21swapper/110:02:231
1685099210,16cyclictest19824-21awk09:05:251
1685099210,16cyclictest17479-21cat07:10:171
1685099210,14cyclictest0-21swapper/107:40:191
1685099210,0cyclictest0-21swapper/111:25:141
1684899213,12cyclictest2663-21perf08:40:020
16848992117,3cyclictest4538-21H212:26:330
16848992115,5cyclictest0-21swapper/009:00:010
16854992014,5cyclictest12404-21cpu08:55:162
16854992014,5cyclictest0-21swapper/209:25:212
16854992014,5cyclictest0-21swapper/207:45:182
16854992013,6cyclictest962-21apt-config12:25:012
16854992013,6cyclictest642-21nfsd411:25:182
16854992013,6cyclictest22060-21awk09:10:182
16854992013,6cyclictest0-21swapper/211:30:222
16854992013,6cyclictest0-21swapper/210:55:002
16854992013,6cyclictest0-21swapper/208:15:022
16854992012,7cyclictest28624-21netstat10:20:192
16854992012,2cyclictest29676-21date08:30:012
1685499200,1cyclictest0-21swapper/212:35:152
1685499200,1cyclictest0-21swapper/210:50:182
1685499200,1cyclictest0-21swapper/210:10:192
1685499200,1cyclictest0-21swapper/207:35:132
1685499200,19cyclictest14955-21ntpq09:55:212
1685499200,19cyclictest0-21swapper/210:37:112
1685499200,19cyclictest0-21swapper/210:37:112
1685499200,16cyclictest11957-21pzem_voltage07:55:222
1685499200,15cyclictest0-21swapper/209:30:172
1685499200,15cyclictest0-21swapper/209:05:162
1685499200,15cyclictest0-21swapper/208:38:332
1685499200,15cyclictest0-21swapper/208:00:142
16850992014,0cyclictest0-21swapper/112:25:141
1685099200,2cyclictest4532-21H212:26:331
1685099200,1cyclictest24590-21sed11:10:171
1685099200,1cyclictest0-21swapper/109:45:191
1685099200,19cyclictest27898-21expr12:15:141
1685099200,19cyclictest0-21swapper/109:35:181
1685099200,19cyclictest0-21swapper/108:30:201
1685099200,15cyclictest30531-21sed09:25:231
1685099200,14cyclictest0-21swapper/111:45:181
1685099200,0cyclictest0-21swapper/112:10:131
1684899200,19cyclictest823-21systemd-network09:20:280
1685499199,9cyclictest0-21swapper/207:40:192
16854991917,1cyclictest0-21swapper/209:43:032
16854991913,5cyclictest0-21swapper/211:45:162
16854991913,5cyclictest0-21swapper/207:25:142
1685499190,1cyclictest0-21swapper/211:35:172
1685499190,1cyclictest0-21swapper/209:15:152
1685499190,1cyclictest0-21swapper/209:15:152
1685499190,18cyclictest0-21swapper/211:50:162
1685499190,18cyclictest0-21swapper/210:40:172
1685499190,18cyclictest0-21swapper/210:00:232
1685499190,15cyclictest0-21swapper/212:20:162
16850991914,4cyclictest0-21swapper/111:43:221
16850991914,0cyclictest0-21swapper/107:25:141
16850991912,1cyclictest0-21swapper/111:54:541
1685099190,14cyclictest0-21swapper/108:45:171
1685099190,0cyclictest0-21swapper/108:15:161
1684899192,16cyclictest6760-21ntp_offset09:40:210
16848991917,1cyclictest0-21swapper/010:47:410
16848991914,4cyclictest0-21swapper/011:07:590
1684899190,1cyclictest0-21swapper/012:15:200
16854991812,0cyclictest0-21swapper/211:55:142
16854991812,0cyclictest0-21swapper/211:55:142
16854991811,1cyclictest0-21swapper/208:45:182
16848991817,1cyclictest9-21ksoftirqd/012:00:380
16848991816,1cyclictest4532-21H212:26:330
16848991816,1cyclictest0-21swapper/010:15:180
16848991815,2cyclictest4538-21H212:26:330
16848991812,3cyclictest4526-21H212:26:330
1684899181,16cyclictest9-21ksoftirqd/007:45:160
1684899180,3cyclictest11066-21fschecks_time07:55:170
1684899180,2cyclictest4593-21H212:26:330
1684899172,1cyclictest9-21ksoftirqd/010:31:370
16848991716,1cyclictest0-21swapper/011:48:210
16848991715,1cyclictest32405-21chrt12:22:290
16848991715,1cyclictest0-21swapper/012:25:150
16848991714,2cyclictest4534-21H212:26:330
16848991714,2cyclictest4532-21H212:26:330
16848991714,2cyclictest4528-21H212:26:330
16848991714,2cyclictest28081-21grep10:20:170
16848991714,2cyclictest18736-21sh12:00:000
16848991714,2cyclictest18736-21sh12:00:000
16848991714,2cyclictest16468-21df08:05:140
1684899171,1cyclictest9-21ksoftirqd/008:22:450
1684899171,15cyclictest4534-21H212:26:330
1684899170,2cyclictest4593-21H212:26:330
1684899170,2cyclictest4581-21H212:26:330
1684899170,1cyclictest4536-21H212:26:330
1684899170,1cyclictest4534-21H212:26:330
1684899170,1cyclictest0-21swapper/011:12:000
1684899170,16cyclictest8318-21nvmesmart_nvme012:35:200
1684899170,16cyclictest6009-21ls12:30:210
1684899170,16cyclictest4593-21H212:26:330
1684899170,16cyclictest4581-21H212:26:330
1684899170,16cyclictest4528-21H212:26:330
1684899170,16cyclictest4528-21H212:26:330
1684899170,16cyclictest26070-21cut09:20:000
1684899170,16cyclictest26070-21cut09:20:000
1684899170,16cyclictest18962-21cpuspeed_turbos08:10:150
1684899170,16cyclictest1404-21lxd09:07:040
1684899170,16cyclictest0-21swapper/011:35:210
1684899170,16cyclictest0-21swapper/007:35:220
1684899170,16cyclictest0-21swapper/007:10:140
1684899170,15cyclictest0-21swapper/010:50:160
16848991614,1cyclictest2410-21cstates09:35:160
16848991614,1cyclictest0-21swapper/012:10:120
16848991614,1cyclictest0-21swapper/012:05:140
16848991614,1cyclictest0-21swapper/011:50:140
16848991614,1cyclictest0-21swapper/011:25:140
16848991614,1cyclictest0-21swapper/011:20:130
16848991614,1cyclictest0-21swapper/011:15:170
16848991614,1cyclictest0-21swapper/008:15:210
16848991613,2cyclictest8995-21idleruntime11:40:170
16848991613,2cyclictest502-21nfsd409:30:180
16848991613,2cyclictest4538-21H212:26:330
16848991613,2cyclictest15021-21sed10:55:020
1684899160,1cyclictest13489-21expr08:00:150
1684899160,1cyclictest0-21swapper/011:00:150
1684899160,1cyclictest0-21swapper/010:00:180
1684899160,1cyclictest0-21swapper/009:45:160
1684899160,15cyclictest10838-21apache_processe09:50:130
1684899160,15cyclictest0-21swapper/010:10:150
1684899160,15cyclictest0-21swapper/009:25:200
1684899150,14cyclictest3441-21gsd-color07:40:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional