You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-24 - 15:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot0.osadl.org (updated Fri Oct 24, 2025 00:45:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2961899242,15cyclictest0-21swapper/219:50:232
2961899240,5cyclictest0-21swapper/200:21:272
2961899234,1cyclictest0-21swapper/200:00:532
2961899231,3cyclictest0-21swapper/220:55:202
2961899230,15cyclictest29297-21latency_hist23:55:012
2961899225,13cyclictest0-21swapper/200:39:322
29618992215,6cyclictest29455-21/usr/sbin/munin23:55:172
29618992214,7cyclictest17510-21grep20:40:242
29618992213,5cyclictest0-21swapper/219:40:182
2961899220,2cyclictest967-21thermald23:20:222
2961899220,21cyclictest28313-21expr20:05:162
2961899220,16cyclictest19975-21cstates22:40:152
2960899222,17cyclictest0-21swapper/021:34:340
29618992116,4cyclictest0-21swapper/200:33:052
2961899211,1cyclictest8505-21processes23:15:212
2961899210,2cyclictest31855-21taskset21:06:132
2961899210,2cyclictest25919-21apache_volume21:55:142
2961899210,2cyclictest17444-21grep22:35:152
2961899210,20cyclictest31445-21pzem_current19:10:242
2961899210,20cyclictest2658-21systemctl23:05:232
2961899210,20cyclictest25582-21mailstats23:45:222
2961899210,20cyclictest22947-21chrt23:41:582
2961899210,1cyclictest7883-21sed19:25:242
2961899210,1cyclictest0-21swapper/222:53:422
2961899210,1cyclictest0-21swapper/221:35:152
2961899210,1cyclictest0-21swapper/221:20:232
2961899210,1cyclictest0-21swapper/219:20:262
2961899210,16cyclictest4527-21H212:26:332
2961899210,16cyclictest0-21swapper/222:55:202
2961899210,15cyclictest27982-21if_lxdbr021:00:172
2961899210,15cyclictest11410-21cat19:35:022
2961899210,15cyclictest10494-21cut20:30:012
2961899210,15cyclictest0-21swapper/221:10:182
29613992111,5cyclictest0-21swapper/120:20:591
2961399210,4cyclictest0-21swapper/121:35:001
2960899215,7cyclictest0-21swapper/019:34:080
2961899204,15cyclictest0-21swapper/222:08:332
29618992014,5cyclictest9227-21expr00:15:142
29618992014,5cyclictest30728-21cpuspeed_turbos23:00:142
29618992014,5cyclictest21473-21sed21:45:202
29618992014,5cyclictest0-21swapper/200:09:002
29618992013,6cyclictest28760-21cpuspeed_turbos22:00:162
29618992013,6cyclictest1834-21appstreamcli20:15:022
29618992013,6cyclictest10420-21memory21:25:192
2961899200,2cyclictest4609-21sed21:15:202
2961899200,1cyclictest0-21swapper/223:30:182
2961899200,19cyclictest0-21swapper/222:25:012
2961899200,19cyclictest0-21swapper/222:10:152
2961899200,19cyclictest0-21swapper/220:36:152
2961899200,19cyclictest0-21swapper/220:00:192
2961899200,19cyclictest0-21swapper/200:28:572
2961899200,16cyclictest21592-21/usr/sbin/munin20:50:212
2961899200,15cyclictest9954-21timerandwakeup22:20:242
2961899200,15cyclictest13878-21timerandwakeup21:30:252
2961899200,15cyclictest0-21swapper/219:35:162
2961899200,0cyclictest0-21swapper/223:29:342
2960899203,16cyclictest0-21swapper/021:36:590
29608992017,2cyclictest4403-21tr23:10:140
2960899201,5cyclictest0-21swapper/000:15:190
2960899200,19cyclictest0-21swapper/020:20:230
29618991914,5cyclictest0-21swapper/221:50:152
29618991914,4cyclictest0-21swapper/221:45:002
29618991913,5cyclictest4321-21cpuspeed_turbos23:10:152
2961899190,18cyclictest0-21swapper/223:35:212
2961899190,18cyclictest0-21swapper/222:15:182
2961899190,18cyclictest0-21swapper/220:30:212
2961899190,18cyclictest0-21swapper/220:10:142
2961899190,18cyclictest0-21swapper/200:10:162
2961899190,18cyclictest0-21swapper/200:10:162
2961899190,14cyclictest0-21swapper/222:31:282
2961899190,14cyclictest0-21swapper/219:15:172
2961899190,0cyclictest0-21swapper/219:55:332
29613991916,2cyclictest921-21in:imklog00:22:331
29613991916,2cyclictest7411-21head21:20:211
2961399190,16cyclictest4536-21H212:26:331
2960899193,1cyclictest2642-21grep22:10:140
2960899193,15cyclictest0-21swapper/022:59:490
2960899192,16cyclictest0-21swapper/021:55:000
2960899190,18cyclictest0-21swapper/020:30:500
29618991813,4cyclictest0-21swapper/222:45:182
29618991812,5cyclictest0-21swapper/220:21:092
2961399182,15cyclictest0-21swapper/120:30:161
29613991815,2cyclictest16390-21chrt00:28:431
2961399180,3cyclictest823-21systemd-network19:49:231
2961399180,3cyclictest2049-21systemd-journal21:51:201
2961399180,2cyclictest28124-21grep22:55:151
2961399180,17cyclictest823-21systemd-network19:52:591
2961399180,16cyclictest6863-21fschecks_time19:25:181
2960899182,1cyclictest0-21swapper/000:32:220
2960899182,15cyclictest248932sleep019:58:350
2960899182,15cyclictest198732chrt21:43:040
2960899182,15cyclictest13186-21mailstats19:35:220
29608991816,1cyclictest0-21swapper/022:02:140
29608991815,2cyclictest19822-21cpuspeed_turbos00:35:150
29608991814,3cyclictest20450-21ls23:39:590
29608991814,3cyclictest1079-21gdbus19:45:220
2960899180,3cyclictest22791-21idleruntime-cro21:50:010
2960899180,3cyclictest2049-21systemd-journal21:07:550
2960899180,3cyclictest0-21swapper/020:50:160
2960899180,17cyclictest12574-21cut22:25:220
2961399172,15cyclictest21-21ksoftirqd/122:03:001
29613991715,1cyclictest24167-21cpuspeed_turbos23:45:141
29613991715,1cyclictest18314-21ntp_offset00:30:241
29613991715,1cyclictest0-21swapper/123:55:261
29613991714,2cyclictest3199-21cat00:05:171
29613991714,2cyclictest27356-21fschecks_count23:50:171
29613991714,2cyclictest24509-21cpuspeed_turbos20:55:151
29613991714,2cyclictest21599-21cat22:40:231
29613991714,2cyclictest11755-21cut21:30:001
29613991713,3cyclictest4523-21H212:26:331
2961399171,15cyclictest13732-21nfsd423:25:221
2961399170,2cyclictest7986-21ls22:20:011
2961399170,2cyclictest31218-21awk19:10:211
2961399170,2cyclictest29396-21nfsd420:05:211
2961399170,2cyclictest18890-21kernelversion23:35:181
2961399170,2cyclictest17534-21cron23:35:001
2961399170,16cyclictest8229-21expr20:25:161
2961399170,16cyclictest777-21timerandwakeup22:05:231
2961399170,16cyclictest26197-21idleruntime20:00:191
2961399170,16cyclictest25246-21date20:00:021
2961399170,16cyclictest23717-21apt-config23:45:011
2961399170,16cyclictest1634-21nfsd419:15:201
2961399170,16cyclictest1059-21cups-browsed21:10:241
2960899172,1cyclictest0-21swapper/000:20:260
29608991715,1cyclictest224252chrt22:45:100
29608991714,2cyclictest7139-21switchtime22:15:230
29608991714,2cyclictest4532-21H212:26:330
29608991714,2cyclictest31046-21missed_timers19:10:210
29608991714,2cyclictest14435-21timerwakeupswit23:25:260
29608991714,2cyclictest0-21swapper/022:35:190
29608991714,2cyclictest0-21swapper/000:25:250
29608991713,2cyclictest31342-21wc20:10:130
2960899171,15cyclictest55632chrt19:22:550
2960899171,15cyclictest0-21swapper/022:05:200
2960899170,2cyclictest27114-21grep21:00:150
2960899170,16cyclictest8434-21ntpq23:15:210
2960899170,16cyclictest6383-21cut21:20:170
2960899170,16cyclictest5992-21cut21:20:010
2960899170,16cyclictest3804-21run-parts20:15:220
2960899170,16cyclictest3006-21expr00:05:180
2960899170,16cyclictest26723-21/usr/sbin/munin23:50:200
2960899170,16cyclictest23263-21cat23:45:010
2960899170,16cyclictest16560-21cstates20:40:200
2960899170,16cyclictest0-21swapper/023:05:160
2960899170,16cyclictest0-21swapper/022:53:390
2960899170,16cyclictest0-21swapper/020:28:590
29613991614,1cyclictest32629-21pzem_voltage20:10:201
29613991614,1cyclictest0-21swapper/123:15:191
29613991614,1cyclictest0-21swapper/122:35:561
29613991614,1cyclictest0-21swapper/122:00:011
29613991614,1cyclictest0-21swapper/121:05:201
29613991614,1cyclictest0-21swapper/121:00:181
29613991614,1cyclictest0-21swapper/119:35:171
29613991614,1cyclictest0-21swapper/100:00:151
29613991613,2cyclictest14821-21systemctl20:35:231
2961399160,2cyclictest15337-21cat21:35:161
2961399160,1cyclictest1227-21cpuspeed_turbos23:05:151
2961399160,1cyclictest10982-21https22:25:001
2961399160,1cyclictest0-21swapper/120:15:151
2961399160,16cyclictest0-21swapper/122:45:111
2961399160,15cyclictest5186-21timerandwakeup19:20:261
2961399160,15cyclictest4876-21expr23:10:161
2961399160,15cyclictest4538-21H212:26:331
2961399160,15cyclictest4523-21H212:26:331
2961399160,15cyclictest4523-21H212:26:331
2961399160,15cyclictest31381-21smartctl23:00:151
2961399160,15cyclictest26984-21timerandwakeup22:50:241
2961399160,15cyclictest14867-21expr19:40:141
2961399160,15cyclictest0-21swapper/123:20:151
2961399160,15cyclictest0-21swapper/121:45:011
2961399160,15cyclictest0-21swapper/121:15:181
2961399160,15cyclictest0-21swapper/120:50:201
2961399160,15cyclictest0-21swapper/120:45:181
2961399160,15cyclictest0-21swapper/120:40:201
2961399160,15cyclictest0-21swapper/119:35:011
2961399160,15cyclictest0-21swapper/100:35:171
29608991614,1cyclictest0-21swapper/023:45:150
29608991614,1cyclictest0-21swapper/023:20:160
29608991614,1cyclictest0-21swapper/023:00:180
29608991614,1cyclictest0-21swapper/021:25:160
29608991614,1cyclictest0-21swapper/021:10:180
2960899160,2cyclictest15227-21chrt20:35:430
2960899160,1cyclictest0-21swapper/019:40:140
2960899160,15cyclictest4538-21H212:26:330
2960899160,15cyclictest3441-21gsd-color00:10:090
2960899160,15cyclictest3441-21gsd-color00:10:080
2960899160,15cyclictest26171-21cat21:55:170
2960899160,15cyclictest20623-21fschecks_time19:50:160
2960899160,15cyclictest19402-21expr20:45:150
2960899160,15cyclictest16563-21awk23:30:200
2960899160,15cyclictest14540-21expr22:30:140
2960899160,15cyclictest0-21swapper/022:20:170
2960899160,15cyclictest0-21swapper/020:55:140
2960899160,15cyclictest0-21swapper/020:05:180
2960899160,15cyclictest0-21swapper/020:00:170
2960899160,15cyclictest0-21swapper/019:25:150
2960899160,15cyclictest0-21swapper/000:00:140
2960899160,15cyclictest0-21swapper/000:00:000
2961399150,14cyclictest0-21swapper/122:23:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional