You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 11:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot0.osadl.org (updated Sat Jul 12, 2025 00:46:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1784999250,21cyclictest0-21swapper/219:15:562
1784599243,1cyclictest0-21swapper/121:13:291
1784599242,3cyclictest0-21swapper/120:50:221
1784999230,3cyclictest32615-21if_lxdbr021:30:172
1784999230,22cyclictest13209-21sh20:00:012
1784999230,17cyclictest23646-21sed00:05:212
1784999221,20cyclictest4539-21H212:26:332
1784999221,20cyclictest30980-21taskset21:25:352
1784999221,20cyclictest0-21swapper/222:10:172
1784999220,21cyclictest966-21expr20:35:152
1784999220,21cyclictest7291-21cat19:45:272
1784999220,21cyclictest6840-21mailstats23:35:252
1784999220,21cyclictest6005-21sed22:39:012
1784999220,21cyclictest25434-21date22:15:192
1784999220,21cyclictest18354-21tr19:10:142
1784999220,1cyclictest0-21swapper/222:50:162
1784999220,1cyclictest0-21swapper/200:25:162
1784999220,0cyclictest0-21swapper/220:59:332
1784599222,19cyclictest29581-21taskset00:16:181
1784599222,16cyclictest967-21thermald22:10:221
1784599220,21cyclictest130162chrt19:57:321
1784999214,3cyclictest0-21swapper/200:12:462
1784999212,18cyclictest285592chrt19:28:582
17849992114,6cyclictest29382-21expr23:20:142
17849992114,6cyclictest18907-21sed20:10:002
17849992114,6cyclictest0-21swapper/200:19:102
1784999211,19cyclictest0-21swapper/223:12:482
1784999210,7cyclictest5716-21expr21:40:142
1784999210,6cyclictest878-21cut00:25:012
1784999210,6cyclictest603-21awk19:35:192
1784999210,6cyclictest5739-21chrt00:30:202
1784999210,6cyclictest24450-21latency_hist20:20:012
1784999210,6cyclictest198532sleep220:10:152
1784999210,2cyclictest13809-21expr21:55:172
1784999210,20cyclictest9825-21expr20:50:152
1784999210,20cyclictest30946-21sort19:30:222
1784999210,20cyclictest18230-21sed22:00:252
1784999210,20cyclictest17837-21cat21:05:142
1784999210,20cyclictest17837-21cat21:05:142
1784999210,20cyclictest15755-21sed21:00:192
1784999210,20cyclictest15537-21timerwakeupswit23:50:242
1784999210,20cyclictest12611-21sort21:50:252
1784999210,20cyclictest0-21swapper/221:20:182
1784999210,1cyclictest0-21swapper/222:05:162
1784999210,1cyclictest0-21swapper/220:40:162
1784999210,1cyclictest0-21swapper/220:40:162
1784999210,1cyclictest0-21swapper/220:30:142
1784999210,1cyclictest0-21swapper/219:40:182
17845992115,5cyclictest14103-21chrt22:52:161
17845992114,6cyclictest9145-21chrt00:37:161
17845992114,6cyclictest9145-21chrt00:37:161
17845992114,6cyclictest5590-21sed20:40:241
17845992114,6cyclictest5590-21sed20:40:231
17845992114,6cyclictest4526-21H212:26:331
17845992114,6cyclictest1231-21apache_volume00:25:141
17845992113,7cyclictest5999-21postgres21:40:151
1784599210,2cyclictest667-21expr23:25:171
1784599210,20cyclictest0-21swapper/122:20:141
1784599210,20cyclictest0-21swapper/121:51:131
1784599210,1cyclictest19177-21munin-run20:10:011
1784599210,1cyclictest0-21swapper/122:15:201
1784599210,1cyclictest0-21swapper/119:35:011
1784599210,19cyclictest0-21swapper/123:40:001
1784599210,17cyclictest7220-21cut22:40:171
1784599210,16cyclictest4555-21chrt23:31:331
1784599210,15cyclictest27528-21nfsd423:15:191
1784599210,15cyclictest27528-21nfsd423:15:191
1784599210,15cyclictest15803-21seq20:03:081
1784599210,15cyclictest0-21swapper/123:45:151
17849992014,5cyclictest25211-21plymouth19:20:202
17849992014,5cyclictest21515-21tune2fs21:10:152
17849992014,5cyclictest0-21swapper/223:15:022
17849992014,5cyclictest0-21swapper/223:15:022
17849992014,5cyclictest0-21swapper/220:00:152
1784999200,6cyclictest31863-21grep23:25:122
1784999200,5cyclictest221782chrt23:05:312
1784999200,2cyclictest19553-21taskset23:01:542
1784999200,2cyclictest163302chrt23:55:042
1784999200,1cyclictest48882chrt21:39:052
1784999200,1cyclictest27460-21/usr/sbin/munin20:25:152
1784999200,1cyclictest0-21swapper/223:40:122
1784999200,19cyclictest8928-21timerwakeupswit00:35:232
1784999200,19cyclictest8928-21timerwakeupswit00:35:232
1784999200,19cyclictest0-21swapper/222:35:012
1784999200,19cyclictest0-21swapper/222:20:142
1784999200,16cyclictest0-21swapper/221:15:172
1784999200,15cyclictest20105-21latency00:00:182
1784999200,15cyclictest0-21swapper/222:55:152
1784999200,0cyclictest0-21swapper/221:45:142
1784999200,0cyclictest0-21swapper/220:45:192
17845992014,5cyclictest4877-21cut22:35:191
17845992014,5cyclictest2827-21fschecks_count21:35:171
17845992014,5cyclictest0-21swapper/122:55:171
17845992014,5cyclictest0-21swapper/121:25:241
17845992014,5cyclictest0-21swapper/121:15:231
17845992014,5cyclictest0-21swapper/121:05:201
17845992014,5cyclictest0-21swapper/121:05:201
17845992014,5cyclictest0-21swapper/120:15:171
17845992014,5cyclictest0-21swapper/119:45:261
17845992014,5cyclictest0-21swapper/119:15:241
17845992012,7cyclictest5987-21cat00:30:231
1784599200,2cyclictest2374-21bounce19:40:141
1784599200,1cyclictest24782-21strings19:20:171
1784599200,1cyclictest101992sleep123:41:261
1784599200,1cyclictest0-21swapper/121:00:171
1784599200,1cyclictest0-21swapper/120:45:201
1784599200,1cyclictest0-21swapper/119:29:331
1784599200,1cyclictest0-21swapper/119:10:171
1784599200,19cyclictest20201-21/usr/sbin/munin23:05:191
1784599200,19cyclictest0-21swapper/123:50:201
1784599200,19cyclictest0-21swapper/122:47:551
1784599200,19cyclictest0-21swapper/122:06:441
1784599200,19cyclictest0-21swapper/121:59:561
1784599200,19cyclictest0-21swapper/121:00:001
1784599200,19cyclictest0-21swapper/120:35:161
1784599200,19cyclictest0-21swapper/100:25:011
1784599200,19cyclictest0-21swapper/100:00:201
1784599200,16cyclictest25367-21fschecks_count20:20:181
1784599200,15cyclictest26511-21cpuspeed_turbos21:20:181
1784599200,15cyclictest0-21swapper/123:10:201
1784599200,15cyclictest0-21swapper/120:30:191
17849991914,5cyclictest0-21swapper/222:45:162
17849991914,4cyclictest0-21swapper/222:40:192
17849991914,4cyclictest0-21swapper/222:28:502
1784999190,1cyclictest0-21swapper/220:20:172
1784999190,0cyclictest0-21swapper/219:55:002
17845991914,4cyclictest21957-21apache_processe00:05:111
17845991914,4cyclictest0-21swapper/123:00:131
17845991914,4cyclictest0-21swapper/121:30:141
17845991913,5cyclictest0-21swapper/119:50:191
17845991912,6cyclictest29135-21cpuspeed_turbos23:20:141
1784599190,1cyclictest894-21expr22:30:141
1784599190,18cyclictest0-21swapper/100:10:211
1784599190,14cyclictest0-21swapper/121:45:131
1784599190,14cyclictest0-21swapper/100:00:001
1784599190,0cyclictest0-21swapper/122:00:051
1784099190,17cyclictest18845-21nfsd423:00:170
17845991814,4cyclictest0-21swapper/120:25:151
1784599180,0cyclictest0-21swapper/122:25:131
1784099182,1cyclictest21211-21chrt22:07:460
1784099182,15cyclictest0-21swapper/019:47:180
17840991815,2cyclictest8919-21if_eno121:45:160
17840991815,2cyclictest25881-21perf21:20:010
1784099181,16cyclictest4594-21H212:26:330
1784099180,17cyclictest0-21swapper/021:28:500
1784599170,14cyclictest0-21swapper/119:35:191
17840991715,1cyclictest9-21ksoftirqd/020:38:320
17840991714,2cyclictest995-21irqbalance19:15:120
17840991714,2cyclictest3974-21nfsd419:40:220
17840991714,2cyclictest32759-21latency_hist20:35:010
17840991714,2cyclictest26326-21/usr/sbin/munin19:25:190
17840991714,2cyclictest18276-21timerwakeupswit23:55:220
1784099171,1cyclictest10623-21expr22:45:180
1784099171,1cyclictest0-21swapper/023:25:010
1784099171,15cyclictest4793-21missed_timers22:35:180
1784099171,15cyclictest3441-21gsd-color00:05:000
1784099171,15cyclictest0-21swapper/023:10:250
1784099170,2cyclictest8005-21date21:45:010
1784099170,2cyclictest3623-21bounce00:27:300
1784099170,16cyclictest798-21date00:25:010
1784099170,16cyclictest26055-21nfsd400:10:190
1784099170,16cyclictest22667-21which00:05:140
1784099170,16cyclictest2157-21cat19:40:010
1784099170,16cyclictest19909-21timerandwakeup19:10:210
1784099170,16cyclictest16310-21systemctl22:55:220
1784099170,16cyclictest1603-21lxd19:50:540
1784099170,16cyclictest15946-21munin-run23:55:000
1784099170,16cyclictest14814-21grep21:00:160
1784099170,16cyclictest12054-21apt-get20:55:130
1784099170,15cyclictest0-21swapper/023:38:020
17840991614,1cyclictest269132sleep022:18:510
17840991614,1cyclictest16851-21kworker/0:022:02:150
17840991614,1cyclictest0-21swapper/023:45:150
17840991614,1cyclictest0-21swapper/023:15:160
17840991614,1cyclictest0-21swapper/023:15:160
17840991614,1cyclictest0-21swapper/022:30:170
17840991614,1cyclictest0-21swapper/022:25:210
17840991614,1cyclictest0-21swapper/021:50:170
17840991614,1cyclictest0-21swapper/021:15:010
17840991614,1cyclictest0-21swapper/020:05:160
17840991614,1cyclictest0-21swapper/019:30:210
17840991614,1cyclictest0-21swapper/000:39:000
17840991614,1cyclictest0-21swapper/000:39:000
17840991613,2cyclictest4448-21fschecks_time20:40:170
17840991613,2cyclictest4448-21fschecks_time20:40:170
1784099160,2cyclictest8150-21sendmail_mailst20:45:220
1784099160,2cyclictest24262-21fschecks_time19:20:140
1784099160,2cyclictest22343-21ls22:10:150
1784099160,1cyclictest7729-21cron23:40:000
1784099160,1cyclictest2049-21systemd-journal20:25:120
1784099160,1cyclictest0-21swapper/021:30:220
1784099160,1cyclictest0-21swapper/000:15:180
1784099160,15cyclictest9890-21expr20:50:150
1784099160,15cyclictest2821-21grep21:35:170
1784099160,15cyclictest28179-21sed22:20:160
1784099160,15cyclictest21996-21apache_volume20:15:120
1784099160,15cyclictest20201-21/usr/sbin/munin23:05:140
1784099160,15cyclictest17499-21/usr/sbin/munin21:05:170
1784099160,15cyclictest17499-21/usr/sbin/munin21:05:170
1784099160,15cyclictest0-21swapper/020:10:220
1784099160,15cyclictest0-21swapper/020:00:150
1784099160,15cyclictest0-21swapper/019:55:030
1784099160,15cyclictest0-21swapper/000:30:150
17840991514,0cyclictest0-21swapper/022:40:200
17840991514,0cyclictest0-21swapper/021:55:140
17840991513,1cyclictest27637-21awk21:20:220
1784099150,15cyclictest0-21swapper/023:25:160
1784099150,14cyclictest0-21swapper/022:50:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional