You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 05:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot0.osadl.org (updated Mon May 05, 2025 00:46:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30981992718,8cyclictest0-21swapper/223:20:272
30981992620,5cyclictest25507-21mii-tool23:45:182
30981992314,7cyclictest30588-21memory22:00:202
3098199230,2cyclictest25558-21latency_hist22:49:592
30980992314,5cyclictest0-21swapper/123:20:001
3098199222,1cyclictest0-21swapper/200:05:222
3098199220,21cyclictest23553-21munin-run19:55:002
3098199220,1cyclictest0-21swapper/223:45:002
3098199220,16cyclictest24096-21grep19:55:152
3098199220,16cyclictest18454-21latency_hist23:35:012
3098199220,15cyclictest0-21swapper/222:35:012
30979992212,5cyclictest0-21swapper/023:40:010
3098199213,2cyclictest6841-21grep00:10:152
30981992115,5cyclictest29489-21chrt23:52:272
30981992115,5cyclictest29489-21chrt23:52:272
30981992114,6cyclictest5705-21latency_hist22:15:002
30981992114,6cyclictest3132-21sed00:05:012
30981992114,6cyclictest11945-21dpkg20:30:022
3098199211,2cyclictest31079-21grep20:05:242
3098199210,2cyclictest4663-21nfsd420:15:242
3098199210,2cyclictest19208-21fschecks_time19:45:182
3098199210,2cyclictest13712-21grep21:30:182
3098199210,20cyclictest31670-21expr21:05:162
3098199210,20cyclictest0-21swapper/222:15:202
3098199210,1cyclictest262872sleep221:53:572
3098199210,1cyclictest22474-21sed21:45:172
3098199210,1cyclictest0-21swapper/220:55:012
3098199210,1cyclictest0-21swapper/200:25:142
3098199210,15cyclictest16120-21sendmail_mailtr22:30:212
3098199210,15cyclictest16120-21sendmail_mailtr22:30:212
3098199210,15cyclictest0-21swapper/223:15:142
3098199210,15cyclictest0-21swapper/222:50:252
3098199210,15cyclictest0-21swapper/222:25:222
3098199210,15cyclictest0-21swapper/220:25:262
3098199210,15cyclictest0-21swapper/219:20:222
3098099213,13cyclictest9084-21cut00:15:001
30981992016,3cyclictest0-21swapper/219:15:032
30981992015,4cyclictest0-21swapper/220:00:122
30981992014,5cyclictest27760-21sed21:55:202
30981992014,5cyclictest113602sleep222:24:412
30981992013,6cyclictest10038-21munin-plugin-st19:30:012
3098199200,2cyclictest5038-21/usr/sbin/munin23:10:182
3098199200,2cyclictest4534-21H212:26:332
3098199200,1cyclictest0-21swapper/221:35:192
3098199200,1cyclictest0-21swapper/220:55:212
3098199200,1cyclictest0-21swapper/220:45:242
3098199200,1cyclictest0-21swapper/220:45:242
3098199200,1cyclictest0-21swapper/200:40:002
3098199200,1cyclictest0-21swapper/200:25:012
3098199200,19cyclictest0-21swapper/223:57:202
3098199200,19cyclictest0-21swapper/221:00:202
3098199200,19cyclictest0-21swapper/200:18:322
3098199200,15cyclictest8558-21latency21:20:202
3098199200,15cyclictest0-21swapper/221:13:152
3098199200,15cyclictest0-21swapper/220:20:552
3098199200,15cyclictest0-21swapper/219:11:222
3098199200,14cyclictest0-21swapper/222:55:182
3098099200,2cyclictest11197-21latency_hist20:30:011
3097999200,5cyclictest0-21swapper/021:12:180
3097999200,4cyclictest0-21swapper/000:07:580
30981991914,4cyclictest4528-21H212:26:332
30981991914,4cyclictest0-21swapper/223:25:142
30981991914,4cyclictest0-21swapper/221:40:252
30981991914,4cyclictest0-21swapper/221:25:222
30981991914,4cyclictest0-21swapper/219:35:182
30981991913,5cyclictest0-21swapper/221:15:172
30981991912,6cyclictest1433-21munin-run23:05:002
3098199190,1cyclictest0-21swapper/220:45:012
3098199190,1cyclictest0-21swapper/220:37:212
3098199190,18cyclictest1351-21nvmesmart_nvme022:05:202
3098199190,18cyclictest0-21swapper/220:10:172
3098199190,18cyclictest0-21swapper/200:30:242
3098099192,2cyclictest9652-21chrt19:28:201
3098099192,2cyclictest15578-21missed_timers22:30:181
3098099192,2cyclictest15578-21missed_timers22:30:181
30980991917,1cyclictest0-21swapper/121:55:041
3098099190,16cyclictest4538-21H212:26:331
30979991917,1cyclictest0-21swapper/019:20:240
30979991916,2cyclictest25896-21nfsd423:45:200
3097999190,18cyclictest0-21swapper/020:00:010
3097999190,17cyclictest18343-21fschecks_time20:40:180
3097999190,16cyclictest4538-21H212:26:330
3098199180,0cyclictest0-21swapper/219:41:232
30980991816,1cyclictest21-21ksoftirqd/123:02:041
30980991816,1cyclictest0-21swapper/123:53:041
30980991816,1cyclictest0-21swapper/123:53:041
30980991816,1cyclictest0-21swapper/120:03:401
30980991815,2cyclictest12746-21cpuspeed_turbos00:20:141
30980991814,3cyclictest4593-21H212:26:331
30980991814,3cyclictest25330-21ntpq19:55:201
30980991814,3cyclictest0-21swapper/121:44:311
30980991814,2cyclictest4532-21H212:26:331
30980991813,4cyclictest0-21swapper/121:13:321
3098099181,16cyclictest23505-21wc23:40:191
3098099180,3cyclictest21611-21/usr/sbin/munin23:40:011
3098099180,2cyclictest4593-21H212:26:331
3098099180,16cyclictest22702-21proc_pri19:50:211
3097999182,15cyclictest9-21ksoftirqd/023:37:520
3097999182,15cyclictest0-21swapper/022:29:310
30979991816,1cyclictest9-21ksoftirqd/000:29:180
30979991815,2cyclictest6596-21timerandwakeup21:15:250
30979991815,2cyclictest434-21systemd-udevd19:34:080
30979991815,2cyclictest20073-21chrt22:39:440
30979991814,2cyclictest14505-21ps21:30:230
3097999181,16cyclictest0-21swapper/000:10:410
3097999180,17cyclictest29090-21python320:05:020
3098199170,0cyclictest0-21swapper/222:40:062
3098099172,1cyclictest0-21swapper/119:18:221
3098099172,14cyclictest0-21swapper/100:16:221
30980991715,1cyclictest0-21swapper/120:30:181
30980991714,2cyclictest6011-21sort23:10:181
30980991714,2cyclictest4526-21H212:26:331
30980991714,2cyclictest3694-21qmgr22:05:211
30980991714,2cyclictest31568-21chrt22:01:251
30980991714,2cyclictest21551-21cpuspeed_turbos21:45:141
30980991714,2cyclictest14305-21grep21:30:211
30980991714,2cyclictest0-21swapper/119:35:231
30980991714,1cyclictest0-21swapper/121:20:201
3098099171,15cyclictest23036-21taskset20:50:051
3098099170,2cyclictest970-21dbus-daemon00:30:231
3098099170,2cyclictest4528-21H212:26:331
3098099170,2cyclictest4528-21H212:26:331
3098099170,2cyclictest20772-21cpuspeed_turbos22:40:151
3098099170,2cyclictest17290-21pzem_power21:35:211
3098099170,2cyclictest1354-21lxd19:20:531
3098099170,2cyclictest11671-21ps19:30:221
3098099170,1cyclictest0-21swapper/120:15:211
3098099170,16cyclictest5345-21expr21:15:171
3098099170,16cyclictest4538-21H212:26:331
3098099170,16cyclictest4528-21H212:26:331
3098099170,16cyclictest30962-21chrt22:59:481
3098099170,16cyclictest30870-21/usr/sbin/munin20:05:231
3098099170,16cyclictest3079-21gmain20:24:251
3098099170,16cyclictest2735-21munin-run20:15:011
3098099170,16cyclictest2605-21http_loadtime23:05:161
3098099170,16cyclictest0-21swapper/123:55:211
3098099170,16cyclictest0-21swapper/123:50:001
3098099170,16cyclictest0-21swapper/123:20:231
3098099170,16cyclictest0-21swapper/122:10:211
30979991715,1cyclictest14865-21expr20:35:150
30979991715,1cyclictest0-21swapper/021:40:250
30979991714,2cyclictest8509-21perf20:25:000
30979991714,2cyclictest4534-21H212:26:330
30979991714,2cyclictest3441-21gsd-color21:50:150
30979991714,2cyclictest28714-21wc22:55:180
30979991714,2cyclictest2787-21postgres00:03:190
30979991714,2cyclictest1147-21snapd22:13:430
30979991714,2cyclictest1132-21snapd22:43:430
30979991714,2cyclictest0-21swapper/021:55:220
30979991714,2cyclictest0-21swapper/020:25:240
3097999171,1cyclictest0-21swapper/020:50:300
3097999171,15cyclictest4530-21H212:26:330
3097999170,2cyclictest899-21timerwakeupswit23:00:220
3097999170,2cyclictest8730-21apt-key22:20:010
3097999170,2cyclictest4530-21H212:26:330
3097999170,2cyclictest4530-21H212:26:330
3097999170,2cyclictest31193-21cut21:05:010
3097999170,2cyclictest30693-21needreboot22:00:200
3097999170,2cyclictest17353-21nvmesmart_nvme023:30:200
3097999170,2cyclictest14986-21expr22:30:140
3097999170,2cyclictest14986-21expr22:30:140
3097999170,16cyclictest893-21systemd-logind20:57:070
3097999170,16cyclictest4534-21H212:26:330
3097999170,16cyclictest4534-21H212:26:330
3097999170,16cyclictest4526-21H212:26:330
3097999170,16cyclictest32239-21chrt23:57:120
3097999170,16cyclictest24172-21/usr/sbin/munin22:45:210
3097999170,16cyclictest22605-21ntpq19:50:190
3097999170,16cyclictest1238-21snapd21:48:120
30980991614,1cyclictest31301-21apt-get19:10:151
30980991614,1cyclictest0-21swapper/121:50:181
30980991614,1cyclictest0-21swapper/121:25:161
30980991614,1cyclictest0-21swapper/121:05:151
30980991614,1cyclictest0-21swapper/120:45:181
30980991614,1cyclictest0-21swapper/120:45:181
30980991614,1cyclictest0-21swapper/119:40:031
30980991613,2cyclictest15541-21expr00:25:141
3098099160,1cyclictest0-21swapper/121:00:231
3098099160,1cyclictest0-21swapper/120:35:221
3098099160,15cyclictest132212chrt22:25:201
3098099160,15cyclictest1018-21expr00:00:151
3098099160,15cyclictest0-21swapper/122:20:021
3098099160,15cyclictest0-21swapper/120:55:211
3098099160,15cyclictest0-21swapper/119:45:171
30979991614,1cyclictest0-21swapper/022:50:200
30979991614,1cyclictest0-21swapper/019:35:160
30979991614,1cyclictest0-21swapper/019:15:150
30979991614,1cyclictest0-21swapper/019:10:160
30979991613,2cyclictest640-21cat20:10:180
30979991613,2cyclictest16361-21expr19:40:140
3097999160,2cyclictest7588-21chrt21:20:070
3097999160,1cyclictest0-21swapper/019:25:180
3097999160,15cyclictest4825-21ntpq20:15:240
3097999160,15cyclictest32359-21wc22:05:150
3097999160,15cyclictest31876-21/usr/sbin/munin21:05:170
3097999160,15cyclictest15763-21apt-get21:35:130
3097999160,15cyclictest12324-21expr20:30:180
3097999160,15cyclictest11727-21ntp_states21:25:210
3097999160,15cyclictest0-21swapper/023:25:200
3097999160,15cyclictest0-21swapper/023:10:130
3097999160,15cyclictest0-21swapper/022:15:170
3097999160,15cyclictest0-21swapper/020:45:160
3097999160,15cyclictest0-21swapper/020:45:160
3097999160,15cyclictest0-21swapper/020:05:270
3097999160,15cyclictest0-21swapper/000:30:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional