You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 10:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot3.osadl.org (updated Sat Jun 13, 2026 00:45:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
216402204172,21sleep20-21swapper/219:08:152
215842203169,22sleep10-21swapper/119:07:311
216802202167,23sleep00-21swapper/019:08:450
214962202169,22sleep30-21swapper/319:06:243
217752163124,13sleep20-21swapper/219:10:012
990721480,6sleep02206699cyclictest19:50:210
2206999706,3cyclictest0-21swapper/319:30:273
22068996227,6cyclictest33-21ksoftirqd/222:50:002
22068996226,6cyclictest33-21ksoftirqd/220:15:012
236072610,3sleep20-21swapper/221:25:182
150192600,8sleep32206999cyclictest23:25:023
22068995926,9cyclictest33-21ksoftirqd/222:00:172
22068995922,10cyclictest33-21ksoftirqd/221:45:182
2206799598,11cyclictest26678-21latency_hist23:50:001
2206799598,10cyclictest660-21mailstats00:00:281
22068995822,10cyclictest33-21ksoftirqd/220:00:232
2206799589,10cyclictest30349-21/usr/sbin/munin20:35:161
2206799587,10cyclictest24342-21latency_hist23:45:001
2206799587,10cyclictest15421-21df_abs21:10:121
22068995726,4cyclictest33-21ksoftirqd/223:05:152
22068995725,9cyclictest33-21ksoftirqd/220:15:262
22068995721,11cyclictest33-21ksoftirqd/223:55:162
22068995721,11cyclictest33-21ksoftirqd/200:10:282
2206799579,10cyclictest20360-21if_enp4s023:35:171
22068995626,5cyclictest33-21ksoftirqd/221:30:152
22068995626,10cyclictest33-21ksoftirqd/223:30:182
22068995626,10cyclictest33-21ksoftirqd/221:15:122
22068995624,4cyclictest33-21ksoftirqd/221:00:132
22068995622,4cyclictest33-21ksoftirqd/222:30:232
2206799568,12cyclictest17639-21expr23:30:121
2206799566,10cyclictest9908-21irqrtprio22:05:171
139391560,45ptp4l0-21swapper/319:10:013
279112550,1sleep327914-21wc19:20:193
22068995523,6cyclictest33-21ksoftirqd/220:45:122
22068995523,4cyclictest33-21ksoftirqd/220:55:152
2206799558,18cyclictest18517-21date00:40:001
2206799558,17cyclictest13749-21date00:30:011
22068995423,4cyclictest33-21ksoftirqd/222:15:112
22068995422,4cyclictest33-21ksoftirqd/223:50:132
2206799547,16cyclictest18337-21grep20:10:111
2206899533,6cyclictest33-21ksoftirqd/219:20:132
2206899533,6cyclictest33-21ksoftirqd/200:25:202
2206799539,14cyclictest9054-21rt-features20:55:241
2206799536,11cyclictest24838-21df_abs19:15:131
2206899522,6cyclictest33-21ksoftirqd/222:40:002
22068995223,4cyclictest33-21ksoftirqd/223:40:132
2206899513,7cyclictest33-21ksoftirqd/219:55:162
2206799517,17cyclictest26996-21cut21:35:001
2206799516,10cyclictest11179-21latency_hist00:25:001
2206899504,8cyclictest33-21ksoftirqd/220:25:152
2206899504,5cyclictest33-21ksoftirqd/219:45:222
22067995010,8cyclictest31529-21meminfo22:50:201
2206899493,5cyclictest33-21ksoftirqd/222:55:232
2206899492,6cyclictest33-21ksoftirqd/219:50:182
2206899491,8cyclictest33-21ksoftirqd/200:20:112
2206799499,7cyclictest24305-21sshd21:26:351
2206799498,7cyclictest3906-21irqstats20:45:181
2206799497,10cyclictest20969-21cat22:30:001
2206899484,9cyclictest33-21ksoftirqd/220:40:232
2206899483,8cyclictest33-21ksoftirqd/220:30:172
2206899481,7cyclictest33-21ksoftirqd/221:40:182
2206899481,5cyclictest33-21ksoftirqd/221:05:202
22067994814,14cyclictest0-21swapper/121:01:041
22066994842,4cyclictest24226-21cron19:14:590
162652480,2sleep10-21swapper/120:05:151
2206899474,10cyclictest33-21ksoftirqd/200:00:182
2206899472,9cyclictest33-21ksoftirqd/222:05:152
2206899472,6cyclictest33-21ksoftirqd/223:35:242
2206899472,6cyclictest33-21ksoftirqd/222:20:172
2206899472,6cyclictest33-21ksoftirqd/221:35:132
2206899472,5cyclictest33-21ksoftirqd/200:15:142
22068994719,5cyclictest33-21ksoftirqd/220:35:252
22068994719,5cyclictest33-21ksoftirqd/200:35:172
2206899471,6cyclictest33-21ksoftirqd/221:50:272
2206799478,9cyclictest4867-21irqrtprio19:40:161
2206799478,8cyclictest32509-21irqstats19:30:181
2206799478,8cyclictest27294-21diskstats23:50:141
2206799478,8cyclictest15299-21python22:15:221
2206899466,5cyclictest33-21ksoftirqd/223:15:162
2206899465,7cyclictest33-21ksoftirqd/219:30:192
2206899465,7cyclictest33-21ksoftirqd/219:25:132
2206899465,6cyclictest33-21ksoftirqd/223:30:012
2206899464,10cyclictest33-21ksoftirqd/220:20:142
2206899463,9cyclictest33-21ksoftirqd/223:10:222
2206899463,5cyclictest33-21ksoftirqd/223:25:012
2206899463,11cyclictest33-21ksoftirqd/222:10:242
2206899462,9cyclictest33-21ksoftirqd/223:45:152
2206899461,5cyclictest33-21ksoftirqd/221:20:002
2206899455,6cyclictest33-21ksoftirqd/219:15:252
2206899455,5cyclictest33-21ksoftirqd/219:35:192
2206899454,7cyclictest33-21ksoftirqd/200:05:172
2206899454,6cyclictest33-21ksoftirqd/222:50:132
2206899452,5cyclictest33-21ksoftirqd/221:55:162
2206899451,5cyclictest33-21ksoftirqd/219:40:182
2206899450,7cyclictest33-21ksoftirqd/200:30:152
2206799458,7cyclictest12439-21irqstats22:10:181
2206799457,7cyclictest5642-21df20:50:131
2206799457,7cyclictest29727-21hddtemp_smartct19:25:151
2206799455,9cyclictest3188-21ls19:35:251
2206899445,7cyclictest33-21ksoftirqd/220:50:142
2206899445,6cyclictest33-21ksoftirqd/222:45:002
2206899441,3cyclictest121rcu_preempt22:25:262
2206799445,8cyclictest2215-21ls20:40:271
139391440,0ptp4l401ktimersoftd/300:07:523
2206899435,7cyclictest33-21ksoftirqd/220:05:182
2206899431,5cyclictest0-21swapper/221:10:232
22066994339,2cyclictest9-21ksoftirqd/020:40:000
139391430,0ptp4l401ktimersoftd/320:20:213
22069994237,3cyclictest41-21ksoftirqd/319:30:003
2206999423,38cyclictest1283-21kworker/3:121:01:333
2206899426,6cyclictest2898-21/usr/sbin/munin23:00:212
2206799427,7cyclictest8570-21irqstats23:10:171
2206799427,7cyclictest2619-21iostat_ios21:50:191
22066994238,2cyclictest9-21ksoftirqd/023:20:000
139391420,0ptp4l401ktimersoftd/323:04:253
139391420,0ptp4l401ktimersoftd/320:34:213
2206799417,8cyclictest7400-21memory19:45:211
2206699418,4cyclictest9-21ksoftirqd/020:45:000
22066994135,4cyclictest9-21ksoftirqd/000:20:000
139391410,0ptp4l401ktimersoftd/322:52:013
22069994035,3cyclictest5106-21cron20:50:003
22069994032,5cyclictest41-21ksoftirqd/323:40:003
22066994035,3cyclictest9-21ksoftirqd/023:00:010
22066994035,3cyclictest9-21ksoftirqd/019:20:010
2206999390,36cyclictest6456-21cron22:00:013
22066993935,2cyclictest9-21ksoftirqd/020:35:010
22066993934,3cyclictest9-21ksoftirqd/023:45:000
2206999387,3cyclictest193342chrt21:16:383
22067993834,3cyclictest25-21ksoftirqd/100:10:001
2206699384,2cyclictest121rcu_preempt21:55:140
22066993833,3cyclictest9-21ksoftirqd/023:15:000
22069993713,22cyclictest9685-21munin-node21:25:073
2206799375,10cyclictest13839-21egrep00:30:131
2206699374,2cyclictest121rcu_preempt19:55:220
2206699373,3cyclictest9-21ksoftirqd/021:05:280
22066993733,2cyclictest9-21ksoftirqd/021:19:590
22066993733,2cyclictest9-21ksoftirqd/019:45:000
22066993732,3cyclictest9-21ksoftirqd/022:45:000
22066993732,3cyclictest9-21ksoftirqd/021:49:590
22066993732,3cyclictest9-21ksoftirqd/021:35:200
22066993732,2cyclictest9-21ksoftirqd/023:05:260
22066993731,4cyclictest9-21ksoftirqd/000:00:140
22069993630,4cyclictest41-21ksoftirqd/321:36:223
2206799367,14cyclictest23383-21apt-get22:35:091
2206699365,3cyclictest121rcu_preempt22:50:000
2206699365,3cyclictest121rcu_preempt21:20:130
2206699363,2cyclictest121rcu_preempt23:50:210
2206699363,2cyclictest121rcu_preempt22:30:230
2206699363,2cyclictest121rcu_preempt21:00:230
2206699363,2cyclictest121rcu_preempt00:35:210
22066993632,3cyclictest9-21ksoftirqd/020:15:010
22066993632,3cyclictest9-21ksoftirqd/000:15:000
22066993632,2cyclictest9-21ksoftirqd/020:20:000
22066993631,3cyclictest9-21ksoftirqd/020:30:010
22066993631,3cyclictest9-21ksoftirqd/020:25:010
22066993631,2cyclictest9-21ksoftirqd/023:35:000
22066993630,4cyclictest9-21ksoftirqd/022:10:000
22066993629,3cyclictest9-21ksoftirqd/019:35:010
2206699362,3cyclictest121rcu_preempt20:50:110
2206699362,2cyclictest121rcu_preempt23:25:250
22069993529,4cyclictest41-21ksoftirqd/322:31:503
22069993529,4cyclictest41-21ksoftirqd/321:43:083
22069993529,4cyclictest41-21ksoftirqd/320:12:303
22069993529,4cyclictest41-21ksoftirqd/319:48:243
22069993528,4cyclictest41-21ksoftirqd/322:12:093
22069993514,18cyclictest18633-21/usr/sbin/munin22:25:193
22067993529,4cyclictest25-21ksoftirqd/120:34:551
2206699355,3cyclictest9-21ksoftirqd/022:05:000
2206699353,3cyclictest9-21ksoftirqd/019:45:260
22066993532,2cyclictest9-21ksoftirqd/021:15:000
22066993532,2cyclictest9-21ksoftirqd/000:25:180
22066993531,3cyclictest9-21ksoftirqd/021:55:000
22066993531,2cyclictest9-21ksoftirqd/023:00:120
22066993531,2cyclictest9-21ksoftirqd/020:00:180
22066993530,3cyclictest9-21ksoftirqd/023:55:130
22066993530,3cyclictest9-21ksoftirqd/022:35:220
22066993530,3cyclictest9-21ksoftirqd/021:35:000
22066993530,3cyclictest9-21ksoftirqd/020:55:310
22066993530,3cyclictest9-21ksoftirqd/020:45:250
22066993530,3cyclictest9-21ksoftirqd/020:10:000
22066993530,3cyclictest9-21ksoftirqd/019:40:000
22066993530,3cyclictest9-21ksoftirqd/019:25:010
2206699351,3cyclictest9-21ksoftirqd/022:19:590
22069993429,3cyclictest41-21ksoftirqd/321:30:103
22069993429,3cyclictest41-21ksoftirqd/300:31:133
22069993428,4cyclictest41-21ksoftirqd/319:42:023
22069993413,19cyclictest8015-21ptp4l22:00:233
22069993413,18cyclictest32534-21if_enp4s021:45:153
22069993412,3cyclictest7637-21/usr/sbin/munin23:10:233
22069993412,3cyclictest25526-21gpgv20:25:003
22069993412,3cyclictest17498-21find00:35:223
22069993412,20cyclictest25759-21/usr/sbin/munin22:40:153
22069993411,3cyclictest15902-21/usr/sbin/munin20:05:243
22067993429,3cyclictest25-21ksoftirqd/121:46:231
22067993428,4cyclictest25-21ksoftirqd/122:00:011
22067993428,4cyclictest25-21ksoftirqd/119:23:061
22067993410,10cyclictest12900-21cut23:20:151
2206699345,2cyclictest121rcu_preempt23:35:150
2206699345,2cyclictest121rcu_preempt21:40:240
2206699343,2cyclictest121rcu_preempt23:45:170
22066993429,3cyclictest9-21ksoftirqd/021:25:220
22066993429,3cyclictest9-21ksoftirqd/019:25:230
22066993429,3cyclictest9-21ksoftirqd/000:30:250
22066993428,4cyclictest9-21ksoftirqd/023:20:300
2206699342,3cyclictest9-21ksoftirqd/022:15:000
2206699341,2cyclictest121rcu_preempt00:20:170
22069993328,3cyclictest41-21ksoftirqd/323:48:453
22069993327,4cyclictest41-21ksoftirqd/322:58:103
22069993327,4cyclictest41-21ksoftirqd/320:43:523
22069993327,4cyclictest41-21ksoftirqd/300:17:573
2206999332,12cyclictest2460-21sed21:50:173
22067993327,4cyclictest25-21ksoftirqd/120:02:581
22067993327,3cyclictest25-21ksoftirqd/120:00:011
2206699334,2cyclictest121rcu_preempt22:25:150
2206699333,2cyclictest9-21ksoftirqd/022:50:230
22066993329,3cyclictest9-21ksoftirqd/022:20:240
139391330,0ptp4l401ktimersoftd/322:07:083
22069993227,3cyclictest41-21ksoftirqd/323:58:333
22069993227,3cyclictest41-21ksoftirqd/323:51:233
22069993226,4cyclictest41-21ksoftirqd/323:06:293
22069993226,4cyclictest41-21ksoftirqd/322:22:523
22069993212,18cyclictest1317-21runrttasks21:09:253
22069993211,3cyclictest11490-21df_abs19:55:153
22069993211,2cyclictest5340-21/usr/sbin/munin20:50:153
2206999321,10cyclictest9164-21fschecks_count19:50:153
22069993210,4cyclictest41-21ksoftirqd/300:14:283
22067993226,4cyclictest25-21ksoftirqd/122:20:531
22067993226,4cyclictest25-21ksoftirqd/121:20:201
22067993226,4cyclictest25-21ksoftirqd/121:17:361
22067993226,4cyclictest25-21ksoftirqd/119:53:151
22067993225,5cyclictest25-21ksoftirqd/122:32:451
22067993219,12cyclictest0-21swapper/123:03:041
22066993227,3cyclictest9-21ksoftirqd/000:05:220
2206999319,3cyclictest9413-21df_abs00:20:143
22069993126,3cyclictest41-21ksoftirqd/300:27:413
2206999312,5cyclictest2031-21Xorg22:45:583
22069993125,4cyclictest41-21ksoftirqd/323:42:353
2206999311,6cyclictest2518-21gnome-shell22:39:583
2206799319,9cyclictest29805-21cstates21:40:131
2206799318,10cyclictest28450-21df_abs22:45:151
2206799314,11cyclictest0-21swapper/120:20:001
22067993125,4cyclictest25-21ksoftirqd/123:28:291
22067993125,4cyclictest25-21ksoftirqd/120:23:391
22067993125,4cyclictest25-21ksoftirqd/100:10:211
2206999308,3cyclictest1920-21df_abs19:35:133
2206999308,3cyclictest17617-21cstates23:30:123
2206999307,3cyclictest10993-21cut23:15:173
2206999306,3cyclictest648-21mailstats00:00:283
22069993025,3cyclictest41-21ksoftirqd/320:36:493
22069993024,4cyclictest41-21ksoftirqd/323:21:253
22069993024,4cyclictest41-21ksoftirqd/319:16:123
2206999301,8cyclictest1300-21snmpd20:19:283
2206799307,10cyclictest27963-21wc22:45:011
2206799305,11cyclictest0-21swapper/123:05:261
22067993025,3cyclictest25-21ksoftirqd/122:56:021
22067993024,4cyclictest25-21ksoftirqd/121:38:531
22069992924,3cyclictest41-21ksoftirqd/321:21:523
2206799297,7cyclictest25628-21apt-get20:25:101
22067992924,3cyclictest25-21ksoftirqd/123:15:271
2206799290,28cyclictest0-21swapper/122:01:251
2206999287,3cyclictest17442-21cat21:15:013
22069992823,3cyclictest41-21ksoftirqd/320:58:503
22069992823,3cyclictest41-21ksoftirqd/320:00:443
22069992722,3cyclictest41-21ksoftirqd/322:19:193
22067992721,4cyclictest25-21ksoftirqd/100:16:591
22067992620,4cyclictest25-21ksoftirqd/123:58:261
22067992620,4cyclictest25-21ksoftirqd/121:05:431
22067992614,8cyclictest22100-21chrt19:10:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional