You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 09:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Tue Nov 25, 2025 00:45:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
427791205170,23phc2sys0-21swapper/319:06:503
111022202169,22sleep10-21swapper/119:07:271
111492200167,22sleep20-21swapper/219:08:002
110832200166,22sleep00-21swapper/019:07:180
2587221330,4sleep21159799cyclictest20:40:272
4277918362,11phc2sys0-21swapper/319:10:003
427291690,0ptp4l401ktimersoftd/322:12:443
11597996331,7cyclictest33-21ksoftirqd/222:00:002
11597996331,4cyclictest33-21ksoftirqd/219:55:212
11597996330,4cyclictest33-21ksoftirqd/200:10:132
11597996326,5cyclictest33-21ksoftirqd/223:00:492
11597996326,4cyclictest33-21ksoftirqd/220:55:182
11597996232,6cyclictest33-21ksoftirqd/221:30:142
11597996228,6cyclictest33-21ksoftirqd/219:40:252
11597996131,3cyclictest33-21ksoftirqd/223:40:202
11597996130,7cyclictest33-21ksoftirqd/222:05:012
11597996129,4cyclictest33-21ksoftirqd/223:15:252
11597996129,4cyclictest33-21ksoftirqd/219:35:232
11597996030,4cyclictest33-21ksoftirqd/223:35:252
11597996029,7cyclictest33-21ksoftirqd/220:25:252
11597996028,4cyclictest33-21ksoftirqd/220:30:162
11597996023,4cyclictest33-21ksoftirqd/219:30:232
1159599600,10cyclictest7781-21chrt20:05:180
427591590,6getstats1159899cyclictest00:21:343
11597995931,7cyclictest33-21ksoftirqd/222:25:222
11597995931,6cyclictest33-21ksoftirqd/221:50:142
11597995929,7cyclictest33-21ksoftirqd/222:30:212
11597995929,3cyclictest33-21ksoftirqd/219:20:162
11597995927,4cyclictest33-21ksoftirqd/222:50:242
11597995926,3cyclictest33-21ksoftirqd/220:00:202
11597995924,3cyclictest33-21ksoftirqd/200:10:002
11597995924,3cyclictest33-21ksoftirqd/200:10:002
11597995923,6cyclictest33-21ksoftirqd/223:55:002
11597995923,4cyclictest33-21ksoftirqd/221:17:102
11597995920,4cyclictest33-21ksoftirqd/222:35:262
11597995919,4cyclictest33-21ksoftirqd/220:20:252
1159599590,10cyclictest21330-21latency_hist19:30:000
322752580,2sleep20-21swapper/219:50:202
268902580,1sleep30-21swapper/321:50:123
11597995829,7cyclictest33-21ksoftirqd/221:40:252
11597995829,4cyclictest33-21ksoftirqd/219:25:142
11597995828,7cyclictest33-21ksoftirqd/221:01:592
11597995828,6cyclictest33-21ksoftirqd/221:10:242
11597995825,7cyclictest33-21ksoftirqd/223:10:122
11597995823,7cyclictest33-21ksoftirqd/220:05:142
11597995818,5cyclictest33-21ksoftirqd/220:50:192
11597995817,7cyclictest33-21ksoftirqd/223:30:202
11597995728,7cyclictest33-21ksoftirqd/200:35:132
11597995728,10cyclictest33-21ksoftirqd/222:45:172
11597995726,4cyclictest33-21ksoftirqd/200:25:192
11597995725,7cyclictest33-21ksoftirqd/223:20:282
11597995725,4cyclictest33-21ksoftirqd/200:30:212
11597995722,4cyclictest33-21ksoftirqd/221:24:242
11597995720,4cyclictest33-21ksoftirqd/223:05:232
11597995720,4cyclictest33-21ksoftirqd/223:05:232
11597995720,4cyclictest33-21ksoftirqd/200:20:252
11597995628,7cyclictest33-21ksoftirqd/223:55:202
11597995627,7cyclictest33-21ksoftirqd/220:15:202
11597995626,7cyclictest33-21ksoftirqd/222:40:242
11597995623,6cyclictest33-21ksoftirqd/219:15:142
11597995623,4cyclictest33-21ksoftirqd/220:10:142
11597995621,4cyclictest33-21ksoftirqd/221:35:252
11597995616,6cyclictest33-21ksoftirqd/222:20:162
11597995616,5cyclictest33-21ksoftirqd/222:05:272
1159599560,16cyclictest6008-21sed20:00:270
1159799555,2cyclictest33-21ksoftirqd/222:20:002
11597995533,5cyclictest33-21ksoftirqd/223:50:002
11597995524,6cyclictest33-21ksoftirqd/221:25:432
11597995522,7cyclictest33-21ksoftirqd/200:15:202
11597995515,6cyclictest33-21ksoftirqd/200:00:142
1159599550,9cyclictest30305-21ls20:50:200
1159599550,17cyclictest14519-21sed21:25:140
1159599550,17cyclictest0-21swapper/023:55:140
1159599550,11cyclictest23904-21cat19:35:000
11597995421,7cyclictest33-21ksoftirqd/220:45:152
11597995420,7cyclictest33-21ksoftirqd/221:05:262
1159599540,12cyclictest3986-21awk21:05:000
1159599540,10cyclictest32147-21/usr/sbin/munin00:10:190
1159799539,6cyclictest33-21ksoftirqd/219:45:152
11597995323,7cyclictest33-21ksoftirqd/222:55:142
11597995322,4cyclictest33-21ksoftirqd/220:35:142
1159599530,18cyclictest9355-21cpuspeed22:20:120
1159599530,16cyclictest0-21swapper/019:50:210
1159599530,12cyclictest30351-21cut23:00:200
1159599530,11cyclictest12138-21cat22:25:140
1159599530,10cyclictest26558-21sed20:45:010
1159599530,10cyclictest22782-21ls22:45:200
230242520,2sleep00-21swapper/020:35:230
11597995217,6cyclictest33-21ksoftirqd/221:45:142
1159599520,18cyclictest16577-21latency_hist20:25:000
1159599520,16cyclictest32294-21sed23:05:140
1159599520,16cyclictest32294-21sed23:05:140
11597995117,7cyclictest33-21ksoftirqd/222:10:232
11597995116,4cyclictest33-21ksoftirqd/219:10:152
1159599510,17cyclictest2205-21expr23:10:130
1159599510,16cyclictest0-21swapper/021:15:140
1159599510,10cyclictest11864-21date23:30:000
1159599500,18cyclictest0-21swapper/022:45:000
1159599500,17cyclictest7044-21cstates21:10:160
1159599500,16cyclictest27014-21expr20:45:150
1159599500,15cyclictest29862-21sed19:45:190
11597994913,4cyclictest33-21ksoftirqd/223:25:142
1159599491,10cyclictest898-21gdbus21:35:260
1159599490,9cyclictest27641-21latency21:50:180
1159599490,10cyclictest6709-21latency_hist22:15:010
1159599490,10cyclictest10507-21irqrtprio00:30:200
1159599480,13cyclictest29494-21apt-get00:05:130
1159599480,13cyclictest29494-21apt-get00:05:130
1159599480,11cyclictest19373-21seq20:30:130
1159599472,16cyclictest17106-21df_abs20:25:140
1159599470,16cyclictest21997-21cstates23:50:130
1159599470,12cyclictest2621-21/usr/sbin/munin19:55:190
1159599470,10cyclictest0-21swapper/022:15:140
1159599461,11cyclictest18259-21ls19:20:260
1159599450,8cyclictest20994-21ls23:45:260
1159599450,10cyclictest22156-21hddtemp_smartct21:40:170
11596994438,3cyclictest25-21ksoftirqd/122:35:001
1159599441,9cyclictest12212-21df_inode20:15:170
1159599441,17cyclictest27598-21if_err_enp4s022:55:180
1159599440,7cyclictest12672-21df_inode00:35:130
1159599440,11cyclictest3563-21ls22:05:260
427291430,0ptp4l401ktimersoftd/323:34:143
11596994338,3cyclictest25-21ksoftirqd/122:55:001
11596994337,3cyclictest25-21ksoftirqd/122:00:001
1159599430,8cyclictest462-21ls22:00:200
1159599430,8cyclictest30865-21users21:55:270
1159599430,8cyclictest12489-21fw_packets23:30:170
1159599430,7cyclictest8681-21ls23:20:280
427291420,0ptp4l401ktimersoftd/319:53:163
11598994236,4cyclictest41-21ksoftirqd/323:46:583
11596994237,3cyclictest25-21ksoftirqd/121:20:001
11596994236,3cyclictest25-21ksoftirqd/122:15:001
11596994236,3cyclictest25-21ksoftirqd/121:15:001
11596994236,3cyclictest25-21ksoftirqd/100:35:011
11596994236,2cyclictest25-21ksoftirqd/100:00:001
1159599420,8cyclictest14301-21cpuspeed22:30:120
1159599420,7cyclictest27489-21df_inode00:00:160
1159599420,7cyclictest17073-21df_inode21:30:160
1159599420,6cyclictest17329-21diskstats23:40:150
427291410,0ptp4l401ktimersoftd/321:09:553
11596994135,3cyclictest25-21ksoftirqd/123:20:001
11596994135,3cyclictest25-21ksoftirqd/122:35:131
11596994135,3cyclictest25-21ksoftirqd/120:55:011
11596994134,3cyclictest25-21ksoftirqd/100:05:001
1159699411,38cyclictest21280-21sh19:30:011
1159599411,7cyclictest5794-21irqstats00:20:220
1159599410,8cyclictest15211-21memory19:15:210
1159599410,7cyclictest2755-21diskstats00:15:160
1159599410,7cyclictest24470-21df_inode19:35:170
1159599410,16cyclictest4562-21cpuspeed_turbos23:15:150
11598994035,3cyclictest41-21ksoftirqd/323:19:213
11598994035,3cyclictest41-21ksoftirqd/319:29:223
11598994034,4cyclictest41-21ksoftirqd/322:05:563
11598994033,4cyclictest41-21ksoftirqd/322:25:203
11596994035,3cyclictest25-21ksoftirqd/121:34:591
11596994034,4cyclictest25-21ksoftirqd/120:45:121
11596994034,3cyclictest25-21ksoftirqd/123:10:181
11596994034,3cyclictest25-21ksoftirqd/120:15:201
11596994033,4cyclictest25-21ksoftirqd/121:00:001
1159699401,36cyclictest11648-21cron23:29:591
1159599400,7cyclictest25156-21irqstats22:50:180
1159599400,12cyclictest11836-21cstates19:10:150
11598993934,3cyclictest41-21ksoftirqd/323:38:073
11598993934,3cyclictest41-21ksoftirqd/320:24:003
11598993934,3cyclictest41-21ksoftirqd/319:17:203
11598993933,4cyclictest41-21ksoftirqd/321:03:423
11598993933,4cyclictest41-21ksoftirqd/300:19:443
11598993933,4cyclictest41-21ksoftirqd/300:08:403
11598993933,4cyclictest41-21ksoftirqd/300:08:403
11596993934,3cyclictest25-21ksoftirqd/123:54:591
11596993934,3cyclictest25-21ksoftirqd/123:10:001
11596993934,3cyclictest25-21ksoftirqd/123:10:001
11596993934,3cyclictest25-21ksoftirqd/122:50:001
11596993934,3cyclictest25-21ksoftirqd/122:25:191
11596993934,3cyclictest25-21ksoftirqd/100:40:011
11596993933,4cyclictest25-21ksoftirqd/120:07:241
11596993932,4cyclictest25-21ksoftirqd/119:39:031
11596993932,4cyclictest25-21ksoftirqd/100:23:501
11595993933,3cyclictest9-21ksoftirqd/020:15:010
11595993932,4cyclictest9-21ksoftirqd/023:37:520
1159599390,7cyclictest12674-21irqstats21:20:190
1159599390,13cyclictest1001-21users20:55:280
11598993833,3cyclictest41-21ksoftirqd/323:50:103
11598993833,3cyclictest41-21ksoftirqd/319:36:213
11598993832,4cyclictest41-21ksoftirqd/300:26:223
11598993831,4cyclictest41-21ksoftirqd/321:10:083
11598993819,16cyclictest41-21ksoftirqd/320:17:583
11596993833,3cyclictest25-21ksoftirqd/122:20:001
11596993833,3cyclictest25-21ksoftirqd/121:25:141
11596993832,3cyclictest25-21ksoftirqd/121:45:001
11596993832,3cyclictest25-21ksoftirqd/121:35:141
11596993832,3cyclictest25-21ksoftirqd/119:50:001
11596993831,4cyclictest25-21ksoftirqd/100:25:111
11596993831,4cyclictest25-21ksoftirqd/100:10:001
11596993831,4cyclictest25-21ksoftirqd/100:10:001
1159599380,6cyclictest7990-21iostat_ios00:25:180
36998370,2rtkit-daemon0-21swapper/120:25:201
11598993732,3cyclictest41-21ksoftirqd/320:53:403
11598993731,4cyclictest41-21ksoftirqd/321:57:503
11598993731,4cyclictest41-21ksoftirqd/320:42:043
11598993731,4cyclictest41-21ksoftirqd/320:37:593
11598993731,4cyclictest41-21ksoftirqd/319:48:323
11598993731,4cyclictest41-21ksoftirqd/319:24:143
11598993731,3cyclictest41-21ksoftirqd/323:40:093
11598993730,4cyclictest41-21ksoftirqd/300:32:473
11596993732,3cyclictest25-21ksoftirqd/120:10:191
11596993732,3cyclictest25-21ksoftirqd/100:15:201
11596993731,4cyclictest25-21ksoftirqd/122:24:321
11596993731,4cyclictest25-21ksoftirqd/120:33:561
11596993731,3cyclictest25-21ksoftirqd/119:10:191
11595993730,4cyclictest9-21ksoftirqd/022:38:510
1159599370,8cyclictest24415-21df_abs21:45:150
1159599370,7cyclictest4578-21df21:05:140
427291360,0ptp4l401ktimersoftd/323:00:303
11598993631,3cyclictest41-21ksoftirqd/321:41:573
11598993631,3cyclictest41-21ksoftirqd/321:38:093
11598993630,4cyclictest41-21ksoftirqd/322:55:113
11598993630,4cyclictest41-21ksoftirqd/322:41:353
11598993630,4cyclictest41-21ksoftirqd/322:32:003
11598993630,4cyclictest41-21ksoftirqd/322:21:373
11596993632,3cyclictest25-21ksoftirqd/123:45:211
11596993632,2cyclictest25-21ksoftirqd/120:25:001
11596993631,3cyclictest25-21ksoftirqd/122:40:121
11596993630,4cyclictest25-21ksoftirqd/119:59:261
11596993630,3cyclictest25-21ksoftirqd/121:50:151
11596993630,3cyclictest25-21ksoftirqd/121:00:171
11596993629,4cyclictest25-21ksoftirqd/119:30:581
11598993530,3cyclictest41-21ksoftirqd/323:27:443
11598993530,3cyclictest41-21ksoftirqd/323:24:033
11598993530,3cyclictest41-21ksoftirqd/322:38:013
11598993530,3cyclictest41-21ksoftirqd/319:56:403
11598993530,3cyclictest41-21ksoftirqd/300:03:163
11598993529,4cyclictest41-21ksoftirqd/323:08:193
11598993529,4cyclictest41-21ksoftirqd/323:08:193
11598993529,4cyclictest41-21ksoftirqd/320:04:053
11598993528,4cyclictest41-21ksoftirqd/320:58:293
11596993531,3cyclictest25-21ksoftirqd/119:15:181
11596993530,3cyclictest25-21ksoftirqd/123:39:591
11596993530,3cyclictest25-21ksoftirqd/119:50:151
11596993530,3cyclictest25-21ksoftirqd/119:24:141
11596993529,4cyclictest25-21ksoftirqd/123:05:001
11596993529,4cyclictest25-21ksoftirqd/120:43:381
11596993529,4cyclictest25-21ksoftirqd/120:37:331
11596993529,4cyclictest25-21ksoftirqd/120:00:021
11596993529,3cyclictest25-21ksoftirqd/122:05:131
11596993529,3cyclictest25-21ksoftirqd/122:00:081
11596993529,3cyclictest25-21ksoftirqd/119:44:591
11598993429,3cyclictest41-21ksoftirqd/300:37:413
11598993428,4cyclictest41-21ksoftirqd/321:30:463
11598993428,4cyclictest41-21ksoftirqd/319:32:063
11598993428,3cyclictest41-21ksoftirqd/322:50:583
11598993427,5cyclictest41-21ksoftirqd/322:19:093
1159699344,2cyclictest121rcu_preempt23:20:241
11596993430,3cyclictest25-21ksoftirqd/121:20:201
11596993429,3cyclictest25-21ksoftirqd/121:45:211
11596993427,4cyclictest25-21ksoftirqd/122:56:251
11595993427,4cyclictest9-21ksoftirqd/019:44:210
11598993328,3cyclictest41-21ksoftirqd/320:28:013
1159899330,31cyclictest0-21swapper/300:10:483
11598993227,3cyclictest41-21ksoftirqd/319:41:233
11598993225,5cyclictest41-21ksoftirqd/320:10:033
11596993227,3cyclictest25-21ksoftirqd/123:40:121
11596993227,3cyclictest25-21ksoftirqd/123:30:141
11596993227,3cyclictest25-21ksoftirqd/121:05:181
11596993226,3cyclictest25-21ksoftirqd/100:10:131
11598993126,3cyclictest41-21ksoftirqd/321:25:353
11598993113,3cyclictest31715-21/usr/sbin/munin22:00:143
11598993025,3cyclictest41-21ksoftirqd/320:33:543
11598993024,4cyclictest41-21ksoftirqd/322:45:363
11598992924,3cyclictest41-21ksoftirqd/321:45:333
11598992923,4cyclictest41-21ksoftirqd/321:22:213
11598992923,4cyclictest41-21ksoftirqd/320:09:543
11598992823,3cyclictest41-21ksoftirqd/321:15:203
11598992621,3cyclictest41-21ksoftirqd/323:55:523
11598992621,3cyclictest41-21ksoftirqd/323:13:073
11598992518,4cyclictest41-21ksoftirqd/320:46:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional