You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 11:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot4.osadl.org (updated Wed Nov 12, 2025 00:45:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
427791229162,21phc2sys0-21swapper/319:09:043
171462215167,37sleep20-21swapper/219:09:592
149152203169,22sleep00-21swapper/019:05:060
168122201167,22sleep10-21swapper/119:05:481
2752021030,2sleep30-21swapper/321:40:143
17441997011,23cyclictest9824-21latency_hist21:05:012
17439996814,17cyclictest12643-21cpuspeed_turbos21:10:130
17439996512,17cyclictest2637-21runrttasks00:03:310
1743999649,16cyclictest2460-21latency_hist23:00:000
427291600,1ptp4l401ktimersoftd/321:40:003
17439996011,11cyclictest21466-21timedrift20:20:270
1743999578,14cyclictest24802-21apt-get20:30:130
1743999578,14cyclictest24101-21ls19:20:270
17439995710,44cyclictest20938-21tune2fs23:35:160
1743999547,13cyclictest16349-21ps00:30:210
1744199520,3cyclictest36998rtkit-daemon22:55:212
427291510,1ptp4l401ktimersoftd/320:55:443
17441995030,17cyclictest33-21ksoftirqd/223:39:372
102782500,2sleep20-21swapper/222:10:142
427291470,1ptp4l0-21swapper/300:35:593
17440994712,24cyclictest20225-21df20:20:141
17439994733,11cyclictest9-21ksoftirqd/022:00:010
17441994639,4cyclictest12508-21cron23:20:012
17441994532,11cyclictest33-21ksoftirqd/222:50:012
17441994439,3cyclictest7210-21dump-pmu-power19:55:002
17441994438,3cyclictest30097-21cron23:55:002
1743999448,14cyclictest13017-21hddtemp_smartct20:05:180
427291430,0ptp4l401ktimersoftd/320:03:563
17442994338,3cyclictest41-21ksoftirqd/321:25:003
17442994337,3cyclictest41-21ksoftirqd/323:15:123
1744199433,37cyclictest29511-21latency_hist20:40:002
1744199430,3cyclictest6430-21ptp4l-jitter22:00:242
1744199430,3cyclictest20338-21latency_hist00:40:012
1743999439,11cyclictest27727-21cstates21:40:150
17442994237,3cyclictest41-21ksoftirqd/322:39:593
1744199420,2cyclictest0-21swapper/222:36:482
17439994212,16cyclictest26882-21mailstats23:45:250
17439994210,11cyclictest16943-21sshd21:16:390
427291410,0ptp4l401ktimersoftd/322:55:183
17442994136,3cyclictest41-21ksoftirqd/319:35:003
17442994135,3cyclictest41-21ksoftirqd/320:24:593
17442994135,3cyclictest41-21ksoftirqd/300:00:003
17441994123,15cyclictest33-21ksoftirqd/219:30:112
1743999417,8cyclictest1878-21users19:40:290
17442994036,3cyclictest41-21ksoftirqd/319:39:593
17442994036,2cyclictest41-21ksoftirqd/321:30:233
17442994034,4cyclictest41-21ksoftirqd/322:08:233
17442994034,4cyclictest41-21ksoftirqd/321:12:113
1744299401,3cyclictest121rcu_preempt22:45:293
1744099401,29cyclictest9334-21seq19:55:491
1744099400,30cyclictest14531-21seq20:08:371
17439994033,4cyclictest9-21ksoftirqd/022:01:060
17442993935,3cyclictest41-21ksoftirqd/319:20:193
17442993934,3cyclictest41-21ksoftirqd/323:50:013
17442993934,3cyclictest41-21ksoftirqd/300:09:403
17442993933,4cyclictest41-21ksoftirqd/300:11:273
17442993933,4cyclictest41-21ksoftirqd/300:11:273
17442993932,5cyclictest41-21ksoftirqd/323:36:323
17442993932,5cyclictest41-21ksoftirqd/322:01:093
17442993925,11cyclictest41-21ksoftirqd/300:30:203
1744199393,3cyclictest121rcu_preempt21:40:192
17441993920,16cyclictest33-21ksoftirqd/221:35:592
17440993933,4cyclictest25-21ksoftirqd/123:33:411
17440993933,4cyclictest25-21ksoftirqd/121:47:261
17440993933,4cyclictest25-21ksoftirqd/120:01:361
17440993933,4cyclictest25-21ksoftirqd/119:24:371
17440993933,4cyclictest25-21ksoftirqd/100:37:081
17439993910,16cyclictest32616-21expr21:50:140
17439993910,16cyclictest20086-21apt-config23:35:010
36998380,3rtkit-daemon17401-21apt-get22:25:123
1744299384,3cyclictest41-21ksoftirqd/321:55:003
17442993834,3cyclictest41-21ksoftirqd/319:55:203
17442993834,3cyclictest41-21ksoftirqd/319:10:263
17442993834,2cyclictest41-21ksoftirqd/323:10:003
17442993833,3cyclictest41-21ksoftirqd/322:30:263
17442993833,3cyclictest41-21ksoftirqd/319:50:003
17442993833,3cyclictest41-21ksoftirqd/300:18:383
17442993832,4cyclictest41-21ksoftirqd/322:15:493
17442993832,4cyclictest41-21ksoftirqd/319:16:213
17442993832,4cyclictest41-21ksoftirqd/300:04:573
17442993831,4cyclictest41-21ksoftirqd/321:45:513
1744199382,33cyclictest12893-21sh00:25:002
1744199381,35cyclictest991-21grep00:00:152
1744199381,33cyclictest1264-21snmpd21:55:012
1744199380,4cyclictest19735-21cat19:14:592
17440993833,3cyclictest25-21ksoftirqd/122:05:441
17440993832,4cyclictest25-21ksoftirqd/123:50:551
17440993832,4cyclictest25-21ksoftirqd/120:43:201
17440993832,4cyclictest25-21ksoftirqd/119:54:541
17440993832,4cyclictest25-21ksoftirqd/100:22:151
17440993832,4cyclictest25-21ksoftirqd/100:06:361
1744099380,20cyclictest17984-21fschecks_count19:10:171
1743999387,19cyclictest0-21swapper/022:35:160
17439993832,4cyclictest9-21ksoftirqd/020:59:200
17439993810,16cyclictest23509-21cat23:40:170
427291370,1ptp4l0-21swapper/319:50:533
1744299374,3cyclictest121rcu_preempt23:30:133
17442993733,3cyclictest41-21ksoftirqd/320:05:213
17442993732,3cyclictest41-21ksoftirqd/323:20:163
17442993732,3cyclictest41-21ksoftirqd/322:20:063
17442993732,3cyclictest41-21ksoftirqd/321:30:003
17442993731,4cyclictest41-21ksoftirqd/321:18:243
17442993731,4cyclictest41-21ksoftirqd/319:27:443
17441993731,4cyclictest33-21ksoftirqd/223:42:052
17441993731,4cyclictest33-21ksoftirqd/223:11:152
17441993731,4cyclictest33-21ksoftirqd/221:20:592
17441993731,4cyclictest33-21ksoftirqd/220:12:242
17441993731,4cyclictest33-21ksoftirqd/219:46:242
17441993730,4cyclictest33-21ksoftirqd/220:04:582
1744199372,33cyclictest27165-21awk19:30:012
17441993714,20cyclictest6189-21phc2sys-jitter20:55:242
17441993712,23cyclictest9298-21sed00:15:212
1744199370,34cyclictest12325-21awk21:10:002
1744199370,2cyclictest70332sleep223:06:102
17440993732,3cyclictest25-21ksoftirqd/122:54:231
17440993732,3cyclictest25-21ksoftirqd/122:34:081
17440993731,4cyclictest25-21ksoftirqd/123:47:021
17440993731,4cyclictest25-21ksoftirqd/121:15:421
17440993731,4cyclictest25-21ksoftirqd/120:58:041
17440993731,4cyclictest25-21ksoftirqd/120:54:111
17440993731,4cyclictest25-21ksoftirqd/120:10:061
17440993731,4cyclictest25-21ksoftirqd/119:40:061
17440993731,4cyclictest25-21ksoftirqd/119:29:591
1744099370,35cyclictest19589-21cron20:20:001
1743999378,15cyclictest31989-21ls23:55:250
1743999377,19cyclictest0-21swapper/021:35:160
17439993732,3cyclictest9-21ksoftirqd/023:24:390
17439993731,4cyclictest9-21ksoftirqd/019:36:200
36998360,13rtkit-daemon0-21swapper/300:20:173
17442993631,3cyclictest41-21ksoftirqd/323:15:003
17442993631,3cyclictest41-21ksoftirqd/321:05:003
17442993631,3cyclictest41-21ksoftirqd/320:10:203
17442993630,4cyclictest41-21ksoftirqd/323:41:573
17442993624,10cyclictest41-21ksoftirqd/323:25:203
17441993631,3cyclictest33-21ksoftirqd/223:30:542
17441993630,4cyclictest33-21ksoftirqd/223:57:412
17441993630,4cyclictest33-21ksoftirqd/223:04:092
17441993630,4cyclictest33-21ksoftirqd/222:27:522
17441993630,4cyclictest33-21ksoftirqd/222:07:452
17441993630,4cyclictest33-21ksoftirqd/200:29:272
17441993629,4cyclictest33-21ksoftirqd/221:15:592
17440993631,3cyclictest25-21ksoftirqd/100:13:141
17440993631,3cyclictest25-21ksoftirqd/100:13:131
17440993630,4cyclictest25-21ksoftirqd/123:41:591
17440993630,4cyclictest25-21ksoftirqd/122:36:321
17440993630,4cyclictest25-21ksoftirqd/119:17:191
17440993630,4cyclictest25-21ksoftirqd/100:04:071
17440993629,4cyclictest25-21ksoftirqd/123:15:101
17440993629,4cyclictest25-21ksoftirqd/122:59:161
17440993629,4cyclictest25-21ksoftirqd/121:37:201
17440993629,4cyclictest25-21ksoftirqd/119:45:511
1743999368,18cyclictest0-21swapper/019:54:050
17439993631,3cyclictest9-21ksoftirqd/020:55:000
17439993630,4cyclictest9-21ksoftirqd/020:15:550
17439993629,4cyclictest9-21ksoftirqd/000:05:370
17442993531,3cyclictest41-21ksoftirqd/322:10:383
17442993530,3cyclictest41-21ksoftirqd/322:50:203
17442993530,3cyclictest41-21ksoftirqd/322:41:203
17442993529,4cyclictest41-21ksoftirqd/319:41:003
17441993529,4cyclictest33-21ksoftirqd/222:22:452
17441993529,4cyclictest33-21ksoftirqd/221:56:352
17441993529,4cyclictest33-21ksoftirqd/220:52:522
17441993529,4cyclictest33-21ksoftirqd/220:44:332
17441993529,4cyclictest33-21ksoftirqd/200:32:042
17441993529,3cyclictest33-21ksoftirqd/222:33:472
17441993528,4cyclictest33-21ksoftirqd/222:40:442
17441993511,21cyclictest30442-21sed22:50:142
1744199350,4cyclictest16890-21ls23:25:282
1744199350,3cyclictest22823-21sort20:25:162
1744199350,2cyclictest0-21swapper/221:15:002
17440993530,3cyclictest25-21ksoftirqd/120:25:291
17440993529,4cyclictest25-21ksoftirqd/122:20:001
17440993529,4cyclictest25-21ksoftirqd/121:21:391
17440993529,3cyclictest25-21ksoftirqd/120:34:081
17440993528,4cyclictest25-21ksoftirqd/123:13:001
17440993528,4cyclictest25-21ksoftirqd/123:06:261
1743999357,15cyclictest28552-21ls19:30:210
1743999356,9cyclictest0-21swapper/019:45:280
1743999356,17cyclictest0-21swapper/021:00:140
17439993530,3cyclictest9-21ksoftirqd/022:09:590
17439993529,4cyclictest9-21ksoftirqd/021:28:390
17439993529,4cyclictest9-21ksoftirqd/021:06:100
17439993529,4cyclictest9-21ksoftirqd/020:38:420
17439993529,4cyclictest9-21ksoftirqd/000:26:480
17442993431,2cyclictest41-21ksoftirqd/321:05:313
17442993429,3cyclictest41-21ksoftirqd/323:53:283
17442993429,3cyclictest41-21ksoftirqd/323:00:203
17442993429,3cyclictest41-21ksoftirqd/320:36:233
17442993429,3cyclictest41-21ksoftirqd/320:25:193
17442993428,4cyclictest41-21ksoftirqd/321:56:313
17442993428,4cyclictest41-21ksoftirqd/320:34:323
17442993428,4cyclictest41-21ksoftirqd/320:19:313
17441993428,4cyclictest33-21ksoftirqd/219:21:332
17441993413,19cyclictest32271-21/usr/sbin/munin20:45:182
1744199340,4cyclictest31675-21grep21:45:282
1744199340,3cyclictest9249-21sed19:55:272
1744199340,3cyclictest23446-21irqstats21:30:192
17440993429,3cyclictest25-21ksoftirqd/122:40:091
17440993428,4cyclictest25-21ksoftirqd/123:24:181
17440993428,4cyclictest25-21ksoftirqd/120:38:431
17440993427,4cyclictest25-21ksoftirqd/121:56:291
17440993427,4cyclictest25-21ksoftirqd/121:52:391
17440993413,18cyclictest8411-21sed21:00:221
17439993429,3cyclictest9-21ksoftirqd/023:17:240
17439993429,3cyclictest9-21ksoftirqd/020:25:380
17439993410,8cyclictest6640-21swap23:05:250
17442993328,3cyclictest41-21ksoftirqd/320:41:443
17441993328,3cyclictest33-21ksoftirqd/220:09:032
17441993328,3cyclictest33-21ksoftirqd/219:41:192
1744199331,29cyclictest14679-21latency_hist22:20:002
17441993311,19cyclictest20198-21cat20:20:152
17440993328,3cyclictest25-21ksoftirqd/121:12:081
17440993328,3cyclictest25-21ksoftirqd/121:05:411
17440993327,4cyclictest25-21ksoftirqd/121:31:341
17440993327,3cyclictest25-21ksoftirqd/123:57:081
17440993326,4cyclictest25-21ksoftirqd/123:26:351
17440993326,4cyclictest25-21ksoftirqd/122:47:441
17440993326,4cyclictest25-21ksoftirqd/122:01:151
1743999337,14cyclictest0-21swapper/019:55:210
1743999337,13cyclictest9942-21/usr/sbin/munin22:10:200
17439993328,3cyclictest9-21ksoftirqd/022:52:130
17439993327,4cyclictest9-21ksoftirqd/021:30:320
17439993326,4cyclictest9-21ksoftirqd/000:20:500
17439993310,9cyclictest28609-21iostat_ios23:50:190
17439993310,8cyclictest18906-21mailstats22:25:240
17442993228,2cyclictest41-21ksoftirqd/320:55:003
17442993228,2cyclictest391rcuc/320:50:003
17442993227,3cyclictest41-21ksoftirqd/300:27:433
17441993228,3cyclictest33-21ksoftirqd/220:32:382
17441993227,3cyclictest33-21ksoftirqd/219:38:082
1744199321,28cyclictest19958-21/usr/sbin/munin21:25:192
17441993210,19cyclictest14075-21phc2sys23:20:262
1744199320,3cyclictest227-21systemd-journal00:05:202
17440993226,4cyclictest25-21ksoftirqd/121:42:201
17440993226,4cyclictest25-21ksoftirqd/120:46:531
17440993226,4cyclictest25-21ksoftirqd/119:38:321
1743999325,17cyclictest0-21swapper/022:30:280
17439993227,3cyclictest9-21ksoftirqd/000:36:030
17439993227,3cyclictest9-21ksoftirqd/000:12:250
17439993227,3cyclictest9-21ksoftirqd/000:12:250
17439993226,4cyclictest9-21ksoftirqd/022:41:220
1744199318,21cyclictest20471-21grep19:15:172
17441993125,3cyclictest33-21ksoftirqd/223:47:272
1744199310,2cyclictest0-21swapper/200:10:282
1744199310,2cyclictest0-21swapper/200:10:282
17440993126,3cyclictest25-21ksoftirqd/122:10:371
17440993126,3cyclictest25-21ksoftirqd/119:32:381
17440993125,4cyclictest25-21ksoftirqd/123:03:171
17440993125,4cyclictest25-21ksoftirqd/122:29:071
17440993113,16cyclictest16667-21sed00:30:211
17439993126,3cyclictest9-21ksoftirqd/020:10:380
17439993126,3cyclictest9-21ksoftirqd/019:27:130
17439993125,4cyclictest9-21ksoftirqd/023:02:150
17439993125,3cyclictest9-21ksoftirqd/019:14:370
17440993025,3cyclictest25-21ksoftirqd/123:35:561
17439993025,3cyclictest9-21ksoftirqd/021:46:340
17439993025,3cyclictest9-21ksoftirqd/019:17:000
17439993024,4cyclictest9-21ksoftirqd/023:13:260
17439993024,4cyclictest9-21ksoftirqd/000:17:170
1744199290,2cyclictest17368-21apt-get20:15:122
17440992924,3cyclictest25-21ksoftirqd/100:26:291
17439992924,3cyclictest9-21ksoftirqd/022:18:460
1744099281,24cyclictest9922-21grep00:15:271
17440992810,16cyclictest21441-21grep21:25:271
17439992823,3cyclictest9-21ksoftirqd/022:46:060
17440992722,3cyclictest25-21ksoftirqd/122:21:371
17439992722,3cyclictest9-21ksoftirqd/022:22:590
17439992621,3cyclictest9-21ksoftirqd/023:26:270
17439992621,3cyclictest9-21ksoftirqd/020:49:430
17439992520,3cyclictest9-21ksoftirqd/020:42:520
17439992419,3cyclictest9-21ksoftirqd/021:20:090
17439992415,6cyclictest11360-21tail20:00:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional