You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-23 - 07:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot6.osadl.org (updated Wed Apr 23, 2025 00:45:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
315949910761,27cyclictest0-21swapper/119:55:131
3059321077,30sleep030685-21/usr/sbin/munin19:05:300
315879910273,15cyclictest14-21ksoftirqd/023:20:150
315879910178,14cyclictest14-21ksoftirqd/020:35:140
315879910168,19cyclictest0-21swapper/021:00:120
3130329728,24sleep10-21swapper/119:08:501
277212960,10sleep127719-21awk00:00:011
31587999564,17cyclictest14-21ksoftirqd/000:30:110
31587999270,12cyclictest14-21ksoftirqd/000:00:140
31587999261,17cyclictest14-21ksoftirqd/023:55:130
31587999160,17cyclictest14-21ksoftirqd/023:30:110
31587998963,17cyclictest14-21ksoftirqd/000:20:230
31587998957,17cyclictest14-21ksoftirqd/019:10:180
31587998860,19cyclictest14-21ksoftirqd/021:55:130
31587998860,18cyclictest14-21ksoftirqd/019:55:150
31587998760,17cyclictest14-21ksoftirqd/022:40:170
31587998658,18cyclictest14-21ksoftirqd/020:25:230
31587998560,16cyclictest14-21ksoftirqd/020:40:190
31587998559,15cyclictest14-21ksoftirqd/021:10:140
31587998558,17cyclictest14-21ksoftirqd/020:10:180
31587998558,17cyclictest14-21ksoftirqd/020:00:160
52002810,5sleep10-21swapper/121:00:011
31587998153,19cyclictest14-21ksoftirqd/023:15:150
31587998150,21cyclictest14-21ksoftirqd/022:20:140
31587998150,21cyclictest14-21ksoftirqd/022:20:140
31587998055,13cyclictest0-21swapper/023:50:100
31587998054,16cyclictest14-21ksoftirqd/022:50:160
31587997947,22cyclictest14-21ksoftirqd/022:55:130
31587997813,55cyclictest0-21swapper/019:40:120
31587997812,21cyclictest0-21swapper/021:20:160
31587997445,17cyclictest0-21swapper/019:45:160
31587997414,53cyclictest0-21swapper/022:00:110
160062740,28sleep1251rcuc/121:30:311
31587997344,20cyclictest14-21ksoftirqd/019:30:100
31587997342,18cyclictest0-21swapper/000:35:140
31587997341,18cyclictest14-21ksoftirqd/021:35:120
31587997312,52cyclictest0-21swapper/020:30:150
3158799726,17cyclictest1235-21munin-run00:20:000
31587997244,16cyclictest0-21swapper/021:40:130
31587997243,18cyclictest14-21ksoftirqd/019:15:160
31587997242,20cyclictest14-21ksoftirqd/019:20:150
31587997212,51cyclictest0-21swapper/021:15:150
31587997134,24cyclictest14-21ksoftirqd/020:20:180
31587997043,16cyclictest14150irq/14-ata_piix23:35:140
31594996943,10cyclictest26-21ksoftirqd/120:21:361
31587996921,41cyclictest7786-21/usr/sbin/munin19:35:260
31587996836,22cyclictest19992sleep022:35:170
31587996836,22cyclictest19992sleep022:35:170
31587996740,16cyclictest0-21swapper/022:15:150
31587996712,23cyclictest22085-21runrttasks23:40:190
31587996712,23cyclictest22085-21runrttasks23:40:180
225372670,8chrt0-21swapper/020:15:400
31587996638,17cyclictest14-21ksoftirqd/021:05:120
3159499654,24cyclictest26-21ksoftirqd/121:10:151
31594996527,23cyclictest26-21ksoftirqd/123:45:051
31587996512,40cyclictest0-21swapper/019:50:160
31594996444,8cyclictest26-21ksoftirqd/121:02:321
31594996441,10cyclictest26-21ksoftirqd/122:07:161
31594996439,9cyclictest26-21ksoftirqd/122:30:081
31594996438,9cyclictest26-21ksoftirqd/120:17:041
3158799648,26cyclictest0-21swapper/000:10:150
3158799647,32cyclictest0-21swapper/023:05:010
31587996413,39cyclictest0-21swapper/020:50:160
31587996413,21cyclictest32514-21turbostat.cron22:30:010
31587996412,26cyclictest23783-21runrttasks23:45:080
3159499632,42cyclictest19664-21grep21:40:351
31594996319,12cyclictest26-21ksoftirqd/121:25:051
3158799639,26cyclictest0-21swapper/022:30:360
3158799639,25cyclictest0-21swapper/022:09:520
31587996331,19cyclictest0-21swapper/022:10:110
31587996317,37cyclictest21002-21aten2.4-expect21:50:130
31587996312,38cyclictest0-21swapper/020:05:160
170792630,5chrt0-21swapper/121:35:201
3159499627,41cyclictest0-21swapper/119:15:131
31594996235,10cyclictest26-21ksoftirqd/123:22:511
31594996223,23cyclictest26-21ksoftirqd/100:00:051
319352610,4chrt0-21swapper/122:25:011
319352610,4chrt0-21swapper/122:25:011
3159499616,9cyclictest0-21swapper/120:40:231
31594996124,13cyclictest26-21ksoftirqd/119:45:011
31594996120,13cyclictest26-21ksoftirqd/122:00:001
3158799616,42cyclictest0-21swapper/020:55:150
31587996131,21cyclictest31581-21cyclictest23:10:150
31587996111,25cyclictest32232-21runrttasks20:45:150
126832610,7chrt12685-21needreboot23:10:281
31594996024,29cyclictest0-21swapper/100:06:581
31594996023,13cyclictest26-21ksoftirqd/100:30:011
3158799605,30cyclictest18047-21idleruntime-cro23:30:000
31587996012,20cyclictest15339-21runrttasks21:30:160
31594995939,15cyclictest26-21ksoftirqd/100:40:001
3159499592,50cyclictest21192-21taskset23:36:391
31594995921,25cyclictest26-21ksoftirqd/120:25:441
3158799598,23cyclictest0-21swapper/022:50:020
31587995916,10cyclictest594-21runrttasks00:28:430
31587995911,24cyclictest14376-21runrttasks21:25:080
31594995835,9cyclictest26-21ksoftirqd/100:21:471
31594995824,21cyclictest26-21ksoftirqd/120:46:061
31594995821,18cyclictest26-21ksoftirqd/121:20:201
31594995818,13cyclictest26-21ksoftirqd/122:55:001
31594995817,18cyclictest17872-21apt-get20:05:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional