You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-07 - 09:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6.osadl.org (updated Fri Nov 07, 2025 00:45:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6779210419,39sleep00-21swapper/019:06:590
678428828,48sleep10-21swapper/119:07:011
40612850,5sleep10-21swapper/123:30:021
7254997027,15cyclictest26-21ksoftirqd/122:25:011
160032700,16sleep016005-21missed_timers19:30:290
7254996925,16cyclictest26-21ksoftirqd/122:00:021
7250996913,47cyclictest21043-21apt-get21:15:140
7254996817,39cyclictest26-21ksoftirqd/123:32:211
7254996810,17cyclictest13609-21basename22:25:171
7250996832,23cyclictest22758-21apt-get19:50:150
7250996729,25cyclictest31578-21apt-get21:45:170
7250996725,36cyclictest24630-21fw_packets22:55:230
7250996646,11cyclictest14-21ksoftirqd/022:30:120
76062650,6sleep07605-21sort23:40:010
725499657,24cyclictest26-21ksoftirqd/123:01:501
7254996530,15cyclictest26-21ksoftirqd/100:15:001
7250996537,18cyclictest17509-21apt-get21:05:110
7250996526,26cyclictest26283-21apt-get21:30:140
7250996524,34cyclictest727-21tail23:20:170
7254996426,12cyclictest26-21ksoftirqd/120:10:171
725499637,23cyclictest26-21ksoftirqd/119:35:501
7254996328,15cyclictest26-21ksoftirqd/122:45:001
7254996317,40cyclictest0-21swapper/120:35:231
7250996335,14cyclictest11721-21apt-get22:20:140
7250996321,36cyclictest19197-21tail22:40:260
6962633,19sleep1705-21sh21:50:001
7254996230,11cyclictest26-21ksoftirqd/120:05:191
7254996228,15cyclictest26-21ksoftirqd/121:20:021
7254996227,15cyclictest26-21ksoftirqd/122:20:011
7254996223,16cyclictest26-21ksoftirqd/100:10:011
7250996234,14cyclictest29560-21apt-get23:10:130
7250996232,16cyclictest31299-21apt-get23:15:150
7250996230,21cyclictest27771-21apt-get23:05:140
725499617,22cyclictest26-21ksoftirqd/100:00:041
7254996129,13cyclictest26-21ksoftirqd/121:45:001
725499612,11cyclictest12896-21chrt23:55:161
7254996115,19cyclictest251rcuc/121:50:521
7254996114,42cyclictest0-21swapper/119:15:311
725099616,44cyclictest9407-21apt-get23:45:130
7250996135,13cyclictest8220-21apt-get22:10:140
7250996132,15cyclictest7670-21apt-get23:40:150
7250996129,19cyclictest26254-21apt-get20:00:120
7250996117,38cyclictest0-21swapper/022:06:390
7250996117,38cyclictest0-21swapper/022:06:390
725499606,23cyclictest26-21ksoftirqd/122:00:351
725499606,23cyclictest26-21ksoftirqd/119:55:251
725499605,24cyclictest26-21ksoftirqd/119:40:221
725499605,23cyclictest26-21ksoftirqd/122:30:301
7254996027,14cyclictest26-21ksoftirqd/123:09:001
7254996015,40cyclictest26-21ksoftirqd/100:35:351
7250996036,20cyclictest14-21ksoftirqd/000:00:010
7250996034,13cyclictest4116-21apt-get23:30:140
7250996031,15cyclictest13457-21apt-get22:25:130
7250996030,15cyclictest32129-21apt-get20:15:160
7250996027,22cyclictest448-21dbus-daemon00:40:010
7250996026,21cyclictest22529-21apt-get22:50:140
7250996020,34cyclictest20108-21aten2.4-expect00:15:220
7250996017,17cyclictest21122-21/usr/sbin/munin19:45:160
725499595,23cyclictest26-21ksoftirqd/119:30:201
7254995917,14cyclictest26-21ksoftirqd/121:15:001
7254995915,10cyclictest0-21swapper/123:45:191
7254995914,19cyclictest251rcuc/119:20:361
7254995913,40cyclictest0-21swapper/119:25:341
725099594,21cyclictest8900-21apt-get19:15:170
7250995933,17cyclictest0-21swapper/020:20:150
7250995932,14cyclictest7332-21apt-get19:10:130
7250995931,14cyclictest26027-21apt-get23:00:130
209532596,44sleep10-21swapper/122:45:211
85112580,8sleep00-21swapper/020:40:190
725499585,24cyclictest26-21ksoftirqd/121:25:361
725499585,22cyclictest26-21ksoftirqd/122:50:361
7254995825,14cyclictest26-21ksoftirqd/120:15:051
7254995822,15cyclictest26-21ksoftirqd/119:50:011
7254995813,17cyclictest26-21ksoftirqd/120:00:321
7254995812,41cyclictest0-21swapper/100:25:221
7254995811,40cyclictest0-21swapper/120:55:201
7254995810,14cyclictest26-21ksoftirqd/123:50:221
725099589,43cyclictest25491-21cstates00:30:240
7250995837,16cyclictest22379-21grep22:50:000
7250995833,14cyclictest13395-21apt-get19:25:170
7250995832,12cyclictest11977-21apt-get20:50:160
7250995831,15cyclictest14686-21apt-get00:00:170
7250995830,15cyclictest28023-21apt-get21:35:120
7250995830,15cyclictest0-21swapper/019:35:170
7250995828,24cyclictest0-21swapper/021:20:140
7250995821,32cyclictest1043-21aten2.4-expect21:50:180
7250995819,34cyclictest4544-21aten2.4-expect22:00:190
7250995819,33cyclictest5288-21sshd20:30:240
7250995819,33cyclictest5288-21sshd20:30:240
173752585,45sleep10-21swapper/122:35:281
725499579,15cyclictest26-21ksoftirqd/100:30:261
725499579,14cyclictest26-21ksoftirqd/122:05:461
725499579,14cyclictest26-21ksoftirqd/122:05:451
725499579,14cyclictest26-21ksoftirqd/120:55:011
725499579,14cyclictest26-21ksoftirqd/120:40:231
725499578,15cyclictest26-21ksoftirqd/119:10:261
725499575,23cyclictest26-21ksoftirqd/123:40:341
725499575,23cyclictest26-21ksoftirqd/120:25:331
7254995721,15cyclictest26-21ksoftirqd/120:35:011
7254995721,15cyclictest26-21ksoftirqd/120:35:001
7254995713,39cyclictest0-21swapper/121:30:221
7254995713,39cyclictest0-21swapper/119:50:221
7254995711,14cyclictest26-21ksoftirqd/121:00:231
7254995711,10cyclictest251rcuc/123:20:001
7250995733,20cyclictest504-21snmpd19:41:090
7250995731,14cyclictest28303-21apt-get20:05:200
7250995728,21cyclictest24543-21apt-get21:25:150
7250995727,18cyclictest10234-21apt-get20:45:130
7250995724,24cyclictest0-21swapper/020:35:150
7250995723,20cyclictest16418-21apt-get00:05:130
7250995719,11cyclictest12190-21unixbench_multi23:50:380
7250995710,43cyclictest0-21swapper/021:10:230
725499569,14cyclictest26-21ksoftirqd/123:35:151
725499569,14cyclictest26-21ksoftirqd/123:20:221
725499569,14cyclictest26-21ksoftirqd/121:20:211
725499569,14cyclictest26-21ksoftirqd/100:20:301
725499569,14cyclictest26-21ksoftirqd/100:15:271
725499568,13cyclictest26-21ksoftirqd/123:10:121
725499567,23cyclictest26-21ksoftirqd/121:05:111
7254995618,21cyclictest26-21ksoftirqd/122:12:241
7254995615,19cyclictest26-21ksoftirqd/122:55:341
7254995610,14cyclictest26-21ksoftirqd/120:20:211
7250995631,12cyclictest30087-21apt-get20:10:140
7250995630,15cyclictest14013-21apt-get20:55:250
7250995629,16cyclictest29838-21apt-get21:40:130
725499559,15cyclictest26-21ksoftirqd/120:45:201
725499558,14cyclictest26-21ksoftirqd/121:35:191
7250995532,15cyclictest23912-21irqstats00:25:270
7250995531,14cyclictest24498-21apt-get19:55:150
7250995531,12cyclictest2623-21apt-get21:55:110
7250995531,12cyclictest2375-21apt-get23:25:140
7250995529,13cyclictest9957-21apt-get22:15:130
7250995529,13cyclictest11654-21apt-get19:20:140
7250995517,32cyclictest17007-21tail22:35:200
7250995431,12cyclictest3203-21apt-get20:25:140
7250995429,13cyclictest18205-21apt-get00:10:150
7250995426,22cyclictest448-21dbus-daemon21:04:590
7250995225,22cyclictest0-21swapper/000:20:170
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional