You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-03 - 11:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6.osadl.org (updated Thu Jul 03, 2025 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
204109911685,20cyclictest26-21ksoftirqd/122:30:151
204109911685,20cyclictest26-21ksoftirqd/122:30:151
204069911313,86cyclictest0-21swapper/019:35:230
204069911312,87cyclictest0-21swapper/020:30:170
204109911235,62cyclictest26-21ksoftirqd/122:00:151
204069910969,29cyclictest14-21ksoftirqd/023:05:130
204069910968,30cyclictest14-21ksoftirqd/023:35:150
204069910710,86cyclictest0-21swapper/021:10:270
204069910710,86cyclictest0-21swapper/021:10:270
204109910468,22cyclictest26-21ksoftirqd/120:35:151
204069910359,31cyclictest14-21ksoftirqd/021:05:170
204069910357,34cyclictest14-21ksoftirqd/021:35:150
204109910265,23cyclictest26-21ksoftirqd/121:35:181
204069910158,30cyclictest14-21ksoftirqd/021:00:140
19970210122,33sleep10-21swapper/119:07:171
204109910062,25cyclictest26-21ksoftirqd/120:20:121
20410999964,23cyclictest26-21ksoftirqd/120:30:201
20410999963,24cyclictest26-21ksoftirqd/120:15:131
20410999912,73cyclictest20397-21cyclictest19:45:141
20406999949,33cyclictest14-21ksoftirqd/021:50:150
20406999949,33cyclictest14-21ksoftirqd/021:50:150
20410999766,19cyclictest26-21ksoftirqd/121:45:151
20410999764,20cyclictest26-21ksoftirqd/122:45:181
20410999758,26cyclictest26-21ksoftirqd/122:50:171
20410999758,26cyclictest26-21ksoftirqd/122:50:171
20406999543,32cyclictest14-21ksoftirqd/023:00:160
20410999449,32cyclictest26-21ksoftirqd/120:40:141
20406999411,29cyclictest0-21swapper/019:15:100
20410999354,28cyclictest26-21ksoftirqd/121:20:131
20410999352,29cyclictest26-21ksoftirqd/100:30:171
20406999336,37cyclictest14-21ksoftirqd/023:30:120
20410999252,28cyclictest26-21ksoftirqd/122:35:191
20410999243,36cyclictest26-21ksoftirqd/119:25:131
2040699929,62cyclictest0-21swapper/019:20:140
2040699928,65cyclictest20490-21taskset19:10:110
20406999245,30cyclictest14-21ksoftirqd/000:35:170
20406999241,34cyclictest14-21ksoftirqd/019:55:200
20406999212,60cyclictest0-21swapper/021:55:120
2041099918,68cyclictest26448-21taskset00:00:161
20410999154,29cyclictest26-21ksoftirqd/100:10:151
20410999154,25cyclictest26-21ksoftirqd/120:50:121
20410999148,31cyclictest26-21ksoftirqd/123:30:151
20406999140,34cyclictest0-21swapper/022:05:170
20406999138,33cyclictest14-21ksoftirqd/023:15:130
20410999051,27cyclictest26-21ksoftirqd/121:30:151
20410998913,63cyclictest0-21swapper/120:25:231
2040699898,58cyclictest5591-21seq20:00:150
2040699898,58cyclictest5591-21seq20:00:150
20410998813,59cyclictest0-21swapper/123:20:151
20406998812,56cyclictest0-21swapper/022:25:160
20406998811,56cyclictest0-21swapper/022:20:170
20406998810,58cyclictest0-21swapper/000:20:260
20410998713,63cyclictest0-21swapper/121:25:141
20410998713,62cyclictest0-21swapper/122:55:151
20410998712,63cyclictest0-21swapper/122:15:141
20410998712,62cyclictest0-21swapper/121:40:261
20410998712,62cyclictest0-21swapper/100:05:131
20410998712,61cyclictest0-21swapper/120:00:151
20410998712,61cyclictest0-21swapper/120:00:151
20410998712,60cyclictest0-21swapper/123:35:171
20410998711,64cyclictest0-21swapper/123:15:141
20410998711,62cyclictest0-21swapper/100:25:131
20406998711,55cyclictest0-21swapper/020:55:160
2041099867,64cyclictest20487-21apt-get19:10:111
20410998614,60cyclictest0-21swapper/123:45:161
20410998612,59cyclictest0-21swapper/123:05:151
20410998611,63cyclictest0-21swapper/123:40:161
20410998611,63cyclictest0-21swapper/122:40:201
20406998640,30cyclictest0-21swapper/021:15:180
20406998611,56cyclictest0-21swapper/020:15:150
20410998525,49cyclictest0-21swapper/100:15:141
20410998517,55cyclictest0-21swapper/119:30:161
20410998513,60cyclictest0-21swapper/120:05:251
20410998512,59cyclictest0-21swapper/123:50:141
20410998512,59cyclictest0-21swapper/122:20:191
20410998511,60cyclictest0-21swapper/122:10:131
20410998510,62cyclictest0-21swapper/123:25:131
20406998539,34cyclictest0-21swapper/021:40:240
2041099842,21cyclictest18183-21apt-get22:05:141
20410998414,54cyclictest0-21swapper/123:55:141
20410998411,57cyclictest0-21swapper/120:45:171
20406998332,33cyclictest0-21swapper/000:00:140
20406998332,31cyclictest0-21swapper/023:25:140
20406998312,50cyclictest0-21swapper/000:05:150
20410998212,56cyclictest0-21swapper/123:10:161
20410998212,56cyclictest0-21swapper/123:10:161
20406998236,28cyclictest0-21swapper/023:10:190
20406998236,28cyclictest0-21swapper/023:10:190
2040699819,52cyclictest0-21swapper/021:45:120
20406998133,31cyclictest0-21swapper/023:40:190
2041099788,56cyclictest31842-21apt-get19:40:151
20406997838,34cyclictest1284-21telnet19:45:180
20406997831,28cyclictest0-21swapper/021:30:160
2003227819,36sleep00-21swapper/019:08:000
2040699778,48cyclictest0-21swapper/020:50:140
20406997727,28cyclictest0-21swapper/000:15:130
2041099768,58cyclictest27237-21apt-get21:00:141
2041099768,57cyclictest25477-21apt-get20:55:141
2041099767,57cyclictest28961-21apt-get21:05:161
20406997633,28cyclictest0-21swapper/019:40:170
20406997625,34cyclictest14-21ksoftirqd/020:10:140
20410997418,47cyclictest0-21swapper/121:55:221
2041099737,57cyclictest9414-21apt-get20:10:131
2041099727,55cyclictest6861-21apt-get00:35:171
2041099717,53cyclictest31058-21apt-get21:10:281
2041099717,53cyclictest31058-21apt-get21:10:281
2041099717,52cyclictest3806-21apt-get19:55:191
20410997122,37cyclictest0-21swapper/122:25:131
20406997124,28cyclictest0-21swapper/019:30:150
20406997123,29cyclictest0-21swapper/023:45:190
2041099707,52cyclictest5066-21apt-get23:00:161
2041099707,52cyclictest331-21apt-get21:15:151
20410996918,44cyclictest420-21dbus-daemon21:55:001
20410996918,44cyclictest420-21dbus-daemon21:55:001
2041099678,49cyclictest30024-21apt-get19:35:241
20410996710,36cyclictest1337-21apt-get00:20:151
20406996647,12cyclictest24645-21apt-get23:55:170
2041099657,47cyclictest24506-21apt-get19:20:141
2041099653,56cyclictest22491-21munin-node19:15:061
2040699659,18cyclictest22910-21apt-get23:50:170
20406996521,19cyclictest261-21systemd-journal00:11:370
2041099643,54cyclictest3463-21latency_hist19:55:021
2040699638,32cyclictest7624-21apt-get20:05:150
20406996342,8cyclictest14-21ksoftirqd/020:40:010
20406996241,14cyclictest19971-21apt-get22:10:160
20406996239,9cyclictest14-21ksoftirqd/019:54:460
2040699623,45cyclictest514-21snmpd22:43:370
20406996218,20cyclictest20414-21aten2.4-expect20:40:180
20406996131,15cyclictest14-21ksoftirqd/019:30:000
2040699599,31cyclictest14952-21apt-get20:25:160
20406995938,9cyclictest514-21snmpd00:31:400
2040699587,16cyclictest14-21ksoftirqd/021:25:160
20406995836,16cyclictest14-21ksoftirqd/020:20:150
2040699583,11cyclictest13954-21munin-run23:25:000
2040699573,7cyclictest151rcu_preempt22:20:000
20406995733,18cyclictest14-21ksoftirqd/022:45:290
20406995728,14cyclictest14-21ksoftirqd/022:40:010
20406995632,10cyclictest14-21ksoftirqd/022:00:350
20406995626,15cyclictest14-21ksoftirqd/022:35:010
20406995626,15cyclictest14-21ksoftirqd/022:35:010
2040699558,40cyclictest0-21swapper/021:21:200
2040699557,19cyclictest0-21swapper/022:53:130
2040699557,19cyclictest0-21swapper/022:53:130
2040699555,11cyclictest0-21swapper/020:45:580
20406995520,14cyclictest14-21ksoftirqd/023:00:010
20406995425,15cyclictest14-21ksoftirqd/000:30:010
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional