You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-01 - 08:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6.osadl.org (updated Sat Nov 01, 2025 00:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
234819911515,92cyclictest0-21swapper/000:00:140
234819910516,81cyclictest0-21swapper/022:00:100
189992920,6sleep119002-21sort23:30:031
2348399915,27cyclictest29759-21apt-get00:00:151
2327828920,25sleep00-21swapper/019:09:200
2318428931,46sleep10-21swapper/119:08:521
23481998617,62cyclictest0-21swapper/023:15:140
23481998617,62cyclictest0-21swapper/023:15:130
23483998328,20cyclictest254-21systemd-journal22:30:001
23481998255,13cyclictest14-21ksoftirqd/022:05:130
23483997828,18cyclictest448-21dbus-daemon19:19:591
23481997749,15cyclictest14-21ksoftirqd/021:25:100
23481997537,33cyclictest254-21systemd-journal21:45:000
23481997244,19cyclictest14-21ksoftirqd/022:20:140
23481997242,20cyclictest0-21swapper/023:25:150
23481997242,20cyclictest0-21swapper/023:25:140
5992710,6sleep10-21swapper/122:35:361
23483997138,18cyclictest26-21ksoftirqd/122:10:121
23481996939,18cyclictest0-21swapper/023:55:130
2348199685,19cyclictest28540-21apt-get22:25:140
23481996740,17cyclictest14-21ksoftirqd/019:30:130
23481996738,21cyclictest14-21ksoftirqd/019:10:160
23481996638,22cyclictest14-21ksoftirqd/021:10:280
23481996637,9cyclictest14-21ksoftirqd/023:05:330
23481996537,18cyclictest14-21ksoftirqd/022:50:130
23481996530,30cyclictest14-21ksoftirqd/021:05:590
2348399642,11cyclictest3188-21unixbench-2d19:40:351
23481996438,14cyclictest0-21swapper/021:45:150
23481996437,17cyclictest14-21ksoftirqd/021:20:140
23483996318,39cyclictest26-21ksoftirqd/123:45:231
23481996335,16cyclictest0-21swapper/020:00:120
23483996215,41cyclictest0-21swapper/120:20:341
23481996236,18cyclictest14-21ksoftirqd/021:35:130
23481996234,18cyclictest0-21swapper/021:30:240
23481996231,18cyclictest0-21swapper/020:45:200
23483996116,40cyclictest0-21swapper/120:50:211
23481996136,13cyclictest0-21swapper/019:50:150
23481996131,20cyclictest14-21ksoftirqd/019:45:100
23481996130,26cyclictest448-21dbus-daemon23:00:010
23481996038,17cyclictest14-21ksoftirqd/023:50:210
23481996036,19cyclictest14-21ksoftirqd/023:10:140
23481996035,20cyclictest14-21ksoftirqd/000:26:230
23481996034,22cyclictest14-21ksoftirqd/020:07:270
23481996034,17cyclictest0-21swapper/023:00:150
23481996033,18cyclictest14-21ksoftirqd/000:15:130
23483995931,18cyclictest26-21ksoftirqd/122:00:121
23483995920,23cyclictest29557-21tr00:00:001
23481995942,10cyclictest14-21ksoftirqd/020:55:390
23481995937,17cyclictest14-21ksoftirqd/000:20:200
23481995935,18cyclictest14-21ksoftirqd/020:15:120
23481995927,18cyclictest0-21swapper/000:10:080
23481995926,25cyclictest448-21dbus-daemon23:34:590
23481995923,31cyclictest14-21ksoftirqd/020:22:020
2348399584,47cyclictest21506-21apt-get22:05:141
23483995812,41cyclictest0-21swapper/119:50:251
23481995843,8cyclictest14-21ksoftirqd/000:40:000
23481995840,9cyclictest14-21ksoftirqd/019:55:280
23481995840,11cyclictest14-21ksoftirqd/022:45:270
23481995840,11cyclictest14-21ksoftirqd/022:35:000
23481995839,10cyclictest14-21ksoftirqd/023:40:300
23481995832,21cyclictest14-21ksoftirqd/021:00:150
23481995831,20cyclictest254-21systemd-journal00:35:000
23481995829,15cyclictest0-21swapper/019:20:150
23483995711,41cyclictest0-21swapper/120:10:201
2348199579,39cyclictest254-21systemd-journal23:46:140
23481995742,9cyclictest14-21ksoftirqd/023:35:210
23481995741,9cyclictest14-21ksoftirqd/020:50:260
23481995740,9cyclictest14-21ksoftirqd/000:10:000
23481995740,8cyclictest14-21ksoftirqd/020:35:260
23481995740,10cyclictest14-21ksoftirqd/023:25:010
23481995739,9cyclictest14-21ksoftirqd/019:40:270
23481995735,17cyclictest14-21ksoftirqd/022:40:200
23481995735,17cyclictest14-21ksoftirqd/022:40:190
23481995734,18cyclictest14-21ksoftirqd/020:25:340
23481995728,21cyclictest14-21ksoftirqd/021:50:160
23481995727,22cyclictest448-21dbus-daemon22:40:010
134612570,5chrt0-21swapper/123:14:571
23483995631,19cyclictest7340-21ntp_states22:55:291
23483995612,39cyclictest0-21swapper/119:30:431
23483995612,23cyclictest21060-21unixbench_singl20:30:401
23483995612,23cyclictest21060-21unixbench_singl20:30:391
23481995639,9cyclictest14-21ksoftirqd/022:15:010
23481995638,11cyclictest14-21ksoftirqd/022:15:330
23481995637,10cyclictest14-21ksoftirqd/020:30:410
23481995637,10cyclictest14-21ksoftirqd/020:30:400
23481995625,21cyclictest2008-21tr19:40:010
23481995619,32cyclictest23652-21aten2.4-expect20:40:160
23481995613,33cyclictest0-21swapper/019:15:140
163622560,5sleep10-21swapper/123:20:371
2348399558,42cyclictest0-21swapper/121:40:231
23483995540,10cyclictest0-21swapper/123:35:161
23483995540,10cyclictest0-21swapper/123:30:011
23483995540,10cyclictest0-21swapper/123:30:001
2348399553,46cyclictest1792-21diskmemload21:10:231
23483995533,16cyclictest27798-21sort22:20:361
23481995540,9cyclictest14-21ksoftirqd/021:55:190
23481995537,10cyclictest14-21ksoftirqd/020:10:250
23481995519,30cyclictest14-21ksoftirqd/021:15:110
23481995510,38cyclictest504-21snmpd19:25:160
2348399548,40cyclictest0-21swapper/122:50:351
2348399546,43cyclictest0-21swapper/119:10:211
2348399546,42cyclictest0-21swapper/123:40:231
23483995437,11cyclictest0-21swapper/119:20:241
23483995422,27cyclictest23559-21telnet20:40:131
23483995419,24cyclictest26-21ksoftirqd/100:20:171
2348399539,10cyclictest0-21swapper/121:29:001
2348399537,40cyclictest0-21swapper/123:00:361
2348399536,42cyclictest0-21swapper/122:30:191
2348399536,42cyclictest0-21swapper/121:15:331
23483995337,11cyclictest0-21swapper/122:40:281
23483995337,11cyclictest0-21swapper/122:40:271
23483995336,11cyclictest0-21swapper/121:34:291
23483995310,37cyclictest0-21swapper/122:45:251
2348399529,39cyclictest0-21swapper/119:55:101
2348399527,40cyclictest0-21swapper/123:05:581
2348399526,41cyclictest0-21swapper/120:00:211
2348399525,10cyclictest0-21swapper/123:50:371
23483995235,11cyclictest0-21swapper/100:10:161
23483995229,17cyclictest504-21snmpd21:20:161
2348399516,40cyclictest0-21swapper/122:16:281
2348399515,41cyclictest0-21swapper/121:05:211
2348399515,39cyclictest0-21swapper/120:40:021
23483995135,9cyclictest26-21ksoftirqd/120:05:171
23483995113,16cyclictest151rcu_preempt19:25:371
2348399505,40cyclictest0-21swapper/100:35:201
2348399505,39cyclictest0-21swapper/100:30:161
2348399504,11cyclictest14494-21python323:15:341
2348399504,11cyclictest14494-21python323:15:341
2348399503,10cyclictest19610-21sendmail-msp22:00:001
23483995011,20cyclictest26-21ksoftirqd/120:27:011
2348399499,17cyclictest0-21swapper/119:35:131
2348399496,39cyclictest0-21swapper/120:45:051
2348399495,39cyclictest0-21swapper/120:55:231
2348399495,38cyclictest0-21swapper/121:00:261
2348399493,41cyclictest1962-21kernelversion00:15:251
23483994927,17cyclictest254-21systemd-journal00:08:581
23483994925,18cyclictest5679-21seq00:25:271
23483994911,22cyclictest26-21ksoftirqd/120:15:241
23483994910,32cyclictest0-21swapper/119:45:131
2348399485,38cyclictest0-21swapper/121:50:041
2348399475,13cyclictest151rcu_preempt21:46:151
23483994616,17cyclictest26-21ksoftirqd/121:35:171
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional