You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-14 - 07:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6.osadl.org (updated Fri Nov 14, 2025 00:45:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
215221020,6chrt0-21swapper/122:35:281
24872999975,12cyclictest14-21ksoftirqd/021:45:150
24872999880,9cyclictest14-21ksoftirqd/020:10:170
24872999867,17cyclictest14-21ksoftirqd/020:50:190
24872999464,21cyclictest14-21ksoftirqd/023:30:160
24872999364,18cyclictest14-21ksoftirqd/020:25:130
24876999115,65cyclictest0-21swapper/122:10:151
24872999162,18cyclictest14-21ksoftirqd/019:50:160
24872998962,18cyclictest14-21ksoftirqd/019:55:140
24872998958,19cyclictest14-21ksoftirqd/021:35:230
24872998862,16cyclictest14-21ksoftirqd/021:25:130
24872998762,17cyclictest14-21ksoftirqd/021:30:140
24872998762,17cyclictest14-21ksoftirqd/021:30:140
24872998661,17cyclictest14-21ksoftirqd/019:35:130
24872998656,20cyclictest14-21ksoftirqd/021:05:130
24872998559,17cyclictest14-21ksoftirqd/021:20:130
24872998559,17cyclictest14-21ksoftirqd/021:20:120
24876998353,9cyclictest504-21snmpd20:03:401
24876998350,10cyclictest504-21snmpd21:50:561
24872998360,13cyclictest14-21ksoftirqd/021:00:150
24872998357,18cyclictest14-21ksoftirqd/022:45:160
24872998357,18cyclictest14-21ksoftirqd/020:20:130
24872998255,16cyclictest14-21ksoftirqd/023:55:150
24876998114,52cyclictest0-21swapper/120:10:171
24872998150,21cyclictest14-21ksoftirqd/022:15:250
24872998058,13cyclictest14-21ksoftirqd/021:50:150
24872998048,18cyclictest14-21ksoftirqd/022:35:160
24872997850,16cyclictest14-21ksoftirqd/019:25:110
24872997848,21cyclictest14-21ksoftirqd/020:30:170
24872997847,21cyclictest14-21ksoftirqd/020:15:140
24872997647,20cyclictest14-21ksoftirqd/019:45:150
24872997644,19cyclictest0-21swapper/022:10:130
24876997517,45cyclictest0-21swapper/121:25:121
24872997548,16cyclictest14-21ksoftirqd/020:45:160
2487699749,15cyclictest0-21swapper/122:20:121
24872997440,22cyclictest14-21ksoftirqd/019:30:250
24872997326,15cyclictest14-21ksoftirqd/020:05:010
24872997245,18cyclictest14-21ksoftirqd/020:40:150
24872997243,21cyclictest0-21swapper/021:40:160
2487299723,10cyclictest2378-21munin-run00:10:010
2309827226,35sleep00-21swapper/019:05:030
2487699716,48cyclictest0-21swapper/100:15:111
24876997111,13cyclictest0-21swapper/120:45:191
24872997142,19cyclictest14-21ksoftirqd/019:10:140
24872997112,46cyclictest42912chrt00:15:130
24872997112,44cyclictest0-21swapper/023:45:170
24872997041,16cyclictest0-21swapper/020:35:170
2347327039,20sleep10-21swapper/119:05:191
2487699697,15cyclictest0-21swapper/123:45:141
24872996939,19cyclictest0-21swapper/023:00:140
24872996938,19cyclictest14-21ksoftirqd/022:40:160
24872996935,21cyclictest0-21swapper/023:15:120
24872996934,22cyclictest14-21ksoftirqd/022:00:170
2487699687,48cyclictest0-21swapper/100:35:151
24872996840,18cyclictest0-21swapper/022:50:140
24872996838,19cyclictest0-21swapper/000:00:150
24872996836,18cyclictest0-21swapper/023:25:180
24872996810,48cyclictest32286-21runrttasks22:30:160
24872996737,19cyclictest0-21swapper/023:20:120
24872996722,13cyclictest14-21ksoftirqd/022:09:000
24872996721,13cyclictest14-21ksoftirqd/000:20:040
24876996636,9cyclictest504-21snmpd22:31:071
24872996617,37cyclictest0-21swapper/023:05:140
24876996536,17cyclictest26-21ksoftirqd/122:51:001
24876996517,42cyclictest0-21swapper/120:15:401
2487299656,47cyclictest28985-21taskset19:20:170
24872996536,18cyclictest0-21swapper/023:50:150
24872996536,18cyclictest0-21swapper/019:40:140
24872996535,19cyclictest0-21swapper/021:15:160
24872996532,28cyclictest132232sleep000:40:010
24872996531,20cyclictest0-21swapper/000:25:200
24872996521,14cyclictest14-21ksoftirqd/022:27:410
24876996436,17cyclictest26-21ksoftirqd/100:03:471
24876996433,13cyclictest26-21ksoftirqd/122:20:001
2487699643,11cyclictest14241-21munin-run21:40:001
2487299648,48cyclictest22634-21runrttasks23:35:170
2487299644,52cyclictest10068-21/usr/sbin/munin00:30:220
24872996435,20cyclictest14-21ksoftirqd/022:55:130
24872996433,22cyclictest448-21dbus-daemon21:14:590
24876996333,11cyclictest24395-21cat23:40:011
24876996318,28cyclictest30589-21sort20:55:011
24872996324,27cyclictest14-21ksoftirqd/020:55:130
24872996323,27cyclictest14-21ksoftirqd/022:20:130
24876996237,9cyclictest7484-21telnet19:50:191
24872996221,30cyclictest14-21ksoftirqd/000:10:170
24876996147,8cyclictest26-21ksoftirqd/121:30:271
24876996147,8cyclictest26-21ksoftirqd/121:30:261
24876996137,9cyclictest26-21ksoftirqd/119:45:341
24876996137,10cyclictest26-21ksoftirqd/123:40:381
24872996131,19cyclictest0-21swapper/023:10:160
24876996037,9cyclictest26-21ksoftirqd/119:15:201
24876996036,9cyclictest26-21ksoftirqd/120:08:131
24876996012,42cyclictest0-21swapper/122:40:231
24876995945,8cyclictest26-21ksoftirqd/123:05:211
24876995937,17cyclictest26-21ksoftirqd/122:50:001
24876995936,17cyclictest26-21ksoftirqd/123:25:211
24876995935,9cyclictest26-21ksoftirqd/119:30:471
24876995935,9cyclictest26-21ksoftirqd/100:30:381
24876995935,9cyclictest26-21ksoftirqd/100:10:311
24876995935,18cyclictest26-21ksoftirqd/121:15:161
24876995934,9cyclictest26-21ksoftirqd/119:25:361
24876995934,10cyclictest26-21ksoftirqd/121:00:391
2487699593,11cyclictest21223-21munin-run22:00:011
24876995910,7cyclictest151rcu_preempt19:55:191
2487299598,40cyclictest14-21ksoftirqd/020:05:150
24872995921,23cyclictest14-21ksoftirqd/023:45:000
24876995836,9cyclictest26-21ksoftirqd/100:05:381
24876995836,17cyclictest26-21ksoftirqd/100:25:251
24876995835,9cyclictest26-21ksoftirqd/123:30:291
24876995835,9cyclictest26-21ksoftirqd/121:05:271
24876995835,9cyclictest26-21ksoftirqd/119:39:001
24876995835,8cyclictest26-21ksoftirqd/121:10:301
24876995835,18cyclictest26-21ksoftirqd/122:09:431
24876995835,17cyclictest26-21ksoftirqd/123:15:281
24876995835,17cyclictest26-21ksoftirqd/123:00:011
24876995834,9cyclictest26-21ksoftirqd/119:10:171
24876995834,18cyclictest26-21ksoftirqd/120:55:171
2487699583,12cyclictest448-21dbus-daemon20:35:061
24876995831,20cyclictest26-21ksoftirqd/120:40:351
24876995829,22cyclictest26-21ksoftirqd/123:50:281
2487699582,49cyclictest21356-21/usr/sbin/munin20:30:321
24876995818,13cyclictest26-21ksoftirqd/119:45:011
24876995814,15cyclictest30920-21seq23:56:531
24872995826,14cyclictest14-21ksoftirqd/019:20:010
24876995739,11cyclictest26-21ksoftirqd/123:20:221
24876995735,8cyclictest26-21ksoftirqd/121:45:371
24876995735,17cyclictest26-21ksoftirqd/122:00:201
24876995733,17cyclictest26-21ksoftirqd/122:30:021
24876995641,9cyclictest26-21ksoftirqd/123:00:361
24876995639,10cyclictest26-21ksoftirqd/123:10:211
24876995639,10cyclictest26-21ksoftirqd/120:25:341
24876995632,18cyclictest26-21ksoftirqd/120:20:201
24876995632,17cyclictest26-21ksoftirqd/121:40:391
24876995631,19cyclictest26-21ksoftirqd/119:20:271
24876995531,9cyclictest26-21ksoftirqd/121:20:181
24876995531,9cyclictest26-21ksoftirqd/121:20:171
2487699553,14cyclictest6170-21cat00:20:041
24872995514,24cyclictest0-21swapper/021:55:110
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional