You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 11:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6.osadl.org (updated Fri May 02, 2025 00:44:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2881429524,23sleep00-21swapper/019:08:160
29169998361,12cyclictest26-21ksoftirqd/122:05:171
2897328126,42sleep10-21swapper/119:09:281
29169997111,26cyclictest18660-21apt-get21:40:151
2916699705,55cyclictest25624-21apt-get22:00:140
2916699699,52cyclictest0-21swapper/021:50:150
29169996631,28cyclictest26-21ksoftirqd/120:44:191
29169996533,17cyclictest0-21swapper/119:35:151
29169996445,11cyclictest26-21ksoftirqd/120:00:161
29169996438,14cyclictest26-21ksoftirqd/121:55:161
29169996436,18cyclictest26-21ksoftirqd/100:10:131
29166996436,15cyclictest14-21ksoftirqd/021:15:370
29166996340,18cyclictest14-21ksoftirqd/021:55:180
29166996338,19cyclictest14-21ksoftirqd/019:20:180
29166996328,23cyclictest14-21ksoftirqd/020:50:380
29169996247,10cyclictest26-21ksoftirqd/123:05:161
29169996134,18cyclictest26-21ksoftirqd/100:35:151
29169996133,19cyclictest208-21jbd2/sda1-823:00:161
2916699617,47cyclictest0-21swapper/022:15:230
29166996137,18cyclictest14-21ksoftirqd/022:25:190
2916999608,8cyclictest151rcu_preempt00:00:001
29166996037,18cyclictest14-21ksoftirqd/019:25:180
29166996036,18cyclictest14-21ksoftirqd/000:10:190
29166996010,43cyclictest0-21swapper/023:35:130
29169995933,17cyclictest0-21swapper/123:40:131
29169995933,17cyclictest0-21swapper/123:40:121
29169995929,24cyclictest420-21dbus-daemon22:05:001
29166995923,24cyclictest14-21ksoftirqd/000:35:200
2916999587,22cyclictest18038-21apt-get23:10:141
2916999583,19cyclictest12069-21unixbench_multi22:50:391
29169995831,15cyclictest0-21swapper/121:50:141
2916699585,17cyclictest0-21swapper/022:35:200
2916699583,20cyclictest21340-21apt-get23:20:010
29169995742,10cyclictest26-21ksoftirqd/122:25:451
29169995738,10cyclictest26-21ksoftirqd/121:10:221
29169995735,13cyclictest26-21ksoftirqd/121:05:161
29169995734,17cyclictest26-21ksoftirqd/123:50:381
29169995734,16cyclictest26-21ksoftirqd/122:35:361
29169995731,15cyclictest0-21swapper/119:45:171
29169995731,15cyclictest0-21swapper/119:45:171
29166995733,18cyclictest14-21ksoftirqd/020:15:210
2916699572,48cyclictest5677-21runrttasks22:35:010
2916999564,47cyclictest8857-21grep19:40:431
29169995642,9cyclictest26-21ksoftirqd/121:20:271
29169995641,9cyclictest26-21ksoftirqd/123:35:321
29169995641,9cyclictest26-21ksoftirqd/122:45:281
29169995641,9cyclictest26-21ksoftirqd/121:30:251
29169995641,9cyclictest26-21ksoftirqd/121:25:251
29169995641,9cyclictest26-21ksoftirqd/120:50:231
29169995641,9cyclictest26-21ksoftirqd/120:35:201
29169995641,9cyclictest26-21ksoftirqd/120:05:331
29169995641,9cyclictest26-21ksoftirqd/119:20:211
29169995641,9cyclictest26-21ksoftirqd/100:30:391
29169995641,8cyclictest26-21ksoftirqd/119:15:281
29169995641,10cyclictest26-21ksoftirqd/119:55:271
29169995640,9cyclictest26-21ksoftirqd/123:30:271
29169995640,9cyclictest26-21ksoftirqd/123:20:341
29169995640,9cyclictest26-21ksoftirqd/122:20:221
29169995640,9cyclictest26-21ksoftirqd/120:10:271
29169995640,9cyclictest26-21ksoftirqd/119:50:211
29169995640,10cyclictest26-21ksoftirqd/122:30:391
29169995639,8cyclictest26-21ksoftirqd/100:25:391
29169995639,10cyclictest26-21ksoftirqd/100:00:211
29169995634,17cyclictest26-21ksoftirqd/123:45:211
29169995634,16cyclictest26-21ksoftirqd/120:20:301
29169995633,17cyclictest26-21ksoftirqd/121:35:291
29169995632,17cyclictest26-21ksoftirqd/120:50:021
2916999563,19cyclictest9294-21aten2.4_r3power21:15:161
2916699569,42cyclictest0-21swapper/000:25:110
29166995636,15cyclictest14-21ksoftirqd/019:30:180
29166995635,16cyclictest14-21ksoftirqd/020:25:180
2916699563,47cyclictest594-21runrttasks23:30:110
29166995634,17cyclictest14-21ksoftirqd/019:10:310
29166995633,17cyclictest14-21ksoftirqd/022:20:180
29169995541,9cyclictest26-21ksoftirqd/123:25:251
29169995541,9cyclictest26-21ksoftirqd/122:40:301
29169995541,9cyclictest26-21ksoftirqd/120:55:261
29169995541,9cyclictest26-21ksoftirqd/120:25:221
29169995540,9cyclictest26-21ksoftirqd/122:55:201
29169995540,9cyclictest26-21ksoftirqd/122:10:191
29169995540,9cyclictest26-21ksoftirqd/100:05:321
29169995540,8cyclictest26-21ksoftirqd/123:15:371
29169995540,8cyclictest26-21ksoftirqd/121:45:211
29169995540,8cyclictest26-21ksoftirqd/120:15:401
29169995540,8cyclictest26-21ksoftirqd/119:35:011
29169995540,8cyclictest26-21ksoftirqd/119:10:241
29169995539,9cyclictest26-21ksoftirqd/121:00:261
29169995539,9cyclictest26-21ksoftirqd/100:20:231
29169995539,10cyclictest26-21ksoftirqd/120:30:351
2916999553,47cyclictest9428-21aten2.4_r3power00:15:181
29169995530,14cyclictest0-21swapper/119:25:131
29166995539,9cyclictest14-21ksoftirqd/019:35:110
29166995538,10cyclictest14-21ksoftirqd/000:00:000
29166995537,11cyclictest14-21ksoftirqd/020:00:010
29166995536,15cyclictest14-21ksoftirqd/021:45:340
29166995535,16cyclictest14-21ksoftirqd/021:35:290
29166995531,19cyclictest420-21dbus-daemon22:10:000
2916699552,39cyclictest23604-21aten2.4-expect23:25:170
29166995520,22cyclictest14-21ksoftirqd/000:30:130
29169995439,9cyclictest26-21ksoftirqd/122:15:311
2916699548,10cyclictest0-21swapper/021:40:350
2916699545,44cyclictest0-21swapper/021:20:320
29166995437,10cyclictest14-21ksoftirqd/019:40:370
29166995433,16cyclictest14-21ksoftirqd/020:20:200
29166995430,18cyclictest14-21ksoftirqd/000:05:270
29166995414,35cyclictest29257-21aten2.4-expect23:40:170
29166995414,35cyclictest29257-21aten2.4-expect23:40:170
2916699535,42cyclictest0-21swapper/022:40:180
29166995337,9cyclictest14-21ksoftirqd/000:23:060
29166995337,10cyclictest14-21ksoftirqd/020:35:010
29166995331,17cyclictest14-21ksoftirqd/021:25:340
29166995328,19cyclictest14-21ksoftirqd/020:55:220
29166995325,24cyclictest0-21swapper/023:03:250
2916699532,44cyclictest20353-21seq20:13:260
29166995316,22cyclictest10874-21cron00:20:000
2916699525,9cyclictest0-21swapper/021:03:050
2916699525,42cyclictest0-21swapper/021:05:280
2916699525,42cyclictest0-21swapper/020:35:150
29166995236,10cyclictest14-21ksoftirqd/023:20:330
29166995235,10cyclictest14-21ksoftirqd/023:10:230
29166995234,14cyclictest14-21ksoftirqd/021:10:220
29166995233,14cyclictest14-21ksoftirqd/023:47:410
29166995220,20cyclictest14-21ksoftirqd/020:45:130
29166995211,25cyclictest151rcu_preempt21:32:380
2916699517,39cyclictest0-21swapper/022:46:460
2916699515,10cyclictest0-21swapper/019:15:390
2916699513,42cyclictest29803-21df20:40:260
29166995134,11cyclictest14-21ksoftirqd/023:50:270
2916699512,43cyclictest13483-21/usr/sbin/munin22:55:300
29166995122,25cyclictest0-21swapper/020:01:050
29166995114,32cyclictest0-21swapper/019:45:410
29166995114,32cyclictest0-21swapper/019:45:410
29166995034,11cyclictest16585-21df23:05:210
29166995012,33cyclictest11144-21cron19:54:550
29166994934,11cyclictest0-21swapper/022:50:180
29166994927,17cyclictest14-21ksoftirqd/020:05:560
29166994814,18cyclictest14-21ksoftirqd/022:10:310
2916699473,10cyclictest4073-21df00:00:200
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional