You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 07:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Wed Nov 26, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17841210382,10sleep30-21swapper/319:06:523
1808529986,9sleep10-21swapper/119:10:001
1776928169,8sleep00-21swapper/019:05:570
1599828069,6sleep20-21swapper/219:05:152
1817199300,1cyclictest10803-21diskmemload22:08:532
1817199261,12cyclictest10803-21diskmemload00:20:582
261442240,0sleep326145-21sleep22:35:013
1817199240,1cyclictest0-21swapper/223:02:282
253742230,0sleep00-21swapper/000:11:140
1817199230,8cyclictest0-21swapper/220:14:182
1816799230,1cyclictest0-21swapper/123:46:131
1816799230,18cyclictest0-21swapper/122:47:461
245262220,0sleep10-21swapper/122:09:101
1817599221,3cyclictest141rcu_preempt21:30:383
1817599200,11cyclictest0-21swapper/321:15:133
1816799200,20cyclictest0-21swapper/123:08:301
1816199202,17cyclictest0-21swapper/022:10:160
1817599190,2cyclictest0-21swapper/323:37:033
1817599190,2cyclictest0-21swapper/323:37:023
18171991911,7cyclictest22998-21sh23:20:372
1816799190,19cyclictest0-21swapper/100:27:351
18161991915,3cyclictest13-21ksoftirqd/021:57:220
18175991817,1cyclictest0-21swapper/319:45:133
1817199183,6cyclictest7744-21snmpd23:44:542
1816799180,1cyclictest0-21swapper/123:18:511
1816799180,0cyclictest0-21swapper/123:28:161
1816199181,13cyclictest0-21swapper/023:05:160
1817599176,8cyclictest846-21python21:50:283
1817599172,2cyclictest0-21swapper/321:49:273
18175991716,1cyclictest0-21swapper/323:08:303
1817599171,14cyclictest0-21swapper/323:28:163
1817199179,2cyclictest14560-21head22:25:212
1817199178,3cyclictest16183-21tr00:05:152
1817199177,5cyclictest24290-21ssh00:10:282
18171991716,1cyclictest37850irq/131-snd_hda22:19:512
1817199171,4cyclictest0-21swapper/222:20:162
18171991713,3cyclictest32-21ksoftirqd/223:30:132
1817199171,1cyclictest0-21swapper/220:40:132
1817199171,1cyclictest0-21swapper/220:40:132
18171991710,2cyclictest5411-21cat20:55:262
1816199175,6cyclictest26503-21perf20:35:010
18161991713,4cyclictest13-21ksoftirqd/022:05:230
1816199170,2cyclictest0-21swapper/023:20:590
1817199160,16cyclictest0-21swapper/222:12:472
18167991616,0cyclictest0-21swapper/121:49:271
18167991611,2cyclictest28647-21apache221:15:261
1816799160,16cyclictest0-21swapper/122:38:151
1816799160,16cyclictest0-21swapper/121:37:021
1816799160,12cyclictest0-21swapper/120:30:211
1816799160,12cyclictest0-21swapper/119:45:131
18175991513,1cyclictest0-21swapper/300:09:443
1817599150,1cyclictest0-21swapper/322:39:043
1817599150,15cyclictest0-21swapper/323:49:113
1817599150,14cyclictest0-21swapper/322:54:353
18171991513,1cyclictest0-21swapper/221:30:472
1817199150,1cyclictest0-21swapper/200:27:092
1816799150,1cyclictest0-21swapper/122:43:101
1816799150,12cyclictest0-21swapper/121:53:261
1816199151,10cyclictest0-21swapper/022:50:110
1816199150,0cyclictest0-21swapper/022:44:480
1817599145,7cyclictest10803-21diskmemload00:35:163
1817599142,4cyclictest0-21swapper/300:25:143
1817599141,12cyclictest14485-21apache_accesses00:30:113
18175991410,3cyclictest14023-21basename23:15:013
18171991410,3cyclictest8398-21tail19:55:162
18171991410,3cyclictest28847-21tr23:25:212
1817199140,1cyclictest0-21swapper/221:36:082
1816799140,13cyclictest0-21swapper/122:22:591
1816799140,13cyclictest0-21swapper/100:10:381
1816199144,9cyclictest26195-21python21:20:270
18161991410,3cyclictest7427-21sleep19:55:000
1816199140,12cyclictest0-21swapper/023:13:450
18175991312,1cyclictest0-21swapper/322:06:393
18175991310,2cyclictest30118-21basename19:34:593
18175991310,2cyclictest20811-21ls20:20:213
18175991310,2cyclictest18938-21grep20:15:273
18175991310,2cyclictest11787-21sed20:00:273
1817599130,12cyclictest0-21swapper/322:47:463
18171991310,2cyclictest7912-21grep21:00:272
18171991310,2cyclictest26445-21grep21:20:282
18171991310,2cyclictest25994-21grep20:30:272
18171991310,2cyclictest21834-21wc22:55:202
1817199130,12cyclictest14792-21tr00:30:152
1816799134,4cyclictest10789-21idleruntime-cro21:10:001
1816199139,3cyclictest22295-21sed23:45:170
1816199131,2cyclictest0-21swapper/023:34:510
18161991310,2cyclictest31326-21awk20:45:010
18161991310,2cyclictest31326-21awk20:45:000
18161991310,2cyclictest30132-21cat19:34:590
18161991310,2cyclictest1677-21awk19:40:200
18161991310,2cyclictest104372sleep000:00:240
1817599129,2cyclictest7948-21grep19:55:143
1817599129,2cyclictest7089-21grep22:20:213
1817599129,2cyclictest31514-21ssh00:15:563
1817599129,2cyclictest27504-21ssh23:00:163
1817599129,2cyclictest23912-21grep19:20:183
1817599129,2cyclictest15239-21tail23:15:183
1817599129,2cyclictest14465-21ntp_states22:25:203
1817599124,3cyclictest14847-21apt-get20:10:173
18175991210,1cyclictest3241-21grep23:55:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional