You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 05:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Sep 07, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
186789911721163,6cyclictest0-21swapper/119:25:091
186779911431118,22cyclictest0-21swapper/019:25:070
186789911421099,26cyclictest4041-21/usr/sbin/munin20:10:201
169122642594,32sleep00-21swapper/019:20:100
177982544465,62sleep10-21swapper/119:20:241
18677999485,6cyclictest0-21swapper/020:10:200
235332890,5sleep1201rcuc/119:35:151
11732470,5sleep124292-21kworker/1:022:55:011
132712461,33sleep113312-21cut20:35:001
18677994024,5cyclictest3-21ksoftirqd/000:01:350
18677993916,8cyclictest3-21ksoftirqd/019:53:210
1867899388,13cyclictest40250irq/92-i91523:10:151
18677993823,5cyclictest3-21ksoftirqd/022:28:190
18677993823,5cyclictest3-21ksoftirqd/022:28:190
18677993823,5cyclictest3-21ksoftirqd/019:31:100
18677993815,7cyclictest3-21ksoftirqd/023:03:250
18677993815,7cyclictest3-21ksoftirqd/022:53:240
1867799379,6cyclictest14129-21cron00:55:000
18677993714,8cyclictest3-21ksoftirqd/000:32:130
18677993614,7cyclictest3-21ksoftirqd/000:47:320
18677993613,8cyclictest3-21ksoftirqd/022:09:160
18677993613,8cyclictest3-21ksoftirqd/021:14:120
18678993520,8cyclictest771-21iostat_ios20:00:221
18677993519,6cyclictest13231-21runrttasks23:25:170
18677993510,8cyclictest18675-21cyclictest22:49:390
179952351,9sleep10-21swapper/123:37:541
1867799341,9cyclictest14866-21latency_hist22:05:000
1867799341,8cyclictest29992-21fschecks_count00:10:160
18677993418,5cyclictest7636-21turbostat20:19:590
18677993412,7cyclictest3-21ksoftirqd/019:36:230
18677993411,8cyclictest3-21ksoftirqd/022:42:010
18677993411,12cyclictest17687-21ntp_states22:10:270
18677993410,8cyclictest10183-21hddtemp_smartct20:25:170
18677993410,6cyclictest0-21swapper/021:01:340
82542331,4sleep08280-21ntp_states21:45:240
227422331,28sleep122795-21df_inode22:25:131
227422331,28sleep122795-21df_inode22:25:131
18678993320,9cyclictest25427-21awk19:40:181
1867799332,20cyclictest0-21swapper/023:47:100
18677993317,5cyclictest20111-21/usr/sbin/munin20:50:270
18677993316,7cyclictest0-21swapper/020:47:250
18677993315,6cyclictest0-21swapper/021:25:240
18677993313,6cyclictest3-21ksoftirqd/020:08:550
18677993312,7cyclictest3-21ksoftirqd/023:13:030
18677993312,7cyclictest3-21ksoftirqd/021:16:160
18677993312,6cyclictest3-21ksoftirqd/022:18:000
18677993312,6cyclictest3-21ksoftirqd/020:59:000
18677993311,7cyclictest3-21ksoftirqd/023:57:480
18677993311,7cyclictest3-21ksoftirqd/019:59:070
18677993311,12cyclictest18675-21cyclictest21:56:220
17712331,28sleep01932-21cat21:30:150
7272320,4sleep041ktimersoftd/020:00:200
229072321,27sleep111038-21snmpd19:33:321
1867799322,13cyclictest81rcu_preempt19:40:130
18677993213,8cyclictest20742sleep000:20:290
18677993213,7cyclictest32620-21grep00:15:290
18677993211,6cyclictest3-21ksoftirqd/021:39:150
18677993211,6cyclictest3-21ksoftirqd/020:23:290
18677993210,6cyclictest3-21ksoftirqd/022:30:370
173862321,27sleep117494-21df20:45:131
105312321,5sleep10-21swapper/100:45:081
323892311,25sleep132556-21df21:25:121
1867799312,14cyclictest28624-21ntp_states00:05:260
18677993115,7cyclictest0-21swapper/021:51:450
18677993113,6cyclictest0-21swapper/021:20:230
18677993111,6cyclictest3-21ksoftirqd/023:37:010
18677993111,6cyclictest3-21ksoftirqd/023:08:130
18677993111,6cyclictest3-21ksoftirqd/021:43:470
18677993110,6cyclictest3-21ksoftirqd/000:26:210
286672303,5sleep10-21swapper/119:49:441
237182301,5sleep00-21swapper/023:53:340
1867899301,4cyclictest81rcu_preempt19:53:201
1867799309,10cyclictest0-21swapper/000:40:420
1867799308,12cyclictest3-21ksoftirqd/023:42:430
1867799303,9cyclictest27273-21python22:35:280
18677993012,9cyclictest2225-21dbus-daemon22:24:110
18677993011,6cyclictest3-21ksoftirqd/000:38:030
18677993010,7cyclictest3-21ksoftirqd/023:15:470
18677993010,6cyclictest3-21ksoftirqd/023:21:410
18677993010,6cyclictest3-21ksoftirqd/019:45:060
55702291,5sleep10-21swapper/121:40:081
48022291,5sleep10-21swapper/123:02:301
320552291,5sleep10-21swapper/121:24:271
30842291,5sleep10-21swapper/121:30:381
270922291,5sleep10-21swapper/122:35:271
1867899294,18cyclictest9983-21diskstats20:25:151
1867899291,4cyclictest81rcu_preempt00:32:131
1867799294,8cyclictest2022-21memory22:55:220
1867799292,23cyclictest15735-21/usr/sbin/munin23:30:290
149432291,5sleep00-21swapper/020:37:530
128532291,5sleep00-21swapper/020:30:370
91552281,5sleep10-21swapper/120:21:111
80722281,5sleep10-21swapper/100:36:131
35192281,5sleep10-21swapper/120:06:201
275142281,5sleep10-21swapper/100:03:491
245112281,5sleep10-21swapper/121:04:191
219382281,5sleep10-21swapper/122:20:501
1867899288,16cyclictest0-21swapper/122:30:301
1867899284,18cyclictest19028-21diskstats22:15:151
1867899284,18cyclictest17151-21diskstats22:10:171
1867899283,19cyclictest31337-21iostat_ios19:55:211
18678992815,7cyclictest13397-21diskstats22:00:131
1867899281,4cyclictest81rcu_preempt22:09:151
18678992811,13cyclictest3685-21/usr/sbin/munin21:35:191
18678992810,14cyclictest21485-21hwlatdetect20:55:181
1867799285,8cyclictest3-21ksoftirqd/021:08:000
159122281,4sleep10-21swapper/123:30:441
127912281,5sleep10-21swapper/121:58:441
7682271,5sleep10-21swapper/100:19:441
316632271,5sleep10-21swapper/122:49:121
280072271,5sleep10-21swapper/121:11:361
260382271,4sleep10-21swapper/121:05:431
197832271,5sleep10-21swapper/123:41:421
1867899273,18cyclictest19390-21diskstats20:50:161
18678992718,5cyclictest13131-21fschecks_count23:25:161
18678992717,6cyclictest22-21ksoftirqd/123:49:581
18678992717,6cyclictest22-21ksoftirqd/123:05:271
1867899271,22cyclictest29430-21seq00:09:131
1867799272,13cyclictest0-21swapper/020:40:050
166712271,5sleep10-21swapper/120:41:071
253412261,5sleep10-21swapper/123:55:581
1867899262,20cyclictest0-21swapper/123:50:181
1867899262,19cyclictest1826-21ntp_states00:20:271
1867899262,18cyclictest9549-21iostat23:15:201
18678992616,6cyclictest2388-21sort22:55:281
1867899261,4cyclictest81rcu_preempt22:42:001
1867899261,4cyclictest81rcu_preempt21:16:161
18678992613,10cyclictest0-21swapper/121:50:191
1867899261,22cyclictest8628-21/usr/sbin/munin00:40:261
147442261,5sleep10-21swapper/120:35:491
1867899255,17cyclictest0-21swapper/100:10:111
1867899252,16cyclictest6514-21irqstats20:15:201
1867899248,12cyclictest3286-21runrttasks21:46:391
18678992415,6cyclictest0-21swapper/100:25:061
18678992415,5cyclictest10913-21wget23:20:111
1867899241,4cyclictest81rcu_preempt00:53:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional