You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 04:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Sun Jun 14, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
276629912491229,16cyclictest2407-21strings19:40:231
276629912491229,16cyclictest2407-21strings19:40:221
276619912431218,7cyclictest0-21swapper/019:25:030
276629911931169,21cyclictest0-21swapper/119:25:071
273812571526,30sleep10-21swapper/119:22:371
272742508460,33sleep00-21swapper/019:21:310
27661999269,18cyclictest0-21swapper/019:40:230
27661999269,18cyclictest0-21swapper/019:40:220
2766299614,49cyclictest19273-21iostat_ios20:25:211
2766299594,48cyclictest13318-21diskstats20:10:141
2766299584,47cyclictest28375-21diskstats20:50:171
2766299563,45cyclictest32450-21iostat_ios21:00:211
2766299563,45cyclictest32450-21iostat_ios21:00:201
2766299551,9cyclictest23718-21seq20:35:401
2766299533,7cyclictest2695-21snmpd00:12:031
2766299532,8cyclictest22328-21irqstats23:25:201
2766299532,15cyclictest3286-21runrttasks00:32:221
2766299531,5cyclictest21947-21sendmail-msp22:00:001
2766299531,47cyclictest0-21swapper/100:00:291
27662995314,33cyclictest2971-21cut22:35:111
2766299531,10cyclictest0-21swapper/122:05:211
2766299522,9cyclictest0-21swapper/122:45:201
2766299522,10cyclictest3286-21runrttasks00:20:521
27662995213,34cyclictest2695-21snmpd20:00:331
27662995213,33cyclictest30553-21iostat_ios20:55:201
27662995211,36cyclictest625-21aten_r4power_po23:55:111
2766299516,11cyclictest5628-21fschecks_time21:15:171
2766299511,8cyclictest21405-21/usr/sbin/munin00:50:111
27662995115,31cyclictest31047-21runrttasks22:22:031
27662995114,32cyclictest0-21swapper/123:31:251
2766299509,3cyclictest0-21swapper/123:52:211
2766299505,8cyclictest3286-21runrttasks21:13:101
2766299505,8cyclictest29941-21memory23:45:221
2766299505,41cyclictest0-21swapper/122:15:231
2766299502,8cyclictest17610-21/usr/sbin/munin00:40:311
2766299502,7cyclictest7862-21hddtemp_smartct19:55:181
2766299502,7cyclictest6330-21ntp_states19:50:261
2766299502,12cyclictest0-21swapper/123:35:381
27662995014,32cyclictest13196-21unixbench_singl00:25:301
27662995013,7cyclictest14398-21cat21:40:001
27662995012,6cyclictest26578-21needreboot22:10:201
27662995011,4cyclictest0-21swapper/121:31:401
2766299499,7cyclictest0-21swapper/122:40:191
2766299499,5cyclictest21040-21hddtemp_smartct20:30:161
2766299499,3cyclictest0-21swapper/121:20:161
2766299497,38cyclictest0-21swapper/100:35:171
2766299494,8cyclictest16078-21/usr/sbin/munin23:10:281
2766299493,8cyclictest4113-21hddtemp_smartct19:45:181
2766299493,40cyclictest0-21swapper/120:05:111
2766299492,8cyclictest3286-21runrttasks23:00:451
2766299492,7cyclictest4439-21/usr/sbin/munin00:05:321
2766299492,13cyclictest3111-21munin-run21:10:001
2766299492,12cyclictest0-21swapper/122:27:081
2766299492,12cyclictest0-21swapper/122:27:081
2766299492,11cyclictest0-21swapper/121:50:131
2766299492,10cyclictest0-21swapper/119:31:361
2766299491,7cyclictest15730-21ntp_states20:15:251
27662994912,4cyclictest0-21swapper/123:20:151
27662994912,32cyclictest0-21swapper/121:27:141
27662994912,32cyclictest0-21swapper/100:19:021
2766299491,16cyclictest3286-21runrttasks00:46:201
2766299491,16cyclictest3286-21runrttasks00:46:201
27662994911,4cyclictest0-21swapper/119:35:201
27662994910,4cyclictest0-21swapper/123:09:081
2766299484,7cyclictest2695-21snmpd20:46:221
2766299484,7cyclictest17628-21ntp_states20:20:251
2766299483,8cyclictest2695-21snmpd22:01:381
2766299483,13cyclictest0-21swapper/123:15:111
2766299483,11cyclictest0-21swapper/120:40:141
2766299482,11cyclictest0-21swapper/121:41:511
2766299482,11cyclictest0-21swapper/121:41:511
2766299481,7cyclictest27851-21cut23:40:151
27662994813,31cyclictest18002-21runrttasks21:48:241
27662994811,32cyclictest0-21swapper/122:56:541
2766299474,7cyclictest9381-21ntp_states22:50:261
2766299471,13cyclictest909-21/usr/sbin/munin22:30:321
178932360,9sleep02766199cyclictest00:40:120
2766199354,7cyclictest81rcu_preempt00:21:500
2766199352,8cyclictest18599-21df21:50:130
7412341,4sleep0759-21latency_hist22:30:000
7412341,4sleep0759-21latency_hist22:30:000
295582331,5sleep00-21swapper/020:52:370
27661993314,5cyclictest3-21ksoftirqd/021:17:580
2766199327,22cyclictest27912-21cron20:50:000
27661993212,7cyclictest5602-21/usr/sbin/munin22:40:240
27661993211,5cyclictest6971-21diskstats22:45:140
139972321,5sleep00-21swapper/023:04:350
326722311,5sleep00-21swapper/023:53:140
180952311,5sleep00-21swapper/021:49:250
46832301,5sleep00-21swapper/021:11:580
2766199302,15cyclictest20928-21/usr/sbin/munin21:55:250
2766199302,14cyclictest13313-21df_inode20:10:140
2766199301,4cyclictest81rcu_preempt21:39:520
2766199301,25cyclictest1743-21grep23:55:290
27661993012,12cyclictest12014-21wget00:25:110
27661993011,6cyclictest29645-21grep23:45:160
27661993011,4cyclictest17688-21ps20:20:270
219372301,5sleep00-21swapper/020:31:380
174162301,5sleep00-21swapper/023:11:050
151382301,5sleep00-21swapper/000:30:440
121002301,5sleep00-21swapper/022:59:330
102252301,5sleep00-21swapper/022:54:380
95832291,5sleep00-21swapper/000:16:460
67932291,5sleep00-21swapper/019:50:410
51642291,5sleep00-21swapper/019:48:140
2766199292,23cyclictest32763-21if_eth019:35:190
2766199292,13cyclictest30212-21iostat22:20:190
27661992917,7cyclictest22661-21ls20:35:130
2766199291,5cyclictest81rcu_preempt21:28:320
2766199291,4cyclictest81rcu_preempt23:05:080
2766199291,4cyclictest81rcu_preempt19:33:110
2766199291,4cyclictest81rcu_preempt00:10:120
2766199291,4cyclictest81rcu_preempt00:03:080
2766199291,14cyclictest8899-21chrt19:58:020
2766199291,13cyclictest3701-21ntpdc22:35:230
27661992910,6cyclictest6146-21cron00:09:590
27661992910,6cyclictest2109-21ntp_states21:05:250
196852290,8sleep02766199cyclictest23:20:000
161912291,5sleep00-21swapper/021:44:060
161912291,5sleep00-21swapper/021:44:050
313382281,5sleep00-21swapper/020:56:360
27661992816,7cyclictest22833-21sort23:25:290
2766199281,14cyclictest11932-21/usr/sbin/munin20:05:240
234092281,5sleep00-21swapper/022:00:590
293412271,5sleep00-21swapper/022:19:020
2766199279,6cyclictest28390-21python23:40:260
2766199272,13cyclictest0-21swapper/020:40:310
27661992718,5cyclictest3-21ksoftirqd/023:35:210
27661992717,6cyclictest21610-21tr00:50:130
2766199271,4cyclictest81rcu_preempt21:03:250
2766199271,4cyclictest81rcu_preempt21:03:240
2766199271,12cyclictest81rcu_preempt20:00:060
2766199271,11cyclictest16599-21grep00:35:270
249132271,5sleep00-21swapper/023:30:520
2766199269,5cyclictest20515-21grep23:20:210
27661992616,6cyclictest8185-21ls21:20:290
2766199261,13cyclictest19117-21cut20:25:170
27661992610,4cyclictest20655-21timerwakeupswit00:45:290
27661992610,4cyclictest20655-21timerwakeupswit00:45:290
274342261,5sleep00-21swapper/022:13:500
2766199257,5cyclictest24976-21python22:05:270
2766199251,15cyclictest0-21swapper/022:30:320
2766199251,15cyclictest0-21swapper/020:15:580
121692251,5sleep00-21swapper/021:31:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional