You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 03:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Mon Jun 29, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
231989911891154,32cyclictest15609-21kworker/0:219:26:010
231999911251089,32cyclictest12335-21/usr/sbin/munin20:20:301
231382808763,29sleep10-21swapper/119:24:571
214262511466,31sleep00-21swapper/019:20:040
2319899146133,10cyclictest0-21swapper/020:20:300
2319999122112,7cyclictest0-21swapper/119:26:021
159802960,4sleep041ktimersoftd/000:45:260
23199996910,38cyclictest24063-21fschecks_time20:50:161
2319999651,45cyclictest8513-21taskset21:35:151
2319999642,9cyclictest10587-21hddtemp_smartct21:40:181
2319999632,40cyclictest0-21swapper/122:55:191
2319999631,44cyclictest10948-21taskset00:33:411
2319999631,42cyclictest5843-21taskset21:26:421
23199996313,33cyclictest14428-21/usr/sbin/munin21:50:181
2319999623,5cyclictest0-21swapper/123:20:111
2319999622,8cyclictest3286-21runrttasks00:43:311
23199996210,6cyclictest16373-21df_inode20:30:141
2319999611,40cyclictest30878-21cut22:35:141
23199996112,33cyclictest22084-21fschecks_count20:45:151
2319999608,5cyclictest17638-21aten_r4power_cu22:00:121
2319999603,49cyclictest26455-21iostat_ios19:30:201
2319999602,41cyclictest0-21swapper/100:15:251
2319999602,39cyclictest17760-21http_loadtime23:25:171
2319999601,6cyclictest17253-21grep00:50:171
2319999598,32cyclictest11974-21taskset21:45:101
2319999592,6cyclictest32246-21cat00:05:001
2319999591,6cyclictest1880-21sshd22:44:271
23199995913,30cyclictest22-21ksoftirqd/120:39:401
2319999583,9cyclictest19787-21df_inode22:05:161
2319999581,40cyclictest29362-21aten_r4power_vo21:05:121
2319999581,39cyclictest20515-21chrt23:31:341
23199995811,29cyclictest7279-21seq00:24:311
2319999573,47cyclictest8154-21diskstats23:00:161
2319999572,6cyclictest25071-21df_inode23:45:131
2319999571,8cyclictest2115-21runrttasks21:18:111
2319999571,38cyclictest497-21taskset19:47:211
2319999568,6cyclictest26165-21seq22:20:281
2319999563,8cyclictest27348-21memory23:50:221
2319999562,8cyclictest5348-21users22:50:281
2319999562,4cyclictest0-21swapper/120:00:121
2319999561,13cyclictest9842-21taskset20:10:341
2319999558,5cyclictest40250irq/92-i91522:30:141
2319999557,4cyclictest7185-21http_loadtime20:05:171
2319999553,8cyclictest2033-21diskstats00:10:161
2319999552,8cyclictest11734-21hddtemp_smartct00:35:191
2319999551,39cyclictest22729-21sh23:44:551
2319999547,5cyclictest40250irq/92-i91519:50:241
2319999542,8cyclictest31735-21iostat21:10:191
2319999542,8cyclictest21864-21hddtemp_smartct22:10:171
2319999541,7cyclictest8337-21open_files00:25:251
2319999541,5cyclictest27389-21/usr/sbin/munin21:00:211
2319999541,5cyclictest27123-21taskset20:59:101
2319999541,12cyclictest12372-21grep23:10:221
23199995410,5cyclictest28336-21seq22:25:501
23199995410,5cyclictest28336-21seq22:25:501
2319999538,5cyclictest24886-21seq22:19:091
2319999537,5cyclictest2279-21grep22:45:121
2319999533,7cyclictest15535-21hddtemp_smartct00:45:171
2319999531,47cyclictest29095-21runrttasks19:36:251
2319999531,45cyclictest20301-21fschecks_time20:40:141
2319999527,5cyclictest28549-21aten_r4power_cu23:55:101
2319999521,46cyclictest21019-21cut23:35:131
23199995211,37cyclictest0-21swapper/121:30:281
2319999511,6cyclictest32601-21diskstats00:05:141
23199995110,37cyclictest31228-21runrttasks19:43:521
2319999504,7cyclictest14807-21iostat_ios20:25:211
2319999502,8cyclictest14076-21iostat23:15:201
2319999502,7cyclictest2861-21diskstats21:20:161
2319999499,36cyclictest3115-21cpuspeed_turbos19:55:121
23199994914,31cyclictest17193-21runrttasks21:57:271
2319999491,42cyclictest10991-21if_eth020:15:181
2319999487,5cyclictest40250irq/92-i91523:05:221
191332401,35sleep019189-21/usr/sbin/munin23:30:110
2319899361,12cyclictest39392awk22:50:000
23198993610,13cyclictest17593-21fschecks_count23:25:150
68162351,4sleep06828-21/usr/sbin/munin21:30:180
2319899351,22cyclictest14866-21python21:50:270
87242341,4sleep08815-21mailstats23:00:270
2319899343,18cyclictest0-21swapper/022:20:010
2319899343,16cyclictest1230-21python22:40:270
2319899341,22cyclictest29449-21cron19:40:000
148442341,10sleep00-21swapper/023:16:220
23198993323,6cyclictest13448-21latency_hist23:15:000
23198993213,6cyclictest10380-21df21:40:140
23198993211,6cyclictest17802-21latency_hist20:35:010
75852311,5sleep00-21swapper/022:59:080
60692311,5sleep00-21swapper/021:29:020
33742311,5sleep00-21swapper/000:13:100
268502311,5sleep00-21swapper/020:56:230
23198993122,6cyclictest3-21ksoftirqd/022:10:200
23198993113,5cyclictest29730-21ntp_states22:30:250
210662311,5sleep00-21swapper/022:08:300
195962311,5sleep00-21swapper/020:39:120
94822301,5sleep00-21swapper/021:35:330
91142301,5sleep00-21swapper/000:29:080
57682301,5sleep00-21swapper/022:54:450
54242301,5sleep00-21swapper/000:19:580
300162301,5sleep00-21swapper/023:57:350
281052301,5sleep00-21swapper/023:52:130
250652301,5sleep00-21swapper/020:52:200
2319899301,4cyclictest81rcu_preempt21:23:500
23198993011,6cyclictest17535-21irqstats00:50:210
23198993011,5cyclictest13736-21iostat_ios00:40:200
190082301,5sleep00-21swapper/022:01:390
133812301,5sleep00-21swapper/021:46:520
119432301,5sleep00-21swapper/020:17:520
98502291,5sleep00-21swapper/020:10:400
68762291,5sleep00-21swapper/000:20:300
6652290,8sleep02319899cyclictest00:05:230
320652291,4sleep00-21swapper/022:35:350
2319899294,13cyclictest11565-21gdbus00:38:540
2319899292,14cyclictest16222-21hddtemp_smartct21:55:170
2319899291,15cyclictest9879-21/usr/sbin/munin00:30:180
167652291,5sleep00-21swapper/023:21:350
305442281,5sleep00-21swapper/021:05:330
271222281,6sleep00-21swapper/019:30:310
262792281,5sleep00-21swapper/023:47:450
2319899282,14cyclictest0-21swapper/000:01:160
2319899282,13cyclictest9754-21aten_r4power_cu23:05:110
2319899282,13cyclictest27873-21perl21:00:160
23198992820,5cyclictest2036-21grep19:50:290
23198992812,4cyclictest0-21swapper/020:05:260
23198992811,5cyclictest27254-21wc22:25:130
23198992811,5cyclictest27254-21wc22:25:130
2319899281,15cyclictest1155-21/usr/sbin/munin21:15:200
2319899281,14cyclictest22352-21taskset23:36:110
23198992810,5cyclictest25347-21tr22:20:120
23198992810,15cyclictest0-21swapper/023:43:100
60722271,5sleep00-21swapper/020:00:300
2319899278,15cyclictest11565-21gdbus21:11:340
2319899272,13cyclictest20686-21ntp_states20:40:240
23198992710,4cyclictest31553-21aten_r4power_en19:45:120
142022271,5sleep00-21swapper/020:25:050
2319899268,5cyclictest3286-21runrttasks19:58:160
2319899268,4cyclictest29646-21aten_r4power_cu19:40:100
2319899262,17cyclictest22011-21df20:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional