You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 16:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Wed Dec 24, 2025 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2637822510,1sleep00-21swapper/007:05:220
2812299936,25cyclictest0-21swapper/012:20:210
2812299936,25cyclictest0-21swapper/012:20:210
56662920,2sleep00-21swapper/009:05:280
69752880,4sleep339-21ksoftirqd/307:40:263
2812299695,46cyclictest32283-21idleruntime-cro11:50:070
2812499667,25cyclictest0-21swapper/210:35:222
2812399665,10cyclictest7750irq/56-dwc_otg10:25:181
28123996523,18cyclictest2351-21/usr/sbin/munin08:55:371
2812299655,43cyclictest10218-21grep12:15:340
2812299637,29cyclictest0-21swapper/009:30:200
2812399623,17cyclictest0-21swapper/108:40:181
28122996214,30cyclictest0-21swapper/008:00:070
179552620,3sleep00-21swapper/011:10:220
2812299619,29cyclictest0-21swapper/009:50:250
2812299613,41cyclictest0-21swapper/010:00:080
2812299611,46cyclictest20558-21grep09:45:340
28123996023,22cyclictest30228-21/usr/sbin/munin08:45:211
28123996020,23cyclictest12538-21/usr/sbin/munin07:55:291
28123996019,15cyclictest26665-21aten_rbpower_cu10:05:201
2812299602,30cyclictest9761-21unixbench_singl09:15:360
2812299592,31cyclictest18453-21grep08:10:360
2812299592,31cyclictest18453-21grep08:10:360
2812299591,44cyclictest31924-21latency_hist10:20:070
2812299581,44cyclictest6756-21latency_hist10:40:080
2812299581,38cyclictest0-21swapper/011:25:340
28123995719,23cyclictest32001-21/usr/sbin/munin08:50:181
2812299571,8cyclictest17587-21grep12:35:370
2812299571,41cyclictest0-21swapper/007:15:350
2812299571,41cyclictest0-21swapper/007:15:350
28122995625,6cyclictest0-21swapper/008:25:190
28122995625,11cyclictest0-21swapper/009:10:180
2812299562,31cyclictest6587-21wget07:40:210
2812299562,30cyclictest0-21swapper/012:05:200
2812299561,8cyclictest3954-21fschecks_count12:00:250
28122995610,6cyclictest0-21swapper/008:35:190
28123995519,13cyclictest7228-21grep10:40:251
2812299559,23cyclictest15613-21grep08:05:220
2812299552,39cyclictest25545-21grep11:30:270
28122995518,15cyclictest25975-21grep08:30:520
28122995518,15cyclictest25975-21grep08:30:520
28123995424,16cyclictest16521-21ntp_states09:35:351
28122995427,12cyclictest7750irq/56-dwc_otg12:35:070
2812299542,27cyclictest27228-21wget11:35:230
2812299541,22cyclictest3311-21grep10:30:230
2812499535,5cyclictest0-21swapper/211:20:192
28124995312,21cyclictest0-21swapper/210:25:182
28123995327,13cyclictest5131-21apt-get10:35:201
28123995319,19cyclictest14083-21taskset12:26:261
2812299532,39cyclictest0-21swapper/011:05:310
2812299531,5cyclictest725-21head08:50:350
28122995314,19cyclictest21791-21/usr/sbin/munin08:20:310
2812499524,36cyclictest0-21swapper/210:45:202
2812499523,5cyclictest0-21swapper/208:50:182
2812399527,5cyclictest0-21swapper/111:25:201
28123995224,13cyclictest20453-21/usr/sbin/munin11:15:301
28123995221,13cyclictest26282-21sshd08:34:251
28123995221,13cyclictest26282-21sshd08:34:251
28123995219,11cyclictest7750irq/56-dwc_otg12:10:211
28123995217,12cyclictest9086-21/usr/sbin/munin12:15:371
2812299526,30cyclictest14113-21latency_hist11:00:080
2812299526,30cyclictest14113-21latency_hist11:00:080
28122995227,5cyclictest1236-21wget07:25:220
2812299522,33cyclictest0-21swapper/010:45:320
28122995221,15cyclictest27707-21sed10:05:340
2812299521,25cyclictest2642-21proc_pri11:55:340
28123995121,12cyclictest13954-21df08:00:221
28123995117,19cyclictest18427-21/usr/sbin/munin11:10:281
28123995113,12cyclictest31481-21proc_pri11:45:331
2812299515,8cyclictest0-21swapper/011:15:180
2812299514,30cyclictest28766-21fschecks_time10:10:260
2812299512,31cyclictest2304-21grep10:25:320
28122995118,10cyclictest0-21swapper/008:45:200
28123995029,7cyclictest14921-21ls09:30:341
28123995014,13cyclictest10222-21aten_rbpower_po07:50:201
2812299502,7cyclictest10762-21aten_rbpower_vo10:50:230
28122995023,4cyclictest0-21swapper/008:15:210
2812299501,8cyclictest25938-21grep10:00:370
2812299501,35cyclictest0-21swapper/009:20:230
2812299501,35cyclictest0-21swapper/009:20:230
28123994921,13cyclictest16521-21sed08:05:341
28123994918,12cyclictest8610-21fschecks_count07:45:251
28123994912,13cyclictest0-21swapper/107:11:171
28122994926,4cyclictest1480-21aten_rbpower_vo08:55:240
268302490,4sleep211-21rcu_preempt11:35:072
2812399488,24cyclictest0-21swapper/110:30:221
2812399484,28cyclictest7950irq/56-dwc_otg_07:25:071
2812399484,28cyclictest7950irq/56-dwc_otg_07:25:071
28123994817,21cyclictest26739-21runrttasks11:34:531
28122994826,4cyclictest7750irq/56-dwc_otg08:40:330
28122994825,5cyclictest7750irq/56-dwc_otg11:40:200
28122994825,5cyclictest7750irq/56-dwc_otg11:40:200
2812299481,24cyclictest14450-21ls11:00:230
2812399479,13cyclictest8268-21latency_hist07:45:081
28123994723,7cyclictest28929-21apt-get11:40:191
28123994723,7cyclictest28929-21apt-get11:40:191
2812299471,35cyclictest0-21swapper/007:45:320
2812599467,25cyclictest0-21swapper/307:30:223
2812599467,23cyclictest0-21swapper/309:05:193
2812599463,7cyclictest0-21swapper/312:35:193
2812499467,25cyclictest0-21swapper/212:35:222
2812499467,25cyclictest0-21swapper/211:25:212
2812499467,25cyclictest0-21swapper/211:00:222
2812499467,25cyclictest0-21swapper/210:55:212
2812499467,25cyclictest0-21swapper/210:55:212
2812499467,24cyclictest0-21swapper/208:30:132
2812499467,24cyclictest0-21swapper/208:30:132
2812399467,25cyclictest0-21swapper/111:55:231
2812399466,24cyclictest0-21swapper/110:10:221
2812399462,7cyclictest7750irq/56-dwc_otg10:45:201
28123994616,17cyclictest28666-21taskset11:40:031
28123994615,13cyclictest17997-21idleruntime-cro12:40:071
28123994614,11cyclictest0-21swapper/112:31:571
28123994610,12cyclictest27939-21chrt08:37:281
28122994625,4cyclictest4728-21cron09:05:070
28122994623,10cyclictest0-21swapper/012:25:210
28122994618,12cyclictest0-21swapper/009:35:220
2812299461,35cyclictest0-21swapper/009:25:430
28122994613,19cyclictest28738-21missed_timers07:10:260
41442450,2sleep20-21swapper/210:30:352
2812499457,22cyclictest0-21swapper/207:15:212
2812499457,22cyclictest0-21swapper/207:15:212
2812499456,18cyclictest0-21swapper/212:25:142
2812499452,19cyclictest0-21swapper/207:25:212
2812499451,5cyclictest0-21swapper/210:20:202
2812399458,22cyclictest0-21swapper/112:07:151
28123994516,18cyclictest15560-21seq11:02:011
28123994514,17cyclictest24770-21latency_hist10:00:081
28123994514,13cyclictest17791-21latency_hist11:10:081
28123994513,12cyclictest0-21swapper/111:24:021
28123994510,19cyclictest7750irq/56-dwc_otg08:19:071
2812299451,19cyclictest14009-21grep08:00:240
2812599447,22cyclictest0-21swapper/310:40:213
2812599446,24cyclictest0-21swapper/310:45:203
2812499449,22cyclictest0-21swapper/211:15:122
2812499442,9cyclictest0-21swapper/208:00:202
2812499442,6cyclictest0-21swapper/208:15:192
2812399446,25cyclictest0-21swapper/108:25:121
28123994414,20cyclictest11932-21taskset09:24:541
28123994414,20cyclictest11932-21taskset09:24:541
28123994414,14cyclictest862-21sshd10:21:251
28123994413,11cyclictest0-21swapper/107:39:301
28123994410,20cyclictest1303-21chrt11:51:001
28123994410,16cyclictest0-21swapper/109:40:321
2812299442,32cyclictest0-21swapper/012:12:520
2812299442,26cyclictest0-21swapper/007:20:300
2812299442,26cyclictest0-21swapper/007:20:300
2812599436,23cyclictest0-21swapper/312:20:213
2812599436,23cyclictest0-21swapper/312:20:213
2812499437,22cyclictest0-21swapper/209:00:222
2812499432,9cyclictest0-21swapper/211:40:192
2812499432,9cyclictest0-21swapper/211:40:192
28124994320,5cyclictest31-21ksoftirqd/212:15:302
28123994316,12cyclictest10109-21seq09:19:331
28123994316,11cyclictest1125-21runrttasks12:23:441
28123994316,11cyclictest1125-21runrttasks12:23:441
28123994315,12cyclictest20668-21sshd09:46:251
28123994313,19cyclictest7850irq/56-dwc_otg_09:51:501
28123994313,11cyclictest0-21swapper/109:11:391
2812399431,12cyclictest0-21swapper/108:20:181
28123994311,21cyclictest0-21swapper/110:59:411
28123994311,21cyclictest0-21swapper/110:59:411
28123994311,17cyclictest7950irq/56-dwc_otg_08:11:161
28123994311,17cyclictest7950irq/56-dwc_otg_08:11:161
28123994311,10cyclictest7850irq/56-dwc_otg_07:16:241
28123994311,10cyclictest7850irq/56-dwc_otg_07:16:241
2812299431,32cyclictest0-21swapper/011:21:120
28125994214,6cyclictest19669-21latency_hist11:15:083
2812399429,17cyclictest0-21swapper/107:29:151
28123994216,12cyclictest12188-21runrttasks09:25:121
28122994225,4cyclictest7850irq/56-dwc_otg_07:30:320
2812299422,23cyclictest0-21swapper/007:37:130
2812299422,20cyclictest11234-21unixbench_multi07:50:340
2812599416,25cyclictest0-21swapper/310:50:133
2812599412,13cyclictest7950irq/56-dwc_otg_10:35:353
2812499417,24cyclictest0-21swapper/207:10:182
28123994115,12cyclictest5196-21seq12:04:321
28123994114,13cyclictest12121-21chrt10:54:131
28122994118,12cyclictest0-21swapper/010:44:260
2812599408,20cyclictest0-21swapper/309:20:223
2812599408,20cyclictest0-21swapper/309:20:223
2812499407,24cyclictest0-21swapper/207:40:202
2812499406,24cyclictest0-21swapper/210:15:212
28124994011,5cyclictest12325-21/usr/sbin/munin09:25:222
28124994011,11cyclictest29-21rcuc/207:39:302
28123994024,12cyclictest25389-21ls10:00:301
28122994013,20cyclictest0-21swapper/011:50:420
2812299401,18cyclictest0-21swapper/009:40:320
2812599393,23cyclictest2378-21ls10:25:333
2812599392,24cyclictest7287-21ls09:10:273
28125993913,5cyclictest37-21rcuc/310:15:263
2812499393,25cyclictest0-21swapper/208:40:192
2812399395,20cyclictest0-21swapper/110:18:501
2812299392,21cyclictest0-21swapper/010:20:410
2812599388,14cyclictest7950irq/56-dwc_otg_11:30:283
2812599386,22cyclictest0-21swapper/310:05:193
2812599381,25cyclictest16344-21cut11:05:243
2812599381,20cyclictest0-21swapper/307:20:263
2812599381,20cyclictest0-21swapper/307:20:263
2812499387,22cyclictest0-21swapper/207:20:232
2812499387,22cyclictest0-21swapper/207:20:232
28124993818,4cyclictest29-21rcuc/212:10:072
28124993816,9cyclictest31-21ksoftirqd/208:55:362
2812399389,11cyclictest0-21swapper/109:06:201
2812399385,13cyclictest0-21swapper/107:32:051
2812599377,5cyclictest21699-21/usr/sbin/munin08:20:303
28125993710,14cyclictest0-21swapper/308:45:213
28123993714,11cyclictest4397-21taskset09:00:581
2812599368,5cyclictest7850irq/56-dwc_otg_09:55:193
28125993628,5cyclictest5759-21fschecks_count12:05:263
2812599362,3cyclictest7950irq/56-dwc_otg_07:10:183
2812499366,23cyclictest0-21swapper/211:05:202
28124993616,7cyclictest29-21rcuc/209:25:072
28124993616,7cyclictest29-21rcuc/209:25:072
28124993610,6cyclictest7950irq/56-dwc_otg_11:50:212
2812599357,24cyclictest0-21swapper/312:00:213
2812599357,15cyclictest0-21swapper/308:30:133
2812599357,15cyclictest0-21swapper/308:30:133
28125993515,4cyclictest2209-21/usr/sbin/munin07:25:353
2812599351,4cyclictest7850irq/56-dwc_otg_09:35:223
2812599351,18cyclictest15720-21ls09:35:073
2812499357,15cyclictest0-21swapper/210:50:142
28124993519,5cyclictest31-21ksoftirqd/210:10:352
2812499351,16cyclictest31-21ksoftirqd/207:55:342
2812599347,5cyclictest7850irq/56-dwc_otg_07:15:353
2812599347,5cyclictest7850irq/56-dwc_otg_07:15:353
2812599345,10cyclictest7950irq/56-dwc_otg_09:55:073
2812599343,6cyclictest7850irq/56-dwc_otg_08:25:193
2812599341,5cyclictest12511-21cut10:55:213
2812599341,5cyclictest12511-21cut10:55:213
28125993413,4cyclictest8965-21netstat07:45:293
2812599341,22cyclictest13985-21cut08:00:243
28125993411,7cyclictest7621-21fschecks_time12:10:263
2812499347,6cyclictest29-21rcuc/209:35:312
2812499347,15cyclictest0-21swapper/208:05:212
2812499342,12cyclictest7750irq/56-dwc_otg12:24:142
2812499342,12cyclictest7750irq/56-dwc_otg12:24:142
28124993414,5cyclictest31-21ksoftirqd/209:30:252
146522340,28sleep37950irq/56-dwc_otg_11:00:273
2812599337,14cyclictest0-21swapper/311:35:133
28125993314,12cyclictest1125-21runrttasks07:50:293
2812599331,22cyclictest19320-21ls09:45:083
2812499339,10cyclictest31-21ksoftirqd/210:05:322
28124993321,4cyclictest31-21ksoftirqd/211:45:242
2812499331,23cyclictest0-21swapper/207:30:222
277732333,23sleep30-21swapper/307:09:153
2812599325,5cyclictest7750irq/56-dwc_otg09:45:333
2812599325,11cyclictest7950irq/56-dwc_otg_09:15:363
2812599324,12cyclictest7950irq/56-dwc_otg_08:10:363
2812599324,12cyclictest7950irq/56-dwc_otg_08:10:363
2812599323,21cyclictest7850irq/56-dwc_otg_08:40:513
2812599321,22cyclictest14380-21latency_hist12:30:073
2812499328,7cyclictest31-21ksoftirqd/210:40:222
2812499327,22cyclictest0-21swapper/211:55:232
2812499323,13cyclictest7850irq/56-dwc_otg_09:15:252
2812499322,16cyclictest7850irq/56-dwc_otg_11:35:132
2812499321,5cyclictest7383-21aten_rbpower_po12:10:232
28124993213,5cyclictest8930-21grep07:45:292
28124993213,17cyclictest31-21ksoftirqd/210:05:072
2812499321,24cyclictest18217-21ls08:10:342
2812499321,24cyclictest18217-21ls08:10:342
277722324,17sleep21124-21snmpd07:09:142
2812599317,5cyclictest7850irq/56-dwc_otg_08:55:243
2812599316,13cyclictest7950irq/56-dwc_otg_08:15:193
2812599315,6cyclictest7950irq/56-dwc_otg_11:50:073
2812599312,19cyclictest0-21swapper/307:57:503
28125993112,5cyclictest2568-21/usr/sbin/munin11:55:313
2812599311,22cyclictest1649-21latency_hist11:55:073
2812599311,14cyclictest7850irq/56-dwc_otg_11:20:073
28124993124,5cyclictest31-21ksoftirqd/208:45:302
2812599306,14cyclictest0-21swapper/308:50:203
28125993023,4cyclictest12266-21aten_rbpower_en09:25:223
2812599302,19cyclictest0-21swapper/311:27:103
2812599301,6cyclictest0-21swapper/308:05:193
2812599301,11cyclictest0-21swapper/312:15:323
28125993010,5cyclictest21824-21fschecks_count11:20:243
2812499309,4cyclictest20986-21idleruntime-cro09:50:072
2812499305,13cyclictest7950irq/56-dwc_otg_12:30:252
2812499304,17cyclictest20969-21/usr/sbin/munin08:20:332
28124993022,6cyclictest31-21ksoftirqd/208:35:222
2812499302,19cyclictest0-21swapper/209:51:412
28124993012,5cyclictest29-21rcuc/211:12:382
28124993010,4cyclictest29-21rcuc/210:00:082
2812599297,6cyclictest27694-21unixbench_multi08:35:343
2812599296,15cyclictest7850irq/56-dwc_otg_11:40:173
2812599296,15cyclictest7850irq/56-dwc_otg_11:40:173
2812599292,5cyclictest28509-21aten_rbpower_po10:10:233
2812599291,8cyclictest3237-21aten_rbpower_cu10:30:223
28125992913,4cyclictest5216-21latency07:35:283
2812599291,19cyclictest0-21swapper/310:22:503
2812499294,10cyclictest7950irq/56-dwc_otg_07:50:202
28124992911,12cyclictest5640-21/usr/sbin/munin09:05:272
270052297,13sleep10-21swapper/107:05:331
2812599285,11cyclictest0-21swapper/312:30:353
28124992821,5cyclictest31-21ksoftirqd/208:25:272
28125992713,7cyclictest7950irq/56-dwc_otg_10:02:183
2812499273,14cyclictest7850irq/56-dwc_otg_12:00:252
2812499266,4cyclictest7850irq/56-dwc_otg_09:40:222
2812499262,6cyclictest7850irq/56-dwc_otg_09:10:292
2812599259,4cyclictest0-21swapper/309:00:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional