You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 15:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Fri Sep 18, 2026 12:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
196199910128,29cyclictest5500-21ssh10:00:330
161512990,2sleep00-21swapper/008:30:230
11262970,6sleep21962199cyclictest11:58:472
1961999957,45cyclictest0-21swapper/007:20:360
205792930,2sleep00-21swapper/012:23:270
19619999116,47cyclictest0-21swapper/008:10:360
35802820,2sleep00-21swapper/010:39:220
253132820,2sleep10-21swapper/110:25:371
122192820,2sleep20-21swapper/210:50:322
1962299812,45cyclictest0-21swapper/312:05:363
112922810,4sleep010185-21kworker/0:010:49:090
19619997945,23cyclictest101ktimersoftd/012:15:230
9362760,2sleep20-21swapper/211:16:242
288372760,2sleep30-21swapper/309:48:313
1961999765,48cyclictest0-21swapper/008:20:350
19619997465,7cyclictest0-21swapper/009:37:190
1961999746,36cyclictest0-21swapper/009:05:350
1961999746,36cyclictest0-21swapper/009:05:350
256382730,3sleep00-21swapper/009:44:570
25062730,2sleep00-21swapper/009:15:320
1962299738,29cyclictest0-21swapper/309:40:353
1961999724,14cyclictest7750irq/56-dwc_otg10:10:350
252942710,2sleep30-21swapper/312:30:033
1961999717,47cyclictest0-21swapper/011:40:300
1961999707,56cyclictest0-21swapper/009:55:350
1961999704,43cyclictest0-21swapper/009:25:340
240422690,2sleep20-21swapper/208:50:402
240422690,2sleep20-21swapper/208:50:402
123872690,3sleep012388-21unixbench_singl11:30:520
19619996823,10cyclictest0-21swapper/010:40:330
225142650,3sleep121-21rcuc/111:03:091
19619996548,3cyclictest0-21swapper/011:55:340
19619996546,4cyclictest7750irq/56-dwc_otg12:25:330
19619996535,9cyclictest15038-21ssh11:35:340
19619996535,6cyclictest7950irq/56-dwc_otg_11:45:340
19619996517,11cyclictest0-21swapper/011:10:340
318382640,3sleep031836-21aten_rbpower_cu11:15:370
19619996428,15cyclictest7750irq/56-dwc_otg11:10:010
19619996416,35cyclictest0-21swapper/008:35:290
25082630,4sleep32502-21ssh09:55:493
19619996355,5cyclictest17748-21cat10:15:420
19619996341,8cyclictest0-21swapper/009:20:370
19619996341,8cyclictest0-21swapper/009:20:370
19619996313,10cyclictest0-21swapper/007:45:340
1961999621,40cyclictest0-21swapper/008:40:290
1961999611,37cyclictest23979-21cut08:50:390
1961999611,37cyclictest23979-21cut08:50:390
19619996033,13cyclictest23207-21seq08:46:470
19619996027,12cyclictest0-21swapper/009:10:240
1961999597,45cyclictest0-21swapper/007:35:360
19619995945,4cyclictest0-21swapper/011:50:370
19619995945,4cyclictest0-21swapper/011:50:370
1961999593,27cyclictest0-21swapper/008:20:230
1961999592,33cyclictest0-21swapper/011:20:500
1961999591,54cyclictest101ktimersoftd/012:05:230
19619995836,13cyclictest101ktimersoftd/010:20:530
1961999582,7cyclictest7473-21ssh12:05:530
1961999567,40cyclictest13-21rcuc/007:30:370
19619995623,4cyclictest0-21swapper/010:25:350
19619995618,19cyclictest26305-21aten_rbpower_vo09:45:370
1962299558,29cyclictest0-21swapper/309:35:293
1962199551,17cyclictest4097-21kworker/u8:210:45:342
19619995541,4cyclictest7750irq/56-dwc_otg08:05:420
19619995535,6cyclictest101ktimersoftd/008:00:030
19619995534,5cyclictest101ktimersoftd/011:25:430
19619995532,7cyclictest7950irq/56-dwc_otg_12:15:490
1961999552,6cyclictest7950irq/56-dwc_otg_10:30:480
19619995519,25cyclictest31159-21ls09:50:520
32652540,2sleep10-21swapper/109:56:351
1961999542,48cyclictest0-21swapper/009:30:370
1961999542,27cyclictest0-21swapper/010:05:480
1961999542,27cyclictest0-21swapper/010:05:480
19619995420,20cyclictest0-21swapper/008:02:320
19619995333,10cyclictest0-21swapper/011:02:220
1961999533,29cyclictest0-21swapper/012:35:450
19619995332,6cyclictest7850irq/56-dwc_otg_10:50:510
19619995310,22cyclictest0-21swapper/010:55:500
1962199529,30cyclictest7850irq/56-dwc_otg_11:35:352
1962099521,38cyclictest0-21swapper/112:30:451
1962099521,38cyclictest0-21swapper/112:30:451
19619995229,10cyclictest26276-21seq07:26:000
19619995223,7cyclictest7850irq/56-dwc_otg_08:55:540
19619995220,18cyclictest1980-21grep07:50:400
19619995217,20cyclictest17933-21latency_hist08:35:230
19619995212,19cyclictest0-21swapper/007:40:510
19619995212,19cyclictest0-21swapper/007:40:510
56702510,3sleep229-21rcuc/212:05:002
315532510,2sleep20-21swapper/212:36:552
1962299518,27cyclictest0-21swapper/309:25:363
1962299518,26cyclictest0-21swapper/311:40:293
19619995125,11cyclictest101ktimersoftd/009:05:230
19619995117,25cyclictest20638-21ls07:10:490
1962299509,29cyclictest0-21swapper/308:45:373
1961999502,25cyclictest26183-21fschecks_time12:30:410
1961999502,25cyclictest26183-21fschecks_time12:30:410
1962299498,25cyclictest29048-21ssh10:30:363
185392494,31sleep00-21swapper/007:05:490
185392494,31sleep00-21swapper/007:05:490
35512480,10sleep229-21rcuc/211:20:392
24102480,3sleep20-21swapper/210:37:022
1962299485,27cyclictest0-21swapper/307:40:353
1962299485,27cyclictest0-21swapper/307:40:353
1962199482,8cyclictest0-21swapper/211:25:342
19621994819,7cyclictest24821-21cron07:25:232
1962099488,7cyclictest7950irq/56-dwc_otg_10:45:331
1962099483,35cyclictest7950irq/56-dwc_otg_11:35:241
19619994820,17cyclictest0-21swapper/007:15:250
237062470,3sleep223681-21ssh11:05:232
1962099471,39cyclictest11456-21ls09:25:511
1962099471,13cyclictest0-21swapper/110:36:461
141702470,2sleep30-21swapper/312:15:373
272822460,1sleep30-21swapper/312:31:123
272822460,1sleep30-21swapper/312:31:123
19622994621,8cyclictest31092-21/usr/sbin/munin11:55:413
19622994613,4cyclictest7750irq/56-dwc_otg12:35:373
1962199467,28cyclictest13353-21ssh10:10:352
1962099468,17cyclictest19893-21fschecks_count07:10:391
1962099467,27cyclictest15451-21ls09:30:521
19620994622,6cyclictest30206-21aten_rbpower_po09:50:381
1962299459,25cyclictest0-21swapper/312:00:363
1962299457,13cyclictest60-21kswapd010:00:333
19622994519,17cyclictest28614-1kworker/u9:209:50:423
19622994511,17cyclictest0-21swapper/311:20:413
1962199455,6cyclictest7850irq/56-dwc_otg_12:15:352
1962099457,23cyclictest7950irq/56-dwc_otg_08:30:221
19620994530,7cyclictest12194-21ssh10:08:451
19620994530,7cyclictest12194-21ssh10:08:451
1962099451,31cyclictest3640-21ls07:55:371
132732450,3sleep10-21swapper/108:20:451
275572441,38sleep227564-21diskstats09:00:402
1962299441,30cyclictest23849-21ls11:05:243
1962099442,28cyclictest0-21swapper/111:45:431
1962099441,6cyclictest7950irq/56-dwc_otg_12:10:351
1962099441,19cyclictest0-21swapper/110:41:561
1962199435,3cyclictest7950irq/56-dwc_otg_08:20:302
1962199432,27cyclictest0-21swapper/209:28:392
1962099433,7cyclictest20188-21snmpd11:25:341
19620994320,12cyclictest7950irq/56-dwc_otg_11:15:501
1962099431,22cyclictest6783-21fschecks_count09:20:411
1962099431,22cyclictest6783-21fschecks_count09:20:411
19622994218,5cyclictest26867-21sh11:50:323
19622994218,5cyclictest26867-21sh11:50:323
1962199429,17cyclictest0-21swapper/209:18:492
1962199427,20cyclictest7850irq/56-dwc_otg_11:30:412
1962199425,23cyclictest7850irq/56-dwc_otg_10:20:372
1962199422,25cyclictest0-21swapper/209:50:462
1962099421,18cyclictest24826-21latency_hist10:25:231
1962299414,17cyclictest23346-21fschecks_time11:45:413
19622994121,5cyclictest1251-21ssh09:13:303
1962199414,24cyclictest7850irq/56-dwc_otg_07:25:432
1962199412,28cyclictest19386-21grep11:40:412
1962199412,15cyclictest0-21swapper/208:30:332
19620994118,5cyclictest2278-21/usr/sbin/munin12:00:331
1962099411,5cyclictest7850irq/56-dwc_otg_09:45:351
1962099411,15cyclictest0-21swapper/112:25:331
102152410,2sleep20-21swapper/210:05:472
102152410,2sleep20-21swapper/210:05:472
1962299408,17cyclictest0-21swapper/307:55:363
1962299403,24cyclictest32217-21ls11:15:423
19622994016,15cyclictest20718-21ssh10:20:073
1962199404,14cyclictest7950irq/56-dwc_otg_11:10:352
1962199402,25cyclictest0-21swapper/208:35:362
19621994012,4cyclictest29-21rcuc/211:50:452
19621994012,4cyclictest29-21rcuc/211:50:452
19620994021,6cyclictest27192-21fschecks_time07:30:401
19620994021,5cyclictest1865450http11:40:231
19620994019,12cyclictest28435-21sh11:51:191
19620994019,12cyclictest28435-21sh11:51:191
19620994018,6cyclictest21724-21sh12:25:231
1962299396,23cyclictest19618-21cyclictest11:05:373
1962299394,15cyclictest7850irq/56-dwc_otg_09:25:233
1962299394,15cyclictest7850irq/56-dwc_otg_09:25:233
1962299393,28cyclictest7950irq/56-dwc_otg_08:25:333
1962299392,25cyclictest10523-21ls12:10:423
1962199398,19cyclictest0-21swapper/208:10:332
1962199397,17cyclictest7950irq/56-dwc_otg_08:20:232
1962199394,25cyclictest7850irq/56-dwc_otg_07:15:222
19621993919,4cyclictest29-21rcuc/207:45:522
19621993912,12cyclictest1180-21runrttasks12:05:352
1962099398,18cyclictest7950irq/56-dwc_otg_11:20:371
19620993919,6cyclictest23852-21sh09:41:251
19620993916,5cyclictest7850irq/56-dwc_otg_12:15:351
1962099391,16cyclictest10442-21idleruntime-cro08:15:231
1962299388,17cyclictest0-21swapper/307:25:363
1962299386,6cyclictest7850irq/56-dwc_otg_08:55:543
1962299382,7cyclictest1163550ssh11:30:433
1962299382,4cyclictest0-21swapper/311:25:373
19622993819,11cyclictest30720-21diskmemload11:35:513
19622993817,5cyclictest20119-21/usr/sbin/munin08:40:473
1962299381,27cyclictest28174-21grep11:10:413
1962299381,27cyclictest25314-21latency_hist08:55:233
1962299381,27cyclictest25314-21latency_hist08:55:233
1962199386,16cyclictest7950irq/56-dwc_otg_08:00:462
1962199384,23cyclictest7850irq/56-dwc_otg_08:25:492
1962199384,20cyclictest0-21swapper/210:27:152
1962199382,7cyclictest7850irq/56-dwc_otg_10:45:242
19621993818,5cyclictest7850irq/56-dwc_otg_09:10:542
19621993818,5cyclictest7850irq/56-dwc_otg_08:55:502
19621993816,6cyclictest7950irq/56-dwc_otg_12:10:362
1962199381,26cyclictest26132-21uniq12:30:412
1962199381,26cyclictest26132-21uniq12:30:412
1962199381,25cyclictest26587-21idleruntime09:45:412
1962099385,16cyclictest7950irq/56-dwc_otg_09:10:421
1962099383,22cyclictest7950irq/56-dwc_otg_10:30:371
1962099383,18cyclictest0-21swapper/108:40:361
1962099382,17cyclictest0-21swapper/110:04:001
19620993818,9cyclictest22770-21latency_hist11:45:231
1962099381,25cyclictest26631-21kworker/u8:309:35:311
1962099381,25cyclictest0-21swapper/109:15:361
1962099381,23cyclictest0-21swapper/111:05:371
1962099381,21cyclictest18466-21rm10:15:521
1962099381,17cyclictest6198-21apt-get12:05:331
19620993811,7cyclictest13789-21if_err_wlan010:10:421
19620993810,8cyclictest509-21cron07:25:231
1962299378,17cyclictest0-21swapper/308:20:293
1962299372,9cyclictest17938-21/usr/sbin/munin12:20:503
19622993725,8cyclictest1284-21ntp_offset10:35:483
1962299371,23cyclictest25428-21fschecks_time10:25:403
1962199378,8cyclictest0-21swapper/210:55:422
1962199377,20cyclictest7850irq/56-dwc_otg_12:25:472
1962199373,8cyclictest0-21swapper/209:40:332
1962199372,19cyclictest0-21swapper/209:33:092
1962199371,4cyclictest0-21swapper/209:23:292
1962199371,4cyclictest0-21swapper/209:23:292
19621993714,19cyclictest0-21swapper/210:00:362
1962199371,24cyclictest18547-21ssh09:35:402
19621993711,7cyclictest0-21swapper/208:40:342
1962099373,5cyclictest7950irq/56-dwc_otg_10:50:341
1962099373,26cyclictest0-21swapper/111:13:221
1962099373,25cyclictest0-21swapper/109:00:361
19620993721,4cyclictest17260-21cat08:30:491
19620993720,5cyclictest1180-21runrttasks07:26:571
1962099371,25cyclictest0-21swapper/108:05:381
1962299364,25cyclictest0-21swapper/308:40:243
19622993630,4cyclictest9375-21ls08:10:433
1962299362,16cyclictest7950irq/56-dwc_otg_08:10:223
19622993617,5cyclictest14327-21sh09:30:363
19622993614,13cyclictest4974-21ssh09:18:053
1962299361,25cyclictest0-21swapper/307:53:503
1962199364,22cyclictest7850irq/56-dwc_otg_07:33:412
1962199362,24cyclictest7850irq/56-dwc_otg_07:15:372
19621993616,7cyclictest7850irq/56-dwc_otg_11:05:412
1962099367,15cyclictest7950irq/56-dwc_otg_07:45:231
1962099367,15cyclictest7950irq/56-dwc_otg_07:45:231
1962099366,22cyclictest7950irq/56-dwc_otg_07:55:231
1962099362,19cyclictest7850irq/56-dwc_otg_08:49:331
1962099362,19cyclictest7750irq/56-dwc_otg07:19:131
1962099361,8cyclictest0-21swapper/107:35:341
1962099361,22cyclictest19313-21ssh10:59:351
1962099361,19cyclictest30020-21fschecks_count12:35:411
19620993610,14cyclictest0-21swapper/111:56:041
292202350,3sleep229222-21aten_rbpower_po09:05:382
292202350,3sleep229222-21aten_rbpower_po09:05:382
1962299357,17cyclictest0-21swapper/308:00:373
1962299355,20cyclictest7950irq/56-dwc_otg_10:55:343
1962299351,22cyclictest30026-21switchtime09:05:513
1962299351,22cyclictest30026-21switchtime09:05:513
1962299351,18cyclictest12477-21df10:50:393
19621993523,10cyclictest19757-21ssh10:18:122
19621993517,6cyclictest20001-21sh12:22:182
1962199351,6cyclictest4993-21sshd10:00:012
19620993519,5cyclictest18208-21/usr/sbin/munin08:35:411
1962099351,19cyclictest0-21swapper/107:45:481
1962099351,17cyclictest0-21swapper/108:20:201
1962299348,14cyclictest0-21swapper/310:09:193
1962299348,14cyclictest0-21swapper/310:09:193
1962299347,11cyclictest16203-21systemd-journal07:40:233
1962299346,12cyclictest7850irq/56-dwc_otg_10:20:403
1962299342,7cyclictest5681-21unixbench_singl10:40:513
19622993418,6cyclictest1563550ssh10:12:503
1962299341,22cyclictest0-21swapper/307:21:113
1962299341,21cyclictest16545-21grep08:30:393
1962199348,7cyclictest7950irq/56-dwc_otg_07:50:362
1962199342,5cyclictest3533-21aten_rbpower_en07:55:362
1962199341,15cyclictest0-21swapper/210:30:462
1962099342,6cyclictest30730-21munin-run09:10:231
1962099342,6cyclictest30730-21munin-run09:10:231
1962099342,17cyclictest0-21swapper/108:00:521
1962299334,14cyclictest7950irq/56-dwc_otg_08:15:503
1962299332,22cyclictest0-21swapper/307:34:003
1962299331,22cyclictest0-21swapper/309:03:293
1962199339,7cyclictest7850irq/56-dwc_otg_07:40:232
1962199331,23cyclictest29-21rcuc/211:45:472
1962099332,16cyclictest0-21swapper/108:50:451
1962099332,16cyclictest0-21swapper/108:50:451
19620993310,5cyclictest1180-21runrttasks08:56:261
1962299321,28cyclictest21779-21uniq07:15:423
19622993211,10cyclictest7950irq/56-dwc_otg_10:45:343
1962199321,7cyclictest31-21ksoftirqd/208:45:382
192512327,18sleep10-21swapper/107:09:061
192512327,18sleep10-21swapper/107:09:061
1962299301,8cyclictest425-21missed_timers07:45:443
1962199302,18cyclictest0-21swapper/208:06:162
19621993019,6cyclictest31006-21latency07:40:422
19621993019,6cyclictest31006-21latency07:40:422
193042307,14sleep20-21swapper/207:09:482
193042307,14sleep20-21swapper/207:09:482
1962299291,20cyclictest0-21swapper/307:12:163
190152273,15sleep30-21swapper/307:06:083
190152273,15sleep30-21swapper/307:06:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional