You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 05:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Tue Apr 21, 2026 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2833722770,2sleep30-21swapper/304:26:043
2833722770,2sleep30-21swapper/304:26:043
880921760,5sleep02990799cyclictest08:26:120
2042921720,5sleep22990999cyclictest08:01:102
1354821290,5sleep32991099cyclictest09:11:123
3231321000,5sleep32991099cyclictest09:34:353
130482940,2sleep10-21swapper/107:51:471
167912930,6sleep22990999cyclictest08:36:082
167912930,6sleep22990999cyclictest08:36:082
19822910,2sleep22990999cyclictest07:01:032
29907998110,5cyclictest27933-21rm08:50:210
2990799806,61cyclictest0-21swapper/007:30:530
2990799781,65cyclictest5796-21grep07:05:470
2990799771,54cyclictest16054-21/usr/sbin/munin07:56:080
318752750,8sleep1221ktimersoftd/107:36:041
29907997517,55cyclictest3595-21latency06:16:060
29907997516,40cyclictest8265-21diskmemload07:16:030
2990799744,4cyclictest15807-21idleruntime-cro08:35:470
2990799742,8cyclictest29905-21cyclictest04:30:490
29907997416,39cyclictest0-21swapper/006:48:330
97632730,5sleep02990799cyclictest07:48:190
2990799733,7cyclictest0-21swapper/005:01:000
29907997117,40cyclictest9455-21uniq09:46:040
29907997116,37cyclictest7950irq/56-dwc_otg_08:16:000
2990799711,25cyclictest0-21swapper/005:05:560
2990799711,15cyclictest29939-21ssh06:56:000
29908997011,16cyclictest0-21swapper/109:10:591
2990799701,8cyclictest21563-21latency05:36:060
29907997017,41cyclictest0-21swapper/007:42:040
29907997017,41cyclictest0-21swapper/007:42:040
2990799701,54cyclictest5666-21grep09:01:150
2990799701,54cyclictest5666-21grep09:01:150
2990799698,47cyclictest0-21swapper/009:31:270
2990799692,6cyclictest1034-21apt06:10:460
116922690,3sleep10-21swapper/107:11:281
29907996816,45cyclictest20931-21ssh09:20:580
2990799671,14cyclictest0-21swapper/009:00:130
29907996623,9cyclictest0-21swapper/009:15:560
29907996610,41cyclictest0-21swapper/008:10:210
29907996520,26cyclictest0-21swapper/005:11:460
29907996510,45cyclictest11959-21ssh09:10:060
2990799646,44cyclictest0-21swapper/008:00:540
2990799646,43cyclictest0-21swapper/007:38:190
29907996433,14cyclictest7950irq/56-dwc_otg_05:30:460
29907996417,35cyclictest7950irq/56-dwc_otg_08:55:390
2990799641,50cyclictest0-21swapper/008:13:130
2990799641,50cyclictest0-21swapper/008:13:130
29907996412,39cyclictest0-21swapper/005:52:370
29907996318,37cyclictest3805-21cut08:21:000
29907996316,36cyclictest7950irq/56-dwc_otg_09:51:420
29907996314,4cyclictest7950irq/56-dwc_otg_06:41:020
29907996313,3cyclictest7950irq/56-dwc_otg_09:29:420
2990799625,39cyclictest0-21swapper/007:26:390
29907996216,25cyclictest0-21swapper/007:08:360
29907996215,38cyclictest0-21swapper/006:32:230
29907996215,38cyclictest0-21swapper/006:32:230
2990799621,14cyclictest12694-21ssh09:11:010
29907996210,3cyclictest0-21swapper/008:36:100
29907996210,3cyclictest0-21swapper/008:36:100
2990799611,13cyclictest0-21swapper/009:57:370
2990799611,13cyclictest0-21swapper/006:26:010
29907996110,39cyclictest2587-21chrt04:44:470
2990799609,8cyclictest11648-21ssh07:11:240
2990799609,38cyclictest0-21swapper/007:53:250
2990799606,45cyclictest734-21taskset04:39:260
2990799605,2cyclictest0-21swapper/008:41:080
29907996016,35cyclictest0-21swapper/005:58:080
2990799601,55cyclictest27249-21ssh06:51:440
2990799601,50cyclictest0-21swapper/006:36:510
298752600,1sleep10-21swapper/108:51:211
2990799599,7cyclictest0-21swapper/007:25:220
2990799592,54cyclictest19513-21fschecks_count05:31:030
2990799591,44cyclictest0-21swapper/009:42:370
29907995914,37cyclictest0-21swapper/005:17:110
29907995914,37cyclictest0-21swapper/005:17:110
2990999586,32cyclictest0-21swapper/206:16:042
2990799581,53cyclictest31233-21unixbench_multi06:01:140
2990799581,13cyclictest0-21swapper/009:36:130
2990799581,13cyclictest0-21swapper/004:50:080
29907995810,4cyclictest2831-21modprobe06:15:460
271882580,33sleep17950irq/56-dwc_otg_08:10:021
191412580,1sleep10-21swapper/106:42:261
29907995720,21cyclictest0-21swapper/004:51:140
29907995710,6cyclictest0-21swapper/005:22:370
260712560,2sleep10-21swapper/107:29:201
29909995521,21cyclictest21547-21sed09:21:082
2990899558,5cyclictest0-21swapper/109:20:581
2990799552,28cyclictest6855-21fschecks_time04:56:040
2990999546,5cyclictest0-21swapper/205:45:582
2990999546,5cyclictest0-21swapper/205:45:582
2990899548,24cyclictest9244-21basename09:46:011
2990799541,44cyclictest0-21swapper/005:41:350
29909995313,13cyclictest13923-21grep09:11:162
29907995315,4cyclictest5946-21grep06:21:140
29909995210,31cyclictest808750kworker/u8:107:06:062
2990899527,26cyclictest14824-21/usr/sbin/munin05:16:141
2990899527,26cyclictest14824-21/usr/sbin/munin05:16:141
2990799521,3cyclictest7950irq/56-dwc_otg_05:46:050
2990799521,3cyclictest7950irq/56-dwc_otg_05:46:050
2990999508,20cyclictest7950irq/56-dwc_otg_08:55:592
2990899502,8cyclictest0-21swapper/104:40:581
2991099498,26cyclictest10092-21seq07:10:473
2991099493,21cyclictest7950irq/56-dwc_otg_08:11:073
2991099493,21cyclictest7950irq/56-dwc_otg_08:11:073
2990999499,10cyclictest0-21swapper/207:30:532
29909994914,13cyclictest265250ssh07:40:252
2990899494,23cyclictest7950irq/56-dwc_otg_04:55:471
29910994812,8cyclictest7850irq/56-dwc_otg_09:45:583
2990999485,30cyclictest10772-21ssh06:32:422
2990999485,30cyclictest10772-21ssh06:32:422
29909994815,12cyclictest5709-21/usr/sbin/munin06:21:112
29909994814,11cyclictest11695-21ssh09:09:372
29909994813,16cyclictest19254-21apt-get05:30:572
29909994813,11cyclictest5490-21ssh09:01:142
29909994813,11cyclictest5490-21ssh09:01:142
29909994812,19cyclictest8311-21cat05:00:472
29908994832,9cyclictest7850irq/56-dwc_otg_07:56:091
29908994820,10cyclictest7950irq/56-dwc_otg_09:04:051
29908994820,10cyclictest7950irq/56-dwc_otg_09:04:051
29908994814,16cyclictest7750irq/56-dwc_otg04:30:501
2990999479,25cyclictest7950irq/56-dwc_otg_06:46:102
2990999473,28cyclictest7950irq/56-dwc_otg_07:25:222
29909994727,4cyclictest7950irq/56-dwc_otg_07:46:012
29909994716,18cyclictest0-21swapper/208:00:022
29909994716,12cyclictest4892-21ssh07:41:572
29909994716,12cyclictest4892-21ssh07:41:572
29909994714,23cyclictest7750irq/56-dwc_otg09:51:392
29909994714,18cyclictest31994-21ssh08:15:512
322182460,2sleep20-21swapper/206:06:042
2991099467,25cyclictest0-21swapper/305:01:013
2991099467,24cyclictest0-21swapper/307:21:003
2990999466,27cyclictest7850irq/56-dwc_otg_09:32:062
2990999466,25cyclictest17155-21ssh06:40:592
2990999465,21cyclictest7950irq/56-dwc_otg_08:07:522
29909994615,17cyclictest14088-21ssh07:53:422
2990899467,21cyclictest7950irq/56-dwc_otg_08:47:311
2990899462,12cyclictest7950irq/56-dwc_otg_07:20:581
2990899461,11cyclictest0-21swapper/107:30:531
29909994514,12cyclictest6248-21chrt04:55:242
29909994513,13cyclictest21534-21uname05:36:062
29909994512,23cyclictest30371-21ssh08:13:172
29909994512,23cyclictest30371-21ssh08:13:172
29909994512,20cyclictest19461-21ssh09:57:362
2990899457,22cyclictest0-21swapper/105:05:591
29908994516,8cyclictest7880-21apt-get08:25:581
296032453,34sleep00-21swapper/004:30:230
296032453,34sleep00-21swapper/004:30:230
29910994419,6cyclictest11707-21latency_hist08:30:473
2990999447,25cyclictest7850irq/56-dwc_otg_07:16:572
2990999445,11cyclictest32198-21sh08:55:362
29909994422,17cyclictest0-21swapper/204:30:492
29909994413,17cyclictest13184-21ssh07:14:062
29909994411,14cyclictest23226-21ssh08:44:172
29908994422,7cyclictest0-21swapper/108:11:051
29908994422,7cyclictest0-21swapper/108:11:051
2990999438,31cyclictest7950irq/56-dwc_otg_06:01:132
2990999438,20cyclictest7950irq/56-dwc_otg_05:01:152
2990999438,20cyclictest28213-21ssh09:29:392
2990999438,18cyclictest9980-21ssh08:27:402
29909994316,17cyclictest1091-21ssh07:00:172
29909994313,15cyclictest15322-21ssh06:38:122
29909994312,19cyclictest5285-21rm08:21:382
2990899436,18cyclictest7950irq/56-dwc_otg_06:16:061
29908994327,8cyclictest7950irq/56-dwc_otg_05:36:031
29908994326,10cyclictest7750irq/56-dwc_otg07:41:561
29908994326,10cyclictest7750irq/56-dwc_otg07:41:561
2991099427,23cyclictest0-21swapper/306:16:003
2990999427,17cyclictest26910-21idleruntime-cro07:30:472
2990999426,24cyclictest0-21swapper/205:25:512
29909994214,11cyclictest26323-21ssh08:47:232
29909994212,11cyclictest9137-21ssh09:45:582
2990899429,4cyclictest7750irq/56-dwc_otg05:31:041
2990899428,14cyclictest7950irq/56-dwc_otg_08:36:111
2990899428,14cyclictest7950irq/56-dwc_otg_08:36:111
2990899426,22cyclictest1767-21ssh07:01:011
2990899425,23cyclictest0-21swapper/106:10:581
29908994218,6cyclictest7850irq/56-dwc_otg_05:01:141
135592420,17sleep17950irq/56-dwc_otg_06:36:101
29910994131,7cyclictest13597-21fschecks_time09:51:043
29910994116,8cyclictest17074-21fschecks_count09:16:023
2990999417,25cyclictest0-21swapper/206:51:012
2990999417,18cyclictest7850irq/56-dwc_otg_08:33:022
29909994113,11cyclictest20794-21cut09:20:472
2990899414,14cyclictest25299-21ssh06:50:461
2990899411,9cyclictest7850irq/56-dwc_otg_08:55:591
29908994115,5cyclictest15788-21sh07:16:161
2990899411,22cyclictest15793-21apt08:35:471
2990899411,21cyclictest8546-21ssh09:05:581
2990999407,21cyclictest0-21swapper/205:05:592
2990999407,19cyclictest501-21taskset04:36:452
29909994025,13cyclictest6694-21apt-get06:25:582
29909994011,12cyclictest16837-21taskset05:22:342
2990899407,23cyclictest21484-21ssh08:02:091
2990899407,23cyclictest0-21swapper/109:26:001
2990899407,17cyclictest0-21swapper/109:43:391
29908994019,7cyclictest7750irq/56-dwc_otg07:06:121
29908994013,12cyclictest7950irq/56-dwc_otg_09:37:371
29908994011,13cyclictest9450irq/48-DMA09:12:251
2990999399,18cyclictest13383-21seq05:14:252
2990899395,22cyclictest0-21swapper/106:06:001
29908993915,9cyclictest7950irq/56-dwc_otg_08:16:171
29908993915,5cyclictest17792-21fschecks_time09:56:051
33022380,1sleep30-21swapper/307:01:403
2991099387,24cyclictest0-21swapper/304:56:003
29910993818,5cyclictest11596-21sh06:34:093
29910993818,5cyclictest11596-21sh06:34:093
29910993817,5cyclictest22647-21sh09:21:583
2990999387,10cyclictest7622-21ssh09:43:372
2990999386,18cyclictest7950irq/56-dwc_otg_09:38:032
2990899388,2cyclictest0-21swapper/106:01:131
2990899387,26cyclictest0-21swapper/105:25:511
29908993825,4cyclictest7950irq/56-dwc_otg_07:47:461
29908993822,4cyclictest908-21runrttasks06:31:111
29908993822,4cyclictest908-21runrttasks06:31:111
29908993818,10cyclictest7950irq/56-dwc_otg_09:51:581
29908993815,7cyclictest221ktimersoftd/109:34:461
2991099377,24cyclictest0-21swapper/305:41:013
2991099377,22cyclictest0-21swapper/304:46:013
2991099375,22cyclictest0-21swapper/308:55:363
2991099374,8cyclictest7750irq/56-dwc_otg07:30:583
29910993715,4cyclictest22960-21ssh06:46:393
29909993711,15cyclictest28033-21seq05:55:432
2990899378,15cyclictest27208-21ssh06:51:401
2990899377,15cyclictest985-21ssh07:00:051
2990899374,8cyclictest0-21swapper/105:55:581
2990899374,20cyclictest0-21swapper/104:36:471
29908993715,5cyclictest221ktimersoftd/109:18:211
29908993712,9cyclictest8265-21diskmemload08:41:141
2990899371,17cyclictest5718-21/usr/sbin/munin06:21:111
2991099369,14cyclictest7950irq/56-dwc_otg_07:41:103
2991099369,14cyclictest7950irq/56-dwc_otg_07:41:103
2991099366,22cyclictest10467-21kworker/3:108:30:593
2991099363,20cyclictest7950irq/56-dwc_otg_08:50:463
2991099363,14cyclictest0-21swapper/304:30:503
2990999361,16cyclictest7850irq/56-dwc_otg_05:16:042
2990999361,16cyclictest7850irq/56-dwc_otg_05:16:042
2990899362,23cyclictest7750irq/56-dwc_otg08:22:221
29908993615,4cyclictest13588-21latency_hist05:15:471
2991099355,19cyclictest4352-21ssh09:00:533
2991099355,19cyclictest4352-21ssh09:00:533
29910993517,4cyclictest7850irq/56-dwc_otg_05:26:053
29910993511,6cyclictest0-21swapper/306:41:053
2990999357,18cyclictest2812-21chrt06:15:382
2990999354,17cyclictest2861-21ls04:45:472
2990899355,9cyclictest0-21swapper/105:25:371
2991099346,6cyclictest32236-21cut06:06:043
2991099345,14cyclictest7950irq/56-dwc_otg_09:41:163
2991099343,7cyclictest2582850ssh09:26:103
2991099341,23cyclictest10406-21uniq05:06:023
2991099341,20cyclictest5312-21ls04:51:073
2990999344,21cyclictest0-21swapper/205:55:582
2990999343,10cyclictest0-21swapper/204:47:242
2990899346,16cyclictest7850irq/56-dwc_otg_05:44:431
29908993417,5cyclictest221ktimersoftd/105:00:471
29908993414,5cyclictest2474650wget05:46:001
29908993414,5cyclictest2474650wget05:46:001
2991099339,12cyclictest0-21swapper/308:09:253
2991099337,14cyclictest0-21swapper/306:00:593
2991099336,15cyclictest0-21swapper/307:25:593
2991099336,14cyclictest7950irq/56-dwc_otg_07:46:143
2991099334,10cyclictest0-21swapper/308:40:583
2991099333,17cyclictest10380-21ssh07:11:013
29910993325,5cyclictest381ktimersoftd/306:50:583
2991099331,5cyclictest0-21swapper/307:15:583
2990899336,13cyclictest0-21swapper/105:55:371
2991099328,12cyclictest7950irq/56-dwc_otg_08:36:043
2991099328,12cyclictest7950irq/56-dwc_otg_08:36:043
2991099327,5cyclictest0-21swapper/306:40:473
2991099325,12cyclictest7950irq/56-dwc_otg_04:41:143
2991099322,20cyclictest0-21swapper/310:00:053
2991099321,22cyclictest14069-21uniq05:16:043
2991099321,22cyclictest14069-21uniq05:16:043
2991099321,20cyclictest31973-21cut04:36:023
2991099321,20cyclictest0-21swapper/308:01:183
2990999324,18cyclictest7850irq/56-dwc_otg_05:41:022
29908993214,5cyclictest7850irq/56-dwc_otg_06:26:151
2991099319,5cyclictest7950irq/56-dwc_otg_09:06:003
2991099316,5cyclictest7750irq/56-dwc_otg06:56:073
2991099313,13cyclictest7950irq/56-dwc_otg_07:36:093
2991099312,15cyclictest7950irq/56-dwc_otg_06:26:013
2991099311,8cyclictest2125-21grep09:36:143
2991099311,21cyclictest11470-21ssh07:51:003
2991099311,20cyclictest16576-21ssh07:56:163
2991099309,4cyclictest0-21swapper/308:25:393
2991099305,5cyclictest16222-21grep05:21:103
2991099305,14cyclictest0-21swapper/308:59:453
2991099304,4cyclictest1509-21fschecks_count06:11:013
296882306,11sleep10-21swapper/104:30:481
296882306,11sleep10-21swapper/104:30:481
287922306,11sleep20-21swapper/204:26:122
287922306,11sleep20-21swapper/204:26:122
2991099297,16cyclictest0-21swapper/305:36:003
2991099293,10cyclictest7850irq/56-dwc_otg_05:30:583
29910992922,5cyclictest24801-21aten_rbpower_vo05:46:003
29910992922,5cyclictest24801-21aten_rbpower_vo05:46:003
2991099291,6cyclictest32065-21apt-get08:15:573
2991099287,10cyclictest7950irq/56-dwc_otg_05:11:123
2991099282,4cyclictest7850irq/56-dwc_otg_05:56:063
29910992822,4cyclictest28050-21sh05:55:463
2991099281,18cyclictest5211-21uniq06:21:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional