You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 03:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Sun Apr 05, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1626421010,2sleep20-21swapper/207:51:472
160492840,4sleep215694-21apt-get09:10:432
131599797,35cyclictest0-21swapper/007:35:510
131599756,18cyclictest0-21swapper/006:50:530
131599754,54cyclictest0-21swapper/004:36:070
131599752,58cyclictest0-21swapper/004:56:050
167492740,1sleep10-21swapper/107:14:221
43842730,2sleep30-21swapper/307:37:553
41292720,2sleep20-21swapper/208:55:572
41292720,2sleep20-21swapper/208:55:572
132699702,31cyclictest0-21swapper/208:10:492
131599702,56cyclictest3557-21aten_rbpower_en06:05:530
131599681,52cyclictest11943-21cut09:05:530
1315996811,44cyclictest18822-21aten_rbpower_po07:55:520
131599671,43cyclictest0-21swapper/005:50:500
131599661,45cyclictest5651-21fschecks_count07:00:540
1315996512,40cyclictest5639-21/usr/sbin/munin04:40:570
1315996418,34cyclictest32124-21ssh08:11:050
131599641,49cyclictest0-21swapper/008:35:590
131599641,23cyclictest0-21swapper/005:05:440
133099632,8cyclictest7750irq/56-dwc_otg08:45:503
1315996310,36cyclictest24830-21unixbench_singl08:41:060
131599622,48cyclictest0-21swapper/005:40:550
131599622,44cyclictest505-21rs:main0
1315996218,30cyclictest8434-21cron04:50:380
131599612,43cyclictest0-21swapper/007:20:560
131599612,38cyclictest0-21swapper/006:00:500
131599612,30cyclictest7762-21sh09:00:510
131599611,44cyclictest22027-21wc05:26:010
1326996013,12cyclictest21908-21ssh07:20:492
131599601,49cyclictest0-21swapper/009:10:570
131599591,24cyclictest3258-21apt-config08:55:380
131599587,33cyclictest0-21swapper/009:35:390
131599582,44cyclictest0-21swapper/008:50:390
131599578,36cyclictest20950-21missed_timers09:16:000
131599572,40cyclictest29827-21sed09:26:080
131599571,42cyclictest28761-21wget05:45:530
193902560,2sleep30-21swapper/307:16:383
193902560,2sleep30-21swapper/307:16:383
131599569,14cyclictest0-21swapper/006:40:520
131599561,47cyclictest101ktimersoftd/009:20:500
71782550,3sleep1132299cyclictest09:38:481
131599559,37cyclictest0-21swapper/006:36:000
1315995529,12cyclictest0-21swapper/007:30:490
1315995523,21cyclictest7750irq/56-dwc_otg08:05:570
1315995523,21cyclictest7750irq/56-dwc_otg08:05:570
1315995523,19cyclictest0-21swapper/005:31:000
131599551,35cyclictest7445-21fschecks_time06:15:560
1315995420,24cyclictest0-21swapper/005:55:500
1315995417,27cyclictest908-21runrttasks08:35:110
131599541,46cyclictest0-21swapper/006:31:010
131599541,41cyclictest0-21swapper/006:55:510
1315995324,16cyclictest7950irq/56-dwc_otg_07:25:530
1315995324,16cyclictest7950irq/56-dwc_otg_07:25:530
1315995319,15cyclictest15028-21sh08:30:390
1315995232,4cyclictest7950irq/56-dwc_otg_05:15:380
1315995216,5cyclictest9550irq/80-mmc009:55:380
1315995210,34cyclictest23215-21fschecks_time08:00:550
132699513,11cyclictest0-21swapper/207:00:482
1315995133,5cyclictest5459-21timerandwakeup09:36:060
131599511,37cyclictest12776-21sed05:00:580
131599511,29cyclictest5560-21fschecks_count06:10:560
103772510,1sleep10-21swapper/104:55:391
143632500,2sleep30-21swapper/309:08:143
1330995014,9cyclictest7950irq/56-dwc_otg_06:00:533
1315995033,3cyclictest7850irq/56-dwc_otg_07:16:030
1315995033,3cyclictest7850irq/56-dwc_otg_07:16:030
1315995027,5cyclictest7850irq/56-dwc_otg_04:35:380
131599501,27cyclictest0-21swapper/007:51:010
131599492,32cyclictest0-21swapper/007:41:450
131599492,30cyclictest0-21swapper/007:05:580
131599491,38cyclictest0-21swapper/005:35:550
131599491,36cyclictest11421-21wc06:26:000
131599491,34cyclictest19610-21/usr/sbin/munin05:21:020
131599491,27cyclictest22992-21seq09:57:270
136592480,2sleep30-21swapper/307:49:473
1315994828,6cyclictest7750irq/56-dwc_otg08:59:430
1315994828,6cyclictest7750irq/56-dwc_otg08:59:430
131599481,5cyclictest3028-21seq08:15:530
131599481,4cyclictest0-21swapper/006:45:390
131599481,4cyclictest0-21swapper/006:45:390
131599481,30cyclictest917-21snmpd07:49:070
1330994726,5cyclictest7950irq/56-dwc_otg_09:01:063
1330994718,5cyclictest9993-21cron07:45:383
133099467,25cyclictest0-21swapper/306:20:443
133099467,25cyclictest0-21swapper/304:35:433
133099467,24cyclictest0-21swapper/305:00:513
131599462,21cyclictest0-21swapper/009:49:570
1315994613,15cyclictest0-21swapper/004:50:590
324102456,25sleep332511-21/usr/sbin/munin04:25:563
27522450,19sleep37950irq/56-dwc_otg_08:54:533
132299454,8cyclictest0-21swapper/107:00:481
133099447,22cyclictest0-21swapper/305:20:523
1330994420,7cyclictest7750irq/56-dwc_otg08:01:473
132699447,25cyclictest0-21swapper/204:55:512
132699447,24cyclictest0-21swapper/204:40:502
1326994421,12cyclictest12323-21seq08:26:082
1322994411,5cyclictest17435-21uniq06:35:561
1315994419,13cyclictest7950irq/56-dwc_otg_09:45:350
131599441,21cyclictest0-21swapper/006:20:580
90724323,13sleep00-21swapper/004:28:490
133099437,25cyclictest0-21swapper/306:30:523
133099437,24cyclictest0-21swapper/304:50:523
1330994323,9cyclictest7750irq/56-dwc_otg09:29:273
1326994322,5cyclictest17535-21ssh08:33:012
1326994314,12cyclictest7345-21fschecks_count06:15:562
1315994328,5cyclictest7750irq/56-dwc_otg08:21:060
1315994319,5cyclictest18260-21seq05:15:580
92732420,2sleep20-21swapper/207:44:192
303412420,1sleep10-21swapper/106:51:031
133099427,25cyclictest0-21swapper/305:05:433
133099421,35cyclictest0-21swapper/308:24:403
132699427,22cyclictest0-21swapper/205:40:512
132699427,22cyclictest0-21swapper/205:05:442
1330994121,5cyclictest6058-21processes06:11:033
1330994111,9cyclictest7850irq/56-dwc_otg_08:35:403
133099411,16cyclictest39-21ksoftirqd/307:11:063
133099407,23cyclictest0-21swapper/309:20:523
133099406,16cyclictest7950irq/56-dwc_otg_07:31:043
133099405,17cyclictest7950irq/56-dwc_otg_09:46:243
1330994024,4cyclictest0-21swapper/304:50:393
132699405,19cyclictest7950irq/56-dwc_otg_09:30:382
132299402,3cyclictest7750irq/56-dwc_otg07:15:481
132299402,3cyclictest7750irq/56-dwc_otg07:15:481
1322994021,9cyclictest31793-21/usr/sbin/munin08:51:031
159632390,6sleep1132299cyclictest06:34:161
153932391,33sleep115480-21ssh07:51:031
133099395,23cyclictest14534-21ssh07:50:473
1330993917,9cyclictest7850irq/56-dwc_otg_08:30:043
1326993911,10cyclictest917-21snmpd06:05:512
1322993922,4cyclictest21-21rcuc/108:16:001
1322993919,5cyclictest23-21ksoftirqd/109:20:531
133099387,21cyclictest0-21swapper/306:45:523
133099387,21cyclictest0-21swapper/306:45:523
1330993817,13cyclictest0-21swapper/307:20:523
1326993818,4cyclictest17862-21aten_rbpower_en05:15:532
132299382,7cyclictest0-21swapper/108:55:511
132299382,7cyclictest0-21swapper/108:55:511
1322993818,6cyclictest12392-21diskmemload07:41:021
1322993814,4cyclictest7850irq/56-dwc_otg_09:10:511
302212370,2sleep20-21swapper/208:09:392
302212370,2sleep20-21swapper/208:09:392
133099379,17cyclictest0-21swapper/309:50:533
133099377,22cyclictest0-21swapper/306:25:523
133099377,15cyclictest7950irq/56-dwc_otg_08:13:263
133099372,24cyclictest0-21swapper/307:55:523
1330993718,4cyclictest7750irq/56-dwc_otg05:10:563
1330993716,8cyclictest7950irq/56-dwc_otg_09:59:583
132699378,5cyclictest8549-21ssh09:40:512
132699377,21cyclictest0-21swapper/207:30:512
132699375,22cyclictest0-21swapper/204:30:502
1326993716,8cyclictest0-21swapper/207:26:062
1326993716,8cyclictest0-21swapper/207:26:062
132299378,14cyclictest7950irq/56-dwc_otg_08:40:381
1322993718,5cyclictest28460-21sh08:06:261
1322993718,5cyclictest28460-21sh08:06:261
132299371,7cyclictest19224-21irqstats07:55:581
133099367,24cyclictest0-21swapper/306:15:523
133099367,18cyclictest37-21rcuc/304:30:483
1330993618,6cyclictest7750irq/56-dwc_otg07:02:373
1330993614,8cyclictest7950irq/56-dwc_otg_08:41:413
1330993614,4cyclictest3504-21sh08:55:403
1330993614,4cyclictest3504-21sh08:55:403
133099361,22cyclictest7850irq/56-dwc_otg_08:15:503
132699364,5cyclictest0-21swapper/206:51:082
132699362,20cyclictest0-21swapper/205:01:062
1326993617,10cyclictest13717-21aten_rbpower_en07:10:522
132699361,25cyclictest0-21swapper/209:30:512
1322993625,7cyclictest21-21rcuc/107:30:481
132299361,6cyclictest7750irq/56-dwc_otg07:06:051
1322993614,4cyclictest14139-21sh07:50:381
132299361,25cyclictest0-21swapper/108:33:351
1322993611,13cyclictest31160-21basename08:10:521
299912351,3sleep10-21swapper/108:47:561
141312350,1sleep10-21swapper/109:07:481
133099358,5cyclictest4435-21sed06:06:053
133099351,3cyclictest7750irq/56-dwc_otg06:40:513
133099351,24cyclictest8400-21ls09:40:393
132699353,11cyclictest0-21swapper/205:55:492
1326993519,4cyclictest4350-21unixbench_multi04:36:062
1326993516,6cyclictest9809-21ssh07:05:552
1326993515,5cyclictest2918-21processes07:36:032
1326993514,7cyclictest20583-21fschecks_count09:15:562
1326993514,5cyclictest13425-21latency06:30:592
132699351,25cyclictest0-21swapper/206:40:512
1326993512,4cyclictest4850-21if_eth009:35:582
132299358,3cyclictest0-21swapper/108:21:071
132299357,12cyclictest0-21swapper/108:02:261
132299355,20cyclictest25025-21/usr/sbin/munin05:36:011
132299354,13cyclictest2047-21/usr/sbin/munin07:35:561
132299353,3cyclictest7950irq/56-dwc_otg_06:20:521
132299352,23cyclictest5678-21ls04:40:581
1322993512,7cyclictest25712-21idleruntime-cro07:25:381
1322993512,11cyclictest2957-21ssh09:33:411
1322993511,6cyclictest26500-21fschecks_time07:25:561
1322993511,6cyclictest26500-21fschecks_time07:25:561
133099348,10cyclictest7950irq/56-dwc_otg_06:51:043
133099345,21cyclictest37-21rcuc/309:31:143
133099343,4cyclictest0-21swapper/305:26:073
133099342,16cyclictest381ktimersoftd/307:25:423
133099342,16cyclictest381ktimersoftd/307:25:423
133099342,14cyclictest7950irq/56-dwc_otg_05:54:593
133099341,24cyclictest25892-21ls05:36:033
133099341,18cyclictest28643-21ls05:45:383
133099341,15cyclictest39-21ksoftirqd/309:17:563
132699348,17cyclictest0-21swapper/209:01:462
132699347,24cyclictest0-21swapper/205:30:512
132699342,14cyclictest1571350http09:10:382
132699341,16cyclictest0-21swapper/205:45:532
132299346,9cyclictest7850irq/56-dwc_otg_06:10:511
132299344,7cyclictest7750irq/56-dwc_otg06:26:061
132299342,3cyclictest0-21swapper/109:50:531
132299341,6cyclictest20779-21sed05:21:071
132299341,4cyclictest1886-21missed_timers06:56:001
1322993410,8cyclictest0-21swapper/108:44:461
100272340,1sleep10-21swapper/109:41:261
33322330,1sleep10-21swapper/106:05:381
133099339,9cyclictest7750irq/56-dwc_otg08:33:093
133099332,22cyclictest0-21swapper/308:06:013
133099332,22cyclictest0-21swapper/308:06:013
133099332,18cyclictest0-21swapper/306:55:493
1330993317,6cyclictest7750irq/56-dwc_otg07:07:523
1330993314,5cyclictest23709-21kworker/3:209:40:543
132699339,3cyclictest0-21swapper/206:38:152
132699339,14cyclictest0-21swapper/206:20:532
132699336,10cyclictest0-21swapper/205:35:562
132699335,19cyclictest19422-21ssh08:35:512
132699334,5cyclictest7850irq/56-dwc_otg_05:11:062
132699333,6cyclictest7750irq/56-dwc_otg08:41:062
132699333,14cyclictest908-21runrttasks06:27:392
1326993325,5cyclictest2468-21grep06:56:072
132699331,4cyclictest18734-21ssh07:55:522
132699331,23cyclictest0-21swapper/208:50:272
1326993312,13cyclictest11284-21switchtime07:46:032
132299339,9cyclictest7950irq/56-dwc_otg_09:45:521
132299339,11cyclictest0-21swapper/109:01:311
132299338,5cyclictest7950irq/56-dwc_otg_05:31:061
132299336,15cyclictest7950irq/56-dwc_otg_05:00:521
132299335,17cyclictest0-21swapper/106:45:531
132299335,17cyclictest0-21swapper/106:45:531
132299334,16cyclictest0-21swapper/104:45:481
1322993317,5cyclictest23-21ksoftirqd/104:35:381
132299331,5cyclictest7750irq/56-dwc_otg05:20:381
1322993315,9cyclictest0-21swapper/106:42:431
1322993311,5cyclictest0-21swapper/104:35:581
133099326,5cyclictest7850irq/56-dwc_otg_05:46:063
133099324,10cyclictest7850irq/56-dwc_otg_09:10:573
133099322,8cyclictest37-21rcuc/306:36:543
1326993223,5cyclictest31-21ksoftirqd/208:15:512
132699321,20cyclictest12958-21grep09:45:562
1326993211,8cyclictest12392-21diskmemload09:21:572
1326993211,4cyclictest0-21swapper/208:01:052
132299326,14cyclictest0-21swapper/105:55:511
132299324,26cyclictest7950irq/56-dwc_otg_09:55:481
1322993218,4cyclictest22357-21sh09:17:311
1322993211,4cyclictest0-21swapper/108:29:251
1322993210,6cyclictest21-21rcuc/105:05:441
132699319,4cyclictest0-21swapper/208:55:382
132699312,7cyclictest20722-21latency_hist09:55:392
132699312,4cyclictest20935-21apt-get09:55:482
132699312,2cyclictest0-21swapper/205:50:512
1326993118,7cyclictest7850irq/56-dwc_otg_06:48:302
1326993118,7cyclictest7850irq/56-dwc_otg_06:48:302
132699311,4cyclictest0-21swapper/208:21:542
1326993112,4cyclictest19783-21sh07:17:212
1326993112,4cyclictest19783-21sh07:17:212
132699311,18cyclictest0-21swapper/205:25:592
1326993111,4cyclictest5382-21basename06:10:532
132299316,12cyclictest7950irq/56-dwc_otg_05:26:071
132299315,4cyclictest7950irq/56-dwc_otg_05:10:501
132299315,4cyclictest7750irq/56-dwc_otg05:51:011
132299312,7cyclictest27420-21memory05:40:581
132299311,6cyclictest2907650ssh09:25:591
132299311,5cyclictest7750irq/56-dwc_otg06:05:501
133099307,15cyclictest7950irq/56-dwc_otg_05:55:513
133099305,5cyclictest7850irq/56-dwc_otg_05:00:383
1326993013,6cyclictest1772-21aten_rbpower_po06:00:502
132699301,22cyclictest0-21swapper/205:21:022
132699301,21cyclictest0-21swapper/204:55:212
1322993014,5cyclictest221ktimersoftd/106:16:021
4492296,11sleep20-21swapper/204:26:042
133099296,8cyclictest39-21ksoftirqd/304:41:143
133099296,6cyclictest18972-21unixbench_singl05:16:073
132699295,6cyclictest31-21ksoftirqd/204:50:372
132299296,6cyclictest7750irq/56-dwc_otg05:45:591
1322992913,5cyclictest11816-21seq04:57:471
7242283,15sleep10-21swapper/104:26:351
133099289,4cyclictest23579-21idleruntime05:30:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional