You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 06:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Mon Sep 07, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3258823500,5sleep132592-21fschecks_count19:05:351
39222520,2sleep00-21swapper/019:05:380
1694521800,2sleep0169599cyclictest00:30:400
1695991195,101cyclictest0-21swapper/021:05:220
169599958,25cyclictest0-21swapper/019:25:300
276552930,2sleep227644-21ssh22:45:422
169599902,45cyclictest25306-21taskset20:15:280
48232850,2sleep20-21swapper/222:18:402
93742820,2sleep20-21swapper/223:42:152
169599811,53cyclictest0-21swapper/000:20:300
223782790,2sleep122379-21expr21:20:421
105662790,2sleep1170099cyclictest23:44:271
169599741,28cyclictest14934-21ssh23:10:300
93092720,1sleep20-21swapper/223:03:092
93092720,1sleep20-21swapper/223:03:092
169599722,4cyclictest7950irq/56-dwc_otg_00:05:300
1695996949,5cyclictest19649-21grep22:35:460
169599691,2cyclictest0-21swapper/021:28:270
169599671,51cyclictest3171950ssh23:30:350
159882670,2sleep20-21swapper/221:13:462
169599662,53cyclictest0-21swapper/023:50:350
169599651,51cyclictest18224-21ssh22:35:170
265742630,3sleep013-21rcuc/023:24:330
169599631,43cyclictest9387-21latency_hist21:45:170
169599621,9cyclictest0-21swapper/019:40:320
169599612,50cyclictest0-21swapper/022:25:420
169599612,50cyclictest0-21swapper/022:25:420
169599611,41cyclictest20340-21unixbench_singl23:15:470
169599611,41cyclictest10062-21unixbench_multi19:30:460
1695996038,6cyclictest13616-21latency_hist21:50:180
1695996012,25cyclictest17667-21cat21:55:170
1702995915,7cyclictest7950irq/56-dwc_otg_22:00:272
1702995915,7cyclictest7950irq/56-dwc_otg_22:00:272
169599592,44cyclictest0-21swapper/019:50:230
169599592,37cyclictest0-21swapper/022:55:390
1695995923,13cyclictest0-21swapper/000:15:280
169599591,41cyclictest6692-21missed_timers22:20:380
169599591,41cyclictest1172-21unixbench_multi20:35:450
13572593,14sleep20-21swapper/219:09:212
169599582,36cyclictest7434-21wget20:55:320
169599581,44cyclictest31197-21uniq22:50:370
169599581,34cyclictest26755-21ssh22:45:290
1703995730,7cyclictest39-21ksoftirqd/322:30:393
169599572,45cyclictest0-21swapper/022:40:400
169599572,40cyclictest0-21swapper/020:52:140
169599571,41cyclictest24561-21sh00:00:410
233112560,5sleep1170099cyclictest00:00:051
1695995632,12cyclictest0-21swapper/021:23:090
1695995630,4cyclictest18516-21grep21:15:570
1695995628,13cyclictest7750irq/56-dwc_otg00:35:440
169599561,41cyclictest0-21swapper/019:10:410
169599561,40cyclictest1180-21runrttasks21:12:460
283542550,2sleep20-21swapper/223:25:442
178072550,2sleep10-21swapper/100:31:211
170099557,41cyclictest7950irq/56-dwc_otg_23:10:301
169599559,3cyclictest0-21swapper/019:25:170
169599557,35cyclictest10943-21aten_rbpower_vo23:05:320
1695995535,5cyclictest7750irq/56-dwc_otg23:55:360
169599552,38cyclictest0-21swapper/021:55:180
169599551,34cyclictest22282-21ntpq20:05:400
169599542,43cyclictest0-21swapper/000:10:180
169599542,43cyclictest0-21swapper/000:10:180
1695995424,19cyclictest20846-21grep20:00:460
1695995424,19cyclictest20846-21grep20:00:460
169599542,40cyclictest0-21swapper/020:45:370
169599542,40cyclictest0-21swapper/020:41:470
169599541,42cyclictest3783-21fschecks_count19:15:340
1695995331,6cyclictest7850irq/56-dwc_otg_23:40:160
169599532,33cyclictest14407-21aten_rbpower_cu19:45:300
169599523,46cyclictest4336-21kworker/0:123:01:520
169599523,46cyclictest4336-21kworker/0:123:01:520
169599522,29cyclictest520-21rs:main0
169599521,39cyclictest0-21swapper/022:15:330
169599521,37cyclictest0-21swapper/000:25:360
169599512,25cyclictest0-21swapper/021:35:180
1702995033,8cyclictest681-21ssh00:10:452
1702995033,8cyclictest681-21ssh00:10:452
1702995011,3cyclictest7850irq/56-dwc_otg_20:50:282
1700995027,5cyclictest22610-21aten_rbpower_en22:40:321
1700995024,8cyclictest7950irq/56-dwc_otg_21:15:311
1695995025,6cyclictest30480-21sh20:30:170
1695995025,6cyclictest30480-21sh20:30:170
169599501,41cyclictest0-21swapper/023:27:110
169599501,35cyclictest11427-21ntpq19:35:390
169599501,29cyclictest23757-21grep20:10:340
169599491,35cyclictest0-21swapper/020:33:330
170099486,5cyclictest7750irq/56-dwc_otg22:10:311
169599482,34cyclictest0-21swapper/022:06:310
169599482,33cyclictest0-21swapper/020:20:240
169599482,17cyclictest8423-21ssh23:40:460
1695994811,19cyclictest509-21cron23:50:170
170399471,16cyclictest37-21rcuc/323:10:163
170299474,5cyclictest0-21swapper/219:40:312
1702994718,8cyclictest7950irq/56-dwc_otg_21:15:292
1695994730,5cyclictest7850irq/56-dwc_otg_21:00:300
169599471,29cyclictest0-21swapper/022:00:300
169599471,29cyclictest0-21swapper/022:00:300
170299467,25cyclictest0-21swapper/219:25:302
170099467,26cyclictest0-21swapper/120:40:301
170099467,26cyclictest0-21swapper/100:10:221
170099467,26cyclictest0-21swapper/100:10:221
169599462,31cyclictest0-21swapper/019:57:290
1703994539,4cyclictest37-21rcuc/321:50:323
1703994538,5cyclictest12060-21ssh00:25:313
170299457,25cyclictest0-21swapper/221:05:232
170099456,25cyclictest0-21swapper/121:05:221
170099453,10cyclictest7750irq/56-dwc_otg23:15:321
170099451,25cyclictest0-21swapper/120:05:311
88162440,5sleep1170099cyclictest00:20:421
170099447,23cyclictest0-21swapper/119:30:321
170099444,25cyclictest0-21swapper/120:10:221
170099442,7cyclictest0-21swapper/119:15:301
169599442,30cyclictest0-21swapper/022:10:270
170099433,11cyclictest0-21swapper/100:25:291
1700994311,19cyclictest7750irq/56-dwc_otg20:50:411
33672420,2sleep30-21swapper/319:15:173
170099428,19cyclictest221ktimersoftd/123:50:081
1700994212,18cyclictest26024-21sh22:05:231
1700994212,14cyclictest7750irq/56-dwc_otg22:30:321
170399416,2cyclictest0-21swapper/322:35:303
170299412,6cyclictest7750irq/56-dwc_otg20:10:312
170099416,29cyclictest7950irq/56-dwc_otg_23:05:291
170099416,26cyclictest0-21swapper/122:50:331
1700994133,5cyclictest18844-21ls19:55:431
1700994118,7cyclictest7750irq/56-dwc_otg20:25:391
1700994118,7cyclictest7750irq/56-dwc_otg20:25:391
1700994111,16cyclictest7850irq/56-dwc_otg_23:01:501
1700994111,16cyclictest7850irq/56-dwc_otg_23:01:501
1700994110,11cyclictest7750irq/56-dwc_otg21:45:361
1703994020,13cyclictest39-21ksoftirqd/322:59:103
170399401,25cyclictest13174-21runrttasks21:49:543
170299401,5cyclictest7950irq/56-dwc_otg_23:55:292
170099404,28cyclictest7950irq/56-dwc_otg_22:20:301
170399392,16cyclictest0-21swapper/323:05:183
170399392,16cyclictest0-21swapper/323:05:183
170399391,24cyclictest7950irq/56-dwc_otg_22:09:313
1703993910,3cyclictest0-21swapper/323:55:573
1702993922,7cyclictest7950irq/56-dwc_otg_21:30:412
170299392,22cyclictest7950irq/56-dwc_otg_21:40:442
170099393,13cyclictest7750irq/56-dwc_otg22:36:101
1700993924,11cyclictest7950irq/56-dwc_otg_21:25:281
1700993914,10cyclictest7850irq/56-dwc_otg_21:37:391
170099391,23cyclictest0-21swapper/121:00:311
24692380,1sleep20-21swapper/223:34:422
1703993825,10cyclictest21623-21cron22:00:173
170299382,19cyclictest31013-21ssh22:10:432
1702993814,7cyclictest0-21swapper/221:35:402
170099385,10cyclictest7750irq/56-dwc_otg19:25:391
170099383,17cyclictest7950irq/56-dwc_otg_23:30:211
39932370,4sleep123-21ksoftirqd/122:55:591
170399377,22cyclictest0-21swapper/319:30:323
170399374,12cyclictest37-21rcuc/321:20:323
1703993722,6cyclictest39-21ksoftirqd/319:55:373
1703993718,5cyclictest7850irq/56-dwc_otg_23:15:323
170099379,13cyclictest7950irq/56-dwc_otg_20:20:301
170099378,6cyclictest21-21rcuc/100:07:101
170099372,15cyclictest7950irq/56-dwc_otg_19:40:171
1700993720,4cyclictest7750irq/56-dwc_otg19:20:331
1700993716,5cyclictest3264550wget20:35:321
1700993715,5cyclictest23425-21sh23:20:331
1700993713,13cyclictest7750irq/56-dwc_otg22:27:421
1700993713,13cyclictest7750irq/56-dwc_otg22:27:421
1700993712,13cyclictest221ktimersoftd/100:38:331
170099371,17cyclictest7950irq/56-dwc_otg_19:50:311
281122360,2sleep30-21swapper/323:25:413
170399366,7cyclictest7750irq/56-dwc_otg22:15:453
170399365,18cyclictest37-21rcuc/323:10:443
170399364,3cyclictest0-21swapper/321:30:333
170399362,24cyclictest0-21swapper/320:18:443
1703993614,5cyclictest39-21ksoftirqd/300:35:393
1703993611,17cyclictest0-21swapper/323:30:183
170299365,25cyclictest11380-21ssh23:45:302
170099365,5cyclictest30904-21grep21:30:471
170099365,13cyclictest7950irq/56-dwc_otg_22:45:451
1700993613,8cyclictest7950irq/56-dwc_otg_21:12:451
170099361,14cyclictest7750irq/56-dwc_otg23:53:051
170399357,5cyclictest32129-21ssh00:10:313
170399357,5cyclictest32129-21ssh00:10:313
170399356,16cyclictest39-21ksoftirqd/323:24:333
170399353,4cyclictest7950irq/56-dwc_otg_21:40:303
170399352,23cyclictest10915-21ntp_kernel_pll_22:25:403
170399352,23cyclictest10915-21ntp_kernel_pll_22:25:403
1703993513,5cyclictest12591-21diskmemload00:05:223
170399351,14cyclictest39-21ksoftirqd/300:21:183
170299358,6cyclictest10191-21aten_rbpower_cu22:25:302
170299358,6cyclictest10191-21aten_rbpower_cu22:25:302
170099359,4cyclictest0-21swapper/122:15:281
170099357,15cyclictest0-21swapper/100:00:321
170099356,16cyclictest0-21swapper/119:45:291
1700993519,5cyclictest9450irq/48-DMA08:56:171
1700993512,8cyclictest7850irq/56-dwc_otg_00:15:461
170099351,13cyclictest0-21swapper/120:15:301
1700993510,11cyclictest7950irq/56-dwc_otg_20:32:221
170399346,16cyclictest247792sleep320:11:573
170399342,22cyclictest16564-21timerandwakeup23:50:453
170399341,26cyclictest0-21swapper/319:50:303
170299347,3cyclictest0-21swapper/200:18:442
170299347,11cyclictest7850irq/56-dwc_otg_00:25:412
170299346,19cyclictest7750irq/56-dwc_otg23:10:422
1702993419,5cyclictest17301-21sh23:51:362
1702993413,6cyclictest301ktimersoftd/222:23:152
170299341,23cyclictest6938-21ls23:40:172
170099347,13cyclictest7950irq/56-dwc_otg_19:15:171
170099345,13cyclictest7850irq/56-dwc_otg_23:38:491
1700993415,5cyclictest7950irq/56-dwc_otg_21:50:331
1700993414,4cyclictest7750irq/56-dwc_otg22:02:401
1700993414,4cyclictest7750irq/56-dwc_otg22:02:401
170399334,19cyclictest39-21ksoftirqd/323:35:593
1703993320,7cyclictest381ktimersoftd/321:10:403
1703993315,12cyclictest39-21ksoftirqd/322:50:363
1703993314,10cyclictest7950irq/56-dwc_otg_00:15:363
170399331,11cyclictest39-21ksoftirqd/322:10:453
170299337,12cyclictest7850irq/56-dwc_otg_21:20:372
170299332,4cyclictest29-21rcuc/200:30:292
1702993318,5cyclictest2741-21/usr/sbin/munin20:40:422
170299331,3cyclictest0-21swapper/200:00:482
170299331,20cyclictest28303-21ls00:05:372
170099338,4cyclictest0-21swapper/123:25:371
1700993312,9cyclictest221ktimersoftd/120:50:171
1700993311,11cyclictest221ktimersoftd/121:56:001
170099331,10cyclictest5857-21fschecks_time21:40:361
170399328,8cyclictest7950irq/56-dwc_otg_19:20:313
170399328,6cyclictest7950irq/56-dwc_otg_22:00:333
170399328,6cyclictest7950irq/56-dwc_otg_22:00:333
170399326,16cyclictest381ktimersoftd/320:20:333
170399322,20cyclictest0-21swapper/323:43:043
170399322,20cyclictest0-21swapper/321:04:323
1703993213,5cyclictest37-21rcuc/320:33:423
170399321,24cyclictest0-21swapper/321:25:343
170399321,16cyclictest39-21ksoftirqd/319:25:313
170399321,15cyclictest39-21ksoftirqd/321:40:173
170399321,15cyclictest39-21ksoftirqd/300:34:153
170299329,10cyclictest0-21swapper/222:31:372
170299326,16cyclictest0-21swapper/223:05:312
1702993223,7cyclictest25659-21aten_rbpower_en21:25:312
170299321,6cyclictest18607-21ntp_kernel_pll_21:55:392
1702993214,7cyclictest9550irq/80-mmc022:45:172
1702993214,6cyclictest7950irq/56-dwc_otg_22:36:132
170299321,3cyclictest7950irq/56-dwc_otg_20:15:372
170299321,17cyclictest5393-21aten_rbpower_cu19:20:292
1702993211,5cyclictest9224-21fschecks_count19:30:352
170299321,15cyclictest7750irq/56-dwc_otg22:05:312
1702993210,9cyclictest0-21swapper/223:20:302
118272320,2sleep20-21swapper/221:47:242
170399319,10cyclictest0-21swapper/322:46:563
170399315,5cyclictest7750irq/56-dwc_otg00:00:413
170399314,18cyclictest15493-21grep19:45:443
170399313,18cyclictest21521-21latency_hist20:05:183
170399313,18cyclictest21521-21latency_hist20:05:183
170399311,5cyclictest0-21swapper/322:23:443
170399311,17cyclictest39-21ksoftirqd/320:25:373
170399311,17cyclictest39-21ksoftirqd/320:25:373
1703993111,6cyclictest0-21swapper/320:50:283
1703993110,6cyclictest0-21swapper/319:40:333
170299319,10cyclictest21982-21ssh23:18:412
170299318,4cyclictest7850irq/56-dwc_otg_00:40:172
170299318,4cyclictest0-21swapper/200:20:392
170299315,12cyclictest7850irq/56-dwc_otg_19:15:382
170299312,5cyclictest731-21/usr/sbin/munin20:35:392
170099312,8cyclictest0-21swapper/120:00:421
170099312,8cyclictest0-21swapper/120:00:421
170099311,8cyclictest13668-21sed19:40:481
170399308,11cyclictest7950irq/56-dwc_otg_21:05:383
170399305,16cyclictest7950irq/56-dwc_otg_21:15:343
170399303,5cyclictest39-21ksoftirqd/319:36:243
1703993024,4cyclictest7950irq/56-dwc_otg_22:43:383
170399302,18cyclictest0-21swapper/323:47:153
170399301,7cyclictest7750irq/56-dwc_otg19:15:353
170299307,14cyclictest0-21swapper/220:20:322
170299304,23cyclictest19956-21cpuspeed20:00:332
170299304,23cyclictest19956-21cpuspeed20:00:332
170299304,11cyclictest7850irq/56-dwc_otg_20:05:442
1702993017,4cyclictest31373-21if_wlan022:50:392
1702993012,5cyclictest2644-21ls19:10:432
170299301,20cyclictest3195-21ssh22:55:382
169242300,2sleep20-21swapper/221:54:122
170399298,8cyclictest37-21rcuc/320:47:323
170399297,5cyclictest39-21ksoftirqd/320:55:433
170399291,6cyclictest0-21swapper/320:40:513
170399291,10cyclictest0-21swapper/320:36:073
170299298,5cyclictest0-21swapper/220:55:342
170299291,5cyclictest14660-21cut19:45:332
170299288,4cyclictest32330-21latency_hist20:35:162
170299284,12cyclictest7950irq/56-dwc_otg_19:38:282
170299283,5cyclictest7950irq/56-dwc_otg_21:00:352
170299281,5cyclictest0-21swapper/219:50:402
170399273,4cyclictest7950irq/56-dwc_otg_20:08:013
13472279,12sleep30-21swapper/319:09:143
170299265,3cyclictest0-21swapper/219:55:442
170299262,5cyclictest7950irq/56-dwc_otg_20:45:432
170299255,4cyclictest7750irq/56-dwc_otg20:25:442
170299255,4cyclictest7750irq/56-dwc_otg20:25:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional