You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 09:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Fri Sep 11, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
160421400,2sleep02710099cyclictest21:44:180
160421400,2sleep02710099cyclictest21:44:180
27100991263,104cyclictest0-21swapper/021:25:420
1203221120,3sleep22710299cyclictest22:35:372
27100991094,78cyclictest0-21swapper/021:10:460
2298421020,2sleep30-21swapper/322:10:183
27100999817,54cyclictest101ktimersoftd/021:20:430
2710099954,51cyclictest13-21rcuc/022:25:320
2710299932,63cyclictest15053-21ssh21:20:462
93032920,6sleep22710299cyclictest21:53:182
27100998916,39cyclictest101ktimersoftd/023:10:320
227932890,3sleep20-21swapper/223:27:472
2710299873,78cyclictest19030-21missed_timers21:25:422
27101998630,26cyclictest7850irq/56-dwc_otg_21:10:421
114212850,5sleep22710299cyclictest21:55:392
2710299773,67cyclictest7104-21timerwakeupswit21:10:472
2710299721,54cyclictest12628-21ssh21:17:592
2710199725,15cyclictest23-21ksoftirqd/121:25:401
2710099712,54cyclictest0-21swapper/019:10:310
27102997014,40cyclictest0-21swapper/221:42:392
27102997014,40cyclictest0-21swapper/221:42:392
27102996816,14cyclictest7850irq/56-dwc_otg_22:40:322
2710099681,50cyclictest11406-21ssh22:35:190
2710099681,47cyclictest0-21swapper/023:50:440
45142670,2sleep10-21swapper/100:24:471
2710299661,43cyclictest27990-21/usr/sbin/munin20:40:382
326632650,2sleep20-21swapper/200:19:292
2710299651,59cyclictest31717-21apt-get22:20:302
2710299651,51cyclictest9446-21ssh23:10:552
2710299651,46cyclictest16141-21ssh23:59:292
2710299651,45cyclictest7950irq/56-dwc_otg_22:10:162
2710299651,42cyclictest30053-21ssh22:18:052
2710399648,34cyclictest7950irq/56-dwc_otg_21:20:463
2710299644,39cyclictest4736-21ssh23:05:432
2710299642,43cyclictest15922-21/usr/sbin/munin20:05:492
2710299642,43cyclictest15922-21/usr/sbin/munin20:05:492
2710299641,51cyclictest6120-21ssh22:28:222
2710299641,45cyclictest16891-21ssh22:01:542
2710299641,44cyclictest9740-21ssh22:32:252
2710299641,44cyclictest11586-21ssh23:53:532
2710099646,48cyclictest0-21swapper/000:05:320
2710099642,52cyclictest0-21swapper/000:35:330
2710299631,50cyclictest12596-21apt-get20:00:252
2710299631,50cyclictest12596-21apt-get20:00:252
2710399623,8cyclictest0-21swapper/321:10:513
2710299621,58cyclictest8893-21ssh00:30:132
2710299621,47cyclictest5575-21ls23:45:462
2710299621,41cyclictest2253-21ssh23:02:492
27100996218,41cyclictest26667-21unixbench_multi20:35:470
27100996145,5cyclictest12741-21apt-config20:00:190
2710099611,49cyclictest0-21swapper/021:53:030
2710099611,45cyclictest5209-21cut00:25:330
2710299601,40cyclictest18540-21ssh23:22:322
27102996012,30cyclictest0-21swapper/200:02:592
27100996028,9cyclictest0-21swapper/019:20:290
2710099602,43cyclictest0-21swapper/020:05:190
2710099602,43cyclictest0-21swapper/020:05:190
2710299591,48cyclictest29840-21ssh21:39:092
2710299591,42cyclictest1907-21/usr/sbin/munin19:30:402
2710299591,40cyclictest14232-21ssh23:17:132
2710299591,36cyclictest12679-21apt-config20:00:192
27100995947,6cyclictest0-21swapper/020:45:300
27100995933,14cyclictest7850irq/56-dwc_otg_00:15:200
27100995933,14cyclictest7850irq/56-dwc_otg_00:15:200
27100995913,17cyclictest0-21swapper/022:45:310
112572590,4sleep10-21swapper/100:32:001
2710299588,18cyclictest7750irq/56-dwc_otg00:10:322
2710299588,18cyclictest7750irq/56-dwc_otg00:10:322
2710299581,45cyclictest10882-21ssh00:31:182
2710299581,40cyclictest27257-21taskset22:54:202
2710299581,39cyclictest31915-21ssh23:00:182
27101995812,15cyclictest221ktimersoftd/121:20:451
2710099582,53cyclictest0-21swapper/023:30:340
2710099581,46cyclictest0-21swapper/022:40:370
289342570,2sleep10-21swapper/119:15:291
2710299571,43cyclictest32480-21latency_hist19:25:192
2710299571,41cyclictest32048-21ssh23:39:372
2710299571,37cyclictest23306-21ssh00:07:282
27100995735,14cyclictest20462-21grep23:25:320
2710099572,46cyclictest0-21swapper/023:59:010
2710299566,37cyclictest0-21swapper/223:45:002
2710299566,37cyclictest0-21swapper/223:45:002
2710299564,38cyclictest0-21swapper/200:36:352
2710299561,51cyclictest3545-21rm00:22:592
2710299561,43cyclictest24486-21ssh23:30:292
2710099569,36cyclictest0-21swapper/019:45:320
27100995633,6cyclictest2404-21wget21:00:320
2710099562,38cyclictest0-21swapper/022:16:420
2710099561,43cyclictest0-21swapper/021:15:370
27103995510,17cyclictest6630-21ssh21:50:303
2710299551,39cyclictest24349-21rm21:31:512
2710299551,39cyclictest24349-21rm21:31:512
2710299551,35cyclictest30480-21/usr/sbin/munin20:45:482
27100995536,4cyclictest32079-21cat23:00:190
27100995533,6cyclictest7850irq/56-dwc_otg_20:30:300
27100995532,13cyclictest0-21swapper/021:30:470
27100995532,13cyclictest0-21swapper/021:30:470
2710099552,38cyclictest0-21swapper/022:50:400
2710299543,7cyclictest7750irq/56-dwc_otg21:05:312
2710299541,49cyclictest4554-21sh21:47:072
2710299541,49cyclictest16550-21apt-get20:10:312
2710299541,38cyclictest29046-21aten_rbpower_vo19:15:322
2710299541,36cyclictest0-21swapper/220:19:152
2710099542,37cyclictest0-21swapper/019:35:280
2710099541,40cyclictest0-21swapper/023:20:320
2710099541,40cyclictest0-21swapper/000:30:400
2710099541,38cyclictest3043-21ssh22:25:180
2710299531,44cyclictest3804-21taskset21:04:552
2710099536,30cyclictest9-21ksoftirqd/000:04:580
2710099532,39cyclictest0-21swapper/021:07:520
2710099532,38cyclictest0-21swapper/019:19:550
2710099531,5cyclictest7950irq/56-dwc_otg_21:55:310
2710299521,48cyclictest23767-21/usr/sbin/munin20:30:362
2710299521,47cyclictest0-21swapper/219:25:442
2710299521,37cyclictest21477-21ssh22:46:162
2710299521,33cyclictest32355-21taskset20:51:262
2710099523,12cyclictest0-21swapper/022:05:300
27100995228,8cyclictest12329-21cat22:35:410
2710099522,38cyclictest0-21swapper/020:15:400
27100995218,28cyclictest0-21swapper/020:50:410
2710099521,42cyclictest673-21idleruntime-cro00:20:180
2710099521,37cyclictest15439-21kworker/u8:123:05:370
2710099521,35cyclictest0-21swapper/020:05:310
2710099521,35cyclictest0-21swapper/020:05:310
2710099521,34cyclictest0-21swapper/000:20:330
27103995114,10cyclictest7950irq/56-dwc_otg_21:25:403
2710299511,47cyclictest8502-21/usr/sbin/munin19:45:462
2710299511,47cyclictest0-21swapper/220:20:352
2710299511,40cyclictest0-21swapper/219:11:532
2710299511,36cyclictest7950irq/56-dwc_otg_20:35:252
27101995123,5cyclictest27944-21if_wlan022:15:361
2710099514,8cyclictest0-21swapper/019:25:390
27100995141,7cyclictest0-21swapper/023:40:320
27100995141,7cyclictest0-21swapper/023:40:320
27100995132,9cyclictest11662sleep020:55:430
27100995125,18cyclictest9441-21fschecks_time19:50:360
2710099512,37cyclictest2493-21cat19:30:390
2710099511,42cyclictest0-21swapper/021:45:390
2710099511,39cyclictest0-21swapper/019:45:100
2710099511,37cyclictest0-21swapper/023:45:350
2710299501,44cyclictest23399-21aten_rbpower_en22:10:332
2710099505,20cyclictest0-21swapper/023:00:470
27100995038,5cyclictest7850irq/56-dwc_otg_22:10:410
2710099502,35cyclictest0-21swapper/020:20:490
2710099501,36cyclictest0-21swapper/023:20:190
229442500,1sleep30-21swapper/322:48:593
2710299491,44cyclictest22685-21awk20:25:422
2710299491,44cyclictest1135-21/usr/sbin/munin20:55:412
2710099491,37cyclictest0-21swapper/023:35:320
2710299481,31cyclictest1180-21runrttasks19:51:552
27100994824,14cyclictest22576-21missed_timers20:25:390
2710099481,35cyclictest0-21swapper/020:10:360
2710099481,32cyclictest0-21swapper/021:35:470
2710299471,31cyclictest5152-21runrttasks19:38:462
2710199476,26cyclictest0-21swapper/119:20:311
2710099473,31cyclictest16246-21unixbench_singl22:00:490
27102994615,26cyclictest0-21swapper/219:40:462
2710199467,24cyclictest0-21swapper/120:30:321
2710099461,31cyclictest28100-21grep20:40:400
27103994524,5cyclictest29947-21grep23:35:483
2710199452,5cyclictest7850irq/56-dwc_otg_22:20:311
254562452,35sleep00-21swapper/019:05:400
2710199445,25cyclictest23361-21ssh22:10:321
27101994411,23cyclictest0-21swapper/123:55:341
27103994323,7cyclictest5692-21latency_hist21:10:193
2710199439,10cyclictest0-21swapper/123:11:571
27101994315,4cyclictest0-21swapper/100:15:391
2710199427,25cyclictest0-21swapper/121:30:321
2710199427,25cyclictest0-21swapper/121:30:321
27103994110,20cyclictest0-21swapper/320:05:493
27103994110,20cyclictest0-21swapper/320:05:493
2710399407,23cyclictest0-21swapper/321:30:323
2710399407,23cyclictest0-21swapper/321:30:323
2710399394,13cyclictest16955-21ssh00:00:323
2710199393,4cyclictest19912-21ssh22:45:311
27101993929,7cyclictest221ktimersoftd/120:55:311
2710399387,21cyclictest0-21swapper/322:00:333
2710399382,26cyclictest0-21swapper/320:47:313
2710199386,6cyclictest7750irq/56-dwc_otg22:00:191
2710399375,19cyclictest322-21ssh23:40:313
2710399375,19cyclictest322-21ssh23:40:313
27103993710,5cyclictest7850irq/56-dwc_otg_20:05:193
27103993710,5cyclictest7850irq/56-dwc_otg_20:05:193
2710199378,17cyclictest0-21swapper/120:00:251
2710199378,17cyclictest0-21swapper/120:00:251
2710199377,5cyclictest7750irq/56-dwc_otg23:30:191
2710199376,4cyclictest7750irq/56-dwc_otg19:35:331
2710199371,20cyclictest16273-21rm00:38:391
2710199371,19cyclictest8613-21ssh23:50:341
268782370,1sleep30-21swapper/322:53:383
2710399361,21cyclictest19681-21ssh22:45:203
27103993611,6cyclictest0-21swapper/319:30:463
27103993611,12cyclictest5656-21diskmemload23:07:393
2710199369,5cyclictest7750irq/56-dwc_otg23:40:351
2710199369,5cyclictest7750irq/56-dwc_otg23:40:351
2710199367,7cyclictest7850irq/56-dwc_otg_19:50:391
2710199363,3cyclictest0-21swapper/119:10:411
2710199363,24cyclictest5150-21ssh00:25:311
27101993627,5cyclictest221ktimersoftd/123:15:281
27101993617,5cyclictest3529-21sh23:05:111
2710199361,6cyclictest7950irq/56-dwc_otg_21:15:321
27101993615,10cyclictest27522-21ssh00:12:391
27101993615,10cyclictest27522-21ssh00:12:391
27101993614,5cyclictest7950irq/56-dwc_otg_21:05:471
153102360,6sleep12710199cyclictest22:00:381
94862350,3sleep39489-21idleruntime19:50:373
2710399357,5cyclictest7750irq/56-dwc_otg21:35:463
2710399357,15cyclictest0-21swapper/320:20:323
2710399355,6cyclictest7850irq/56-dwc_otg_21:50:193
2710399353,6cyclictest2281-21/usr/sbin/munin21:00:403
2710399352,4cyclictest0-21swapper/300:05:303
27103993514,6cyclictest0-21swapper/319:55:343
27103993511,5cyclictest7750irq/56-dwc_otg19:10:483
2710199358,5cyclictest7750irq/56-dwc_otg19:45:461
2710199357,6cyclictest7850irq/56-dwc_otg_22:50:441
2710199356,5cyclictest7850irq/56-dwc_otg_21:40:351
2710199356,5cyclictest7850irq/56-dwc_otg_21:40:351
2710199353,6cyclictest23-21ksoftirqd/100:05:311
2710199353,4cyclictest7850irq/56-dwc_otg_21:00:291
2710199352,7cyclictest7950irq/56-dwc_otg_21:50:311
27101993524,8cyclictest6302-21sh21:50:181
2710199352,18cyclictest0-21swapper/120:15:181
27101993515,5cyclictest27492-21/usr/sbin/munin20:40:391
2710399345,6cyclictest7750irq/56-dwc_otg20:40:473
2710399344,16cyclictest29629-21ssh00:15:353
2710399342,8cyclictest3758-21ssh23:05:203
2710399341,9cyclictest2997150ssh22:17:563
27103993416,6cyclictest31808-21sshd20:50:433
2710199346,6cyclictest7850irq/56-dwc_otg_22:30:441
2710199345,9cyclictest0-21swapper/123:35:341
2710199344,9cyclictest7850irq/56-dwc_otg_23:35:201
2710199343,13cyclictest26244-21ntp_kernel_err20:35:411
27101993424,7cyclictest23005-21munin-plugin-st22:10:181
2710199341,15cyclictest6352-21sh22:28:471
290192330,2sleep30-21swapper/300:15:193
290192330,2sleep30-21swapper/300:15:193
2710399338,7cyclictest7950irq/56-dwc_otg_22:10:433
2710399337,6cyclictest7850irq/56-dwc_otg_23:55:203
27103993313,4cyclictest498-21aten_rbpower_en20:55:333
2710399331,22cyclictest11260-21timerwakeupswit21:15:483
2710199339,5cyclictest0-21swapper/122:38:321
2710199333,15cyclictest7950irq/56-dwc_otg_20:30:201
2710199333,12cyclictest7850irq/56-dwc_otg_23:05:481
2710199333,10cyclictest7850irq/56-dwc_otg_20:50:421
27101993321,4cyclictest28124-21/usr/sbin/munin22:55:461
2710199331,21cyclictest6048-21ls19:40:381
2679723320,6sleep10-21swapper/119:09:541
2710399328,8cyclictest20188-21snmpd00:30:343
2710399326,14cyclictest7850irq/56-dwc_otg_22:35:493
2710399323,13cyclictest7850irq/56-dwc_otg_22:24:403
2710399322,6cyclictest988-21/usr/sbin/munin00:20:343
2710399321,7cyclictest37-21rcuc/319:15:453
2710399321,3cyclictest0-21swapper/322:57:433
2710399321,22cyclictest5669-21irqstats00:25:393
2710399321,10cyclictest5714-21sed23:45:473
27103993210,6cyclictest39-21ksoftirqd/323:30:393
2710199327,6cyclictest7750irq/56-dwc_otg20:05:471
2710199327,6cyclictest7750irq/56-dwc_otg20:05:471
2710199327,6cyclictest19454-21unixbench_multi20:15:481
2710199325,10cyclictest7750irq/56-dwc_otg19:35:191
2710199324,14cyclictest0-21swapper/122:40:401
2710199322,9cyclictest12742-21latency_hist20:00:191
27101993213,5cyclictest186072chrt23:22:391
27101993212,13cyclictest0-21swapper/123:46:201
2710199321,13cyclictest29296-21rm21:38:081
2710399318,5cyclictest7750irq/56-dwc_otg21:55:333
2710399312,4cyclictest7850irq/56-dwc_otg_19:25:453
27103993121,7cyclictest31167-21fschecks_time21:40:383
27103993121,7cyclictest31167-21fschecks_time21:40:383
2710399311,5cyclictest8816-21grep22:30:473
27103993111,3cyclictest0-21swapper/323:10:423
27103993110,4cyclictest13376-21latency23:55:413
2710199319,5cyclictest0-21swapper/100:00:411
27101993114,11cyclictest1180-21runrttasks20:21:431
2710399308,5cyclictest0-21swapper/323:25:323
2710399302,4cyclictest20188-21snmpd20:30:453
2710399301,4cyclictest4635-21unixbench_multi22:25:493
2710399301,3cyclictest7750irq/56-dwc_otg20:15:343
27103993010,5cyclictest7750irq/56-dwc_otg23:16:293
2710399298,4cyclictest0-21swapper/300:37:483
2710399296,5cyclictest7950irq/56-dwc_otg_20:10:403
2710399296,5cyclictest7850irq/56-dwc_otg_19:45:193
27103992920,6cyclictest16333-21basename23:20:323
2710399291,4cyclictest7850irq/56-dwc_otg_20:25:473
27103992912,4cyclictest30862-21aten_rbpower_vo19:20:323
2710399291,19cyclictest0-21swapper/320:38:263
2710199291,12cyclictest0-21swapper/120:45:321
2710399283,5cyclictest37-21rcuc/319:35:383
2710199286,5cyclictest7850irq/56-dwc_otg_19:25:311
265502277,13sleep20-21swapper/219:06:482
252612273,14sleep30-21swapper/319:05:233
27103992614,8cyclictest0-21swapper/319:45:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional