You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 04:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Jul 25, 2026 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
610625810,4sleep30-21swapper/319:05:403
7728991533,126cyclictest3565-21latency_hist22:50:250
7728991482,130cyclictest0-21swapper/022:34:540
7728991442,118cyclictest9131-21taskset00:15:490
7728991432,117cyclictest7761-21ls21:35:450
7728991423,119cyclictest0-21swapper/022:10:440
7728991403,113cyclictest0-21swapper/023:05:450
7728991382,113cyclictest25508-21sh23:15:590
7728991273,83cyclictest0-21swapper/000:05:380
7728991243,63cyclictest31488-21latency_hist22:05:240
7728991212,98cyclictest21323-21grep00:30:450
1938521210,4sleep0772899cyclictest19:40:460
7728991189,88cyclictest706-21/usr/sbin/munin23:25:490
77289911714,82cyclictest2166-21kworker/0:222:55:500
7728991163,93cyclictest0-21swapper/022:25:430
7728991142,85cyclictest11750-1kworker/u9:221:55:540
3167921130,2sleep20-21swapper/221:25:422
7729991104,34cyclictest0-21swapper/121:35:461
7728991095,67cyclictest0-21swapper/023:00:460
7728991073,62cyclictest12577-21ssh23:40:440
77299910510,15cyclictest7850irq/56-dwc_otg22:10:461
77299910210,24cyclictest27263-21latency_hist22:00:241
7728991023,79cyclictest31559-21apt-config22:05:250
77299910110,23cyclictest1371-21grep00:05:571
77299910110,17cyclictest7850irq/56-dwc_otg22:05:261
7728999910,75cyclictest9650irq/80-mmc023:50:300
175092990,4sleep017512-21diskmemload00:25:500
7729999813,17cyclictest8050irq/56-dwc_otg_23:00:471
772999974,12cyclictest0-21swapper/100:15:361
7729999610,18cyclictest7850irq/56-dwc_otg22:05:251
7729999413,9cyclictest7950irq/56-dwc_otg_23:25:511
772899936,64cyclictest29099-21ps23:20:490
772999914,16cyclictest7850irq/56-dwc_otg23:15:521
147442910,2sleep20-21swapper/200:22:422
772899902,82cyclictest0-21swapper/000:20:480
772899891,5cyclictest19981-21munin-run23:50:230
772899882,79cyclictest32436-21sed21:25:530
7730998716,13cyclictest7850irq/56-dwc_otg21:55:522
772899871,5cyclictest5174-21grep23:30:540
772899869,39cyclictest0-21swapper/020:30:360
772899843,53cyclictest0-21swapper/022:50:560
772899842,7cyclictest6802-21latency_hist21:35:240
772899842,7cyclictest6802-21latency_hist21:35:240
772899841,6cyclictest27709-21latency_hist22:40:230
773199833,47cyclictest31529-21ssh22:05:253
7731998310,30cyclictest37-21rcuc/300:15:423
772899823,72cyclictest29860-21grep00:00:550
772899823,72cyclictest29860-21grep00:00:550
7728998224,47cyclictest20159-21ssh21:50:490
772899821,8cyclictest22540-21fschecks_time19:50:400
7730998118,28cyclictest7850irq/56-dwc_otg00:00:552
7730998118,28cyclictest7850irq/56-dwc_otg00:00:552
772999819,56cyclictest13305-21ls23:40:551
772899817,57cyclictest0-21swapper/000:10:350
772899811,5cyclictest0-21swapper/019:40:230
7729998040,18cyclictest16785-21ssh23:05:491
772899802,10cyclictest0-21swapper/021:40:480
772899801,7cyclictest20385-21acpi19:45:340
42682790,6sleep1772999cyclictest23:30:421
772899784,5cyclictest20063-21ssh23:10:350
772899782,6cyclictest0-21swapper/019:55:510
772899781,5cyclictest12498-21wc20:50:490
271812780,4sleep227171-21apt-get21:20:352
772899771,6cyclictest8201-21ssh22:15:450
7731997626,15cyclictest7950irq/56-dwc_otg_23:05:523
772899768,50cyclictest19335-21/usr/sbin/munin21:10:410
772899762,57cyclictest0-21swapper/000:35:400
7728997623,29cyclictest9927-21aten_rbpower_vo20:45:360
7731997526,24cyclictest381ktimersoftd/321:35:463
772899751,5cyclictest16524-21unixbench_singl21:45:520
187662750,2sleep20-21swapper/223:08:362
7730997417,21cyclictest7950irq/56-dwc_otg_23:40:432
772999748,29cyclictest0-21swapper/122:30:371
772899741,7cyclictest24113-21timerandwakeup21:15:510
772899741,63cyclictest13331-21ssh22:21:390
7728997411,46cyclictest0-21swapper/021:21:550
7730997359,9cyclictest31534-21apt-config22:05:252
772899731,5cyclictest28498-21if_eth022:40:430
7728997312,49cyclictest8007-21/usr/sbin/munin20:40:410
772899722,4cyclictest0-21swapper/023:58:510
772899721,5cyclictest0-21swapper/019:30:230
773099714,45cyclictest0-21swapper/223:15:452
772999713,41cyclictest0-21swapper/122:50:241
232342710,2sleep20-21swapper/222:34:442
86822700,9sleep1772999cyclictest22:55:501
7731997035,20cyclictest8638-21rm22:55:493
773099706,41cyclictest4068-21ls22:10:462
7730997022,19cyclictest0-21swapper/200:15:482
772899702,4cyclictest0-21swapper/020:01:040
772899701,5cyclictest9715-21chrt23:36:290
773099695,40cyclictest0-21swapper/222:50:242
773099693,27cyclictest0-21swapper/222:55:502
7729996915,37cyclictest7850irq/56-dwc_otg00:20:491
7731996820,9cyclictest7850irq/56-dwc_otg23:40:543
772999689,14cyclictest0-21swapper/122:50:371
772999683,43cyclictest29852-21grep00:00:551
772999683,43cyclictest29852-21grep00:00:551
7728996815,31cyclictest7677-21munin-plugin-st20:40:230
7728996815,31cyclictest7677-21munin-plugin-st20:40:230
773199675,42cyclictest24669-21ssh21:55:553
7728996711,34cyclictest9256-21sshd19:14:500
773099662,45cyclictest7686-21ssh21:35:442
772999663,26cyclictest8050irq/56-dwc_otg_22:25:451
773199659,32cyclictest381ktimersoftd/323:25:443
7731996519,26cyclictest7950irq/56-dwc_otg_22:10:453
772899652,49cyclictest0-21swapper/021:06:510
7728996512,42cyclictest3899-21sshd20:29:510
772899642,53cyclictest0-21swapper/019:32:420
772899642,4cyclictest0-21swapper/020:22:150
7728996424,8cyclictest0-21swapper/020:55:370
772899641,6cyclictest0-21swapper/020:11:270
772899641,6cyclictest0-21swapper/020:11:270
773099632,41cyclictest7950irq/56-dwc_otg_00:05:582
262522630,5sleep3773199cyclictest20:00:413
7731996214,25cyclictest7950irq/56-dwc_otg_22:50:243
773199612,48cyclictest32342-21ssh21:25:513
772999613,10cyclictest29033-21ntp_states23:20:471
772999611,45cyclictest8050irq/56-dwc_otg_21:15:361
772899612,45cyclictest0-21swapper/021:03:550
63712615,9sleep00-21swapper/019:05:470
773199603,31cyclictest7850irq/56-dwc_otg22:50:553
7731996011,31cyclictest0-21swapper/323:16:003
7730996046,10cyclictest31-21ksoftirqd/222:50:552
772899602,34cyclictest10519-21seq19:15:500
772899601,39cyclictest0-21swapper/020:05:450
773199598,30cyclictest8050irq/56-dwc_otg_00:05:363
773199593,39cyclictest0-21swapper/323:00:473
7731995929,13cyclictest8050irq/56-dwc_otg_00:00:543
7731995929,13cyclictest8050irq/56-dwc_otg_00:00:543
773099598,23cyclictest7950irq/56-dwc_otg_22:25:442
773099597,30cyclictest0-21swapper/223:25:472
7730995933,10cyclictest31616-21sh22:05:272
7729995910,25cyclictest0-21swapper/120:30:301
7731995827,18cyclictest381ktimersoftd/320:15:383
773199573,38cyclictest18593-21diskmemload23:20:473
7730995740,11cyclictest8050irq/56-dwc_otg_23:45:362
772899571,45cyclictest0-21swapper/020:19:220
7728995711,36cyclictest0-21swapper/019:22:290
7728995711,36cyclictest0-21swapper/019:22:290
7731995615,6cyclictest0-21swapper/322:34:533
7730995622,14cyclictest0-21swapper/223:00:482
772999568,28cyclictest21366-21ntpq00:30:461
71492552,45sleep20-21swapper/219:06:292
7731995412,25cyclictest0-21swapper/300:20:483
7729995413,18cyclictest7850irq/56-dwc_otg21:25:511
7730995311,20cyclictest7850irq/56-dwc_otg23:20:472
772999527,12cyclictest7950irq/56-dwc_otg_19:55:361
7729995117,5cyclictest0-21swapper/121:30:351
7729995117,5cyclictest0-21swapper/121:30:351
124042511,41sleep312500-21ssh22:20:493
773199504,11cyclictest381ktimersoftd/322:25:433
7730995029,14cyclictest18593-21diskmemload00:30:472
7729995012,26cyclictest0-21swapper/123:50:291
773199498,22cyclictest7950irq/56-dwc_otg_00:30:453
773199483,16cyclictest18593-21diskmemload22:05:253
773199481,32cyclictest4811-21ssh00:10:453
772999488,25cyclictest0-21swapper/120:00:361
773199463,5cyclictest8050irq/56-dwc_otg_00:25:353
773099456,4cyclictest0-21swapper/221:40:352
773199447,24cyclictest0-21swapper/319:20:353
773199447,24cyclictest0-21swapper/319:20:353
773199446,24cyclictest0-21swapper/321:00:393
7731994425,7cyclictest39-21ksoftirqd/323:50:383
773199437,12cyclictest7950irq/56-dwc_otg_00:35:383
773199431,8cyclictest8050irq/56-dwc_otg_20:20:373
7730994322,9cyclictest8050irq/56-dwc_otg_23:35:402
7729994310,10cyclictest0-21swapper/120:40:331
772999422,6cyclictest18918-21/usr/sbin/munin21:10:381
7729994217,4cyclictest23852-21latency_hist23:15:231
773099412,7cyclictest7950irq/56-dwc_otg_00:25:372
7730994123,5cyclictest15283-21cut21:45:362
773099411,29cyclictest28666-21ls00:40:242
772999417,24cyclictest0-21swapper/120:35:371
772999417,24cyclictest0-21swapper/120:35:371
772999417,22cyclictest0-21swapper/121:20:361
7729994118,7cyclictest2815750wget22:40:391
773199401,32cyclictest5867-21latency_hist20:35:243
7729994010,5cyclictest7850irq/56-dwc_otg00:35:551
7731993922,5cyclictest989750wget20:45:363
773099398,16cyclictest0-21swapper/222:35:352
773099396,24cyclictest0-21swapper/223:50:362
773099396,15cyclictest7950irq/56-dwc_otg_19:40:412
7730993915,5cyclictest3190-21sh21:30:412
7730993915,5cyclictest3190-21sh21:30:412
773099391,3cyclictest0-21swapper/220:50:352
772999391,27cyclictest17352-21cut21:05:401
7729993912,11cyclictest13267-21tr19:25:381
773199385,25cyclictest8050irq/56-dwc_otg_21:20:343
773199382,8cyclictest7950irq/56-dwc_otg_23:30:363
7731993824,4cyclictest8050irq/56-dwc_otg_21:50:373
773099387,17cyclictest0-21swapper/220:30:292
773099384,18cyclictest8050irq/56-dwc_otg_21:15:412
256542381,30sleep20-21swapper/223:55:532
773199375,5cyclictest8050irq/56-dwc_otg_22:40:373
7731993713,12cyclictest0-21swapper/322:15:393
773199371,25cyclictest0-21swapper/323:10:503
772999375,4cyclictest8050irq/56-dwc_otg_21:00:241
772999373,7cyclictest7850irq/56-dwc_otg23:35:351
772999371,27cyclictest0-21swapper/100:10:421
773199361,5cyclictest8429-21fschecks_time23:35:393
773199361,18cyclictest8251-21ls19:10:433
773099365,5cyclictest8050irq/56-dwc_otg_22:40:542
773099361,32cyclictest3323-21ls20:25:482
773099361,28cyclictest8278-21ls19:10:432
7730993612,8cyclictest19852-21if_wlan021:50:432
773099361,25cyclictest23902-21ls19:55:242
772999368,15cyclictest0-21swapper/119:10:361
772999368,14cyclictest16877-21sort00:25:411
772999365,8cyclictest0-21swapper/122:20:531
772999364,7cyclictest7950irq/56-dwc_otg_23:45:371
7729993630,3cyclictest0-21swapper/122:35:391
772999362,21cyclictest8050irq/56-dwc_otg_20:10:401
772999362,21cyclictest8050irq/56-dwc_otg_20:10:401
772999361,5cyclictest25004-21cut23:55:431
773199352,4cyclictest0-21swapper/320:55:363
773199351,23cyclictest15268-21cut19:30:403
773199351,21cyclictest0-21swapper/321:30:423
773199351,21cyclictest0-21swapper/321:30:423
773099358,16cyclictest0-21swapper/200:10:382
773099353,5cyclictest7850irq/56-dwc_otg22:25:242
772999358,15cyclictest0-21swapper/121:50:421
772999355,21cyclictest7483-21ssh22:15:361
772999351,20cyclictest13183-21latency_hist20:55:241
773199345,15cyclictest8050irq/56-dwc_otg_23:50:243
773199345,12cyclictest8050irq/56-dwc_otg_22:35:393
7731993423,7cyclictest39-21ksoftirqd/321:10:503
773199342,18cyclictest23646-21ssh21:15:443
773199341,4cyclictest8050irq/56-dwc_otg_21:45:343
773199341,3cyclictest8050irq/56-dwc_otg_19:40:363
773199341,22cyclictest4037-21ls20:30:233
773099343,22cyclictest0-21swapper/220:40:292
773099341,23cyclictest21165-21ssh23:10:522
772999347,17cyclictest0-21swapper/119:40:351
772999343,7cyclictest0-21swapper/119:30:391
772999343,10cyclictest18647-21ssh21:49:421
772999342,8cyclictest15464-21grep21:00:421
772999341,27cyclictest11320-21ls21:40:371
773199339,4cyclictest0-21swapper/321:40:323
773199334,9cyclictest8050irq/56-dwc_otg_19:25:363
773199332,22cyclictest0-21swapper/320:05:273
773099339,11cyclictest7950irq/56-dwc_otg_20:45:512
773099338,5cyclictest7850irq/56-dwc_otg21:05:232
7730993325,5cyclictest301ktimersoftd/219:20:332
7730993325,5cyclictest301ktimersoftd/219:20:332
7730993317,5cyclictest18593-21diskmemload22:17:102
772999337,16cyclictest0-21swapper/119:50:361
772999332,9cyclictest0-21swapper/120:25:321
772999332,19cyclictest0-21swapper/120:24:131
772999331,6cyclictest32367-21grep20:15:521
170362331,4sleep30-21swapper/321:05:353
773199326,15cyclictest0-21swapper/320:50:373
773199325,14cyclictest8050irq/56-dwc_otg_19:55:513
773199323,4cyclictest7950irq/56-dwc_otg_20:15:223
773199323,4cyclictest7950irq/56-dwc_otg_20:15:223
773099328,11cyclictest15218-21grep19:30:402
773099327,13cyclictest0-21swapper/220:05:352
7730993225,5cyclictest25545-21cron20:00:232
773099321,6cyclictest2149-21cron20:25:232
7730993212,16cyclictest31-21ksoftirqd/219:45:342
7730993211,9cyclictest7950irq/56-dwc_otg_23:30:402
773199313,13cyclictest8050irq/56-dwc_otg_19:35:403
7731993124,5cyclictest39-21ksoftirqd/320:40:383
773099311,17cyclictest14034-21ls19:25:502
772999317,14cyclictest0-21swapper/120:45:351
772999312,17cyclictest21965-21latency_hist19:50:241
69642316,10sleep10-21swapper/119:05:561
773199306,22cyclictest0-21swapper/320:35:373
773199306,22cyclictest0-21swapper/320:35:373
7731993011,5cyclictest7950irq/56-dwc_otg_23:59:463
773099309,9cyclictest8050irq/56-dwc_otg_21:10:452
772999301,6cyclictest7850irq/56-dwc_otg19:20:361
772999301,6cyclictest7850irq/56-dwc_otg19:20:361
772999301,19cyclictest0-21swapper/119:15:571
773199297,9cyclictest8050irq/56-dwc_otg_19:50:403
773099296,7cyclictest7950irq/56-dwc_otg_20:35:412
773099296,7cyclictest7950irq/56-dwc_otg_20:35:412
772999293,6cyclictest16777-21/usr/sbin/munin19:35:401
773199282,13cyclictest8050irq/56-dwc_otg_19:16:153
773099282,7cyclictest14346-21timerandwakeup20:55:512
773099282,14cyclictest727-21runrttasks19:16:042
772999286,5cyclictest7850irq/56-dwc_otg20:06:071
773199274,4cyclictest7950irq/56-dwc_otg_19:45:463
773099276,10cyclictest0-21swapper/219:36:012
773099271,10cyclictest7850irq/56-dwc_otg21:05:452
773099263,5cyclictest26596-21taskset20:00:472
773099262,6cyclictest0-21swapper/220:15:382
773099261,7cyclictest29399-21/usr/sbin/munin20:10:452
773099261,7cyclictest29399-21/usr/sbin/munin20:10:452
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional