You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 15:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Aug 27, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
836322500,3sleep20-21swapper/207:05:312
308321760,6sleep1959199cyclictest10:45:401
308321760,6sleep1959199cyclictest10:45:401
2498321680,2sleep1959199cyclictest09:55:191
95909910853,25cyclictest0-21swapper/011:00:370
2100721040,5sleep220999-21ssh09:10:272
9590991033,68cyclictest0-21swapper/010:25:330
9590991029,68cyclictest21604-21rm09:10:360
95909910286,4cyclictest7950irq/56-dwc_otg_11:35:250
95909910286,4cyclictest7950irq/56-dwc_otg_11:35:250
9592991013,62cyclictest30873-21sed10:40:322
95909910154,25cyclictest0-21swapper/010:50:310
3085521010,2sleep30-21swapper/309:22:483
9590999626,44cyclictest30785-21ls10:40:290
959099934,54cyclictest26905-21grep10:35:390
9590999344,26cyclictest0-21swapper/010:00:340
9590999344,26cyclictest0-21swapper/010:00:340
959099927,63cyclictest0-21swapper/009:15:360
959299904,65cyclictest17743-21/usr/sbin/munin10:25:352
959099903,67cyclictest0-21swapper/008:10:180
959099903,67cyclictest0-21swapper/008:10:180
254142890,2sleep10-21swapper/109:15:301
9590998459,6cyclictest0-21swapper/009:57:530
9590998445,10cyclictest7850irq/56-dwc_otg_12:15:240
959299822,73cyclictest25953-21switchtime09:15:402
298432810,2sleep10-21swapper/111:57:021
229882810,2sleep00-21swapper/007:45:330
9590997962,8cyclictest0-21swapper/011:22:500
959299782,69cyclictest26910-21processes10:35:392
9592997823,49cyclictest6049-21/usr/sbin/munin10:50:302
9590997772,3cyclictest0-21swapper/009:34:540
9590997772,3cyclictest0-21swapper/009:34:540
959099775,11cyclictest0-21swapper/010:30:220
9590997614,20cyclictest0-21swapper/008:45:220
959299752,45cyclictest7950irq/56-dwc_otg_11:00:352
959199758,46cyclictest15204-21ssh11:00:371
273862740,5sleep0959099cyclictest07:58:210
959299731,43cyclictest17461-21sh11:42:092
959299723,62cyclictest29838-21sed10:00:322
959299723,62cyclictest29838-21sed10:00:322
959199726,46cyclictest221ktimersoftd/110:40:311
9591997131,25cyclictest7750irq/56-dwc_otg10:50:311
959299706,14cyclictest8064-21kworker/u8:310:15:222
959099705,57cyclictest0-21swapper/007:40:110
959099698,40cyclictest24380-21ls12:30:120
959099694,51cyclictest0-21swapper/011:45:230
214152690,5sleep2959299cyclictest07:40:362
959399683,47cyclictest0-21swapper/310:35:373
9593996814,28cyclictest7950irq/56-dwc_otg_10:25:393
9592996818,22cyclictest19482-21ssh11:45:232
959299681,53cyclictest2906-21diskstats08:20:272
959099689,42cyclictest7401-21idleruntime11:30:300
959299671,48cyclictest29098-21ssh11:17:102
959299671,41cyclictest19156-21rm09:47:432
959099660,55cyclictest24538-21taskset11:50:370
959299651,53cyclictest28154-21ssh09:58:572
959299651,53cyclictest1270-21unixbench_multi09:25:402
959299651,45cyclictest23471-21ssh09:52:592
959299651,44cyclictest21567-21ssh11:08:462
9591996511,37cyclictest0-21swapper/110:25:381
239162650,2sleep121-21rcuc/109:13:531
959299641,44cyclictest354-21sshd08:12:222
959299641,44cyclictest354-21sshd08:12:222
9591996411,24cyclictest26969-21ssh10:35:401
959099647,47cyclictest0-21swapper/009:40:210
9590996410,35cyclictest18187-21grep09:00:390
9590996410,35cyclictest18187-21grep09:00:390
295712640,1sleep30-21swapper/310:00:293
295712640,1sleep30-21swapper/310:00:293
14172640,2sleep30-21swapper/310:05:323
959299631,49cyclictest14993-21ssh12:18:462
959299631,45cyclictest4490-21apt-get08:25:242
959299631,44cyclictest13965-21ssh11:00:042
959299631,43cyclictest25304-21/usr/sbin/munin12:30:342
959099636,41cyclictest0-21swapper/011:16:520
959099630,48cyclictest4747-21grep08:25:280
108692630,2sleep20-21swapper/212:13:492
959399627,35cyclictest7750irq/56-dwc_otg12:10:233
959299624,41cyclictest22667-21fschecks_time07:45:292
959299621,50cyclictest25994-21ssh11:14:042
959299621,45cyclictest15067-21ssh10:21:082
959299621,43cyclictest17818-21ntp_states09:00:342
959299621,43cyclictest17818-21ntp_states09:00:342
9590996213,46cyclictest101ktimersoftd/011:05:390
9590996212,47cyclictest101ktimersoftd/009:25:120
959399616,36cyclictest24955-21/usr/sbin/munin09:15:413
959299612,46cyclictest5673-21ssh11:28:242
959299611,50cyclictest14552-21ssh09:41:532
959299611,47cyclictest0-21swapper/209:08:512
9591996113,13cyclictest0-21swapper/110:00:351
9591996113,13cyclictest0-21swapper/110:00:351
959099616,43cyclictest9222-21ssh10:15:150
959099612,42cyclictest9536-21timerwakeupswit09:35:380
9593996013,12cyclictest6358-21fschecks_count10:50:313
959299601,56cyclictest8393-21apt-get09:35:242
959299601,48cyclictest29478-21sshd11:56:212
959299601,36cyclictest14847-21taskset07:24:352
9591996041,6cyclictest0-21swapper/111:50:251
959099609,36cyclictest0-21swapper/010:46:040
959099609,36cyclictest0-21swapper/010:46:040
959099605,10cyclictest7449-21cron12:10:120
959099605,10cyclictest7449-21cron12:10:120
959299591,40cyclictest31134-21apt-get11:20:242
9591995914,10cyclictest7850irq/56-dwc_otg_12:20:241
959099591,51cyclictest0-21swapper/011:40:250
9590995914,41cyclictest101ktimersoftd/012:30:260
959399584,16cyclictest15207-21awk11:00:363
959299581,48cyclictest5796-21ssh09:31:052
959299581,48cyclictest5796-21ssh09:31:052
959299581,45cyclictest0-21swapper/210:05:312
959099588,41cyclictest20643-21latency_hist09:50:120
959099588,35cyclictest0-21swapper/011:11:150
9590995814,41cyclictest101ktimersoftd/010:15:110
9590995812,34cyclictest1468-21ssh12:01:530
959399577,30cyclictest7950irq/56-dwc_otg_09:10:363
959299573,41cyclictest20495-21diskmemload11:39:412
959299573,41cyclictest20495-21diskmemload11:39:412
959299571,43cyclictest20495-21diskmemload12:00:552
959299571,42cyclictest18173-21ssh12:21:592
959299571,35cyclictest14851-21taskset08:52:262
959099578,40cyclictest9607-21/usr/sbin/munin07:10:260
959099578,36cyclictest0-21swapper/008:55:290
959099572,40cyclictest0-21swapper/012:10:330
959099571,4cyclictest17440-21apt-config10:25:120
959099570,41cyclictest0-21swapper/012:24:530
90122570,2sleep30-21swapper/311:31:563
84702576,41sleep08503-21/usr/sbin/munin07:05:340
959299561,52cyclictest24739-21/usr/sbin/munin07:50:322
959299561,45cyclictest12269-21ls08:45:312
959299561,38cyclictest7950irq/56-dwc_otg_09:22:382
959099567,35cyclictest19756-21sensors09:05:370
959099565,39cyclictest3999-21timerwakeupswit11:25:390
959099563,45cyclictest0-21swapper/009:27:590
9590995624,16cyclictest28829-21cat11:55:390
959399552,9cyclictest0-21swapper/308:55:243
959299551,42cyclictest17153-21chrt07:30:252
959099554,38cyclictest12424-21ssh10:57:170
959099554,10cyclictest0-21swapper/007:35:120
9590995510,33cyclictest21578-21ls09:50:340
959399543,14cyclictest30785-21ls10:40:293
959299541,49cyclictest16208-21ls07:25:392
959299541,44cyclictest26674-21ssh11:53:492
959299541,40cyclictest6900-21ssh12:09:122
959299541,40cyclictest6900-21ssh12:09:122
959299541,38cyclictest31107-21chrt08:09:462
959299541,34cyclictest23863-21ssh12:29:442
959199544,8cyclictest7850irq/56-dwc_otg_09:40:251
959099548,38cyclictest0-21swapper/008:35:250
959099546,30cyclictest31732-21ssh12:38:430
959099544,47cyclictest4404-21ssh10:09:380
959099544,40cyclictest0-21swapper/008:41:340
959099544,24cyclictest0-21swapper/007:25:230
959099541,29cyclictest0-21swapper/007:15:400
959099541,29cyclictest0-21swapper/007:15:400
9590995410,30cyclictest0-21swapper/007:53:450
9592995316,29cyclictest1180-21runrttasks07:19:492
9592995316,29cyclictest1180-21runrttasks07:19:492
959299531,40cyclictest31728-21rm12:38:422
959299531,39cyclictest8628-21ssh11:31:142
959299531,39cyclictest0-21swapper/208:01:262
959299531,38cyclictest5519-21if_eth010:10:312
959299531,36cyclictest5015-21ssh10:48:552
959299531,36cyclictest5015-21ssh10:48:552
959199532,7cyclictest7850irq/56-dwc_otg_11:40:221
959099536,33cyclictest0-21swapper/008:20:260
959099532,39cyclictest0-21swapper/008:00:380
959299528,41cyclictest10317-21if_eth008:40:302
959299522,38cyclictest0-21swapper/208:57:572
959299521,42cyclictest20111-21runrttasks07:37:362
959299521,33cyclictest22309-21ssh10:30:352
959199525,9cyclictest0-21swapper/109:05:251
9591995211,30cyclictest0-21swapper/111:35:231
9591995211,30cyclictest0-21swapper/111:35:231
959099524,34cyclictest0-21swapper/007:40:310
9590995226,5cyclictest30695-21unixbench_multi08:05:380
959399512,6cyclictest0-21swapper/312:35:223
959299511,46cyclictest9620-21apt-get07:10:242
959299511,46cyclictest25996-21apt-get07:55:232
959299511,40cyclictest7495-21chrt08:30:512
959299511,35cyclictest0-21swapper/208:20:112
959199515,9cyclictest7750irq/56-dwc_otg09:30:241
959199515,9cyclictest7750irq/56-dwc_otg09:30:241
959099511,42cyclictest0-21swapper/008:20:030
959399500,43cyclictest0-21swapper/311:40:223
959199508,34cyclictest0-21swapper/110:30:221
959199505,10cyclictest7750irq/56-dwc_otg12:30:251
9590995021,13cyclictest0-21swapper/007:20:250
959299491,37cyclictest9324-21chrt08:36:102
9591994918,23cyclictest9340-21ssh10:15:251
959199483,7cyclictest0-21swapper/107:40:231
9591994821,7cyclictest5845-21sh10:10:351
959199478,23cyclictest0-21swapper/107:15:171
959199478,23cyclictest0-21swapper/107:15:171
9591994719,4cyclictest21-21rcuc/111:05:281
959099476,27cyclictest7518-21chrt08:31:090
959199466,25cyclictest0-21swapper/107:30:241
959199462,6cyclictest0-21swapper/112:00:231
85042465,25sleep10-21swapper/107:05:351
959199457,23cyclictest0-21swapper/108:05:241
959199452,6cyclictest7750irq/56-dwc_otg08:10:211
959199452,6cyclictest7750irq/56-dwc_otg08:10:211
959099457,28cyclictest0-21swapper/008:55:090
959399448,11cyclictest7850irq/56-dwc_otg_08:30:223
959399446,23cyclictest0-21swapper/310:45:253
959399446,23cyclictest0-21swapper/310:45:253
959399445,12cyclictest7850irq/56-dwc_otg_12:20:233
959199443,5cyclictest0-21swapper/107:35:221
959199442,9cyclictest0-21swapper/111:45:241
959399437,24cyclictest0-21swapper/308:35:233
959199437,24cyclictest0-21swapper/108:35:231
959199435,7cyclictest7750irq/56-dwc_otg11:15:341
72952430,2sleep10-21swapper/111:30:291
959399427,25cyclictest0-21swapper/308:10:193
959399427,25cyclictest0-21swapper/308:10:193
959399427,24cyclictest0-21swapper/310:15:173
959399425,4cyclictest7950irq/56-dwc_otg_11:10:223
959199427,20cyclictest0-21swapper/110:20:231
959399414,5cyclictest0-21swapper/308:00:233
9593994118,5cyclictest2792950wget11:55:273
959199419,7cyclictest0-21swapper/111:25:231
959199417,28cyclictest0-21swapper/107:25:251
959199416,11cyclictest7750irq/56-dwc_otg07:45:241
9591994115,6cyclictest31517-21systemd-journal09:23:161
959399401,11cyclictest7850irq/56-dwc_otg_11:25:223
959399391,4cyclictest7950irq/56-dwc_otg_08:45:243
959199398,9cyclictest0-21swapper/108:45:221
959199398,20cyclictest0-21swapper/110:56:391
959199396,7cyclictest7750irq/56-dwc_otg07:55:241
9591993915,14cyclictest3756-21aten_rbpower_vo12:05:251
9591993915,14cyclictest3756-21aten_rbpower_vo12:05:251
959399385,15cyclictest7950irq/56-dwc_otg_11:40:123
959399385,15cyclictest7950irq/56-dwc_otg_11:40:123
9593993821,4cyclictest20334-21latency_hist07:40:113
959199388,14cyclictest7950irq/56-dwc_otg_07:15:111
959199383,29cyclictest7950irq/56-dwc_otg_08:50:221
959199381,4cyclictest0-21swapper/109:50:251
9591993810,4cyclictest7750irq/56-dwc_otg08:15:301
959399375,19cyclictest5085-21ssh10:10:263
959399372,16cyclictest7950irq/56-dwc_otg_08:10:133
959399371,5cyclictest0-21swapper/311:05:213
959199373,6cyclictest7750irq/56-dwc_otg10:05:411
959199371,5cyclictest24247-21aten_rbpower_en07:50:251
9591993715,16cyclictest0-21swapper/108:00:251
282782370,5sleep3959399cyclictest12:35:003
959399366,23cyclictest0-21swapper/308:25:253
9593993626,6cyclictest381ktimersoftd/311:50:233
959199362,17cyclictest10997-21sed08:40:391
9591993620,5cyclictest851-21sh11:22:141
246462360,6sleep3959399cyclictest07:50:313
959399358,14cyclictest7950irq/56-dwc_otg_09:30:263
959399358,14cyclictest7950irq/56-dwc_otg_09:30:263
959399356,20cyclictest60-21kswapd007:15:183
959399356,20cyclictest60-21kswapd007:15:183
959399355,13cyclictest0-21swapper/311:22:253
959199357,15cyclictest0-21swapper/108:20:241
959199356,4cyclictest7950irq/56-dwc_otg_09:45:251
959199351,20cyclictest3303-21kworker/u8:012:40:121
959399344,4cyclictest7750irq/56-dwc_otg11:15:253
9593993415,12cyclictest1180-21runrttasks09:30:123
9593993411,8cyclictest7950irq/56-dwc_otg_09:35:283
959199344,4cyclictest7750irq/56-dwc_otg12:10:221
959199344,15cyclictest7850irq/56-dwc_otg_09:38:221
9591993410,4cyclictest0-21swapper/111:10:231
959399339,6cyclictest7750irq/56-dwc_otg12:05:283
959399339,6cyclictest7750irq/56-dwc_otg12:05:283
959399338,12cyclictest7950irq/56-dwc_otg_07:40:273
959399331,5cyclictest0-21swapper/312:25:213
959199333,9cyclictest0-21swapper/109:27:121
959199333,8cyclictest0-21swapper/112:25:281
959199331,6cyclictest21-21rcuc/108:30:371
91312332,23sleep30-21swapper/307:07:443
959399328,11cyclictest7950irq/56-dwc_otg_12:15:283
959399326,14cyclictest0-21swapper/307:10:243
959399322,3cyclictest0-21swapper/312:01:453
959399322,14cyclictest7950irq/56-dwc_otg_10:20:323
959399321,15cyclictest7950irq/56-dwc_otg_07:25:403
9593993211,5cyclictest0-21swapper/309:55:233
959199324,4cyclictest7750irq/56-dwc_otg08:25:381
959399313,15cyclictest19467-21/usr/sbin/munin11:45:363
959399311,14cyclictest7950irq/56-dwc_otg_09:40:293
959199318,6cyclictest7750irq/56-dwc_otg08:55:311
959199311,4cyclictest7950irq/56-dwc_otg_12:15:221
959399308,16cyclictest0-21swapper/308:40:293
959399307,4cyclictest0-21swapper/310:33:053
959399305,5cyclictest7750irq/56-dwc_otg09:45:273
959399304,4cyclictest7950irq/56-dwc_otg_07:20:303
959399302,20cyclictest0-21swapper/308:53:443
959399302,19cyclictest0-21swapper/308:18:113
959399301,7cyclictest14051-21munin-run11:00:113
959399301,3cyclictest0-21swapper/309:50:423
959399291,7cyclictest19145-21runrttasks09:05:273
959199291,7cyclictest18832-21latency_hist09:05:121
959199291,7cyclictest18832-21latency_hist09:05:121
9591992911,4cyclictest14022-21/usr/sbin/munin07:20:331
959399282,5cyclictest7950irq/56-dwc_otg_08:20:243
959399282,13cyclictest7950irq/56-dwc_otg_07:30:323
959399272,14cyclictest0-21swapper/307:56:073
959399262,14cyclictest22780-21/usr/sbin/munin07:45:303
959399241,2cyclictest0-21swapper/309:00:323
959399241,2cyclictest0-21swapper/309:00:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional