You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 19:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Tue Sep 08, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18387991082,89cyclictest0-21swapper/011:10:420
1838799964,70cyclictest0-21swapper/008:15:300
205772940,3sleep020561-21ssh10:15:450
64572910,2sleep20-21swapper/211:55:522
1838799902,62cyclictest23779-21latency_hist07:25:190
1838799891,62cyclictest5687-21wget09:20:320
1838799891,49cyclictest0-21swapper/010:40:320
1838799882,64cyclictest0-21swapper/012:10:420
1838799882,64cyclictest0-21swapper/012:10:420
201802870,15sleep27950irq/56-dwc_otg_08:45:182
1838999863,12cyclictest987-21ntp_states11:10:412
1838899863,59cyclictest993-21ssh11:10:421
18387998673,4cyclictest0-21swapper/010:05:300
18387998673,4cyclictest0-21swapper/010:05:300
176642830,4sleep217663-21unixbench_multi07:05:452
18387998223,40cyclictest7950irq/56-dwc_otg_10:55:170
18387998219,48cyclictest20188-21snmpd09:40:430
109652810,1sleep10-21swapper/111:22:421
312812800,3sleep229-21rcuc/209:11:302
1838799805,4cyclictest0-21swapper/010:12:230
1838799801,56cyclictest0-21swapper/011:56:320
1838799791,64cyclictest0-21swapper/007:30:330
1838799781,16cyclictest15740-21ssh12:07:460
1838899774,53cyclictest0-21swapper/108:55:291
1838899761,56cyclictest29794-21uname11:45:381
1838899761,56cyclictest29794-21uname11:45:381
1838799761,19cyclictest4906-21grep10:35:480
1838899751,54cyclictest6534-21/usr/sbin/munin09:20:431
1838899751,50cyclictest12984-21kworker/u8:012:30:241
1838799751,18cyclictest31352-21cut09:50:330
1838899742,53cyclictest8151-21if_eth008:10:371
1838899742,50cyclictest19451-21latency_hist10:15:181
147522740,2sleep30-21swapper/309:30:393
1838899731,52cyclictest25649-21apt-get07:30:321
1838899731,45cyclictest25568-21ls11:00:471
1838799735,18cyclictest0-21swapper/011:00:310
18387997319,30cyclictest21368-21fschecks_time11:35:360
1838799731,21cyclictest8931-21fschecks_time11:20:340
18387997221,34cyclictest7950irq/56-dwc_otg_08:10:400
1838799721,63cyclictest0-21swapper/011:30:400
18387997215,47cyclictest9450irq/48-DMA08:56:170
18387997215,47cyclictest9450irq/48-DMA08:56:170
1838799721,18cyclictest20614-21fschecks_time10:55:350
1838899711,56cyclictest2647-21ssh11:51:271
1838799711,60cyclictest0-21swapper/012:25:430
1838799711,22cyclictest0-21swapper/011:45:390
1838799711,22cyclictest0-21swapper/011:45:390
1838899709,46cyclictest25201-21aten_rbpower_en11:40:321
1838899701,54cyclictest31291-21sh10:29:381
1838899701,46cyclictest13959-21rm10:47:001
1838799709,51cyclictest29108-21grep10:25:450
1838899697,30cyclictest0-21swapper/108:15:301
1838899694,50cyclictest20233-21/usr/sbin/munin10:55:431
1838899692,51cyclictest1670-21latency_hist12:30:181
1838899691,57cyclictest6568-21date08:05:391
1838899691,57cyclictest6568-21date08:05:391
1838799691,21cyclictest25246-21ssh10:21:070
171362690,5sleep30-21swapper/307:05:383
1838899681,53cyclictest31757-21ssh11:09:181
1838899681,52cyclictest22451-21sshd10:18:341
1838899681,49cyclictest23049-21fschecks_count09:40:361
1838899681,49cyclictest20404-21ssh12:13:441
1838899681,49cyclictest20404-21ssh12:13:441
1838899681,43cyclictest7750irq/56-dwc_otg09:35:181
18387996822,41cyclictest16202-21ssh09:32:060
1838799681,20cyclictest24550-21runrttasks08:55:350
1838899672,56cyclictest337-21ntpq10:30:431
1838899671,62cyclictest18386-21cyclictest07:10:181
1838899671,49cyclictest3657-21ssh10:35:241
1838899671,48cyclictest8566-21ssh11:59:451
1838899671,45cyclictest20784-21ssh09:37:401
1838899671,43cyclictest21826-21taskset07:20:181
18387996720,36cyclictest4579-21sh11:15:330
1838799671,17cyclictest23796-21latency_hist08:55:180
1838899668,36cyclictest7850irq/56-dwc_otg_12:36:001
1838899661,50cyclictest5498-21sh09:57:511
1838899661,50cyclictest13033-21ssh10:06:301
1838899661,50cyclictest13033-21ssh10:06:301
1838899661,48cyclictest23596-21idleruntime-cro07:25:181
1838799661,56cyclictest4812-21sshd09:56:350
1838799661,55cyclictest0-21swapper/012:21:510
1838799661,51cyclictest0-21swapper/011:53:060
18387996612,42cyclictest0-21swapper/008:05:330
18387996612,42cyclictest0-21swapper/008:05:330
1838799661,23cyclictest0-21swapper/012:32:350
1838799661,13cyclictest0-21swapper/008:40:400
1839099653,42cyclictest0-21swapper/311:10:433
1838899651,48cyclictest24929-21rm12:19:161
1838899651,48cyclictest1180-21runrttasks08:41:051
1838899651,46cyclictest23915-21aten_rbpower_po07:25:311
1838899651,41cyclictest8124-21/usr/sbin/munin10:00:421
1838799656,44cyclictest0-21swapper/011:06:280
1838799656,15cyclictest0-21swapper/009:11:270
1838799652,15cyclictest0-21swapper/012:03:320
18387996519,36cyclictest0-21swapper/010:49:370
1838799651,20cyclictest0-21swapper/009:49:160
132732650,2sleep30-21swapper/309:29:273
132732650,2sleep30-21swapper/309:29:273
1838899642,41cyclictest0-21swapper/108:35:481
1838899642,40cyclictest1180-21runrttasks11:28:551
1838899641,52cyclictest11651-21ssh09:26:351
1838899641,52cyclictest11651-21ssh09:26:351
1838899641,48cyclictest3769-21seq09:17:401
1838899641,46cyclictest9254-21ssh10:40:571
1838899641,46cyclictest7750irq/56-dwc_otg12:05:271
1838899641,46cyclictest6914-21ssh11:18:021
1838899641,45cyclictest29516-21ssh12:24:491
1838899641,40cyclictest11503-21rm12:02:341
18387996415,40cyclictest0-21swapper/009:37:510
18387996414,9cyclictest0-21swapper/011:26:140
1838799641,15cyclictest0-21swapper/012:16:160
1838899631,45cyclictest31560-21ssh09:12:001
1838899631,44cyclictest16307-21runrttasks08:32:321
1838799635,2cyclictest0-21swapper/008:35:320
18387996317,37cyclictest0-21swapper/012:35:340
18387996314,8cyclictest7950irq/56-dwc_otg_07:38:460
1838799631,37cyclictest25550-21ls11:40:370
18387996312,9cyclictest0-21swapper/009:04:030
18390996215,11cyclictest7850irq/56-dwc_otg_10:55:293
1838899621,43cyclictest1180-21runrttasks09:54:531
18388996214,39cyclictest1180-21runrttasks10:21:041
1838899621,40cyclictest20845-21ssh11:35:181
18387996213,41cyclictest0-21swapper/007:41:240
1838999617,25cyclictest0-21swapper/211:20:302
1838799611,15cyclictest0-21swapper/010:00:230
1838799611,11cyclictest0-21swapper/010:31:120
1838899603,45cyclictest0-21swapper/111:40:161
1838899601,46cyclictest18456-21ssh10:52:391
1838899601,45cyclictest32624-21chrt07:49:101
1838899601,40cyclictest1796-21runrttasks07:51:511
1838899601,38cyclictest14452-21chrt08:26:531
18387996024,27cyclictest7850irq/56-dwc_otg_07:54:200
1838899594,41cyclictest30285-21ssh09:49:151
1838899591,44cyclictest7850irq/56-dwc_otg_08:55:131
1838899591,43cyclictest3618-21runrttasks07:56:541
1838899591,42cyclictest5671-21seq08:05:071
1838899591,42cyclictest5671-21seq08:05:071
1838799597,13cyclictest0-21swapper/008:21:510
18387995912,2cyclictest0-21swapper/007:25:390
1838799591,15cyclictest0-21swapper/009:17:200
1838899585,42cyclictest7750irq/56-dwc_otg09:00:301
1838899581,52cyclictest27553-21apt-get07:35:281
1838799582,40cyclictest3922-21cat08:00:180
1838799581,15cyclictest0-21swapper/008:49:350
1838899571,33cyclictest0-21swapper/108:45:431
1838799571,5cyclictest7850irq/56-dwc_otg_08:05:180
1838799571,5cyclictest7850irq/56-dwc_otg_08:05:180
1838799571,14cyclictest0-21swapper/009:09:180
1838799571,14cyclictest0-21swapper/008:32:390
1838999564,8cyclictest7850irq/56-dwc_otg_08:30:292
1838899562,42cyclictest29077-21runrttasks09:09:151
1838799561,13cyclictest14488-21taskset08:27:210
1838799561,13cyclictest0-21swapper/007:12:350
1838799551,4cyclictest0-21swapper/007:50:180
1838799551,15cyclictest0-21swapper/007:20:060
1839099516,14cyclictest17449-21ssh12:10:283
1839099516,14cyclictest17449-21ssh12:10:283
1838899511,47cyclictest30267-21ls07:40:441
1838899491,36cyclictest12634-21runrttasks08:21:421
1838999478,25cyclictest0-21swapper/207:50:292
1838999477,26cyclictest0-21swapper/207:35:222
1839099458,6cyclictest0-21swapper/312:30:293
1838999457,24cyclictest0-21swapper/212:20:242
179952453,34sleep00-21swapper/007:08:440
1838999447,25cyclictest0-21swapper/210:40:322
1838999447,22cyclictest0-21swapper/207:55:322
1838999446,23cyclictest0-21swapper/209:45:322
18389994413,7cyclictest29292-21latency_hist09:10:182
1839099427,22cyclictest0-21swapper/309:40:233
1839099422,17cyclictest11318-21ssh10:05:283
1839099422,17cyclictest11318-21ssh10:05:283
1838999427,25cyclictest0-21swapper/212:30:312
1839099418,4cyclictest7950irq/56-dwc_otg_09:05:293
1839099412,7cyclictest7950irq/56-dwc_otg_10:50:293
1838999416,4cyclictest7850irq/56-dwc_otg_11:20:172
144622410,2sleep218386-21cyclictest10:09:072
144622410,2sleep218386-21cyclictest10:09:072
1839099407,6cyclictest7750irq/56-dwc_otg12:05:463
1839099406,24cyclictest0-21swapper/311:40:323
1839099406,20cyclictest7950irq/56-dwc_otg_11:15:313
279682390,2sleep327973-21aten_rbpower_vo10:25:313
18390993915,4cyclictest20659-21if_wlan007:15:373
1838999395,8cyclictest0-21swapper/208:10:312
1839099386,19cyclictest0-21swapper/308:35:303
18390993818,18cyclictest1554450wget10:10:353
1838999389,21cyclictest30126-21sh12:25:292
1838999385,20cyclictest27880-21ssh10:25:302
1838999384,16cyclictest7850irq/56-dwc_otg_09:54:352
79422370,1sleep30-21swapper/308:10:333
1839099372,3cyclictest0-21swapper/309:45:303
18390993718,10cyclictest23873-21sh12:17:213
1839099371,24cyclictest32431-21ls10:30:383
18390993710,12cyclictest7850irq/56-dwc_otg_11:30:183
1838999373,13cyclictest7850irq/56-dwc_otg_09:20:392
1838999371,23cyclictest13108-21ls12:05:182
1839099367,24cyclictest0-21swapper/308:30:303
1839099363,15cyclictest0-21swapper/310:25:183
1839099361,23cyclictest24119-21grep07:25:343
1838999363,5cyclictest0-21swapper/208:45:292
18389993619,10cyclictest301ktimersoftd/209:40:302
18389993610,6cyclictest18656-21fschecks_count07:10:342
68102350,1sleep30-21swapper/310:00:143
1839099357,5cyclictest7950irq/56-dwc_otg_10:15:343
1839099357,24cyclictest0-21swapper/308:20:333
1839099354,5cyclictest7750irq/56-dwc_otg11:50:183
1839099354,5cyclictest7750irq/56-dwc_otg11:50:183
1839099351,28cyclictest4991-21ls08:00:433
1839099351,28cyclictest4991-21ls08:00:433
18390993510,6cyclictest0-21swapper/311:05:303
1838999353,6cyclictest0-21swapper/211:40:312
18389993517,5cyclictest9754-21sh08:15:322
1839099349,5cyclictest7850irq/56-dwc_otg_12:25:173
1839099345,5cyclictest7850irq/56-dwc_otg_09:50:403
1839099345,5cyclictest7750irq/56-dwc_otg11:35:183
1839099345,15cyclictest0-21swapper/310:42:073
1839099344,26cyclictest7950irq/56-dwc_otg_09:20:293
18390993419,5cyclictest39-21ksoftirqd/311:20:353
1838999347,14cyclictest0-21swapper/211:35:292
18389993414,10cyclictest26064-21ssh10:22:372
1838999341,26cyclictest1888-21sensors11:50:432
141922340,4sleep2301ktimersoftd/208:25:462
1839099337,14cyclictest0-21swapper/307:35:233
1839099337,12cyclictest0-21swapper/310:47:093
1839099332,21cyclictest0-21swapper/311:35:503
18390993317,4cyclictest9732-21irqstats12:00:383
1838999337,14cyclictest0-21swapper/209:00:302
1838999331,4cyclictest5728-21latency_hist08:05:182
1838999331,4cyclictest5728-21latency_hist08:05:182
1839099328,16cyclictest0-21swapper/310:00:303
1839099328,11cyclictest27217-21awk07:35:173
1839099327,14cyclictest0-21swapper/308:45:313
1839099327,12cyclictest7950irq/56-dwc_otg_08:55:303
18390993223,7cyclictest24411-21ssh11:00:333
1839099321,7cyclictest10529-21timerwakeupswit08:15:443
1839099321,23cyclictest0-21swapper/308:51:183
1839099321,22cyclictest0-21swapper/309:01:043
1839099321,17cyclictest4850-21ls11:55:183
1838999328,4cyclictest0-21swapper/211:05:372
1838999326,12cyclictest7950irq/56-dwc_otg_09:15:332
1838999325,4cyclictest7950irq/56-dwc_otg_12:05:472
1838999322,8cyclictest7950irq/56-dwc_otg_09:25:292
1838999322,8cyclictest7950irq/56-dwc_otg_09:25:292
1838999322,5cyclictest3812-21taskset09:55:402
1838999321,6cyclictest7750irq/56-dwc_otg11:25:452
1838999321,5cyclictest0-21swapper/210:59:272
1838999321,3cyclictest0-21swapper/211:02:102
18389993213,10cyclictest0-21swapper/209:35:342
1839099318,11cyclictest7950irq/56-dwc_otg_07:20:373
1839099317,15cyclictest0-21swapper/309:35:333
1839099313,22cyclictest30118-21ssh12:25:293
1839099312,11cyclictest0-21swapper/308:40:323
18390993114,9cyclictest7850irq/56-dwc_otg_11:55:373
1838999315,9cyclictest0-21swapper/209:30:322
1838999311,3cyclictest0-21swapper/210:19:102
18389993111,6cyclictest9450irq/48-DMA08:56:172
1838999311,10cyclictest0-21swapper/210:10:472
1839099309,5cyclictest7750irq/56-dwc_otg10:35:383
1839099307,12cyclictest7950irq/56-dwc_otg_08:25:293
1839099302,19cyclictest0-21swapper/308:07:023
1839099302,19cyclictest0-21swapper/308:07:023
1839099302,19cyclictest0-21swapper/307:58:403
1839099302,19cyclictest0-21swapper/307:47:023
1839099302,19cyclictest0-21swapper/307:41:453
1839099301,8cyclictest7750irq/56-dwc_otg07:50:443
1839099301,18cyclictest0-21swapper/309:15:333
1838999309,4cyclictest0-21swapper/210:03:052
1838999307,10cyclictest7750irq/56-dwc_otg10:50:352
1838999303,12cyclictest420-21grep10:30:452
18389993023,5cyclictest30458-21grep11:45:462
18389993023,5cyclictest30458-21grep11:45:462
1838999301,5cyclictest7750irq/56-dwc_otg10:45:312
1838999301,5cyclictest12434-21grep08:20:472
1838999301,10cyclictest7950irq/56-dwc_otg_07:45:402
18389993010,9cyclictest0-21swapper/212:15:092
18389993010,9cyclictest0-21swapper/212:15:092
1839099293,13cyclictest29662-21cut09:10:313
1839099292,7cyclictest7505-21ssh12:36:023
1838999299,4cyclictest0-21swapper/212:15:242
1838999296,14cyclictest0-21swapper/210:35:332
1838999293,4cyclictest7850irq/56-dwc_otg_07:30:372
1838999292,11cyclictest7950irq/56-dwc_otg_08:55:412
1838999287,5cyclictest7850irq/56-dwc_otg_11:30:442
1838999286,4cyclictest7950irq/56-dwc_otg_08:05:382
1838999286,4cyclictest7950irq/56-dwc_otg_08:05:382
1838999281,5cyclictest16874-21wget08:35:332
1838999281,4cyclictest7950irq/56-dwc_otg_07:20:462
179282284,15sleep10-21swapper/107:07:521
1838999273,12cyclictest7850irq/56-dwc_otg_12:35:192
1839099261,17cyclictest0-21swapper/307:14:003
1838999263,10cyclictest7950irq/56-dwc_otg_07:40:372
1838999251,13cyclictest0-21swapper/207:15:282
1838999241,3cyclictest7750irq/56-dwc_otg07:25:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional