You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 18:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Wed Dec 31, 2025 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2189221700,5sleep2771099cyclictest10:45:342
77089911057,45cyclictest0-21swapper/008:05:250
77089911057,45cyclictest0-21swapper/008:05:250
246352930,2sleep30-21swapper/307:55:293
298672920,4sleep029871-21latency_hist09:40:110
166722880,2sleep00-21swapper/010:30:390
152102780,2sleep00-21swapper/007:30:260
7708997742,19cyclictest0-21swapper/009:09:250
7711997417,40cyclictest30243-21fschecks_time09:40:283
770899729,54cyclictest20526-21/usr/sbin/munin12:10:380
770899717,56cyclictest10586-21fschecks_count10:15:280
770899693,14cyclictest0-21swapper/009:45:220
771099689,25cyclictest0-21swapper/209:45:222
659226847,11sleep30-21swapper/307:05:363
771199651,53cyclictest26420-21aten_rbpower_vo09:30:273
770899652,39cyclictest25948-21seq10:55:430
770899652,39cyclictest0-21swapper/011:50:230
771199641,47cyclictest8464-21modprobe11:40:113
7708996416,22cyclictest9310-21idleruntime-cro07:15:110
770899641,11cyclictest29071-21fschecks_time12:35:310
181422640,2sleep10-21swapper/112:05:271
771199634,10cyclictest7850irq/56-dwc_otg_08:20:233
770899638,36cyclictest30166-21cut09:40:280
770899631,6cyclictest8450-21idleruntime-cro11:40:100
771199613,5cyclictest7950irq/56-dwc_otg_12:35:403
771199611,50cyclictest28946-21expr09:35:373
770899616,42cyclictest0-21swapper/008:15:170
770899609,30cyclictest10493-21dpkg11:45:220
770899603,50cyclictest0-21swapper/012:33:030
207122600,1sleep20-21swapper/212:10:402
771199592,5cyclictest7850irq/56-dwc_otg_11:20:403
770899592,9cyclictest15047-21unixbench_multi10:25:400
7708995920,23cyclictest5771-21unixbench_singl08:30:400
771199582,38cyclictest7950irq/56-dwc_otg_10:50:273
771199582,38cyclictest7950irq/56-dwc_otg_10:50:273
7709995711,5cyclictest0-21swapper/107:15:161
770899573,43cyclictest0-21swapper/011:01:290
7708995730,11cyclictest22676-21fschecks_time07:50:290
7708995730,11cyclictest22676-21fschecks_time07:50:290
770899572,8cyclictest13119-21munin-run07:25:110
7708995721,7cyclictest0-21swapper/010:20:210
7708995715,7cyclictest2125-21unixbench_multi08:20:380
771199561,5cyclictest8975-21/usr/sbin/munin10:10:333
771199561,5cyclictest7950irq/56-dwc_otg_11:45:323
771199561,4cyclictest18246-21fschecks_time12:05:283
771199561,42cyclictest32352-21fschecks_count11:15:283
7708995616,22cyclictest2956-21aten_rbpower_en09:55:270
770899561,44cyclictest1735-21fschecks_count11:20:290
7708995614,32cyclictest9-21ksoftirqd/010:50:110
771199553,8cyclictest7950irq/56-dwc_otg_11:40:243
771199553,4cyclictest7850irq/56-dwc_otg_08:09:043
771199553,4cyclictest7850irq/56-dwc_otg_08:09:043
771199552,4cyclictest7950irq/56-dwc_otg_10:35:323
7711995518,34cyclictest2883-21aten_rbpower_en08:25:263
771199551,7cyclictest0-21swapper/309:55:253
771199551,4cyclictest27159-21taskset12:30:273
770899555,36cyclictest15127-21taskset08:59:100
7708995522,17cyclictest0-21swapper/012:05:320
770899551,46cyclictest0-21swapper/008:39:010
771199542,39cyclictest0-21swapper/311:30:403
771199541,5cyclictest4692-21runrttasks11:28:473
771199541,5cyclictest4692-21runrttasks11:28:473
771199541,5cyclictest30990-21ntp_states11:10:363
771099541,14cyclictest0-21swapper/211:55:252
770899545,33cyclictest13307-21chrt08:54:020
770899544,37cyclictest0-21swapper/007:39:390
770899542,29cyclictest16218-21grep09:00:370
7708995417,23cyclictest0-21swapper/008:10:250
771199536,44cyclictest12077-21latency_hist10:20:113
771199533,35cyclictest7850irq/56-dwc_otg_12:00:353
7711995313,37cyclictest19001-21fschecks_count07:40:263
770899534,38cyclictest28055-21latency_hist09:35:110
770899533,37cyclictest0-21swapper/010:39:560
7708995327,13cyclictest0-21swapper/009:25:110
771199528,41cyclictest13981-21fschecks_time08:55:303
771199523,32cyclictest0-21swapper/308:10:233
771199522,7cyclictest18368-21unixbench_multi09:05:383
771199522,40cyclictest0-21swapper/308:38:493
771199521,43cyclictest0-21swapper/309:48:373
771199521,42cyclictest0-21swapper/309:17:133
771199521,18cyclictest0-21swapper/309:25:113
7711995210,39cyclictest31759-21aten_rbpower_vo08:15:263
770999521,13cyclictest0-21swapper/109:40:221
770899528,7cyclictest0-21swapper/012:20:230
770899524,27cyclictest24108-21unixbench_singl10:50:390
770899524,27cyclictest24108-21unixbench_singl10:50:390
770899521,39cyclictest21061-21sed10:45:120
770899521,33cyclictest24262-21aten_rbpower_po07:55:240
770899521,32cyclictest0-21swapper/009:15:300
771199512,46cyclictest28229-21latency_hist11:05:113
771199512,16cyclictest0-21swapper/312:10:293
771199511,4cyclictest7950irq/56-dwc_otg_08:01:323
7708995130,5cyclictest7950irq/56-dwc_otg_08:25:400
770899512,30cyclictest14506-21grep07:25:400
770899512,27cyclictest0-21swapper/011:55:260
770899511,7cyclictest7598-21chrt10:05:390
770899511,33cyclictest25481-21grep12:25:310
771199509,37cyclictest17075-21cpu07:35:263
771199504,4cyclictest7750irq/56-dwc_otg08:50:233
771199502,45cyclictest25400-21fschecks_count12:25:303
771199502,44cyclictest23121-21ps07:50:363
771199502,44cyclictest23121-21ps07:50:363
771199501,7cyclictest23741-21if_eth012:20:293
770899508,28cyclictest8756-21cut10:10:300
770899503,30cyclictest0-21swapper/008:01:460
771199495,40cyclictest0-21swapper/311:05:283
771199492,5cyclictest19469-21wget10:40:253
771199492,2cyclictest0-21swapper/310:05:223
771199491,8cyclictest20651-21aten_rbpower_po07:45:233
771199491,8cyclictest13535-21head11:50:403
771199491,8cyclictest0-21swapper/310:20:333
771199491,7cyclictest25633-21sed09:25:403
771199491,7cyclictest25633-21sed09:25:403
771199491,7cyclictest10722-21ntp_kernel_pll_08:45:353
771199491,6cyclictest5017-21fschecks_time10:00:293
771199491,4cyclictest7950irq/56-dwc_otg_10:31:463
771199491,40cyclictest0-21swapper/307:12:033
7710994910,25cyclictest0-21swapper/210:15:172
7708994930,7cyclictest0-21swapper/011:19:360
7708994922,6cyclictest21645-21unixbench-2d07:45:360
771199482,4cyclictest9643-21apt-get07:15:223
771199481,7cyclictest21596-21if_wlan010:45:283
771199481,7cyclictest15286-21cpu07:30:273
771199481,4cyclictest0-21swapper/309:02:033
771099482,10cyclictest31-21ksoftirqd/212:35:252
770899482,36cyclictest0-21swapper/008:44:030
770899482,36cyclictest0-21swapper/008:44:030
770899482,28cyclictest0-21swapper/012:00:290
770899482,25cyclictest0-21swapper/011:10:310
771199477,26cyclictest0-21swapper/310:55:273
771199472,8cyclictest12669-21tail07:20:383
771199472,3cyclictest0-21swapper/312:15:363
771199471,7cyclictest19574-21cut09:10:333
771199471,6cyclictest15224-21wc11:55:403
771199471,6cyclictest13976-21aten_rbpower_cu10:25:263
771199471,5cyclictest0-21swapper/308:45:113
771199471,5cyclictest0-21swapper/308:45:113
771099477,26cyclictest0-21swapper/212:20:242
771099477,25cyclictest0-21swapper/208:10:232
771099471,4cyclictest32354-21grep11:15:282
770999473,8cyclictest7950irq/56-dwc_otg_10:25:251
770899474,20cyclictest0-21swapper/011:42:330
7708994727,10cyclictest0-21swapper/011:28:450
7708994727,10cyclictest0-21swapper/011:28:450
771199462,41cyclictest0-21swapper/307:25:293
771199461,5cyclictest5094-21uname08:30:313
771199461,5cyclictest1148-21/usr/sbin/munin09:50:253
770999467,25cyclictest0-21swapper/108:50:231
770999467,24cyclictest0-21swapper/109:20:251
770899466,19cyclictest24860-21ls09:25:300
770899466,19cyclictest24860-21ls09:25:300
770899462,26cyclictest22079-21missed_timers12:15:320
770899461,5cyclictest4733-21wget10:00:250
770899460,11cyclictest6531-21taskset11:34:080
771099457,24cyclictest0-21swapper/209:00:262
770999457,25cyclictest0-21swapper/108:30:251
770999457,24cyclictest0-21swapper/111:05:161
770999457,22cyclictest0-21swapper/107:30:261
770999456,25cyclictest0-21swapper/108:20:241
7709994526,7cyclictest28820-21ntp_states09:35:351
7709994524,7cyclictest11020-21ntp_states10:15:351
7709994518,9cyclictest0-21swapper/109:55:251
770899452,35cyclictest11315-21taskset08:46:380
72902452,13sleep00-21swapper/007:08:240
771099446,24cyclictest0-21swapper/207:35:242
770999447,24cyclictest0-21swapper/107:20:161
770899444,27cyclictest20074-21chrt07:42:050
770899441,25cyclictest0-21swapper/009:50:350
7708994411,30cyclictest101ktimersoftd/009:11:540
771099437,22cyclictest0-21swapper/211:00:252
771099436,24cyclictest0-21swapper/209:40:242
770999438,12cyclictest11486-21cat11:45:381
770999434,10cyclictest0-21swapper/107:50:231
770999434,10cyclictest0-21swapper/107:50:231
7709994317,15cyclictest0-21swapper/111:30:261
7708994317,4cyclictest28906-21if_wlan011:05:300
7708994313,23cyclictest0-21swapper/007:19:150
771099427,25cyclictest0-21swapper/209:35:252
770999429,23cyclictest0-21swapper/110:00:251
770999427,22cyclictest0-21swapper/110:40:241
771099419,7cyclictest31-21ksoftirqd/211:39:332
771099418,24cyclictest0-21swapper/210:10:162
771099414,24cyclictest0-21swapper/207:20:172
771099413,22cyclictest7750irq/56-dwc_otg11:45:382
770999417,24cyclictest15992-21ls09:00:331
770999416,21cyclictest0-21swapper/112:00:231
770999416,21cyclictest0-21swapper/110:55:271
7709994117,5cyclictest4385-21latency_hist08:30:111
770999411,21cyclictest0-21swapper/110:50:221
770999411,21cyclictest0-21swapper/110:50:221
770999410,23cyclictest29408-21/usr/sbin/munin12:35:351
771099409,8cyclictest0-21swapper/209:30:262
7710994020,11cyclictest24260-21aten_rbpower_po07:55:242
770999406,24cyclictest0-21swapper/108:15:171
770999403,27cyclictest0-21swapper/112:15:281
7709994025,4cyclictest221ktimersoftd/111:15:391
770999401,5cyclictest7950irq/56-dwc_otg_08:05:341
770999401,5cyclictest7950irq/56-dwc_otg_08:05:341
770999401,25cyclictest21479-21fschecks_time10:45:271
771099393,14cyclictest29-21rcuc/210:55:432
771099392,7cyclictest8073-21fschecks_time07:10:282
770999393,8cyclictest0-21swapper/110:30:251
7709993927,10cyclictest17854-21fschecks_time10:35:281
770999383,13cyclictest7950irq/56-dwc_otg_11:35:251
7709993819,5cyclictest14170-21sed08:55:331
770999381,18cyclictest20581-21switchtime12:10:381
771099379,17cyclictest0-21swapper/212:25:272
771099377,18cyclictest301ktimersoftd/211:31:542
771099377,18cyclictest0-21swapper/211:50:162
771099376,17cyclictest7750irq/56-dwc_otg11:12:422
7710993719,4cyclictest29-21rcuc/209:25:072
770999371,18cyclictest7669-21dhclient-script08:36:151
770999370,18cyclictest27907-21latency_hist09:35:111
771099362,21cyclictest7750irq/56-dwc_otg10:10:022
7710993618,11cyclictest31-21ksoftirqd/211:20:232
7710993614,5cyclictest3981-21/usr/sbin/munin09:55:412
7710993613,8cyclictest29-21rcuc/211:28:402
7710993613,8cyclictest29-21rcuc/211:28:402
770999361,16cyclictest0-21swapper/109:17:111
770999360,18cyclictest1858-21/usr/sbin/munin11:20:311
770999360,17cyclictest0-21swapper/110:10:251
771099357,5cyclictest7850irq/56-dwc_otg_07:25:402
771099352,5cyclictest7950irq/56-dwc_otg_09:15:232
770999357,16cyclictest7950irq/56-dwc_otg_11:50:231
770999354,21cyclictest27149-21df12:30:261
770999351,11cyclictest7850irq/56-dwc_otg_10:10:121
770999351,10cyclictest128-21systemd-journal12:24:511
771099347,24cyclictest0-21swapper/212:05:172
771099346,14cyclictest7850irq/56-dwc_otg_08:15:152
771099345,18cyclictest0-21swapper/210:20:392
771099342,23cyclictest7750irq/56-dwc_otg12:16:252
771099341,23cyclictest1588-21ls09:50:312
770999342,15cyclictest0-21swapper/109:49:571
770999342,14cyclictest9297-21apt-get07:15:111
770999341,19cyclictest0-21swapper/108:42:181
770999341,19cyclictest0-21swapper/108:42:181
770999341,14cyclictest30389-21aten_rbpower_vo11:10:271
771099338,18cyclictest0-21swapper/209:05:432
771099337,14cyclictest0-21swapper/207:45:222
771099335,7cyclictest7950irq/56-dwc_otg_08:35:392
771099333,8cyclictest22607-21chrt07:50:292
771099333,8cyclictest22607-21chrt07:50:292
771099332,14cyclictest7950irq/56-dwc_otg_08:50:102
771099331,4cyclictest0-21swapper/208:02:402
7709993315,4cyclictest19171-21aten_rbpower_po09:10:281
770999331,2cyclictest0-21swapper/109:05:231
770999331,22cyclictest0-21swapper/111:40:191
770999331,17cyclictest18790-21aten_rbpower_cu07:40:231
7709993311,7cyclictest0-21swapper/109:30:051
7709993311,7cyclictest0-21swapper/109:30:051
770999330,17cyclictest266792sleep112:30:031
770999330,13cyclictest10169-21cpu08:45:271
771099324,6cyclictest7850irq/56-dwc_otg_10:25:412
7710993213,8cyclictest29-21rcuc/209:29:562
7710993213,8cyclictest29-21rcuc/209:29:562
770999328,9cyclictest0-21swapper/108:00:231
770999321,21cyclictest24163-21/usr/sbin/munin07:55:311
770999321,21cyclictest0-21swapper/111:00:251
770999321,18cyclictest0-21swapper/107:46:401
770999321,14cyclictest0-21swapper/107:37:161
770999321,12cyclictest0-21swapper/110:20:141
770999320,23cyclictest1125-21runrttasks11:59:501
770999320,12cyclictest2320-21chrt09:51:111
771099317,7cyclictest24384-21packagekitd08:55:302
771099315,18cyclictest7750irq/56-dwc_otg10:50:332
771099315,18cyclictest7750irq/56-dwc_otg10:50:332
771099314,6cyclictest31-21ksoftirqd/212:02:062
771099313,7cyclictest0-21swapper/208:40:392
771099313,7cyclictest0-21swapper/208:40:392
771099312,19cyclictest7750irq/56-dwc_otg11:09:242
7710993115,10cyclictest7750irq/56-dwc_otg07:32:272
771099311,3cyclictest0-21swapper/209:10:422
7710993113,8cyclictest29-21rcuc/208:06:422
7710993113,8cyclictest29-21rcuc/208:06:422
771099311,21cyclictest15942-21cpuspeed10:30:272
771099311,18cyclictest7750irq/56-dwc_otg08:33:382
770999318,17cyclictest0-21swapper/108:10:211
770999313,6cyclictest3574-21tune2fs11:25:301
770999313,6cyclictest3574-21tune2fs11:25:301
771099304,5cyclictest7750irq/56-dwc_otg10:35:342
771099304,5cyclictest1710-21ntp_states08:20:332
771099303,4cyclictest7750irq/56-dwc_otg10:40:222
7710993023,5cyclictest31-21ksoftirqd/207:40:212
771099302,18cyclictest0-21swapper/211:40:332
771099302,17cyclictest31-21ksoftirqd/207:17:102
771099301,25cyclictest12174-21uniq08:50:272
770999301,20cyclictest0-21swapper/107:25:181
771099296,6cyclictest128-21systemd-journal10:04:212
771099294,17cyclictest7850irq/56-dwc_otg_12:30:282
771099293,17cyclictest31-21ksoftirqd/208:28:552
72102292,20sleep20-21swapper/207:07:212
65232294,17sleep16572-21tr07:05:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional