You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 21:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Thu Aug 20, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1928022740,3sleep20-21swapper/207:05:212
209829913916,104cyclictest0-21swapper/312:15:153
20979991334,106cyclictest24312-21ssh12:15:160
20979991273,7cyclictest0-21swapper/010:05:200
20979991215,79cyclictest0-21swapper/012:25:360
20979991153,105cyclictest0-21swapper/011:25:350
712221110,9sleep02097999cyclictest08:00:270
20979991105,80cyclictest19320-21ssh10:50:280
20979991093,11cyclictest29265-21ntp_states12:20:330
20979991052,9cyclictest6363-21apt-get10:35:240
20979991032,9cyclictest30520-21apt-get10:25:190
237042970,2sleep30-21swapper/312:14:443
208972940,2sleep30-21swapper/310:51:593
2097999926,70cyclictest0-21swapper/012:35:220
119542870,5sleep12098099cyclictest12:00:211
20980998516,34cyclictest31517-21systemd-journal10:05:201
2097999842,8cyclictest19343-21unixbench_multi10:10:360
2097999842,8cyclictest19343-21unixbench_multi10:10:360
20979998420,53cyclictest4805-21awk09:15:290
284822830,2sleep20-21swapper/212:20:192
2097999833,71cyclictest11217-21ssh10:00:400
2097999831,7cyclictest20429-21grep12:10:250
2097999826,58cyclictest30537-21switchtime09:45:330
2097999802,69cyclictest0-21swapper/009:10:200
209202790,5sleep22098199cyclictest10:52:022
2097999787,4cyclictest0-21swapper/011:40:360
2097999785,66cyclictest13064-21ssh12:00:360
2097999782,8cyclictest0-21swapper/008:05:320
20979997815,47cyclictest2469-21sh10:30:240
75922770,2sleep07593-21ssh09:56:450
20979997715,46cyclictest11197-21rm11:20:190
20979997715,46cyclictest11197-21rm11:20:190
2097999764,54cyclictest0-21swapper/008:40:220
2097999764,54cyclictest0-21swapper/008:40:220
2097999761,56cyclictest2969-21ssh09:51:040
20982997543,10cyclictest381ktimersoftd/311:25:353
2098199756,46cyclictest0-21swapper/212:25:372
20981997525,16cyclictest15327-21apt-get11:25:232
2098099753,50cyclictest7750irq/56-dwc_otg12:25:361
20980997430,24cyclictest7750irq/56-dwc_otg11:25:231
2097999741,55cyclictest3000-21ssh11:49:370
20979997414,51cyclictest9835-21ssh09:20:530
20979997414,45cyclictest0-21swapper/012:30:260
2098299733,48cyclictest0-21swapper/312:25:413
2097999732,55cyclictest0-21swapper/009:04:570
2097999731,55cyclictest6027-21taskset11:52:350
20979997311,4cyclictest22573-21grep10:15:250
20981997226,24cyclictest14046-21ssh10:05:232
20979997219,32cyclictest0-21swapper/011:05:190
20979997214,42cyclictest0-21swapper/010:46:530
20979997114,38cyclictest29381-21unixbench_singl07:30:350
20980997014,41cyclictest0-21swapper/112:20:361
2097999706,14cyclictest0-21swapper/011:30:210
2097999697,29cyclictest0-21swapper/007:45:180
2097999691,48cyclictest0-21swapper/010:44:100
2097999689,6cyclictest0-21swapper/011:02:250
20979996826,7cyclictest0-21swapper/011:55:180
20979996815,42cyclictest0-21swapper/010:21:500
2097999681,52cyclictest0-21swapper/007:25:350
20982996718,32cyclictest0-21swapper/312:00:373
20982996715,15cyclictest39-21ksoftirqd/310:05:213
20981996723,26cyclictest24324-21awk12:15:162
20980996715,32cyclictest7750irq/56-dwc_otg10:50:271
2097999663,48cyclictest0-21swapper/007:20:210
20979996615,31cyclictest7950irq/56-dwc_otg_09:30:290
20979996611,45cyclictest23483-21taskset11:35:120
2097999661,12cyclictest0-21swapper/010:58:400
2097999661,12cyclictest0-21swapper/010:58:400
20980996532,13cyclictest7850irq/56-dwc_otg_10:00:391
2097999652,47cyclictest0-21swapper/009:40:230
20979996515,36cyclictest0-21swapper/011:14:200
2097999651,45cyclictest10432-21ssh11:19:220
20980996410,30cyclictest0-21swapper/110:35:241
2097999646,6cyclictest0-21swapper/008:25:170
2097999646,6cyclictest0-21swapper/008:25:170
2097999643,47cyclictest0-21swapper/009:37:410
2097999641,41cyclictest0-21swapper/012:06:290
2097999631,6cyclictest7850irq/56-dwc_otg_09:10:080
2097999622,16cyclictest0-21swapper/008:35:140
20980996124,15cyclictest0-21swapper/110:25:191
20980996123,16cyclictest7750irq/56-dwc_otg12:15:171
2097999611,42cyclictest0-21swapper/007:15:210
2097999611,15cyclictest0-21swapper/008:15:240
2098299604,33cyclictest0-21swapper/312:20:283
20981996012,28cyclictest7850irq/56-dwc_otg_10:00:372
20981996012,27cyclictest7850irq/56-dwc_otg_12:00:372
2097999601,11cyclictest0-21swapper/009:25:330
16552600,2sleep20-21swapper/210:29:442
20979995914,41cyclictest27842-21grep08:55:360
2097999591,13cyclictest0-21swapper/007:14:410
2097999586,22cyclictest0-21swapper/008:50:220
2097999582,7cyclictest0-21swapper/008:21:430
2097999582,43cyclictest0-21swapper/007:41:120
2098299573,29cyclictest0-21swapper/310:00:393
20979995713,36cyclictest0-21swapper/007:52:150
320862560,4sleep332084-21ssh10:26:033
2097999561,42cyclictest18814-21runrttasks08:32:110
20979995611,41cyclictest0-21swapper/008:50:070
2097999561,13cyclictest0-21swapper/008:11:000
151722560,2sleep30-21swapper/310:45:273
2098299555,36cyclictest18153-21ssh10:10:213
2098299555,36cyclictest18153-21ssh10:10:213
2098199556,35cyclictest7850irq/56-dwc_otg_10:35:222
2098299543,5cyclictest0-21swapper/309:35:203
20982995413,24cyclictest7950irq/56-dwc_otg_10:35:213
2097999538,3cyclictest0-21swapper/007:40:080
2098199522,13cyclictest0-21swapper/209:45:192
20980995216,24cyclictest0-21swapper/108:00:221
20981995112,29cyclictest0-21swapper/208:40:212
20981995112,29cyclictest0-21swapper/208:40:212
20979995127,5cyclictest30076-21wget07:35:210
20981995025,8cyclictest7950irq/56-dwc_otg_11:35:312
2097999501,12cyclictest0-21swapper/007:57:150
2098199493,29cyclictest0-21swapper/209:25:202
20981994915,13cyclictest0-21swapper/212:10:502
205942493,39sleep00-21swapper/007:08:430
2098199485,20cyclictest4481-21cat09:15:252
2098299477,25cyclictest0-21swapper/308:45:133
2098199478,16cyclictest0-21swapper/209:00:202
2098199474,22cyclictest0-21swapper/208:50:222
20981994714,8cyclictest32257-21apt-get09:10:202
20981994714,16cyclictest14638-21dpkg10:45:152
2098099477,25cyclictest0-21swapper/107:10:201
2098199467,25cyclictest0-21swapper/207:10:202
2098199466,24cyclictest19062-21apt-get08:35:132
2098199464,25cyclictest0-21swapper/208:15:202
20981994623,8cyclictest7950irq/56-dwc_otg_11:56:082
2098199461,9cyclictest0-21swapper/209:35:222
2098099457,23cyclictest0-21swapper/109:05:211
2098199448,17cyclictest0-21swapper/212:35:222
2098199447,25cyclictest0-21swapper/207:25:212
20981994434,7cyclictest301ktimersoftd/210:30:212
2098199443,26cyclictest6374-21ssh11:53:142
2098199439,17cyclictest7850irq/56-dwc_otg_11:02:232
2098199436,13cyclictest11175-21apt-get11:20:182
2098199436,13cyclictest11175-21apt-get11:20:182
20981994317,11cyclictest7850irq/56-dwc_otg_07:30:312
2098099437,22cyclictest0-21swapper/108:45:141
69602420,2sleep220978-21cyclictest11:15:092
66652420,2sleep10-21swapper/109:17:491
2098299427,25cyclictest0-21swapper/309:15:203
2098199427,20cyclictest9813-21ssh09:20:512
2098199425,15cyclictest0-21swapper/208:25:172
2098199425,15cyclictest0-21swapper/208:25:172
20981994223,9cyclictest25686-21uniq09:40:252
2098099428,22cyclictest0-21swapper/108:35:131
2098099424,24cyclictest0-21swapper/108:40:221
2098099424,24cyclictest0-21swapper/108:40:221
2098099423,29cyclictest0-21swapper/109:30:081
20980994217,5cyclictest27579-21if_wlan011:00:271
20980994216,8cyclictest0-21swapper/109:40:241
2098299417,22cyclictest0-21swapper/308:20:203
2098299411,4cyclictest16017-21ssh12:05:203
20982994110,3cyclictest0-21swapper/309:11:203
2098199418,11cyclictest0-21swapper/211:05:212
2098199417,22cyclictest0-21swapper/212:05:222
2098199417,21cyclictest17670-21ls08:30:232
2098199417,16cyclictest12702-21ssh10:42:162
2098199416,25cyclictest0-21swapper/209:55:222
2098199416,24cyclictest0-21swapper/207:55:212
2098199416,21cyclictest0-21swapper/209:05:212
2098199414,22cyclictest24810-21taskset10:56:342
2098199414,22cyclictest24810-21taskset10:56:342
20981994117,7cyclictest7850irq/56-dwc_otg_11:41:042
20981994114,13cyclictest7950irq/56-dwc_otg_12:33:152
2098099419,20cyclictest7850irq/56-dwc_otg_11:55:181
20981994026,4cyclictest7950irq/56-dwc_otg_08:05:332
20981994018,8cyclictest7850irq/56-dwc_otg_10:21:472
20981994014,10cyclictest7950irq/56-dwc_otg_09:51:012
2098099407,23cyclictest0-21swapper/109:45:201
2098099403,28cyclictest0-21swapper/111:05:191
20980994017,9cyclictest221ktimersoftd/110:45:141
2098299397,24cyclictest0-21swapper/308:00:223
2098299396,22cyclictest0-21swapper/309:25:213
2098299391,26cyclictest0-21swapper/309:05:263
2098299391,24cyclictest16050-21ls08:25:243
2098299391,24cyclictest16050-21ls08:25:243
2098199392,6cyclictest0-21swapper/208:55:212
2098199391,24cyclictest0-21swapper/208:45:142
2098099393,6cyclictest0-21swapper/112:10:201
2098099393,28cyclictest0-21swapper/107:15:201
2098099393,24cyclictest0-21swapper/108:05:221
2098099392,22cyclictest21-21rcuc/112:35:541
20980993920,5cyclictest221ktimersoftd/107:45:211
14272390,2sleep20-21swapper/211:46:452
116942390,2sleep30-21swapper/309:24:113
275412380,1sleep30-21swapper/308:55:333
2098299382,12cyclictest7950irq/56-dwc_otg_08:30:223
2098299381,4cyclictest0-21swapper/308:50:213
2098299381,27cyclictest26718-21grep07:25:253
2098199389,8cyclictest0-21swapper/207:45:182
20981993817,7cyclictest0-21swapper/211:30:092
20981993815,11cyclictest301ktimersoftd/210:16:102
20981993812,15cyclictest301ktimersoftd/210:10:312
20981993812,15cyclictest301ktimersoftd/210:10:312
20980993813,14cyclictest221ktimersoftd/110:30:271
2098099381,19cyclictest7750irq/56-dwc_otg09:35:211
2098299373,4cyclictest7718-21/usr/sbin/munin11:55:363
2098299371,26cyclictest13720-21ls08:20:083
2098299371,22cyclictest1518-21cut07:45:243
2098199379,14cyclictest0-21swapper/209:34:322
20981993718,8cyclictest114612sleep208:10:402
2098099377,25cyclictest6224-21ls09:55:291
2098099373,15cyclictest221ktimersoftd/110:16:131
2098099372,17cyclictest0-21swapper/107:55:201
2098099371,15cyclictest7750irq/56-dwc_otg07:40:361
204292370,3sleep3381ktimersoftd/309:34:373
2098299368,4cyclictest0-21swapper/310:41:163
2098299366,22cyclictest0-21swapper/307:10:203
2098299365,19cyclictest27103-21ssh11:00:213
2098299363,5cyclictest7750irq/56-dwc_otg10:20:273
20981993620,5cyclictest4135-21grep07:50:332
2098099369,9cyclictest221ktimersoftd/107:25:111
2098099367,6cyclictest23-21ksoftirqd/111:35:081
2098099365,8cyclictest23-21ksoftirqd/108:35:071
20980993618,8cyclictest7750irq/56-dwc_otg09:51:171
20980993618,5cyclictest7070-21sh11:15:191
20980993613,8cyclictest221ktimersoftd/110:10:331
20980993613,8cyclictest221ktimersoftd/110:10:331
20980993612,9cyclictest221ktimersoftd/107:20:211
20980993612,5cyclictest7750irq/56-dwc_otg08:10:351
2098099361,19cyclictest8986-21ssh09:20:291
72732350,2sleep10-21swapper/111:54:541
64382350,1sleep30-21swapper/311:14:383
2098299357,15cyclictest0-21swapper/311:15:213
2098299351,3cyclictest0-21swapper/309:40:223
20981993511,13cyclictest0-21swapper/207:43:522
2098099358,13cyclictest7750irq/56-dwc_otg11:38:071
20980993515,5cyclictest17236-21grep12:05:371
20980993512,6cyclictest221ktimersoftd/110:22:011
20980993511,14cyclictest0-21swapper/108:15:191
20980993510,14cyclictest11664-21if_wlan011:20:251
20980993510,14cyclictest11664-21if_wlan011:20:251
2098299347,15cyclictest0-21swapper/311:45:143
2098299346,15cyclictest0-21swapper/310:15:213
2098299342,3cyclictest0-21swapper/307:35:183
2098299342,3cyclictest0-21swapper/307:35:183
20982993419,4cyclictest20184-21ntp_states11:30:313
2098299341,6cyclictest7950irq/56-dwc_otg_10:55:183
2098299341,6cyclictest7950irq/56-dwc_otg_10:55:183
2098299341,22cyclictest5237-21ls12:30:333
2098199344,14cyclictest7850irq/56-dwc_otg_07:35:352
2098199344,14cyclictest7850irq/56-dwc_otg_07:35:352
2098099348,6cyclictest23-21ksoftirqd/112:30:211
2098099347,15cyclictest0-21swapper/111:45:131
2098099346,14cyclictest21-21rcuc/108:24:031
2098099345,7cyclictest12581-21chrt10:42:031
20980993421,4cyclictest221ktimersoftd/111:42:441
20980993411,6cyclictest7850irq/56-dwc_otg_07:30:271
2098299335,4cyclictest7750irq/56-dwc_otg09:45:213
2098299334,8cyclictest39-21ksoftirqd/311:20:183
2098299334,8cyclictest39-21ksoftirqd/311:20:183
2098299332,4cyclictest0-21swapper/311:41:353
2098299331,6cyclictest29631-21grep09:00:353
2098199337,12cyclictest7850irq/56-dwc_otg_11:11:422
2098199333,9cyclictest0-21swapper/207:20:182
2098099335,6cyclictest21-21rcuc/111:12:251
2098099333,6cyclictest31919-21diskmemload10:55:201
2098099333,6cyclictest31919-21diskmemload10:55:201
2098099332,14cyclictest31690-21date07:40:081
2098099332,14cyclictest31690-21date07:40:081
2098299329,6cyclictest37-21rcuc/308:10:243
2098299322,8cyclictest3479-21unixbench_multi10:30:373
20982993210,8cyclictest9004-21wc12:35:293
2098199321,21cyclictest7850irq/56-dwc_otg_08:00:262
2098099322,12cyclictest7750irq/56-dwc_otg08:29:231
2098099322,12cyclictest7750irq/56-dwc_otg08:29:231
20980993217,4cyclictest19651-21sh09:33:161
2098099321,4cyclictest0-21swapper/109:01:321
2098299319,4cyclictest0-21swapper/309:55:073
2098299317,10cyclictest7950irq/56-dwc_otg_07:15:323
2098299316,15cyclictest0-21swapper/311:05:213
2098299316,15cyclictest0-21swapper/309:58:333
2098299314,5cyclictest9581-21grep08:05:383
2098299313,14cyclictest7950irq/56-dwc_otg_08:40:373
2098299313,14cyclictest7950irq/56-dwc_otg_08:40:373
2098299311,21cyclictest3404-21idleruntime07:50:233
2098199317,5cyclictest0-21swapper/208:24:032
2098099313,18cyclictest221ktimersoftd/109:10:191
2098099311,15cyclictest0-21swapper/107:52:051
20980993110,4cyclictest7750irq/56-dwc_otg08:53:461
2098299307,14cyclictest0-21swapper/308:35:123
20982993024,4cyclictest23556-21ssh11:35:193
20982993015,8cyclictest39-21ksoftirqd/307:40:183
20982993010,5cyclictest373250wget11:50:223
2098299296,5cyclictest7850irq/56-dwc_otg_07:30:203
2098299293,10cyclictest7750irq/56-dwc_otg07:20:183
2098099291,24cyclictest27231-21ls08:55:281
2098299285,6cyclictest5149-21fschecks_time07:55:253
2098199281,3cyclictest0-21swapper/207:15:292
204002284,16sleep10-21swapper/107:06:181
203802272,15sleep30-21swapper/307:06:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional