You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 16:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Wed Aug 26, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1654826370,5sleep20-21swapper/207:05:362
17630991105,64cyclictest0-21swapper/010:05:370
2003321080,32sleep27950irq/56-dwc_otg_12:15:152
17630991075,80cyclictest0-21swapper/009:50:140
17630991023,77cyclictest0-21swapper/011:40:420
176319910011,8cyclictest0-21swapper/111:40:291
164322970,5sleep30-21swapper/307:05:333
1763099922,72cyclictest11-21rcu_preempt11:15:340
156062910,3sleep121-21rcuc/110:50:361
1763099903,64cyclictest0-21swapper/009:20:230
5302860,12sleep27950irq/56-dwc_otg_11:11:182
1763099864,53cyclictest0-21swapper/011:20:400
1763399853,22cyclictest0-21swapper/311:20:393
1763199845,13cyclictest0-21swapper/110:05:361
1763199842,19cyclictest29854-21apt-key09:50:121
198162830,2sleep10-21swapper/109:37:331
1763199833,8cyclictest0-21swapper/111:15:351
313372820,11sleep27950irq/56-dwc_otg_10:30:322
1763199825,17cyclictest7850irq/56-dwc_otg_09:20:241
154752810,5sleep315472-21users10:10:403
1763199788,10cyclictest0-21swapper/111:20:391
1763199783,15cyclictest60-21kswapd010:45:241
1763199783,15cyclictest60-21kswapd010:45:241
281132740,2sleep00-21swapper/012:25:120
281132740,2sleep00-21swapper/012:25:120
170242742,64sleep00-21swapper/007:05:550
80922720,2sleep20-21swapper/209:23:492
237572720,2sleep10-21swapper/108:55:301
65192710,2sleep10-21swapper/111:58:441
81612700,1sleep10-21swapper/110:02:251
223172700,6sleep11763199cyclictest10:20:121
223172700,6sleep11763199cyclictest10:20:121
1763199701,6cyclictest26848-21/usr/sbin/munin10:25:291
279952690,1sleep20-21swapper/211:45:282
17633996920,27cyclictest7850irq/56-dwc_otg_09:50:143
152382680,2sleep337-21rcuc/308:30:363
241122670,2sleep20-21swapper/208:55:352
1763399677,25cyclictest0-21swapper/307:20:243
117582670,2sleep311759-21timerwakeupswit08:20:383
6852660,5sleep31763399cyclictest11:11:353
1763099660,55cyclictest19404-21kworker/0:108:50:100
17632996519,23cyclictest24807-21timerwakeupswit11:40:432
17630996547,4cyclictest0-21swapper/012:10:230
288412640,1sleep20-21swapper/207:40:282
1763399645,13cyclictest23892-21df_inode11:40:293
1763199638,15cyclictest7950irq/56-dwc_otg_09:35:111
1763099634,34cyclictest0-21swapper/008:25:390
142152630,2sleep20-21swapper/211:28:412
1763399622,34cyclictest10823-21ntp_states10:05:363
1763199613,5cyclictest7950irq/56-dwc_otg_11:30:331
1763199604,11cyclictest7950irq/56-dwc_otg_08:00:241
1763199602,8cyclictest8275-21grep08:10:401
1763199601,6cyclictest7850irq/56-dwc_otg_11:05:111
231602590,1sleep00-21swapper/009:41:060
1763399593,28cyclictest3761-21ntpq11:15:343
1763299596,12cyclictest7850irq/56-dwc_otg_11:15:342
17631995917,6cyclictest11604-21fschecks_time11:25:271
1763199591,5cyclictest0-21swapper/110:24:011
17631995816,6cyclictest1180-21runrttasks12:37:291
17630995824,14cyclictest0-21swapper/008:00:280
1763199577,5cyclictest0-21swapper/109:45:251
1763199577,5cyclictest0-21swapper/109:45:251
1763199575,23cyclictest23-21ksoftirqd/109:40:221
17630995747,4cyclictest7750irq/56-dwc_otg11:00:110
1763099572,12cyclictest0-21swapper/012:30:110
167332570,2sleep30-21swapper/309:34:293
1763199561,5cyclictest32279-21ssh11:10:371
1763099561,42cyclictest4709-21sh09:20:110
1763099561,41cyclictest0-21swapper/011:50:310
1763099561,40cyclictest0-21swapper/010:04:100
1763099561,36cyclictest9450irq/48-DMA08:56:170
1763099558,25cyclictest0-21swapper/010:10:280
1763099554,35cyclictest31517-21systemd-journal11:40:110
1763099553,28cyclictest0-21swapper/008:00:100
1763199546,3cyclictest0-21swapper/110:44:531
1763099542,37cyclictest0-21swapper/007:35:240
1763099541,43cyclictest28597-21sh09:10:110
1763099541,41cyclictest0-21swapper/011:02:360
1763199534,4cyclictest0-21swapper/112:34:371
1763099537,30cyclictest22278-21latency_hist10:20:120
1763099537,30cyclictest22278-21latency_hist10:20:120
17630995328,6cyclictest2462-21aten_rbpower_cu10:35:250
1763099531,42cyclictest0-21swapper/010:49:280
1763099531,42cyclictest0-21swapper/010:49:280
17630995313,37cyclictest28605-21diskmemload10:40:290
1763099531,30cyclictest31517-21systemd-journal09:00:100
17633995241,8cyclictest7950irq/56-dwc_otg_12:35:223
1763199523,4cyclictest32306-21ssh09:14:131
17630995236,5cyclictest4421-21ssh12:35:280
1763099522,39cyclictest5559-21grep08:05:280
1763099522,36cyclictest0-21swapper/011:32:490
1763099522,25cyclictest30408-21wc07:45:120
1763099521,44cyclictest0-21swapper/010:25:400
1763099521,31cyclictest0-21swapper/011:25:300
1763099521,27cyclictest30159-21ssh09:10:390
17632995110,35cyclictest7850irq/56-dwc_otg_09:50:152
1763099514,25cyclictest0-21swapper/010:20:400
17630995129,5cyclictest0-21swapper/012:05:220
17630995127,7cyclictest7850irq/56-dwc_otg_12:15:240
17630995127,14cyclictest7950irq/56-dwc_otg_08:30:290
1763099512,37cyclictest0-21swapper/010:30:250
1763099512,35cyclictest25849-21ssh09:45:260
1763099512,35cyclictest25849-21ssh09:45:260
17630995118,23cyclictest11182-21ssh12:04:440
1763099511,37cyclictest1180-21runrttasks09:29:430
1763099511,20cyclictest31537-21ssh11:50:110
1763399507,28cyclictest7850irq/56-dwc_otg_09:20:233
17633995034,9cyclictest7950irq/56-dwc_otg_09:10:213
1763299502,26cyclictest7750irq/56-dwc_otg10:05:382
17630995025,14cyclictest0-21swapper/008:15:320
1763099502,32cyclictest32743-21fschecks_count12:30:270
1763199497,26cyclictest0-21swapper/108:15:241
1763199494,6cyclictest7950irq/56-dwc_otg_08:30:221
1763199494,10cyclictest0-21swapper/111:50:411
17630994933,5cyclictest9450irq/48-DMA08:56:170
17630994915,19cyclictest3226050ssh11:10:370
1763099491,33cyclictest22717-21unixbench_multi08:50:390
17630994828,10cyclictest0-21swapper/010:50:370
17630994823,12cyclictest0-21swapper/008:20:520
163272480,1sleep20-21swapper/210:12:122
1763299474,7cyclictest7850irq/56-dwc_otg_10:40:202
1763199476,15cyclictest7950irq/56-dwc_otg_09:30:111
1763099476,20cyclictest0-21swapper/011:07:430
1763099472,29cyclictest0-21swapper/007:20:110
1763099472,29cyclictest0-21swapper/007:20:110
1763099471,36cyclictest0-21swapper/011:55:320
1763099471,34cyclictest0-21swapper/007:11:130
1763099471,32cyclictest520-21rs:main0
1763099471,31cyclictest0-21swapper/009:40:120
1763299463,7cyclictest7850irq/56-dwc_otg_09:55:242
17632994613,18cyclictest7850irq/56-dwc_otg_09:45:232
17632994613,18cyclictest7850irq/56-dwc_otg_09:45:232
17632994612,11cyclictest31517-21systemd-journal11:20:392
1763199468,14cyclictest0-21swapper/107:20:241
1763099462,35cyclictest0-21swapper/007:21:270
1763099462,23cyclictest0-21swapper/009:30:300
17630994620,8cyclictest0-21swapper/008:41:410
17630994620,8cyclictest0-21swapper/008:41:410
1763399457,23cyclictest0-21swapper/308:25:243
1763299455,16cyclictest4169-21ssh12:35:232
17632994514,10cyclictest31-21ksoftirqd/208:05:222
17630994527,6cyclictest7850irq/56-dwc_otg_07:45:130
17630994527,6cyclictest7850irq/56-dwc_otg_07:45:130
1763099452,36cyclictest0-21swapper/008:11:170
1763099451,30cyclictest0-21swapper/007:30:280
1763099451,20cyclictest17737-21modprobe08:40:110
1763399447,23cyclictest0-21swapper/307:15:243
1763399447,23cyclictest0-21swapper/307:15:243
1763399444,4cyclictest7850irq/56-dwc_otg_11:25:213
1763199436,23cyclictest0-21swapper/107:45:171
1763199436,23cyclictest0-21swapper/107:45:171
1763099431,35cyclictest0-21swapper/007:53:420
1763399422,3cyclictest7850irq/56-dwc_otg_08:40:243
1763399422,3cyclictest7850irq/56-dwc_otg_08:40:243
17632994220,5cyclictest301ktimersoftd/210:15:342
17632994220,5cyclictest301ktimersoftd/210:15:342
1763199427,25cyclictest0-21swapper/112:25:231
1763399417,23cyclictest0-21swapper/309:15:243
1763399412,3cyclictest0-21swapper/312:30:233
1763299418,12cyclictest31877-21ssh11:50:242
1763299417,24cyclictest0-21swapper/208:45:232
1763299413,14cyclictest0-21swapper/208:30:222
1763199411,5cyclictest7950irq/56-dwc_otg_07:55:231
46862400,1sleep20-21swapper/209:20:102
1763399402,7cyclictest7950irq/56-dwc_otg_07:30:223
1763199407,23cyclictest0-21swapper/109:55:251
1763199407,23cyclictest0-21swapper/108:05:241
1763199401,24cyclictest0-21swapper/107:30:241
1763399397,21cyclictest0-21swapper/308:05:243
17632993916,8cyclictest0-21swapper/212:30:392
1763299391,11cyclictest7950irq/56-dwc_otg_09:35:242
1763399386,22cyclictest5824-21ssh10:00:173
1763299382,7cyclictest7950irq/56-dwc_otg_11:35:252
17631993818,6cyclictest23383-21dhclient-script07:25:261
1763399376,5cyclictest7850irq/56-dwc_otg_10:15:303
1763399376,5cyclictest7850irq/56-dwc_otg_10:15:303
17633993711,13cyclictest0-21swapper/309:40:303
1763299371,7cyclictest0-21swapper/211:55:222
1763299371,5cyclictest7850irq/56-dwc_otg_09:30:222
1763299371,24cyclictest16242-21snmpd11:34:272
1763199377,25cyclictest0-21swapper/107:15:241
1763199377,25cyclictest0-21swapper/107:15:241
1763199377,23cyclictest0-21swapper/110:30:241
1763199374,4cyclictest7750irq/56-dwc_otg07:15:111
17631993718,5cyclictest28250-21timerandwakeup11:05:391
1763299366,16cyclictest7850irq/56-dwc_otg_10:45:252
1763299366,16cyclictest7850irq/56-dwc_otg_10:45:252
1763299363,4cyclictest7750irq/56-dwc_otg09:40:232
1763299361,4cyclictest0-21swapper/208:20:242
17632993613,5cyclictest301ktimersoftd/212:15:112
17631993618,5cyclictest29314-21sh11:46:091
1763399357,25cyclictest0-21swapper/309:05:243
1763399357,11cyclictest0-21swapper/311:45:253
1763399356,13cyclictest7950irq/56-dwc_otg_07:55:283
1763399352,6cyclictest0-21swapper/310:40:333
1763299356,7cyclictest0-21swapper/210:20:222
17632993526,6cyclictest26902-21latency_hist11:05:112
1763299351,4cyclictest7950irq/56-dwc_otg_09:10:232
1763299351,24cyclictest22228-21switchtime07:20:362
1763199356,9cyclictest7950irq/56-dwc_otg_12:21:581
1763199356,9cyclictest7950irq/56-dwc_otg_12:21:581
1763199351,20cyclictest11726-21timerwakeupswit08:20:381
174592350,1sleep10-21swapper/110:14:161
173322353,25sleep10-21swapper/107:09:491
1763399347,6cyclictest7850irq/56-dwc_otg_09:58:313
1763399347,15cyclictest0-21swapper/312:25:233
1763399346,6cyclictest22466-21ssh10:20:223
17633993416,4cyclictest1527250ssh12:09:313
1763299346,17cyclictest7750irq/56-dwc_otg08:10:322
17632993424,7cyclictest7744-21sh12:00:242
1763299342,15cyclictest7950irq/56-dwc_otg_07:40:112
17632993414,5cyclictest31-21ksoftirqd/212:20:302
17632993414,5cyclictest31-21ksoftirqd/212:20:302
1763299341,27cyclictest0-21swapper/210:01:092
17632993412,4cyclictest23235-21aten_rbpower_en07:25:242
1763299341,17cyclictest9980-21ntp_states09:25:362
1763199345,5cyclictest7950irq/56-dwc_otg_12:05:171
1763199345,5cyclictest7950irq/56-dwc_otg_09:00:391
1763199342,18cyclictest7950irq/56-dwc_otg_10:35:391
17631993414,5cyclictest7750irq/56-dwc_otg12:00:231
47492330,3sleep20-21swapper/210:37:322
1763399332,21cyclictest0-21swapper/311:35:183
17633993319,4cyclictest37-21rcuc/312:10:353
1763299337,5cyclictest7850irq/56-dwc_otg_08:18:472
1763299337,11cyclictest0-21swapper/211:05:372
1763299333,14cyclictest7950irq/56-dwc_otg_10:25:382
1763299332,13cyclictest7750irq/56-dwc_otg07:15:112
1763299331,25cyclictest31468-21ls07:45:372
1763299331,25cyclictest31468-21ls07:45:372
318732320,2sleep331864-21apt-get11:50:243
218972321,2sleep10-21swapper/112:16:321
1763399327,15cyclictest0-21swapper/307:45:243
1763399327,15cyclictest0-21swapper/307:45:243
1763399326,6cyclictest7850irq/56-dwc_otg_08:50:293
1763399324,5cyclictest22428-21sh12:17:293
1763399324,4cyclictest7950irq/56-dwc_otg_10:49:243
1763399324,4cyclictest7950irq/56-dwc_otg_10:49:243
17633993216,5cyclictest2737450ssh10:25:363
1763399321,21cyclictest20006-21cut08:45:263
17633993210,6cyclictest9550irq/80-mmc011:05:113
17633993210,5cyclictest8437-21sh12:00:343
1763299327,6cyclictest19041-21grep08:40:382
1763299327,6cyclictest19041-21grep08:40:382
1763199329,13cyclictest0-21swapper/110:55:241
1763199327,5cyclictest7750irq/56-dwc_otg08:40:111
1763199327,15cyclictest0-21swapper/109:15:241
1763199325,4cyclictest7950irq/56-dwc_otg_09:05:391
1763199323,5cyclictest29304-21ntp_states07:40:341
1763199323,14cyclictest7950irq/56-dwc_otg_08:30:111
1763199322,21cyclictest0-21swapper/108:44:451
1763199322,21cyclictest0-21swapper/108:44:451
1763199321,21cyclictest20508-21switchtime11:35:381
1763399318,4cyclictest0-21swapper/309:28:483
1763399313,14cyclictest7950irq/56-dwc_otg_10:50:333
1763399312,9cyclictest0-21swapper/309:02:143
1763399311,16cyclictest0-21swapper/312:20:423
1763399311,16cyclictest0-21swapper/312:20:423
17633993110,6cyclictest0-21swapper/309:48:523
17633993110,6cyclictest0-21swapper/309:48:523
1763299311,12cyclictest7950irq/56-dwc_otg_07:15:222
1763299311,12cyclictest7950irq/56-dwc_otg_07:15:222
1763199318,5cyclictest0-21swapper/112:10:391
1763199316,15cyclictest0-21swapper/108:50:251
1763399307,21cyclictest0-21swapper/308:55:263
1763399306,21cyclictest0-21swapper/311:30:233
1763399305,4cyclictest7750irq/56-dwc_otg10:55:353
1763399304,12cyclictest7950irq/56-dwc_otg_07:45:113
1763399303,5cyclictest0-21swapper/310:35:273
1763399303,4cyclictest7850irq/56-dwc_otg_10:30:163
1763399302,7cyclictest26794-21apt-get07:35:233
1763399302,19cyclictest0-21swapper/309:38:543
17633993010,4cyclictest0-21swapper/311:55:283
1763299307,15cyclictest0-21swapper/212:05:172
1763299303,7cyclictest0-21swapper/212:25:292
1763299301,24cyclictest26145-21timerandwakeup09:00:372
1763199305,6cyclictest7950irq/56-dwc_otg_07:35:381
1763199304,6cyclictest7850irq/56-dwc_otg_07:50:331
17631993011,5cyclictest1180-21runrttasks08:48:241
1763399292,12cyclictest7950irq/56-dwc_otg_08:35:343
1763399291,13cyclictest7850irq/56-dwc_otg_08:15:043
1763299299,4cyclictest0-21swapper/210:57:072
1763299291,9cyclictest7850irq/56-dwc_otg_07:55:232
1763299291,6cyclictest14881-21cut10:50:252
1763399289,4cyclictest0-21swapper/311:05:553
1763399285,11cyclictest7750irq/56-dwc_otg07:50:323
1763399281,6cyclictest9886-21timerandwakeup08:15:383
1763399281,16cyclictest0-21swapper/307:30:113
1763299283,9cyclictest7850irq/56-dwc_otg_08:35:402
1763299283,7cyclictest7850irq/56-dwc_otg_07:50:252
1763299283,10cyclictest28600-21latency_hist09:10:112
1763299281,12cyclictest7950irq/56-dwc_otg_08:00:362
1763299272,12cyclictest0-21swapper/208:52:482
17632992716,7cyclictest26062-21grep07:30:382
1763299264,3cyclictest7850irq/56-dwc_otg_08:25:272
1763399252,3cyclictest0-21swapper/308:00:393
1763399241,5cyclictest0-21swapper/307:10:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional