You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 22:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Jan 01, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
157499996,83cyclictest0-21swapper/010:03:510
19302980,2sleep10-21swapper/108:40:221
315622870,5sleep2157699cyclictest10:00:332
157499846,61cyclictest0-21swapper/011:30:250
1574997613,38cyclictest0-21swapper/009:20:250
223962740,2sleep30-21swapper/311:05:263
157499723,52cyclictest0-21swapper/007:10:140
236852700,1sleep20-21swapper/209:40:122
1574996847,10cyclictest101ktimersoftd/009:10:120
1575996611,27cyclictest1571-21cyclictest11:55:231
32182640,3sleep22573-21/usr/sbin/munin11:40:352
1574996427,19cyclictest22464-21idleruntime-cro12:35:110
1574996423,7cyclictest0-21swapper/010:55:220
1574996317,29cyclictest1125-21runrttasks09:25:280
1574996243,5cyclictest30946-21latency_hist10:00:110
157499622,27cyclictest0-21swapper/009:50:240
77602610,2sleep00-21swapper/008:55:300
157499616,53cyclictest0-21swapper/009:15:230
157499611,20cyclictest8021-21cut10:25:290
1576996033,22cyclictest1571-21cyclictest07:10:142
157599602,23cyclictest0-21swapper/109:32:291
1574996030,4cyclictest0-21swapper/008:40:240
1574995814,22cyclictest13-21rcuc/007:20:360
1574995814,22cyclictest13-21rcuc/007:20:360
1574995726,17cyclictest15576-21fschecks_count12:15:280
1574995722,4cyclictest8386-21cut11:55:290
1574995715,5cyclictest0-21swapper/012:20:250
157699559,27cyclictest10783-21latency_hist09:05:122
1574995516,18cyclictest3685-21unixbench_multi11:40:420
1576995410,16cyclictest8148-21aten_rbpower_en11:55:262
1574995440,5cyclictest101ktimersoftd/010:05:390
1574995431,11cyclictest101ktimersoftd/008:10:280
1574995423,15cyclictest0-21swapper/008:50:260
1574995422,9cyclictest7850irq/56-dwc_otg_12:10:370
157499541,50cyclictest9-21ksoftirqd/010:30:320
157499541,50cyclictest9-21ksoftirqd/010:30:320
1574995325,6cyclictest7850irq/56-dwc_otg_07:30:320
157499532,40cyclictest9-21ksoftirqd/008:45:300
11652533,12sleep00-21swapper/007:08:400
157599527,8cyclictest7750irq/56-dwc_otg07:10:131
157499526,30cyclictest13-21rcuc/012:40:120
157499521,28cyclictest31805-21grep08:30:420
157499521,28cyclictest31805-21grep08:30:420
157499521,20cyclictest24357-21ls09:40:320
157499521,20cyclictest24357-21ls09:40:320
1576995112,18cyclictest13803-21timerwakeupswit09:10:382
1576995112,18cyclictest13803-21timerwakeupswit09:10:382
1574995137,6cyclictest101ktimersoftd/008:05:110
11582512,42sleep30-21swapper/307:08:343
1574995026,10cyclictest7750irq/56-dwc_otg11:15:320
1574995025,7cyclictest7850irq/56-dwc_otg_07:45:350
1574995023,12cyclictest0-21swapper/008:20:380
157499502,26cyclictest0-21swapper/010:40:310
1574995017,10cyclictest0-21swapper/012:00:280
157499501,6cyclictest1125-21runrttasks09:10:400
157499501,6cyclictest1125-21runrttasks09:10:400
157499501,15cyclictest0-21swapper/011:50:180
157599492,9cyclictest7750irq/56-dwc_otg09:05:221
157499491,15cyclictest0-21swapper/011:10:220
157699487,26cyclictest0-21swapper/211:10:252
157699487,22cyclictest7850irq/56-dwc_otg_08:40:322
157699487,12cyclictest22707-21aten_rbpower_cu12:35:262
1575994820,10cyclictest7950irq/56-dwc_otg_07:15:221
157499486,7cyclictest13-21rcuc/009:32:100
1574994828,12cyclictest0-21swapper/010:50:270
1574994825,5cyclictest11949-21grep10:35:320
1574994823,7cyclictest25498-21fschecks_time08:15:290
1574994821,15cyclictest0-21swapper/011:25:180
1574994818,15cyclictest22691-21grep08:05:390
1574994818,15cyclictest15269-21fschecks_count10:45:300
157599477,25cyclictest0-21swapper/108:15:251
157599477,25cyclictest0-21swapper/107:45:241
1574994711,28cyclictest0-21swapper/012:25:280
157799467,25cyclictest0-21swapper/311:25:173
157699467,25cyclictest0-21swapper/211:20:252
157699467,25cyclictest0-21swapper/209:20:172
1575994615,16cyclictest21-21rcuc/109:35:251
1574994624,5cyclictest26835-21grep09:45:390
1574994619,15cyclictest27716-21aten_rbpower_cu11:20:250
157799458,23cyclictest0-21swapper/311:10:253
157799457,24cyclictest0-21swapper/311:40:263
157799457,24cyclictest0-21swapper/309:45:243
1577994524,4cyclictest7750irq/56-dwc_otg08:10:313
1577994521,14cyclictest7750irq/56-dwc_otg10:25:313
157699457,24cyclictest0-21swapper/207:50:242
157699457,24cyclictest0-21swapper/207:50:242
157699457,23cyclictest0-21swapper/208:30:262
157699457,23cyclictest0-21swapper/208:30:262
157699456,19cyclictest7950irq/56-dwc_otg_09:35:122
157499457,23cyclictest0-21swapper/008:25:260
157499455,21cyclictest13-21rcuc/011:00:490
157499455,19cyclictest0-21swapper/010:10:230
157499454,27cyclictest9-21ksoftirqd/008:35:130
157499453,38cyclictest0-21swapper/009:05:120
1574994519,14cyclictest1282-21latency11:35:330
157499451,20cyclictest0-21swapper/008:00:120
157799447,23cyclictest0-21swapper/307:40:243
157799446,23cyclictest0-21swapper/311:45:253
157699447,25cyclictest0-21swapper/207:40:242
157699447,24cyclictest0-21swapper/208:05:242
1576994412,12cyclictest24965-21sed09:40:402
1576994412,12cyclictest24965-21sed09:40:402
157599447,24cyclictest0-21swapper/111:50:171
1574994430,6cyclictest101ktimersoftd/007:15:320
157499442,39cyclictest101ktimersoftd/010:22:130
157499441,12cyclictest12040-21grep12:05:290
157799437,24cyclictest0-21swapper/311:20:253
157799437,24cyclictest0-21swapper/308:35:173
157799437,22cyclictest0-21swapper/310:15:253
1577994323,4cyclictest7750irq/56-dwc_otg08:40:293
1577994319,11cyclictest7950irq/56-dwc_otg_09:40:453
1577994319,11cyclictest7950irq/56-dwc_otg_09:40:453
1577994312,13cyclictest7850irq/56-dwc_otg_08:45:393
157699437,24cyclictest0-21swapper/208:35:172
157699437,22cyclictest0-21swapper/210:15:252
157699437,22cyclictest0-21swapper/208:20:232
157699433,3cyclictest7950irq/56-dwc_otg_11:25:252
157699432,25cyclictest12002-21chrt07:36:232
157599437,22cyclictest0-21swapper/107:20:241
157599437,22cyclictest0-21swapper/107:20:241
157499431,22cyclictest4791-21/usr/sbin/munin10:15:330
157799425,23cyclictest0-21swapper/307:50:243
157799425,23cyclictest0-21swapper/307:50:243
157799424,24cyclictest0-21swapper/310:20:283
157799421,15cyclictest7950irq/56-dwc_otg_12:10:313
1576994219,7cyclictest1563-21ls10:05:392
157699421,7cyclictest0-21swapper/208:00:242
1576994214,10cyclictest9560-21/usr/sbin/munin10:30:392
1576994214,10cyclictest9560-21/usr/sbin/munin10:30:392
157499422,23cyclictest0-21swapper/007:40:210
157499421,3cyclictest0-21swapper/011:45:260
1574994211,22cyclictest0-21swapper/007:38:490
157799417,21cyclictest0-21swapper/309:10:243
157799417,21cyclictest0-21swapper/309:10:243
157799416,23cyclictest0-21swapper/310:55:253
157699417,24cyclictest0-21swapper/210:20:282
157699417,17cyclictest20598-21taskset12:29:482
1576994130,7cyclictest301ktimersoftd/207:20:242
1576994130,7cyclictest301ktimersoftd/207:20:242
1576994116,10cyclictest9914-21apt-get12:00:262
1576994111,12cyclictest24101-21ntp_states08:10:352
1575994119,18cyclictest0-21swapper/110:25:251
1575994118,8cyclictest12654-21aten_rbpower_vo07:40:251
1574994118,4cyclictest22318-21grep11:05:260
1574994117,8cyclictest22386-21fschecks_time09:35:290
157799407,22cyclictest0-21swapper/309:25:253
157799407,21cyclictest0-21swapper/311:50:183
157799401,24cyclictest0-21swapper/309:55:253
157699409,11cyclictest7767-21/usr/sbin/munin10:25:252
157699407,19cyclictest61-21kswapd007:30:172
157699407,10cyclictest0-21swapper/209:46:182
1576994010,14cyclictest8250-21taskset07:25:592
1576994010,13cyclictest4917-21unixbench_singl08:45:392
1576994010,11cyclictest18926-21perl10:55:292
157599407,23cyclictest0-21swapper/111:25:261
157599402,5cyclictest0-21swapper/112:00:261
157499402,19cyclictest0-21swapper/007:50:250
157499402,19cyclictest0-21swapper/007:50:250
157499401,28cyclictest6568-21kworker/0:207:25:310
157799397,22cyclictest0-21swapper/312:25:253
157799397,22cyclictest0-21swapper/310:00:273
1577993919,6cyclictest7750irq/56-dwc_otg08:05:333
1577993919,6cyclictest1125-21runrttasks08:50:393
157799391,23cyclictest0-21swapper/311:30:253
157799391,18cyclictest0-21swapper/307:45:283
157699397,20cyclictest0-21swapper/212:30:262
157699395,20cyclictest6791-21chrt08:51:092
157699393,15cyclictest4435-21timerwakeupswit07:15:392
1576993915,9cyclictest7850irq/56-dwc_otg_10:50:232
1575993918,12cyclictest23-21ksoftirqd/108:10:221
1575993912,8cyclictest0-21swapper/108:25:231
157799388,26cyclictest0-21swapper/312:30:263
157699388,11cyclictest15639-21taskset07:46:452
157699387,18cyclictest28997-21seq09:54:392
157699386,11cyclictest7850irq/56-dwc_otg_11:33:332
157699384,10cyclictest7850irq/56-dwc_otg_10:39:232
1575993819,5cyclictest5587-21aten_rbpower_cu08:50:261
1575993815,12cyclictest0-21swapper/108:35:411
1575993814,12cyclictest7466-21aten_rbpower_vo08:55:261
324852373,21sleep20-21swapper/207:05:302
157799377,23cyclictest0-21swapper/312:35:263
157799377,18cyclictest0-21swapper/308:30:263
157799377,18cyclictest0-21swapper/308:30:263
157799376,22cyclictest0-21swapper/308:00:253
157799375,5cyclictest7950irq/56-dwc_otg_09:05:123
157799373,19cyclictest0-21swapper/307:25:233
157799372,8cyclictest0-21swapper/312:00:243
157799371,28cyclictest13124-21ls10:40:123
157799371,22cyclictest0-21swapper/310:05:243
157699377,11cyclictest1125-21runrttasks11:38:522
157699374,19cyclictest7950irq/56-dwc_otg_09:05:132
157699374,14cyclictest7850irq/56-dwc_otg_08:00:122
157599376,19cyclictest23051-21ls12:35:311
157599372,18cyclictest128-21systemd-journal10:13:361
1575993714,13cyclictest20891-21runrttasks12:30:231
157599371,25cyclictest20148-21ls08:00:291
1577993611,10cyclictest7850irq/56-dwc_otg_07:31:313
157699368,17cyclictest30626-21runrttasks09:57:252
157699367,11cyclictest15829-21taskset09:16:052
157699364,15cyclictest7950irq/56-dwc_otg_08:16:162
157599367,14cyclictest7850irq/56-dwc_otg_11:00:351
157599364,27cyclictest7950irq/56-dwc_otg_09:00:241
157599362,5cyclictest7850irq/56-dwc_otg_11:20:121
157599361,5cyclictest7750irq/56-dwc_otg10:00:251
157599361,24cyclictest1368-21ls11:35:341
157599361,23cyclictest27245-21latency_hist09:50:121
157799357,20cyclictest0-21swapper/308:20:233
157799357,18cyclictest0-21swapper/310:40:253
157799357,16cyclictest0-21swapper/309:20:173
157799356,14cyclictest16871-21cut10:50:273
157799354,12cyclictest12703-21sed09:10:123
157799353,14cyclictest7950irq/56-dwc_otg_09:35:123
157799351,2cyclictest0-21swapper/311:35:263
157799351,23cyclictest6177-21ls07:20:383
157799351,23cyclictest6177-21ls07:20:383
157699356,14cyclictest0-21swapper/212:14:192
157699354,13cyclictest7850irq/56-dwc_otg_08:29:342
157699351,5cyclictest128-21systemd-journal12:10:112
157699351,4cyclictest0-21swapper/211:45:242
157599359,8cyclictest2938150wget09:55:251
157599352,10cyclictest16516-21/usr/sbin/munin09:20:361
157599351,23cyclictest20714-21ls12:30:111
157599351,21cyclictest16528-21ls07:50:281
157599351,21cyclictest16528-21ls07:50:281
157799349,11cyclictest7950irq/56-dwc_otg_11:55:233
157799347,8cyclictest7950irq/56-dwc_otg_07:10:143
1577993415,7cyclictest7750irq/56-dwc_otg09:35:303
157799341,2cyclictest0-21swapper/311:15:243
157699348,9cyclictest7850irq/56-dwc_otg_10:47:402
157699345,16cyclictest0-21swapper/209:29:572
157699342,19cyclictest7850irq/56-dwc_otg_10:14:042
157599347,4cyclictest7850irq/56-dwc_otg_10:15:401
157599346,5cyclictest7750irq/56-dwc_otg10:55:401
157599345,4cyclictest7750irq/56-dwc_otg10:50:121
157599341,3cyclictest7950irq/56-dwc_otg_10:05:231
1575993413,5cyclictest1686150wget10:50:261
157599341,14cyclictest0-21swapper/110:37:141
157799334,13cyclictest7950irq/56-dwc_otg_09:00:113
157799332,11cyclictest0-21swapper/308:25:243
157799331,14cyclictest0-21swapper/307:15:353
157699338,8cyclictest7850irq/56-dwc_otg_10:44:542
157699332,4cyclictest7850irq/56-dwc_otg_11:00:252
157599337,5cyclictest7950irq/56-dwc_otg_09:20:111
157599337,12cyclictest7850irq/56-dwc_otg_09:10:271
157599337,12cyclictest7850irq/56-dwc_otg_09:10:271
1575993325,6cyclictest221ktimersoftd/109:25:251
157599331,3cyclictest7950irq/56-dwc_otg_07:35:231
1577993214,6cyclictest26746-21seq08:19:443
157699324,6cyclictest7950irq/56-dwc_otg_11:15:412
157599329,4cyclictest21701-21aten_rbpower_vo08:05:251
157599326,5cyclictest7750irq/56-dwc_otg08:50:111
157599323,7cyclictest7750irq/56-dwc_otg12:05:291
157599322,4cyclictest8595-21apt-get07:30:171
157599322,22cyclictest0-21swapper/111:45:201
1575993215,5cyclictest1125-21runrttasks07:27:391
157599321,21cyclictest25506-21runrttasks09:45:121
157599321,21cyclictest25506-21runrttasks09:45:121
157799313,11cyclictest7850irq/56-dwc_otg_09:55:013
157799311,11cyclictest0-21swapper/310:30:363
157799311,11cyclictest0-21swapper/310:30:363
157699318,12cyclictest8656-21taskset08:56:542
157699314,13cyclictest7950irq/56-dwc_otg_11:05:292
1576993116,5cyclictest301ktimersoftd/212:24:312
1576993113,5cyclictest1125-21runrttasks12:19:012
157599319,4cyclictest3727-21grep11:40:421
157599317,9cyclictest0-21swapper/109:51:121
157599317,5cyclictest7750irq/56-dwc_otg12:20:291
157599316,16cyclictest7950irq/56-dwc_otg_08:20:391
1575993115,5cyclictest32241-21idleruntime-cro08:35:121
1575993115,5cyclictest32241-21idleruntime-cro08:35:121
1575993115,5cyclictest27728-21aten_rbpower_en11:20:251
157599311,22cyclictest0-21swapper/110:40:141
157599311,11cyclictest7850irq/56-dwc_otg_10:20:401
157799306,19cyclictest0-21swapper/307:35:253
157799301,20cyclictest0-21swapper/312:23:143
157799301,19cyclictest15517-21ls10:45:333
157799301,17cyclictest21571-21grep11:00:423
157599303,15cyclictest0-21swapper/110:34:111
157599303,15cyclictest0-21swapper/110:34:111
157599302,16cyclictest0-21swapper/112:15:331
157799293,18cyclictest0-21swapper/310:10:283
157799292,9cyclictest7950irq/56-dwc_otg_12:19:023
1576992919,8cyclictest6296-21apt-get11:50:252
157599291,13cyclictest7950irq/56-dwc_otg_07:55:361
321872285,13sleep10-21swapper/107:05:251
157599281,4cyclictest7750irq/56-dwc_otg11:30:261
157799272,13cyclictest7950irq/56-dwc_otg_12:05:373
157799271,16cyclictest0-21swapper/309:15:283
157799271,16cyclictest0-21swapper/307:57:283
157599274,16cyclictest0-21swapper/111:05:191
157599271,5cyclictest13536-21apt-get12:10:261
157599271,18cyclictest0-21swapper/111:12:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional