You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 19:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Fri Aug 28, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1521725710,8sleep214725-21kworker/2:007:05:252
1754621460,2sleep217547-21/usr/sbin/munin10:15:312
16901991213,99cyclictest0-21swapper/009:20:400
2942621120,6sleep21690399cyclictest10:30:132
2942621120,6sleep21690399cyclictest10:30:132
16901991033,83cyclictest0-21swapper/009:15:430
16901991032,31cyclictest5723-21kworker/0:010:20:300
1690199962,9cyclictest32590-21apt-get09:55:160
1690199954,69cyclictest7434-21kworker/0:311:20:410
1690199896,21cyclictest26758-21ssh11:45:230
156532870,3sleep10-21swapper/110:13:131
156532870,3sleep10-21swapper/110:13:131
181132850,7sleep21690399cyclictest09:36:352
1690199834,63cyclictest1600-21kworker/0:011:15:240
1690199831,29cyclictest28275-21aten_rbpower_vo09:10:260
1690199831,29cyclictest28275-21aten_rbpower_vo09:10:260
1690199822,27cyclictest0-21swapper/008:50:300
16901998032,39cyclictest0-21swapper/008:55:250
16901998021,37cyclictest1275-21ssh10:35:160
16901998021,37cyclictest1275-21ssh10:35:160
50142790,3sleep10-21swapper/111:57:441
1690199792,7cyclictest29368-21latency_hist10:30:130
1690199792,7cyclictest29368-21latency_hist10:30:130
13102790,1sleep10-21swapper/110:35:191
13102790,1sleep10-21swapper/110:35:191
1690199761,29cyclictest2676-21aten_rbpower_po11:55:270
1690199741,28cyclictest0-21swapper/009:30:210
16904997314,37cyclictest7950irq/56-dwc_otg_09:20:383
16902997328,14cyclictest27790-21diskmemload11:20:411
1690199732,26cyclictest0-21swapper/010:10:260
1690199732,26cyclictest0-21swapper/010:10:260
1690199731,21cyclictest0-21swapper/012:25:570
16904997131,14cyclictest995-21ssh09:15:413
16901997117,6cyclictest27089-21unixbench_multi07:35:400
1690399692,9cyclictest0-21swapper/211:06:392
149702670,2sleep10-21swapper/112:10:241
317462660,2sleep20-21swapper/209:14:522
317462660,2sleep20-21swapper/209:14:522
16903996646,16cyclictest1180-21runrttasks08:55:222
1690199656,15cyclictest0-21swapper/009:50:170
1690199656,15cyclictest0-21swapper/009:50:170
1690199655,26cyclictest0-21swapper/009:35:220
1690199641,34cyclictest0-21swapper/011:05:230
1690199631,41cyclictest12007-21grep08:25:310
6272620,1sleep10-21swapper/111:52:171
16901996220,19cyclictest0-21swapper/012:05:120
1690299613,35cyclictest1090-21grep09:15:421
16901996118,26cyclictest21656-21grep07:20:400
16901996112,20cyclictest0-21swapper/009:00:260
1690499604,32cyclictest0-21swapper/310:20:443
1690299604,13cyclictest21-21rcuc/109:20:381
1690199601,5cyclictest0-21swapper/009:25:230
16904995922,9cyclictest7950irq/56-dwc_otg_10:15:253
1690399596,14cyclictest0-21swapper/210:20:442
1690199595,31cyclictest16900-21cyclictest08:15:230
16901995916,5cyclictest0-21swapper/010:00:380
1690399583,33cyclictest5063-21sort09:20:402
16903995816,10cyclictest7750irq/56-dwc_otg10:35:142
16903995816,10cyclictest7750irq/56-dwc_otg10:35:142
1690199582,28cyclictest31526-21ssh12:30:250
1690199581,31cyclictest0-21swapper/007:50:400
133442580,2sleep10-21swapper/111:28:581
1690299579,33cyclictest23-21ksoftirqd/110:20:321
1690199572,31cyclictest5540-21aten_rbpower_cu10:40:260
16901995627,9cyclictest3647-21grep08:00:390
1690399553,12cyclictest1092-21head09:15:422
1690299552,25cyclictest7850irq/56-dwc_otg_09:55:141
16901995521,16cyclictest23495-21grep11:40:370
1690199551,32cyclictest1893-21grep07:55:390
1690499547,33cyclictest0-21swapper/307:35:253
1690399544,14cyclictest460-21ssh09:55:152
1690199543,28cyclictest22592-21fschecks_count07:25:290
16901995430,6cyclictest7850irq/56-dwc_otg_10:50:390
1690499535,22cyclictest0-21swapper/311:20:413
1690499533,34cyclictest0-21swapper/310:35:143
1690499533,34cyclictest0-21swapper/310:35:143
1690399533,33cyclictest0-21swapper/211:20:412
16901995327,6cyclictest3421-21ssh12:35:280
16901995316,17cyclictest27790-21diskmemload11:30:410
16904995211,22cyclictest0-21swapper/309:55:163
1690199522,31cyclictest0-21swapper/012:15:270
16901995214,18cyclictest13-21rcuc/007:45:400
1690199521,29cyclictest15200-21latency_hist08:35:130
16901995212,19cyclictest14728-21cat12:10:130
16901995212,19cyclictest14728-21cat12:10:130
1690199521,13cyclictest0-21swapper/010:58:170
1690199516,25cyclictest9982-21cut10:45:300
1690199512,28cyclictest10447-21missed_timers08:20:320
1690199511,16cyclictest24283-21ssh09:45:130
16901995034,4cyclictest7750irq/56-dwc_otg12:25:120
1690199501,35cyclictest0-21swapper/011:10:300
1690199501,30cyclictest0-21swapper/008:45:250
164462503,37sleep00-21swapper/007:07:510
16904994925,8cyclictest7950irq/56-dwc_otg_09:50:173
16904994925,8cyclictest7950irq/56-dwc_otg_09:50:173
1690499492,3cyclictest0-21swapper/308:20:243
1690499492,10cyclictest39-21ksoftirqd/309:35:213
16901994928,5cyclictest5378-21timerandwakeup08:05:380
16901994918,19cyclictest17523-21cut10:15:310
1690199491,33cyclictest0-21swapper/008:35:340
1690199491,33cyclictest0-21swapper/008:35:340
1690199491,27cyclictest0-21swapper/011:35:270
1690199491,27cyclictest0-21swapper/011:35:270
16901994912,19cyclictest0-21swapper/011:00:240
16904994817,15cyclictest7950irq/56-dwc_otg_11:43:553
1690399483,12cyclictest0-21swapper/207:50:222
1690199488,19cyclictest0-21swapper/011:25:310
16901994821,14cyclictest0-21swapper/012:14:210
16901994814,7cyclictest24882-21fschecks_time09:45:300
1690199481,29cyclictest17586-21ntpq07:10:320
1690199474,28cyclictest0-21swapper/007:40:250
16901994731,5cyclictest1142-21apt-key10:35:130
1690499468,23cyclictest0-21swapper/308:40:183
1690499466,24cyclictest2009-21ssh11:15:273
16902994622,5cyclictest8611-21latency_hist10:05:121
1690199461,24cyclictest18305-21grep08:40:400
1690199461,21cyclictest0-21swapper/008:10:360
1690499457,24cyclictest0-21swapper/309:25:253
1690199452,27cyclictest0-21swapper/007:35:030
1690199452,27cyclictest0-21swapper/007:35:030
1690199451,23cyclictest0-21swapper/011:50:340
1690499441,7cyclictest7850irq/56-dwc_otg_08:25:263
16904994319,5cyclictest4984-21fschecks_count10:00:293
1690499431,5cyclictest0-21swapper/310:50:243
16904994315,12cyclictest7750irq/56-dwc_otg12:12:293
16904994312,10cyclictest7950irq/56-dwc_otg_10:55:383
1690199431,22cyclictest0-21swapper/010:05:310
16904994217,6cyclictest7950irq/56-dwc_otg_12:15:243
16904994211,14cyclictest12831-21sed10:10:133
1690299428,24cyclictest25971-21kworker/u8:009:50:181
1690299428,24cyclictest25971-21kworker/u8:009:50:181
1690199421,22cyclictest0-21swapper/009:05:390
1690499417,21cyclictest0-21swapper/312:25:253
1690499412,3cyclictest7950irq/56-dwc_otg_12:05:233
1690499412,3cyclictest7950irq/56-dwc_otg_12:05:233
16904994122,13cyclictest0-21swapper/308:30:243
16904994120,11cyclictest7750irq/56-dwc_otg11:35:323
16904994120,11cyclictest7750irq/56-dwc_otg11:35:323
16904994117,4cyclictest7750irq/56-dwc_otg09:30:203
1690299417,25cyclictest31493-21ssh12:30:251
1690299416,2cyclictest0-21swapper/108:05:181
1690299416,12cyclictest16291-21sh09:35:221
16902994119,7cyclictest23-21ksoftirqd/107:35:331
16901994110,19cyclictest0-21swapper/007:20:120
1690499407,18cyclictest0-21swapper/308:35:253
1690499407,18cyclictest0-21swapper/308:35:253
16904994013,7cyclictest7750irq/56-dwc_otg09:10:423
16904994013,7cyclictest7750irq/56-dwc_otg09:10:423
1690399407,21cyclictest0-21swapper/209:50:252
1690399407,21cyclictest0-21swapper/209:50:252
1690399406,4cyclictest7750irq/56-dwc_otg11:25:222
1690499397,23cyclictest0-21swapper/312:20:253
1690499396,14cyclictest11735-21ssh10:47:083
16904993920,8cyclictest7750irq/56-dwc_otg09:42:063
16904993911,15cyclictest7950irq/56-dwc_otg_11:04:093
1690399399,9cyclictest10973-21unixbench_multi08:20:392
1690399398,25cyclictest0-21swapper/207:55:252
1690299397,23cyclictest0-21swapper/108:50:261
1690299392,12cyclictest7950irq/56-dwc_otg_08:45:261
1690299391,23cyclictest0-21swapper/107:10:241
1690299391,21cyclictest27790-21diskmemload10:25:401
1690299391,21cyclictest27790-21diskmemload10:25:401
1690499389,5cyclictest39-21ksoftirqd/312:00:233
1690499386,22cyclictest0-21swapper/312:35:243
16904993813,10cyclictest7750irq/56-dwc_otg10:30:073
16904993813,10cyclictest7750irq/56-dwc_otg10:30:073
1690499381,24cyclictest1247-21latency07:55:313
16904993812,3cyclictest7750irq/56-dwc_otg11:45:233
16904993811,13cyclictest7950irq/56-dwc_otg_11:55:423
1690299383,8cyclictest0-21swapper/110:15:251
1690299381,6cyclictest20377-21unixbench_singl12:15:421
1690499377,25cyclictest0-21swapper/308:00:253
1690499377,12cyclictest7950irq/56-dwc_otg_08:50:273
16904993717,9cyclictest7750irq/56-dwc_otg10:42:373
1690499371,27cyclictest7950irq/56-dwc_otg_08:05:243
1690499371,24cyclictest2395-21ls11:55:123
1690499371,21cyclictest0-21swapper/307:25:303
1690399374,14cyclictest31-21ksoftirqd/210:10:202
1690399374,14cyclictest31-21ksoftirqd/210:10:202
1690399372,3cyclictest7950irq/56-dwc_otg_07:25:232
16903993716,4cyclictest14095-21fschecks_time10:50:302
1690399371,29cyclictest27140-21ls11:45:272
1690399371,24cyclictest21076-21cut08:50:302
1690299379,5cyclictest6520-21/usr/sbin/munin10:40:391
16902993718,15cyclictest21-21rcuc/108:00:221
16902993716,5cyclictest14628-21grep08:30:391
16902993713,4cyclictest23172-21sensors07:25:371
1690299371,26cyclictest28769-21ssh09:10:331
1690299371,26cyclictest28769-21ssh09:10:331
1690499367,9cyclictest30094-21chrt10:30:303
1690499367,15cyclictest0-21swapper/308:10:253
1690499366,13cyclictest14274-21ssh10:10:403
1690499366,13cyclictest14274-21ssh10:10:403
1690499364,5cyclictest0-21swapper/311:30:233
1690499363,15cyclictest7950irq/56-dwc_otg_11:26:513
1690399367,13cyclictest7950irq/56-dwc_otg_10:50:122
1690399361,26cyclictest19286-21ls12:15:282
16902993619,4cyclictest29961-21sh10:30:281
16902993616,5cyclictest2628150wget09:05:251
14072361,3sleep30-21swapper/312:32:383
1690499355,5cyclictest7850irq/56-dwc_otg_07:45:403
16904993513,8cyclictest7950irq/56-dwc_otg_09:47:263
16904993510,10cyclictest7950irq/56-dwc_otg_11:10:283
1690399355,6cyclictest16888-21latency_hist08:40:122
1690399355,6cyclictest16888-21latency_hist08:40:122
1690399355,5cyclictest7750irq/56-dwc_otg08:25:412
1690399351,5cyclictest7950irq/56-dwc_otg_11:40:132
1690399351,5cyclictest7950irq/56-dwc_otg_11:40:132
16903993514,5cyclictest25641-21cat09:45:392
1690299356,23cyclictest0-21swapper/111:05:261
1690299353,27cyclictest7950irq/56-dwc_otg_12:25:241
1690299351,3cyclictest7850irq/56-dwc_otg_11:15:371
16902993512,5cyclictest0-21swapper/111:12:401
1690299351,25cyclictest0-21swapper/108:15:251
1690299351,22cyclictest21669-21latency_hist11:00:121
1690499347,5cyclictest24462-21fschecks_time07:30:283
1690499347,5cyclictest24462-21fschecks_time07:30:283
16904993414,4cyclictest1180-21runrttasks08:55:383
16904993413,4cyclictest7850irq/56-dwc_otg_11:09:483
1690399347,16cyclictest7950irq/56-dwc_otg_11:00:252
1690399346,13cyclictest7950irq/56-dwc_otg_11:30:292
1690399345,17cyclictest7950irq/56-dwc_otg_12:35:352
1690399343,17cyclictest0-21swapper/211:14:012
16903993413,6cyclictest27790-21diskmemload11:52:382
1690399341,30cyclictest26256-21grep07:35:292
16903993411,6cyclictest7950irq/56-dwc_otg_08:05:122
1690299347,8cyclictest0-21swapper/107:30:321
1690299347,8cyclictest0-21swapper/107:30:321
1690299346,15cyclictest24967-21ssh09:45:311
1690299341,5cyclictest18588-21aten_rbpower_en11:35:261
1690299341,5cyclictest18588-21aten_rbpower_en11:35:261
1690299341,4cyclictest0-21swapper/111:40:321
1690299341,27cyclictest0-21swapper/110:54:011
16902993410,11cyclictest27790-21diskmemload12:02:171
112352341,4sleep20-21swapper/209:29:072
1690399339,5cyclictest7950irq/56-dwc_otg_07:35:122
1690399339,5cyclictest7950irq/56-dwc_otg_07:35:122
1690399338,4cyclictest0-21swapper/210:40:412
1690399337,17cyclictest7750irq/56-dwc_otg09:32:002
1690399337,14cyclictest0-21swapper/208:05:182
1690399334,16cyclictest0-21swapper/208:30:352
1690399334,12cyclictest7950irq/56-dwc_otg_09:45:122
1690399331,19cyclictest26331-21aten_rbpower_vo09:05:252
1690299339,5cyclictest7950irq/56-dwc_otg_08:35:291
1690299339,5cyclictest7950irq/56-dwc_otg_08:35:291
1690299339,5cyclictest7750irq/56-dwc_otg11:00:321
1690299336,6cyclictest27806-21timerandwakeup11:45:361
1690299333,6cyclictest7850irq/56-dwc_otg_07:50:231
1690299333,3cyclictest0-21swapper/109:30:271
1690299331,19cyclictest25707-21ssh12:22:481
16902993310,4cyclictest0-21swapper/112:36:211
16902993310,12cyclictest8389-21fschecks_time09:25:291
1690499329,5cyclictest7950irq/56-dwc_otg_07:10:383
1690499324,13cyclictest7950irq/56-dwc_otg_07:19:513
1690399328,5cyclictest7950irq/56-dwc_otg_10:30:242
1690399327,13cyclictest7950irq/56-dwc_otg_12:15:012
1690399324,12cyclictest7950irq/56-dwc_otg_10:00:362
1690399321,4cyclictest7950irq/56-dwc_otg_07:45:232
1690399321,20cyclictest28290-21ls07:40:312
1690299326,5cyclictest7850irq/56-dwc_otg_10:45:341
1690299324,6cyclictest7750irq/56-dwc_otg11:31:091
16902993226,4cyclictest221ktimersoftd/112:05:241
16902993226,4cyclictest221ktimersoftd/112:05:241
16902993217,5cyclictest25333-21sshd09:00:401
9202310,10sleep17850irq/56-dwc_otg_07:55:261
1690499312,12cyclictest0-21swapper/307:51:393
1690499311,23cyclictest8633-21ls08:15:333
1690499311,19cyclictest25685-21chrt09:01:413
1690499311,15cyclictest7850irq/56-dwc_otg_07:20:313
1690399319,5cyclictest8622-1kworker/u9:212:05:312
1690399319,5cyclictest8622-1kworker/u9:212:05:312
1690399314,3cyclictest7950irq/56-dwc_otg_10:55:282
16903993113,9cyclictest8834-21sh10:05:232
16903993112,5cyclictest7426-21uptime08:10:402
1690399311,16cyclictest0-21swapper/211:15:312
1690299317,10cyclictest27790-21diskmemload09:41:291
1690299313,4cyclictest0-21swapper/108:40:371
1690299311,7cyclictest9172-21tune2fs10:05:291
1690499306,6cyclictest7950irq/56-dwc_otg_08:45:373
1690499306,11cyclictest0-21swapper/307:43:523
1690499305,15cyclictest7950irq/56-dwc_otg_09:05:283
1690399309,8cyclictest5772chrt12:31:072
1690399309,4cyclictest0-21swapper/212:29:072
1690399306,4cyclictest7950irq/56-dwc_otg_09:05:122
1690399304,5cyclictest0-21swapper/211:55:352
1690399304,14cyclictest0-21swapper/212:20:252
1690399304,12cyclictest7950irq/56-dwc_otg_08:45:332
1690399302,5cyclictest8618-21/usr/sbin/munin08:15:322
16903993021,5cyclictest18820-21wget07:15:262
1690399301,20cyclictest17248-21uniq07:10:282
1690299308,7cyclictest9450irq/48-DMA08:56:171
1690299304,6cyclictest7750irq/56-dwc_otg07:45:291
1690299301,9cyclictest11510-21grep08:25:121
1690299301,7cyclictest28928-21grep07:40:391
1690299301,22cyclictest20814-21cut07:20:291
1690399291,4cyclictest0-21swapper/212:03:182
1690399291,18cyclictest0-21swapper/208:40:182
1690399291,14cyclictest0-21swapper/211:40:312
1690299296,11cyclictest7950irq/56-dwc_otg_07:15:341
1690299292,6cyclictest7850irq/56-dwc_otg_08:10:371
1690299291,15cyclictest24179-21latency_hist09:00:121
1690399283,21cyclictest7950irq/56-dwc_otg_07:20:232
164752286,14sleep30-21swapper/307:08:143
163522273,15sleep10-21swapper/107:06:391
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional