You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 23:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Wed Apr 24, 2024 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2421122450,3sleep324028-21/usr/sbin/munin07:07:313
327432950,2sleep00-21swapper/011:32:050
70442940,2sleep00-21swapper/007:57:460
187002900,2sleep20-21swapper/211:12:142
2585699764,35cyclictest0-21swapper/007:37:240
152562750,2sleep00-21swapper/009:32:370
25856997110,18cyclictest2625650ssh11:22:310
25856996645,5cyclictest8150irq/56-dwc_otg_12:02:290
2585699664,36cyclictest0-21swapper/008:27:240
181162660,2sleep20-21swapper/209:37:182
2585699656,15cyclictest0-21swapper/008:22:320
2585699642,32cyclictest28460-21ssh09:52:290
25856996010,20cyclictest0-21swapper/011:57:270
25856995935,4cyclictest8050irq/56-dwc_otg_09:17:330
2585699592,31cyclictest0-21swapper/012:32:330
25856995813,19cyclictest30434-21/usr/sbin/munin07:27:330
247472573,7sleep10-21swapper/107:07:431
25856995628,6cyclictest20878-21grep12:37:500
25856995616,22cyclictest1292-21runrttasks09:47:240
2585699561,38cyclictest748-21ls09:57:470
2585699561,32cyclictest5557-21grep07:52:590
10382560,2sleep20-21swapper/207:37:402
2585899557,23cyclictest0-21swapper/212:17:312
2585899556,9cyclictest8050irq/56-dwc_otg_12:37:312
2585699558,24cyclictest0-21swapper/012:27:080
2585699555,27cyclictest15802-21rm11:07:380
25856995534,6cyclictest8150irq/56-dwc_otg_10:02:340
25856995533,6cyclictest8150irq/56-dwc_otg_09:12:470
2585699552,33cyclictest12168-21ntpq12:27:410
25856995419,16cyclictest13094-21switchtime11:02:460
25856995324,18cyclictest22004-21unixbench_singl10:27:520
2585699531,27cyclictest14945-21grep10:17:500
25856995229,5cyclictest1158-21fschecks_time11:32:330
2585699522,26cyclictest11-21rcu_preempt11:17:410
25856995120,7cyclictest7950irq/56-dwc_otg09:12:180
25858995015,10cyclictest8050irq/56-dwc_otg_09:37:292
2585799505,24cyclictest0-21swapper/108:02:271
2585699503,27cyclictest0-21swapper/009:37:300
2585699501,35cyclictest0-21swapper/012:12:370
2585699501,30cyclictest0-21swapper/011:47:300
2585999498,19cyclictest11000-21ssh12:27:183
2585699499,32cyclictest0-21swapper/009:02:480
25856994928,5cyclictest8150irq/56-dwc_otg_11:37:530
2585699492,27cyclictest0-21swapper/010:17:190
25856994916,16cyclictest7950irq/56-dwc_otg09:22:530
25856994916,16cyclictest7950irq/56-dwc_otg09:22:530
2585699491,32cyclictest28506-21aten_rbpower_po07:22:280
2585699491,32cyclictest28506-21aten_rbpower_po07:22:280
2585699491,28cyclictest11545-21cut09:27:360
253902495,36sleep00-21swapper/007:09:440
2585699481,33cyclictest7625-21kworker/u8:212:07:410
2585699481,33cyclictest7625-21kworker/u8:212:07:410
2585899477,25cyclictest0-21swapper/208:57:312
2585899477,25cyclictest0-21swapper/208:32:332
2585699477,17cyclictest0-21swapper/010:22:320
2585699473,29cyclictest31512-21kworker/0:207:36:220
25856994719,15cyclictest23666-21unixbench-2d08:42:470
25856994717,15cyclictest3224-21aten_rbpower_po12:17:320
2585699471,4cyclictest18960-21munin-run11:57:180
2585699471,26cyclictest21808-21fschecks_count09:42:350
2585899469,9cyclictest8150irq/56-dwc_otg_08:42:182
2585899467,24cyclictest0-21swapper/209:57:302
2585899467,24cyclictest0-21swapper/207:12:312
25856994625,5cyclictest9550irq/48-DMA14:55:080
25856994623,3cyclictest0-21swapper/007:12:490
25856994621,4cyclictest10108-21fschecks_count08:07:350
2585899457,15cyclictest19764-21ssh11:12:412
25858994527,8cyclictest7950irq/56-dwc_otg11:31:152
2585899452,10cyclictest0-21swapper/208:02:292
25858994516,10cyclictest7950irq/56-dwc_otg11:55:212
2585799455,4cyclictest8150irq/56-dwc_otg_10:47:331
2585799455,4cyclictest8150irq/56-dwc_otg_10:47:331
2585699457,27cyclictest31179-21grep10:42:450
25856994526,4cyclictest7950irq/56-dwc_otg08:57:180
2585699452,4cyclictest9693-21latency_hist08:07:190
25856994519,4cyclictest7723-21ps10:07:510
2585699451,31cyclictest0-21swapper/010:51:260
2585699451,31cyclictest0-21swapper/010:51:260
2585899445,5cyclictest3325-21ssh10:02:322
25856994429,2cyclictest0-21swapper/010:37:240
2585699442,28cyclictest0-21swapper/007:47:160
25856994420,16cyclictest7950irq/56-dwc_otg11:42:420
2585899437,23cyclictest0-21swapper/208:17:302
2585899436,25cyclictest15541-21ssh12:32:342
25858994323,4cyclictest8150irq/56-dwc_otg_12:22:312
2585899431,5cyclictest0-21swapper/208:42:302
25858994315,8cyclictest0-21swapper/210:22:282
2585699436,6cyclictest0-21swapper/008:17:280
2585699432,25cyclictest0-21swapper/010:52:470
25856994322,13cyclictest25163-21ps08:47:480
25856994322,13cyclictest25163-21ps08:47:480
25856994321,12cyclictest0-21swapper/008:32:410
25856994318,12cyclictest0-21swapper/008:57:300
25856994317,16cyclictest0-21swapper/008:12:340
25856994317,16cyclictest0-21swapper/008:12:340
2585699431,23cyclictest20204-21ssh11:12:470
2585899427,23cyclictest0-21swapper/212:02:242
25858994220,8cyclictest8050irq/56-dwc_otg_08:52:362
25858994214,14cyclictest8050irq/56-dwc_otg_10:27:442
2585699426,19cyclictest0-21swapper/007:47:310
25856994218,14cyclictest0-21swapper/008:41:390
152232420,4sleep315226-21latency_hist12:32:183
68432410,2sleep30-21swapper/310:07:223
2585899415,14cyclictest8050irq/56-dwc_otg_10:20:052
2585799411,3cyclictest8150irq/56-dwc_otg_08:52:411
25857994113,5cyclictest16002-21unixbench_singl09:32:481
2585799411,29cyclictest8150irq/56-dwc_otg_11:42:181
25856994124,4cyclictest8050irq/56-dwc_otg_10:32:220
121252410,3sleep30-21swapper/309:27:453
97152400,2sleep339-21ksoftirqd/311:43:513
6242400,1sleep10-21swapper/112:13:201
61402400,2sleep10-21swapper/110:06:191
25859994021,5cyclictest28821-21tune2fs09:52:363
2585899407,23cyclictest0-21swapper/207:57:322
2585899407,23cyclictest0-21swapper/207:52:312
2585899404,20cyclictest0-21swapper/209:47:322
2585899403,16cyclictest8150irq/56-dwc_otg_08:47:382
2585899403,16cyclictest8150irq/56-dwc_otg_08:47:382
25858994023,9cyclictest7950irq/56-dwc_otg12:27:292
25858994015,9cyclictest301ktimersoftd/211:21:462
25858994010,14cyclictest8150irq/56-dwc_otg_11:37:002
25857994024,5cyclictest22818-21vmstat09:42:501
25857994023,5cyclictest5144-21if_wlan009:17:391
25857994018,5cyclictest28658-21fschecks_count07:22:311
25857994018,5cyclictest28658-21fschecks_count07:22:311
2585799401,32cyclictest0-21swapper/109:22:571
2585799401,32cyclictest0-21swapper/109:22:571
25859993929,7cyclictest12363-21ls11:02:323
25859993919,18cyclictest1682-21rm12:15:173
2585999391,5cyclictest0-21swapper/311:52:323
2585899398,11cyclictest8050irq/56-dwc_otg_09:42:492
2585899397,22cyclictest0-21swapper/209:52:312
2585899397,16cyclictest8050irq/56-dwc_otg_11:42:212
2585899394,18cyclictest2996-21ls07:47:322
2585699392,7cyclictest0-21swapper/007:18:520
245632390,3sleep10-21swapper/112:02:491
209072390,2sleep20-21swapper/211:58:232
25859993815,5cyclictest90250wget11:32:303
2585999381,22cyclictest8543-21ls10:57:193
2585899386,9cyclictest7950irq/56-dwc_otg10:47:332
2585899386,9cyclictest7950irq/56-dwc_otg10:47:332
2585899386,16cyclictest8050irq/56-dwc_otg_09:26:532
2585899386,16cyclictest8050irq/56-dwc_otg_09:26:532
25858993820,7cyclictest7950irq/56-dwc_otg12:14:212
2585899381,6cyclictest12504-21grep11:02:352
25858993812,13cyclictest0-21swapper/211:37:352
2585799388,20cyclictest5492-21ls07:52:581
2585799386,22cyclictest0-21swapper/110:17:431
2585799382,5cyclictest0-21swapper/108:47:311
2585799382,5cyclictest0-21swapper/108:47:311
2585799381,7cyclictest23862-21unixbench_multi11:17:451
2585799381,17cyclictest0-21swapper/108:07:381
116792380,3sleep22585899cyclictest08:12:332
116792380,3sleep22585899cyclictest08:12:332
2585999371,8cyclictest22367-21idleruntime-cro08:42:183
25859993718,10cyclictest21199-21sh12:38:203
2585899377,6cyclictest8050irq/56-dwc_otg_09:07:502
25858993710,11cyclictest7950irq/56-dwc_otg11:50:002
2585799378,6cyclictest8150irq/56-dwc_otg_12:27:181
2585799372,4cyclictest7950irq/56-dwc_otg12:37:301
2585799372,14cyclictest0-21swapper/111:28:281
2585799371,27cyclictest0-21swapper/112:08:551
2585799371,27cyclictest0-21swapper/112:08:551
2585799371,17cyclictest21238-21modprobe09:42:181
2585799371,17cyclictest16821-21grep11:52:561
111642370,2sleep20-21swapper/210:12:492
25859993618,4cyclictest28827-21if_eth007:22:333
25859993618,4cyclictest28827-21if_eth007:22:333
25859993613,5cyclictest27525-21sh09:50:473
2585899368,6cyclictest0-21swapper/209:17:512
2585899368,15cyclictest6891-21ssh10:54:072
2585899366,15cyclictest29-21rcuc/210:43:322
25857993617,5cyclictest32424-21idleruntime-cro07:37:181
2585799361,5cyclictest26478-21munin-run10:37:181
25857993613,6cyclictest19311-21aten_rbpower_cu11:57:301
2585999356,5cyclictest8150irq/56-dwc_otg_07:57:503
25859993513,6cyclictest9223-21grep08:02:463
2585999351,29cyclictest32406-21sh09:57:353
25859993511,9cyclictest31837-1kworker/u9:111:37:373
25859993511,4cyclictest13425-21idleruntime-cro10:17:183
2585899358,17cyclictest0-21swapper/212:07:322
2585899358,17cyclictest0-21swapper/212:07:322
2585899355,6cyclictest8050irq/56-dwc_otg_10:32:252
2585899351,7cyclictest31-21ksoftirqd/210:38:152
2585899351,26cyclictest9350-21missed_timers10:57:442
2585799355,14cyclictest8150irq/56-dwc_otg_09:32:181
2585799351,8cyclictest10761-21ssh11:46:001
25857993516,5cyclictest11659-21/usr/sbin/munin08:12:371
25857993516,5cyclictest11659-21/usr/sbin/munin08:12:371
25857993516,4cyclictest7950irq/56-dwc_otg12:30:291
25857993512,10cyclictest0-21swapper/110:37:421
213712350,1sleep30-21swapper/310:27:433
2585999349,6cyclictest8050irq/56-dwc_otg_11:07:433
2585999348,12cyclictest0-21swapper/310:37:373
2585999347,3cyclictest0-21swapper/309:45:203
2585999345,16cyclictest9909-21aten_rbpower_en08:07:313
2585999344,19cyclictest0-21swapper/307:19:313
25859993413,6cyclictest4756-21cron10:52:183
25859993413,6cyclictest4756-21cron10:52:183
2585999341,22cyclictest19277-21ls11:12:333
2585899346,6cyclictest8050irq/56-dwc_otg_09:07:182
2585899346,16cyclictest0-21swapper/209:12:302
25858993411,8cyclictest8150irq/56-dwc_otg_11:23:442
2585899341,12cyclictest0-21swapper/209:29:222
25858993410,4cyclictest7221-21fschecks_count10:07:382
2585799347,12cyclictest8150irq/56-dwc_otg_10:52:501
2585799347,12cyclictest0-21swapper/110:27:361
2585799346,8cyclictest31899-21latency_hist07:32:181
2585799346,14cyclictest7950irq/56-dwc_otg12:17:351
2585799341,5cyclictest8050irq/56-dwc_otg_11:32:281
25857993414,11cyclictest17317-21sh10:22:291
25857993413,4cyclictest19290-21fschecks_time08:32:381
2585799341,17cyclictest0-21swapper/110:01:521
114762340,1sleep10-21swapper/111:01:301
2585999339,3cyclictest0-21swapper/312:03:433
2585999338,8cyclictest17118-21ssh12:33:223
2585999332,5cyclictest7950irq/56-dwc_otg11:22:363
25859993323,7cyclictest5693-21ssh12:20:063
25859993313,4cyclictest22980-21grep11:17:333
25859993312,5cyclictest28036-21sh12:07:403
25859993312,5cyclictest28036-21sh12:07:403
2585999331,20cyclictest8150irq/56-dwc_otg_10:27:193
2585899334,13cyclictest31-21ksoftirqd/208:07:332
2585899330,15cyclictest7950irq/56-dwc_otg08:22:472
2585799337,4cyclictest8050irq/56-dwc_otg_08:57:371
2585799335,13cyclictest8150irq/56-dwc_otg_08:27:191
2585799334,18cyclictest0-21swapper/109:54:301
25857993325,6cyclictest7950irq/56-dwc_otg10:07:311
25857993321,4cyclictest1292-21runrttasks09:12:201
2585799331,6cyclictest15773-21diskstats12:32:371
25857993315,10cyclictest13572-21sh11:48:591
2585799331,3cyclictest8050irq/56-dwc_otg_10:12:301
25857993311,4cyclictest0-21swapper/111:12:341
2585799331,10cyclictest0-21swapper/111:24:541
2585999327,14cyclictest0-21swapper/310:19:183
2585999324,5cyclictest8050irq/56-dwc_otg_09:37:503
2585999322,13cyclictest0-21swapper/311:47:323
25859993213,4cyclictest738-21diskmemload10:06:213
2585799327,5cyclictest7950irq/56-dwc_otg09:47:511
2585799326,15cyclictest0-21swapper/110:42:431
2585799323,16cyclictest0-21swapper/111:03:501
2585799322,9cyclictest9550irq/48-DMA14:55:081
2585799321,13cyclictest20856-21aten_rbpower_en08:37:321
2585999317,5cyclictest7950irq/56-dwc_otg08:57:373
2585999317,4cyclictest8150irq/56-dwc_otg_09:17:373
2585999316,8cyclictest0-21swapper/311:57:283
2585999314,9cyclictest0-21swapper/308:27:313
2585999314,5cyclictest8050irq/56-dwc_otg_08:17:343
2585999312,12cyclictest3274350wget07:37:273
2585999311,5cyclictest30927-21irqstats10:42:413
2585999311,4cyclictest29702-21/usr/sbin/munin11:27:323
2585999311,3cyclictest0-21swapper/309:33:573
2585899311,6cyclictest17189-21/usr/sbin/munin08:27:432
2585799316,12cyclictest7950irq/56-dwc_otg07:12:231
2585799314,15cyclictest0-21swapper/107:37:291
2585799314,12cyclictest22942-21tune2fs08:42:351
2585799311,7cyclictest31742-21aten_rbpower_vo09:07:341
25857993114,5cyclictest13526-21aten_rbpower_en08:17:301
2585799311,10cyclictest0-21swapper/111:09:311
25859993021,7cyclictest26472-21ssh10:37:183
25859993010,4cyclictest8050irq/56-dwc_otg_11:00:553
25859993010,4cyclictest19742-21proc_pri08:32:463
2585899308,10cyclictest29-21rcuc/207:34:282
2585799307,11cyclictest8150irq/56-dwc_otg_07:57:341
2585799305,12cyclictest8150irq/56-dwc_otg_08:27:501
2585799303,21cyclictest0-21swapper/107:43:421
248352307,11sleep20-21swapper/207:07:442
2585999299,4cyclictest0-21swapper/309:15:073
2585999292,18cyclictest0-21swapper/308:25:253
2585999292,12cyclictest8050irq/56-dwc_otg_08:47:353
2585999292,12cyclictest8050irq/56-dwc_otg_08:47:353
25859992910,3cyclictest0-21swapper/309:25:153
25859992910,3cyclictest0-21swapper/309:25:153
2585899291,26cyclictest2470-21ls07:47:182
2585999288,6cyclictest8050irq/56-dwc_otg_07:27:443
2585999286,4cyclictest8150irq/56-dwc_otg_07:17:193
2585999286,4cyclictest0-21swapper/308:12:383
2585999286,4cyclictest0-21swapper/308:12:383
2585999282,18cyclictest0-21swapper/308:57:053
25859992813,12cyclictest31866-21fschecks_count09:07:373
2585999281,14cyclictest8150irq/56-dwc_otg_09:02:223
2585899282,13cyclictest8050irq/56-dwc_otg_07:25:502
2585899282,13cyclictest8050irq/56-dwc_otg_07:25:502
2585799281,13cyclictest0-21swapper/109:02:511
2585999273,5cyclictest8050irq/56-dwc_otg_07:57:183
2585999272,16cyclictest0-21swapper/307:34:263
25858992712,6cyclictest8050irq/56-dwc_otg_07:21:342
2585799271,17cyclictest0-21swapper/107:47:401
2585999266,10cyclictest8150irq/56-dwc_otg_07:50:313
2585999253,6cyclictest8150irq/56-dwc_otg_08:42:393
2585899251,4cyclictest0-21swapper/207:27:242
2585999242,4cyclictest8150irq/56-dwc_otg_07:43:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional