You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 12:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Fri Apr 26, 2024 00:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24753991054,36cyclictest0-21swapper/119:12:211
152542950,4sleep015256-21latency_hist22:12:200
2475599895,7cyclictest8150irq/56-dwc_otg_19:12:223
2475399827,35cyclictest0-21swapper/119:37:311
24752998136,20cyclictest0-21swapper/019:12:220
183182810,3sleep118321-21aten_rbpower_cu21:32:321
178102810,2sleep121-21rcuc/121:31:591
270522790,3sleep30-21swapper/321:42:483
270522790,3sleep30-21swapper/321:42:483
2475399777,34cyclictest0-21swapper/119:17:321
207862770,4sleep12475399cyclictest22:18:331
35192750,4sleep337-21rcuc/322:39:243
176762750,6sleep12475399cyclictest20:22:201
176762750,6sleep12475399cyclictest20:22:201
24752997319,20cyclictest20170-21sh23:02:310
24752997319,20cyclictest20170-21sh23:02:310
24752997132,8cyclictest0-21swapper/022:42:300
24752997132,8cyclictest0-21swapper/022:42:300
2475299679,13cyclictest0-21swapper/020:22:310
2475299675,33cyclictest0-21swapper/023:37:320
2475299668,31cyclictest11-21rcu_preempt22:32:330
2475299658,40cyclictest0-21swapper/023:32:290
24752996334,5cyclictest8050irq/56-dwc_otg_21:12:190
24752996334,5cyclictest8050irq/56-dwc_otg_21:12:190
2475299626,26cyclictest0-21swapper/019:32:300
2475299616,34cyclictest9-21ksoftirqd/021:27:490
2475299612,30cyclictest22046-21ssh21:37:260
24752996042,5cyclictest23789-21ls20:37:400
24752996038,4cyclictest8150irq/56-dwc_otg_22:22:320
24752996031,8cyclictest7950irq/56-dwc_otg21:47:350
2475299592,5cyclictest0-21swapper/000:02:190
2475299592,54cyclictest18276-21ssh21:32:290
2475299591,6cyclictest10863-21ssh21:22:280
24752995816,4cyclictest0-21swapper/022:47:320
2475599573,4cyclictest0-21swapper/323:07:293
24752995726,11cyclictest7950irq/56-dwc_otg00:37:370
2475299571,36cyclictest16690-21unixbench_singl22:12:490
24754995615,27cyclictest17611-21ssh23:42:292
24752995632,4cyclictest0-21swapper/000:32:350
24754995513,30cyclictest0-21swapper/220:22:312
24752995516,9cyclictest0-21swapper/023:42:290
2475299551,38cyclictest0-21swapper/021:02:350
2475299551,28cyclictest0-21swapper/019:17:300
2475299551,24cyclictest0-21swapper/022:17:380
242272552,14sleep00-21swapper/019:09:090
2475299549,26cyclictest0-21swapper/000:22:190
2475299546,33cyclictest0-21swapper/019:52:330
2475299546,30cyclictest9-21ksoftirqd/022:02:360
2475299541,6cyclictest13-21rcuc/022:29:280
2475299541,36cyclictest25613-21grep23:52:390
24754995313,8cyclictest0-21swapper/222:07:312
2475299539,27cyclictest9-21ksoftirqd/023:17:470
2475299531,30cyclictest30196-21ls20:57:190
2475299531,24cyclictest0-21swapper/023:12:430
24754995232,13cyclictest3170-21diskmemload22:52:322
2475299527,24cyclictest26863-21timerwakeupswit21:42:470
2475299527,24cyclictest26863-21timerwakeupswit21:42:470
2475299523,9cyclictest0-21swapper/019:42:310
24752995230,11cyclictest9-21ksoftirqd/020:47:430
2475299522,46cyclictest0-21swapper/020:02:320
2475299522,38cyclictest0-21swapper/000:27:310
2475299522,25cyclictest0-21swapper/023:22:520
2475299521,30cyclictest7569-21fschecks_time21:17:380
2475599514,38cyclictest8150irq/56-dwc_otg_00:27:303
2475299515,22cyclictest31525-21grep20:57:500
2475299513,31cyclictest18368-21ssh22:59:080
2475299512,34cyclictest0-21swapper/020:27:400
2475299512,32cyclictest4692-21unixbench_multi21:12:490
2475299512,24cyclictest0-21swapper/023:27:500
2475299511,32cyclictest13-21rcuc/022:37:360
2475599502,4cyclictest8150irq/56-dwc_otg_19:17:313
2475299507,28cyclictest15980-21apt-get20:17:300
2475299507,28cyclictest15980-21apt-get20:17:300
2475299505,13cyclictest12545-21uniq20:07:380
2475299504,23cyclictest26092-21grep20:42:550
2475599498,25cyclictest0-21swapper/320:17:323
2475599498,25cyclictest0-21swapper/320:17:323
24754994911,12cyclictest0-21swapper/220:32:302
2475299495,6cyclictest7950irq/56-dwc_otg20:32:300
24752994925,5cyclictest30388-21aten_rbpower_po19:27:330
2475299492,4cyclictest0-21swapper/021:52:510
2475299492,22cyclictest0-21swapper/000:02:340
2475299491,30cyclictest0-21swapper/023:51:270
2475299491,2cyclictest0-21swapper/000:22:270
2475299491,24cyclictest5441-21ls19:47:390
2475499484,22cyclictest0-21swapper/223:22:322
2475299482,34cyclictest0-21swapper/020:16:260
2475299482,34cyclictest0-21swapper/020:16:260
2475299481,29cyclictest0-21swapper/019:22:250
2475299481,29cyclictest0-21swapper/019:22:250
2475299481,24cyclictest13486-21tr22:52:450
2475599477,26cyclictest0-21swapper/319:57:313
2475599471,5cyclictest8150irq/56-dwc_otg_22:32:343
2475499475,6cyclictest0-21swapper/222:32:322
24752994728,4cyclictest8150irq/56-dwc_otg_00:07:480
2475499467,14cyclictest0-21swapper/221:02:322
2475499465,15cyclictest15437-21ssh22:12:292
2475499463,7cyclictest8050irq/56-dwc_otg_22:02:282
24754994623,14cyclictest29640-21ssh21:47:352
2475399467,26cyclictest0-21swapper/122:42:311
2475399467,26cyclictest0-21swapper/122:42:311
2475399457,26cyclictest0-21swapper/121:47:341
2475399453,6cyclictest7950irq/56-dwc_otg23:07:291
24753994520,12cyclictest1329-21cat19:37:191
2475299452,33cyclictest2621-21grep19:37:480
2475299450,37cyclictest6107-21kworker/0:100:12:240
2475599445,11cyclictest8050irq/56-dwc_otg_00:12:303
2475499444,23cyclictest0-21swapper/219:12:212
2475399447,24cyclictest0-21swapper/120:57:321
2475399445,3cyclictest0-21swapper/121:42:431
2475399445,3cyclictest0-21swapper/121:42:431
2475299442,34cyclictest0-21swapper/023:11:580
2475299441,32cyclictest13-21rcuc/021:57:420
2475599438,23cyclictest4532-21ssh21:57:313
24755994320,5cyclictest21700-21sh00:32:493
2475499437,23cyclictest0-21swapper/222:37:292
2475499437,22cyclictest0-21swapper/200:02:302
2475499436,23cyclictest0-21swapper/220:27:302
2475499435,28cyclictest7950irq/56-dwc_otg22:47:192
2475499435,28cyclictest7950irq/56-dwc_otg22:47:192
2475499434,21cyclictest0-21swapper/220:12:312
2475499434,21cyclictest0-21swapper/220:12:312
2475399436,23cyclictest0-21swapper/123:32:321
2475299432,25cyclictest0-21swapper/020:00:160
2475599427,29cyclictest0-21swapper/320:57:323
2475599427,24cyclictest0-21swapper/321:47:253
2475499427,25cyclictest0-21swapper/219:52:332
2475499422,27cyclictest8050irq/56-dwc_otg_23:32:392
2475399427,22cyclictest0-21swapper/122:07:321
2475599416,25cyclictest0-21swapper/319:37:313
2475599413,24cyclictest0-21swapper/319:47:333
2475499416,25cyclictest0-21swapper/219:32:312
2475499414,8cyclictest0-21swapper/223:37:322
24754994111,5cyclictest0-21swapper/220:02:322
194662410,2sleep30-21swapper/323:01:303
2475599402,30cyclictest0-21swapper/300:40:543
2475499407,23cyclictest0-21swapper/222:17:332
2475499406,24cyclictest0-21swapper/200:37:322
2475499405,24cyclictest7950irq/56-dwc_otg21:12:492
2475499403,20cyclictest0-21swapper/223:07:292
24754994010,8cyclictest0-21swapper/219:47:502
24753994018,10cyclictest8150irq/56-dwc_otg_21:17:481
24755993929,6cyclictest381ktimersoftd/320:12:293
24755993929,6cyclictest381ktimersoftd/320:12:293
2475599391,23cyclictest32009-21ls19:32:193
2475599391,20cyclictest14384-21ssh21:27:203
2475499397,23cyclictest0-21swapper/219:22:252
2475499397,23cyclictest0-21swapper/219:22:252
2475499397,22cyclictest0-21swapper/220:42:302
2475499394,23cyclictest8050irq/56-dwc_otg_00:32:192
2475399392,7cyclictest8050irq/56-dwc_otg_20:47:301
24753993921,5cyclictest4844-21seq21:12:541
24753993914,5cyclictest21014-21ps23:02:461
24753993914,5cyclictest21014-21ps23:02:461
24755993814,15cyclictest381ktimersoftd/322:17:483
2475599381,3cyclictest0-21swapper/323:13:013
2475499387,26cyclictest0-21swapper/200:22:302
2475499386,20cyclictest8944-21ssh22:47:342
2475499381,25cyclictest25422-21ls23:52:362
24753993824,7cyclictest8150irq/56-dwc_otg_20:12:491
24753993824,7cyclictest8150irq/56-dwc_otg_20:12:491
2475399381,8cyclictest2201750ssh00:32:521
24753993818,8cyclictest26707-21sh00:41:161
2475399381,25cyclictest0-21swapper/121:22:341
2475599377,10cyclictest8150irq/56-dwc_otg_23:47:373
2475599374,10cyclictest13853-21ssh23:37:313
2475599373,28cyclictest8150irq/56-dwc_otg_00:07:313
2475599371,3cyclictest7950irq/56-dwc_otg20:07:333
2475499376,19cyclictest0-21swapper/200:32:252
2475399376,4cyclictest7950irq/56-dwc_otg22:59:081
2475399374,5cyclictest0-21swapper/122:32:391
2475399373,5cyclictest7950irq/56-dwc_otg22:52:431
24753993716,4cyclictest28532-21cat23:12:491
24753993710,4cyclictest0-21swapper/122:27:431
2475599366,20cyclictest22046-21ssh21:37:263
2475599363,24cyclictest18279-21apt-get21:32:293
2475499361,8cyclictest2631-21unixbench_singl19:37:482
2475399367,4cyclictest0-21swapper/100:27:401
2475399367,21cyclictest8050irq/56-dwc_otg_00:00:471
24753993622,5cyclictest1930-21sh00:04:061
24753993617,5cyclictest6632-21fschecks_time23:27:361
24753993612,5cyclictest18131-21kernelversion23:42:381
24753993611,10cyclictest8150irq/56-dwc_otg_23:47:411
206722360,2sleep20-21swapper/221:35:062
2475599353,17cyclictest8150irq/56-dwc_otg_22:23:533
2475599352,8cyclictest0-21swapper/319:23:003
2475599352,8cyclictest0-21swapper/319:23:003
24755993517,5cyclictest21883-21/usr/sbin/munin20:32:413
2475599351,3cyclictest0-21swapper/323:06:293
2475599351,3cyclictest0-21swapper/323:06:293
24755993513,11cyclictest1862-21fschecks_count21:07:353
24755993513,11cyclictest1862-21fschecks_count21:07:353
24755993512,12cyclictest15673-21/usr/sbin/munin22:12:333
2475599351,17cyclictest0-21swapper/321:12:493
2475499353,17cyclictest8150irq/56-dwc_otg_23:27:492
2475499352,3cyclictest0-21swapper/223:57:492
2475499351,25cyclictest0-21swapper/220:57:502
2475499351,24cyclictest15271-21missed_timers21:27:422
2475499351,23cyclictest30908-21latency_hist23:17:202
2475499351,23cyclictest0-21swapper/220:47:422
2475399358,3cyclictest8150irq/56-dwc_otg_21:52:311
2475399358,16cyclictest0-21swapper/120:02:381
2475399355,15cyclictest8150irq/56-dwc_otg_22:22:501
2475399354,14cyclictest8150irq/56-dwc_otg_00:27:191
2475399352,23cyclictest0-21swapper/119:52:501
2475399351,4cyclictest8150irq/56-dwc_otg_21:07:371
2475399351,4cyclictest8150irq/56-dwc_otg_21:07:371
24753993514,5cyclictest1329450kworker/u9:022:12:281
24753993513,9cyclictest7950irq/56-dwc_otg22:50:481
2475399351,24cyclictest8429-21cut22:02:351
24753993511,13cyclictest28600-21cat23:57:201
2475599342,9cyclictest0-21swapper/320:02:493
2475599341,9cyclictest8150irq/56-dwc_otg_23:34:593
2475599341,24cyclictest8243-21ssh21:17:493
2475499347,24cyclictest15980-21apt-get20:17:302
2475499347,24cyclictest15980-21apt-get20:17:302
2475499346,19cyclictest8050irq/56-dwc_otg_22:59:442
2475499342,23cyclictest0-21swapper/221:58:142
2475499342,10cyclictest22120-21ssh21:37:322
2475499341,24cyclictest2113-21latency21:07:392
2475499341,24cyclictest2113-21latency21:07:392
2475399348,15cyclictest7863-21ntp_kernel_pll_00:12:431
2475399347,15cyclictest0-21swapper/121:57:311
2475399344,5cyclictest1292-21runrttasks20:42:421
2475399341,7cyclictest4388-21ntpq00:07:431
2475399341,6cyclictest11768-21grep00:17:491
24753993414,10cyclictest1631-21sh23:21:071
2475399341,24cyclictest5367-21cut19:47:371
24753993410,14cyclictest0-21swapper/123:22:531
2475599338,15cyclictest39-21ksoftirqd/323:57:193
2475599337,15cyclictest0-21swapper/323:22:343
2475599336,14cyclictest0-21swapper/322:52:403
2475599332,5cyclictest0-21swapper/300:02:413
24755993314,10cyclictest6984-21basename19:52:353
24755993312,9cyclictest27149-21tune2fs20:47:393
24755993310,13cyclictest0-21swapper/322:42:403
24755993310,13cyclictest0-21swapper/322:42:403
2475499336,13cyclictest8150irq/56-dwc_otg_00:07:472
2475499334,12cyclictest8050irq/56-dwc_otg_22:27:492
24754993318,4cyclictest301ktimersoftd/220:37:382
24754993315,5cyclictest8403-21/usr/sbin/munin00:12:522
2475499331,26cyclictest20560-21ls23:02:382
2475499331,26cyclictest20560-21ls23:02:382
2475499331,23cyclictest0-21swapper/223:17:362
2475399337,7cyclictest8050irq/56-dwc_otg_20:07:311
2475399337,23cyclictest0-21swapper/119:22:321
2475399337,23cyclictest0-21swapper/119:22:321
2475399336,4cyclictest0-21swapper/122:39:441
2475399336,13cyclictest8150irq/56-dwc_otg_21:37:471
2475399332,10cyclictest0-21swapper/123:37:311
2475399331,6cyclictest0-21swapper/120:22:511
2475399331,23cyclictest30537-21uniq19:27:371
2475399331,13cyclictest8150irq/56-dwc_otg_20:32:331
236362335,19sleep123680-21/usr/sbin/munin19:07:441
2475599327,5cyclictest8150irq/56-dwc_otg_20:52:513
2475599326,5cyclictest8150irq/56-dwc_otg_20:42:423
2475599321,6cyclictest11796-21grep00:17:493
2475599321,5cyclictest0-21swapper/300:22:373
2475599321,21cyclictest12813-21ssh22:07:503
2475499329,11cyclictest8150irq/56-dwc_otg_00:17:402
2475499324,5cyclictest8150irq/56-dwc_otg_20:57:192
2475499323,18cyclictest0-21swapper/221:57:012
2475499322,14cyclictest8150irq/56-dwc_otg_22:27:192
2475599319,4cyclictest8150irq/56-dwc_otg_23:42:443
2475599317,15cyclictest0-21swapper/321:27:323
2475599315,6cyclictest8050irq/56-dwc_otg_23:57:403
24755993110,4cyclictest8150irq/56-dwc_otg_22:47:363
24755993110,16cyclictest8150irq/56-dwc_otg_22:02:283
2475499316,15cyclictest0-21swapper/219:27:332
2475499314,4cyclictest8050irq/56-dwc_otg_23:47:462
2475499313,6cyclictest7950irq/56-dwc_otg21:17:372
2475499311,14cyclictest8050irq/56-dwc_otg_21:42:452
2475499311,14cyclictest8050irq/56-dwc_otg_21:42:452
24754993110,4cyclictest14181-21latency_hist21:27:192
2475399315,5cyclictest8050irq/56-dwc_otg_19:57:311
2475399312,4cyclictest29713-21unixbench-2d20:52:501
2475399311,23cyclictest3671-21snmpd21:03:301
2475399311,22cyclictest21204-21ls20:32:191
245012310,5sleep324499-21apt19:12:183
2475599309,4cyclictest0-21swapper/321:56:193
2475599305,11cyclictest8150irq/56-dwc_otg_19:42:483
24755993015,5cyclictest480-21ntp_states21:02:453
2475499305,6cyclictest8050irq/56-dwc_otg_19:17:502
2475499301,6cyclictest12630-21idleruntime20:07:402
2475399304,5cyclictest0-21swapper/119:42:321
2475599297,11cyclictest0-21swapper/323:17:273
2475599292,4cyclictest0-21swapper/323:27:353
2475599291,6cyclictest27045-21uname22:27:383
2475599291,3cyclictest0-21swapper/320:27:393
2475499296,10cyclictest0-21swapper/219:57:412
24753992917,9cyclictest0-21swapper/120:37:491
2475599286,15cyclictest0-21swapper/320:37:483
2475599282,6cyclictest8150irq/56-dwc_otg_19:32:313
229202283,13sleep20-21swapper/219:07:292
2475599278,12cyclictest8150irq/56-dwc_otg_20:22:443
2475499267,9cyclictest31-21ksoftirqd/219:42:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional