You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 15:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Tue Jul 16, 2024 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4086991035,12cyclictest11891-21fschecks_time10:12:270
4091999611,19cyclictest0-21swapper/206:52:172
409199954,30cyclictest0-21swapper/207:35:462
4091999522,13cyclictest0-21swapper/210:32:502
409099954,85cyclictest0-21swapper/111:12:051
4086999439,10cyclictest13482-21unixbench_multi11:17:460
4091999334,41cyclictest0-21swapper/211:22:252
4091999334,41cyclictest0-21swapper/211:22:252
4090999330,8cyclictest19248-21munin-node08:18:021
408699939,17cyclictest0-21swapper/007:27:150
409199924,30cyclictest0-21swapper/207:12:312
409199924,30cyclictest0-21swapper/207:12:312
4091999237,48cyclictest17254-21crond08:17:112
4091999236,47cyclictest29755-21gltestperf10:47:322
4090999238,47cyclictest5311-21gltestperf06:47:381
4090999226,13cyclictest0-21swapper/109:07:111
409399913,81cyclictest0-21swapper/307:47:143
409199915,28cyclictest0-21swapper/209:52:492
409199914,30cyclictest0-21swapper/208:38:062
409199914,30cyclictest0-21swapper/208:38:062
4091999131,43cyclictest0-21swapper/211:32:052
409199904,29cyclictest0-21swapper/208:32:562
409099905,9cyclictest22482-21munin-node11:37:211
409099902,81cyclictest20366-21idleruntime-cro09:27:091
4091998910,12cyclictest0-21swapper/210:52:442
409099894,79cyclictest0-21swapper/110:47:451
4090998937,46cyclictest6469-21head08:57:331
409099893,77cyclictest7678-21fschecks_time06:52:361
4091998815,7cyclictest7150irq/45-ahci09:27:102
409099886,25cyclictest14155-21munin-node11:22:421
409099886,25cyclictest14155-21munin-node11:22:421
409099883,37cyclictest0-21swapper/109:37:251
4090998821,9cyclictest9922-21munin-node08:03:011
180202880,6sleep1201ktimersoftd/107:12:411
180202880,6sleep1201ktimersoftd/107:12:411
409399877,72cyclictest0-21swapper/309:57:403
409199874,11cyclictest5000-21grep11:02:312
4093998611,52cyclictest98550irq/46-eth010:22:243
409199867,13cyclictest0-21swapper/211:52:142
409199864,76cyclictest0-21swapper/211:12:292
409199864,73cyclictest0-21swapper/210:47:062
409199864,73cyclictest0-21swapper/210:47:062
409199864,14cyclictest0-21swapper/209:07:452
4091998617,11cyclictest0-21swapper/207:17:442
4091998617,11cyclictest0-21swapper/207:17:442
409099869,12cyclictest0-21swapper/110:52:151
409099864,34cyclictest0-21swapper/107:43:051
409099864,33cyclictest29570-21vmstat08:38:081
409099864,33cyclictest29570-21vmstat08:38:081
409099863,30cyclictest0-21swapper/107:52:301
409399854,8cyclictest24265-21df_abs10:37:253
409199855,32cyclictest0-21swapper/207:47:572
409199854,34cyclictest0-21swapper/208:22:032
409199854,33cyclictest0-21swapper/208:52:572
409199854,22cyclictest0-21swapper/211:32:212
409199854,13cyclictest0-21swapper/210:02:482
409199854,13cyclictest0-21swapper/210:02:482
4091998524,12cyclictest0-21swapper/209:17:532
4091998524,12cyclictest0-21swapper/209:17:532
4090998534,44cyclictest17429-21grep11:27:241
409099853,27cyclictest0-21swapper/112:12:161
4090998520,10cyclictest1304-21runrttasks09:51:231
409399844,64cyclictest0-21swapper/307:32:493
409399843,48cyclictest0-21swapper/309:21:413
409399843,48cyclictest0-21swapper/309:21:413
409199844,17cyclictest0-21swapper/207:42:542
4091998427,12cyclictest0-21swapper/206:57:322
4091998424,12cyclictest1304-21runrttasks11:43:102
4091998417,14cyclictest0-21swapper/208:30:562
4091998416,15cyclictest0-21swapper/210:27:342
409099844,37cyclictest0-21swapper/110:22:081
409099844,34cyclictest21987-21munin-node07:23:001
409099843,37cyclictest0-21swapper/110:02:081
409099843,36cyclictest0-21swapper/107:57:311
409099843,36cyclictest0-21swapper/107:57:311
409199835,29cyclictest0-21swapper/212:07:222
409199835,14cyclictest0-21swapper/208:42:442
409199834,34cyclictest0-21swapper/207:57:562
409199834,34cyclictest0-21swapper/207:57:562
409199834,27cyclictest0-21swapper/207:27:332
409199834,16cyclictest0-21swapper/212:02:292
409199834,16cyclictest0-21swapper/212:02:292
409199834,15cyclictest0-21swapper/209:32:342
4091998330,11cyclictest5523-21fschecks_count07:52:322
4091998328,9cyclictest31671-21grep09:47:362
409099833,40cyclictest0-21swapper/109:32:261
409099833,26cyclictest0-21swapper/108:35:561
409399823,71cyclictest0-21swapper/307:12:313
409399823,71cyclictest0-21swapper/307:12:313
409199825,32cyclictest0-21swapper/207:37:252
409199824,27cyclictest0-21swapper/206:52:452
409199824,13cyclictest0-21swapper/210:57:182
4091998231,44cyclictest20771-21egrep09:27:232
4091998224,13cyclictest0-21swapper/207:02:322
4091998216,13cyclictest0-21swapper/211:17:172
409099824,32cyclictest30140-21munin-node08:42:281
4090998230,9cyclictest4136-21cut11:02:191
409099823,38cyclictest0-21swapper/110:33:021
409099823,33cyclictest1283-21snmpd07:38:001
176532820,7sleep00-21swapper/011:27:270
409399814,70cyclictest0-21swapper/312:12:443
409399813,71cyclictest0-21swapper/307:57:373
409399813,71cyclictest0-21swapper/307:57:373
409199816,14cyclictest0-21swapper/208:07:242
409199815,66cyclictest13350-21latency_hist10:17:082
409199814,33cyclictest0-21swapper/208:47:532
409199814,16cyclictest0-21swapper/210:07:492
409199814,15cyclictest0-21swapper/207:07:532
409199814,12cyclictest0-21swapper/210:37:232
4091998130,38cyclictest0-21swapper/208:22:312
409099814,34cyclictest1304-21runrttasks11:32:481
409099813,71cyclictest0-21swapper/112:07:251
409099813,14cyclictest0-21swapper/108:30:561
409399804,69cyclictest0-21swapper/311:57:413
409399804,46cyclictest0-21swapper/311:37:053
409399804,46cyclictest0-21swapper/306:52:163
409399803,9cyclictest4284-21needreboot08:52:443
4093998014,41cyclictest141551munin-node11:22:383
4093998014,41cyclictest141551munin-node11:22:383
409199809,10cyclictest98550irq/46-eth010:17:472
409199805,14cyclictest0-21swapper/209:12:172
409199804,30cyclictest0-21swapper/209:59:032
409199804,14cyclictest0-21swapper/209:37:172
4091998038,34cyclictest9380-21nfs_client09:02:492
4091998022,10cyclictest6863-21cat11:07:172
4091998020,9cyclictest31966-21telnet11:57:142
4091998019,14cyclictest0-21swapper/209:42:372
409099803,70cyclictest0-21swapper/108:52:421
409099803,33cyclictest17010-21munin-node09:17:461
409099803,33cyclictest17010-21munin-node09:17:461
409099803,33cyclictest13014-21munin-node09:12:471
409099803,33cyclictest0-21swapper/107:32:271
409399795,67cyclictest0-21swapper/310:07:083
409399795,67cyclictest0-21swapper/310:07:083
409399793,58cyclictest0-21swapper/306:57:363
409399793,52cyclictest13339-21cpuspeed_turbos09:12:213
409399793,11cyclictest0-21swapper/307:07:563
409199798,16cyclictest0-21swapper/212:12:462
409199794,33cyclictest0-21swapper/207:22:252
409199794,28cyclictest0-21swapper/210:22:452
409099794,35cyclictest0-21swapper/107:11:081
409099794,32cyclictest3261-21iostat12:02:371
409099794,32cyclictest3261-21iostat12:02:371
409099794,23cyclictest0-21swapper/109:07:211
409099793,35cyclictest0-21swapper/107:50:441
409399788,48cyclictest0-21swapper/309:32:103
409399784,67cyclictest0-21swapper/308:37:473
409399784,67cyclictest0-21swapper/308:37:473
409399783,9cyclictest29023-21grep09:42:363
409399783,67cyclictest1283-21snmpd11:12:273
409399783,47cyclictest0-21swapper/311:02:323
409199784,34cyclictest0-21swapper/211:47:212
409099784,31cyclictest24601-21fschecks_time10:37:291
409099783,68cyclictest0-21swapper/111:52:121
4090997823,13cyclictest0-21swapper/109:30:141
4090997821,10cyclictest0-21swapper/108:27:041
409399774,66cyclictest0-21swapper/309:32:243
409399773,9cyclictest26559-21latency_hist11:47:043
4093997710,48cyclictest2072-21telnet12:02:163
4093997710,48cyclictest2072-21telnet12:02:163
409199774,25cyclictest0-21swapper/208:02:242
409199772,22cyclictest0-21swapper/208:59:272
4091997719,12cyclictest1304-21runrttasks11:37:222
409099773,25cyclictest0-21swapper/110:58:391
4090997718,10cyclictest0-21swapper/110:27:451
409399764,65cyclictest0-21swapper/311:40:333
409399763,67cyclictest0-21swapper/310:32:523
409399763,11cyclictest0-21swapper/309:07:303
4093997620,33cyclictest0-21swapper/310:16:453
409099763,36cyclictest0-21swapper/111:18:461
4090997622,11cyclictest0-21swapper/109:57:091
4090997618,11cyclictest0-21swapper/111:47:251
409399759,43cyclictest0-21swapper/311:02:063
409399755,9cyclictest21599-21fgrep08:22:513
409399753,9cyclictest26424-21unixbench_singl07:28:023
409399753,9cyclictest26221-21df_abs09:37:253
409399753,50cyclictest0-21swapper/308:57:563
409399753,46cyclictest0-21swapper/310:22:083
409399753,11cyclictest0-21swapper/310:52:173
409399753,10cyclictest0-21swapper/308:44:443
409399744,9cyclictest13481-21python07:02:593
409399743,7cyclictest29093-21munin-run11:52:033
409099744,9cyclictest28193-21yum10:42:541
409099744,9cyclictest28193-21yum10:42:541
409099743,36cyclictest0-21swapper/107:05:441
409099743,35cyclictest0-21swapper/110:08:471
4090997421,10cyclictest10265-21iostat11:12:301
4090997421,10cyclictest0-21swapper/107:27:351
409399738,44cyclictest98550irq/46-eth010:42:183
409399738,44cyclictest98550irq/46-eth010:42:183
409399737,58cyclictest29863-21cpuspeed_turbos07:37:283
409399735,49cyclictest31053-21sleep10:52:063
409399735,10cyclictest21279-21unixbench-2d07:18:043
409399735,10cyclictest21279-21unixbench-2d07:18:043
409399734,8cyclictest7150irq/45-ahci12:09:143
409399734,41cyclictest0-21swapper/309:25:133
4093997317,42cyclictest0-21swapper/309:02:563
4093997312,46cyclictest12597-21gltestperf11:17:273
409099733,39cyclictest0-21swapper/108:49:241
409399728,49cyclictest98550irq/46-eth011:07:173
409399726,59cyclictest0-21swapper/308:07:263
409399725,60cyclictest0-21swapper/307:52:513
409399724,8cyclictest27372-21munin-run08:37:113
409399723,53cyclictest0-21swapper/307:22:583
409399723,49cyclictest30811-21telnet09:47:223
409099723,36cyclictest0-21swapper/107:01:281
409099723,34cyclictest0-21swapper/111:57:481
409099723,34cyclictest0-21swapper/107:21:371
409099723,34cyclictest0-21swapper/107:21:371
409399719,55cyclictest0-21swapper/311:32:053
409399715,58cyclictest0-21swapper/308:47:363
409399714,58cyclictest0-21swapper/310:27:173
409399713,8cyclictest9122-21latency_hist06:57:153
409399712,10cyclictest0-21swapper/309:56:083
409099713,35cyclictest0-21swapper/110:07:011
409099713,35cyclictest0-21swapper/110:07:011
409099713,34cyclictest0-21swapper/109:42:531
409099713,34cyclictest0-21swapper/108:16:471
409399706,57cyclictest0-21swapper/308:17:353
409399704,58cyclictest0-21swapper/308:12:253
409399703,9cyclictest0-21swapper/311:52:153
409399703,60cyclictest0-21swapper/307:52:133
409099703,59cyclictest11156-21telnet10:12:191
4090997020,10cyclictest0-21swapper/110:22:541
409399694,58cyclictest0-21swapper/308:02:263
409399694,57cyclictest0-21swapper/310:07:103
409399694,57cyclictest0-21swapper/308:27:353
409399685,56cyclictest0-21swapper/306:47:173
408699683,58cyclictest0-21swapper/008:12:130
409099673,34cyclictest0-21swapper/108:09:031
4086996414,43cyclictest0-21swapper/011:41:380
408699616,49cyclictest0-21swapper/010:47:060
408699616,49cyclictest0-21swapper/010:47:060
408699605,47cyclictest1304-21runrttasks07:52:300
408699593,12cyclictest0-21swapper/011:32:220
4086995838,13cyclictest570-21grep08:47:260
23462574,46sleep02618-21fschecks_time06:42:360
409099563,46cyclictest0-21swapper/111:42:501
408699565,11cyclictest0-21swapper/006:57:300
408699564,12cyclictest0-21swapper/007:18:030
408699564,12cyclictest0-21swapper/007:18:030
408699564,11cyclictest0-21swapper/009:17:470
408699564,11cyclictest0-21swapper/009:17:470
408699563,13cyclictest0-21swapper/010:57:430
408699563,12cyclictest0-21swapper/009:07:190
408699563,12cyclictest0-21swapper/007:32:450
96702554,44sleep00-21swapper/008:02:010
96702554,44sleep00-21swapper/008:02:010
62222553,11sleep00-21swapper/011:05:350
408699553,12cyclictest0-21swapper/007:47:300
4086995510,19cyclictest0-21swapper/011:17:060
31712554,12sleep00-21swapper/009:56:150
309162556,43sleep00-21swapper/010:50:320
408699545,27cyclictest0-21swapper/009:12:110
408699544,12cyclictest0-21swapper/009:07:110
408699543,11cyclictest0-21swapper/009:27:480
408699543,10cyclictest0-21swapper/007:07:490
4086995422,14cyclictest0-21swapper/008:30:580
408699535,29cyclictest0-21swapper/007:03:020
408699534,29cyclictest0-21swapper/006:47:390
408699534,21cyclictest0-21swapper/007:42:490
4086995322,12cyclictest0-21swapper/007:37:480
4086995310,19cyclictest0-21swapper/011:22:170
4086995310,19cyclictest0-21swapper/011:22:170
4086995237,10cyclictest27111-21grep11:47:180
4086995235,10cyclictest18560-21wc08:17:390
253472524,41sleep00-21swapper/009:36:240
234402527,39sleep00-21swapper/010:37:020
220572525,41sleep00-21swapper/008:23:540
183692523,42sleep00-21swapper/010:26:500
65632516,38sleep00-21swapper/012:07:500
408699514,29cyclictest0-21swapper/010:52:150
408699514,29cyclictest0-21swapper/007:22:420
408699514,27cyclictest0-21swapper/011:52:480
408699514,27cyclictest0-21swapper/010:21:460
408699514,27cyclictest0-21swapper/009:02:110
4086995121,13cyclictest0-21swapper/008:56:000
4086995120,14cyclictest0-21swapper/009:42:280
4086995120,13cyclictest0-21swapper/012:16:310
4086995119,14cyclictest23714-21head10:37:180
408699505,27cyclictest0-21swapper/008:42:420
408699505,27cyclictest0-21swapper/007:12:270
408699505,27cyclictest0-21swapper/007:12:270
408699504,28cyclictest0-21swapper/012:05:090
408699504,28cyclictest0-21swapper/012:05:090
408699504,27cyclictest0-21swapper/011:57:150
408699504,27cyclictest0-21swapper/009:22:570
4086995019,13cyclictest0-21swapper/008:05:510
4086995018,13cyclictest0-21swapper/010:07:540
297962503,40sleep00-21swapper/008:40:500
297962503,40sleep00-21swapper/008:40:500
77682493,40sleep00-21swapper/006:52:380
408699494,27cyclictest0-21swapper/009:51:080
408699494,25cyclictest0-21swapper/009:37:250
408699494,15cyclictest0-21swapper/011:07:260
408699494,14cyclictest0-21swapper/010:02:360
408699494,14cyclictest0-21swapper/010:02:360
4086994918,15cyclictest0-21swapper/011:42:190
4086994918,14cyclictest0-21swapper/009:57:330
4086994918,14cyclictest0-21swapper/008:32:280
408699485,26cyclictest0-21swapper/008:12:250
408699483,26cyclictest0-21swapper/010:27:320
409199393,32cyclictest0-21swapper/206:47:162
4090993116,8cyclictest4269-21sed06:47:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional