You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 01:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

x86 Intel Atom D510 @1667 MHz, Linux 3.12.61-rt81 (Profile)

Latency plot of shadow in rack #1, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Aug 12, 2022 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1337599915,54cyclictest0-21swapper/211:53:042
241999890,5rtkit-daemon2418-21rtkit-daemon10:31:483
241999860,5rtkit-daemon2418-21rtkit-daemon07:28:483
241999820,4rtkit-daemon2418-21rtkit-daemon12:15:443
13374998236,29cyclictest23685-21idleruntime-cro08:38:121
241999810,5rtkit-daemon2418-21rtkit-daemon09:48:353
13374998139,35cyclictest22800-21kernelversion11:58:301
13374998139,35cyclictest22800-21kernelversion11:58:301
241999800,5rtkit-daemon2418-21rtkit-daemon09:43:283
241999800,4rtkit-daemon2418-21rtkit-daemon08:58:303
13374998031,41cyclictest0-21swapper/110:52:581
241999790,4rtkit-daemon2418-21rtkit-daemon11:14:173
241999790,4rtkit-daemon2418-21rtkit-daemon11:14:173
13374997938,34cyclictest32698-21unixbench_multi08:53:431
13374997931,40cyclictest0-21swapper/107:43:251
13374997825,29cyclictest0-21swapper/108:38:241
241999760,5rtkit-daemon2418-21rtkit-daemon11:43:383
241999760,5rtkit-daemon2418-21rtkit-daemon08:28:383
241999760,5rtkit-daemon2418-21rtkit-daemon08:28:383
241999760,4rtkit-daemon2418-21rtkit-daemon07:18:483
13374997656,13cyclictest20236-21cut11:53:301
13374997629,29cyclictest0-21swapper/110:13:091
13374997538,30cyclictest19118-21fschecks_time10:43:251
13374997527,40cyclictest0-21swapper/110:38:071
13374997527,40cyclictest0-21swapper/110:38:071
13374997526,32cyclictest0-21swapper/110:03:361
1337799747,44cyclictest0-21swapper/308:58:113
13374997430,37cyclictest0-21swapper/107:50:071
13374997430,37cyclictest0-21swapper/107:50:071
13374997430,36cyclictest17061-21sshd11:48:151
13374997430,36cyclictest0-21swapper/109:19:311
13374997427,32cyclictest0-21swapper/107:22:101
13374997426,41cyclictest0-21swapper/110:38:361
13377997319,47cyclictest22200-21timerandwakeup07:23:463
13374997340,24cyclictest24061-21tail10:53:231
13374997339,26cyclictest5340-21runrttasks09:04:551
13374997338,28cyclictest7233-21needreboot12:33:271
13374997329,37cyclictest27049-21fschecks_count12:08:231
241999720,4rtkit-daemon2418-21rtkit-daemon08:08:463
241999720,13rtkit-daemon2418-21rtkit-daemon08:12:312
13374997240,23cyclictest1162-21gltestperf11:13:251
13374997240,23cyclictest1162-21gltestperf11:13:251
13374997236,29cyclictest23235-21gltestperf09:43:291
13374997234,30cyclictest1334-21runrttasks12:03:441
13374997229,36cyclictest0-21swapper/108:18:131
13374997228,36cyclictest0-21swapper/108:28:131
13374997223,42cyclictest0-21swapper/109:13:281
13374997223,29cyclictest5179-21chrt11:23:131
13374997220,44cyclictest0-21swapper/112:28:211
241999710,5rtkit-daemon2418-21rtkit-daemon11:53:153
241999710,5rtkit-daemon2418-21rtkit-daemon11:33:383
13374997133,31cyclictest0-21swapper/108:04:211
13374997131,33cyclictest5229-21hwlatdetect10:13:281
13374997131,33cyclictest10480-21python10:23:411
13374997131,32cyclictest20689-21munin-node07:23:291
13374997130,35cyclictest0-21swapper/108:19:251
13374997130,33cyclictest28554-21taskset09:53:411
13374997130,33cyclictest28554-21taskset09:53:411
13374997127,34cyclictest0-21swapper/107:33:291
13374997126,37cyclictest30227-21perl09:58:311
13374997123,42cyclictest0-21swapper/111:34:521
13374997123,39cyclictest0-21swapper/108:32:371
13374997123,39cyclictest0-21swapper/108:32:371
241999700,5rtkit-daemon2418-21rtkit-daemon09:33:213
13374997034,29cyclictest0-21swapper/111:18:491
13374997033,30cyclictest1334-21runrttasks07:11:321
13374997033,30cyclictest1334-21runrttasks07:11:321
13374997032,31cyclictest1334-21runrttasks12:21:051
13374997031,15cyclictest0-21swapper/109:28:101
13374997030,34cyclictest0-21swapper/108:47:191
13374997030,32cyclictest0-21swapper/109:41:401
13374997028,35cyclictest0-21swapper/111:09:071
13374997022,42cyclictest0-21swapper/107:31:561
13374996949,12cyclictest11859-21munin-node10:28:251
13374996940,22cyclictest1334-21runrttasks11:32:111
13374996937,25cyclictest29423-21fschecks_count12:13:191
13374996936,25cyclictest1334-21runrttasks12:27:311
13374996932,28cyclictest5393-21munin-node07:58:281
13374996924,37cyclictest0-21swapper/111:38:201
241999680,6rtkit-daemon2418-21rtkit-daemon09:28:583
241999680,4rtkit-daemon2418-21rtkit-daemon11:32:163
13374996835,27cyclictest0-21swapper/109:32:101
13374996835,26cyclictest1334-21runrttasks11:05:471
13374996833,28cyclictest1334-21runrttasks09:02:491
13374996734,26cyclictest1334-21runrttasks07:56:061
13374996734,20cyclictest28388-21fschecks_time07:38:291
13374996729,33cyclictest1334-21runrttasks10:18:281
241999660,4rtkit-daemon2418-21rtkit-daemon10:33:413
241999660,4rtkit-daemon2418-21rtkit-daemon10:33:413
241999660,4rtkit-daemon2418-21rtkit-daemon08:32:232
241999660,4rtkit-daemon2418-21rtkit-daemon08:32:232
13374996640,19cyclictest1240-21snmpd08:08:251
13374996637,22cyclictest16600-21runrttasks11:45:341
13374996630,28cyclictest0-21swapper/108:48:281
13374996628,17cyclictest0-21swapper/111:03:061
241999650,5rtkit-daemon2418-21rtkit-daemon12:33:142
241999650,4rtkit-daemon2418-21rtkit-daemon12:35:443
241999650,4rtkit-daemon2418-21rtkit-daemon10:49:183
241999650,4rtkit-daemon2418-21rtkit-daemon10:08:343
241999650,4rtkit-daemon2418-21rtkit-daemon09:58:273
13374996536,23cyclictest7714-21runrttasks09:09:561
13374996536,23cyclictest7714-21runrttasks09:09:561
13374996528,30cyclictest17824-21chrt07:14:511
13374996528,30cyclictest0-21swapper/109:50:131
284472648,8sleep20-21swapper/211:03:232
241999640,4rtkit-daemon2418-21rtkit-daemon09:27:062
241999640,4rtkit-daemon2418-21rtkit-daemon07:50:403
241999640,4rtkit-daemon2418-21rtkit-daemon07:50:403
241999630,5rtkit-daemon2418-21rtkit-daemon11:08:392
241999630,4rtkit-daemon2418-21rtkit-daemon09:08:292
241999630,4rtkit-daemon2418-21rtkit-daemon09:08:292
241999630,4rtkit-daemon2418-21rtkit-daemon07:23:262
13374996332,18cyclictest19728-21runrttasks09:37:191
13374996321,37cyclictest0-21swapper/107:08:161
64822623,12sleep30-21swapper/309:08:293
64822623,12sleep30-21swapper/309:08:293
241999620,5rtkit-daemon2418-21rtkit-daemon10:53:182
241999620,4rtkit-daemon2418-21rtkit-daemon11:38:312
241999620,4rtkit-daemon2418-21rtkit-daemon09:53:422
241999620,4rtkit-daemon2418-21rtkit-daemon09:53:422
241999620,4rtkit-daemon2418-21rtkit-daemon08:03:322
43352613,50sleep20-21swapper/211:18:392
241999610,6rtkit-daemon2418-21rtkit-daemon11:28:162
241999610,4rtkit-daemon2418-21rtkit-daemon09:01:222
241999610,4rtkit-daemon2418-21rtkit-daemon07:08:262
241999610,4rtkit-daemon2418-21rtkit-daemon07:08:262
61892603,48sleep00-21swapper/011:23:290
241999600,5rtkit-daemon2418-21rtkit-daemon08:16:242
241999600,4rtkit-daemon2418-21rtkit-daemon11:53:452
118482603,49sleep30-21swapper/309:18:453
77592583,46sleep07772-21diskstats08:03:280
1337599584,38cyclictest0-21swapper/209:08:112
10192584,12sleep00-21swapper/011:13:250
10192584,12sleep00-21swapper/011:13:250
66652570,5sleep334-21rcuc/307:58:463
241999570,4rtkit-daemon2418-21rtkit-daemon07:58:322
159392573,46sleep20-21swapper/210:38:082
159392573,46sleep20-21swapper/210:38:082
1337599574,36cyclictest0-21swapper/209:42:512
1337099565,41cyclictest0-21swapper/008:08:330
241999550,5rtkit-daemon2418-21rtkit-daemon08:33:302
1337599554,43cyclictest0-21swapper/208:48:232
13370995540,9cyclictest10957-21df09:18:290
6892545,9sleep2900-21latency_hist08:58:122
241999540,6rtkit-daemon2418-21rtkit-daemon10:58:402
241999540,6rtkit-daemon2418-21rtkit-daemon09:28:282
241999540,6rtkit-daemon2418-21rtkit-daemon07:14:492
241999540,5rtkit-daemon2418-21rtkit-daemon10:28:262
241999540,5rtkit-daemon2418-21rtkit-daemon10:18:342
1337799545,29cyclictest0-21swapper/310:23:433
1337799544,30cyclictest0-21swapper/309:08:113
1337799544,30cyclictest0-21swapper/307:48:143
13370995410,35cyclictest0-21swapper/012:33:140
4492533,8sleep20-21swapper/212:18:372
292292534,41sleep30-21swapper/309:57:553
292292534,41sleep30-21swapper/309:57:553
241999530,6rtkit-daemon2418-21rtkit-daemon09:15:212
241999530,6rtkit-daemon2418-21rtkit-daemon07:48:402
241999530,6rtkit-daemon2418-21rtkit-daemon07:48:402
241999530,5rtkit-daemon2418-21rtkit-daemon11:13:242
241999530,5rtkit-daemon2418-21rtkit-daemon11:13:242
1337799534,29cyclictest0-21swapper/311:58:273
1337799534,29cyclictest0-21swapper/311:58:273
13377995321,13cyclictest0-21swapper/311:23:283
1337099534,41cyclictest0-21swapper/010:51:300
13370995333,13cyclictest0-21swapper/010:53:270
32582522,43sleep20-21swapper/212:25:342
320112522,43sleep00-21swapper/007:44:500
308262522,44sleep00-21swapper/012:15:490
247552522,9sleep00-21swapper/009:48:120
241999520,5rtkit-daemon2418-21rtkit-daemon12:28:363
241999520,5rtkit-daemon2418-21rtkit-daemon12:05:222
241999520,5rtkit-daemon2418-21rtkit-daemon12:00:152
241999520,5rtkit-daemon2418-21rtkit-daemon12:00:152
241999520,5rtkit-daemon2418-21rtkit-daemon08:18:462
184472522,10sleep00-21swapper/009:33:290
1337799524,29cyclictest0-21swapper/310:13:253
13377995234,11cyclictest29459-21cut08:48:293
13377995222,12cyclictest0-21swapper/310:58:413
13377995221,13cyclictest0-21swapper/310:43:343
13377995219,13cyclictest0-21swapper/308:38:283
1337099524,39cyclictest0-21swapper/009:53:300
1337099524,39cyclictest0-21swapper/009:53:300
13370995230,16cyclictest15094-21proc_pri10:33:350
13370995230,16cyclictest15094-21proc_pri10:33:350
13370995230,15cyclictest0-21swapper/009:28:410
13370995229,10cyclictest0-21swapper/008:33:130
13370995229,10cyclictest0-21swapper/008:33:130
13370995226,8cyclictest4091-21latency_hist10:13:090
77222512,43sleep00-21swapper/009:10:030
77222512,43sleep00-21swapper/009:10:030
30052512,43sleep00-21swapper/009:00:190
267242514,40sleep00-21swapper/010:58:380
241999510,6rtkit-daemon2418-21rtkit-daemon12:14:222
241999510,6rtkit-daemon2418-21rtkit-daemon11:35:232
241999510,5rtkit-daemon2418-21rtkit-daemon11:25:162
241999510,5rtkit-daemon2418-21rtkit-daemon10:42:182
241999510,5rtkit-daemon2418-21rtkit-daemon10:03:572
241999510,5rtkit-daemon2418-21rtkit-daemon10:03:273
241999510,5rtkit-daemon2418-21rtkit-daemon09:50:422
213042512,9sleep00-21swapper/011:55:130
182722512,9sleep30-21swapper/310:43:013
1337799514,30cyclictest0-21swapper/311:21:173
1337799514,27cyclictest0-21swapper/307:38:243
1337799514,26cyclictest21810-21df08:33:243
1337799514,26cyclictest0-21swapper/311:07:173
1337599514,40cyclictest0-21swapper/208:38:382
1337599513,24cyclictest2798-21grep07:53:252
1337099516,38cyclictest0-21swapper/011:33:180
1337099514,40cyclictest0-21swapper/012:23:200
1337099514,28cyclictest0-21swapper/009:38:440
1337099514,21cyclictest0-21swapper/007:28:300
13370995135,11cyclictest0-21swapper/008:33:470
13370995132,14cyclictest0-21swapper/010:43:220
13370995131,13cyclictest0-21swapper/007:39:250
13370995124,21cyclictest0-21swapper/010:32:360
13370995122,13cyclictest0-21swapper/008:13:290
274172502,41sleep00-21swapper/007:36:350
226682502,41sleep00-21swapper/007:26:230
166462502,9sleep20-21swapper/211:46:122
1337799505,26cyclictest0-21swapper/312:03:173
1337799504,28cyclictest0-21swapper/312:23:343
1337799504,27cyclictest0-21swapper/311:08:323
1337599505,27cyclictest0-21swapper/212:12:142
1337599504,29cyclictest0-21swapper/209:58:292
1337599504,28cyclictest0-21swapper/207:18:442
1337599504,22cyclictest0-21swapper/208:27:552
13375995031,11cyclictest30774-21tune2fs07:43:302
13370995035,9cyclictest17037-21cpu11:48:150
13370995033,12cyclictest0-21swapper/011:58:350
13370995033,12cyclictest0-21swapper/011:58:350
13370995032,13cyclictest0-21swapper/012:08:200
13370995032,10cyclictest15135-21grep08:18:300
13370995030,13cyclictest0-21swapper/012:32:240
13370995021,12cyclictest0-21swapper/009:23:410
102002502,9sleep30-21swapper/309:16:353
241999490,6rtkit-daemon2418-21rtkit-daemon10:50:032
241999490,5rtkit-daemon2418-21rtkit-daemon08:03:173
241999490,5rtkit-daemon2418-21rtkit-daemon07:34:482
1337799495,26cyclictest0-21swapper/310:53:193
1337799494,27cyclictest0-21swapper/309:23:273
1337799494,26cyclictest0-21swapper/312:08:183
1337599494,27cyclictest0-21swapper/212:28:222
1337599494,27cyclictest0-21swapper/209:18:362
13375994920,12cyclictest0-21swapper/210:08:302
1337599492,34cyclictest0-21swapper/210:25:532
13375994919,12cyclictest0-21swapper/209:33:422
1337099495,27cyclictest0-21swapper/009:58:470
1337099494,38cyclictest0-21swapper/012:18:200
13370994931,13cyclictest0-21swapper/011:18:310
13370994928,14cyclictest0-21swapper/010:13:390
131072494,6sleep30-21swapper/307:05:153
46052482,39sleep00-21swapper/007:56:430
144212482,9sleep00-21swapper/011:43:000
1337799484,27cyclictest0-21swapper/309:38:393
1337799484,27cyclictest0-21swapper/308:20:403
1337799484,26cyclictest0-21swapper/311:48:153
1337799484,26cyclictest0-21swapper/311:38:133
1337799484,26cyclictest0-21swapper/310:22:583
13377994817,13cyclictest0-21swapper/308:43:263
13377994815,13cyclictest0-21swapper/307:57:533
1337599484,27cyclictest0-21swapper/210:13:352
1337599484,27cyclictest0-21swapper/208:43:242
1337599484,26cyclictest0-21swapper/209:43:422
1337599484,13cyclictest0-21swapper/207:43:142
13375994832,9cyclictest18679-21tr10:43:202
1337099484,27cyclictest0-21swapper/009:43:360
1337099484,27cyclictest0-21swapper/008:53:390
1337099484,27cyclictest0-21swapper/008:23:340
1337099484,26cyclictest0-21swapper/010:18:280
1337099484,26cyclictest0-21swapper/007:08:300
1337099484,26cyclictest0-21swapper/007:08:300
260082472,40sleep00-21swapper/012:04:360
241999470,5rtkit-daemon2418-21rtkit-daemon07:31:482
203592472,39sleep00-21swapper/007:22:040
180692472,9sleep30-21swapper/307:18:043
179522472,39sleep00-21swapper/007:16:320
13377994726,13cyclictest0-21swapper/308:13:413
1337099474,36cyclictest0-21swapper/009:03:380
1337099474,35cyclictest0-21swapper/008:43:230
13370994732,10cyclictest0-21swapper/011:08:250
13370994729,12cyclictest0-21swapper/011:28:320
130372474,6sleep00-21swapper/007:04:200
71042462,9sleep00-21swapper/008:03:120
241999460,5rtkit-daemon2418-21rtkit-daemon07:03:262
146662462,38sleep00-21swapper/011:43:160
1337799466,24cyclictest0-21swapper/307:08:353
1337799466,24cyclictest0-21swapper/307:08:353
1337799462,31cyclictest0-21swapper/312:23:003
1337099464,36cyclictest0-21swapper/009:13:470
13370994631,11cyclictest0-21swapper/010:23:450
13370994627,13cyclictest0-21swapper/008:50:340
13370994624,15cyclictest0-21swapper/011:03:270
257342452,36sleep00-21swapper/008:39:190
1337099454,34cyclictest0-21swapper/007:48:230
1337099454,34cyclictest0-21swapper/007:48:230
1337099453,29cyclictest0-21swapper/010:40:260
1337799444,24cyclictest0-21swapper/308:23:413
1337099443,35cyclictest0-21swapper/010:03:310
1337799430,7cyclictest27206-21yum07:33:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional