You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-17 - 05:44

Intel(R) Atom(TM) CPU Z530 @ 1.60GHz, Linux 3.12.61-rt81 (Profile)

Latency plot of system in rack #1, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack1slot8.osadl.org (updated Sun Oct 17, 2021 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
320912758739,12sleep10-21swapper/119:05:291
3258399464383,48cyclictest10493-21df_inode19:40:170
3258499447402,30cyclictest0-21swapper/119:40:161
3258499442365,47cyclictest0-21swapper/119:11:081
3258399420345,45cyclictest0-21swapper/019:11:080
322462306284,15sleep00-21swapper/019:07:030
315972940,3sleep03258399cyclictest23:35:160
248672780,11sleep03258399cyclictest23:24:350
32583997613,43cyclictest0-21swapper/023:42:460
3258399753,66cyclictest13611-21kworker/0:223:08:590
3258399753,55cyclictest31160-21ssh00:27:060
32583997524,44cyclictest0-21swapper/023:55:220
201792750,3sleep10-21swapper/100:10:011
3258499746,17cyclictest0-21swapper/123:01:561
3258499745,16cyclictest0-21swapper/121:36:551
3258499736,17cyclictest0-21swapper/122:55:431
3258499736,17cyclictest0-21swapper/122:34:451
3258399732,66cyclictest746-21lldpad20:40:160
3258399732,66cyclictest746-21lldpad20:40:150
3258499726,17cyclictest0-21swapper/100:02:251
3258499726,16cyclictest0-21swapper/100:39:161
3258499725,17cyclictest0-21swapper/122:12:371
3258499725,13cyclictest0-21swapper/122:15:031
3258499722,61cyclictest14210-21wc21:20:201
3258399725,60cyclictest0-21swapper/000:16:060
3258499716,59cyclictest0-21swapper/122:10:001
3258499716,17cyclictest0-21swapper/121:29:491
3258499716,17cyclictest0-21swapper/119:35:251
3258499716,17cyclictest0-21swapper/100:28:071
3258499715,16cyclictest0-21swapper/123:47:231
3258499715,14cyclictest0-21swapper/122:40:121
3258499714,14cyclictest0-21swapper/121:31:551
32584997124,40cyclictest0-21swapper/123:20:231
32584997122,40cyclictest0-21swapper/119:50:241
3258399712,63cyclictest29293-21latency_hist00:25:000
3258399712,41cyclictest10952-21latency_hist23:55:010
3258499706,17cyclictest0-21swapper/121:52:111
3258499706,16cyclictest0-21swapper/100:22:401
3258499705,17cyclictest0-21swapper/120:35:311
3258499705,16cyclictest0-21swapper/123:27:431
3258499705,16cyclictest0-21swapper/122:00:201
32584997010,13cyclictest0-21swapper/122:47:141
3258399706,57cyclictest0-21swapper/021:17:420
3258399704,51cyclictest889-21ssh21:51:020
3258399702,45cyclictest8834-21df_inode19:35:140
3258499699,14cyclictest0-21swapper/122:26:351
3258499696,18cyclictest0-21swapper/123:15:251
3258499696,18cyclictest0-21swapper/122:53:321
3258499696,18cyclictest0-21swapper/120:20:021
3258499696,17cyclictest0-21swapper/100:30:111
3258499696,16cyclictest0-21swapper/121:06:261
3258499696,16cyclictest0-21swapper/100:12:411
3258499695,17cyclictest0-21swapper/123:58:081
3258499695,17cyclictest0-21swapper/121:10:251
3258499695,15cyclictest0-21swapper/122:23:411
3258499695,15cyclictest0-21swapper/100:17:361
3258499695,13cyclictest0-21swapper/122:36:211
3258499694,10cyclictest8761-21ssh23:50:241
3258399694,58cyclictest0-21swapper/023:01:060
3258399693,59cyclictest16521-21iostat23:10:270
3258399693,59cyclictest16521-21iostat23:10:260
32583996922,22cyclictest0-21swapper/019:30:000
3258399692,61cyclictest8523-21latency_hist19:35:020
3258399692,55cyclictest26792-21crond20:30:010
3258399692,49cyclictest26953-21munin-node20:30:140
3258499686,18cyclictest0-21swapper/123:36:051
3258499686,17cyclictest0-21swapper/121:16:331
3258499686,15cyclictest0-21swapper/119:30:191
3258499685,30cyclictest0-21swapper/119:48:381
3258499685,14cyclictest0-21swapper/123:06:531
32584996819,41cyclictest0-21swapper/123:40:241
3258399685,56cyclictest0-21swapper/020:19:410
3258399683,58cyclictest3852-21yum21:55:300
3258399682,60cyclictest2913-21munin-node20:55:290
3258399682,42cyclictest17982-21ssh22:20:140
3258499676,18cyclictest0-21swapper/121:55:031
3258499676,17cyclictest0-21swapper/120:56:131
3258499676,17cyclictest0-21swapper/120:05:171
3258499676,17cyclictest0-21swapper/119:59:241
3258499676,16cyclictest0-21swapper/121:47:551
3258499676,16cyclictest0-21swapper/121:00:261
3258499676,15cyclictest0-21swapper/123:30:501
3258499674,14cyclictest0-21swapper/119:19:131
3258399677,35cyclictest0-21swapper/022:00:280
3258399675,55cyclictest0-21swapper/022:58:190
3258399674,57cyclictest0-21swapper/020:50:030
3258399674,57cyclictest0-21swapper/000:32:300
32583996726,35cyclictest0-21swapper/023:29:140
32583996721,39cyclictest0-21swapper/022:08:420
3258399672,58cyclictest15585-21sh00:01:110
3258399672,40cyclictest31204-21ssh21:48:270
3258399672,36cyclictest16800-21idleruntime-cro20:00:000
32583996717,43cyclictest0-21swapper/022:36:030
32583996711,51cyclictest14725-21idleruntime-cro22:15:010
3258499667,53cyclictest0-21swapper/123:11:081
3258499667,53cyclictest0-21swapper/123:11:081
3258499666,17cyclictest0-21swapper/120:35:001
3258499666,17cyclictest0-21swapper/120:25:321
3258499666,16cyclictest0-21swapper/120:50:261
3258499663,9cyclictest30557-21munin-node20:40:181
3258499663,9cyclictest30557-21munin-node20:40:171
3258499663,54cyclictest26076-21df_abs21:40:151
3258399662,58cyclictest7741-21diskmemload23:15:220
3258399662,58cyclictest7741-21diskmemload22:44:320
3258399662,58cyclictest23152-21latency_hist00:15:000
3258399662,58cyclictest18625-21munin-node20:05:320
3258399662,57cyclictest24772-21ssh21:37:340
3258399662,46cyclictest16750-21munin-node21:25:230
3258399662,39cyclictest15052-21ssh21:21:000
3258399662,33cyclictest6023-21latency_hist00:40:010
3258499657,13cyclictest0-21swapper/119:25:141
3258499656,17cyclictest0-21swapper/119:20:271
3258499655,28cyclictest0-21swapper/120:10:241
3258499655,15cyclictest0-21swapper/120:05:001
3258399655,55cyclictest0-21swapper/020:10:270
3258399653,56cyclictest6154-21unixbench_singl23:45:300
3258399653,55cyclictest6179-21latency_hist21:05:010
3258399653,38cyclictest17292-21munin-node00:05:340
3258399653,36cyclictest20186-21iostat21:30:190
3258399652,57cyclictest30188-21ssh23:32:350
3258399652,56cyclictest28364-21ssh21:43:590
3258399652,56cyclictest25885-21sh22:32:180
3258399652,56cyclictest13492-21idleruntime-cro19:50:000
3258499646,18cyclictest0-21swapper/120:45:151
3258399642,56cyclictest17763-21latency_hist22:20:000
3258399642,47cyclictest7741-21diskmemload22:49:150
3258499636,17cyclictest0-21swapper/120:20:301
3258399632,37cyclictest1442-21runrttasks19:20:040
3258399625,51cyclictest0-21swapper/021:12:110
3258399623,53cyclictest7741-21diskmemload22:53:520
3258399614,51cyclictest0-21swapper/020:47:460
3258399612,54cyclictest25142-21idleruntime-cro20:25:000
32583996117,38cyclictest79450irq/46-eth0-tx-22:26:070
3258399602,40cyclictest1070-21snmpd20:38:170
3258399592,51cyclictest17045-21df20:00:170
3258399591,4cyclictest0-21swapper/019:53:590
3258399574,49cyclictest0-21swapper/021:06:260
3258399562,37cyclictest2453-21kernelversion19:15:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional