You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-15 - 08:12

Intel(R) Atom(TM) CPU E3845 @ 1.91GHz, Linux 4.19.37-rt20 (Profile)

Latency plot of system in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Sat May 15, 2021 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
873911640,5ptp4l391rcuc/320:23:423
2492021470,2sleep10-21swapper/100:28:191
3053221340,1sleep20-21swapper/200:35:182
79512840,2sleep00-21swapper/021:10:300
87391770,1ptp4l391rcuc/322:35:353
87391760,1ptp4l391rcuc/300:35:013
87391760,1ptp4l391rcuc/300:20:383
87391750,2ptp4l391rcuc/323:25:373
87391740,2ptp4l391rcuc/323:09:553
87391740,2ptp4l391rcuc/323:03:453
87391740,1ptp4l391rcuc/323:20:203
87391740,1ptp4l391rcuc/301:45:553
87391740,1ptp4l391rcuc/301:02:563
87391740,1ptp4l391rcuc/300:58:083
87391740,1ptp4l391rcuc/300:52:253
87391730,4ptp4l391rcuc/322:49:153
87391730,2ptp4l391rcuc/323:11:373
87391730,2ptp4l391rcuc/322:26:243
87391730,1ptp4l391rcuc/323:57:073
87391730,1ptp4l391rcuc/323:46:183
87391730,1ptp4l391rcuc/323:31:033
87391730,1ptp4l391rcuc/323:18:263
87391730,1ptp4l391rcuc/301:54:453
87391730,1ptp4l391rcuc/301:36:373
87391730,1ptp4l391rcuc/301:31:163
87391730,1ptp4l391rcuc/301:22:103
87391730,1ptp4l391rcuc/300:02:203
87391720,1ptp4l391rcuc/323:38:113
87391720,1ptp4l391rcuc/322:32:153
87391720,1ptp4l391rcuc/301:27:543
87391720,1ptp4l391rcuc/300:26:073
87391710,1ptp4l391rcuc/322:40:383
87391710,1ptp4l391rcuc/321:55:463
87391710,1ptp4l391rcuc/301:10:403
87391710,1ptp4l391rcuc/301:08:033
87391710,1ptp4l391rcuc/300:47:083
87391700,1ptp4l391rcuc/322:55:233
87391700,1ptp4l391rcuc/322:52:313
87391700,1ptp4l391rcuc/322:52:313
87391700,1ptp4l391rcuc/301:40:483
87391700,1ptp4l391rcuc/301:40:483
87391700,1ptp4l391rcuc/301:15:533
87391700,1ptp4l391rcuc/300:40:113
87391700,1ptp4l391rcuc/300:14:483
87391690,1ptp4l391rcuc/300:42:413
173362694,10sleep00-21swapper/020:22:560
87391680,1ptp4l391rcuc/321:03:043
87391670,1ptp4l391rcuc/323:40:413
87391650,1ptp4l391rcuc/321:08:413
229692650,1sleep10-21swapper/101:36:251
87391640,1ptp4l391rcuc/320:32:173
321682640,5sleep21778099cyclictest00:35:422
87391630,1ptp4l391rcuc/300:09:363
61702610,3sleep11777999cyclictest00:06:541
87391600,1ptp4l391rcuc/321:30:273
319462600,4sleep09-21ksoftirqd/000:00:310
41332590,4sleep21778099cyclictest01:51:162
234812590,2sleep00-21swapper/000:25:490
87391570,1ptp4l391rcuc/322:10:433
87391570,1ptp4l391rcuc/321:47:473
87391570,1ptp4l391rcuc/321:25:573
87391570,1ptp4l391rcuc/321:13:183
87391560,1ptp4l391rcuc/321:43:363
87391560,1ptp4l391rcuc/321:35:413
87391560,1ptp4l391rcuc/320:56:393
87391550,2ptp4l391rcuc/320:35:473
87391550,1ptp4l391rcuc/323:51:033
87391550,1ptp4l391rcuc/322:20:023
87391550,1ptp4l391rcuc/321:53:303
87391550,1ptp4l391rcuc/321:16:523
87391550,1ptp4l391rcuc/320:53:303
87391550,1ptp4l391rcuc/300:17:063
87391540,1ptp4l391rcuc/322:20:313
87391540,1ptp4l391rcuc/322:09:553
87391540,1ptp4l391rcuc/320:49:293
87391540,1ptp4l391rcuc/320:27:083
87391530,1ptp4l391rcuc/321:22:343
87391520,1ptp4l391rcuc/322:02:233
87391520,1ptp4l391rcuc/320:43:353
253972510,1sleep00-21swapper/023:52:480
17780994839,5cyclictest33-21ksoftirqd/200:40:282
17780994737,6cyclictest33-21ksoftirqd/222:45:282
17780994434,6cyclictest33-21ksoftirqd/221:30:242
17780994433,6cyclictest33-21ksoftirqd/221:50:252
1731824425,8sleep20-21swapper/220:22:412
17780994232,5cyclictest33-21ksoftirqd/223:55:282
1722024122,8sleep10-21swapper/120:21:231
1778099345,14cyclictest33-21ksoftirqd/220:55:322
17780993415,10cyclictest33-21ksoftirqd/200:15:412
17780993226,4cyclictest33-21ksoftirqd/222:00:342
17780993217,12cyclictest33-21ksoftirqd/222:00:152
120542320,2sleep00-21swapper/022:25:340
1778099315,4cyclictest33-21ksoftirqd/223:09:432
1778099313,3cyclictest121rcu_preempt22:30:312
17780993121,4cyclictest33-21ksoftirqd/223:20:282
17780993111,3cyclictest33-21ksoftirqd/220:40:362
17779993124,4cyclictest25-21ksoftirqd/100:20:221
17779993122,4cyclictest25-21ksoftirqd/123:25:271
17780993018,9cyclictest33-21ksoftirqd/201:05:532
17780993018,4cyclictest33-21ksoftirqd/200:55:522
17780992924,3cyclictest33-21ksoftirqd/201:25:362
17780992924,3cyclictest33-21ksoftirqd/201:15:372
17780992924,3cyclictest33-21ksoftirqd/201:10:482
1778099292,3cyclictest33-21ksoftirqd/221:35:312
17780992923,3cyclictest7240-21irqrtprio22:15:362
17780992923,3cyclictest33-21ksoftirqd/221:20:452
1778099282,3cyclictest33-21ksoftirqd/221:50:152
17780992822,3cyclictest33-21ksoftirqd/222:10:262
17780992821,4cyclictest33-21ksoftirqd/200:50:332
17779992821,3cyclictest25-21ksoftirqd/121:10:301
1778099273,8cyclictest33-21ksoftirqd/201:20:372
17780992722,3cyclictest33-21ksoftirqd/201:50:202
17780992722,3cyclictest33-21ksoftirqd/201:40:352
17780992722,3cyclictest33-21ksoftirqd/201:40:352
17780992722,3cyclictest33-21ksoftirqd/200:50:192
17780992721,3cyclictest33-21ksoftirqd/223:45:482
17780992721,3cyclictest33-21ksoftirqd/223:35:312
17780992721,3cyclictest33-21ksoftirqd/200:05:382
17780992720,3cyclictest33-21ksoftirqd/201:35:342
17780992717,6cyclictest33-21ksoftirqd/220:35:252
17780992714,10cyclictest33-21ksoftirqd/200:15:172
1777999275,15cyclictest6017-21ssh22:55:261
17779992721,3cyclictest25-21ksoftirqd/100:55:191
17779992713,7cyclictest25-21ksoftirqd/123:00:341
17778992720,4cyclictest12897-21ssh23:02:120
17780992621,3cyclictest33-21ksoftirqd/223:45:182
17780992621,3cyclictest33-21ksoftirqd/222:05:432
17780992620,3cyclictest33-21ksoftirqd/200:05:172
17780992619,4cyclictest33-21ksoftirqd/223:20:172
17780992618,6cyclictest33-21ksoftirqd/201:03:132
17780992615,9cyclictest33-21ksoftirqd/222:40:282
17780992615,5cyclictest33-21ksoftirqd/221:05:232
17780992614,10cyclictest33-21ksoftirqd/223:30:372
1777999262,14cyclictest11054-21diskmemload23:50:321
17779992621,3cyclictest25-21ksoftirqd/100:45:401
17779992620,3cyclictest25-21ksoftirqd/123:05:311
17779992620,3cyclictest25-21ksoftirqd/122:30:151
17779992614,10cyclictest25-21ksoftirqd/101:40:491
17779992614,10cyclictest25-21ksoftirqd/101:40:491
17779992613,3cyclictest25-21ksoftirqd/101:25:051
17778992619,4cyclictest9-21ksoftirqd/023:12:320
17778992619,4cyclictest1065-21ssh01:49:080
1778099253,3cyclictest121rcu_preempt22:35:402
17780992520,3cyclictest33-21ksoftirqd/223:10:312
17780992520,3cyclictest33-21ksoftirqd/223:00:382
17780992520,3cyclictest33-21ksoftirqd/222:55:312
17780992520,3cyclictest33-21ksoftirqd/201:35:192
17780992520,3cyclictest33-21ksoftirqd/200:25:292
17780992520,3cyclictest33-21ksoftirqd/200:20:222
17780992519,3cyclictest33-21ksoftirqd/223:50:332
17780992519,3cyclictest33-21ksoftirqd/222:20:302
17780992519,3cyclictest33-21ksoftirqd/221:00:252
17780992519,3cyclictest33-21ksoftirqd/220:50:252
17780992519,3cyclictest33-21ksoftirqd/220:25:422
17780992517,5cyclictest3489-21unixbench_singl22:50:562
17780992517,5cyclictest3489-21unixbench_singl22:50:562
1777999254,8cyclictest0-21swapper/123:15:311
1777999254,13cyclictest8974-21ssh23:35:301
1777999252,12cyclictest11054-21diskmemload00:00:291
17779992520,3cyclictest25-21ksoftirqd/123:50:161
17779992520,3cyclictest25-21ksoftirqd/120:35:431
17779992520,3cyclictest25-21ksoftirqd/120:25:411
17779992519,3cyclictest25-21ksoftirqd/122:45:151
17779992518,4cyclictest25-21ksoftirqd/122:47:161
17779992516,7cyclictest25-21ksoftirqd/101:10:491
17779992512,6cyclictest25-21ksoftirqd/121:25:281
17778992520,3cyclictest9-21ksoftirqd/022:40:460
82522240,20sleep011054-21diskmemload23:34:460
323412240,3sleep111054-21diskmemload01:46:461
1778099243,8cyclictest33-21ksoftirqd/221:25:452
17780992420,3cyclictest33-21ksoftirqd/221:40:312
17780992419,3cyclictest33-21ksoftirqd/221:20:142
17780992419,3cyclictest33-21ksoftirqd/220:45:412
17780992418,4cyclictest33-21ksoftirqd/222:30:152
17780992418,3cyclictest33-21ksoftirqd/223:25:202
17780992418,3cyclictest33-21ksoftirqd/221:10:462
17780992418,3cyclictest33-21ksoftirqd/220:35:132
1777999243,11cyclictest63-21kswapd001:50:311
17779992419,3cyclictest25-21ksoftirqd/123:40:591
17779992419,3cyclictest25-21ksoftirqd/122:05:311
17779992419,3cyclictest25-21ksoftirqd/121:50:151
17779992418,4cyclictest25-21ksoftirqd/101:10:191
17779992418,3cyclictest25-21ksoftirqd/123:56:011
17779992418,3cyclictest25-21ksoftirqd/121:15:371
17779992418,3cyclictest25-21ksoftirqd/120:40:311
17779992417,4cyclictest9292-21tune2fs22:20:301
17779992318,3cyclictest25-21ksoftirqd/121:00:331
17779992318,3cyclictest25-21ksoftirqd/120:30:281
17779992318,3cyclictest25-21ksoftirqd/100:40:411
17779992318,3cyclictest25-21ksoftirqd/100:35:501
17779992318,3cyclictest25-21ksoftirqd/100:30:401
17779992318,3cyclictest25-21ksoftirqd/100:15:561
17779992317,3cyclictest25-21ksoftirqd/121:42:421
17779992317,3cyclictest25-21ksoftirqd/101:30:471
17779992311,3cyclictest849-21runrttasks22:33:171
17778992317,3cyclictest9-21ksoftirqd/020:27:330
17778992317,3cyclictest9-21ksoftirqd/000:50:380
283892220,5sleep11777999cyclictest23:20:331
1777999225,10cyclictest0-21swapper/122:15:281
1777999224,10cyclictest0-21swapper/123:30:311
17779992217,3cyclictest5614-1kworker/u9:200:14:581
17779992217,3cyclictest25-21ksoftirqd/122:12:171
17779992217,3cyclictest25-21ksoftirqd/101:25:451
17779992216,3cyclictest25-21ksoftirqd/122:53:331
17779992216,3cyclictest25-21ksoftirqd/122:53:331
17779992216,3cyclictest25-21ksoftirqd/120:50:431
17779992215,4cyclictest25-21ksoftirqd/101:03:361
17779992215,4cyclictest20142-21grep21:35:311
17779992214,5cyclictest11054-21diskmemload01:15:331
1777899223,3cyclictest121rcu_preempt21:00:390
17778992217,3cyclictest9-21ksoftirqd/023:23:310
17778992216,4cyclictest9-21ksoftirqd/023:40:480
17778992216,3cyclictest9-21ksoftirqd/021:27:510
17778992215,4cyclictest9-21ksoftirqd/022:07:400
17778992214,5cyclictest48550irq/100-ens3-Tx00:35:310
1777899220,16cyclictest0-21swapper/001:34:460
164212220,2sleep00-21swapper/000:19:350
71632210,4sleep0101ktimersoftd/000:08:540
17779992115,3cyclictest25-21ksoftirqd/122:01:421
17779992115,3cyclictest25-21ksoftirqd/120:55:131
17779992115,3cyclictest25-21ksoftirqd/100:55:451
17779992114,4cyclictest25965-21timedrift21:45:441
17779992114,4cyclictest25-21ksoftirqd/121:09:151
17778992116,3cyclictest9-21ksoftirqd/023:35:390
17778992115,3cyclictest9-21ksoftirqd/023:48:230
17778992115,3cyclictest9-21ksoftirqd/021:59:370
17778992115,3cyclictest9-21ksoftirqd/021:43:250
17778992114,4cyclictest9-21ksoftirqd/022:14:180
17778992114,4cyclictest9-21ksoftirqd/021:38:530
17778992114,4cyclictest9-21ksoftirqd/021:10:060
17778992114,4cyclictest29904-21fschecks_time22:45:340
17778992114,4cyclictest20710-21cat22:35:310
17778992114,4cyclictest15835-21cut01:30:190
17778992114,4cyclictest11602-21seq00:13:520
17778992113,4cyclictest5934-21/usr/sbin/munin22:55:350
17778992111,7cyclictest25426-21latency_hist20:40:140
1777899210,18cyclictest29751-21date01:45:200
1777899210,18cyclictest29751-21date01:45:200
26332200,2sleep00-21swapper/022:50:360
26332200,2sleep00-21swapper/022:50:360
17779992015,3cyclictest25-21ksoftirqd/121:55:421
17779992014,3cyclictest25-21ksoftirqd/121:21:261
17779992013,4cyclictest25-21ksoftirqd/120:45:261
17779992013,4cyclictest18648-21sendmail_mailtr21:30:381
17779992010,7cyclictest23674-21sh22:38:181
17778992016,3cyclictest9-21ksoftirqd/020:55:280
17778992015,3cyclictest18107-21sed00:20:370
17778992014,3cyclictest3382-21sh23:28:550
17778992014,3cyclictest30693-21cat20:50:260
17778992014,3cyclictest24987-21sh01:05:020
17778992014,3cyclictest11597-21sed21:15:410
17778992014,3cyclictest10187-21processes22:20:380
17778992013,4cyclictest26511-21sed01:05:420
17778992013,4cyclictest21261-21grep01:35:390
17778992013,4cyclictest17374-21basename22:30:420
17778992013,4cyclictest10634-21sh01:24:430
17779991913,3cyclictest11054-21diskmemload23:10:521
1777899193,9cyclictest16590-21ssh00:55:310
17778991914,3cyclictest9-21ksoftirqd/023:55:380
17778991914,3cyclictest25642-21/usr/sbin/munin20:40:420
17778991914,3cyclictest20855-21/usr/sbin/munin20:30:320
17778991913,3cyclictest9912-21sh00:47:010
17778991913,3cyclictest9-21ksoftirqd/022:02:340
17778991913,3cyclictest9-21ksoftirqd/021:23:410
17778991913,3cyclictest9-21ksoftirqd/020:46:330
17778991913,3cyclictest7812-21ptp4l22:15:400
17778991913,3cyclictest31357-21ptp4l-jitter01:10:410
17778991913,3cyclictest3080-21sh01:15:410
17778991913,3cyclictest23482-21/usr/sbin/munin23:15:440
17778991913,3cyclictest16804-21sh23:06:050
17778991912,4cyclictest849-21runrttasks00:41:190
17778991912,4cyclictest2891-21cut01:50:380
17778991912,4cyclictest27812-21sed21:50:320
17778991912,4cyclictest11054-21diskmemload00:33:310
17778991812,3cyclictest9-21ksoftirqd/021:32:500
17778991811,4cyclictest9-21ksoftirqd/021:46:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional