You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-27 - 18:13

x86 Intel Atom E3845 @1915 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of system in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackbslot6.osadl.org (updated Fri May 27, 2022 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
485821690,5sleep23197199cyclictest12:02:452
2471621620,4sleep33198199cyclictest11:49:493
2090921560,5sleep03196099cyclictest12:19:180
911911110,4ptp4l401ktimersoftd/309:14:473
136692680,2sleep20-21swapper/214:19:502
264212640,2sleep10-21swapper/112:24:411
264212640,2sleep10-21swapper/112:24:411
321982630,1sleep30-21swapper/314:38:543
318212634,10sleep00-21swapper/009:18:580
315482604,9sleep10-21swapper/109:15:241
196032570,1sleep10-21swapper/112:49:421
3198199550,4cyclictest11422-21ssh11:36:383
3197199530,4cyclictest21197-21latency_hist12:19:292
256512480,2sleep20-21swapper/210:09:592
170092480,1sleep20-21swapper/213:19:352
3197199434,32cyclictest15111-21apt-get13:49:452
3198199414,30cyclictest26476-21apt-get12:24:413
3198199414,30cyclictest26476-21apt-get12:24:413
105552410,2sleep20-21swapper/209:39:432
91191400,1ptp4l401ktimersoftd/314:28:553
91191400,1ptp4l401ktimersoftd/314:04:183
91191400,1ptp4l401ktimersoftd/314:04:183
91191400,1ptp4l401ktimersoftd/313:38:453
91191400,1ptp4l401ktimersoftd/311:43:193
91191400,1ptp4l401ktimersoftd/311:32:583
91191400,1ptp4l401ktimersoftd/311:25:193
91191400,0ptp4l401ktimersoftd/311:45:503
3198199402,30cyclictest25839-21apt-get11:19:403
3197199403,28cyclictest14702-21apt-get09:49:362
3197199400,4cyclictest3157-21grep09:24:412
3197199400,4cyclictest3157-21grep09:24:412
91191390,1ptp4l401ktimersoftd/314:39:433
91191390,1ptp4l401ktimersoftd/314:16:253
91191390,1ptp4l401ktimersoftd/313:51:193
91191390,1ptp4l401ktimersoftd/313:48:403
91191390,1ptp4l401ktimersoftd/313:43:123
91191390,1ptp4l401ktimersoftd/312:03:123
3198199392,29cyclictest17157-21apt-get13:19:413
3197199395,26cyclictest25413-21diskmemload12:34:412
3197199393,29cyclictest0-21swapper/214:04:422
3197199390,5cyclictest1992-21latency_hist09:24:252
3197199390,5cyclictest1992-21latency_hist09:24:252
91191380,1ptp4l401ktimersoftd/314:47:083
91191380,1ptp4l401ktimersoftd/314:09:343
91191380,1ptp4l401ktimersoftd/313:31:073
91191380,1ptp4l401ktimersoftd/313:05:493
91191380,1ptp4l401ktimersoftd/312:47:063
91191380,1ptp4l401ktimersoftd/312:23:183
91191380,1ptp4l401ktimersoftd/312:15:103
3198199382,30cyclictest12144-21apt-get13:14:433
3198199380,3cyclictest19233-21apt-get12:49:343
3197199380,6cyclictest19836-21head12:49:462
3197199380,4cyclictest22529-21munin-run14:29:322
91191370,1ptp4l401ktimersoftd/312:56:453
91191370,1ptp4l401ktimersoftd/312:33:213
91191370,1ptp4l401ktimersoftd/312:14:023
91191370,1ptp4l401ktimersoftd/311:57:053
91191370,1ptp4l401ktimersoftd/311:01:203
91191370,0ptp4l401ktimersoftd/312:08:113
3197199374,27cyclictest0-21swapper/209:34:382
3197199374,25cyclictest14192-21apt-get12:44:412
3197199373,28cyclictest0-21swapper/213:59:432
3197199373,28cyclictest0-21swapper/213:59:432
3197199373,28cyclictest0-21swapper/211:39:402
31971993710,23cyclictest27723-21proc_pri12:24:532
31971993710,23cyclictest27723-21proc_pri12:24:532
3197199370,4cyclictest26203-21ls12:24:292
91191360,1ptp4l401ktimersoftd/313:12:483
91191360,1ptp4l401ktimersoftd/310:24:543
3198199361,29cyclictest0-21swapper/314:29:423
3198199360,5cyclictest29584-21perl10:19:423
3197199363,27cyclictest0-21swapper/211:19:402
3197199362,3cyclictest0-21swapper/211:29:392
31971993611,21cyclictest16001-21idleruntime-cro12:14:282
3197199360,4cyclictest20503-21sort09:59:462
306002367,13sleep20-21swapper/209:14:442
91191350,1ptp4l401ktimersoftd/314:24:063
91191350,1ptp4l401ktimersoftd/313:25:043
3198199358,23cyclictest13865-21bc10:54:393
3198199355,28cyclictest29776-21fschecks_count12:59:453
3198199352,27cyclictest4131-21apt-get12:34:413
3198199352,26cyclictest7582-21apt-get09:34:383
3198199352,26cyclictest1714-21apt-get10:29:383
31981993513,18cyclictest19724-21expr09:59:393
3197199352,28cyclictest4079-21apt-get10:34:382
3197199352,27cyclictest11503-21apt-get10:49:392
3197199351,7cyclictest29831-21strings11:54:502
3197199350,4cyclictest27185-21ssh14:33:562
3198199343,24cyclictest30161-21apt-get14:04:423
3198199341,28cyclictest0-21swapper/309:49:363
3198199340,3cyclictest24049-21idleruntime-cro10:09:263
3197199342,4cyclictest0-21swapper/210:29:382
3197199342,3cyclictest0-21swapper/213:14:432
3197199342,28cyclictest7082-21apt-get13:09:412
3197199341,6cyclictest3351-21ssh13:04:522
31971993411,20cyclictest513-21cat14:39:442
3197199340,5cyclictest12091-21ssh11:37:442
3197199340,4cyclictest24834-21sh13:26:182
3198199332,25cyclictest9948-21apt-get09:39:363
31981993314,16cyclictest23544-21sh13:57:353
31981993314,16cyclictest23544-21sh13:57:353
3198199331,26cyclictest0-21swapper/310:34:383
3198199330,3cyclictest28542-21chrt10:16:383
3198199330,3cyclictest18389-21mailstats09:54:503
3198199330,3cyclictest13751-21cut10:54:273
3197199339,20cyclictest26934-21cat10:14:392
3197199338,21cyclictest16093-21date10:59:272
3197199338,21cyclictest10002-21uname10:44:472
3197199334,4cyclictest10683-21in:imuxsock10:09:262
3197199331,6cyclictest770-21sed10:24:562
3197199331,6cyclictest30800-21grep10:19:562
3197199331,6cyclictest17837-21tail10:59:562
3197199331,5cyclictest31253-21sed13:00:002
31971993313,17cyclictest2173-21sh11:28:002
31971993313,17cyclictest10533-21tr12:39:522
3197199331,28cyclictest19127-21hddtemp_smartct11:44:462
3197199330,5cyclictest8007-21seq14:14:452
3197199330,4cyclictest7276-21latency_hist09:34:252
3197199330,4cyclictest7276-21latency_hist09:34:252
3197199330,4cyclictest14384-21latency_hist09:49:252
3197199330,30cyclictest5172-21rm14:10:532
3198199320,3cyclictest5050-21latency_hist09:29:253
3198199320,3cyclictest5050-21latency_hist09:29:253
3198199320,2cyclictest0-21swapper/311:19:273
3198199320,2cyclictest0-21swapper/311:09:273
3198199320,2cyclictest0-21swapper/310:39:433
3197199328,20cyclictest7022-21irqrtprio12:04:472
3197199327,22cyclictest1321-21/usr/sbin/munin13:34:582
3197199327,21cyclictest24696-21df12:54:452
3197199325,4cyclictest23186-21latency_hist11:14:272
3197199324,4cyclictest28957-21latency14:34:522
3197199324,4cyclictest25419-21latency_hist11:19:272
3197199323,7cyclictest27226-21apt-get13:29:412
3197199321,6cyclictest212-21systemd-journal13:39:312
3197199321,5cyclictest22364-21runrttasks13:55:392
3197199321,5cyclictest22364-21runrttasks13:55:392
31971993211,18cyclictest13877-21sh13:48:162
3197199320,7cyclictest8913-21latency_hist10:44:272
3198199318,19cyclictest9790-21if_ens312:39:473
3198199310,2cyclictest0-21swapper/309:44:413
3197199319,19cyclictest23830-21cstates11:49:412
3197199311,5cyclictest18722-21cpuspeed_turbos11:04:412
3197199311,3cyclictest0-21swapper/214:49:102
3197199310,4cyclictest3913-21latency_hist12:34:292
3196099315,14cyclictest9161-21ssh12:39:410
3198199306,20cyclictest21083-21cpuspeed_turbos11:09:423
3198199300,4cyclictest32698-21hddtemp_smartct09:19:413
3198199300,4cyclictest32698-21hddtemp_smartct09:19:413
3198199300,2cyclictest0-21swapper/309:29:453
3198199300,2cyclictest0-21swapper/309:29:453
31960993015,9cyclictest101ktimersoftd/012:04:390
3198199298,18cyclictest25461-21phc2sys10:09:573
3198199296,20cyclictest10217-21phc2sys10:44:493
3197199296,3cyclictest17639-21if_ens309:54:442
3196699291,3cyclictest121rcu_preempt14:22:131
31960992919,4cyclictest9-21ksoftirqd/011:34:420
31960992817,6cyclictest899-21runrttasks12:19:400
31960992817,4cyclictest9-21ksoftirqd/012:49:410
3196099275,12cyclictest12869-21ssh14:19:430
3196099272,15cyclictest18601-21ssh11:44:400
31960992720,4cyclictest9-21ksoftirqd/014:09:420
31960992719,4cyclictest1755-21grep11:59:460
31960992714,7cyclictest9-21ksoftirqd/010:44:390
182482270,2sleep00-21swapper/013:52:090
3196099264,13cyclictest11501-21ssh12:09:520
31960992614,7cyclictest9-21ksoftirqd/011:24:390
31966992519,3cyclictest25-21ksoftirqd/110:10:031
31966992518,4cyclictest22647-21tail13:24:481
31960992519,3cyclictest9-21ksoftirqd/010:33:560
31960992518,4cyclictest18798-21cron12:49:290
31960992517,5cyclictest18604-21sed14:24:510
31966992418,4cyclictest25-21ksoftirqd/109:57:141
31966992411,10cyclictest8001-21cstates14:14:451
31960992418,3cyclictest9-21ksoftirqd/010:09:540
31960992418,3cyclictest9-21ksoftirqd/009:39:440
31960992418,3cyclictest9-21ksoftirqd/009:29:250
31960992418,3cyclictest9-21ksoftirqd/009:29:250
31960992417,4cyclictest9-21ksoftirqd/009:35:110
3196099240,4cyclictest121rcu_preempt13:42:350
31966992317,3cyclictest25-21ksoftirqd/109:31:241
31966992317,3cyclictest25-21ksoftirqd/109:31:241
31966992316,4cyclictest25-21ksoftirqd/111:11:251
31966992316,4cyclictest25-21ksoftirqd/110:35:311
31966992316,4cyclictest25-21ksoftirqd/109:59:301
31960992317,3cyclictest9-21ksoftirqd/010:55:290
31960992317,3cyclictest9-21ksoftirqd/010:26:070
3196699221,9cyclictest75822sh14:14:321
31966992216,4cyclictest9636-21awk13:44:301
31966992215,4cyclictest4251-21tr12:34:431
31966992215,4cyclictest17807-21/usr/sbin/munin14:24:531
31966992213,5cyclictest46550irq/101-ens3-Tx12:09:521
3196699221,18cyclictest26212-21grep11:19:441
3196099223,12cyclictest563-21ssh14:39:450
31960992217,3cyclictest9-21ksoftirqd/014:09:310
31960992217,3cyclictest9-21ksoftirqd/009:29:440
31960992217,3cyclictest9-21ksoftirqd/009:29:440
31960992217,3cyclictest25641-1kworker/u9:111:22:080
31960992216,3cyclictest9-21ksoftirqd/014:44:500
31960992216,3cyclictest9-21ksoftirqd/009:55:550
3196099221,2cyclictest0-21swapper/011:04:400
31960992210,5cyclictest9-21ksoftirqd/011:09:400
264272220,2sleep00-21swapper/012:55:160
3196699214,2cyclictest121rcu_preempt14:05:461
31966992116,3cyclictest25-21ksoftirqd/113:33:511
31966992115,3cyclictest25-21ksoftirqd/111:06:591
31966992115,3cyclictest25-21ksoftirqd/110:50:531
31966992115,3cyclictest25-21ksoftirqd/110:47:271
31966992115,3cyclictest25-21ksoftirqd/110:26:131
31966992115,3cyclictest25-21ksoftirqd/110:18:411
31966992115,3cyclictest25-21ksoftirqd/109:52:491
31966992115,3cyclictest21339-21/usr/sbin/munin12:19:451
31966992115,3cyclictest13949-21head13:15:011
31966992114,4cyclictest9625-21latency_hist13:44:311
31966992114,4cyclictest31416-21/usr/sbin/munin12:29:411
31966992114,4cyclictest2589-21sh14:40:161
3196699211,14cyclictest25413-21diskmemload14:44:441
3196699210,4cyclictest9177-21ssh13:10:211
3196099212,6cyclictest29428-21apt-get12:59:400
3196099212,16cyclictest3938-21grep11:29:450
3196099212,16cyclictest10172-21tr13:44:440
31960992116,3cyclictest9-21ksoftirqd/013:19:460
31960992116,3cyclictest9-21ksoftirqd/013:04:470
31960992116,3cyclictest9-21ksoftirqd/011:54:440
31960992116,3cyclictest9-21ksoftirqd/010:36:150
31960992116,3cyclictest9-21ksoftirqd/009:59:540
31960992116,3cyclictest21523-1kworker/u9:113:35:480
31960992115,3cyclictest9-21ksoftirqd/009:44:310
31960992115,3cyclictest11760-21df_inode10:49:420
31960992114,4cyclictest9-21ksoftirqd/011:02:320
31960992114,4cyclictest9-21ksoftirqd/009:51:460
31960992113,4cyclictest22136-21acpi13:24:430
31966992015,3cyclictest25-21ksoftirqd/113:19:461
31966992015,3cyclictest25-21ksoftirqd/109:39:581
31966992015,3cyclictest15897-21kworker/1:013:04:421
31966992015,3cyclictest15897-21kworker/1:011:44:551
31966992014,4cyclictest25-21ksoftirqd/109:19:471
31966992014,4cyclictest25-21ksoftirqd/109:19:471
31966992014,4cyclictest23356-21apt-get11:14:391
31966992014,3cyclictest4470-21kernelversion11:29:481
31966992014,3cyclictest25-21ksoftirqd/111:04:121
31966992014,3cyclictest25-21ksoftirqd/110:21:201
31966992014,3cyclictest12101-21sh11:37:451
31966992013,4cyclictest46550irq/101-ens3-Tx13:50:051
31966992013,4cyclictest32165-21/usr/sbin/munin13:34:461
31966992013,4cyclictest28278-21forks14:34:471
31966992013,4cyclictest23153-21cat14:29:441
31966992013,4cyclictest22534-21sh13:55:551
31966992013,4cyclictest22534-21sh13:55:551
31966992013,4cyclictest16902-21gltestperf12:14:461
31966992013,4cyclictest14703-21sed12:44:461
31966992012,5cyclictest25413-21diskmemload11:49:451
31966992012,5cyclictest13287-21cat09:44:451
3196699200,6cyclictest1403-21ssh13:04:081
3196699200,4cyclictest5290-21ssh12:03:281
31960992015,3cyclictest26669-1kworker/u9:213:33:540
31960992015,3cyclictest12061-21/usr/sbin/munin13:14:450
31960992014,3cyclictest9-21ksoftirqd/010:44:260
31960992014,3cyclictest9-21ksoftirqd/009:24:250
31960992014,3cyclictest9-21ksoftirqd/009:24:250
31960992014,3cyclictest7506-21sh12:37:290
31960992013,4cyclictest31397-21sh14:37:360
31960992013,4cyclictest26125-21sh11:50:580
31960992013,4cyclictest25935-21sh14:31:530
31960992013,4cyclictest25413-21diskmemload11:39:350
31960992013,4cyclictest20454-21cut13:54:470
31960992013,4cyclictest20454-21cut13:54:470
31960992012,5cyclictest899-21runrttasks12:29:110
31960992012,5cyclictest899-21runrttasks12:29:110
31966991914,3cyclictest22174-21kworker/1:310:54:391
31966991914,3cyclictest2003-21munin-node09:24:351
31966991914,3cyclictest2003-21munin-node09:24:351
31966991913,4cyclictest8056-21gltestperf09:34:421
31966991913,3cyclictest899-21runrttasks10:29:411
31966991913,3cyclictest693-21sh11:25:361
31966991913,3cyclictest28616-21cat11:54:391
31966991913,3cyclictest27639-21sh14:01:041
31966991913,3cyclictest27639-21sh14:01:041
31966991912,4cyclictest6964-21fschecks_time10:39:431
31966991912,4cyclictest13538-21basename11:39:391
3196699191,16cyclictest26248-21grep12:55:001
3196699191,16cyclictest15897-21kworker/1:012:06:131
3196099199,4cyclictest0-21swapper/010:14:380
31960991913,3cyclictest7023-21cat13:09:400
31960991913,3cyclictest32289-21cut12:29:470
31960991913,3cyclictest26785-21cat14:00:010
31960991913,3cyclictest26785-21cat14:00:010
31960991913,3cyclictest23870-21if_enp1s011:14:460
31960991912,4cyclictest30346-21tail10:19:480
31966991812,3cyclictest25-21ksoftirqd/110:06:221
31966991812,3cyclictest241ktimersoftd/112:40:421
31960991812,4cyclictest8124-21forks14:14:470
31960991812,4cyclictest23546-21unixbench_multi10:04:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional