You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-30 - 20:58

x86 Intel Celeron N3350 @1100 MHz, Linux 5.10.90-rt60 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, Linux 4.9.20-rt16, x86_64 highest latencies:
System rackcslot4.osadl.org (updated Thu Jun 30, 2022 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35619892282238,29sleep00-21swapper/007:07:120
35619472245202,27sleep10-21swapper/107:06:451
35774042620,1chrt3577405-21/usr/sbin/munin07:45:150
37648662570,2sleep00-21swapper/012:30:020
36377452510,9sleep126-21ksoftirqd/109:43:191
172099490,13rtkit-daemon0-21swapper/110:16:491
36759382470,3sleep00-21swapper/010:32:230
36691032430,1sleep10-21swapper/110:24:161
37706192390,3sleep00-21swapper/012:36:300
35720072390,4sleep00-21swapper/007:30:220
172099380,6rtkit-daemon3626843-21rm09:29:331
172099380,3rtkit-daemon0-21swapper/011:59:270
37370572350,8sleep013-21ksoftirqd/011:54:070
36909982340,3sleep10-21swapper/110:52:141
3562358992918,6cyclictest3642019-21ld-2.23.so09:50:061
3562358992812,10cyclictest3718328-1kworker/u9:111:40:111
172099280,5rtkit-daemon3654325-40apt-check10:05:101
3562358992718,7cyclictest3699078-21ssh11:03:381
356235499272,17cyclictest3575158-21apt-get07:40:110
3562354992712,10cyclictest3684835-21apt-get10:45:130
3562358992610,10cyclictest3599386-21apt-get08:40:131
356235499264,2cyclictest141rcu_preempt09:55:100
356235499262,16cyclictest3579126-21apt-get07:50:140
356235499262,12cyclictest3707673-21apt-esm-hook11:15:140
356235499262,12cyclictest3707673-21apt-esm-hook11:15:130
3562354992614,7cyclictest62050irq/130-enp2s010:10:110
356235899253,14cyclictest3699999-21apt-get11:05:121
3562358992511,8cyclictest3629595-1kworker/u9:009:45:141
356235499256,3cyclictest141rcu_preempt09:25:420
356235499253,16cyclictest3642019-21ld-2.23.so09:49:430
3562354992513,7cyclictest62050irq/130-enp2s012:10:150
3562354992512,7cyclictest654544-21snapd09:50:170
172099250,3rtkit-daemon0-21swapper/112:28:291
172099250,3rtkit-daemon0-21swapper/008:37:210
172099250,18rtkit-daemon0-21swapper/107:10:491
172099250,17rtkit-daemon0-21swapper/109:15:331
356235899247,3cyclictest141rcu_preempt11:35:221
356235899244,18cyclictest0-21swapper/109:55:211
356235899242,5cyclictest3593190-21cron08:25:001
356235899242,16cyclictest3609732-21apt-esm-hook09:05:131
356235899242,15cyclictest3589441-21apt-esm-hook08:15:121
356235899242,15cyclictest3577155-21apt-esm-hook07:45:121
3562358992417,5cyclictest3565413-21fschecks_time07:15:141
356235899241,20cyclictest3585437-40apt-check08:05:121
356235899240,6cyclictest3749379-40apt-check12:10:131
356235899240,4cyclictest3704100-21rm11:10:141
356235499249,9cyclictest3751620-1kworker/u9:112:25:110
356235499242,15cyclictest3562542-21apt-esm-hook07:10:130
3562354992412,7cyclictest62050irq/130-enp2s010:20:130
3562354992412,6cyclictest3677409-21apt-get10:35:140
3562354992411,7cyclictest3741455-21apt-get12:00:120
3562354992410,9cyclictest3718893-21apt-get11:30:120
172099240,6rtkit-daemon3628168-21ntp_states09:30:241
172099240,3rtkit-daemon0-21swapper/112:05:261
172099240,3rtkit-daemon0-21swapper/108:28:041
172099240,3rtkit-daemon0-21swapper/108:12:411
356235899238,8cyclictest26-21ksoftirqd/107:35:111
356235899232,15cyclictest3681130-21apt-esm-hook10:40:131
356235899232,14cyclictest3737736-21apt-esm-hook11:55:131
356235899232,14cyclictest3677459-21apt-esm-hook10:35:141
356235899232,14cyclictest3607353-21apt-esm-hook09:00:131
356235899232,14cyclictest3605348-21apt-esm-hook08:55:111
356235899232,14cyclictest3569091-21apt-esm-hook07:25:131
3562358992314,7cyclictest3676635-21sh10:33:591
3562358992312,7cyclictest3733307-1kworker/u9:212:00:131
3562358992312,6cyclictest3650368-21apt-get10:00:121
3562358992311,7cyclictest62050irq/130-enp2s012:35:101
356235899230,4cyclictest3719065-21tr11:30:131
356235499238,13cyclictest3633146-21ssh09:36:390
356235499234,17cyclictest3689102-21cut10:50:180
356235499233,2cyclictest141rcu_preempt08:55:170
356235499232,14cyclictest3611825-21apt-esm-hook09:10:130
3562354992311,7cyclictest62050irq/130-enp2s011:20:100
356235499231,15cyclictest3593398-21apt-get08:25:120
3562354992310,11cyclictest3637581-21seq09:42:560
356235499230,4cyclictest3603513-21cpuspeed_turbos08:50:150
172099230,4rtkit-daemon0-21swapper/110:11:001
172099230,3rtkit-daemon0-21swapper/109:23:401
172099230,3rtkit-daemon0-21swapper/011:46:140
172099230,3rtkit-daemon0-21swapper/011:14:580
172099230,15rtkit-daemon3686789-21sshd10:46:311
172099230,15rtkit-daemon0-21swapper/112:32:101
356235899223,11cyclictest3595385-21apt-get08:30:111
356235899222,14cyclictest3611772-21apt-get09:10:131
356235899222,14cyclictest3579140-21apt-esm-hook07:50:141
356235899222,13cyclictest3603382-21apt-esm-hook08:50:141
356235899222,13cyclictest3601383-21apt-esm-hook08:45:131
356235899222,13cyclictest3567109-21apt-esm-hook07:20:141
3562358992217,3cyclictest3582914-21perf07:59:591
3562358992210,7cyclictest62050irq/130-enp2s012:15:121
356235899220,4cyclictest3711121-21latency_hist11:20:011
356235899220,4cyclictest3711121-21latency_hist11:20:001
356235499222,14cyclictest3745359-21apt-esm-hook12:05:150
356235499222,14cyclictest3692534-21apt-get10:55:120
356235499222,14cyclictest3669746-21apt-get10:25:130
356235499222,14cyclictest3587426-21apt-get08:10:140
356235499222,14cyclictest3567078-21apt-get07:20:140
356235499222,14cyclictest3565067-21apt-get07:15:120
356235499222,13cyclictest3654389-21apt-get10:05:220
3562354992212,5cyclictest3601369-21apt-get08:45:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional