You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-05 - 03:04

x86 Intel Celeron N3350 @1100 MHz, Linux 5.10.90-rt60 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Sun Jun 04, 2023 12:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
41245932327281,27sleep10-21swapper/107:05:401
41246052320272,28sleep00-21swapper/007:05:480
412523599162157,3cyclictest57909-21kworker/u8:112:29:520
41929312590,4sleep1673-21dbus-daemon09:55:301
159199590,3rtkit-daemon1590-21rtkit-daemon11:08:331
159199560,4rtkit-daemon1590-21rtkit-daemon11:40:301
471022540,3sleep00-21swapper/011:55:320
159199540,4rtkit-daemon1590-21rtkit-daemon08:57:391
159199530,4rtkit-daemon1590-21rtkit-daemon08:31:130
159199520,3rtkit-daemon1590-21rtkit-daemon12:32:211
159199510,4rtkit-daemon1590-21rtkit-daemon11:17:421
159199490,4rtkit-daemon1590-21rtkit-daemon10:41:291
159199480,3rtkit-daemon0-21swapper/108:20:480
159199470,7rtkit-daemon4141769-21python307:50:011
159199470,4rtkit-daemon1590-21rtkit-daemon08:06:451
159199470,4rtkit-daemon0-21swapper/010:00:061
159199470,3rtkit-daemon1590-21rtkit-daemon11:52:521
159199470,3rtkit-daemon0-21swapper/108:13:411
159199460,3rtkit-daemon1590-21rtkit-daemon11:29:591
159199460,3rtkit-daemon1590-21rtkit-daemon11:29:581
159199460,3rtkit-daemon0-21swapper/111:20:581
4125235994533,6cyclictest39415-21unixbench_multi11:35:360
159199450,3rtkit-daemon0-21swapper/112:03:241
159199450,3rtkit-daemon0-21swapper/111:56:561
159199440,3rtkit-daemon1590-21rtkit-daemon08:25:150
159199430,3rtkit-daemon0-21swapper/007:50:501
159199420,3rtkit-daemon0-21swapper/110:45:221
159199420,3rtkit-daemon0-21swapper/008:48:271
4125240994110,10cyclictest26-21ksoftirqd/111:00:321
159199410,3rtkit-daemon0-21swapper/110:59:231
159199410,3rtkit-daemon0-21swapper/109:51:091
412524099407,12cyclictest26-21ksoftirqd/110:20:561
159199400,4rtkit-daemon1590-21rtkit-daemon12:15:031
159199400,3rtkit-daemon0-21swapper/009:26:261
159199400,3rtkit-daemon0-21swapper/008:31:201
159199400,3rtkit-daemon0-21swapper/007:41:231
4125240993928,2cyclictest3769-21cron10:09:591
159199390,3rtkit-daemon0-21swapper/111:00:520
159199390,3rtkit-daemon0-21swapper/109:47:161
159199390,3rtkit-daemon0-21swapper/007:57:441
159199390,3rtkit-daemon0-21swapper/007:35:501
4125240993810,12cyclictest26-21ksoftirqd/110:34:211
4125235993815,5cyclictest13-21ksoftirqd/010:55:010
159199380,4rtkit-daemon1590-21rtkit-daemon10:50:161
159199380,3rtkit-daemon0-21swapper/109:01:091
159199380,3rtkit-daemon0-21swapper/007:21:011
412524099379,10cyclictest26-21ksoftirqd/111:10:211
4125240993720,9cyclictest51874-21grep12:10:001
4125240993711,2cyclictest0-21swapper/112:35:301
4125240993711,2cyclictest0-21swapper/112:35:291
159199370,4rtkit-daemon1590-21rtkit-daemon07:20:270
159199370,3rtkit-daemon1590-21rtkit-daemon09:41:431
159199370,3rtkit-daemon0-21swapper/008:39:381
159199370,3rtkit-daemon0-21swapper/008:22:251
159199370,3rtkit-daemon0-21swapper/007:27:441
159199370,3rtkit-daemon0-21swapper/007:17:181
412524099367,11cyclictest0-21swapper/110:36:301
412524099367,11cyclictest0-21swapper/110:36:291
4125240993628,3cyclictest6281-21cut10:15:231
412523599369,4cyclictest0-21swapper/010:20:010
412523599365,4cyclictest32131-21latency_hist11:20:010
4125235993612,2cyclictest0-21swapper/012:15:270
389682367,19sleep139021-21pmu-power11:35:321
159199360,3rtkit-daemon0-21swapper/110:34:550
159199360,3rtkit-daemon0-21swapper/010:27:431
159199360,3rtkit-daemon0-21swapper/009:07:431
159199360,3rtkit-daemon0-21swapper/009:04:340
412524099358,10cyclictest0-21swapper/112:20:061
4125240993512,2cyclictest0-21swapper/112:25:321
4125235993513,4cyclictest0-21swapper/012:20:250
4125235993511,14cyclictest41954-21idleruntime-cro11:45:000
159199350,3rtkit-daemon1590-21rtkit-daemon11:32:531
159199350,3rtkit-daemon0-21swapper/112:05:230
159199350,3rtkit-daemon0-21swapper/111:29:060
159199350,3rtkit-daemon0-21swapper/111:29:060
159199350,3rtkit-daemon0-21swapper/008:41:370
4125235993422,3cyclictest24093-21turbostat11:00:000
4125235993418,3cyclictest0-21swapper/007:10:180
412523599341,3cyclictest0-21swapper/010:10:290
159199340,3rtkit-daemon0-21swapper/007:31:140
412524099338,3cyclictest0-21swapper/112:10:311
4125235993327,2cyclictest37405-21grep11:30:380
4125235993325,2cyclictest16142-21cron10:40:010
4125235993325,2cyclictest16142-21cron10:40:010
4125235993322,2cyclictest48965-21pmu-power12:00:310
4125235993321,3cyclictest19613-21unixbench_multi10:45:350
159199330,4rtkit-daemon1590-21rtkit-daemon09:19:210
4125240993215,2cyclictest0-21swapper/111:45:341
4125240993212,4cyclictest26-21ksoftirqd/110:14:101
412523599327,6cyclictest28700-21tail11:10:320
4125235993215,4cyclictest26537-21fschecks_count11:05:230
4125235993214,5cyclictest63182-21needreboot12:35:260
4125235993214,5cyclictest63182-21needreboot12:35:260
4125235993210,15cyclictest33095-21pmu-power11:20:310
159199320,3rtkit-daemon1590-21rtkit-daemon07:15:450
159199320,3rtkit-daemon0-21swapper/108:57:040
4125235993124,2cyclictest3874-21grep10:10:010
4125235993117,5cyclictest62302-21idleruntime-cro12:35:000
4125235993112,6cyclictest9150-21head10:20:320
4125235993111,18cyclictest4189851-21cat09:50:010
4125235993022,4cyclictest52209-21cpuspeed_turbos12:10:240
4125235993021,4cyclictest11374-21gunzip10:25:360
4125235993017,8cyclictest44542-21gltestperf11:50:220
4125235993016,9cyclictest16621-21/usr/sbin/munin10:40:270
412523599294,2cyclictest42511-21fschecks_time11:45:350
4125235992922,2cyclictest1829-21sleep10:05:000
159199290,1rtkit-daemon1590-21rtkit-daemon09:38:531
159199290,1rtkit-daemon1590-21rtkit-daemon08:04:281
412524099287,11cyclictest26-21ksoftirqd/107:32:251
4125240992811,3cyclictest0-21swapper/108:52:221
159199280,5rtkit-daemon4151986-21apt-get08:15:021
412523599279,3cyclictest0-21swapper/007:37:460
4125235992716,2cyclictest0-21swapper/008:39:570
412524099265,7cyclictest26-21ksoftirqd/109:20:311
412524099263,15cyclictest4174111-21apt-get09:10:231
4125240992615,2cyclictest0-21swapper/108:42:571
412523599263,2cyclictest0-21swapper/008:02:380
4125235992614,3cyclictest3114519-21cups-browsed08:50:300
412523599261,20cyclictest4141732-21apt-get07:50:260
159199260,1rtkit-daemon1590-21rtkit-daemon07:49:530
412524099251,3cyclictest0-21swapper/109:33:071
412524099251,3cyclictest0-21swapper/109:33:061
159199250,1rtkit-daemon1590-21rtkit-daemon09:10:540
4125240992412,2cyclictest0-21swapper/107:12:371
412523599243,5cyclictest13-21ksoftirqd/009:09:270
412523599242,2cyclictest0-21swapper/007:42:450
412523599241,2cyclictest0-21swapper/009:30:280
412523599241,2cyclictest0-21swapper/009:30:280
412523599240,2cyclictest0-21swapper/009:52:330
159199240,1rtkit-daemon1590-21rtkit-daemon09:26:330
412524099235,3cyclictest0-21swapper/109:17:111
412523599239,3cyclictest13-21ksoftirqd/009:23:170
412523599233,1cyclictest13-21ksoftirqd/009:56:270
159199230,1rtkit-daemon1590-21rtkit-daemon08:49:370
159199230,1rtkit-daemon1590-21rtkit-daemon07:26:050
412524099222,15cyclictest4156509-21apt-get08:25:221
412523599223,17cyclictest4151967-21cat08:14:550
412523599218,4cyclictest0-21swapper/008:09:030
412523599210,1cyclictest160340-21snapd07:59:060
412523599200,6cyclictest4152790-21/usr/sbin/munin08:15:200
412523599200,1cyclictest0-21swapper/009:36:300
4125235991911,6cyclictest4187444-21seq09:41:330
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional