You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-31 - 03:04

x86 Intel Celeron N3350 @1100 MHz, Linux 5.10.90-rt60 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Tue May 30, 2023 12:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7054002324282,27sleep00-21swapper/007:06:440
7056272304263,27sleep10-21swapper/107:09:111
70584599205199,4cyclictest832229-21kworker/u8:212:28:371
159199690,7rtkit-daemon3437640-21snmpd11:38:410
159199660,6rtkit-daemon766569-21/usr/sbin/munin09:40:310
7179282620,1chrt717892-21unixbench_multi07:35:310
159199600,3rtkit-daemon0-21swapper/008:13:350
159199600,3rtkit-daemon0-21swapper/008:13:350
159199590,3rtkit-daemon0-21swapper/007:31:040
159199570,3rtkit-daemon0-21swapper/008:01:350
159199560,3rtkit-daemon0-21swapper/007:50:060
159199550,5rtkit-daemon705835-21cyclictest08:17:250
159199550,3rtkit-daemon0-21swapper/011:51:180
159199550,3rtkit-daemon0-21swapper/009:27:400
159199540,3rtkit-daemon0-21swapper/011:15:520
159199540,3rtkit-daemon0-21swapper/010:11:460
159199530,3rtkit-daemon0-21swapper/012:35:340
159199530,3rtkit-daemon0-21swapper/012:34:070
159199530,3rtkit-daemon0-21swapper/012:34:060
159199530,3rtkit-daemon0-21swapper/012:00:260
159199530,3rtkit-daemon0-21swapper/011:45:110
159199530,3rtkit-daemon0-21swapper/011:20:260
159199530,3rtkit-daemon0-21swapper/010:15:320
159199530,3rtkit-daemon0-21swapper/010:07:250
159199530,3rtkit-daemon0-21swapper/009:10:350
159199530,3rtkit-daemon0-21swapper/008:05:130
159199520,3rtkit-daemon0-21swapper/012:28:230
159199520,3rtkit-daemon0-21swapper/011:59:440
159199520,3rtkit-daemon0-21swapper/009:58:440
159199520,3rtkit-daemon0-21swapper/009:48:550
159199520,3rtkit-daemon0-21swapper/009:32:090
159199520,3rtkit-daemon0-21swapper/009:09:080
159199520,3rtkit-daemon0-21swapper/008:30:050
159199520,3rtkit-daemon0-21swapper/008:26:041
159199520,3rtkit-daemon0-21swapper/008:25:570
159199520,3rtkit-daemon0-21swapper/008:24:340
159199520,3rtkit-daemon0-21swapper/007:49:430
159199510,4rtkit-daemon1590-21rtkit-daemon09:17:470
159199510,3rtkit-daemon0-21swapper/011:30:360
159199510,3rtkit-daemon0-21swapper/011:28:370
159199510,3rtkit-daemon0-21swapper/011:06:590
159199510,3rtkit-daemon0-21swapper/010:58:230
159199510,3rtkit-daemon0-21swapper/010:32:350
159199510,3rtkit-daemon0-21swapper/008:42:030
159199500,5rtkit-daemon1590-21rtkit-daemon11:00:180
159199500,3rtkit-daemon0-21swapper/011:40:171
159199500,3rtkit-daemon0-21swapper/008:55:520
159199500,3rtkit-daemon0-21swapper/008:46:480
159199490,4rtkit-daemon1590-21rtkit-daemon10:40:130
159199490,3rtkit-daemon1590-21rtkit-daemon10:50:030
159199490,3rtkit-daemon0-21swapper/011:14:280
159199490,3rtkit-daemon0-21swapper/008:37:450
159199480,8rtkit-daemon725169-21missed_timers07:55:271
159199480,4rtkit-daemon1590-21rtkit-daemon12:18:280
159199480,3rtkit-daemon0-21swapper/011:44:010
159199480,3rtkit-daemon0-21swapper/009:51:560
159199470,4rtkit-daemon1590-21rtkit-daemon10:28:160
159199470,3rtkit-daemon1590-21rtkit-daemon12:09:060
705845994611,16cyclictest831946-21switchtime12:20:331
159199460,3rtkit-daemon1590-21rtkit-daemon12:21:050
159199460,3rtkit-daemon1590-21rtkit-daemon10:21:280
159199460,21rtkit-daemon705835-21cyclictest09:01:070
159199460,13rtkit-daemon0-21swapper/107:17:190
159199450,5rtkit-daemon768339-21dump-pmu-power09:44:551
159199450,5rtkit-daemon1590-21rtkit-daemon10:40:261
159199450,3rtkit-daemon1590-21rtkit-daemon07:13:190
159199450,19rtkit-daemon705835-21cyclictest07:43:200
159199440,3rtkit-daemon0-21swapper/110:47:091
159199410,3rtkit-daemon0-21swapper/008:40:251
159199400,6rtkit-daemon818577-21/usr/sbin/munin11:50:251
159199390,5rtkit-daemon720674-21apt-get07:45:181
159199390,3rtkit-daemon0-21swapper/012:30:231
159199390,3rtkit-daemon0-21swapper/012:30:221
159199390,3rtkit-daemon0-21swapper/011:56:071
70584599388,3cyclictest0-21swapper/108:45:221
70584599387,4cyclictest729156-21cut08:05:271
705845993812,16cyclictest828837-40apt-check12:15:131
159199380,4rtkit-daemon0-21swapper/011:04:091
159199380,3rtkit-daemon0-21swapper/008:56:261
159199380,12rtkit-daemon0-21swapper/112:12:500
159199370,3rtkit-daemon0-21swapper/009:46:551
159199370,3rtkit-daemon0-21swapper/009:34:221
159199370,3rtkit-daemon0-21swapper/009:02:311
159199370,3rtkit-daemon0-21swapper/008:50:071
159199370,12rtkit-daemon0-21swapper/109:39:340
705845993622,9cyclictest726529-21apt-get08:00:171
705845993618,2cyclictest0-21swapper/107:40:271
705845993617,3cyclictest0-21swapper/110:00:301
705845993617,2cyclictest0-21swapper/107:50:301
705845993612,2cyclictest0-21swapper/108:30:171
159199360,3rtkit-daemon0-21swapper/008:23:041
70584599359,4cyclictest0-21swapper/109:10:331
70584599359,3cyclictest0-21swapper/109:05:291
70584599359,2cyclictest0-21swapper/111:35:381
70584599357,4cyclictest758388-21apt-key09:20:021
70584599356,9cyclictest0-21swapper/108:15:251
705845993524,3cyclictest716573-21gpgv07:35:021
705845993519,9cyclictest778295-21python310:10:011
705845993518,3cyclictest0-21swapper/112:10:231
705845993516,8cyclictest797276-21if_err_enp2s010:55:281
159199350,3rtkit-daemon0-21swapper/011:09:271
159199350,3rtkit-daemon0-21swapper/010:17:531
70584599348,4cyclictest0-21swapper/111:10:311
70584599347,4cyclictest0-21swapper/111:20:211
70584599347,4cyclictest0-21swapper/109:25:371
705845993418,2cyclictest0-21swapper/110:25:191
705845993410,3cyclictest0-21swapper/111:20:011
70584599338,2cyclictest0-21swapper/111:30:361
70584599337,4cyclictest730401-21/usr/sbin/munin08:10:251
70584599337,4cyclictest730401-21/usr/sbin/munin08:10:241
70584599337,4cyclictest0-21swapper/112:10:011
70584599336,2cyclictest0-21swapper/109:50:171
705845993324,2cyclictest784690-21grep10:25:001
705845993321,3cyclictest26-21ksoftirqd/108:36:311
705845993316,2cyclictest0-21swapper/111:30:001
705845993316,2cyclictest0-21swapper/109:20:361
705845993314,3cyclictest0-21swapper/112:00:391
705845993313,3cyclictest0-21swapper/112:40:011
70584599331,2cyclictest0-21swapper/110:30:291
705845993312,5cyclictest773823-21grep09:55:411
705842993310,2cyclictest0-21swapper/010:45:270
70584599327,2cyclictest0-21swapper/109:35:191
70584599326,3cyclictest63950irq/130-enp2s010:10:031
705845993217,2cyclictest0-21swapper/110:35:191
70584299326,3cyclictest0-21swapper/010:00:290
70584299322,6cyclictest724935-21tail07:55:240
159199320,3rtkit-daemon0-21swapper/008:54:500
70584599318,4cyclictest0-21swapper/110:50:221
705842993123,3cyclictest789402-21wc10:35:250
705845993014,2cyclictest0-21swapper/111:45:221
705845992917,3cyclictest0-21swapper/107:11:411
705842992921,3cyclictest758427-21apt-config09:20:020
705845992810,7cyclictest0-21swapper/107:34:101
705845992715,3cyclictest0-21swapper/107:25:131
70584599248,2cyclictest0-21swapper/107:23:101
70584599247,2cyclictest26-21ksoftirqd/107:16:041
705842992213,7cyclictest712619-21expr07:25:220
70584299201,13cyclictest710469-21apt-get07:20:190
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional