You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 02:30

x86 Intel Celeron N3350 @1100 MHz, Linux 5.10.90-rt60 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Sun Jun 26, 2022 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32447542323278,29sleep10-21swapper/107:05:471
32449452269190,27sleep00-21swapper/007:07:520
172099560,5rtkit-daemon1719-21rtkit-daemon11:20:421
172099530,4rtkit-daemon1719-21rtkit-daemon11:30:291
172099530,4rtkit-daemon1719-21rtkit-daemon11:30:281
172099510,3rtkit-daemon1719-21rtkit-daemon11:39:271
172099500,4rtkit-daemon1719-21rtkit-daemon07:28:381
172099490,4rtkit-daemon1719-21rtkit-daemon11:26:541
172099490,3rtkit-daemon1719-21rtkit-daemon11:57:040
172099480,4rtkit-daemon1719-21rtkit-daemon11:54:360
172099480,4rtkit-daemon1719-21rtkit-daemon07:54:461
172099470,4rtkit-daemon1719-21rtkit-daemon08:38:491
172099460,3rtkit-daemon1719-21rtkit-daemon10:19:350
32877042440,2sleep13287698-21cstates08:50:151
172099420,3rtkit-daemon1719-21rtkit-daemon07:46:091
172099410,8rtkit-daemon3263093-21head07:50:200
172099400,4rtkit-daemon1719-21rtkit-daemon10:20:170
172099390,5rtkit-daemon26-21ksoftirqd/109:52:170
172099390,3rtkit-daemon0-21swapper/009:13:470
172099390,3rtkit-daemon0-21swapper/009:13:470
172099380,6rtkit-daemon3432029-21ntp_kernel_pll_12:15:261
172099380,4rtkit-daemon1719-21rtkit-daemon12:25:151
172099380,3rtkit-daemon0-21swapper/112:21:031
172099370,4rtkit-daemon1719-21rtkit-daemon11:50:201
172099370,4rtkit-daemon1719-21rtkit-daemon11:46:291
172099360,5rtkit-daemon3342593-21ssh10:13:070
172099360,5rtkit-daemon3305912-21ssh09:23:330
172099360,5rtkit-daemon3260373-21/usr/sbin/munin07:45:120
172099360,4rtkit-daemon1719-21rtkit-daemon12:13:370
172099360,4rtkit-daemon1719-21rtkit-daemon10:44:040
172099360,4rtkit-daemon1719-21rtkit-daemon10:35:551
172099360,3rtkit-daemon0-21swapper/111:23:110
172099360,3rtkit-daemon0-21swapper/007:19:050
172099350,4rtkit-daemon3424872-21ntp_offset12:05:210
172099350,4rtkit-daemon1719-21rtkit-daemon12:12:231
172099350,4rtkit-daemon1719-21rtkit-daemon10:01:521
172099350,4rtkit-daemon1719-21rtkit-daemon09:30:061
172099350,4rtkit-daemon1719-21rtkit-daemon09:17:540
172099350,3rtkit-daemon0-21swapper/111:15:300
172099350,3rtkit-daemon0-21swapper/109:53:281
172099350,3rtkit-daemon0-21swapper/108:32:401
172099350,3rtkit-daemon0-21swapper/108:01:031
172099340,4rtkit-daemon1719-21rtkit-daemon10:46:170
172099340,4rtkit-daemon1719-21rtkit-daemon10:34:221
172099340,4rtkit-daemon1719-21rtkit-daemon09:57:551
172099340,3rtkit-daemon0-21swapper/110:08:140
172099340,3rtkit-daemon0-21swapper/110:04:170
172099340,3rtkit-daemon0-21swapper/108:40:560
172099330,4rtkit-daemon1719-21rtkit-daemon08:55:340
172099330,4rtkit-daemon1719-21rtkit-daemon08:48:321
172099330,4rtkit-daemon1719-21rtkit-daemon08:00:011
172099330,3rtkit-daemon1719-21rtkit-daemon12:37:481
172099330,3rtkit-daemon0-21swapper/111:31:190
172099330,3rtkit-daemon0-21swapper/111:31:190
172099330,3rtkit-daemon0-21swapper/108:38:420
172099330,3rtkit-daemon0-21swapper/108:13:091
172099330,3rtkit-daemon0-21swapper/008:51:560
172099320,4rtkit-daemon1719-21rtkit-daemon09:02:070
172099320,3rtkit-daemon0-21swapper/008:57:541
172099320,3rtkit-daemon0-21swapper/008:19:191
172099310,4rtkit-daemon1719-21rtkit-daemon12:31:401
172099310,4rtkit-daemon1719-21rtkit-daemon07:43:311
172099310,4rtkit-daemon1719-21rtkit-daemon07:36:020
172099310,3rtkit-daemon0-21swapper/112:01:350
172099310,3rtkit-daemon0-21swapper/111:41:380
172099310,3rtkit-daemon0-21swapper/007:14:161
172099310,1rtkit-daemon1719-21rtkit-daemon10:50:141
324524399302,5cyclictest3339946-40apt-check10:10:121
324524399302,23cyclictest3268648-40apt-check08:05:131
172099300,5rtkit-daemon787-21runrttasks09:18:011
172099300,3rtkit-daemon0-21swapper/112:20:200
172099300,3rtkit-daemon0-21swapper/110:50:370
172099300,3rtkit-daemon0-21swapper/007:32:541
3245243992911,4cyclictest26-21ksoftirqd/111:01:501
172099290,4rtkit-daemon1719-21rtkit-daemon11:56:521
172099290,4rtkit-daemon1719-21rtkit-daemon10:27:401
172099290,3rtkit-daemon0-21swapper/112:29:520
172099290,3rtkit-daemon0-21swapper/112:18:400
172099290,3rtkit-daemon0-21swapper/109:49:010
172099280,4rtkit-daemon1719-21rtkit-daemon10:42:301
172099280,3rtkit-daemon1719-21rtkit-daemon11:09:191
172099280,3rtkit-daemon0-21swapper/111:29:230
172099280,3rtkit-daemon0-21swapper/109:34:560
172099280,3rtkit-daemon0-21swapper/009:20:361
172099280,3rtkit-daemon0-21swapper/008:22:051
324524399272,20cyclictest3250278-40apt-check07:20:141
3245243992713,2cyclictest141rcu_preempt12:08:161
3245241992711,10cyclictest3285539-21apt-get08:45:120
172099270,3rtkit-daemon0-21swapper/108:03:310
172099270,21rtkit-daemon3245233-21cyclictest07:36:161
3245243992612,9cyclictest3309195-1kworker/u9:109:35:131
3245243992610,10cyclictest3317552-1kworker/u9:209:40:131
3245241992611,10cyclictest3279165-21apt-get08:30:120
324524199260,6cyclictest0-21swapper/011:11:420
172099260,20rtkit-daemon3245233-21cyclictest10:39:470
172099260,1rtkit-daemon1719-21rtkit-daemon11:42:071
324524399257,3cyclictest0-21swapper/109:14:211
324524399257,3cyclictest0-21swapper/109:14:201
324524399252,16cyclictest3365345-21apt-esm-hook10:45:141
324524399251,19cyclictest3343680-21apt-get10:15:121
324524399250,7cyclictest3364631-21kworker/1:211:14:421
324524199253,15cyclictest3252317-21apt-esm-hook07:25:130
3245243992416,6cyclictest654-21dbus-daemon07:20:011
324524199246,2cyclictest3295277-21diskmemload12:35:140
324524199242,15cyclictest3376442-21apt-get11:00:150
324524199242,15cyclictest3372844-21apt-get10:55:130
324524199241,18cyclictest3305721-21kworker/u8:009:25:130
172099240,4rtkit-daemon1719-21rtkit-daemon07:32:120
172099240,2rtkit-daemon0-21swapper/009:03:591
172099240,1rtkit-daemon1719-21rtkit-daemon11:16:261
172099240,1rtkit-daemon1719-21rtkit-daemon07:22:000
172099240,18rtkit-daemon3245233-21cyclictest08:13:290
32686872230,2sleep03268674-21apt-get08:05:150
324524399233,5cyclictest26-21ksoftirqd/110:24:271
324524199232,15cyclictest3402021-21apt-get11:35:130
324524199232,12cyclictest3274932-21apt-get08:20:140
172099230,1rtkit-daemon1719-21rtkit-daemon09:28:411
172099230,1rtkit-daemon1719-21rtkit-daemon07:40:110
324524399224,10cyclictest3321303-21apt-get09:45:131
3245243992212,2cyclictest141rcu_preempt10:05:161
324524199227,5cyclictest0-21swapper/009:38:570
324524199227,10cyclictest3293496-21apt-get09:05:140
324524199222,14cyclictest3277084-21apt-get08:25:130
324524199222,14cyclictest3264356-21taskset07:55:120
324524199220,5cyclictest3445284-21dump-pmu-power12:35:000
172099220,4rtkit-daemon1719-21rtkit-daemon09:09:171
172099220,1rtkit-daemon1719-21rtkit-daemon08:19:470
172099220,1rtkit-daemon1719-21rtkit-daemon07:11:130
324524399212,13cyclictest3420556-21apt-esm-hook12:00:121
324524399211,14cyclictest3277117-21apt-esm-hook08:25:131
324524199212,14cyclictest3328718-21apt-get09:55:130
324524199212,13cyclictest3409340-21apt-get11:45:130
324524199212,13cyclictest3350879-21apt-esm-hook10:25:140
172099210,14rtkit-daemon0-21swapper/108:44:061
324524399202,13cyclictest3372868-21apt-esm-hook10:55:131
324524199202,13cyclictest3354514-21apt-esm-hook10:30:130
324524199202,13cyclictest3317877-21apt-esm-hook09:40:140
324524199181,12cyclictest3380174-21apt-esm-hook11:05:140
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional