You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-28 - 13:28

x86 Intel Celeron N3350 @1100 MHz, Linux 5.10.90-rt60 (Profile)

Latency plot of system in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackcslot4.osadl.org (updated Sat May 28, 2022 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14863332280214,51sleep00-21swapper/019:06:580
14864002269206,48sleep10-21swapper/119:07:411
172099660,4rtkit-daemon1719-21rtkit-daemon19:10:461
172099620,4rtkit-daemon1719-21rtkit-daemon23:26:591
172099610,4rtkit-daemon1719-21rtkit-daemon00:11:090
172099590,4rtkit-daemon1719-21rtkit-daemon21:24:271
172099580,4rtkit-daemon1719-21rtkit-daemon20:20:001
172099570,3rtkit-daemon1719-21rtkit-daemon22:45:251
172099570,3rtkit-daemon1719-21rtkit-daemon20:34:251
172099540,3rtkit-daemon1719-21rtkit-daemon00:31:280
172099530,4rtkit-daemon1719-21rtkit-daemon23:30:401
172099510,4rtkit-daemon1719-21rtkit-daemon20:59:291
172099510,4rtkit-daemon1719-21rtkit-daemon20:03:141
172099510,4rtkit-daemon1719-21rtkit-daemon19:53:251
172099500,3rtkit-daemon1719-21rtkit-daemon19:41:481
172099500,3rtkit-daemon1719-21rtkit-daemon19:37:151
172099490,3rtkit-daemon1719-21rtkit-daemon23:42:370
172099470,3rtkit-daemon1719-21rtkit-daemon22:42:461
172099470,3rtkit-daemon1719-21rtkit-daemon21:41:431
172099440,3rtkit-daemon0-21swapper/121:38:541
172099440,3rtkit-daemon0-21swapper/121:05:361
172099440,3rtkit-daemon0-21swapper/119:28:011
16735722440,3sleep00-21swapper/000:20:440
16087542430,3sleep11535354-21diskmemload22:50:241
172099420,4rtkit-daemon1719-21rtkit-daemon23:16:501
172099420,3rtkit-daemon1719-21rtkit-daemon22:30:221
172099420,3rtkit-daemon0-21swapper/123:21:351
172099420,3rtkit-daemon0-21swapper/021:46:051
172099410,3rtkit-daemon1719-21rtkit-daemon22:57:071
172099410,3rtkit-daemon0-21swapper/119:57:381
172099410,3rtkit-daemon0-21swapper/119:31:121
172099410,3rtkit-daemon0-21swapper/000:07:281
172099400,4rtkit-daemon1719-21rtkit-daemon22:19:301
172099400,4rtkit-daemon1719-21rtkit-daemon19:15:361
172099400,3rtkit-daemon0-21swapper/120:27:221
172099400,3rtkit-daemon0-21swapper/120:09:221
172099400,3rtkit-daemon0-21swapper/021:53:201
172099400,1rtkit-daemon1719-21rtkit-daemon20:23:240
172099390,4rtkit-daemon1719-21rtkit-daemon21:31:151
172099390,3rtkit-daemon1719-21rtkit-daemon20:52:131
172099390,3rtkit-daemon0-21swapper/000:02:451
172099380,5rtkit-daemon1557623-21apt-get21:40:110
172099380,3rtkit-daemon0-21swapper/023:42:231
172099380,1rtkit-daemon1719-21rtkit-daemon23:49:410
172099370,3rtkit-daemon0-21swapper/023:58:231
172099370,3rtkit-daemon0-21swapper/022:14:081
172099370,3rtkit-daemon0-21swapper/000:32:071
172099370,3rtkit-daemon0-21swapper/000:28:430
172099370,3rtkit-daemon0-21swapper/000:20:021
172099360,4rtkit-daemon1719-21rtkit-daemon00:19:560
172099360,3rtkit-daemon0-21swapper/023:49:551
172099360,3rtkit-daemon0-21swapper/000:19:141
15524102360,11sleep0161rcuc/021:32:030
172099350,4rtkit-daemon1719-21rtkit-daemon21:47:550
172099350,3rtkit-daemon1719-21rtkit-daemon22:06:570
172099350,3rtkit-daemon0-21swapper/122:25:560
172099350,3rtkit-daemon0-21swapper/119:52:260
172099350,3rtkit-daemon0-21swapper/000:26:031
172099330,3rtkit-daemon1719-21rtkit-daemon00:08:470
172099330,3rtkit-daemon0-21swapper/123:07:580
172099330,3rtkit-daemon0-21swapper/122:49:550
172099330,3rtkit-daemon0-21swapper/122:22:180
172099330,3rtkit-daemon0-21swapper/120:27:520
172099330,3rtkit-daemon0-21swapper/023:34:230
15145892330,5sleep01514592-21unixbench_singl20:15:250
172099320,3rtkit-daemon0-21swapper/122:33:140
1486731993224,6cyclictest13-21ksoftirqd/000:00:010
172099310,4rtkit-daemon1719-21rtkit-daemon23:18:270
172099310,4rtkit-daemon1719-21rtkit-daemon21:58:301
172099310,3rtkit-daemon1719-21rtkit-daemon20:47:010
172099310,3rtkit-daemon0-21swapper/121:24:220
172099310,1rtkit-daemon1719-21rtkit-daemon23:12:261
148673699307,16cyclictest1600704-21grep22:40:001
1486736993013,2cyclictest1586616-21apt-get22:20:121
1486736993010,18cyclictest26-21ksoftirqd/121:30:001
148673699291,16cyclictest1535354-21diskmemload22:07:141
1486731992913,10cyclictest1495406-21apt-get19:30:110
172099280,1rtkit-daemon1719-21rtkit-daemon00:39:550
148673699288,10cyclictest0-21swapper/123:36:311
148673699281,13cyclictest1535354-21diskmemload21:11:191
1486731992812,9cyclictest1650461-21apt-get23:50:130
148673699279,8cyclictest0-21swapper/121:19:431
148673699277,5cyclictest26-21ksoftirqd/120:40:011
148673199272,9cyclictest1527585-21apt-get20:50:140
1486731992715,10cyclictest1532208-21memory21:00:180
15080412260,2sleep00-21swapper/020:00:200
148673699268,8cyclictest0-21swapper/122:01:211
148673699261,8cyclictest1535354-21diskmemload23:53:511
148673699261,23cyclictest1683574-21pluginstate00:35:211
148673699261,13cyclictest1535354-21diskmemload23:09:011
148673699260,9cyclictest1665093-21cstates00:10:181
1486731992615,7cyclictest13-21ksoftirqd/021:15:100
148673199261,4cyclictest1658035-21apt-get00:00:210
172099250,1rtkit-daemon1719-21rtkit-daemon22:14:270
15297862250,10sleep013-21ksoftirqd/020:55:140
148673699251,6cyclictest1535354-21diskmemload23:02:041
148673699251,13cyclictest1535354-21diskmemload22:26:471
1486731992511,8cyclictest1567258-1kworker/u9:122:00:170
172099240,3rtkit-daemon0-21swapper/121:02:071
172099240,3rtkit-daemon0-21swapper/120:10:261
148673699249,10cyclictest1515313-21apt-get20:20:141
148673199243,14cyclictest1521660-21apt-esm-hook20:35:230
148673199242,15cyclictest1497391-21apt-get19:35:130
148673699232,14cyclictest1523618-21apt-get20:40:131
1486736992318,4cyclictest26-21ksoftirqd/120:50:011
148673699231,4cyclictest0-21swapper/119:45:221
148673199239,8cyclictest1611530-21apt-get22:55:180
148673199232,15cyclictest1511335-21apt-esm-hook20:10:140
1486731992312,5cyclictest1615119-21apt-get23:00:120
148673199227,13cyclictest13-21ksoftirqd/023:29:550
148673199227,11cyclictest1622013-21apt-get23:10:130
148673199223,11cyclictest1491441-21apt-get19:20:140
148673199222,14cyclictest1639911-21apt-get23:35:190
148673199222,14cyclictest1629173-21apt-get23:20:140
148673199222,14cyclictest1519293-21apt-esm-hook20:30:120
148673199222,14cyclictest1489429-21apt-get19:15:130
148673699210,4cyclictest1491792-21grep19:20:181
148673199213,11cyclictest1533556-21apt-get21:05:130
148673199213,11cyclictest1509371-21apt-esm-hook20:05:130
148673199213,10cyclictest1486871-21apt-get19:10:130
148673199212,14cyclictest1564656-21apt-esm-hook21:50:180
148673199212,14cyclictest1493454-21apt-esm-hook19:25:130
148673199212,13cyclictest1535635-21apt-esm-hook21:10:130
1486731992116,4cyclictest13-21ksoftirqd/021:40:010
148673199209,8cyclictest1501626-21df_inode19:45:180
148673199204,9cyclictest1505361-21apt-esm-hook19:55:120
148673199202,13cyclictest1597304-21apt-esm-hook22:35:180
148673199202,13cyclictest1546878-21apt-esm-hook21:25:170
148673199202,12cyclictest1499428-21apt-esm-hook19:40:130
1486731992013,5cyclictest1584036-21sshd22:15:270
1486731991910,5cyclictest1535354-21diskmemload21:59:080
1486731991810,6cyclictest1607817-21seq22:50:080
148673199180,8cyclictest1600915-21ssh22:40:120
148673199173,8cyclictest1523650-21apt-esm-hook20:40:140
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:393
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
none08:51:392
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional