You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-02-08 - 04:50

x86 Intel Celeron G1620 @2700 MHz, Linux 5.4.17-rt9 (Profile)

Latency plot of system in rack #9, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack9slot5.osadl.org (updated Wed Feb 08, 2023 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
320082500,0sleep10-21swapper/123:23:441
240472450,1sleep121-21ksoftirqd/118:30:311
201082430,1sleep0101rcuc/022:30:130
297522420,0sleep10-21swapper/122:59:391
49852410,0sleep00-21swapper/023:04:560
256622410,0sleep00-21swapper/021:48:260
274492400,0sleep10-21swapper/122:11:571
75262390,0sleep00-21swapper/023:05:490
207702239,10sleep00-21swapper/018:26:240
264599200,1rtkit-daemon2644-21rtkit-daemon22:01:551
264599180,1rtkit-daemon2644-21rtkit-daemon22:46:470
210492184,4sleep10-21swapper/118:27:111
156202170,0sleep10-21swapper/122:26:111
85752160,0sleep00-21swapper/021:35:440
264599160,1rtkit-daemon2644-21rtkit-daemon19:40:581
22223991611,4cyclictest16833-21x2gosqlitewrapp20:56:110
304042150,0sleep00-21swapper/020:43:330
264599150,1rtkit-daemon2644-21rtkit-daemon21:34:480
264599150,1rtkit-daemon2644-21rtkit-daemon20:35:380
264599150,1rtkit-daemon2644-21rtkit-daemon20:20:000
264599150,1rtkit-daemon2644-21rtkit-daemon19:32:580
143122150,0sleep00-21swapper/023:10:350
264599140,1rtkit-daemon2644-21rtkit-daemon23:25:200
264599140,1rtkit-daemon2644-21rtkit-daemon23:00:201
264599140,1rtkit-daemon2644-21rtkit-daemon20:48:430
22223991412,1cyclictest25484-21x2gosqlitewrapp22:55:410
264599130,1rtkit-daemon2644-21rtkit-daemon19:20:320
22224991313,0cyclictest0-21swapper/123:46:321
22224991313,0cyclictest0-21swapper/121:27:511
22224991311,1cyclictest9080-21x2gosqlitewrapp20:50:311
22224991311,1cyclictest11812-21x2golistsession22:46:111
2222499130,0cyclictest0-21swapper/120:41:411
22223991311,1cyclictest9687-21x2golistsession19:41:400
8122120,0sleep00-21swapper/022:15:420
264599120,1rtkit-daemon2644-21rtkit-daemon22:21:050
22224991212,0cyclictest0-21swapper/123:35:021
22224991212,0cyclictest0-21swapper/121:51:511
22224991210,1cyclictest0-21swapper/122:17:311
2222499120,12cyclictest0-21swapper/123:58:021
2222499120,12cyclictest0-21swapper/121:10:011
2222499120,0cyclictest0-21swapper/120:07:011
2222499120,0cyclictest0-21swapper/119:21:311
22223991212,0cyclictest0-21swapper/023:45:110
22223991212,0cyclictest0-21swapper/023:24:110
22223991212,0cyclictest0-21swapper/022:27:210
22223991212,0cyclictest0-21swapper/022:12:310
22223991212,0cyclictest0-21swapper/021:04:210
22223991212,0cyclictest0-21swapper/020:51:410
22223991212,0cyclictest0-21swapper/018:53:000
318892110,0sleep00-21swapper/021:06:570
264599110,2rtkit-daemon28601-21sh18:38:130
264599110,1rtkit-daemon2644-21rtkit-daemon20:13:351
22224991111,0cyclictest0-21swapper/123:15:221
22224991111,0cyclictest0-21swapper/123:07:321
22224991111,0cyclictest0-21swapper/122:31:411
22224991111,0cyclictest0-21swapper/118:50:301
2222499110,11cyclictest0-21swapper/119:27:511
2222499110,11cyclictest0-21swapper/118:58:411
22223991111,0cyclictest0-21swapper/023:57:210
22223991111,0cyclictest0-21swapper/021:58:210
22223991111,0cyclictest0-21swapper/021:44:510
264599100,2rtkit-daemon17671-21rm23:35:470
249552100,0sleep00-21swapper/019:18:480
22224991010,0cyclictest0-21swapper/121:38:211
22224991010,0cyclictest0-21swapper/121:09:411
22224991010,0cyclictest0-21swapper/118:40:401
2222499100,10cyclictest0-21swapper/118:46:001
2222499100,10cyclictest0-21swapper/118:36:501
2222399105,1cyclictest333-21cron18:44:570
2222399104,5cyclictest23429-21x2golistsession21:24:290
22223991010,0cyclictest0-21swapper/023:33:410
22223991010,0cyclictest0-21swapper/022:42:310
22223991010,0cyclictest0-21swapper/021:13:110
22223991010,0cyclictest0-21swapper/018:46:500
26459990,1rtkit-daemon2644-21rtkit-daemon20:46:031
26459990,1rtkit-daemon1376-21/usr/sbin/munin20:36:261
222249999,0cyclictest0-21swapper/119:18:311
222249997,1cyclictest13990-21x2gosqlitewrapp20:55:011
26459980,1rtkit-daemon25731-21snmpd23:52:131
26459980,1rtkit-daemon18311-21expr22:05:221
26459980,1rtkit-daemon18311-21expr22:05:221
222249988,0cyclictest0-21swapper/123:34:421
222249988,0cyclictest0-21swapper/121:22:311
222239988,0cyclictest0-21swapper/023:44:510
222239988,0cyclictest0-21swapper/018:33:100
222239985,2cyclictest5620-21grep23:50:190
222239983,4cyclictest18904-21grep19:55:180
222239982,5cyclictest14701-21latency_hist19:04:570
222249977,0cyclictest0-21swapper/119:30:111
222249975,1cyclictest32760-21ssh22:38:501
222249974,2cyclictest3161-21ssh23:25:211
222249974,2cyclictest11451-21ssh22:23:551
222239974,2cyclictest27830-21ssh21:26:520
222239974,2cyclictest19547-21x2golistsession22:06:190
222239974,2cyclictest19547-21x2golistsession22:06:190
222239972,4cyclictest0-21swapper/023:17:290
222239972,4cyclictest0-21swapper/022:51:350
222239972,4cyclictest0-21swapper/021:51:570
222239971,5cyclictest32514-21latency_hist19:29:570
222239971,5cyclictest10606-21iostat_ios22:00:150
222249964,1cyclictest2773-21x2golistsession20:18:021
222249964,1cyclictest2618-21gdm-simple-gree19:02:551
222249964,1cyclictest22509-21/usr/sbin/munin23:40:181
222249964,1cyclictest20547-21/usr/sbin/munin21:45:251
222249964,1cyclictest20444-21x2golistsession19:56:551
222249964,1cyclictest1853-21x2golistsession22:40:061
222249964,1cyclictest17783-21unixbench-2d22:50:211
222249964,1cyclictest12821-21x2golistsession19:45:321
222249963,2cyclictest9984-21x2gopath21:14:571
222249963,2cyclictest5731-21readlink19:35:361
222249963,2cyclictest4715-21ssh21:55:411
222249963,2cyclictest3186-21ssh21:32:211
222249963,2cyclictest23731-21sh20:01:041
222249963,2cyclictest19361-21x2golistsession19:10:161
222249963,2cyclictest18708-21nscd19:04:591
222249963,2cyclictest1860-21runrttasks21:00:401
222249963,2cyclictest16979-21x2golistsession19:52:091
222249963,2cyclictest14175-21ssh20:31:391
222249963,2cyclictest12085-21ssh23:10:001
222249963,2cyclictest10145-21seq20:28:411
222249962,3cyclictest14856-21pmu-power21:40:261
222239964,1cyclictest20185-21sshd19:10:280
222239964,1cyclictest10907-21ssh20:30:050
222239963,2cyclictest9610-21readlink18:55:430
222239963,2cyclictest25772-21diskstats20:05:130
222239961,4cyclictest0-21swapper/021:14:580
222239961,3cyclictest32505-21x2gosqlitewrapp20:15:140
222239960,5cyclictest7271-21/usr/sbin/munin20:25:150
222239960,5cyclictest3927-21x2gosqlitewrapp19:35:040
222239960,5cyclictest28516-21grep22:35:200
222239960,5cyclictest23689-21x2gosqlitewrapp20:00:560
222239960,2cyclictest15786-21iostat19:05:160
222239960,2cyclictest15065-21diskstats19:50:140
222239960,2cyclictest11101-21/usr/sbin/munin19:45:260
222239960,1cyclictest29027-21cut20:10:100
222249952,2cyclictest4451-21fschecks_time20:20:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional