You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-21 - 15:58

Intel(R) Celeron(R) CPU G1620 @ 2.70GHz, Linux 5.4.17-rt9 (Profile)

Latency plot of system in rack #9, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack9slot5.osadl.org (updated Tue Sep 21, 2021 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2877821020,1sleep128777-21x2gosqlitewrapp10:20:151
170962460,1sleep00-21swapper/008:46:510
277812370,0sleep00-21swapper/011:13:200
196322370,0sleep10-21swapper/111:06:201
2859922214,4sleep10-21swapper/106:46:511
29320991913,5cyclictest25587-21x2gosqlitewrapp11:11:031
276362192,4sleep00-21swapper/006:44:080
264599190,0rtkit-daemon0-21swapper/007:53:250
29320991812,5cyclictest16510-21x2gosqlitewrapp08:45:121
264599170,1rtkit-daemon2644-21rtkit-daemon10:26:430
264599160,1rtkit-daemon2644-21rtkit-daemon07:25:550
2932099154,6cyclictest20248-21readlink07:19:051
29320991513,2cyclictest0-21swapper/111:58:031
29320991513,2cyclictest0-21swapper/108:05:021
2932099150,1cyclictest2788-21taskset06:55:011
2932099150,1cyclictest17608-21taskset08:02:251
2932099150,14cyclictest17153-21x2golistsession09:14:421
29319991513,1cyclictest2564-21ntp_states09:58:440
264599150,1rtkit-daemon2644-21rtkit-daemon10:00:451
2932099144,6cyclictest14401-21ssh11:02:271
2932099144,5cyclictest8303-21ssh09:07:381
29320991413,1cyclictest0-21swapper/110:53:431
29320991413,1cyclictest0-21swapper/109:28:221
2932099140,1cyclictest32027-21ssh09:56:411
2932099140,1cyclictest29876-21ssh11:13:571
2932099140,1cyclictest26544-21ssh12:04:451
2932099140,1cyclictest1048-21ssh11:43:571
2932099140,14cyclictest0-21swapper/109:46:221
2932099140,14cyclictest0-21swapper/107:57:521
29319991412,1cyclictest14615-21x2golistsession10:35:040
264599140,1rtkit-daemon2644-21rtkit-daemon12:00:260
264599140,1rtkit-daemon2644-21rtkit-daemon07:14:360
264599140,1rtkit-daemon2644-21rtkit-daemon07:05:170
2932099133,5cyclictest20795-21fschecks_count09:18:381
29320991313,0cyclictest0-21swapper/112:14:331
29320991313,0cyclictest0-21swapper/111:51:131
29320991312,1cyclictest0-21swapper/109:03:121
2932099130,7cyclictest27315-21x2golistsession08:14:481
2932099130,7cyclictest11700-21x2gosqlitewrapp10:33:321
2932099130,2cyclictest19507-21x2golistsession10:13:261
2932099130,1cyclictest29332-21x2gosqlitewrapp10:48:211
2932099130,1cyclictest26338-21x2golistsession09:51:411
2932099130,0cyclictest0-21swapper/109:36:451
2932099130,0cyclictest0-21swapper/107:08:421
2931999130,13cyclictest0-21swapper/009:47:140
2931999130,13cyclictest0-21swapper/007:09:230
264599130,1rtkit-daemon2644-21rtkit-daemon10:29:301
252562130,0sleep10-21swapper/107:28:121
296982120,0sleep129696-21x2golistsession08:18:481
2932099121,9cyclictest7213-21apt-get08:33:341
29320991212,0cyclictest0-21swapper/108:38:421
29320991212,0cyclictest0-21swapper/107:43:321
29320991212,0cyclictest0-21swapper/107:02:321
2932099120,7cyclictest31640-21x2gosqlitewrapp10:23:271
2932099120,7cyclictest26876-21x2gosqlitewrapp11:38:441
2932099120,7cyclictest21149-21x2gosqlitewrapp08:50:111
2932099120,7cyclictest20903-21python11:33:411
2932099120,7cyclictest10128-21x2golistsession07:05:381
2932099120,2cyclictest7427-21x2gosqlitewrapp07:48:211
2932099120,2cyclictest23620-21x2gosqlitewrapp08:09:211
2932099120,1cyclictest17650-21diskmemload11:19:211
2932099120,1cyclictest0-21swapper/111:59:171
29319991212,0cyclictest0-21swapper/011:37:550
29319991212,0cyclictest0-21swapper/007:22:040
2931999120,12cyclictest0-21swapper/011:46:550
2931999120,12cyclictest0-21swapper/010:12:240
2931999120,12cyclictest0-21swapper/007:59:140
2931999120,12cyclictest0-21swapper/007:39:340
264599120,0rtkit-daemon0-21swapper/009:31:340
130432120,0sleep10-21swapper/109:39:201
2932099111,9cyclictest31065-21x2gosqlitewrapp06:48:471
2932099111,9cyclictest26237-21apt-get09:23:351
2932099110,6cyclictest9426-21x2golistsession11:24:031
2932099110,6cyclictest9032-21x2gosqlitewrapp09:08:231
2932099110,6cyclictest7981-21irqstats_110:03:401
2932099110,6cyclictest5362-21x2golistsession08:28:501
2932099110,6cyclictest27315-21x2golistsession07:29:011
2932099110,6cyclictest26375-21x2gosqlitewrapp08:53:591
2932099110,6cyclictest23343-21x2golistsession10:43:301
2932099110,6cyclictest1880-21x2golistsession08:24:191
2932099110,6cyclictest14834-21x2gosqlitewrapp07:13:261
2932099110,6cyclictest14504-21x2golistsession10:08:431
2932099110,2cyclictest32132-21x2golistsession12:09:111
2932099110,2cyclictest18346-21perl10:38:341
2932099110,1cyclictest31288-21x2gosqlitewrapp07:35:091
2932099110,1cyclictest15285-21x2golistsession11:28:451
29319991111,0cyclictest0-21swapper/012:10:150
29319991111,0cyclictest0-21swapper/011:29:140
29319991111,0cyclictest0-21swapper/010:46:140
29319991111,0cyclictest0-21swapper/010:05:340
29319991111,0cyclictest0-21swapper/009:35:440
264599110,1rtkit-daemon2472-21gnome-settings-07:30:260
2932099100,6cyclictest1230-21x2golistsession07:38:401
2931999105,1cyclictest23114-21dpkg10:43:200
29319991010,0cyclictest0-21swapper/011:55:550
29319991010,0cyclictest0-21swapper/011:49:050
29319991010,0cyclictest0-21swapper/011:40:050
29319991010,0cyclictest0-21swapper/010:57:240
29319991010,0cyclictest0-21swapper/010:21:240
29319991010,0cyclictest0-21swapper/010:14:340
29319991010,0cyclictest0-21swapper/009:42:340
29319991010,0cyclictest0-21swapper/009:14:540
29319991010,0cyclictest0-21swapper/007:34:340
29319991010,0cyclictest0-21swapper/007:03:130
293199999,0cyclictest0-21swapper/010:59:340
293199999,0cyclictest0-21swapper/010:30:240
293199999,0cyclictest0-21swapper/009:54:040
293199999,0cyclictest0-21swapper/009:19:340
293199999,0cyclictest0-21swapper/008:49:240
293199999,0cyclictest0-21swapper/008:13:240
26459990,1rtkit-daemon29871-21ls08:18:490
26459990,0rtkit-daemon0-21swapper/108:28:450
293199988,0cyclictest0-21swapper/012:14:550
293199988,0cyclictest0-21swapper/009:05:340
293199988,0cyclictest0-21swapper/009:00:540
293199988,0cyclictest0-21swapper/008:56:140
293199988,0cyclictest0-21swapper/008:40:240
293199988,0cyclictest0-21swapper/008:34:140
293199980,7cyclictest2910-21munin-run10:53:200
293199980,4cyclictest13230-21turbostat.cron11:28:190
293199977,0cyclictest0-21swapper/009:49:240
293199977,0cyclictest0-21swapper/008:26:140
293199975,2cyclictest2780-21kworker/0:211:19:460
293199974,2cyclictest26126-21x2gosqlitewrapp09:23:270
293199972,4cyclictest0-21swapper/011:17:260
293199972,4cyclictest0-21swapper/011:05:150
26459970,1rtkit-daemon2644-21rtkit-daemon09:09:350
26459970,0rtkit-daemon0-21swapper/106:55:180
293199964,1cyclictest8431-21irqstats07:48:490
293199964,1cyclictest6206-21x2gosqlitewrapp07:45:250
293199964,1cyclictest22702-21x2golistsession08:08:390
293199963,2cyclictest31066-21/usr/sbin/munin06:48:470
293199960,5cyclictest23991-21/usr/sbin/munin12:03:380
293199960,5cyclictest18170-21/usr/sbin/munin08:03:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional