You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 05:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackcslot4.osadl.org (updated Fri May 09, 2025 00:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27748022323281,28sleep10-21swapper/119:07:551
27737852275218,43sleep00-21swapper/019:05:220
28906732720,4sleep00-21swapper/022:39:110
125899720,6rtkit-daemon2967045-21sort00:20:250
125899650,3rtkit-daemon1257-21rtkit-daemon23:25:501
29252782640,4chrt0-21swapper/023:25:000
125899570,4rtkit-daemon1257-21rtkit-daemon22:01:470
125899560,3rtkit-daemon1257-21rtkit-daemon23:28:110
125899550,4rtkit-daemon1257-21rtkit-daemon00:02:490
125899510,4rtkit-daemon1257-21rtkit-daemon21:47:261
125899510,22rtkit-daemon2775121-21cyclictest19:51:540
125899500,4rtkit-daemon1257-21rtkit-daemon21:34:301
125899500,3rtkit-daemon1257-21rtkit-daemon22:19:390
29372172480,4sleep12937215-21gltestperf23:40:181
29146162470,5chrt2914577-21fschecks_time23:10:310
125899470,4rtkit-daemon1257-21rtkit-daemon20:07:370
125899470,4rtkit-daemon1257-21rtkit-daemon20:01:560
125899470,20rtkit-daemon2775121-21cyclictest22:13:020
28807802440,2sleep12880008-21/usr/sbin/munin22:25:211
125899440,3rtkit-daemon1257-21rtkit-daemon22:07:191
125899430,3rtkit-daemon0-21swapper/119:10:441
29501942420,2sleep02950195-21sh23:57:150
125899410,6rtkit-daemon2787885-21seq19:40:031
28896472390,3sleep10-21swapper/122:37:001
125899370,7rtkit-daemon2822876-21diskmemload00:23:151
125899370,3rtkit-daemon0-21swapper/022:14:181
125899360,4rtkit-daemon849-21snmpd22:59:281
125899360,4rtkit-daemon2882510-21ssh22:28:000
125899360,4rtkit-daemon1257-21rtkit-daemon19:31:310
125899360,3rtkit-daemon0-21swapper/023:02:090
125899360,3rtkit-daemon0-21swapper/019:39:360
125899360,3rtkit-daemon0-21swapper/000:16:400
125899350,4rtkit-daemon1257-21rtkit-daemon23:51:280
125899350,3rtkit-daemon0-21swapper/023:54:291
125899350,3rtkit-daemon0-21swapper/021:22:160
125899340,4rtkit-daemon1257-21rtkit-daemon21:39:591
125899340,4rtkit-daemon1257-21rtkit-daemon21:30:190
125899340,3rtkit-daemon0-21swapper/023:21:411
125899340,3rtkit-daemon0-21swapper/020:41:290
125899330,4rtkit-daemon1257-21rtkit-daemon19:45:450
125899330,4rtkit-daemon1257-21rtkit-daemon19:27:231
125899330,4rtkit-daemon1257-21rtkit-daemon00:10:310
125899330,3rtkit-daemon0-21swapper/023:59:381
125899330,3rtkit-daemon0-21swapper/020:45:171
125899320,4rtkit-daemon2801625-21awk20:15:141
125899320,4rtkit-daemon1257-21rtkit-daemon22:21:390
125899320,4rtkit-daemon1257-21rtkit-daemon20:29:100
125899320,4rtkit-daemon1257-21rtkit-daemon00:02:421
125899320,4rtkit-daemon0-21swapper/020:11:191
125899320,3rtkit-daemon0-21swapper/023:46:551
125899320,3rtkit-daemon0-21swapper/023:18:521
125899320,3rtkit-daemon0-21swapper/022:52:191
125899320,3rtkit-daemon0-21swapper/020:59:471
125899320,3rtkit-daemon0-21swapper/020:59:471
2775129993119,7cyclictest2835174-21apt-get21:25:241
125899310,4rtkit-daemon1257-21rtkit-daemon23:35:451
125899310,4rtkit-daemon1257-21rtkit-daemon20:40:021
125899310,4rtkit-daemon1257-21rtkit-daemon20:24:041
125899310,3rtkit-daemon0-21swapper/119:18:010
125899310,3rtkit-daemon0-21swapper/023:13:021
125899310,3rtkit-daemon0-21swapper/022:45:241
125899310,3rtkit-daemon0-21swapper/000:07:111
28239182300,3sleep02823127-21/usr/sbin/munin21:10:210
125899300,5rtkit-daemon828-21runrttasks20:53:221
125899300,4rtkit-daemon2878379-21ssh22:21:541
125899300,4rtkit-daemon1257-21rtkit-daemon19:58:300
125899300,3rtkit-daemon1257-21rtkit-daemon20:48:110
125899300,3rtkit-daemon0-21swapper/119:26:490
125899300,3rtkit-daemon0-21swapper/119:22:490
125899300,3rtkit-daemon0-21swapper/021:00:081
125899300,3rtkit-daemon0-21swapper/020:08:061
125899300,3rtkit-daemon0-21swapper/020:04:041
125899300,3rtkit-daemon0-21swapper/019:39:011
2775124992913,10cyclictest2955410-21apt-get00:05:140
125899290,4rtkit-daemon1257-21rtkit-daemon00:25:091
125899290,3rtkit-daemon0-21swapper/121:47:580
125899290,3rtkit-daemon0-21swapper/121:35:420
125899290,3rtkit-daemon0-21swapper/023:01:001
125899290,3rtkit-daemon0-21swapper/022:33:121
125899290,3rtkit-daemon0-21swapper/020:33:141
277512499284,17cyclictest2883743-21apt-get22:30:140
125899280,4rtkit-daemon1257-21rtkit-daemon21:09:551
125899280,3rtkit-daemon0-21swapper/019:31:171
2775129992711,10cyclictest2890271-1kworker/u9:022:40:141
277512499272,18cyclictest2969633-21apt-get00:25:120
2775124992712,10cyclictest2898755-21apt-get22:50:150
2775124992711,10cyclictest2787914-21apt-get19:40:130
125899270,3rtkit-daemon0-21swapper/022:15:571
125899270,22rtkit-daemon849-21snmpd22:57:580
277512999260,8cyclictest2963256-21/usr/sbin/munin00:15:261
277512499261,12cyclictest2835034-40apt-check21:25:170
125899260,3rtkit-daemon1257-21rtkit-daemon21:20:101
125899260,1rtkit-daemon1257-21rtkit-daemon23:05:260
125899260,1rtkit-daemon1257-21rtkit-daemon22:01:121
125899260,1rtkit-daemon1257-21rtkit-daemon21:54:111
277512999250,7cyclictest2780824-21/usr/sbin/munin19:20:171
277512999250,5cyclictest0-21swapper/121:40:221
277512499251,19cyclictest2865114-21apt-get22:05:140
2775124992511,8cyclictest63750irq/132-enp2s023:45:140
2775124992510,11cyclictest2857683-21apt-get21:55:120
125899250,20rtkit-daemon1257-21rtkit-daemon21:52:470
277512999249,9cyclictest2954816-1kworker/u9:200:10:161
277512499246,12cyclictest2973502-21apt-get00:30:150
277512499242,14cyclictest2819172-21apt-get21:00:130
2775124992411,8cyclictest63750irq/132-enp2s023:30:150
2775124992411,7cyclictest63750irq/132-enp2s000:35:140
125899240,1rtkit-daemon1257-21rtkit-daemon20:13:560
277512999238,9cyclictest2909943-21apt-get23:05:151
277512999233,6cyclictest2968599-1kworker/u9:200:35:311
277512499232,15cyclictest2918021-21apt-get23:15:130
125899230,4rtkit-daemon1257-21rtkit-daemon19:56:231
2775129992216,4cyclictest2861349-21latency_hist22:00:011
2775129992211,7cyclictest2824638-1kworker/u9:221:15:121
277512499224,11cyclictest2807441-21apt-get20:30:140
277512499223,11cyclictest2815250-21apt-get20:50:090
277512499222,14cyclictest2827083-21apt-get21:15:130
125899220,1rtkit-daemon1257-21rtkit-daemon20:15:270
2775129992111,8cyclictest2806526-21sed20:25:241
277512999210,7cyclictest2975984-21ssh00:33:011
277512999210,19cyclictest2826753-21cat21:14:551
277512499214,9cyclictest2936778-21apt-get23:40:140
277512499213,11cyclictest2809385-21apt-get20:35:100
2775124992112,5cyclictest2822876-21diskmemload22:46:450
277512999201,18cyclictest0-21swapper/120:40:011
2775129992010,8cyclictest2792007-21df19:50:141
277512499203,9cyclictest2803540-21apt-get20:20:110
2775124992015,3cyclictest2822362-21unixbench_singl21:05:260
125899200,12rtkit-daemon0-21swapper/119:15:291
2775129991914,3cyclictest2790623-21ntp_offset19:45:221
2775129991912,5cyclictest2931379-21seq23:31:531
277512499184,9cyclictest2775258-21apt-get19:10:110
2775124991813,3cyclictest2935319-21sh23:37:180
2775124991813,3cyclictest2847321-21open_files21:40:220
277512499180,8cyclictest2893150-21ssh22:41:290
2775124991614,1cyclictest0-21swapper/020:55:410
2775124991614,1cyclictest0-21swapper/020:55:400
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional