You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 15:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot4.osadl.org (updated Sun Apr 28, 2024 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25514402269228,27sleep10-21swapper/119:05:321
25516332252184,52sleep00-21swapper/019:07:360
26236262850,5sleep00-21swapper/021:45:170
159199720,3rtkit-daemon0-21swapper/122:25:061
26742772660,3sleep0161rcuc/023:00:000
159199660,4rtkit-daemon2637153-21apt-get22:05:131
159199560,4rtkit-daemon1590-21rtkit-daemon23:12:551
159199560,4rtkit-daemon1590-21rtkit-daemon21:20:521
159199560,3rtkit-daemon0-21swapper/121:48:581
159199540,4rtkit-daemon1590-21rtkit-daemon23:45:101
159199540,3rtkit-daemon1590-21rtkit-daemon23:37:251
159199540,3rtkit-daemon1590-21rtkit-daemon23:31:121
159199530,4rtkit-daemon1590-21rtkit-daemon22:04:041
159199530,4rtkit-daemon1590-21rtkit-daemon20:53:201
159199530,4rtkit-daemon1590-21rtkit-daemon20:02:351
159199520,4rtkit-daemon1590-21rtkit-daemon22:10:511
159199520,3rtkit-daemon0-21swapper/122:31:301
159199520,3rtkit-daemon0-21swapper/120:05:031
159199510,4rtkit-daemon1590-21rtkit-daemon20:46:001
159199510,3rtkit-daemon1590-21rtkit-daemon22:52:041
159199500,4rtkit-daemon1590-21rtkit-daemon20:11:421
159199500,4rtkit-daemon1590-21rtkit-daemon19:10:591
159199500,4rtkit-daemon1590-21rtkit-daemon00:04:541
159199500,3rtkit-daemon1590-21rtkit-daemon23:23:521
159199500,3rtkit-daemon0-21swapper/121:39:481
159199490,4rtkit-daemon0-21swapper/121:09:411
159199490,3rtkit-daemon1590-21rtkit-daemon20:16:541
159199490,3rtkit-daemon0-21swapper/119:36:051
159199490,22rtkit-daemon2551970-21cyclictest19:52:141
159199490,21rtkit-daemon2551970-21cyclictest00:16:001
159199490,18rtkit-daemon2673276-21runrttasks22:57:301
27360212480,4sleep02736015-21df00:30:150
159199480,4rtkit-daemon1590-21rtkit-daemon20:56:510
159199480,3rtkit-daemon0-21swapper/119:33:441
159199480,3rtkit-daemon0-21swapper/119:33:431
159199480,20rtkit-daemon0-21swapper/019:19:231
159199480,19rtkit-daemon2551970-21cyclictest22:35:591
26115562470,4sleep1251rcuc/121:28:051
159199470,3rtkit-daemon0-21swapper/121:44:021
159199470,19rtkit-daemon2551970-21cyclictest22:43:271
159199470,19rtkit-daemon2551970-21cyclictest19:29:241
159199460,17rtkit-daemon1590-21rtkit-daemon22:17:461
159199450,5rtkit-daemon2711518-21ssh23:53:550
26837882440,2sleep00-21swapper/023:13:030
159199440,3rtkit-daemon1590-21rtkit-daemon23:18:351
159199440,20rtkit-daemon2551970-21cyclictest19:43:051
25774312430,4sleep00-21swapper/020:15:260
159199420,9rtkit-daemon0-21swapper/122:46:421
159199420,13rtkit-daemon0-21swapper/020:37:281
26504782410,4chrt2650476-21systemd-run22:25:001
159199410,4rtkit-daemon1590-21rtkit-daemon20:32:150
159199400,7rtkit-daemon2572203-21scp20:04:280
159199370,3rtkit-daemon0-21swapper/119:34:260
159199370,3rtkit-daemon0-21swapper/119:34:250
159199350,3rtkit-daemon0-21swapper/119:56:131
159199350,3rtkit-daemon0-21swapper/119:49:521
159199340,3rtkit-daemon0-21swapper/123:42:000
159199340,3rtkit-daemon0-21swapper/122:31:010
159199340,3rtkit-daemon0-21swapper/121:24:360
159199340,3rtkit-daemon0-21swapper/121:17:361
159199340,3rtkit-daemon0-21swapper/100:11:501
159199330,4rtkit-daemon1590-21rtkit-daemon00:06:541
159199330,3rtkit-daemon0-21swapper/119:29:520
159199330,3rtkit-daemon0-21swapper/119:20:190
159199330,3rtkit-daemon0-21swapper/100:01:340
159199320,3rtkit-daemon1590-21rtkit-daemon21:31:241
159199320,3rtkit-daemon0-21swapper/122:05:060
159199320,3rtkit-daemon0-21swapper/121:57:520
159199320,3rtkit-daemon0-21swapper/121:25:040
159199320,3rtkit-daemon0-21swapper/121:18:380
159199320,3rtkit-daemon0-21swapper/119:38:120
159199320,3rtkit-daemon0-21swapper/023:54:481
26806642310,4sleep10-21swapper/123:08:421
159199310,3rtkit-daemon0-21swapper/122:42:590
159199310,3rtkit-daemon0-21swapper/121:43:400
159199310,3rtkit-daemon0-21swapper/119:53:120
159199310,27rtkit-daemon26-21ksoftirqd/100:20:031
159199300,4rtkit-daemon1590-21rtkit-daemon20:52:140
159199300,4rtkit-daemon1590-21rtkit-daemon20:05:310
159199300,4rtkit-daemon0-21swapper/121:36:080
159199300,3rtkit-daemon1590-21rtkit-daemon00:38:071
159199300,3rtkit-daemon0-21swapper/121:10:590
159199300,3rtkit-daemon0-21swapper/119:45:180
159199300,3rtkit-daemon0-21swapper/100:10:390
255197799292,21cyclictest2712459-40apt-check23:55:090
159199290,4rtkit-daemon0-21swapper/120:49:300
159199290,3rtkit-daemon1590-21rtkit-daemon23:19:410
159199290,3rtkit-daemon0-21swapper/123:46:120
159199290,3rtkit-daemon0-21swapper/122:36:140
159199290,3rtkit-daemon0-21swapper/122:26:400
159199290,3rtkit-daemon0-21swapper/120:13:280
159199280,4rtkit-daemon1590-21rtkit-daemon20:41:221
159199280,3rtkit-daemon0-21swapper/123:21:410
159199280,3rtkit-daemon0-21swapper/122:47:160
159199280,3rtkit-daemon0-21swapper/122:24:100
159199280,3rtkit-daemon0-21swapper/122:04:520
159199280,3rtkit-daemon0-21swapper/121:30:090
159199280,3rtkit-daemon0-21swapper/119:44:280
159199280,3rtkit-daemon0-21swapper/119:18:470
159199280,3rtkit-daemon0-21swapper/100:19:120
159199280,24rtkit-daemon3143951-21snmpd20:28:031
2551982992712,13cyclictest2704944-21seq23:44:351
255197799271,20cyclictest2626167-21apt-get21:50:170
159199270,3rtkit-daemon0-21swapper/020:57:051
255198299262,17cyclictest2691684-21apt-get23:25:121
255198299262,16cyclictest2674556-21apt-get23:00:121
255198299260,7cyclictest0-21swapper/121:58:561
255198299250,8cyclictest27333552sensors_temp00:25:271
255197799252,17cyclictest2586590-21apt-get20:40:140
255197799252,15cyclictest2552109-21apt-get19:10:080
2551977992512,12cyclictest13-21ksoftirqd/022:20:000
159199250,1rtkit-daemon1590-21rtkit-daemon23:07:520
159199250,1rtkit-daemon1590-21rtkit-daemon21:03:500
159199250,1rtkit-daemon1590-21rtkit-daemon00:25:050
255198299243,14cyclictest2582664-21apt-get20:30:111
2551982992412,6cyclictest63950irq/130-enp2s023:55:121
255198299240,6cyclictest0-21swapper/119:22:271
255197799244,5cyclictest2709984-1kworker/u9:100:07:370
159199240,1rtkit-daemon1590-21rtkit-daemon22:52:510
159199240,19rtkit-daemon1590-21rtkit-daemon21:04:511
255198299232,7cyclictest2735795-21apt-get00:30:141
255197799236,16cyclictest2570197-21latency_hist20:00:000
2551977992310,9cyclictest2698520-21apt-get23:35:100
255197799224,17cyclictest2739583-21tune2fs00:35:190
255197799222,14cyclictest2580600-21apt-get20:25:140
255198299214,15cyclictest26-21ksoftirqd/121:51:241
255198299212,12cyclictest2598384-21apt-get21:10:161
255197799212,13cyclictest2640498-21apt-get22:10:120
255197799211,3cyclictest2580451-1kworker/0:0H20:25:010
255197799210,8cyclictest2729702-21pmu-power00:20:220
159199210,3rtkit-daemon0-21swapper/023:00:230
255197799205,7cyclictest13-21ksoftirqd/023:28:400
255197799201,13cyclictest2584623-21apt-get20:35:140
255197799200,3cyclictest2691451-1kworker/0:2H23:30:230
159199200,12rtkit-daemon0-21swapper/120:20:241
255197799187,8cyclictest2596556-21df21:05:150
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional