You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-16 - 02:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot4.osadl.org (updated Mon Apr 15, 2024 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5809492245201,29sleep10-21swapper/107:09:191
5807332239196,28sleep00-21swapper/007:06:590
71916621660,4sleep00-21swapper/011:20:010
581153996965,3cyclictest587370-21kworker/u8:107:28:140
6229032620,1chrt622906-21timerandwakeup08:50:281
6552482510,1chrt655167-21/usr/sbin/munin09:45:061
159199500,4rtkit-daemon1590-21rtkit-daemon07:32:131
159199500,3rtkit-daemon1590-21rtkit-daemon11:27:401
7165732490,4sleep0716576-21latency11:15:150
159199480,4rtkit-daemon1590-21rtkit-daemon07:12:031
159199470,3rtkit-daemon1590-21rtkit-daemon08:15:560
159199390,8rtkit-daemon717258-21unixbench_multi11:15:231
159199390,3rtkit-daemon0-21swapper/109:33:341
159199360,3rtkit-daemon0-21swapper/011:40:221
159199360,3rtkit-daemon0-21swapper/010:36:590
159199360,3rtkit-daemon0-21swapper/009:45:150
159199350,4rtkit-daemon1590-21rtkit-daemon12:20:270
159199350,3rtkit-daemon635816-21ssh09:17:050
159199350,3rtkit-daemon0-21swapper/110:08:201
159199350,3rtkit-daemon0-21swapper/010:58:461
159199340,4rtkit-daemon1590-21rtkit-daemon09:51:020
159199340,4rtkit-daemon1590-21rtkit-daemon07:35:550
159199340,4rtkit-daemon0-21swapper/111:56:251
159199330,4rtkit-daemon1590-21rtkit-daemon10:54:310
159199330,4rtkit-daemon1590-21rtkit-daemon10:43:580
159199330,4rtkit-daemon1590-21rtkit-daemon10:04:551
159199330,4rtkit-daemon1590-21rtkit-daemon09:40:170
159199330,3rtkit-daemon1590-21rtkit-daemon11:48:261
159199330,3rtkit-daemon0-21swapper/108:00:380
159199330,3rtkit-daemon0-21swapper/012:20:411
159199320,4rtkit-daemon1590-21rtkit-daemon12:27:250
159199320,4rtkit-daemon1590-21rtkit-daemon11:30:521
159199320,4rtkit-daemon1590-21rtkit-daemon09:22:260
159199320,4rtkit-daemon1590-21rtkit-daemon08:10:320
159199320,4rtkit-daemon1590-21rtkit-daemon07:44:561
159199320,3rtkit-daemon0-21swapper/111:48:050
159199320,3rtkit-daemon0-21swapper/109:04:501
159199320,3rtkit-daemon0-21swapper/107:15:080
159199310,3rtkit-daemon1590-21rtkit-daemon12:02:191
159199310,3rtkit-daemon1590-21rtkit-daemon11:20:591
159199310,3rtkit-daemon1590-21rtkit-daemon11:05:180
159199310,3rtkit-daemon1590-21rtkit-daemon08:35:191
159199310,3rtkit-daemon0-21swapper/107:50:020
159199310,3rtkit-daemon0-21swapper/010:21:071
159199310,3rtkit-daemon0-21swapper/008:09:201
58115799303,7cyclictest648177-21apt-get09:35:091
581153993022,3cyclictest13-21ksoftirqd/009:30:130
581153993016,9cyclictest669038-21apt-get10:05:070
159199300,4rtkit-daemon1590-21rtkit-daemon10:58:390
159199300,4rtkit-daemon0-21swapper/108:44:420
159199300,3rtkit-daemon1590-21rtkit-daemon08:42:421
159199300,3rtkit-daemon1590-21rtkit-daemon07:34:000
159199300,3rtkit-daemon0-21swapper/108:36:570
159199300,3rtkit-daemon0-21swapper/010:12:591
159199300,3rtkit-daemon0-21swapper/010:12:591
159199300,3rtkit-daemon0-21swapper/008:13:471
58115399292,11cyclictest712732-21apt-get11:10:060
581153992912,3cyclictest13-21ksoftirqd/010:34:180
159199290,3rtkit-daemon0-21swapper/111:43:140
159199290,3rtkit-daemon0-21swapper/107:49:060
159199290,3rtkit-daemon0-21swapper/009:22:491
159199290,3rtkit-daemon0-21swapper/009:19:071
159199280,3rtkit-daemon0-21swapper/011:08:201
159199280,3rtkit-daemon0-21swapper/010:26:131
159199280,3rtkit-daemon0-21swapper/009:10:281
159199280,22rtkit-daemon581149-21cyclictest08:30:300
7071092270,10sleep10-21swapper/111:00:201
58115799270,6cyclictest0-21swapper/107:15:351
58115399275,20cyclictest605597-21ls08:09:590
581153992715,7cyclictest599880-40apt-check07:55:100
581153992714,2cyclictest141rcu_preempt09:10:070
159199270,22rtkit-daemon581149-21cyclictest07:39:501
58115799260,6cyclictest0-21swapper/109:27:291
58115399261,7cyclictest622593-21ntp_states08:50:210
58115399261,6cyclictest676178-40apt-check10:15:140
58115399260,2cyclictest141rcu_preempt12:00:010
159199260,21rtkit-daemon581149-21cyclictest10:19:001
159199260,20rtkit-daemon581149-21cyclictest07:41:060
159199260,1rtkit-daemon1590-21rtkit-daemon11:51:011
159199260,15rtkit-daemon696534-21apt-get10:45:080
58115799251,19cyclictest63950irq/130-enp2s012:15:131
58115399250,6cyclictest0-21swapper/012:37:080
159199250,4rtkit-daemon1590-21rtkit-daemon08:57:101
159199250,3rtkit-daemon0-21swapper/010:54:451
159199250,20rtkit-daemon581149-21cyclictest08:48:070
159199250,20rtkit-daemon581149-21cyclictest08:28:000
159199250,20rtkit-daemon1590-21rtkit-daemon08:03:171
159199250,1rtkit-daemon1590-21rtkit-daemon07:55:361
58115799249,5cyclictest0-21swapper/112:13:221
58115799243,8cyclictest768795-21apt-get12:35:081
58115799240,6cyclictest0-21swapper/108:33:031
58115399244,6cyclictest768085-21ssh12:33:370
58115399242,15cyclictest662038-21apt-get09:55:090
58115399242,14cyclictest627682-21apt-get09:05:070
581153992416,4cyclictest755689-21apt-get12:15:130
581153992410,2cyclictest141rcu_preempt11:51:290
159199240,1rtkit-daemon1590-21rtkit-daemon07:47:391
159199240,19rtkit-daemon1590-21rtkit-daemon08:59:530
58115799239,12cyclictest673-21dbus-daemon11:40:001
58115799239,12cyclictest673-21dbus-daemon11:40:001
58115799233,11cyclictest693250-21apt-get10:40:051
58115799232,15cyclictest651750-21apt-get09:40:081
58115799231,15cyclictest765597-21apt-get12:30:071
58115399233,13cyclictest665550-21apt-get10:00:080
581153992310,8cyclictest636793-1kworker/u9:111:35:070
581153992310,8cyclictest636793-1kworker/u9:111:35:070
58115399230,5cyclictest0-21swapper/012:00:220
6992552220,19sleep1699257-21ssh10:49:191
58115799223,12cyclictest607736-21apt-get08:15:081
58115799222,15cyclictest585761-21apt-get07:20:081
58115799222,15cyclictest585761-21apt-get07:20:081
58115399222,13cyclictest726033-21apt-get11:30:170
58115399221,6cyclictest636793-1kworker/u9:109:35:160
58115399220,5cyclictest0-21swapper/009:00:280
159199220,1rtkit-daemon1590-21rtkit-daemon07:53:191
58115799218,11cyclictest765388-21ls12:29:591
58115799212,13cyclictest612043-21apt-get08:25:081
58115799211,14cyclictest610092-21apt-get08:20:131
58115399212,13cyclictest748808-21apt-get12:05:070
58115399212,13cyclictest672359-21apt-get10:10:080
58115399212,13cyclictest672359-21apt-get10:10:070
581153992117,3cyclictest13-21ksoftirqd/011:30:010
58115399210,5cyclictest0-21swapper/011:02:550
159199210,1rtkit-daemon1590-21rtkit-daemon07:25:521
581157992014,4cyclictest26-21ksoftirqd/109:59:591
581157992012,6cyclictest751204-21seq12:08:101
58115399209,7cyclictest636793-1kworker/u9:109:25:080
581153992015,2cyclictest13-21ksoftirqd/010:20:210
58115399200,5cyclictest0-21swapper/010:28:130
58115399200,3cyclictest755122-21python312:15:010
159199200,16rtkit-daemon1590-21rtkit-daemon10:38:521
581157991911,6cyclictest713554-21ntpq11:10:161
58115799190,17cyclictest686483-21/usr/sbin/munin10:30:071
58115399193,14cyclictest609942-21packagekitd08:20:020
58115399192,16cyclictest0-21swapper/007:10:120
159199190,12rtkit-daemon0-21swapper/108:48:011
581157991810,4cyclictest629440-21diskmemload09:53:271
581153991814,3cyclictest585743-21/usr/sbin/munin07:20:180
581153991814,3cyclictest585743-21/usr/sbin/munin07:20:180
581157991712,3cyclictest629436-21sh09:10:001
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional