You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-17 - 00:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Tue Apr 16, 2024 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37394482264179,28sleep00-21swapper/007:06:010
37395512256182,59sleep10-21swapper/107:07:091
373994899125119,4cyclictest3731128-21kworker/u8:307:36:241
37765762600,4sleep03776020-21/usr/sbin/munin08:40:320
159199560,4rtkit-daemon1590-21rtkit-daemon07:57:201
159199540,4rtkit-daemon1590-21rtkit-daemon11:42:420
159199520,4rtkit-daemon1590-21rtkit-daemon10:36:030
159199520,4rtkit-daemon1590-21rtkit-daemon10:24:091
159199500,4rtkit-daemon1590-21rtkit-daemon07:43:531
159199500,3rtkit-daemon1590-21rtkit-daemon12:06:401
159199500,3rtkit-daemon1590-21rtkit-daemon08:34:101
3739948994913,17cyclictest3804119-21chrt09:31:491
39014982480,7sleep00-21swapper/011:50:300
3739948994811,11cyclictest3865471-21apt-get11:00:101
159199480,3rtkit-daemon1590-21rtkit-daemon08:22:210
3739948994715,14cyclictest3871722-21chrt11:07:511
3739948994715,14cyclictest3855981-21ntp_offset10:45:201
3739948994712,20cyclictest3906956-21apt-get12:00:121
159199470,4rtkit-daemon1590-21rtkit-daemon10:57:531
3739948994611,19cyclictest3903454-21apt-get11:55:111
3739948994610,21cyclictest3896788-21apt-get11:45:131
159199460,3rtkit-daemon1590-21rtkit-daemon11:50:151
3739948994515,11cyclictest3809235-21chrt09:40:051
3739948994514,13cyclictest3740414-21chrt07:10:301
3739948994514,12cyclictest3921987-21taskset12:22:241
3739948994512,21cyclictest3889881-21grep11:35:151
3739948994510,20cyclictest3844409-21apt-get10:30:111
3739948994415,9cyclictest3769709-21chrt08:22:291
3739948994414,9cyclictest3917354-21sshd12:15:231
3739948994414,12cyclictest3881593-21sh11:21:501
3739948994414,12cyclictest3771881-21taskset08:29:521
3739948994414,10cyclictest3761842-21taskset08:02:021
3739948994413,12cyclictest3895199-21seq11:41:531
3739948994315,9cyclictest3743934-21chrt07:15:421
3739948994315,12cyclictest3775453-21taskset08:36:181
3739948994314,12cyclictest3929290-21chrt12:34:411
3739948994314,10cyclictest3915569-21taskset12:12:411
3739948994313,18cyclictest3777482-21runrttasks08:41:571
3739948994215,10cyclictest3790080-21ssh09:11:351
3739948994214,13cyclictest3825565-21seq10:01:221
3739948994214,12cyclictest3931821-21taskset12:37:361
3739948994214,11cyclictest3925287-21seq12:27:251
3739948994214,10cyclictest3767619-21chrt08:16:151
3739948994213,10cyclictest3821966-21seq09:56:111
3739948994211,10cyclictest3748325-21cat07:30:011
3739948994114,10cyclictest3852654-21ssh10:40:351
3739948994112,11cyclictest37779602sleep108:45:041
3739948994111,11cyclictest3842270-21sed10:25:291
3739948994111,10cyclictest3788029-21cut09:10:011
3739948994110,14cyclictest3755689-21sed07:45:321
3739948994110,10cyclictest3758316-21latency_hist07:55:001
38439012400,3chrt0-21swapper/010:29:200
3739948994015,10cyclictest3781296-21taskset08:51:011
3739948994014,8cyclictest3832258-21seq10:11:151
3739948994014,10cyclictest3875552-21chrt11:14:081
3739948994012,11cyclictest38886032sleep111:32:381
3739948994012,10cyclictest3744560-21/usr/sbin/munin07:20:231
3739948994011,13cyclictest3827221-21/usr/sbin/munin10:05:191
3739948994011,11cyclictest3797258-21ssh09:21:341
3739948994010,9cyclictest3806929-21sed09:35:431
3739948994010,17cyclictest3860602-21sh10:52:091
3739948994010,13cyclictest3799477-21cat09:25:301
3739948994010,13cyclictest3762506-21expr08:05:181
159199400,5rtkit-daemon3911080-21ntp_states12:05:230
373994899399,9cyclictest3766116-21latency_hist08:15:011
3739948993914,10cyclictest3793847-21sh09:16:571
3739948993914,10cyclictest3785762-21taskset09:02:341
3739948993911,7cyclictest3816858-21apt-get09:50:131
3739948993910,13cyclictest3812853-21grep09:45:151
3739948993910,12cyclictest3886264-21cut11:30:011
3739948993910,12cyclictest3782550-21sed08:55:331
3739948993910,11cyclictest3848495-21sed10:35:241
159199390,6rtkit-daemon3917219-21latency12:15:220
3739948993811,16cyclictest3749267-21awk07:30:271
373994899379,11cyclictest3877193-21awk11:15:241
373994899379,10cyclictest38359672sleep110:16:471
159199360,7rtkit-daemon3909755-21ssh12:04:200
159199360,7rtkit-daemon0-21swapper/012:23:110
159199360,3rtkit-daemon0-21swapper/009:47:130
159199360,1rtkit-daemon1590-21rtkit-daemon12:26:140
159199350,4rtkit-daemon1590-21rtkit-daemon11:36:310
159199340,4rtkit-daemon1590-21rtkit-daemon11:33:490
159199340,3rtkit-daemon0-21swapper/108:35:430
159199340,3rtkit-daemon0-21swapper/008:10:420
159199330,4rtkit-daemon1590-21rtkit-daemon07:13:520
159199330,3rtkit-daemon0-21swapper/108:02:230
159199320,4rtkit-daemon1590-21rtkit-daemon12:38:180
159199320,3rtkit-daemon1590-21rtkit-daemon08:08:090
159199310,4rtkit-daemon1590-21rtkit-daemon09:44:470
159199310,4rtkit-daemon1590-21rtkit-daemon07:28:500
159199310,3rtkit-daemon0-21swapper/109:51:260
159199310,3rtkit-daemon0-21swapper/108:58:040
3739945993017,8cyclictest3872801-21apt-get11:10:130
3739945993013,11cyclictest3804533-1kworker/u9:111:20:130
159199300,3rtkit-daemon1590-21rtkit-daemon09:21:410
159199300,3rtkit-daemon0-21swapper/108:47:040
159199300,3rtkit-daemon0-21swapper/107:54:500
159199300,3rtkit-daemon0-21swapper/107:45:140
159199290,4rtkit-daemon3905632-21ssh11:57:310
159199290,3rtkit-daemon0-21swapper/111:47:320
159199290,3rtkit-daemon0-21swapper/111:17:010
159199290,3rtkit-daemon0-21swapper/110:24:160
159199290,3rtkit-daemon0-21swapper/109:02:140
159199290,3rtkit-daemon0-21swapper/108:51:270
159199280,3rtkit-daemon1590-21rtkit-daemon07:22:240
159199280,3rtkit-daemon0-21swapper/110:33:270
159199280,3rtkit-daemon0-21swapper/110:08:500
159199280,3rtkit-daemon0-21swapper/107:59:080
3739945992715,7cyclictest3854661-40apt-check10:44:400
3739945992712,9cyclictest2385015-1kworker/u9:209:15:160
373994599270,13cyclictest3886192-21sh11:30:000
159199270,23rtkit-daemon3742007-21munin-node09:05:360
373994599263,15cyclictest3788223-21apt-get09:10:130
159199260,1rtkit-daemon1590-21rtkit-daemon12:30:300
159199260,1rtkit-daemon1590-21rtkit-daemon07:40:140
159199260,18rtkit-daemon3803790-21kworker/u8:109:38:400
373994599251,22cyclictest3855986-21ntp_states10:45:210
159199250,20rtkit-daemon1590-21rtkit-daemon12:13:370
373994599242,15cyclictest3830608-21apt-get10:10:130
159199240,1rtkit-daemon1590-21rtkit-daemon08:32:490
373994599234,17cyclictest3750742-21tune2fs07:35:200
159199230,14rtkit-daemon3826472-21ssh10:03:410
373994599227,8cyclictest13-21ksoftirqd/009:25:150
373994599223,17cyclictest3837279-21latency_hist10:20:010
373994599223,10cyclictest3742601-21apt-get07:15:100
373994599221,19cyclictest0-21swapper/008:25:300
373994599220,6cyclictest3869195-21apt-config11:05:020
373994599220,6cyclictest3804533-1kworker/u9:111:05:020
373994599212,13cyclictest3820329-21apt-get09:55:150
373994599211,14cyclictest3802218-21apt-get09:30:140
373994599202,12cyclictest3748479-21apt-get07:30:140
3739945991914,3cyclictest3859897-21grep10:50:300
373994599191,16cyclictest3766552-21tune2fs08:15:190
373994599189,5cyclictest3787964-21diskmemload10:59:190
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional