You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-29 - 08:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Thu Feb 29, 2024 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
380375023530,20sleep00-21swapper/019:05:240
38051342252197,27sleep10-21swapper/119:08:481
380538299136130,4cyclictest3880054-21kworker/u8:221:49:280
3805386996714,26cyclictest3821603-21cat19:50:011
380538699652,42cyclictest3887616-21apt-get22:00:231
380538699610,4cyclictest3977835-21/usr/sbin/munin00:15:401
3805386995910,25cyclictest3809762-21cron19:20:001
3805382995914,21cyclictest3979407-21taskset00:16:190
380538699582,4cyclictest3981010-21cpuspeed_turbos00:20:231
380538299582,36cyclictest3867527-21apt-get21:30:250
380538299582,35cyclictest3825623-21apt-get20:00:250
380538699575,34cyclictest3805992-21if_enp2s019:10:291
380538699572,6cyclictest3900851-21apt-get22:20:191
380538299572,35cyclictest3823651-21apt-get19:55:220
380538299562,35cyclictest3845540-21apt-get20:50:210
380538299552,34cyclictest3884229-21apt-get21:55:220
38933952540,3sleep00-21swapper/022:08:550
380538699543,5cyclictest3904176-21apt-get22:25:211
380538699542,4cyclictest3921121-21apt-get22:50:241
3805386995412,34cyclictest38191402sleep119:40:481
3805386995412,34cyclictest38191402sleep119:40:471
3805382995413,20cyclictest3993905-21taskset00:39:250
380538699536,3cyclictest3821685-21/usr/sbin/munin19:50:281
380538699533,2cyclictest3813659-21taskset19:29:531
380538699531,5cyclictest3880860-21apt-get21:50:211
3805386995312,32cyclictest38174552sleep119:38:491
380538299534,4cyclictest3972639-21missed_timers00:05:290
380538299532,34cyclictest3914446-40apt-check22:40:100
3805382995312,20cyclictest3981950-21basename00:20:390
3805382995310,28cyclictest3990693-21apt-config00:35:010
38166262520,4sleep00-21swapper/019:35:360
380538699529,32cyclictest0-21swapper/123:03:361
380538699522,3cyclictest3897520-21apt-get22:15:221
380538699521,6cyclictest3984119-21apt-get00:25:231
3805386995210,34cyclictest38152372sleep119:30:541
3805382995213,24cyclictest3829166-21seq20:08:440
380538299512,7cyclictest3864286-21apt-get21:25:190
380538299511,6cyclictest3950971-21apt-get23:35:190
3805382995111,24cyclictest3985523-21chrt00:25:430
159199510,4rtkit-daemon1590-21rtkit-daemon23:15:091
380538699509,23cyclictest0-21swapper/123:54:301
380538699505,2cyclictest38252972sleep119:59:161
380538699502,5cyclictest3870930-21apt-get21:35:231
380538699502,4cyclictest3914446-40apt-check22:40:071
380538699502,2cyclictest3809993-21/usr/sbin/munin19:20:341
380538699501,4cyclictest3853197-21diskmemload23:22:031
380538699500,9cyclictest3926857-21ssh22:58:141
380538699500,1cyclictest3890844-21apt-get22:05:201
380538299502,5cyclictest3851406-21apt-get21:05:230
380538299501,7cyclictest3829512-21apt-get20:10:190
380538299501,6cyclictest3847492-21apt-get20:55:250
380538299501,5cyclictest3894154-21apt-get22:10:200
380538699492,5cyclictest3880300-21fwupd21:49:311
380538699492,36cyclictest3910060-21ssh22:33:481
380538699491,9cyclictest3992065-21ntp_states00:35:421
380538699491,9cyclictest3839618-40apt-check20:35:151
380538699491,7cyclictest3860150-21ssh21:18:561
380538299492,7cyclictest3810011-21apt-get19:20:220
380538299490,4cyclictest3976672-21ssh00:11:280
380538299490,1cyclictest4173779-21snapd19:12:300
39893042480,4sleep10-21swapper/100:31:521
380538699484,3cyclictest3972223-21fschecks_count00:05:241
380538699482,34cyclictest0-21swapper/122:45:561
380538699481,9cyclictest3975150-21apt-get00:10:251
380538699481,9cyclictest3964976-21apt-get23:55:181
380538699480,9cyclictest3895530-21users22:10:351
380538299482,7cyclictest3811955-21apt-get19:25:210
380538299482,2cyclictest0-21swapper/019:30:260
380538299481,7cyclictest3860891-21apt-get21:20:190
380538299481,5cyclictest3855600-21ssh21:12:180
380538699471,9cyclictest3968362-21apt-config00:00:021
380538699471,9cyclictest3852526-21lsb_release21:05:371
380538699471,7cyclictest3886976-21sh21:59:181
380538699471,6cyclictest3946909-21ssh23:28:521
380538699470,9cyclictest3843140-21sshd20:42:351
380538699470,7cyclictest3956592-21sh23:43:131
380538699470,7cyclictest3836824-21seq20:27:031
380538299478,22cyclictest0-21swapper/019:49:480
380538299471,8cyclictest3876681-21ssh21:43:250
380538299471,5cyclictest3821703-21apt-get19:50:190
380538699461,10cyclictest3958178-21memory23:45:311
380538699460,10cyclictest3864935-21memory21:25:291
380538299462,7cyclictest3934321-21ssh23:10:080
380538299462,4cyclictest3907430-21apt-get22:30:230
380538299461,9cyclictest3905744-21ssh22:26:140
380538299461,8cyclictest3920422-21ssh22:49:000
380538299461,7cyclictest3923592-21ssh22:53:290
380538299461,7cyclictest3857439-21apt-get21:15:220
380538699451,6cyclictest3853197-21diskmemload23:07:121
380538699451,6cyclictest3853197-21diskmemload21:30:321
380538699450,9cyclictest3834032-21memory20:20:261
380538299452,3cyclictest3807746-21munin-node19:15:030
380538299451,9cyclictest3841648-21apt-get20:40:200
380538299451,6cyclictest3955817-21ssh23:41:040
380538299451,4cyclictest3967992-21apt-get00:00:080
380538699441,5cyclictest63950irq/130-enp2s021:10:241
380538699440,8cyclictest3874601-21perl21:40:241
380538299446,2cyclictest3853197-21diskmemload23:32:110
380538299442,4cyclictest3927873-21apt-get23:00:230
380538299441,5cyclictest3944385-21apt-get23:25:210
380538299441,4cyclictest3963211-21ssh23:52:150
380538299441,4cyclictest3882953-21ssh21:52:280
380538299440,8cyclictest3933286-21sh23:07:510
380538299440,8cyclictest3899398-21ssh22:16:590
380538299440,6cyclictest3853197-21diskmemload22:36:360
380538299440,2cyclictest3819564-21dump-pmu-power19:45:020
380538299440,2cyclictest3819564-21dump-pmu-power19:45:010
380538699431,7cyclictest3838966-21runrttasks20:34:071
380538699431,7cyclictest3832467-21sensors_temp20:15:331
380538299431,9cyclictest3959931-21ssh23:48:260
380538299431,6cyclictest3871192-21ssh21:35:280
380538299431,6cyclictest3853197-21diskmemload22:04:160
380538299431,4cyclictest3941152-21apt-get23:20:200
380538299431,3cyclictest3849460-21apt-get21:00:230
380538299431,10cyclictest3837332-21apt-get20:30:200
159199430,3rtkit-daemon0-21swapper/020:19:480
380538699420,3cyclictest4173787-21snapd23:36:561
380538299421,4cyclictest3964976-21apt-get23:55:190
380538299421,4cyclictest3924500-21apt-get22:55:210
380538299420,9cyclictest3900851-21apt-get22:20:190
380538699411,6cyclictest3853197-21diskmemload23:13:121
380538699410,4cyclictest4173779-21snapd20:11:561
380538299411,4cyclictest3853197-21diskmemload23:15:130
159199390,3rtkit-daemon0-21swapper/020:29:070
380538699388,7cyclictest3911378-21cat22:35:261
3805386993814,22cyclictest3864003-21/usr/sbin/munin21:25:001
380538699361,5cyclictest3845752-21diskstats20:50:251
3805386993612,22cyclictest3949699-21sh23:32:271
380538699355,4cyclictest0-21swapper/120:02:051
380538699341,5cyclictest3843805-21diskstats20:45:241
380538299342,7cyclictest3843593-21apt-get20:45:200
380538699331,9cyclictest3827782-21diskstats20:05:251
380538699331,10cyclictest3849777-21perl21:00:291
380538699330,10cyclictest3847477-21find20:55:231
380538299333,6cyclictest3839618-40apt-check20:35:130
380538299290,9cyclictest3833524-21/usr/sbin/munin20:20:180
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional