You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 04:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackcslot4.osadl.org (updated Thu Sep 18, 2025 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36486082257185,57sleep00-21swapper/019:05:520
36488722243202,26sleep10-21swapper/119:08:411
36491129914156,73cyclictest3814125-21/usr/sbin/munin00:00:211
36491099912839,77cyclictest3814110-21which00:00:210
366136821150,4sleep0161rcuc/019:40:000
36778472550,4sleep03677821-21cron20:20:000
36857582540,4sleep1251rcuc/120:39:591
37843412530,2sleep13784342-21ssh23:17:381
125899480,3rtkit-daemon0-21swapper/021:15:480
125899470,3rtkit-daemon0-21swapper/021:55:360
37271192460,4sleep13727114-21needreboot21:55:171
125899460,3rtkit-daemon0-21swapper/019:34:580
125899450,3rtkit-daemon0-21swapper/020:23:380
125899450,3rtkit-daemon0-21swapper/000:33:500
125899440,3rtkit-daemon0-21swapper/023:49:440
125899440,3rtkit-daemon0-21swapper/023:41:090
125899440,3rtkit-daemon0-21swapper/020:03:480
125899440,3rtkit-daemon0-21swapper/019:49:450
125899430,3rtkit-daemon0-21swapper/021:09:360
125899430,3rtkit-daemon0-21swapper/020:37:150
125899420,3rtkit-daemon0-21swapper/020:11:260
125899410,3rtkit-daemon0-21swapper/022:11:530
125899410,3rtkit-daemon0-21swapper/020:56:340
125899400,3rtkit-daemon0-21swapper/020:48:490
125899390,5rtkit-daemon3733347-21apt-get22:05:151
125899390,3rtkit-daemon0-21swapper/023:32:510
125899390,3rtkit-daemon0-21swapper/022:49:410
125899390,3rtkit-daemon0-21swapper/022:00:580
125899390,3rtkit-daemon0-21swapper/021:47:080
125899380,5rtkit-daemon3763632-21ssh22:46:541
125899380,3rtkit-daemon0-21swapper/022:40:580
125899380,3rtkit-daemon0-21swapper/022:36:000
125899380,3rtkit-daemon0-21swapper/019:53:300
125899350,4rtkit-daemon1257-21rtkit-daemon00:25:071
3649112993413,7cyclictest26-21ksoftirqd/123:30:011
3649112993213,9cyclictest0-21swapper/121:30:171
3649112993112,5cyclictest26-21ksoftirqd/122:15:011
3649112993014,10cyclictest3696308-1kworker/u9:121:25:151
364911299300,15cyclictest3812909-21sh00:00:001
3649109993013,11cyclictest3680007-21apt-get20:25:120
3649109993010,7cyclictest3785296-21cron23:20:010
3649109993010,5cyclictest13-1ksoftirqd/000:29:310
3649112992922,5cyclictest3664853-21seq19:45:341
364910999297,5cyclictest13-21ksoftirqd/021:40:150
364910999297,12cyclictest0-21swapper/022:23:250
3649109992912,11cyclictest3751061-21apt-get22:30:150
125899290,4rtkit-daemon3655702-21apt-get19:25:110
125899290,3rtkit-daemon0-21swapper/023:09:210
364910999287,7cyclictest13-21ksoftirqd/023:00:250
364911299271,21cyclictest3803012-40apt-check23:45:181
3649112992711,14cyclictest63750irq/132-enp2s020:00:001
3649109992720,3cyclictest3696109-21diskmemload22:50:140
3649109992712,13cyclictest36511712sleep019:15:020
36928052260,10sleep10-21swapper/120:55:251
364911299266,2cyclictest141rcu_preempt00:20:291
364910999268,3cyclictest3816885-21entropy00:05:190
364910999261,2cyclictest141rcu_preempt23:35:140
364911299257,3cyclictest141rcu_preempt21:45:211
364911299253,3cyclictest141rcu_preempt23:45:011
364911299253,3cyclictest141rcu_preempt22:30:001
364911299253,15cyclictest3768420-21apt-get22:55:141
364911299252,15cyclictest3740504-21apt-get22:15:131
364911299251,6cyclictest26-21ksoftirqd/121:22:011
3649112992513,10cyclictest3696119-21turbostat21:10:001
364910999256,5cyclictest13-21ksoftirqd/000:20:010
364910999251,2cyclictest141rcu_preempt23:15:130
125899250,3rtkit-daemon0-21swapper/021:30:300
125899250,15rtkit-daemon0-21swapper/119:14:571
364911299246,2cyclictest141rcu_preempt23:07:191
364911299243,14cyclictest3823021-21apt-get00:15:171
364911299243,13cyclictest3717467-21apt-get21:40:151
364911299241,3cyclictest3696109-21diskmemload22:03:171
3649112992411,11cyclictest287-20systemd-journal22:44:551
364910999249,11cyclictest3788991-21apt-get23:25:140
364910999247,1cyclictest0-21swapper/021:27:290
364910999244,2cyclictest0-21swapper/023:56:000
364910999242,2cyclictest141rcu_preempt22:15:250
364910999242,15cyclictest3826504-21apt-get00:20:150
364910999242,14cyclictest3689795-21apt-get20:50:180
364910999241,6cyclictest131ksoftirqd/021:54:310
364910999241,2cyclictest141rcu_preempt23:10:160
364910999241,2cyclictest141rcu_preempt21:10:100
125899240,3rtkit-daemon0-21swapper/019:55:300
364911299237,2cyclictest141rcu_preempt22:35:161
364911299234,2cyclictest141rcu_preempt21:18:431
364911299234,2cyclictest141rcu_preempt00:35:491
364911299233,18cyclictest3695462-21latency_hist21:05:011
364911299233,11cyclictest141rcu_preempt20:35:011
364911299232,2cyclictest3696109-21diskmemload23:12:061
364911299232,15cyclictest3792219-21apt-get23:30:131
364911299232,14cyclictest3816645-21apt-get00:05:171
364911299232,14cyclictest3659612-21apt-get19:35:151
3649112992316,5cyclictest3651450-21fschecks_time19:15:031
3649112992310,12cyclictest26-21ksoftirqd/122:25:011
3649112992310,11cyclictest26-21ksoftirqd/120:25:011
364911299230,5cyclictest3658632-21grep19:30:241
364910999232,2cyclictest141rcu_preempt22:28:230
364910999232,15cyclictest3681958-21apt-get20:30:140
3649109992312,3cyclictest13-21ksoftirqd/000:35:250
3649109992311,6cyclictest3733347-21apt-get22:05:160
125899230,3rtkit-daemon0-21swapper/023:51:240
125899230,3rtkit-daemon0-21swapper/019:23:520
364911299226,3cyclictest141rcu_preempt23:00:551
364911299222,18cyclictest3798909-21latency_hist23:40:001
364911299222,14cyclictest3833343-21apt-get00:30:161
3649112992216,4cyclictest26-21ksoftirqd/120:09:591
3649112992211,8cyclictest3674333-21df20:10:161
364910999223,2cyclictest141rcu_preempt00:10:170
364910999222,3cyclictest141rcu_preempt21:35:250
125899220,3rtkit-daemon0-21swapper/021:00:500
125899220,14rtkit-daemon0-21swapper/021:22:110
364911299219,10cyclictest0-21swapper/120:00:351
364911299214,10cyclictest3765057-21apt-get22:50:141
364911299213,17cyclictest26-21ksoftirqd/123:24:551
364911299213,10cyclictest3806377-21apt-get23:50:151
364911299212,13cyclictest3653759-21apt-get19:20:151
364911299210,5cyclictest3666836-21sendmail_mailqu19:50:251
364910999214,11cyclictest3685883-21apt-get20:40:130
364910999212,2cyclictest141rcu_preempt20:05:140
3649109992110,8cyclictest3768645-21df_inode22:55:170
364911299209,3cyclictest26-21ksoftirqd/122:35:021
364911299202,13cyclictest3819634-21apt-get00:10:171
3649112992016,2cyclictest3688274-21hwlatdetect20:45:181
364911299200,3cyclictest3679781-1kworker/1:0H20:45:011
3649112991916,2cyclictest3659340-21kworker/1:119:44:551
364911299191,17cyclictest0-21swapper/120:25:221
364911299191,17cyclictest0-21swapper/120:15:171
364911299190,3cyclictest3688051-1kworker/1:1H21:54:541
364911299190,2cyclictest3688051-1kworker/1:1H21:10:071
364911299190,16cyclictest3655681-21seq19:25:071
364910999193,8cyclictest3661586-21apt-get19:40:120
3649109991911,6cyclictest3649473-21entropy19:10:170
3649112991813,3cyclictest3690179-21gltestperf20:50:211
3649112991810,6cyclictest3714689-21ntp_states21:35:241
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:543
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
none10:34:542
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional