You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 20:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot4.osadl.org (updated Sun Apr 28, 2024 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
41324702287224,49sleep00-21swapper/007:06:180
41326542242199,28sleep10-21swapper/107:08:181
707852570,4sleep10-21swapper/111:12:321
159199540,4rtkit-daemon1590-21rtkit-daemon11:32:051
159199510,4rtkit-daemon1590-21rtkit-daemon10:04:541
159199500,4rtkit-daemon1590-21rtkit-daemon12:29:181
159199500,3rtkit-daemon1590-21rtkit-daemon10:45:271
159199490,4rtkit-daemon1590-21rtkit-daemon11:36:210
159199480,4rtkit-daemon1590-21rtkit-daemon08:05:521
41395132460,7sleep00-21swapper/007:25:210
131762430,3sleep00-21swapper/009:49:170
159199380,3rtkit-daemon0-21swapper/112:32:231
159199370,3rtkit-daemon0-21swapper/110:05:081
159199360,6rtkit-daemon678-21irqbalance09:53:510
159199360,3rtkit-daemon0-21swapper/107:50:081
159199350,8rtkit-daemon4149289-21pmu-power07:50:210
159199350,4rtkit-daemon1590-21rtkit-daemon11:20:401
159199350,4rtkit-daemon1590-21rtkit-daemon08:03:581
159199350,3rtkit-daemon0-21swapper/112:11:261
159199350,3rtkit-daemon0-21swapper/109:14:161
159199350,3rtkit-daemon0-21swapper/108:35:390
159199350,3rtkit-daemon0-21swapper/107:33:501
159199350,3rtkit-daemon0-21swapper/009:03:320
159199340,5rtkit-daemon3143951-21snmpd10:02:000
159199340,4rtkit-daemon1590-21rtkit-daemon08:18:471
159199340,4rtkit-daemon1590-21rtkit-daemon07:37:331
159199340,3rtkit-daemon0-21swapper/111:01:570
159199340,3rtkit-daemon0-21swapper/109:16:251
159199340,3rtkit-daemon0-21swapper/008:56:050
159199330,4rtkit-daemon1590-21rtkit-daemon09:06:120
159199330,3rtkit-daemon1590-21rtkit-daemon12:04:481
159199330,3rtkit-daemon0-21swapper/111:32:480
159199330,3rtkit-daemon0-21swapper/111:13:070
159199330,3rtkit-daemon0-21swapper/107:44:040
63882320,3chrt141rcu_preempt09:40:011
159199320,4rtkit-daemon1590-21rtkit-daemon09:24:271
159199320,4rtkit-daemon1590-21rtkit-daemon07:42:291
159199320,4rtkit-daemon0-21swapper/111:05:560
159199320,3rtkit-daemon1590-21rtkit-daemon10:42:451
159199320,3rtkit-daemon1590-21rtkit-daemon07:16:301
159199320,3rtkit-daemon0-21swapper/110:17:140
159199320,3rtkit-daemon0-21swapper/109:24:330
159199320,3rtkit-daemon0-21swapper/109:10:250
159199320,3rtkit-daemon0-21swapper/108:26:251
159199310,4rtkit-daemon1590-21rtkit-daemon10:17:061
159199310,3rtkit-daemon1590-21rtkit-daemon07:28:041
159199310,3rtkit-daemon0-21swapper/112:28:150
159199310,3rtkit-daemon0-21swapper/111:45:310
159199310,3rtkit-daemon0-21swapper/111:18:080
159199310,3rtkit-daemon0-21swapper/110:44:520
159199310,3rtkit-daemon0-21swapper/110:25:310
159199310,3rtkit-daemon0-21swapper/110:08:450
159199310,3rtkit-daemon0-21swapper/108:30:420
586342300,6sleep023167-1kworker/u9:110:55:120
159199300,3rtkit-daemon1590-21rtkit-daemon11:47:231
159199300,3rtkit-daemon1590-21rtkit-daemon08:34:211
159199300,3rtkit-daemon0-21swapper/108:19:570
159199300,3rtkit-daemon0-21swapper/108:07:510
159199300,3rtkit-daemon0-21swapper/009:59:471
413292499291,9cyclictest55085-40apt-check10:50:180
159199290,3rtkit-daemon1590-21rtkit-daemon07:48:511
159199290,3rtkit-daemon0-21swapper/112:12:000
159199290,3rtkit-daemon0-21swapper/111:51:330
159199290,3rtkit-daemon0-21swapper/108:27:250
159199290,3rtkit-daemon0-21swapper/008:57:481
413292999283,4cyclictest26-21ksoftirqd/112:20:011
4132929992813,10cyclictest37798-21apt-get10:25:111
159199280,3rtkit-daemon0-21swapper/111:21:150
159199280,3rtkit-daemon0-21swapper/107:34:120
159199280,3rtkit-daemon0-21swapper/009:51:521
159199280,3rtkit-daemon0-21swapper/008:53:001
159199280,3rtkit-daemon0-21swapper/008:49:561
4132929992712,5cyclictest26-21ksoftirqd/110:50:391
159199270,3rtkit-daemon0-21swapper/107:11:560
159199270,21rtkit-daemon4132919-21cyclictest11:35:261
413292999263,15cyclictest96224-21apt-get11:50:111
413292999261,6cyclictest26-21ksoftirqd/111:55:121
4132929992613,7cyclictest63950irq/130-enp2s010:30:111
413292999260,6cyclictest0-21swapper/108:14:401
4132924992612,9cyclictest23167-1kworker/u9:112:05:120
159199260,3rtkit-daemon0-21swapper/009:01:561
159199260,22rtkit-daemon4132919-21cyclictest09:17:380
159199260,1rtkit-daemon1590-21rtkit-daemon11:01:351
159199260,1rtkit-daemon1590-21rtkit-daemon08:35:331
159199260,1rtkit-daemon1590-21rtkit-daemon07:20:161
159199260,16rtkit-daemon0-21swapper/111:28:161
413292999250,6cyclictest0-21swapper/109:48:081
4132924992516,7cyclictest4150630-21df07:55:160
159199250,1rtkit-daemon1590-21rtkit-daemon10:11:161
413292999247,3cyclictest26-21ksoftirqd/109:40:221
413292999245,2cyclictest141rcu_preempt09:30:011
413292999242,14cyclictest4193573-21apt-get09:30:121
413292499242,15cyclictest116763-21apt-get12:20:120
21972240,8sleep00-21swapper/009:33:270
159199240,1rtkit-daemon1590-21rtkit-daemon08:50:450
460972230,1sleep00-21swapper/010:36:080
413292499239,8cyclictest2773353-1kworker/u9:211:40:130
413292499236,11cyclictest23167-1kworker/u9:112:35:140
4132924992311,8cyclictest23167-1kworker/u9:112:30:140
413292499230,5cyclictest0-21swapper/012:01:030
159199230,18rtkit-daemon4132919-21cyclictest08:23:480
413292999226,3cyclictest26-21ksoftirqd/112:20:211
4132929992215,5cyclictest26-21ksoftirqd/107:15:001
413292999220,1cyclictest141rcu_preempt08:00:011
413292499223,12cyclictest27380-21apt-get10:10:080
413292499221,17cyclictest4179412-21diskmemload09:40:580
413292499221,14cyclictest51369-21apt-get10:45:120
413292499220,20cyclictest4152779-21apt-get08:00:150
413292499220,16cyclictest37565-21latency_hist10:25:010
159199220,14rtkit-daemon0-21swapper/111:17:461
413292999219,7cyclictest63950irq/130-enp2s010:55:121
413292999212,13cyclictest4177659-21apt-get09:05:141
413292999212,13cyclictest4161366-21apt-get08:20:121
4132929992111,2cyclictest141rcu_preempt10:20:121
413292999210,3cyclictest47702-21munin-run10:40:001
413292499212,17cyclictest4137364-21perf07:24:550
413292499212,13cyclictest4190309-21apt-get09:25:150
4132924992116,4cyclictest13-21ksoftirqd/010:00:000
4132924992116,3cyclictest4158005-21/usr/sbin/munin08:10:270
4132924992110,6cyclictest41055-21apt-get10:30:100
413292999203,10cyclictest4167890-21apt-get08:40:091
413292999201,7cyclictest107304-21ntpq12:05:221
4132929992010,8cyclictest67534-21ssh11:07:441
413292499202,13cyclictest4169839-21apt-get08:45:130
413292499202,11cyclictest4142501-21apt-get07:35:120
413292499200,18cyclictest4169700-21wc08:45:000
413292499200,18cyclictest113746-21ssh12:15:190
413292999199,8cyclictest4179412-21diskmemload12:35:401
413292999195,2cyclictest141rcu_preempt11:40:121
413292499192,12cyclictest78786-21apt-get11:25:120
4132924991912,5cyclictest673-21dbus-daemon09:40:000
413292499191,16cyclictest4147744-21grep07:45:300
4132924991911,6cyclictest4137135-21seq07:17:540
413292499180,16cyclictest102930-21cat12:00:000
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional