You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 19:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Wed Apr 24, 2024 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39971992319277,28sleep00-21swapper/007:06:190
39973652303260,28sleep10-21swapper/107:08:081
41083032550,8sleep126-21ksoftirqd/110:45:301
159199520,4rtkit-daemon1590-21rtkit-daemon12:30:361
159199520,3rtkit-daemon1590-21rtkit-daemon09:27:111
159199470,3rtkit-daemon0-21swapper/012:00:110
159199460,3rtkit-daemon0-21swapper/010:28:580
159199450,4rtkit-daemon0-21swapper/009:49:520
159199450,3rtkit-daemon0-21swapper/011:58:160
159199450,3rtkit-daemon0-21swapper/009:39:420
159199450,3rtkit-daemon0-21swapper/008:34:110
159199440,3rtkit-daemon0-21swapper/012:25:300
159199440,3rtkit-daemon0-21swapper/012:25:300
159199430,3rtkit-daemon0-21swapper/012:08:290
159199430,3rtkit-daemon0-21swapper/009:41:220
159199430,3rtkit-daemon0-21swapper/009:11:420
159199420,3rtkit-daemon0-21swapper/008:22:240
159199420,3rtkit-daemon0-21swapper/008:08:310
40086202411,2sleep04008616-21apt-get07:45:080
159199410,3rtkit-daemon0-21swapper/008:48:040
40731322400,3sleep00-21swapper/009:54:490
159199400,5rtkit-daemon0-21swapper/012:23:180
159199400,4rtkit-daemon0-21swapper/012:14:180
159199400,3rtkit-daemon0-21swapper/009:16:470
159199400,3rtkit-daemon0-21swapper/008:36:590
159199390,3rtkit-daemon0-21swapper/008:27:020
159199380,3rtkit-daemon0-21swapper/010:32:150
159199380,3rtkit-daemon0-21swapper/008:14:110
159199370,8rtkit-daemon13-21ksoftirqd/008:35:551
159199370,3rtkit-daemon0-21swapper/009:20:320
159199340,4rtkit-daemon1590-21rtkit-daemon10:41:081
3997653993313,5cyclictest13-21ksoftirqd/010:15:000
159199330,4rtkit-daemon1590-21rtkit-daemon11:37:041
41302822310,3sleep00-21swapper/011:17:190
40748352310,5sleep04074838-21grep09:55:270
159199310,4rtkit-daemon1590-21rtkit-daemon10:18:171
159199310,4rtkit-daemon1590-21rtkit-daemon09:06:001
399765399309,6cyclictest13-21ksoftirqd/010:05:010
159199300,4rtkit-daemon1590-21rtkit-daemon08:43:550
3997656992922,5cyclictest26-21ksoftirqd/108:20:001
399765399299,6cyclictest4113032-21ssh10:51:510
399765399299,5cyclictest13-21ksoftirqd/009:35:010
159199290,15rtkit-daemon41200302sleep111:01:581
399765699281,9cyclictest0-21swapper/110:26:071
399765399289,5cyclictest13-21ksoftirqd/011:15:010
399765399276,7cyclictest13-21ksoftirqd/011:30:000
3997653992721,2cyclictest4042039-21diskmemload10:45:220
3997653992712,2cyclictest0-21swapper/011:48:050
399765399268,7cyclictest13-21ksoftirqd/008:00:000
399765399267,5cyclictest13-21ksoftirqd/011:55:010
399765399265,5cyclictest13-21ksoftirqd/009:30:000
399765399264,8cyclictest13-21ksoftirqd/010:21:530
3997653992610,9cyclictest4005543-21apt-get07:35:080
159199260,19rtkit-daemon0-21swapper/110:51:311
399765699252,7cyclictest4182138-21apt-get12:35:121
3997656992513,7cyclictest63950irq/130-enp2s011:55:101
399765699250,5cyclictest4124728-21ls11:10:001
399765399257,6cyclictest13-21ksoftirqd/008:54:480
399765399257,6cyclictest13-21ksoftirqd/007:45:020
399765399255,7cyclictest13-21ksoftirqd/007:35:000
399765399254,2cyclictest141rcu_preempt10:05:300
399765399252,16cyclictest4040292-21apt-get09:05:130
399765699245,4cyclictest26-21ksoftirqd/111:45:541
399765699243,14cyclictest4090710-21apt-get10:20:121
399765699243,14cyclictest4059745-21apt-get09:35:131
399765699242,16cyclictest4131992-21apt-get11:20:121
399765699242,14cyclictest4083806-21apt-get10:10:121
3997656992414,8cyclictest4071409-21awk09:50:301
3997656992413,2cyclictest26-21ksoftirqd/109:45:001
3997656992413,10cyclictest26-21ksoftirqd/112:30:011
3997656992413,10cyclictest26-21ksoftirqd/112:30:001
399765699241,17cyclictest4073469-21apt-get09:55:121
399765399245,5cyclictest13-21ksoftirqd/011:35:000
399765399244,3cyclictest0-21swapper/011:03:140
399765399243,14cyclictest4103603-21apt-get10:40:130
399765399243,14cyclictest4002947-21apt-get07:25:110
159199240,4rtkit-daemon4022056-21sshd08:19:480
159199240,3rtkit-daemon0-21swapper/010:36:210
41151162230,10sleep013-21ksoftirqd/010:55:220
399765699232,14cyclictest4042300-21apt-get09:10:131
3997656992319,3cyclictest26-21ksoftirqd/111:20:001
3997656992312,6cyclictest63950irq/130-enp2s011:30:091
3997656992311,7cyclictest63950irq/130-enp2s012:05:131
399765699231,15cyclictest3997796-21apt-get07:10:121
3997656992311,10cyclictest4008598-21/usr/sbin/munin07:45:131
399765399236,4cyclictest0-21swapper/007:16:100
3997653992310,3cyclictest4042039-21diskmemload12:15:440
399765399230,4cyclictest4148738-21python311:45:010
159199230,3rtkit-daemon0-21swapper/009:00:450
41701852220,1sleep10-21swapper/112:15:331
399765699223,11cyclictest4159075-21apt-get12:00:141
399765699222,14cyclictest4124871-21apt-get11:10:131
399765699222,12cyclictest4036368-21apt-get08:55:131
399765699220,4cyclictest4034706-21fschecks_time08:50:181
399765699220,20cyclictest1855330-20systemd-journal07:40:011
399765399225,10cyclictest4185163-21sendmail12:40:000
399765399222,14cyclictest4000994-21apt-get07:20:100
399765699212,14cyclictest4165660-21apt-get12:10:101
399765699212,13cyclictest4066740-21apt-get09:45:141
3997656992115,4cyclictest26-21ksoftirqd/111:30:001
399765699211,16cyclictest26-21ksoftirqd/110:00:141
399765699211,15cyclictest26-21ksoftirqd/110:55:141
3997656992110,6cyclictest63950irq/130-enp2s010:35:071
399765399215,10cyclictest4012522-21apt-get07:55:150
399765399214,2cyclictest141rcu_preempt11:20:030
399765399213,16cyclictest4012327-21latency_hist07:55:000
3997653992113,6cyclictest4121488-21seq11:05:100
3997653992113,6cyclictest4089014-21seq10:16:310
3997653992112,7cyclictest4142528-21fw_packets11:35:210
159199210,13rtkit-daemon0-21swapper/111:41:161
159199210,13rtkit-daemon0-21swapper/107:43:131
159199210,10rtkit-daemon26-21ksoftirqd/109:33:441
399765699203,10cyclictest4172454-21apt-get12:20:151
3997656992014,4cyclictest26-21ksoftirqd/108:15:011
3997656992012,6cyclictest4082620-21seq10:07:331
399765699200,1cyclictest141rcu_preempt08:00:001
399765399204,2cyclictest141rcu_preempt07:10:180
159199200,13rtkit-daemon0-21swapper/107:30:591
159199200,13rtkit-daemon0-21swapper/107:27:141
159199200,13rtkit-daemon0-21swapper/008:56:410
399765699192,9cyclictest4152610-21apt-get11:50:141
399765699192,12cyclictest4050351-21ntp_states09:20:251
3997656991914,4cyclictest26-21ksoftirqd/108:00:001
3997656991914,3cyclictest4031177-21tail08:40:201
3997656991914,3cyclictest3143951-21snmpd09:03:451
3997656991911,6cyclictest4034134-21seq08:49:171
399765699191,15cyclictest4098429-21ssh10:31:191
3997656991811,5cyclictest4000403-21seq07:16:131
3997656991811,5cyclictest26-21ksoftirqd/108:10:021
3997656991810,6cyclictest4046019-21cat09:15:141
3997656991810,6cyclictest4012347-21systemd-run07:55:011
399765699180,16cyclictest4024819-21ls08:25:171
3997653991811,5cyclictest1855330-20systemd-journal12:35:010
399765699179,5cyclictest26-21ksoftirqd/108:20:031
3997656991713,2cyclictest4002743-21turbostat07:25:011
399765699171,11cyclictest4026580-21/usr/sbin/munin08:30:311
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional