You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-05 - 00:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6 (updated Wed Oct 04, 2023 12:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
273812807,20sleep00-21swapper/007:08:080
27748997219,17cyclictest0-21swapper/011:55:200
27748997127,8cyclictest14-21ksoftirqd/010:14:120
27748996843,10cyclictest14-21ksoftirqd/010:50:300
27748996737,25cyclictest14-21ksoftirqd/011:50:250
27748996735,16cyclictest14-21ksoftirqd/008:28:440
2599526724,30sleep10-21swapper/107:05:161
2774899668,17cyclictest0-21swapper/010:30:260
119892660,4sleep1251rcuc/107:50:421
27760996538,10cyclictest26-21ksoftirqd/107:39:431
27760996534,25cyclictest21838-21idleruntime-cro08:19:591
27748996527,32cyclictest14-21ksoftirqd/012:05:260
27748996439,9cyclictest14-21ksoftirqd/009:30:360
27748996438,20cyclictest14-21ksoftirqd/011:09:170
27748996438,20cyclictest14-21ksoftirqd/011:09:160
27748996438,10cyclictest14-21ksoftirqd/007:35:050
27748996435,24cyclictest14-21ksoftirqd/009:10:450
27760996337,10cyclictest26-21ksoftirqd/112:10:111
2774899638,47cyclictest6390-21apt-get12:10:240
27760996238,9cyclictest26-21ksoftirqd/110:50:321
27760996233,20cyclictest12635-21apt-get09:25:251
2774899625,52cyclictest0-21swapper/008:35:230
27748996238,9cyclictest14-21ksoftirqd/008:55:360
27748996237,9cyclictest14-21ksoftirqd/007:30:450
27748996237,10cyclictest14-21ksoftirqd/008:30:330
27748996218,40cyclictest0-21swapper/009:24:560
27760996136,10cyclictest26-21ksoftirqd/111:01:061
27748996137,9cyclictest14-21ksoftirqd/012:00:500
27748996137,9cyclictest14-21ksoftirqd/012:00:490
27748996132,16cyclictest14-21ksoftirqd/010:15:480
27748996130,17cyclictest14-21ksoftirqd/009:49:000
27760996037,18cyclictest26-21ksoftirqd/108:09:481
27748996037,17cyclictest14-21ksoftirqd/012:20:300
27748996036,9cyclictest14-21ksoftirqd/008:24:590
27748996035,9cyclictest14-21ksoftirqd/011:12:290
27748996035,9cyclictest14-21ksoftirqd/009:26:230
27748996034,9cyclictest14-21ksoftirqd/010:40:290
27748996034,18cyclictest14-21ksoftirqd/008:14:260
2776099594,23cyclictest10714-21systemctl09:19:591
27760995936,9cyclictest26-21ksoftirqd/109:05:341
27760995934,9cyclictest26-21ksoftirqd/111:35:281
27760995934,9cyclictest26-21ksoftirqd/109:50:111
27748995935,9cyclictest14-21ksoftirqd/012:30:240
27748995935,9cyclictest14-21ksoftirqd/009:59:560
27748995935,9cyclictest14-21ksoftirqd/007:40:380
27748995934,9cyclictest14-21ksoftirqd/011:45:300
27748995927,16cyclictest14-21ksoftirqd/009:00:250
301642580,10chrt0-21swapper/008:40:480
2776099584,22cyclictest31878-21/usr/sbin/munin10:20:391
27760995835,18cyclictest26-21ksoftirqd/112:30:441
27760995834,9cyclictest26-21ksoftirqd/110:34:231
27760995834,9cyclictest26-21ksoftirqd/110:14:131
27760995834,9cyclictest26-21ksoftirqd/107:49:001
27760995833,9cyclictest26-21ksoftirqd/112:22:251
27748995839,13cyclictest5989-21grep10:35:480
27748995835,9cyclictest14-21ksoftirqd/011:28:240
27748995835,17cyclictest14-21ksoftirqd/009:44:430
27748995833,9cyclictest14-21ksoftirqd/010:57:470
27760995735,8cyclictest26-21ksoftirqd/107:40:431
27760995734,9cyclictest26-21ksoftirqd/108:14:001
27760995733,9cyclictest26-21ksoftirqd/110:08:261
27760995733,9cyclictest26-21ksoftirqd/108:40:451
27760995733,9cyclictest26-21ksoftirqd/108:39:151
27760995733,9cyclictest26-21ksoftirqd/107:21:431
27760995733,8cyclictest26-21ksoftirqd/112:15:571
27760995729,22cyclictest255-21systemd-journal10:30:001
27748995734,9cyclictest14-21ksoftirqd/009:19:130
27748995733,9cyclictest14-21ksoftirqd/012:35:360
27748995733,9cyclictest14-21ksoftirqd/012:28:150
27748995733,9cyclictest14-21ksoftirqd/011:42:400
27748995733,9cyclictest14-21ksoftirqd/007:29:230
27748995733,18cyclictest467-21dbus-daemon09:39:000
2774899572,50cyclictest13417-21ntpq07:55:420
2776099564,46cyclictest467-21dbus-daemon08:25:001
27760995634,9cyclictest26-21ksoftirqd/111:55:551
27760995633,9cyclictest26-21ksoftirqd/109:33:501
27760995633,8cyclictest26-21ksoftirqd/110:05:021
27760995627,23cyclictest19703-21aten2.4-expect09:45:251
27760995610,6cyclictest151rcu_preempt12:09:041
2774899568,16cyclictest0-21swapper/008:00:230
27748995633,9cyclictest14-21ksoftirqd/011:38:250
27748995633,9cyclictest14-21ksoftirqd/011:31:230
27748995633,8cyclictest14-21ksoftirqd/011:04:020
27748995632,8cyclictest14-21ksoftirqd/009:09:370
27748995632,8cyclictest14-21ksoftirqd/007:52:210
27748995629,21cyclictest255-21systemd-journal10:04:040
2774899562,49cyclictest22124-21grep11:20:450
2776099554,20cyclictest1818-21dpkg08:55:021
27760995533,8cyclictest26-21ksoftirqd/107:11:141
27760995533,8cyclictest26-21ksoftirqd/107:11:141
27760995532,9cyclictest26-21ksoftirqd/110:47:191
27760995532,9cyclictest26-21ksoftirqd/107:58:321
27760995531,9cyclictest26-21ksoftirqd/111:10:011
27760995531,9cyclictest26-21ksoftirqd/111:10:001
27760995531,9cyclictest26-21ksoftirqd/108:59:071
27760995531,8cyclictest26-21ksoftirqd/108:45:031
27760995530,9cyclictest26-21ksoftirqd/109:55:521
27760995530,19cyclictest510-21snmpd09:35:321
27748995533,16cyclictest14-21ksoftirqd/010:05:200
27748995531,9cyclictest14-21ksoftirqd/008:46:300
27748995530,9cyclictest14-21ksoftirqd/007:15:420
2776099548,39cyclictest4282-21apt-config12:05:031
2776099548,39cyclictest4282-21apt-config12:05:021
27760995431,9cyclictest26-21ksoftirqd/110:39:061
27760995431,9cyclictest26-21ksoftirqd/109:44:591
27760995431,9cyclictest26-21ksoftirqd/107:27:231
27760995430,9cyclictest26-21ksoftirqd/111:51:461
27760995430,9cyclictest26-21ksoftirqd/108:33:111
27760995430,9cyclictest26-21ksoftirqd/107:18:401
27760995429,20cyclictest510-21snmpd11:30:301
2774899545,24cyclictest14-21ksoftirqd/007:49:110
2774899543,45cyclictest17542-21sed08:05:470
27748995430,9cyclictest14-21ksoftirqd/010:21:580
27748995426,17cyclictest0-21swapper/007:20:220
27748995426,16cyclictest0-21swapper/012:15:240
2774899542,47cyclictest560-21runrttasks08:51:540
2774899542,16cyclictest21968-21latency_hist08:20:010
27760995330,9cyclictest26-21ksoftirqd/111:18:511
27760995330,9cyclictest26-21ksoftirqd/109:13:041
27760995330,17cyclictest8306-21cron10:44:591
27760995329,9cyclictest26-21ksoftirqd/110:18:451
2774899535,9cyclictest0-21swapper/007:10:260
2774899535,9cyclictest0-21swapper/007:10:260
27760995229,9cyclictest26-21ksoftirqd/108:29:441
27760995228,9cyclictest26-21ksoftirqd/109:23:471
2774899526,41cyclictest0-21swapper/010:45:390
2774899524,43cyclictest0-21swapper/009:50:280
2774899523,13cyclictest2222-21ntp_states10:25:420
27748995227,17cyclictest14-21ksoftirqd/011:15:210
27760995128,8cyclictest26-21ksoftirqd/111:48:591
27760995128,17cyclictest29120-21grep11:40:491
27760995127,9cyclictest26-21ksoftirqd/112:27:471
27760995127,18cyclictest467-21dbus-daemon07:30:061
27760995024,20cyclictest255-21systemd-journal09:05:001
2776099496,10cyclictest0-21swapper/111:15:021
27760994925,9cyclictest26-21ksoftirqd/110:59:261
27760994924,9cyclictest26-21ksoftirqd/111:26:451
27760994832,11cyclictest0-21swapper/111:20:371
27760994629,11cyclictest0-21swapper/108:05:011
27760994622,18cyclictest467-21dbus-daemon12:39:011
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional