You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 18:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4.osadl.org (updated Thu Apr 25, 2024 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29802422332289,29sleep10-21swapper/107:08:431
29803602325283,28sleep00-21swapper/007:09:580
298051099230224,5cyclictest3127509-21kworker/u8:311:58:521
31414642550,6sleep10-21swapper/111:53:481
31005912550,4sleep03100594-21tail10:50:260
159199550,4rtkit-daemon1590-21rtkit-daemon11:06:461
159199530,4rtkit-daemon1590-21rtkit-daemon11:04:221
159199520,4rtkit-daemon1590-21rtkit-daemon12:17:341
159199520,4rtkit-daemon1590-21rtkit-daemon10:25:261
30794502500,4sleep126-21ksoftirqd/110:20:211
159199500,3rtkit-daemon0-21swapper/009:37:050
30817452450,1sleep00-21swapper/010:24:150
159199440,3rtkit-daemon0-21swapper/007:54:070
159199430,3rtkit-daemon0-21swapper/008:08:080
159199420,3rtkit-daemon0-21swapper/009:50:180
159199420,3rtkit-daemon0-21swapper/007:26:110
2980505994110,20cyclictest13-21ksoftirqd/010:10:300
159199410,3rtkit-daemon0-21swapper/112:10:510
159199410,3rtkit-daemon0-21swapper/010:04:360
159199410,3rtkit-daemon0-21swapper/007:58:350
298050599399,18cyclictest13-21ksoftirqd/011:10:270
2980505993910,18cyclictest13-21ksoftirqd/010:00:000
159199390,2rtkit-daemon0-21swapper/008:54:560
159199380,3rtkit-daemon0-21swapper/010:09:270
159199380,3rtkit-daemon0-21swapper/008:31:380
298050599377,19cyclictest13-21ksoftirqd/009:25:040
298050599377,19cyclictest13-21ksoftirqd/009:15:260
159199370,3rtkit-daemon0-21swapper/008:02:580
2980510993612,3cyclictest3164609-21date12:30:011
159199360,4rtkit-daemon1590-21rtkit-daemon09:27:411
2980505993518,3cyclictest3164398-21python312:30:010
159199350,4rtkit-daemon1590-21rtkit-daemon11:10:381
159199350,3rtkit-daemon0-21swapper/009:47:561
159199340,4rtkit-daemon1590-21rtkit-daemon11:18:331
298050599335,18cyclictest13-21ksoftirqd/009:40:280
159199330,4rtkit-daemon1590-21rtkit-daemon10:31:321
159199330,4rtkit-daemon1590-21rtkit-daemon07:10:460
298050599323,17cyclictest3155896-21ssh12:15:270
2980505993214,8cyclictest2985968-21pmu-power07:20:260
159199310,3rtkit-daemon1590-21rtkit-daemon09:23:321
2980510993016,12cyclictest3043774-21cnf-update-db09:30:021
298050599299,3cyclictest13-21ksoftirqd/010:15:150
2980505992916,8cyclictest63950irq/130-enp2s011:55:120
2980505992910,5cyclictest13-21ksoftirqd/011:40:000
31226762280,4sleep03122657-21packagekitd11:25:030
298050599287,4cyclictest3089663-21latency10:35:210
298050599281,6cyclictest3164989-21apt-get12:30:110
2980505992815,6cyclictest13-21ksoftirqd/010:29:160
159199280,1rtkit-daemon1590-21rtkit-daemon09:08:520
298051099275,3cyclictest3028861-21diskmemload12:38:331
298051099273,15cyclictest2997732-21apt-get07:50:111
298051099272,17cyclictest3001657-21apt-get08:00:141
2980510992720,5cyclictest26-21ksoftirqd/110:10:001
2980510992711,2cyclictest141rcu_preempt11:29:011
298050599278,8cyclictest13-21ksoftirqd/008:29:130
298050599278,6cyclictest13-21ksoftirqd/009:00:000
298050599277,8cyclictest13-21ksoftirqd/011:18:550
298050599277,7cyclictest13-21ksoftirqd/007:30:290
298050599277,6cyclictest13-21ksoftirqd/007:45:000
298050599273,3cyclictest141rcu_preempt12:20:160
2980505992714,11cyclictest13-21ksoftirqd/009:25:010
2980505992710,8cyclictest13-21ksoftirqd/011:48:150
2980510992613,8cyclictest3148607-21apt-get12:05:111
298050599268,8cyclictest809-21runrttasks11:05:340
298050599267,5cyclictest13-21ksoftirqd/010:55:260
298050599266,8cyclictest3141976-21date11:55:000
298050599260,8cyclictest2992325-21/usr/sbin/munin07:35:220
2980510992510,9cyclictest1687284-1kworker/u9:110:40:101
298050599256,7cyclictest13-21ksoftirqd/011:33:120
298050599255,6cyclictest13-21ksoftirqd/009:15:010
298050599251,7cyclictest3028861-21diskmemload12:39:360
2980505992510,4cyclictest3028861-21diskmemload10:44:290
298051099245,3cyclictest141rcu_preempt10:45:161
298051099242,15cyclictest2999680-21apt-get07:55:111
2980510992412,8cyclictest3030709-1kworker/u9:009:35:151
298051099240,4cyclictest3071551-21cnf-update-db10:10:021
298050599244,6cyclictest3025373-21df09:00:140
298050599242,14cyclictest3145349-21apt-get12:00:100
159199240,3rtkit-daemon0-21swapper/009:45:560
298051099235,10cyclictest3003599-21apt-get08:05:111
298051099233,11cyclictest3158154-21apt-get12:20:161
298051099233,10cyclictest3005552-21apt-get08:10:111
298051099232,15cyclictest3075347-21apt-get10:15:111
298051099232,15cyclictest3057703-21apt-get09:50:131
298050599239,4cyclictest3028861-21diskmemload10:46:290
298050599238,4cyclictest3028861-21diskmemload11:40:500
298050599238,11cyclictest3085664-21apt-get10:30:100
298050599235,4cyclictest3009783-21fschecks_time08:20:180
298050599235,4cyclictest3009783-21fschecks_time08:20:170
298050599234,8cyclictest13-21ksoftirqd/011:24:280
2980505992311,6cyclictest63950irq/130-enp2s009:30:130
159199230,3rtkit-daemon1590-21rtkit-daemon07:33:261
159199230,3rtkit-daemon0-21swapper/111:21:361
298051099229,8cyclictest3049459-1kworker/u9:212:10:131
298051099229,7cyclictest26-21ksoftirqd/107:10:111
298051099224,11cyclictest3007498-21apt-get08:15:111
298051099222,14cyclictest3135732-21apt-get11:45:131
298051099222,14cyclictest3089020-21apt-get10:35:131
298051099222,13cyclictest2995787-21apt-get07:45:141
2980510992214,6cyclictest3164399-21python312:30:021
298051099221,16cyclictest26-21ksoftirqd/108:55:121
298051099220,4cyclictest2995593-21awk07:44:591
298050599229,7cyclictest3019243-21apt-get08:45:120
2980505992219,2cyclictest3109296-21awk11:05:000
2980505992213,7cyclictest3008796-21users08:15:280
2980505992213,7cyclictest3005520-21seq08:10:020
159199220,3rtkit-daemon1590-21rtkit-daemon08:43:321
298051099213,11cyclictest3025163-21apt-get09:00:101
298051099213,11cyclictest3009475-21apt-get08:20:121
298051099213,11cyclictest3009475-21apt-get08:20:121
298051099213,10cyclictest3145349-21apt-get12:00:111
298051099212,13cyclictest3129213-21apt-get11:35:161
298051099212,13cyclictest3064613-21apt-get10:00:111
298051099212,13cyclictest2991729-21apt-get07:35:131
298051099212,12cyclictest3013371-21apt-get08:30:111
2980510992112,5cyclictest3028861-21diskmemload09:19:321
298051099211,14cyclictest3029133-21taskset09:10:131
298050599213,4cyclictest3019107-21latency_hist08:45:010
298050599212,11cyclictest3015329-21apt-get08:35:140
2980505992112,7cyclictest2996353-21sed07:45:210
298051099203,11cyclictest2985122-21apt-get07:20:121
298051099202,10cyclictest3022834-21apt-get08:53:481
298051099201,2cyclictest141rcu_preempt11:33:111
298051099201,16cyclictest3061103-21apt-get09:55:121
298051099201,13cyclictest2983147-21apt-get07:15:141
298051099200,18cyclictest3051014-21cat09:40:141
2980505992014,4cyclictest13-21ksoftirqd/012:05:250
298050599200,4cyclictest2982616-21awk07:15:010
2980510991911,6cyclictest3102192-21seq10:54:301
2980510991910,7cyclictest3020727-21seq08:47:171
2980510991814,3cyclictest3143951-21snmpd08:39:011
2980510991811,5cyclictest3028652-21seq09:07:541
2980510991811,5cyclictest2988763-21seq07:29:361
2980510991810,6cyclictest673-21dbus-daemon10:55:251
298051099172,9cyclictest3011421-21apt-get08:25:091
159199160,6rtkit-daemon3132371-21ssh11:40:071
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional