You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-21 - 22:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot3.osadl.org (updated Sun Jul 21, 2024 12:46:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8255912020,6ptp4l401ktimersoftd/307:05:223
3236521850,7sleep2470299cyclictest07:15:432
3236521850,7sleep2470299cyclictest07:15:422
3237021640,8sleep3470399cyclictest08:36:273
2950721540,6sleep1470199cyclictest09:40:211
2092021300,8sleep0470099cyclictest07:11:230
2181321240,4sleep121821-21spawn07:12:531
470399776,13cyclictest10151-21grep07:17:553
470399776,13cyclictest10151-21grep07:17:543
4700997661,8cyclictest9-21ksoftirqd/009:00:100
4700997661,8cyclictest9-21ksoftirqd/009:00:100
4700997561,8cyclictest9-21ksoftirqd/011:00:160
163292730,5sleep216335-21spawn07:11:292
94382720,6sleep19411-21sh07:15:541
94382720,6sleep19411-21sh07:15:541
470399694,12cyclictest17009-21od07:21:023
4700996856,6cyclictest9-21ksoftirqd/012:15:090
178982680,8sleep2470299cyclictest08:05:312
59962660,4sleep05997-21hwlatdetect10:00:150
4700996654,6cyclictest9-21ksoftirqd/011:15:120
470399654,12cyclictest16058-21apt-key08:05:013
470399654,11cyclictest4010-21sed12:10:313
4700996553,6cyclictest9-21ksoftirqd/007:50:100
240822650,3sleep0470099cyclictest07:15:330
240822650,3sleep0470099cyclictest07:15:320
172872620,3sleep10-21swapper/108:05:221
4700996151,5cyclictest9-21ksoftirqd/011:05:110
4700996049,6cyclictest9-21ksoftirqd/008:45:100
4700995947,6cyclictest9-21ksoftirqd/008:35:170
4700995923,4cyclictest9-21ksoftirqd/007:20:280
4700995822,4cyclictest9-21ksoftirqd/012:05:000
79502570,6sleep37967-21spawn07:11:583
57698570,14rtkit-daemon0-21swapper/009:40:320
92442560,3sleep1470199cyclictest11:15:191
4700995643,7cyclictest9-21ksoftirqd/008:50:120
4700995522,4cyclictest9-21ksoftirqd/010:55:220
825591540,1ptp4l391rcuc/308:44:383
4700995447,4cyclictest26290-21turbostat.cron10:45:010
4700995442,6cyclictest9-21ksoftirqd/010:50:090
4700995441,7cyclictest9-21ksoftirqd/011:45:120
57698530,10rtkit-daemon0-21swapper/008:16:590
4700995342,6cyclictest9-21ksoftirqd/007:55:110
825591510,2ptp4l22945-21ls09:25:253
4700995140,6cyclictest9-21ksoftirqd/007:25:100
4700995136,5cyclictest9-21ksoftirqd/009:05:150
4700995115,9cyclictest9-21ksoftirqd/011:20:260
4700995044,4cyclictest9-21ksoftirqd/012:35:010
4700995043,4cyclictest9-21ksoftirqd/011:10:110
4700995043,4cyclictest9-21ksoftirqd/009:35:000
470199493,24cyclictest18373-21df_abs11:35:201
4700994944,3cyclictest9-21ksoftirqd/009:00:000
4700994941,4cyclictest9-21ksoftirqd/010:05:330
4700994917,4cyclictest9-21ksoftirqd/012:25:270
30782490,2sleep13082-21tr08:45:121
4700994842,3cyclictest9-21ksoftirqd/007:35:000
4700994839,5cyclictest9-21ksoftirqd/009:35:300
4700994814,5cyclictest9-21ksoftirqd/010:30:170
4700994741,4cyclictest9-21ksoftirqd/008:24:590
4700994741,3cyclictest9-21ksoftirqd/012:25:000
4700994741,3cyclictest9-21ksoftirqd/008:45:010
4700994741,3cyclictest9-21ksoftirqd/007:50:010
4700994740,4cyclictest9-21ksoftirqd/008:05:000
4700994740,4cyclictest9-21ksoftirqd/007:45:000
4700994732,7cyclictest9-21ksoftirqd/011:30:290
4700994715,4cyclictest9-21ksoftirqd/011:35:270
4700994714,4cyclictest9-21ksoftirqd/011:40:250
4700994712,6cyclictest9-21ksoftirqd/008:05:180
470099469,6cyclictest9-21ksoftirqd/009:25:100
470099465,8cyclictest9-21ksoftirqd/009:18:430
4700994641,3cyclictest9-21ksoftirqd/010:40:000
4700994640,4cyclictest9-21ksoftirqd/009:50:000
4700994640,3cyclictest9-21ksoftirqd/012:15:010
4700994639,4cyclictest9-21ksoftirqd/011:55:130
4700994638,4cyclictest9-21ksoftirqd/009:15:000
4700994632,6cyclictest9-21ksoftirqd/012:35:160
4700994629,7cyclictest9-21ksoftirqd/010:25:000
57698450,8rtkit-daemon575-21rtkit-daemon07:08:042
4700994539,4cyclictest9-21ksoftirqd/010:20:000
4700994538,4cyclictest9-21ksoftirqd/010:00:000
4700994538,4cyclictest9-21ksoftirqd/009:50:200
4700994538,4cyclictest9-21ksoftirqd/007:35:330
4700994538,4cyclictest15235-21cron11:29:590
4700994438,3cyclictest9-21ksoftirqd/011:55:000
4700994411,4cyclictest9-21ksoftirqd/008:30:120
279032440,6sleep227919-21sh07:21:232
20302445,23sleep12117-21/usr/sbin/munin07:05:131
4701994326,14cyclictest25-21ksoftirqd/109:56:141
4700994338,3cyclictest9-21ksoftirqd/009:25:000
4700994336,4cyclictest9-21ksoftirqd/012:05:280
4700994336,4cyclictest9-21ksoftirqd/010:45:170
470199423,33cyclictest6045-21apt-get11:10:111
4700994237,3cyclictest9-21ksoftirqd/010:25:110
4700994237,3cyclictest9-21ksoftirqd/010:15:000
4700994235,4cyclictest9-21ksoftirqd/008:25:310
4700994235,3cyclictest9-21ksoftirqd/008:10:180
24702413,23sleep02479-21/usr/sbin/munin07:05:160
4702993933,4cyclictest33-21ksoftirqd/210:00:002
4702993933,4cyclictest33-21ksoftirqd/209:11:262
4701993933,4cyclictest25-21ksoftirqd/109:36:271
470199393,29cyclictest17259-21apt-get10:25:111
470199393,28cyclictest28894-21apt-get10:50:091
4701993932,4cyclictest25-21ksoftirqd/111:55:491
4701993931,5cyclictest25-21ksoftirqd/112:18:111
470199392,30cyclictest11601-21apt-get07:55:121
4702993831,4cyclictest33-21ksoftirqd/212:09:022
4702993831,4cyclictest33-21ksoftirqd/209:00:282
4702993831,4cyclictest33-21ksoftirqd/209:00:272
4702993831,4cyclictest33-21ksoftirqd/208:20:122
470199384,27cyclictest9905-21apt-get09:00:111
470199384,27cyclictest9905-21apt-get09:00:101
470199383,27cyclictest3723-21apt-get11:05:111
4701993831,4cyclictest25-21ksoftirqd/112:05:151
4701993831,4cyclictest25-21ksoftirqd/109:12:311
4701993830,5cyclictest25-21ksoftirqd/111:23:071
470199382,30cyclictest9289-21apt-get07:50:101
470199382,30cyclictest5444-21apt-get10:00:101
8259913729,4phc2sys41-21ksoftirqd/309:42:113
825591370,5ptp4l575-21rtkit-daemon07:35:513
4703993730,4cyclictest41-21ksoftirqd/311:29:593
470199378,25cyclictest25079-21sh07:20:161
470199373,27cyclictest22979-21apt-get11:45:111
4701993730,4cyclictest25-21ksoftirqd/111:41:421
4701993730,4cyclictest25-21ksoftirqd/110:39:151
4701993730,4cyclictest25-21ksoftirqd/108:53:481
470199372,28cyclictest30642-21apt-get08:35:181
470199372,28cyclictest1351-21apt-get11:00:161
4701993714,20cyclictest8345-21sed08:55:201
4701993714,20cyclictest20199-21sed09:20:251
470199370,4cyclictest15587-21/usr/sbin/munin12:35:301
57698360,2rtkit-daemon575-21rtkit-daemon10:34:222
4703993630,4cyclictest41-21ksoftirqd/310:03:593
4703993630,4cyclictest41-21ksoftirqd/308:29:213
4703993629,4cyclictest41-21ksoftirqd/312:30:133
4703993629,4cyclictest41-21ksoftirqd/312:17:583
4702993630,3cyclictest33-21ksoftirqd/212:03:252
4702993630,3cyclictest33-21ksoftirqd/209:29:322
4702993630,3cyclictest33-21ksoftirqd/208:10:032
4702993630,3cyclictest33-21ksoftirqd/207:26:142
4702993630,3cyclictest13494-21kworker/2:108:20:002
4702993629,4cyclictest33-21ksoftirqd/212:35:002
4702993629,4cyclictest33-21ksoftirqd/211:42:062
4702993629,4cyclictest33-21ksoftirqd/211:23:282
4702993629,4cyclictest33-21ksoftirqd/210:56:502
4702993629,4cyclictest33-21ksoftirqd/209:46:502
4702993629,4cyclictest33-21ksoftirqd/209:07:542
4702993629,4cyclictest33-21ksoftirqd/207:35:582
470299361,3cyclictest121rcu_preempt08:55:262
470199368,25cyclictest21827-21irqrtprio08:15:201
4701993630,3cyclictest25-21ksoftirqd/111:34:261
4701993630,3cyclictest25-21ksoftirqd/111:25:111
4701993629,4cyclictest25-21ksoftirqd/112:34:401
4701993629,4cyclictest25-21ksoftirqd/112:29:351
4701993629,4cyclictest25-21ksoftirqd/110:49:021
4701993629,4cyclictest25-21ksoftirqd/107:25:151
470199360,5cyclictest30938-21uname12:00:231
4703993530,3cyclictest41-21ksoftirqd/308:47:273
4703993529,4cyclictest41-21ksoftirqd/308:23:273
4703993529,4cyclictest41-21ksoftirqd/307:32:203
4703993529,3cyclictest41-21ksoftirqd/311:24:533
4703993529,3cyclictest41-21ksoftirqd/311:11:043
4703993528,4cyclictest41-21ksoftirqd/310:37:563
4703993528,4cyclictest41-21ksoftirqd/309:22:133
4703993528,4cyclictest41-21ksoftirqd/308:56:063
4702993529,4cyclictest33-21ksoftirqd/211:18:302
4702993529,3cyclictest33-21ksoftirqd/211:14:262
4702993529,3cyclictest33-21ksoftirqd/208:32:112
4702993528,4cyclictest33-21ksoftirqd/209:15:052
4702993528,4cyclictest33-21ksoftirqd/207:59:162
4701993528,4cyclictest25-21ksoftirqd/110:59:141
4701993528,4cyclictest25-21ksoftirqd/110:40:021
4701993528,4cyclictest25-21ksoftirqd/108:40:551
4701993528,4cyclictest25-21ksoftirqd/107:34:071
470199352,26cyclictest10078-21apt-get10:10:091
4701993514,18cyclictest24281-21fschecks_count09:30:151
4701993513,19cyclictest13005-21cut09:05:201
470199350,5cyclictest7685-21/usr/sbin/munin10:05:141
470199350,5cyclictest7472-21df_abs12:20:151
470199350,4cyclictest16772-21/usr/sbin/munin09:15:261
470199350,2cyclictest0-21swapper/108:10:181
8259913426,4phc2sys41-21ksoftirqd/307:50:153
57698340,2rtkit-daemon575-21rtkit-daemon11:03:142
4703993428,4cyclictest41-21ksoftirqd/312:09:173
4703993428,4cyclictest41-21ksoftirqd/309:36:493
4703993428,4cyclictest41-21ksoftirqd/309:05:003
4703993428,4cyclictest41-21ksoftirqd/309:05:003
4703993428,3cyclictest41-21ksoftirqd/308:54:003
4703993427,4cyclictest41-21ksoftirqd/311:39:103
4703993427,4cyclictest41-21ksoftirqd/310:48:413
4703993427,4cyclictest41-21ksoftirqd/310:20:053
4703993427,4cyclictest41-21ksoftirqd/308:16:273
4702993429,3cyclictest33-21ksoftirqd/212:15:132
4702993428,3cyclictest33-21ksoftirqd/211:28:392
4702993427,4cyclictest33-21ksoftirqd/212:21:122
470199344,27cyclictest2355-21gnome-shell08:25:251
4701993427,4cyclictest25-21ksoftirqd/109:50:451
4701993427,4cyclictest25-21ksoftirqd/108:22:361
470199340,5cyclictest13700-21sensors_temp10:15:261
470199340,2cyclictest0-21swapper/108:30:111
470199340,2cyclictest0-21swapper/108:00:181
470199340,11cyclictest159262ptp4l10:20:271
470399335,7cyclictest57698rtkit-daemon10:40:273
4703993328,3cyclictest41-21ksoftirqd/307:27:273
4703993327,4cyclictest41-21ksoftirqd/308:06:403
4703993327,3cyclictest41-21ksoftirqd/311:15:023
4703993326,4cyclictest41-21ksoftirqd/312:24:313
4702993327,4cyclictest33-21ksoftirqd/212:25:472
4702993327,4cyclictest33-21ksoftirqd/208:49:142
4702993327,4cyclictest33-21ksoftirqd/208:40:442
4702993327,4cyclictest33-21ksoftirqd/208:01:292
4702993327,3cyclictest33-21ksoftirqd/211:33:412
4702993327,3cyclictest33-21ksoftirqd/209:54:242
4702993327,3cyclictest33-21ksoftirqd/209:32:382
4702993327,3cyclictest33-21ksoftirqd/207:34:022
4702993326,4cyclictest33-21ksoftirqd/212:39:482
4702993326,4cyclictest33-21ksoftirqd/209:40:062
470199336,24cyclictest2975-21hwlatdetect12:10:161
4701993327,3cyclictest25-21ksoftirqd/110:33:101
4701993326,4cyclictest25-21ksoftirqd/109:29:251
4701993325,5cyclictest25-21ksoftirqd/107:39:081
470199330,4cyclictest8518-21ls07:45:301
470199330,2cyclictest0-21swapper/109:45:271
470199330,2cyclictest0-21swapper/107:40:231
4703993225,4cyclictest41-21ksoftirqd/311:08:103
4703993225,4cyclictest41-21ksoftirqd/309:16:353
4703993225,4cyclictest41-21ksoftirqd/309:10:443
4703993225,4cyclictest41-21ksoftirqd/307:56:123
4702993226,4cyclictest33-21ksoftirqd/211:37:502
4702993226,4cyclictest33-21ksoftirqd/211:06:312
4702993226,4cyclictest33-21ksoftirqd/210:02:142
4702993226,4cyclictest33-21ksoftirqd/208:39:032
4702993226,3cyclictest33-21ksoftirqd/211:45:232
4702993226,3cyclictest33-21ksoftirqd/209:35:382
4702993225,4cyclictest33-21ksoftirqd/212:14:422
4702993225,4cyclictest33-21ksoftirqd/208:50:432
4702993225,4cyclictest33-21ksoftirqd/207:55:002
470199320,2cyclictest0-21swapper/111:50:101
825591310,4ptp4l391rcuc/310:05:173
825391310,2getstats0-21swapper/312:28:303
4703993125,4cyclictest41-21ksoftirqd/308:33:063
4703993125,4cyclictest41-21ksoftirqd/308:11:303
4703993124,4cyclictest41-21ksoftirqd/311:53:323
4703993124,4cyclictest41-21ksoftirqd/310:30:043
4703993124,4cyclictest41-21ksoftirqd/310:18:533
4703993124,4cyclictest41-21ksoftirqd/309:45:523
4703993124,4cyclictest41-21ksoftirqd/307:48:303
4702993126,3cyclictest33-21ksoftirqd/211:55:302
4702993125,4cyclictest33-21ksoftirqd/210:49:132
4702993125,4cyclictest33-21ksoftirqd/207:49:272
4702993125,3cyclictest33-21ksoftirqd/210:20:072
4703993024,4cyclictest41-21ksoftirqd/312:01:263
4703993023,4cyclictest41-21ksoftirqd/312:38:133
4703993023,4cyclictest41-21ksoftirqd/311:56:223
4702993025,3cyclictest33-21ksoftirqd/207:42:582
4702993023,4cyclictest33-21ksoftirqd/210:14:342
4703992924,3cyclictest41-21ksoftirqd/311:33:053
4703992923,4cyclictest41-21ksoftirqd/307:42:353
4703992923,3cyclictest41-21ksoftirqd/311:42:463
4702992923,4cyclictest33-21ksoftirqd/210:40:002
4702992922,5cyclictest33-21ksoftirqd/210:15:232
4702992922,4cyclictest33-21ksoftirqd/209:21:402
4702992921,6cyclictest33-21ksoftirqd/210:25:122
4702992822,4cyclictest33-21ksoftirqd/210:06:402
4702992821,4cyclictest33-21ksoftirqd/210:41:452
4703992720,4cyclictest41-21ksoftirqd/309:34:163
4702992721,3cyclictest33-21ksoftirqd/211:51:332
825591260,1ptp4l401ktimersoftd/309:50:133
4703992620,4cyclictest41-21ksoftirqd/309:56:173
4703992620,4cyclictest41-21ksoftirqd/309:08:383
4703992620,3cyclictest41-21ksoftirqd/311:00:163
4702992620,3cyclictest33-21ksoftirqd/210:51:202
825591250,1ptp4l401ktimersoftd/310:10:273
4703992519,4cyclictest41-21ksoftirqd/310:29:543
4703992519,3cyclictest41-21ksoftirqd/311:47:553
825591240,1ptp4l401ktimersoftd/310:55:113
825591240,1ptp4l401ktimersoftd/310:50:153
4702991912,4cyclictest26280-21expr08:25:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional