You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 19:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot4.osadl.org (updated Sun Apr 28, 2024 12:46:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1906721740,6sleep11871799cyclictest09:35:011
1299911150,87ptp4l401ktimersoftd/307:06:083
18357211291,10sleep20-21swapper/207:09:092
1299911030,2ptp4l23802-21ls12:00:233
1829628361,10sleep00-21swapper/007:08:210
1834128160,9sleep10-21swapper/107:08:551
18716997967,7cyclictest9-21ksoftirqd/008:45:130
18718997164,4cyclictest33-21ksoftirqd/209:25:132
18718997163,5cyclictest33-21ksoftirqd/208:35:122
52332700,8sleep21871899cyclictest09:05:142
18716997035,6cyclictest9-21ksoftirqd/009:25:200
18716996935,6cyclictest9-21ksoftirqd/009:00:300
18716996935,4cyclictest9-21ksoftirqd/007:40:320
18716996927,7cyclictest9-21ksoftirqd/008:15:180
18716996860,5cyclictest9-21ksoftirqd/012:30:050
18716996860,5cyclictest9-21ksoftirqd/012:30:040
18716996834,4cyclictest9-21ksoftirqd/009:20:270
18716996832,4cyclictest9-21ksoftirqd/008:14:170
18716996759,5cyclictest9-21ksoftirqd/009:15:040
18716996730,5cyclictest9-21ksoftirqd/011:50:250
18716996725,7cyclictest9-21ksoftirqd/007:15:140
18718996657,5cyclictest33-21ksoftirqd/209:35:132
18716996631,4cyclictest9-21ksoftirqd/008:58:430
18716996628,5cyclictest9-21ksoftirqd/009:05:290
18718996556,5cyclictest33-21ksoftirqd/211:05:122
18718996556,5cyclictest33-21ksoftirqd/211:05:112
18718996456,4cyclictest33-21ksoftirqd/211:50:102
18718996455,5cyclictest33-21ksoftirqd/211:00:102
18718996455,5cyclictest33-21ksoftirqd/210:40:132
18716996423,7cyclictest9-21ksoftirqd/008:35:230
129991640,2ptp4l401ktimersoftd/310:10:083
18718996353,6cyclictest33-21ksoftirqd/211:10:102
18718996253,5cyclictest33-21ksoftirqd/210:10:082
18716996227,7cyclictest9-21ksoftirqd/007:55:150
18716996210,4cyclictest9-21ksoftirqd/012:35:180
129991620,4ptp4l401ktimersoftd/307:10:013
18718996151,5cyclictest33-21ksoftirqd/208:15:122
18716996125,4cyclictest9-21ksoftirqd/009:36:030
18716996124,6cyclictest9-21ksoftirqd/009:40:340
18716996124,6cyclictest9-21ksoftirqd/009:40:340
18718996051,5cyclictest33-21ksoftirqd/208:00:122
18716996027,7cyclictest9-21ksoftirqd/011:00:270
18716996022,5cyclictest9-21ksoftirqd/007:10:110
18716995953,4cyclictest9-21ksoftirqd/011:45:060
18716995946,3cyclictest9-21ksoftirqd/012:15:330
18716995946,3cyclictest9-21ksoftirqd/008:40:340
18718995847,7cyclictest33-21ksoftirqd/210:45:112
1871699588,4cyclictest9-21ksoftirqd/010:10:210
1871699587,7cyclictest9-21ksoftirqd/011:30:200
124991580,8getstats1871999cyclictest07:49:193
1871699577,7cyclictest9-21ksoftirqd/007:25:100
18716995751,4cyclictest9-21ksoftirqd/007:39:590
18716995721,5cyclictest9-21ksoftirqd/011:05:120
18716995721,5cyclictest9-21ksoftirqd/011:05:110
18716995720,6cyclictest9-21ksoftirqd/010:55:180
1871699569,4cyclictest9-21ksoftirqd/007:31:400
1871699567,3cyclictest9-21ksoftirqd/010:25:260
1871699566,8cyclictest121rcu_preempt11:10:330
1871699565,5cyclictest9-21ksoftirqd/010:15:250
18716995650,3cyclictest9-21ksoftirqd/012:25:000
18716995649,4cyclictest9-21ksoftirqd/012:15:000
18716995618,7cyclictest9-21ksoftirqd/010:01:360
18716995618,7cyclictest9-21ksoftirqd/007:45:230
18718995536,9cyclictest33-21ksoftirqd/212:05:332
1871699558,3cyclictest9-21ksoftirqd/010:21:440
1871699556,3cyclictest9-21ksoftirqd/012:00:160
18716995549,4cyclictest9-21ksoftirqd/012:30:010
18716995549,4cyclictest9-21ksoftirqd/012:30:000
1871699553,7cyclictest9-21ksoftirqd/010:54:590
18716995527,7cyclictest9-21ksoftirqd/010:30:100
129991550,1ptp4l391rcuc/312:36:203
18718995410,7cyclictest33-21ksoftirqd/210:30:182
1871699547,7cyclictest9-21ksoftirqd/010:35:190
18716995449,3cyclictest9-21ksoftirqd/009:50:010
18716995449,3cyclictest9-21ksoftirqd/009:50:000
18716995448,3cyclictest9-21ksoftirqd/009:30:310
18716995447,4cyclictest9-21ksoftirqd/011:20:000
18716995447,4cyclictest9-21ksoftirqd/010:05:120
18716995447,4cyclictest9-21ksoftirqd/008:05:000
18716995441,4cyclictest9-21ksoftirqd/012:05:210
18716995437,9cyclictest9-21ksoftirqd/009:55:170
18716995435,8cyclictest9-21ksoftirqd/010:45:000
1871699542,6cyclictest15106-21basename11:45:000
1871699541,4cyclictest9-21ksoftirqd/011:20:120
1871699540,3cyclictest9-21ksoftirqd/012:00:000
18718995347,3cyclictest33-21ksoftirqd/207:35:012
18718995346,4cyclictest7500-21cron10:20:002
1871699537,7cyclictest9-21ksoftirqd/008:30:210
1871699534,7cyclictest9-21ksoftirqd/011:25:120
18716995346,4cyclictest9-21ksoftirqd/008:55:010
1871699531,8cyclictest9-21ksoftirqd/009:50:220
1871699530,3cyclictest121rcu_preempt11:35:250
18718995243,6cyclictest33-21ksoftirqd/209:55:082
18716995245,4cyclictest9-21ksoftirqd/008:25:010
1871699524,3cyclictest9-21ksoftirqd/010:45:280
18718995145,3cyclictest33-21ksoftirqd/210:30:012
18718995145,3cyclictest33-21ksoftirqd/207:40:002
18718995144,4cyclictest33-21ksoftirqd/209:25:002
18718995143,4cyclictest33-21ksoftirqd/208:50:122
18718995139,7cyclictest33-21ksoftirqd/209:15:122
18716995146,3cyclictest9-21ksoftirqd/007:50:110
18716995144,4cyclictest9-21ksoftirqd/009:10:210
1871699511,4cyclictest9-21ksoftirqd/008:05:150
129991510,1ptp4l401ktimersoftd/309:20:223
18718995043,4cyclictest33-21ksoftirqd/212:00:012
18718995043,4cyclictest33-21ksoftirqd/211:20:002
18718995037,8cyclictest33-21ksoftirqd/209:30:122
1871899500,3cyclictest121rcu_preempt10:20:222
18718994944,3cyclictest33-21ksoftirqd/209:40:342
18718994944,3cyclictest33-21ksoftirqd/209:40:332
18718994943,3cyclictest33-21ksoftirqd/207:20:012
18716994943,4cyclictest9-21ksoftirqd/007:25:010
129991490,1ptp4l401ktimersoftd/308:52:113
18718994842,3cyclictest33-21ksoftirqd/211:45:012
18718994842,3cyclictest33-21ksoftirqd/209:15:012
18718994841,4cyclictest33-21ksoftirqd/210:40:002
18718994841,3cyclictest33-21ksoftirqd/211:35:002
18716994842,4cyclictest9-21ksoftirqd/008:30:000
129991480,1ptp4l401ktimersoftd/310:02:443
18718994741,3cyclictest33-21ksoftirqd/212:30:012
18718994741,3cyclictest33-21ksoftirqd/212:30:002
18718994741,3cyclictest33-21ksoftirqd/211:45:052
18718994734,11cyclictest33-21ksoftirqd/208:45:242
18718994538,4cyclictest33-21ksoftirqd/208:30:002
18718994538,3cyclictest33-21ksoftirqd/211:40:012
18718994537,5cyclictest33-21ksoftirqd/212:30:302
18718994537,5cyclictest33-21ksoftirqd/212:30:302
18718994439,3cyclictest33-21ksoftirqd/207:55:182
18718994437,4cyclictest33-21ksoftirqd/212:20:002
18718994437,4cyclictest33-21ksoftirqd/208:35:002
18718994433,6cyclictest33-21ksoftirqd/210:05:092
18717994426,15cyclictest25-21ksoftirqd/108:28:111
129991440,1ptp4l401ktimersoftd/310:50:343
129991440,11ptp4l401ktimersoftd/308:24:343
18718994338,3cyclictest33-21ksoftirqd/212:35:172
18718994338,3cyclictest33-21ksoftirqd/212:04:592
18718994336,4cyclictest33-21ksoftirqd/209:55:002
18717994334,5cyclictest25-21ksoftirqd/107:25:011
18719994235,4cyclictest41-21ksoftirqd/311:40:013
18718994237,3cyclictest33-21ksoftirqd/207:25:012
18718994236,4cyclictest33-21ksoftirqd/210:55:112
18718994236,4cyclictest33-21ksoftirqd/210:00:322
18718994235,4cyclictest33-21ksoftirqd/211:20:152
18718994235,4cyclictest33-21ksoftirqd/207:50:112
18718994235,4cyclictest33-21ksoftirqd/207:45:172
18717994225,14cyclictest25-21ksoftirqd/110:24:381
56498410,9rtkit-daemon0-21swapper/308:30:453
18718994136,3cyclictest33-21ksoftirqd/208:09:592
18718994136,3cyclictest33-21ksoftirqd/207:10:152
18718994135,4cyclictest33-21ksoftirqd/209:02:462
18718994135,3cyclictest33-21ksoftirqd/207:44:052
18718994134,4cyclictest33-21ksoftirqd/208:10:222
18718994133,5cyclictest33-21ksoftirqd/208:43:542
18717994134,4cyclictest25-21ksoftirqd/111:20:541
18717994134,4cyclictest25-21ksoftirqd/109:22:461
18717994134,4cyclictest25-21ksoftirqd/108:15:111
18719994034,4cyclictest41-21ksoftirqd/309:15:123
18719994034,3cyclictest41-21ksoftirqd/309:04:273
18719994033,4cyclictest41-21ksoftirqd/312:14:313
18719994033,4cyclictest41-21ksoftirqd/311:49:493
18719994033,4cyclictest41-21ksoftirqd/309:51:123
18718994035,3cyclictest33-21ksoftirqd/212:10:272
18718994034,4cyclictest33-21ksoftirqd/210:50:182
18718994034,3cyclictest33-21ksoftirqd/212:20:202
18718994034,3cyclictest33-21ksoftirqd/208:55:282
18718994033,4cyclictest33-21ksoftirqd/208:21:032
18717994034,3cyclictest25-21ksoftirqd/109:47:351
18717994034,3cyclictest25-21ksoftirqd/109:47:351
18717994033,4cyclictest25-21ksoftirqd/111:58:321
18717994016,21cyclictest30032-21sh08:50:011
16512400,2sleep10-21swapper/108:55:341
18719993932,4cyclictest41-21ksoftirqd/310:32:003
18719993932,4cyclictest41-21ksoftirqd/307:18:393
18718993932,4cyclictest33-21ksoftirqd/207:28:582
18717993933,4cyclictest25-21ksoftirqd/108:31:401
18717993932,4cyclictest25-21ksoftirqd/112:23:101
1871799392,7cyclictest21132-21apt-get07:15:101
18719993831,4cyclictest41-21ksoftirqd/311:19:133
18719993831,4cyclictest41-21ksoftirqd/309:10:413
18719993831,4cyclictest41-21ksoftirqd/308:12:123
18719993831,4cyclictest41-21ksoftirqd/307:52:403
18719993830,4cyclictest41-21ksoftirqd/311:24:303
18718993833,3cyclictest33-21ksoftirqd/209:45:152
18718993833,3cyclictest33-21ksoftirqd/209:45:142
18718993832,4cyclictest33-21ksoftirqd/211:25:192
1871799383,6cyclictest22811-21apt-get12:00:111
18717993832,3cyclictest25-21ksoftirqd/112:09:411
18717993831,4cyclictest25-21ksoftirqd/110:42:101
18717993831,4cyclictest25-21ksoftirqd/110:26:441
18717993831,4cyclictest25-21ksoftirqd/109:25:091
18717993831,4cyclictest25-21ksoftirqd/109:09:381
18717993831,4cyclictest25-21ksoftirqd/107:32:511
18717993831,4cyclictest25-21ksoftirqd/107:10:111
18717993830,5cyclictest25-21ksoftirqd/110:01:061
18717993830,5cyclictest25-21ksoftirqd/108:22:051
1871799382,6cyclictest2048-21apt-get12:25:111
1871799382,6cyclictest2048-21apt-get12:25:111
1871799382,6cyclictest0-21swapper/107:50:091
18717993813,22cyclictest25696-21expr08:40:121
18717993811,23cyclictest16943-21latency_hist10:40:001
18717993811,23cyclictest13448-21grep08:10:161
129991380,2ptp4l0-21swapper/307:39:563
18719993731,4cyclictest41-21ksoftirqd/308:08:553
18719993731,3cyclictest41-21ksoftirqd/311:55:393
18719993731,3cyclictest41-21ksoftirqd/309:07:233
18719993730,5cyclictest41-21ksoftirqd/310:41:033
18719993730,4cyclictest41-21ksoftirqd/311:01:023
18719993730,4cyclictest41-21ksoftirqd/310:07:073
18719993730,4cyclictest41-21ksoftirqd/309:29:523
1871799373,28cyclictest0-21swapper/109:00:121
18717993731,4cyclictest25-21ksoftirqd/111:16:271
18717993731,3cyclictest25-21ksoftirqd/111:27:281
18717993730,4cyclictest25-21ksoftirqd/112:13:071
18717993730,4cyclictest25-21ksoftirqd/111:37:421
18717993730,4cyclictest25-21ksoftirqd/111:04:531
18717993730,4cyclictest25-21ksoftirqd/110:33:221
18717993730,4cyclictest25-21ksoftirqd/109:56:231
18717993730,4cyclictest25-21ksoftirqd/108:09:361
18717993730,4cyclictest25-21ksoftirqd/108:03:471
18717993730,4cyclictest25-21ksoftirqd/107:45:401
18719993630,4cyclictest41-21ksoftirqd/311:40:103
18719993630,3cyclictest41-21ksoftirqd/310:46:023
18719993630,3cyclictest41-21ksoftirqd/309:57:533
18719993630,3cyclictest41-21ksoftirqd/307:41:113
18719993629,4cyclictest41-21ksoftirqd/310:56:583
18719993629,4cyclictest41-21ksoftirqd/308:42:153
18717993630,3cyclictest25-21ksoftirqd/109:17:371
18717993630,3cyclictest25-21ksoftirqd/108:53:261
18717993630,3cyclictest25-21ksoftirqd/107:56:421
18717993629,4cyclictest25-21ksoftirqd/111:49:391
18717993629,4cyclictest25-21ksoftirqd/109:38:331
18717993629,4cyclictest25-21ksoftirqd/107:37:501
18717993618,15cyclictest25-21ksoftirqd/110:16:041
18717993613,20cyclictest32426-21pluginstate07:40:291
18717993611,21cyclictest9415-21latency_hist09:15:001
129991360,1ptp4l401ktimersoftd/312:25:253
129991360,1ptp4l401ktimersoftd/312:25:243
129991360,1ptp4l401ktimersoftd/311:05:163
129991360,1ptp4l401ktimersoftd/311:05:153
18719993529,4cyclictest41-21ksoftirqd/312:31:283
18719993529,4cyclictest41-21ksoftirqd/312:31:273
18719993529,4cyclictest41-21ksoftirqd/312:24:463
18719993529,3cyclictest41-21ksoftirqd/312:05:403
18719993529,3cyclictest41-21ksoftirqd/308:39:233
18719993528,4cyclictest41-21ksoftirqd/311:29:103
18719993528,4cyclictest41-21ksoftirqd/311:12:263
18719993528,4cyclictest41-21ksoftirqd/308:29:543
1871799353,7cyclictest21850-21apt-get10:50:111
1871799353,27cyclictest0-21swapper/111:30:131
18717993529,4cyclictest25-21ksoftirqd/108:36:261
18717993528,4cyclictest25-21ksoftirqd/112:39:461
18717993528,4cyclictest25-21ksoftirqd/112:31:221
18717993528,4cyclictest25-21ksoftirqd/112:31:211
18717993528,4cyclictest25-21ksoftirqd/111:44:491
18717993528,4cyclictest25-21ksoftirqd/109:40:111
18717993528,4cyclictest25-21ksoftirqd/109:40:101
18717993527,5cyclictest25-21ksoftirqd/112:16:001
129991350,1ptp4l401ktimersoftd/308:55:303
129991350,1ptp4l401ktimersoftd/308:01:173
18719993427,4cyclictest41-21ksoftirqd/312:19:363
18719993427,4cyclictest41-21ksoftirqd/311:51:183
18719993427,4cyclictest41-21ksoftirqd/308:15:203
18719993427,4cyclictest41-21ksoftirqd/307:23:073
18717993413,18cyclictest1977-21ptp4l10:05:271
18717993411,20cyclictest25230-21open_files10:55:251
18717993411,19cyclictest31820-21iostat11:10:211
129991340,1ptp4l401ktimersoftd/310:21:053
129991340,1ptp4l401ktimersoftd/309:38:573
129991340,1ptp4l401ktimersoftd/307:33:433
18719993327,3cyclictest41-21ksoftirqd/311:34:233
1871799336,5cyclictest24583-21fschecks_time07:25:131
18717993327,4cyclictest25-21ksoftirqd/111:51:221
18717993327,4cyclictest25-21ksoftirqd/111:05:371
18717993327,4cyclictest25-21ksoftirqd/111:05:361
18717993326,4cyclictest25-21ksoftirqd/110:45:511
18717993326,4cyclictest25-21ksoftirqd/110:12:301
18719993226,3cyclictest41-21ksoftirqd/308:48:593
18719993225,4cyclictest41-21ksoftirqd/309:43:493
18719993225,4cyclictest41-21ksoftirqd/309:43:493
18719993124,4cyclictest41-21ksoftirqd/310:37:213
18719993124,4cyclictest41-21ksoftirqd/307:25:043
1871999310,3cyclictest121rcu_preempt10:25:193
18717993125,4cyclictest25-21ksoftirqd/109:50:211
18719993024,4cyclictest41-21ksoftirqd/309:33:463
18719993024,3cyclictest41-21ksoftirqd/307:56:373
18719992923,4cyclictest41-21ksoftirqd/310:16:313
18719992923,3cyclictest41-21ksoftirqd/309:48:523
18719992923,3cyclictest41-21ksoftirqd/309:48:513
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional