You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 02:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot2.osadl.org (updated Thu Apr 18, 2024 12:46:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
576981460,6rtkit-daemon27036-21apache207:05:341
1235911290,37ptp4l401ktimersoftd/307:05:503
217789910690,12cyclictest9-21ksoftirqd/010:20:110
217789910186,10cyclictest9-21ksoftirqd/011:25:110
21778999580,9cyclictest9-21ksoftirqd/009:15:140
21778999380,6cyclictest9-21ksoftirqd/011:05:090
21778999379,7cyclictest9-21ksoftirqd/012:05:110
21778999377,8cyclictest9-21ksoftirqd/011:15:130
21778999376,11cyclictest9-21ksoftirqd/012:15:120
21778999177,7cyclictest9-21ksoftirqd/008:55:100
21778999174,8cyclictest9-21ksoftirqd/008:45:120
21778998874,7cyclictest9-21ksoftirqd/011:00:110
21778998773,6cyclictest9-21ksoftirqd/011:50:100
21781998672,7cyclictest41-21ksoftirqd/308:40:123
21778998473,6cyclictest9-21ksoftirqd/011:35:140
21778998472,6cyclictest9-21ksoftirqd/010:05:100
21778998272,5cyclictest9-21ksoftirqd/007:15:120
21781998166,7cyclictest41-21ksoftirqd/310:55:123
21778998066,8cyclictest9-21ksoftirqd/010:00:130
21778997967,7cyclictest9-21ksoftirqd/010:40:130
21780997635,10cyclictest33-21ksoftirqd/209:29:592
21780997568,4cyclictest33-21ksoftirqd/208:00:112
21780997533,10cyclictest33-21ksoftirqd/211:35:242
21781997460,7cyclictest41-21ksoftirqd/312:30:113
21781997359,6cyclictest41-21ksoftirqd/308:10:123
21780997236,5cyclictest33-21ksoftirqd/212:25:232
21780997235,4cyclictest33-21ksoftirqd/208:25:192
21780997135,5cyclictest33-21ksoftirqd/207:10:262
21780997134,6cyclictest33-21ksoftirqd/207:15:272
21780997130,9cyclictest33-21ksoftirqd/210:45:262
21780997031,6cyclictest33-21ksoftirqd/210:40:222
21780997029,7cyclictest33-21ksoftirqd/211:30:142
21780996962,4cyclictest33-21ksoftirqd/207:35:152
21780996952,3cyclictest33-21ksoftirqd/211:20:272
21780996952,3cyclictest33-21ksoftirqd/211:20:272
21780996933,10cyclictest33-21ksoftirqd/207:50:172
21780996929,10cyclictest33-21ksoftirqd/208:55:282
2178099684,10cyclictest33-21ksoftirqd/208:20:012
21780996832,4cyclictest33-21ksoftirqd/207:55:182
21780996830,5cyclictest33-21ksoftirqd/212:05:282
21778996855,7cyclictest9-21ksoftirqd/012:35:130
21778996831,5cyclictest9-21ksoftirqd/011:55:150
21780996732,4cyclictest33-21ksoftirqd/210:50:112
21780996731,4cyclictest33-21ksoftirqd/211:25:322
2178099667,9cyclictest24728-21turbostat08:25:002
21780996631,6cyclictest33-21ksoftirqd/212:00:132
2178099662,9cyclictest33-21ksoftirqd/211:15:222
21780996629,6cyclictest33-21ksoftirqd/209:20:192
21780996628,11cyclictest33-21ksoftirqd/207:25:122
21778996660,4cyclictest9-21ksoftirqd/009:20:050
142162660,8sleep02177899cyclictest09:10:190
2178099656,9cyclictest33-21ksoftirqd/211:50:162
21780996528,11cyclictest33-21ksoftirqd/210:25:212
21778996558,4cyclictest9-21ksoftirqd/010:20:010
2178099644,8cyclictest13261-21apt09:10:002
21780996427,5cyclictest33-21ksoftirqd/207:20:182
21780996425,9cyclictest33-21ksoftirqd/209:15:152
2178099636,9cyclictest29975-21cron09:45:002
2178099635,9cyclictest33-21ksoftirqd/207:40:162
2178099632,8cyclictest33-21ksoftirqd/208:05:142
2178099631,9cyclictest33-21ksoftirqd/208:50:012
123591630,1ptp4l401ktimersoftd/307:28:493
2178099627,6cyclictest33-21ksoftirqd/209:35:292
2178099625,9cyclictest33-21ksoftirqd/212:15:152
2178099625,6cyclictest33-21ksoftirqd/209:45:182
2178099624,9cyclictest33-21ksoftirqd/207:45:132
2178099623,9cyclictest33-21ksoftirqd/211:55:312
2178099622,8cyclictest33-21ksoftirqd/211:45:152
2178099621,8cyclictest33-21ksoftirqd/210:15:242
2178099618,4cyclictest33-21ksoftirqd/208:40:302
2178099615,7cyclictest33-21ksoftirqd/209:00:282
2178099613,10cyclictest33-21ksoftirqd/210:10:152
2178099613,10cyclictest33-21ksoftirqd/208:30:292
2178099613,10cyclictest33-21ksoftirqd/208:30:292
2178099613,10cyclictest33-21ksoftirqd/207:30:162
2178099612,9cyclictest33-21ksoftirqd/212:30:232
21780996125,6cyclictest33-21ksoftirqd/208:35:222
21778996117,8cyclictest9-21ksoftirqd/008:05:000
2178099606,7cyclictest33-21ksoftirqd/209:50:172
2178099605,7cyclictest23394-21tr09:30:162
2178099605,10cyclictest33-21ksoftirqd/211:10:172
21780996026,5cyclictest33-21ksoftirqd/208:50:152
2178099600,8cyclictest33-21ksoftirqd/210:30:262
21778996052,4cyclictest9-21ksoftirqd/007:15:000
256622590,2sleep30-21swapper/309:35:103
21781995947,6cyclictest41-21ksoftirqd/309:20:103
2178099597,7cyclictest33-21ksoftirqd/211:00:172
2178099594,9cyclictest33-21ksoftirqd/210:00:012
2178099594,9cyclictest33-21ksoftirqd/210:00:012
2178099594,7cyclictest33-21ksoftirqd/212:20:332
21780995947,4cyclictest33-21ksoftirqd/210:20:252
2178099593,9cyclictest33-21ksoftirqd/211:45:012
123591590,1ptp4l401ktimersoftd/309:19:243
2178099586,8cyclictest33-21ksoftirqd/209:10:202
2178099585,7cyclictest33-21ksoftirqd/210:35:232
2178099583,7cyclictest33-21ksoftirqd/210:05:322
2178099582,4cyclictest121rcu_preempt08:10:272
2178099581,7cyclictest33-21ksoftirqd/210:55:162
21778995824,5cyclictest9-21ksoftirqd/012:30:150
21778995824,4cyclictest9-21ksoftirqd/008:05:160
21778995823,8cyclictest9-21ksoftirqd/010:55:000
2178099574,10cyclictest33-21ksoftirqd/212:10:122
2178099573,8cyclictest33-21ksoftirqd/211:05:242
21778995750,4cyclictest9-21ksoftirqd/008:20:000
21778995735,10cyclictest9-21ksoftirqd/008:40:000
21778995721,5cyclictest9-21ksoftirqd/009:00:200
2178099562,6cyclictest33-21ksoftirqd/210:00:192
21778995623,5cyclictest9-21ksoftirqd/012:20:220
21778995622,4cyclictest9-21ksoftirqd/010:25:320
21781995548,4cyclictest41-21ksoftirqd/307:20:003
21781995543,7cyclictest41-21ksoftirqd/309:30:133
21781995542,7cyclictest41-21ksoftirqd/309:10:113
21778995548,4cyclictest9-21ksoftirqd/011:45:230
21778995524,7cyclictest9-21ksoftirqd/010:55:140
21778995522,7cyclictest9-21ksoftirqd/009:50:290
21778995520,5cyclictest9-21ksoftirqd/009:45:170
21781995448,4cyclictest41-21ksoftirqd/310:30:013
2178099541,9cyclictest33-21ksoftirqd/212:35:162
21778995447,3cyclictest9-21ksoftirqd/012:30:000
21778995418,4cyclictest9-21ksoftirqd/012:00:260
21778995347,3cyclictest9-21ksoftirqd/007:40:010
21778995346,4cyclictest9-21ksoftirqd/008:45:010
21778995321,4cyclictest9-21ksoftirqd/011:10:140
21781995247,3cyclictest41-21ksoftirqd/312:30:003
21781995247,3cyclictest41-21ksoftirqd/308:35:003
21781995247,3cyclictest41-21ksoftirqd/308:34:593
21781995246,3cyclictest41-21ksoftirqd/307:54:593
21778995246,3cyclictest9-21ksoftirqd/009:10:000
21778995246,3cyclictest9-21ksoftirqd/007:45:000
21778995245,4cyclictest9-21ksoftirqd/007:50:120
21778995216,4cyclictest9-21ksoftirqd/008:20:130
21779995134,14cyclictest25-21ksoftirqd/112:04:311
21778995144,4cyclictest9-21ksoftirqd/010:00:000
21778995144,4cyclictest9-21ksoftirqd/010:00:000
21778995144,4cyclictest9-21ksoftirqd/009:40:120
21778995144,4cyclictest9-21ksoftirqd/008:50:170
21778995137,5cyclictest9-21ksoftirqd/010:30:230
21778995122,3cyclictest9-21ksoftirqd/008:30:180
21778995122,3cyclictest9-21ksoftirqd/008:30:180
21781995045,3cyclictest41-21ksoftirqd/310:20:013
21781995044,4cyclictest41-21ksoftirqd/307:45:003
21781995044,3cyclictest41-21ksoftirqd/308:30:003
21781995043,4cyclictest41-21ksoftirqd/310:05:203
21781995043,4cyclictest41-21ksoftirqd/307:40:003
21781995038,9cyclictest41-21ksoftirqd/309:05:283
21779995043,4cyclictest25-21ksoftirqd/110:40:011
21778995045,3cyclictest9-21ksoftirqd/010:40:010
21778995044,4cyclictest9-21ksoftirqd/011:30:170
21778995043,4cyclictest9-21ksoftirqd/011:20:320
21778995043,4cyclictest9-21ksoftirqd/011:20:320
21778995043,3cyclictest9-21ksoftirqd/010:49:590
21781994942,4cyclictest41-21ksoftirqd/311:50:153
21781994942,4cyclictest41-21ksoftirqd/311:20:003
21781994937,7cyclictest41-21ksoftirqd/311:30:113
21779994931,15cyclictest25-21ksoftirqd/112:22:501
21779994931,15cyclictest25-21ksoftirqd/111:06:061
21778994943,4cyclictest9-21ksoftirqd/010:10:200
21778994943,3cyclictest9-21ksoftirqd/009:30:000
21778994931,5cyclictest9-21ksoftirqd/008:00:000
21778994918,8cyclictest9-21ksoftirqd/008:30:000
21781994842,3cyclictest41-21ksoftirqd/311:55:153
21781994841,4cyclictest41-21ksoftirqd/307:35:003
21778994843,3cyclictest9-21ksoftirqd/008:10:260
21778994843,3cyclictest9-21ksoftirqd/007:30:240
21778994842,3cyclictest9-21ksoftirqd/009:39:590
21778994835,4cyclictest9-21ksoftirqd/007:45:130
21781994742,3cyclictest41-21ksoftirqd/309:05:003
21781994742,3cyclictest41-21ksoftirqd/307:25:013
21781994740,4cyclictest41-21ksoftirqd/311:25:003
21781994740,4cyclictest41-21ksoftirqd/311:25:003
21781994740,4cyclictest41-21ksoftirqd/307:15:003
21778994742,3cyclictest9-21ksoftirqd/007:25:010
21778994741,4cyclictest9-21ksoftirqd/011:40:090
21778994740,4cyclictest9-21ksoftirqd/007:25:190
21778994740,3cyclictest9-21ksoftirqd/012:10:290
21781994641,3cyclictest41-21ksoftirqd/311:40:013
21781994640,3cyclictest41-21ksoftirqd/308:50:163
21781994639,4cyclictest41-21ksoftirqd/308:35:323
21781994633,6cyclictest41-21ksoftirqd/308:19:303
21778994640,3cyclictest9-21ksoftirqd/009:30:160
2122424615,19sleep20-21swapper/207:06:352
21781994539,4cyclictest41-21ksoftirqd/310:35:003
21781994539,4cyclictest41-21ksoftirqd/308:09:593
21781994532,7cyclictest41-21ksoftirqd/312:00:103
21779994527,15cyclictest25-21ksoftirqd/110:33:061
2143824515,19sleep00-21swapper/007:09:230
123591450,1ptp4l401ktimersoftd/309:25:233
21781994439,3cyclictest41-21ksoftirqd/309:40:123
21781994438,4cyclictest41-21ksoftirqd/311:45:163
21781994438,3cyclictest41-21ksoftirqd/312:40:003
21781994438,3cyclictest41-21ksoftirqd/310:25:003
21781994437,4cyclictest41-21ksoftirqd/311:15:003
21781994425,9cyclictest41-21ksoftirqd/309:55:003
21779994424,17cyclictest25-21ksoftirqd/110:22:301
123591440,1ptp4l401ktimersoftd/311:07:503
21781994338,3cyclictest41-21ksoftirqd/308:00:293
21781994338,3cyclictest41-21ksoftirqd/307:50:013
21781994337,4cyclictest41-21ksoftirqd/312:15:223
21781994337,3cyclictest41-21ksoftirqd/312:20:173
21781994336,4cyclictest41-21ksoftirqd/311:00:313
21779994336,4cyclictest25-21ksoftirqd/111:52:581
21781994236,4cyclictest41-21ksoftirqd/307:55:193
21781994236,3cyclictest41-21ksoftirqd/310:00:153
21781994235,5cyclictest41-21ksoftirqd/310:10:233
21781994235,4cyclictest41-21ksoftirqd/310:45:193
21781994235,4cyclictest41-21ksoftirqd/310:45:003
21781994235,4cyclictest41-21ksoftirqd/309:45:143
21781994235,4cyclictest41-21ksoftirqd/308:45:173
21779994224,15cyclictest25-21ksoftirqd/111:02:281
21779994222,16cyclictest25-21ksoftirqd/108:39:041
21781994136,3cyclictest41-21ksoftirqd/311:29:553
21781994135,4cyclictest41-21ksoftirqd/309:55:283
21781994135,4cyclictest41-21ksoftirqd/309:55:283
21781994135,3cyclictest41-21ksoftirqd/310:55:003
21781994134,4cyclictest41-21ksoftirqd/312:10:013
21781994134,4cyclictest41-21ksoftirqd/311:45:003
21781994134,4cyclictest41-21ksoftirqd/310:35:133
21779994135,4cyclictest25-21ksoftirqd/112:09:511
21779994134,4cyclictest25-21ksoftirqd/109:11:111
21779994134,4cyclictest25-21ksoftirqd/108:20:171
21781994034,4cyclictest41-21ksoftirqd/308:55:193
21781994034,3cyclictest41-21ksoftirqd/308:20:243
21781994033,4cyclictest41-21ksoftirqd/312:10:163
21779994034,4cyclictest25-21ksoftirqd/108:30:401
21779994034,4cyclictest25-21ksoftirqd/108:30:401
21779993933,4cyclictest25-21ksoftirqd/111:40:541
21779993932,4cyclictest25-21ksoftirqd/112:25:061
21779993932,4cyclictest25-21ksoftirqd/111:33:281
21779993932,4cyclictest25-21ksoftirqd/111:18:491
21779993932,4cyclictest25-21ksoftirqd/110:05:431
21779993932,4cyclictest25-21ksoftirqd/107:50:391
21779993832,4cyclictest25-21ksoftirqd/110:57:591
21779993832,4cyclictest25-21ksoftirqd/110:27:481
21779993832,4cyclictest25-21ksoftirqd/110:04:551
21779993832,3cyclictest25-21ksoftirqd/109:51:151
21779993831,4cyclictest25-21ksoftirqd/111:28:261
21779993831,4cyclictest25-21ksoftirqd/109:42:211
21779993831,4cyclictest25-21ksoftirqd/109:25:401
21779993831,4cyclictest25-21ksoftirqd/109:23:281
21779993831,4cyclictest25-21ksoftirqd/107:58:091
21779993830,5cyclictest25-21ksoftirqd/108:44:421
21779993732,3cyclictest25-21ksoftirqd/107:29:341
21779993731,4cyclictest25-21ksoftirqd/111:20:341
21779993731,4cyclictest25-21ksoftirqd/111:20:341
21779993731,3cyclictest25-21ksoftirqd/108:00:521
21779993730,4cyclictest25-21ksoftirqd/112:32:531
21779993730,4cyclictest25-21ksoftirqd/109:05:301
21779993730,4cyclictest25-21ksoftirqd/108:59:561
21779993717,4cyclictest25-21ksoftirqd/108:26:151
21779993630,4cyclictest25-21ksoftirqd/110:54:181
21779993630,4cyclictest25-21ksoftirqd/108:52:041
21779993630,4cyclictest25-21ksoftirqd/107:17:071
21779993630,3cyclictest25-21ksoftirqd/110:45:121
21779993629,4cyclictest25-21ksoftirqd/112:13:101
21779993629,4cyclictest25-21ksoftirqd/109:32:431
21779993629,4cyclictest25-21ksoftirqd/107:36:371
21779993629,4cyclictest25-21ksoftirqd/107:20:551
21779993628,5cyclictest25-21ksoftirqd/109:16:021
21779993529,4cyclictest25-21ksoftirqd/111:57:161
21779993529,4cyclictest25-21ksoftirqd/111:48:501
21779993529,4cyclictest25-21ksoftirqd/111:35:071
21779993529,4cyclictest25-21ksoftirqd/108:47:241
21779993529,4cyclictest25-21ksoftirqd/107:14:101
21779993529,3cyclictest25-21ksoftirqd/107:30:371
21779993527,5cyclictest25-21ksoftirqd/111:11:111
21779993516,4cyclictest25-21ksoftirqd/110:16:151
21779993428,4cyclictest25-21ksoftirqd/112:19:081
21779993428,4cyclictest25-21ksoftirqd/109:38:051
21779993428,3cyclictest25-21ksoftirqd/109:04:031
21779993427,4cyclictest25-21ksoftirqd/109:45:121
21779993327,4cyclictest25-21ksoftirqd/110:42:211
21779993327,4cyclictest25-21ksoftirqd/107:49:091
21779993327,3cyclictest25-21ksoftirqd/112:37:101
2177999330,3cyclictest121rcu_preempt08:15:261
21779993227,3cyclictest25-21ksoftirqd/108:09:331
21779993226,3cyclictest25-21ksoftirqd/109:57:441
21779993226,3cyclictest25-21ksoftirqd/109:57:441
21779993225,4cyclictest25-21ksoftirqd/110:10:501
21779993126,3cyclictest25-21ksoftirqd/107:42:441
21779993125,4cyclictest25-21ksoftirqd/108:12:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional