You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-13 - 22:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot1.osadl.org (updated Wed Nov 13, 2024 12:46:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1166911730,8ptp4l0-21swapper/107:08:431
1166911610,73ptp4l9-21ksoftirqd/007:06:280
1166911450,14ptp4l0-21swapper/207:08:182
1166911280,15ptp4l0-21swapper/307:08:123
114869910387,9cyclictest9-21ksoftirqd/008:15:110
11488999884,8cyclictest33-21ksoftirqd/210:50:192
11486999784,8cyclictest9-21ksoftirqd/010:15:100
11486999784,7cyclictest9-21ksoftirqd/011:35:110
11486999782,9cyclictest9-21ksoftirqd/008:50:130
11488999581,8cyclictest33-21ksoftirqd/209:40:132
11486999582,7cyclictest9-21ksoftirqd/009:35:140
11486999479,8cyclictest9-21ksoftirqd/008:25:130
11488999379,9cyclictest33-21ksoftirqd/207:35:122
11488999278,8cyclictest33-21ksoftirqd/209:50:132
11486999076,9cyclictest9-21ksoftirqd/009:20:130
11488998978,6cyclictest33-21ksoftirqd/212:00:132
11486998877,6cyclictest9-21ksoftirqd/010:10:120
11488998674,7cyclictest33-21ksoftirqd/207:30:122
11488998674,7cyclictest33-21ksoftirqd/207:30:122
11486998168,6cyclictest9-21ksoftirqd/007:45:130
11488997943,4cyclictest33-21ksoftirqd/207:25:162
11488997943,4cyclictest33-21ksoftirqd/207:25:162
11488997843,4cyclictest33-21ksoftirqd/208:40:242
11486997842,4cyclictest9-21ksoftirqd/011:05:320
11486997841,4cyclictest9-21ksoftirqd/007:20:320
11486997838,4cyclictest9-21ksoftirqd/011:05:010
11488997768,5cyclictest33-21ksoftirqd/211:15:122
11486997742,7cyclictest9-21ksoftirqd/009:10:010
11488997638,7cyclictest33-21ksoftirqd/211:24:592
11486997634,5cyclictest9-21ksoftirqd/011:55:160
11486997634,5cyclictest9-21ksoftirqd/011:55:160
11486997534,5cyclictest9-21ksoftirqd/011:10:140
11488997440,4cyclictest33-21ksoftirqd/212:10:372
11488997439,4cyclictest33-21ksoftirqd/209:05:232
11486997442,7cyclictest9-21ksoftirqd/010:35:300
11486997438,7cyclictest9-21ksoftirqd/007:50:170
11486997438,4cyclictest9-21ksoftirqd/009:55:230
11488997338,5cyclictest33-21ksoftirqd/211:35:232
1148899733,4cyclictest131rcu_sched08:02:432
1148899732,4cyclictest33-21ksoftirqd/211:00:262
11486997340,8cyclictest9-21ksoftirqd/010:20:260
11486997337,4cyclictest9-21ksoftirqd/008:20:310
11486997332,7cyclictest9-21ksoftirqd/010:30:290
11486997332,7cyclictest9-21ksoftirqd/010:30:280
11488997239,7cyclictest33-21ksoftirqd/208:20:272
11488997238,4cyclictest33-21ksoftirqd/210:45:262
11488997236,5cyclictest33-21ksoftirqd/208:35:272
11488997236,4cyclictest33-21ksoftirqd/208:55:242
11488997236,4cyclictest33-21ksoftirqd/208:20:002
11486997237,8cyclictest9-21ksoftirqd/008:10:320
11486997237,4cyclictest9-21ksoftirqd/008:41:050
11488997137,4cyclictest33-21ksoftirqd/209:00:302
11488997137,4cyclictest33-21ksoftirqd/209:00:292
11488997134,5cyclictest33-21ksoftirqd/211:30:232
11488997131,4cyclictest33-21ksoftirqd/209:50:002
11486997130,6cyclictest9-21ksoftirqd/007:40:000
56592700,5sleep2311rcuc/208:05:192
11488997063,4cyclictest33-21ksoftirqd/209:20:052
11488997034,7cyclictest33-21ksoftirqd/211:50:002
11488997019,5cyclictest33-21ksoftirqd/208:33:252
11486997035,5cyclictest9-21ksoftirqd/007:13:170
11486997030,5cyclictest9-21ksoftirqd/010:05:260
11486997029,5cyclictest9-21ksoftirqd/007:55:230
11488996935,4cyclictest33-21ksoftirqd/209:10:102
1148899690,4cyclictest33-21ksoftirqd/210:15:002
11488996861,4cyclictest33-21ksoftirqd/212:25:052
1148699688,4cyclictest9-21ksoftirqd/008:00:150
11486996834,7cyclictest9-21ksoftirqd/010:25:010
11486996834,7cyclictest9-21ksoftirqd/010:25:010
11488996760,4cyclictest33-21ksoftirqd/210:40:142
11488996733,4cyclictest33-21ksoftirqd/207:55:172
11488996732,4cyclictest33-21ksoftirqd/211:50:372
11488996732,4cyclictest33-21ksoftirqd/210:20:172
11488996732,4cyclictest33-21ksoftirqd/209:25:152
11486996732,4cyclictest9-21ksoftirqd/011:25:380
11488996644,10cyclictest33-21ksoftirqd/208:25:322
11488996637,5cyclictest33-21ksoftirqd/207:10:152
11487996630,18cyclictest25-21ksoftirqd/108:11:511
1148699667,4cyclictest9-21ksoftirqd/011:45:220
11486996654,3cyclictest9-21ksoftirqd/012:39:590
11486996635,7cyclictest9-21ksoftirqd/012:15:130
11486996631,4cyclictest9-21ksoftirqd/012:02:410
11488996534,7cyclictest33-21ksoftirqd/207:40:192
11488996531,4cyclictest33-21ksoftirqd/210:35:262
11488996530,4cyclictest33-21ksoftirqd/211:05:202
11488996529,4cyclictest33-21ksoftirqd/210:55:302
11488996524,5cyclictest33-21ksoftirqd/210:25:172
11488996524,5cyclictest33-21ksoftirqd/210:25:162
1148699656,4cyclictest9-21ksoftirqd/009:50:310
11486996529,4cyclictest9-21ksoftirqd/011:30:130
11486996527,5cyclictest9-21ksoftirqd/008:35:000
116691640,1ptp4l0-21swapper/308:20:413
11488996431,4cyclictest33-21ksoftirqd/209:15:192
11488996430,4cyclictest33-21ksoftirqd/207:45:282
11488996429,4cyclictest33-21ksoftirqd/212:20:012
11488996429,4cyclictest33-21ksoftirqd/211:25:152
1148699648,7cyclictest9-21ksoftirqd/011:19:590
11488996328,4cyclictest33-21ksoftirqd/212:30:182
1148899632,4cyclictest121rcu_preempt10:20:002
11488996323,5cyclictest33-21ksoftirqd/208:50:002
1148699635,3cyclictest9-21ksoftirqd/010:45:260
11486996352,4cyclictest9-21ksoftirqd/009:45:170
1148699633,4cyclictest9-21ksoftirqd/008:35:320
11488996228,4cyclictest33-21ksoftirqd/211:55:212
11488996228,4cyclictest33-21ksoftirqd/211:55:202
11488996228,4cyclictest33-21ksoftirqd/211:40:192
11488996228,4cyclictest33-21ksoftirqd/209:30:172
11488996227,4cyclictest33-21ksoftirqd/212:20:192
1148699628,7cyclictest9-21ksoftirqd/009:40:280
1148699626,3cyclictest9-21ksoftirqd/010:55:190
1148699625,4cyclictest9-21ksoftirqd/008:45:280
11486996227,8cyclictest9-21ksoftirqd/009:15:180
1148699621,4cyclictest11390-21/usr/sbin/munin09:25:290
1148699620,7cyclictest9-21ksoftirqd/012:20:230
11486996150,3cyclictest9-21ksoftirqd/010:40:170
1148899605,3cyclictest33-21ksoftirqd/211:10:162
1148899602,8cyclictest33-21ksoftirqd/207:50:142
11488996025,4cyclictest33-21ksoftirqd/209:35:172
11488996022,5cyclictest33-21ksoftirqd/209:55:212
1148899600,4cyclictest121rcu_preempt12:40:002
1148699605,4cyclictest9-21ksoftirqd/009:10:120
11486996051,3cyclictest9-21ksoftirqd/011:50:300
11486996050,3cyclictest9-21ksoftirqd/011:20:170
11486996042,7cyclictest9-21ksoftirqd/007:15:140
11486996027,7cyclictest9-21ksoftirqd/009:00:010
11488995952,4cyclictest33-21ksoftirqd/210:05:162
1148899594,9cyclictest121rcu_preempt07:25:002
1148699595,3cyclictest9-21ksoftirqd/007:30:140
1148699595,3cyclictest9-21ksoftirqd/007:30:130
11486995952,4cyclictest9-21ksoftirqd/010:50:400
11486995949,4cyclictest9-21ksoftirqd/012:05:330
1148699592,4cyclictest9-21ksoftirqd/011:45:000
116691580,2ptp4l0-21swapper/110:00:251
11488995850,4cyclictest33-21ksoftirqd/212:10:012
11486995852,3cyclictest9-21ksoftirqd/012:15:000
11486995851,4cyclictest9-21ksoftirqd/007:25:310
11486995851,4cyclictest9-21ksoftirqd/007:25:300
1148699583,3cyclictest9-21ksoftirqd/009:30:150
1148699581,8cyclictest4528-21kworker/0:208:05:180
116691570,2ptp4l0-21swapper/309:50:063
116691570,2ptp4l0-21swapper/207:18:302
116691570,2ptp4l0-21swapper/107:39:421
116691570,2ptp4l0-21swapper/012:28:140
11488995724,4cyclictest33-21ksoftirqd/210:00:222
1148699572,7cyclictest121rcu_preempt09:00:300
1148699572,7cyclictest121rcu_preempt09:00:290
1148699570,5cyclictest9-21ksoftirqd/010:00:310
116691560,2ptp4l0-21swapper/312:17:543
116691560,14ptp4l0-21swapper/308:50:273
11486995646,3cyclictest9-21ksoftirqd/012:30:250
116691550,2ptp4l0-21swapper/308:55:323
116691550,13ptp4l0-21swapper/312:02:183
11488995548,4cyclictest33-21ksoftirqd/208:50:212
1148899552,8cyclictest121rcu_preempt10:30:232
1148899552,8cyclictest121rcu_preempt10:30:232
1148899551,4cyclictest121rcu_preempt08:10:182
1148699552,3cyclictest9-21ksoftirqd/007:40:140
116691540,2ptp4l0-21swapper/310:48:483
116691540,2ptp4l0-21swapper/309:16:203
116691540,1ptp4l0-21swapper/108:25:341
116691530,2ptp4l0-21swapper/107:24:591
1148799531,10cyclictest116791getstats08:07:391
116691520,8ptp4l0-21swapper/108:37:251
116691520,2ptp4l0-21swapper/311:20:273
116691520,2ptp4l0-21swapper/110:55:201
116691520,2ptp4l0-21swapper/109:20:131
116691520,2ptp4l0-21swapper/108:40:171
116691510,2ptp4l0-21swapper/110:40:261
116691510,2ptp4l0-21swapper/107:52:471
116691510,1ptp4l0-21swapper/310:10:273
11487995133,15cyclictest25-21ksoftirqd/110:17:081
116791500,12getstats25867-21users09:55:341
116691500,2ptp4l0-21swapper/308:35:233
116691500,2ptp4l0-21swapper/308:31:333
116691500,2ptp4l0-21swapper/307:38:433
116691500,2ptp4l0-21swapper/112:35:461
116691500,2ptp4l0-21swapper/112:30:091
116691500,2ptp4l0-21swapper/111:40:581
116691500,2ptp4l0-21swapper/111:10:131
116691490,2ptp4l0-21swapper/312:21:023
116691490,2ptp4l0-21swapper/311:15:233
116691490,2ptp4l0-21swapper/310:40:133
116691490,2ptp4l0-21swapper/112:19:121
116691490,1ptp4l0-21swapper/111:36:151
116691490,1ptp4l0-21swapper/109:36:271
116691480,2ptp4l0-21swapper/311:11:343
116691480,2ptp4l0-21swapper/309:06:483
116691480,2ptp4l0-21swapper/110:45:131
116691480,1ptp4l0-21swapper/312:05:013
116691480,1ptp4l0-21swapper/311:58:593
116691480,1ptp4l0-21swapper/311:58:583
116691480,1ptp4l0-21swapper/308:46:383
116691480,1ptp4l0-21swapper/110:53:491
116691480,1ptp4l0-21swapper/107:43:101
116691480,10ptp4l0-21swapper/111:33:381
11487994830,14cyclictest25-21ksoftirqd/107:16:521
116791470,9getstats0-21swapper/109:16:561
116791470,8getstats0-21swapper/108:59:521
116691470,2ptp4l0-21swapper/310:04:383
116691470,2ptp4l0-21swapper/309:45:583
116691470,1ptp4l0-21swapper/311:35:343
116691470,1ptp4l0-21swapper/309:35:583
116691470,1ptp4l0-21swapper/112:14:521
116691470,1ptp4l0-21swapper/111:16:311
116691470,1ptp4l0-21swapper/111:04:481
116691470,1ptp4l0-21swapper/109:47:451
116691470,1ptp4l0-21swapper/109:27:321
11487994739,5cyclictest25-21ksoftirqd/112:00:011
11487994739,5cyclictest25-21ksoftirqd/112:00:001
11487994731,13cyclictest25-21ksoftirqd/110:34:191
11487994731,13cyclictest25-21ksoftirqd/110:34:181
116691460,7ptp4l0-21swapper/311:41:003
116691460,2ptp4l0-21swapper/312:29:483
116691460,2ptp4l0-21swapper/310:08:393
116691460,1ptp4l0-21swapper/310:23:103
116691460,1ptp4l0-21swapper/112:20:301
116691460,1ptp4l0-21swapper/108:18:171
11487994631,12cyclictest25-21ksoftirqd/108:54:391
116791450,8getstats0-21swapper/109:31:451
116791450,8getstats0-21swapper/108:34:091
116791450,8getstats0-21swapper/108:01:301
116691450,8ptp4l0-21swapper/308:29:133
116691450,8ptp4l0-21swapper/307:19:343
116691450,7ptp4l0-21swapper/311:03:473
116691450,7ptp4l0-21swapper/309:12:323
116691450,7ptp4l0-21swapper/308:14:443
116691450,6ptp4l0-21swapper/310:38:553
116691450,2ptp4l0-21swapper/309:21:413
116691450,2ptp4l0-21swapper/307:21:013
116691450,1ptp4l0-21swapper/311:31:423
116691450,1ptp4l0-21swapper/310:16:163
116691450,1ptp4l0-21swapper/111:20:421
116691450,1ptp4l0-21swapper/107:46:441
11487994539,4cyclictest25-21ksoftirqd/111:07:441
116691440,9ptp4l0-21swapper/110:29:301
116691440,9ptp4l0-21swapper/110:29:291
116691440,7ptp4l0-21swapper/311:51:063
116691440,7ptp4l0-21swapper/309:57:033
116691440,7ptp4l0-21swapper/309:34:403
116691440,7ptp4l0-21swapper/308:17:083
116691440,2ptp4l0-21swapper/312:32:463
116691440,2ptp4l0-21swapper/310:53:213
116691440,2ptp4l0-21swapper/107:59:001
116691440,1ptp4l0-21swapper/311:26:443
116691440,1ptp4l0-21swapper/311:07:323
116691440,1ptp4l0-21swapper/310:57:173
116691440,12ptp4l0-21swapper/310:27:003
116691440,12ptp4l0-21swapper/310:27:003
116691440,11ptp4l0-21swapper/110:06:391
11489994438,4cyclictest41-21ksoftirqd/307:53:183
11487994437,4cyclictest25-21ksoftirqd/110:14:581
11487994426,15cyclictest25-21ksoftirqd/112:28:231
116691430,8ptp4l0-21swapper/307:14:453
116691430,7ptp4l0-21swapper/309:28:083
116691430,7ptp4l0-21swapper/309:02:373
116691430,7ptp4l0-21swapper/309:02:363
116691430,7ptp4l0-21swapper/307:57:553
116691430,2ptp4l0-21swapper/311:46:213
116691430,2ptp4l0-21swapper/111:52:381
116691430,2ptp4l0-21swapper/110:23:181
116691430,1ptp4l0-21swapper/308:04:473
116691430,1ptp4l0-21swapper/110:39:521
11487994336,4cyclictest25-21ksoftirqd/109:54:481
116691420,2ptp4l0-21swapper/312:12:393
116691420,2ptp4l0-21swapper/308:09:073
116691420,2ptp4l0-21swapper/109:40:501
11487994235,4cyclictest3516-21sshd11:28:371
116691410,2ptp4l0-21swapper/309:42:043
116691410,2ptp4l0-21swapper/308:44:533
116691410,2ptp4l0-21swapper/307:31:283
116691410,2ptp4l0-21swapper/307:31:273
11487994136,3cyclictest25-21ksoftirqd/108:20:141
11487994134,5cyclictest25-21ksoftirqd/108:49:421
116691400,5ptp4l3396-21hddtemp_smartct09:10:151
116691400,5ptp4l21271-21ntp_states12:05:261
116691400,3ptp4l1491-21ls09:05:221
116691400,2ptp4l0-21swapper/307:45:563
116691400,2ptp4l0-21swapper/307:41:363
116691400,2ptp4l0-21swapper/112:01:471
116691400,2ptp4l0-21swapper/109:01:541
116691400,2ptp4l0-21swapper/109:01:541
116691400,1ptp4l0-21swapper/310:34:303
116691400,1ptp4l0-21swapper/310:34:293
11487994034,4cyclictest25-21ksoftirqd/107:29:371
11487994034,4cyclictest25-21ksoftirqd/107:29:361
116691390,4ptp4l21144-21/usr/sbin/munin07:30:141
116691390,4ptp4l21144-21/usr/sbin/munin07:30:141
116691390,2ptp4l0-21swapper/107:10:231
116691370,3ptp4l12135-21gzip11:45:261
116691370,2ptp4l0-21swapper/312:35:153
116691370,2ptp4l0-21swapper/307:29:083
116691370,2ptp4l0-21swapper/307:29:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional