You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 00:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Wed Apr 24, 2024 12:46:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1176911710,13ptp4l0-21swapper/007:06:140
1176911620,10ptp4l0-21swapper/107:05:061
542021570,6sleep31173699cyclictest08:15:143
1176911450,13ptp4l0-21swapper/207:07:132
2684221370,2sleep00-21swapper/009:00:200
111472826,20sleep30-21swapper/307:06:113
254422740,8sleep11173499cyclictest10:05:291
117691740,2ptp4l0-21swapper/110:33:151
117691710,1ptp4l0-21swapper/109:25:101
117691690,12ptp4l33-21ksoftirqd/209:32:462
117691680,2ptp4l0-21swapper/210:40:302
117691670,2ptp4l0-21swapper/110:25:411
117691660,3ptp4l14328-21/usr/sbin/munin08:35:111
117691660,2ptp4l0-21swapper/107:35:191
117691650,2ptp4l0-21swapper/008:00:250
117691650,2ptp4l0-21swapper/007:45:120
117691630,2ptp4l0-21swapper/308:20:203
11733996349,7cyclictest9-21ksoftirqd/009:10:110
11733996348,7cyclictest9-21ksoftirqd/012:00:120
11736996150,6cyclictest41-21ksoftirqd/311:25:133
11736996149,6cyclictest41-21ksoftirqd/311:10:123
11736996149,6cyclictest41-21ksoftirqd/310:15:133
11736996148,7cyclictest41-21ksoftirqd/312:05:133
11733996149,6cyclictest9-21ksoftirqd/010:25:130
117691600,2ptp4l0-21swapper/007:10:260
117691600,2ptp4l0-21swapper/007:10:260
11736996049,6cyclictest41-21ksoftirqd/307:10:123
11736996049,6cyclictest41-21ksoftirqd/307:10:113
11736996048,6cyclictest41-21ksoftirqd/311:15:103
11733996045,7cyclictest9-21ksoftirqd/008:40:100
117691590,2ptp4l0-21swapper/212:10:472
117691590,2ptp4l0-21swapper/208:01:192
117691590,2ptp4l0-21swapper/108:30:281
117691590,2ptp4l0-21swapper/108:30:281
117691590,2ptp4l0-21swapper/007:20:240
11736995948,6cyclictest41-21ksoftirqd/310:40:143
11736995945,7cyclictest41-21ksoftirqd/308:35:133
117691580,2ptp4l0-21swapper/012:08:030
11736995845,7cyclictest41-21ksoftirqd/307:20:083
117691570,4ptp4l31354-21ntp_states11:30:241
117691570,4ptp4l19652-21ps08:45:261
117691570,13ptp4l27451-21apt-get11:25:052
117691560,2ptp4l0-21swapper/207:45:182
117691560,2ptp4l0-21swapper/112:30:311
117691560,2ptp4l0-21swapper/112:20:371
117691560,2ptp4l0-21swapper/112:20:361
117691560,2ptp4l0-21swapper/111:40:121
117691560,2ptp4l0-21swapper/011:45:150
117691560,2ptp4l0-21swapper/010:16:370
117691560,2ptp4l0-21swapper/009:50:130
117691560,1ptp4l0-21swapper/109:09:051
117691550,5ptp4l15947-21memory09:45:260
117691550,5ptp4l15947-21memory09:45:250
117691550,2ptp4l0-21swapper/207:34:482
117691550,2ptp4l0-21swapper/107:45:491
117691550,1ptp4l0-21swapper/109:41:441
117691550,1ptp4l0-21swapper/109:35:311
11736995545,5cyclictest41-21ksoftirqd/309:40:113
117691540,4ptp4l24825-21ntp_states12:25:260
117691540,3ptp4l18908-21/usr/sbin/munin08:45:360
117691540,3ptp4l1179-21strings11:35:301
117691540,2ptp4l0-21swapper/107:21:071
117691540,2ptp4l0-21swapper/011:10:200
117691540,2ptp4l0-21swapper/010:10:380
117691540,2ptp4l0-21swapper/010:05:300
117691540,2ptp4l0-21swapper/008:55:150
117691540,2ptp4l0-21swapper/007:18:390
117691540,2ptp4l0-21swapper/007:18:380
117691540,1ptp4l0-21swapper/110:45:211
117791530,11getstats0-21swapper/309:51:113
117691530,2ptp4l0-21swapper/111:50:441
117691530,2ptp4l0-21swapper/109:11:541
117691530,2ptp4l0-21swapper/011:38:210
117691530,2ptp4l0-21swapper/007:43:200
117691530,1ptp4l0-21swapper/011:55:210
117691530,15ptp4l0-21swapper/108:52:171
55198520,11rtkit-daemon0-21swapper/110:21:501
117691520,3ptp4l19033-21apt-get12:15:121
117691520,3ptp4l19033-21apt-get12:15:121
117691520,2ptp4l0-21swapper/308:14:113
117691520,2ptp4l0-21swapper/210:36:542
117691520,2ptp4l0-21swapper/107:14:091
117691520,2ptp4l0-21swapper/107:14:091
117691520,2ptp4l0-21swapper/008:05:200
117691520,1ptp4l0-21swapper/012:40:000
117691520,1ptp4l0-21swapper/010:52:450
117691520,1ptp4l0-21swapper/010:30:250
117691520,1ptp4l0-21swapper/008:36:180
117691520,13ptp4l0-21swapper/208:20:342
117691520,13ptp4l0-21swapper/108:25:421
117691520,10ptp4l0-21swapper/110:41:261
11736995225,7cyclictest41-21ksoftirqd/308:45:343
11736995222,5cyclictest41-21ksoftirqd/308:40:273
11733995239,7cyclictest9-21ksoftirqd/007:55:130
11733995238,8cyclictest9-21ksoftirqd/011:05:130
117691510,2ptp4l0-21swapper/208:07:432
117691510,2ptp4l0-21swapper/111:15:311
117691510,2ptp4l0-21swapper/107:52:191
117691510,2ptp4l0-21swapper/011:30:280
117691510,1ptp4l0-21swapper/112:05:251
117691510,1ptp4l0-21swapper/108:40:341
117691510,15ptp4l21170-21cat07:35:182
117691510,10ptp4l0-21swapper/208:35:272
11736995140,5cyclictest41-21ksoftirqd/311:40:133
11736995124,4cyclictest41-21ksoftirqd/311:00:243
11736995124,4cyclictest41-21ksoftirqd/311:00:233
117791500,10getstats0-21swapper/310:05:133
117791500,10getstats0-21swapper/208:30:332
117791500,10getstats0-21swapper/208:30:332
117691500,2ptp4l0-21swapper/310:35:373
117691500,2ptp4l0-21swapper/111:59:341
117691500,2ptp4l0-21swapper/111:22:381
117691500,2ptp4l0-21swapper/109:46:431
117691500,2ptp4l0-21swapper/109:46:431
117691500,2ptp4l0-21swapper/107:29:301
117691500,2ptp4l0-21swapper/009:55:250
117691500,1ptp4l0-21swapper/012:30:180
117691500,1ptp4l0-21swapper/010:45:360
117691500,1ptp4l0-21swapper/009:09:090
117691500,13ptp4l0-21swapper/208:10:102
117691500,10ptp4l0-21swapper/008:18:080
11736995026,7cyclictest41-21ksoftirqd/312:25:273
11733995038,6cyclictest9-21ksoftirqd/012:20:140
11733995038,6cyclictest9-21ksoftirqd/012:20:130
117691490,7ptp4l0-21swapper/209:44:532
117691490,2ptp4l0-21swapper/111:02:011
117691490,2ptp4l0-21swapper/111:02:011
117691490,2ptp4l0-21swapper/110:13:191
117691490,2ptp4l0-21swapper/109:57:021
117691490,2ptp4l0-21swapper/108:18:021
117691490,2ptp4l0-21swapper/011:15:310
117691490,1ptp4l0-21swapper/111:29:241
117691490,1ptp4l0-21swapper/110:03:381
117691490,1ptp4l0-21swapper/108:04:131
117691490,1ptp4l0-21swapper/107:58:021
117691490,1ptp4l0-21swapper/107:42:421
117691490,1ptp4l0-21swapper/107:30:421
11736994922,4cyclictest41-21ksoftirqd/312:20:373
11736994922,4cyclictest41-21ksoftirqd/312:20:363
11736994921,4cyclictest41-21ksoftirqd/308:05:273
11736994919,8cyclictest41-21ksoftirqd/309:05:003
11733994935,7cyclictest9-21ksoftirqd/009:20:130
117791480,9getstats0-21swapper/209:37:532
117791480,9getstats0-21swapper/208:25:582
117791480,9getstats0-21swapper/208:15:172
117791480,9getstats0-21swapper/207:58:142
117791480,8getstats0-21swapper/209:50:462
117791480,10getstats0-21swapper/208:55:512
117691480,9ptp4l0-21swapper/212:29:302
117691480,9ptp4l0-21swapper/210:19:022
117691480,8ptp4l0-21swapper/010:58:550
117691480,2ptp4l0-21swapper/111:07:331
117691480,2ptp4l0-21swapper/109:16:111
117691480,2ptp4l0-21swapper/008:52:520
117691480,1ptp4l0-21swapper/309:30:543
117691480,1ptp4l0-21swapper/112:26:451
117691480,1ptp4l0-21swapper/110:57:231
117691480,1ptp4l0-21swapper/110:17:061
117691480,1ptp4l0-21swapper/109:33:071
117691480,1ptp4l0-21swapper/109:22:481
117691480,1ptp4l0-21swapper/011:29:460
117691480,1ptp4l0-21swapper/009:33:100
117691480,1ptp4l0-21swapper/009:29:120
117691480,1ptp4l0-21swapper/007:31:240
11736994821,4cyclictest41-21ksoftirqd/311:55:203
11733994836,6cyclictest9-21ksoftirqd/007:35:070
117791470,9getstats0-21swapper/312:30:183
117791470,9getstats0-21swapper/307:37:473
117791470,9getstats0-21swapper/211:00:282
117791470,9getstats0-21swapper/211:00:272
117791470,9getstats0-21swapper/210:04:372
117791470,9getstats0-21swapper/208:47:352
117791470,8getstats0-21swapper/210:09:192
117691470,9ptp4l0-21swapper/210:26:172
117691470,8ptp4l0-21swapper/212:18:042
117691470,8ptp4l0-21swapper/212:18:032
117691470,8ptp4l0-21swapper/210:46:322
117691470,4ptp4l11732-21cyclictest09:25:143
117691470,2ptp4l0-21swapper/110:54:501
117691470,2ptp4l0-21swapper/108:24:491
117691470,1ptp4l0-21swapper/207:10:162
117691470,1ptp4l0-21swapper/207:10:152
117691470,1ptp4l0-21swapper/108:59:111
117691470,1ptp4l0-21swapper/010:03:480
117691470,11ptp4l0-21swapper/311:35:183
117691470,11ptp4l0-21swapper/212:30:332
11736994734,4cyclictest41-21ksoftirqd/309:00:003
11736994722,4cyclictest41-21ksoftirqd/308:00:303
11736994720,4cyclictest41-21ksoftirqd/308:30:253
11736994720,4cyclictest41-21ksoftirqd/308:30:253
11736994718,4cyclictest41-21ksoftirqd/308:50:143
11736994713,5cyclictest41-21ksoftirqd/311:45:353
11733994733,8cyclictest9-21ksoftirqd/010:35:070
117791460,9getstats0-21swapper/309:13:193
117791460,9getstats0-21swapper/209:48:492
117791460,9getstats0-21swapper/209:48:482
117791460,8getstats0-21swapper/311:21:363
117791460,8getstats0-21swapper/309:48:103
117791460,8getstats0-21swapper/309:48:093
117791460,8getstats0-21swapper/309:38:343
117791460,8getstats0-21swapper/212:24:042
117791460,8getstats0-21swapper/212:24:042
117791460,8getstats0-21swapper/209:29:512
117691460,8ptp4l0-21swapper/211:13:562
117691460,8ptp4l0-21swapper/209:14:522
117691460,8ptp4l0-21swapper/207:50:072
117691460,7ptp4l0-21swapper/207:15:182
117691460,7ptp4l0-21swapper/207:15:182
117691460,4ptp4l16206-21apt-get12:10:051
117691460,2ptp4l0-21swapper/311:50:153
117691460,2ptp4l0-21swapper/310:23:513
117691460,2ptp4l0-21swapper/010:21:040
117691460,2ptp4l0-21swapper/009:38:230
117691460,1ptp4l0-21swapper/111:10:461
117691460,1ptp4l0-21swapper/109:51:041
11736994619,4cyclictest41-21ksoftirqd/310:00:233
11736994618,7cyclictest41-21ksoftirqd/309:20:153
11736994617,5cyclictest41-21ksoftirqd/309:55:263
11736994614,11cyclictest41-21ksoftirqd/307:50:203
1173399468,8cyclictest9-21ksoftirqd/009:40:330
117791450,8getstats0-21swapper/210:11:382
117691450,8ptp4l0-21swapper/212:38:192
117691450,8ptp4l0-21swapper/008:25:170
117691450,7ptp4l0-21swapper/209:57:022
117691450,5ptp4l17340-21/usr/sbin/munin12:10:190
117691450,3ptp4l121rcu_preempt12:00:342
117691450,2ptp4l0-21swapper/312:35:333
117691450,2ptp4l0-21swapper/311:34:533
117691450,2ptp4l0-21swapper/212:05:322
117691450,2ptp4l0-21swapper/207:25:142
117691450,2ptp4l0-21swapper/112:03:141
117691450,2ptp4l0-21swapper/011:00:500
117691450,2ptp4l0-21swapper/011:00:490
11736994539,3cyclictest401ktimersoftd/312:15:203
11736994539,3cyclictest401ktimersoftd/312:15:193
11736994529,3cyclictest41-21ksoftirqd/312:00:203
11736994519,4cyclictest41-21ksoftirqd/310:50:263
11736994518,4cyclictest41-21ksoftirqd/307:45:143
117791440,9getstats0-21swapper/308:26:093
117691440,8ptp4l0-21swapper/211:50:072
117691440,8ptp4l0-21swapper/210:51:492
117691440,7ptp4l0-21swapper/211:05:472
117691440,6ptp4l7070-21latency_hist11:50:012
117691440,2ptp4l0-21swapper/207:42:202
117691440,2ptp4l0-21swapper/107:18:561
117691440,2ptp4l0-21swapper/107:18:551
117691440,1ptp4l0-21swapper/011:53:380
117691440,1ptp4l0-21swapper/011:20:580
117691440,1ptp4l0-21swapper/007:51:560
117691440,10ptp4l0-21swapper/211:20:122
11736994418,7cyclictest41-21ksoftirqd/310:10:143
117691430,8ptp4l0-21swapper/208:44:342
117691430,5ptp4l7245-21iostat_ios10:40:230
117691430,4ptp4l0-21swapper/211:39:052
117691430,3ptp4l4898-21apt-get11:45:131
117691430,2ptp4l0-21swapper/211:55:422
117691430,2ptp4l0-21swapper/210:20:222
117691430,2ptp4l0-21swapper/009:18:150
117691430,1ptp4l0-21swapper/110:37:031
11736994316,4cyclictest41-21ksoftirqd/308:00:003
11736994312,5cyclictest41-21ksoftirqd/311:10:003
117691420,8ptp4l0-21swapper/210:56:242
117691420,4ptp4l32541-21apt-get08:05:121
117691420,2ptp4l0-21swapper/211:40:142
117691420,2ptp4l0-21swapper/209:18:542
117691420,2ptp4l0-21swapper/208:51:322
117691420,2ptp4l0-21swapper/008:31:000
117691420,2ptp4l0-21swapper/008:31:000
117691420,2ptp4l0-21swapper/008:13:450
1173699422,8cyclictest41-21ksoftirqd/307:25:153
11736994215,4cyclictest41-21ksoftirqd/309:10:013
117691410,2ptp4l0-21swapper/312:12:263
117691410,2ptp4l0-21swapper/307:16:373
117691410,2ptp4l0-21swapper/307:16:363
117691410,2ptp4l0-21swapper/211:32:362
117691410,2ptp4l0-21swapper/211:15:272
117691410,2ptp4l0-21swapper/210:31:592
117691410,2ptp4l0-21swapper/209:00:342
117691410,2ptp4l0-21swapper/207:21:502
1173699413,4cyclictest41-21ksoftirqd/309:15:143
11736994114,4cyclictest41-21ksoftirqd/307:41:583
11736994113,4cyclictest41-21ksoftirqd/310:55:143
117691400,5ptp4l8067-21irqrtprio08:20:230
117691400,4ptp4l4025-21sort11:40:340
117691400,4ptp4l3018-21hddtemp_smartct08:10:191
117691400,4ptp4l26790-21hddtemp_smartct09:00:191
117691400,4ptp4l19550-21hddtemp_smartct12:15:170
117691400,4ptp4l19550-21hddtemp_smartct12:15:160
117691400,2ptp4l0-21swapper/310:46:383
117691400,2ptp4l0-21swapper/310:33:583
117691400,2ptp4l0-21swapper/209:20:102
117691400,2ptp4l0-21swapper/209:05:332
117691390,2ptp4l0-21swapper/307:30:093
117691390,2ptp4l0-21swapper/112:35:251
117691390,2ptp4l0-21swapper/007:25:140
11736993927,3cyclictest41-21ksoftirqd/310:25:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional