You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 17:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot1.osadl.org (updated Fri Apr 19, 2024 00:46:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1176911660,17ptp4l0-21swapper/019:05:420
1176911620,14ptp4l0-21swapper/319:07:043
1176911480,14ptp4l0-21swapper/119:06:281
1176911470,9ptp4l0-21swapper/219:08:372
1176911300,24ptp4l31162-21calmdown-rtkit19:10:001
117691640,9ptp4l0-21swapper/223:40:112
117691640,2ptp4l0-21swapper/023:01:340
117691640,2ptp4l0-21swapper/023:01:330
117691630,3ptp4l14853-21iostat23:10:180
117691630,2ptp4l0-21swapper/123:31:111
116092630,2sleep00-21swapper/021:55:140
117691620,2ptp4l0-21swapper/122:15:411
117691610,2ptp4l0-21swapper/221:15:112
117691600,2ptp4l0-21swapper/323:25:153
117691600,2ptp4l0-21swapper/220:24:162
117691600,2ptp4l0-21swapper/120:25:131
117691600,2ptp4l0-21swapper/120:25:121
117691590,2ptp4l0-21swapper/223:54:022
117691590,2ptp4l0-21swapper/000:05:320
117691590,1ptp4l0-21swapper/120:46:331
3121599580,4cyclictest121rcu_preempt19:35:132
117691580,2ptp4l0-21swapper/121:08:521
117691580,2ptp4l0-21swapper/019:22:460
183032570,2sleep10-21swapper/121:00:151
117691570,2ptp4l0-21swapper/221:06:422
117691570,2ptp4l0-21swapper/123:42:471
117691570,2ptp4l0-21swapper/119:45:221
3121599560,3cyclictest121rcu_preempt23:15:122
117691560,2ptp4l0-21swapper/221:51:142
117691560,2ptp4l0-21swapper/220:59:192
117691560,2ptp4l0-21swapper/220:17:182
117691560,2ptp4l0-21swapper/022:15:310
117691560,2ptp4l0-21swapper/019:50:010
117691560,1ptp4l0-21swapper/022:45:310
117691560,1ptp4l0-21swapper/000:33:290
117691560,10ptp4l0-21swapper/022:55:140
117691550,3ptp4l32173-21/usr/sbin/munin19:10:220
117691550,2ptp4l0-21swapper/219:32:542
117691550,2ptp4l0-21swapper/019:25:260
117691550,1ptp4l0-21swapper/122:24:551
117691550,1ptp4l0-21swapper/020:35:330
117691540,2ptp4l0-21swapper/223:45:162
117691540,2ptp4l0-21swapper/222:27:202
117691540,2ptp4l0-21swapper/222:21:542
117691540,2ptp4l0-21swapper/221:01:092
117691540,2ptp4l0-21swapper/122:50:131
117691540,2ptp4l0-21swapper/020:58:450
117691530,2ptp4l0-21swapper/221:11:162
117691530,2ptp4l0-21swapper/122:40:221
117691530,2ptp4l0-21swapper/122:02:081
117691530,2ptp4l0-21swapper/020:01:400
117691530,1ptp4l0-21swapper/120:56:261
117691520,2ptp4l0-21swapper/323:05:243
117691520,2ptp4l0-21swapper/319:33:313
117691520,2ptp4l0-21swapper/220:09:562
117691520,2ptp4l0-21swapper/219:17:202
117691520,1ptp4l0-21swapper/100:18:151
117691510,2ptp4l0-21swapper/123:55:041
117691510,2ptp4l0-21swapper/020:52:210
117691510,2ptp4l0-21swapper/019:59:190
117691510,1ptp4l0-21swapper/122:46:161
55198500,12rtkit-daemon0-21swapper/100:37:521
31216995019,7cyclictest41-21ksoftirqd/322:50:003
3121599508,10cyclictest33-21ksoftirqd/221:35:252
31215995019,5cyclictest33-21ksoftirqd/222:30:162
117691500,9ptp4l0-21swapper/000:36:100
117691500,2ptp4l0-21swapper/222:15:182
117691500,2ptp4l0-21swapper/220:02:502
117691500,2ptp4l0-21swapper/021:50:290
117691500,2ptp4l0-21swapper/000:19:350
117691490,8ptp4l0-21swapper/222:48:452
117691490,2ptp4l0-21swapper/000:25:530
117691490,11ptp4l0-21swapper/119:35:201
117691480,8ptp4l16519-21apt-get23:15:151
117691480,8ptp4l0-21swapper/200:21:122
117691480,8ptp4l0-21swapper/200:21:122
117691480,2ptp4l0-21swapper/219:44:582
117691480,2ptp4l0-21swapper/123:28:261
117691480,2ptp4l0-21swapper/121:21:521
117691480,2ptp4l0-21swapper/119:31:121
117691480,2ptp4l0-21swapper/022:36:530
117691480,2ptp4l0-21swapper/019:34:090
117691480,1ptp4l0-21swapper/119:28:221
117691480,10ptp4l0-21swapper/020:30:180
3121599474,10cyclictest33-21ksoftirqd/220:40:172
117691470,9ptp4l0-21swapper/123:11:491
117691470,9ptp4l0-21swapper/121:55:281
117691470,2ptp4l0-21swapper/121:50:451
117691470,2ptp4l0-21swapper/022:32:160
117691470,1ptp4l0-21swapper/120:07:011
117691470,1ptp4l0-21swapper/119:41:341
31216994625,5cyclictest41-21ksoftirqd/322:05:263
3121599467,3cyclictest33-21ksoftirqd/200:36:182
117691460,8ptp4l0-21swapper/222:44:492
117691460,8ptp4l0-21swapper/120:15:411
117691460,7ptp4l0-21swapper/223:35:402
117691460,7ptp4l0-21swapper/219:56:572
117691460,5ptp4l0-21swapper/223:24:322
117691460,2ptp4l0-21swapper/322:37:123
117691460,2ptp4l0-21swapper/223:27:502
117691460,2ptp4l0-21swapper/222:07:472
117691460,2ptp4l0-21swapper/221:40:192
117691460,2ptp4l0-21swapper/221:33:132
117691460,2ptp4l0-21swapper/219:50:242
117691460,2ptp4l0-21swapper/100:29:061
117691460,2ptp4l0-21swapper/020:42:460
117691460,2ptp4l0-21swapper/020:11:590
117691460,1ptp4l0-21swapper/123:38:301
117691460,1ptp4l0-21swapper/121:42:471
117691460,1ptp4l0-21swapper/022:22:520
31215994528,5cyclictest33-21ksoftirqd/219:45:242
31215994522,5cyclictest33-21ksoftirqd/220:30:152
117691450,9ptp4l0-21swapper/019:42:350
117691450,7ptp4l0-21swapper/223:59:192
117691450,7ptp4l0-21swapper/223:32:362
117691450,4ptp4l0-21swapper/023:25:130
117691450,2ptp4l0-21swapper/223:07:592
117691450,2ptp4l0-21swapper/222:59:522
117691450,2ptp4l0-21swapper/222:51:492
117691450,2ptp4l0-21swapper/222:14:192
117691450,2ptp4l0-21swapper/219:13:192
117691450,2ptp4l0-21swapper/200:10:282
117691450,2ptp4l0-21swapper/123:04:541
117691450,2ptp4l0-21swapper/123:04:541
117691450,2ptp4l0-21swapper/120:51:451
117691450,2ptp4l0-21swapper/119:24:511
117691450,1ptp4l0-21swapper/120:03:431
117691450,1ptp4l0-21swapper/119:16:091
117691450,1ptp4l0-21swapper/022:25:500
117691450,13ptp4l0-21swapper/319:11:153
319372440,6sleep331943-21cpuspeed_turbos20:20:143
31216994426,4cyclictest41-21ksoftirqd/320:40:253
31216994425,4cyclictest41-21ksoftirqd/320:10:003
31215994427,4cyclictest33-21ksoftirqd/223:10:172
31215994427,4cyclictest33-21ksoftirqd/221:55:302
117691440,9ptp4l0-21swapper/200:27:592
117691440,9ptp4l0-21swapper/121:48:111
117691440,9ptp4l0-21swapper/121:48:111
117691440,8ptp4l0-21swapper/020:09:380
117691440,2ptp4l0-21swapper/319:47:303
117691440,2ptp4l0-21swapper/200:16:352
117691440,2ptp4l0-21swapper/122:36:131
117691440,2ptp4l0-21swapper/122:26:431
117691440,2ptp4l0-21swapper/120:42:041
117691440,2ptp4l0-21swapper/120:30:351
117691440,2ptp4l0-21swapper/023:59:530
117691440,1ptp4l0-21swapper/323:17:193
117691440,1ptp4l0-21swapper/323:12:493
117691440,1ptp4l0-21swapper/219:26:392
117691440,1ptp4l0-21swapper/121:36:111
117691440,11ptp4l0-21swapper/020:23:080
117691440,10ptp4l0-21swapper/021:15:100
31216994324,5cyclictest41-21ksoftirqd/300:05:183
31216994324,4cyclictest41-21ksoftirqd/322:55:133
31216994324,4cyclictest41-21ksoftirqd/319:50:323
31216994323,5cyclictest41-21ksoftirqd/320:10:163
31216994323,4cyclictest41-21ksoftirqd/321:55:173
31216994321,4cyclictest41-21ksoftirqd/323:55:183
31216994311,4cyclictest121rcu_preempt21:30:153
31215994326,4cyclictest33-21ksoftirqd/223:00:152
31215994326,4cyclictest33-21ksoftirqd/223:00:152
31215994321,4cyclictest33-21ksoftirqd/220:45:142
117691430,8ptp4l0-21swapper/122:11:081
117691430,5ptp4l32494-21chrt23:46:471
117691430,2ptp4l0-21swapper/221:22:142
117691430,2ptp4l0-21swapper/220:29:572
117691430,2ptp4l0-21swapper/220:29:572
117691430,2ptp4l0-21swapper/023:21:230
117691430,1ptp4l0-21swapper/120:23:351
117691430,1ptp4l0-21swapper/100:22:211
117691430,1ptp4l0-21swapper/100:22:201
117691430,1ptp4l0-21swapper/000:10:150
3121699424,3cyclictest121rcu_preempt00:27:023
31216994225,4cyclictest41-21ksoftirqd/323:35:003
31216994224,4cyclictest41-21ksoftirqd/323:00:093
31216994224,4cyclictest41-21ksoftirqd/323:00:093
31216994223,5cyclictest41-21ksoftirqd/321:25:233
31216994223,5cyclictest41-21ksoftirqd/300:35:333
31216994223,4cyclictest41-21ksoftirqd/319:40:013
3121699421,9cyclictest41-21ksoftirqd/300:13:103
3121699421,4cyclictest41-21ksoftirqd/322:50:313
31216994211,3cyclictest121rcu_preempt21:00:163
3121599424,5cyclictest33-21ksoftirqd/200:05:372
117691420,6ptp4l572-21df_inode22:40:160
117691420,6ptp4l16749-21iostat_ios22:05:211
117691420,5ptp4l6094-21hddtemp_smartct00:00:180
117691420,5ptp4l29074-21iostat23:40:180
117691420,5ptp4l28001-21meminfo20:10:211
117691420,5ptp4l21420-21meminfo21:05:240
117691420,5ptp4l1631-21ls23:50:261
117691420,4ptp4l6803-21apt-get21:45:110
117691420,4ptp4l6803-21apt-get21:45:110
117691420,3ptp4l0-21swapper/222:35:322
117691420,2ptp4l0-21swapper/222:00:282
117691420,2ptp4l0-21swapper/221:45:012
117691420,2ptp4l0-21swapper/221:45:012
117691420,2ptp4l0-21swapper/221:26:002
117691420,2ptp4l0-21swapper/220:51:052
117691420,2ptp4l0-21swapper/220:35:032
117691420,2ptp4l0-21swapper/219:20:542
117691420,2ptp4l0-21swapper/200:02:572
117691420,2ptp4l0-21swapper/122:31:141
117691420,2ptp4l0-21swapper/120:35:131
117691420,2ptp4l0-21swapper/023:06:180
117691420,2ptp4l0-21swapper/022:51:220
117691420,2ptp4l0-21swapper/000:20:100
117691420,2ptp4l0-21swapper/000:20:090
3121699419,10cyclictest41-21ksoftirqd/321:45:163
3121699419,10cyclictest41-21ksoftirqd/321:45:153
31216994124,4cyclictest41-21ksoftirqd/322:10:253
31216994124,4cyclictest41-21ksoftirqd/320:55:123
31216994124,4cyclictest41-21ksoftirqd/300:15:303
31216994123,5cyclictest41-21ksoftirqd/322:00:273
31216994123,4cyclictest41-21ksoftirqd/321:40:333
31216994122,5cyclictest41-21ksoftirqd/320:00:223
31216994122,4cyclictest41-21ksoftirqd/322:20:303
31216994121,5cyclictest41-21ksoftirqd/300:30:283
3121699411,10cyclictest41-21ksoftirqd/323:20:323
3121699410,8cyclictest41-21ksoftirqd/323:43:143
117691410,5ptp4l9472-21unixbench_multi00:05:371
117691410,5ptp4l31921-21ps23:45:290
117691410,5ptp4l30246-21diskstats21:25:170
117691410,5ptp4l19217-21df_abs23:20:131
117691410,5ptp4l19101-21memory21:00:240
117691410,5ptp4l16119-21meminfo19:45:220
117691410,5ptp4l1310-21ps23:50:230
117691410,4ptp4l661-21meminfo21:30:211
117691410,4ptp4l2524-21df_inode21:35:160
117691410,4ptp4l2177-21meminfo19:15:210
117691410,4ptp4l17003-21memory22:05:250
117691410,4ptp4l0-21swapper/021:30:260
117691410,3ptp4l11540-21ls19:35:250
117691410,2ptp4l0-21swapper/321:52:233
117691410,2ptp4l0-21swapper/321:20:113
117691410,2ptp4l0-21swapper/220:10:592
117691410,2ptp4l0-21swapper/200:31:512
117691410,2ptp4l0-21swapper/121:25:451
117691410,2ptp4l0-21swapper/121:11:541
117691410,2ptp4l0-21swapper/119:52:381
117691410,2ptp4l0-21swapper/023:39:590
117691410,2ptp4l0-21swapper/022:13:070
117691410,2ptp4l0-21swapper/021:40:110
117691410,2ptp4l0-21swapper/020:17:560
117691410,1ptp4l0-21swapper/119:56:181
3121699405,7cyclictest121rcu_preempt20:16:503
31216994024,5cyclictest41-21ksoftirqd/322:15:273
31216994023,4cyclictest41-21ksoftirqd/322:40:163
31216994023,4cyclictest41-21ksoftirqd/321:15:233
31216994022,4cyclictest41-21ksoftirqd/320:50:193
31216994022,4cyclictest41-21ksoftirqd/320:25:153
31216994022,4cyclictest41-21ksoftirqd/320:25:143
31216994019,5cyclictest41-21ksoftirqd/300:20:123
31216994019,5cyclictest41-21ksoftirqd/300:20:113
3121699401,10cyclictest41-21ksoftirqd/319:58:563
3121699400,8cyclictest41-21ksoftirqd/323:35:183
117691400,4ptp4l5952-21df_inode00:00:141
117691400,4ptp4l23793-21meminfo21:10:250
117691400,4ptp4l101ktimersoftd/022:00:300
117691400,3ptp4l26104-21ls21:15:211
117691400,2ptp4l0-21swapper/122:55:121
117691400,2ptp4l0-21swapper/100:30:331
117691400,2ptp4l0-21swapper/023:15:230
117691400,2ptp4l0-21swapper/021:22:380
117691400,2ptp4l0-21swapper/020:45:580
117691400,2ptp4l0-21swapper/020:27:460
117691400,2ptp4l0-21swapper/020:27:450
31216993928,3cyclictest41-21ksoftirqd/319:40:263
31216993922,4cyclictest41-21ksoftirqd/322:30:283
31216993922,4cyclictest41-21ksoftirqd/320:45:163
31216993920,3cyclictest41-21ksoftirqd/320:34:463
117691390,3ptp4l24658-21ls23:30:210
117691390,2ptp4l0-21swapper/123:05:121
117691390,2ptp4l0-21swapper/100:10:161
117691390,10ptp4l0-21swapper/319:23:303
3121699382,3cyclictest121rcu_preempt19:18:413
31216993823,4cyclictest41-21ksoftirqd/321:15:003
31216993820,4cyclictest41-21ksoftirqd/323:45:323
117691380,2ptp4l0-21swapper/300:00:273
31216993720,4cyclictest41-21ksoftirqd/319:25:263
117691370,2ptp4l0-21swapper/321:35:123
117691370,2ptp4l0-21swapper/321:07:043
31216993619,4cyclictest41-21ksoftirqd/323:50:213
117691360,2ptp4l0-21swapper/320:35:073
31216993529,3cyclictest41-21ksoftirqd/322:25:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional