You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-25 - 07:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot1.osadl.org (updated Tue Jun 25, 2024 00:46:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1176911720,12ptp4l0-21swapper/219:09:552
1176911660,13ptp4l0-21swapper/019:08:410
1176911570,12ptp4l0-21swapper/319:09:093
930221440,6sleep32821499cyclictest00:10:203
1176911410,15ptp4l0-21swapper/119:08:231
117691730,1ptp4l0-21swapper/020:04:480
219782720,5sleep0111rcuc/000:35:380
117691680,7ptp4l29355-21latency_hist23:45:001
117691680,2ptp4l0-21swapper/123:20:341
117691670,4ptp4l11433-21python19:40:441
280952660,8sleep32821499cyclictest21:25:133
117691650,2ptp4l0-21swapper/223:19:592
117691650,2ptp4l0-21swapper/023:59:200
117691630,2ptp4l0-21swapper/119:27:141
28214996212,32cyclictest28310-21fschecks_time20:15:193
324172600,8sleep22821399cyclictest23:50:222
117691600,1ptp4l0-21swapper/123:09:501
117691600,1ptp4l0-21swapper/121:04:331
28211995926,7cyclictest9-21ksoftirqd/019:44:560
117691590,2ptp4l0-21swapper/019:50:240
28211995812,8cyclictest9-21ksoftirqd/019:45:080
117691580,2ptp4l0-21swapper/122:25:111
117691580,2ptp4l0-21swapper/020:45:410
117691580,1ptp4l0-21swapper/123:33:271
117691580,1ptp4l0-21swapper/021:06:500
117691570,2ptp4l0-21swapper/223:45:322
117691570,2ptp4l0-21swapper/220:52:082
117691570,1ptp4l0-21swapper/121:09:291
117691570,1ptp4l0-21swapper/021:30:140
2821199564,4cyclictest121rcu_preempt21:16:380
2821199564,4cyclictest121rcu_preempt21:16:370
117691560,2ptp4l0-21swapper/222:25:302
117691560,2ptp4l0-21swapper/222:00:152
117691560,2ptp4l0-21swapper/220:20:212
117691560,2ptp4l0-21swapper/023:49:350
117691560,2ptp4l0-21swapper/022:45:120
117691560,2ptp4l0-21swapper/020:39:410
117691560,2ptp4l0-21swapper/020:30:090
117691560,1ptp4l0-21swapper/123:15:551
117691560,1ptp4l0-21swapper/023:05:180
117691560,1ptp4l0-21swapper/020:07:120
117691560,15ptp4l0-21swapper/323:52:473
117691550,2ptp4l0-21swapper/223:55:242
117691550,2ptp4l0-21swapper/222:10:182
117691550,2ptp4l0-21swapper/221:05:212
117691550,2ptp4l0-21swapper/121:54:501
117691550,2ptp4l0-21swapper/120:31:451
117691550,2ptp4l0-21swapper/021:41:380
117691550,2ptp4l0-21swapper/019:13:400
117691550,2ptp4l0-21swapper/000:01:330
28211995419,11cyclictest9-21ksoftirqd/021:39:030
213492540,3sleep121343-21sendmail-msp22:20:001
117691540,7ptp4l0-21swapper/119:14:411
117691540,5ptp4l4039-21ntp_states21:40:281
117691540,2ptp4l0-21swapper/221:35:172
117691540,2ptp4l0-21swapper/122:09:011
117691540,2ptp4l0-21swapper/023:00:420
117691540,2ptp4l0-21swapper/022:36:110
117691540,2ptp4l0-21swapper/022:36:100
117691540,1ptp4l0-21swapper/100:31:261
117691540,1ptp4l0-21swapper/023:51:520
117691540,1ptp4l0-21swapper/021:45:220
117691530,2ptp4l0-21swapper/222:42:592
117691530,2ptp4l0-21swapper/100:13:111
117691530,2ptp4l0-21swapper/023:12:150
117691530,2ptp4l0-21swapper/020:21:560
117691530,2ptp4l0-21swapper/000:25:270
117691530,1ptp4l0-21swapper/123:02:161
117691530,1ptp4l0-21swapper/019:29:450
117691530,11ptp4l0-21swapper/122:59:581
2821199524,5cyclictest9-21ksoftirqd/020:51:420
117691520,2ptp4l0-21swapper/223:09:142
117691520,2ptp4l0-21swapper/222:56:582
117691520,2ptp4l0-21swapper/222:20:562
117691520,2ptp4l0-21swapper/221:44:082
117691520,2ptp4l0-21swapper/221:03:552
117691520,2ptp4l0-21swapper/219:14:182
117691520,2ptp4l0-21swapper/200:30:162
117691520,2ptp4l0-21swapper/200:19:382
117691520,2ptp4l0-21swapper/022:15:430
117691520,1ptp4l0-21swapper/022:08:320
28212995116,5cyclictest25-21ksoftirqd/119:45:021
28211995125,8cyclictest9-21ksoftirqd/021:53:310
117791510,10getstats0-21swapper/223:25:142
117691510,2ptp4l0-21swapper/221:34:282
117691510,2ptp4l0-21swapper/220:35:062
117691510,2ptp4l0-21swapper/200:24:152
117691510,2ptp4l0-21swapper/022:55:240
117691510,2ptp4l0-21swapper/000:30:270
117691510,2ptp4l0-21swapper/000:24:340
117691510,2ptp4l0-21swapper/000:05:590
117691510,15ptp4l0-21swapper/321:05:133
117691500,7ptp4l0-21swapper/121:57:031
117691500,2ptp4l0-21swapper/222:47:422
117691500,2ptp4l0-21swapper/220:33:392
117691500,2ptp4l0-21swapper/120:11:031
117691500,2ptp4l0-21swapper/023:20:270
117691500,2ptp4l0-21swapper/022:25:250
117691500,2ptp4l0-21swapper/000:18:590
117691500,12ptp4l1673-21apt-get23:55:121
117691500,10ptp4l0-21swapper/122:34:521
117691500,10ptp4l0-21swapper/020:15:250
117691490,8ptp4l0-21swapper/221:26:122
117691490,2ptp4l0-21swapper/223:43:102
117691490,2ptp4l0-21swapper/220:49:442
117691490,2ptp4l0-21swapper/220:11:432
117691490,2ptp4l0-21swapper/200:35:282
117691490,2ptp4l0-21swapper/121:37:011
117691490,2ptp4l0-21swapper/022:20:340
117791480,9getstats0-21swapper/219:15:172
117691480,8ptp4l0-21swapper/223:34:512
117691480,8ptp4l0-21swapper/223:04:522
117691480,8ptp4l0-21swapper/221:22:182
117691480,8ptp4l0-21swapper/221:10:452
117691480,8ptp4l0-21swapper/219:36:572
117691480,8ptp4l0-21swapper/200:14:022
117691480,8ptp4l0-21swapper/200:01:162
117691480,2ptp4l0-21swapper/219:44:362
117691480,2ptp4l0-21swapper/123:45:281
117691480,2ptp4l0-21swapper/123:38:101
117691480,2ptp4l0-21swapper/122:44:231
117691480,2ptp4l0-21swapper/119:54:471
117691480,2ptp4l0-21swapper/023:25:180
117691480,1ptp4l0-21swapper/023:41:580
117691480,1ptp4l0-21swapper/020:13:530
28211994735,4cyclictest9-21ksoftirqd/022:40:170
117691470,8ptp4l0-21swapper/219:56:202
117691470,8ptp4l0-21swapper/219:56:202
117691470,2ptp4l0-21swapper/323:46:203
117691470,2ptp4l0-21swapper/323:09:003
117691470,2ptp4l0-21swapper/319:19:203
117691470,2ptp4l0-21swapper/300:17:103
117691470,2ptp4l0-21swapper/221:59:492
117691470,2ptp4l0-21swapper/123:25:101
117691470,2ptp4l0-21swapper/021:03:470
117691470,1ptp4l0-21swapper/322:49:483
117691470,1ptp4l0-21swapper/021:55:200
117691470,11ptp4l20369-21ntp_states22:15:382
117691470,10ptp4l0-21swapper/119:15:431
28211994624,7cyclictest9-21ksoftirqd/020:40:140
28211994616,9cyclictest9-21ksoftirqd/000:10:180
117691460,9ptp4l0-21swapper/120:50:021
117691460,8ptp4l0-21swapper/222:32:222
117691460,8ptp4l0-21swapper/220:56:432
117691460,8ptp4l0-21swapper/220:19:262
117691460,8ptp4l0-21swapper/219:28:152
117691460,8ptp4l0-21swapper/121:28:371
117691460,8ptp4l0-21swapper/100:01:421
117691460,7ptp4l0-21swapper/219:49:582
117691460,6ptp4l16566-21irqrtprio00:25:262
117691460,2ptp4l0-21swapper/223:11:282
117691460,2ptp4l0-21swapper/100:15:311
117691460,1ptp4l0-21swapper/321:43:283
117691460,1ptp4l0-21swapper/100:28:061
117691460,1ptp4l0-21swapper/021:12:100
117691460,11ptp4l30254-21grep20:20:121
28211994517,5cyclictest9-21ksoftirqd/023:15:240
28211994514,5cyclictest9-21ksoftirqd/019:30:260
117691450,9ptp4l0-21swapper/219:24:202
117691450,8ptp4l0-21swapper/222:08:062
117691450,8ptp4l0-21swapper/120:41:291
117691450,8ptp4l0-21swapper/022:10:290
117691450,8ptp4l0-21swapper/019:56:430
117691450,8ptp4l0-21swapper/019:56:430
117691450,7ptp4l0-21swapper/120:17:481
117691450,5ptp4l0-21swapper/020:26:280
117691450,4ptp4l33-21ksoftirqd/221:47:142
117691450,3ptp4l0-21swapper/200:05:342
117691450,2ptp4l0-21swapper/323:20:233
117691450,2ptp4l0-21swapper/222:37:482
117691450,2ptp4l0-21swapper/222:37:472
117691450,2ptp4l0-21swapper/221:53:032
117691450,2ptp4l0-21swapper/221:16:232
117691450,2ptp4l0-21swapper/221:16:232
117691450,2ptp4l0-21swapper/122:24:141
117691450,1ptp4l0-21swapper/121:31:041
117691450,1ptp4l0-21swapper/120:00:071
117691450,1ptp4l0-21swapper/023:37:130
28214994416,24cyclictest1675-21systemd19:44:423
2821499440,22cyclictest117691ptp4l21:55:183
2821199448,10cyclictest9-21ksoftirqd/019:35:150
117691440,8ptp4l0-21swapper/119:20:491
117691440,5ptp4l14710-21phc2sys00:20:341
117691440,4ptp4l5897-21iostat19:30:231
117691440,2ptp4l0-21swapper/300:30:413
117691440,2ptp4l0-21swapper/222:50:282
117691440,2ptp4l0-21swapper/121:15:121
117691440,2ptp4l0-21swapper/121:15:111
117691440,2ptp4l0-21swapper/022:01:350
117691440,1ptp4l0-21swapper/020:59:510
117691440,1ptp4l0-21swapper/019:21:500
2821499432,34cyclictest507-21apt-get19:20:143
117691430,8ptp4l0-21swapper/021:26:260
117691430,5ptp4l25914-21cpuspeed_turbos21:20:151
117691430,4ptp4l17831-21apt-get23:20:122
117691430,2ptp4l0-21swapper/123:11:181
117691430,2ptp4l0-21swapper/122:10:461
117691430,2ptp4l0-21swapper/120:27:131
117691430,2ptp4l0-21swapper/023:30:560
2821499422,35cyclictest0-21swapper/322:10:143
2821499422,32cyclictest25476-21apt-get20:10:123
2821499421,28cyclictest117691ptp4l22:50:123
28211994236,3cyclictest9-21ksoftirqd/022:30:110
117691420,8ptp4l0-21swapper/120:09:541
117691420,5ptp4l9920-21hddtemp_smartct20:45:221
117691420,5ptp4l8728-21users20:40:382
117691420,5ptp4l5558-21irqstats20:35:241
117691420,5ptp4l23054-21if_enp4s023:30:183
117691420,4ptp4l22487-21users20:00:392
117691420,2ptp4l0-21swapper/223:38:512
117691420,2ptp4l0-21swapper/219:50:192
117691420,2ptp4l0-21swapper/219:31:232
117691420,2ptp4l0-21swapper/122:49:051
117691420,2ptp4l0-21swapper/121:11:531
28212994124,4cyclictest25-21ksoftirqd/120:00:001
28212994124,4cyclictest25-21ksoftirqd/120:00:001
117691410,5ptp4l8680-21meminfo19:35:241
117691410,5ptp4l3792-21diskstats22:50:181
117691410,4ptp4l6331-21ntp_states19:30:333
117691410,4ptp4l31048-21fschecks_count19:15:190
117691410,4ptp4l22769-21systemctl00:40:013
117691410,4ptp4l14713-21apt-get23:15:043
117691410,3ptp4l13178-21ls22:00:281
117691410,2ptp4l0-21swapper/220:25:042
117691410,2ptp4l0-21swapper/220:06:082
117691410,1ptp4l0-21swapper/121:48:541
2821499403,31cyclictest9403-21apt-get20:45:153
2821499403,31cyclictest16191-21apt-get19:50:123
2821499403,31cyclictest12269-21apt-get22:00:123
28214994011,25cyclictest6907-21unixbench_singl21:45:413
2821299403,4cyclictest1142-21runrttasks00:38:301
117691400,7ptp4l0-21swapper/120:56:421
117691400,5ptp4l25979-21cstates21:20:160
117691400,4ptp4l29892-21python22:35:341
117691400,4ptp4l29892-21python22:35:331
117691400,4ptp4l26185-21acpi22:30:103
117691400,4ptp4l13678-21ls23:10:253
117691400,2ptp4l0-21swapper/322:05:383
117691400,2ptp4l0-21swapper/100:05:251
117691400,2ptp4l0-21swapper/022:50:260
2821499393,30cyclictest25777-21apt-get21:20:133
2821499392,32cyclictest5725-21apt-get22:55:123
2821499391,32cyclictest0-21swapper/321:00:123
2821499391,31cyclictest0-21swapper/321:50:123
117691390,5ptp4l28835-21cstates22:35:143
117691390,5ptp4l28835-21cstates22:35:133
117691390,4ptp4l3512-21ntp_states20:30:273
117691390,4ptp4l19314-21/usr/sbin/munin19:55:233
117691390,4ptp4l19314-21/usr/sbin/munin19:55:233
117691390,4ptp4l1840-21cpuspeed_turbos23:55:163
117691390,3ptp4l20266-21ls22:15:353
117691390,2ptp4l0-21swapper/322:40:313
2821499382,29cyclictest0-21swapper/323:00:103
28214993811,23cyclictest8707-21missed_timers19:35:253
2821499380,4cyclictest22073-21/usr/sbin/munin20:00:333
2821499380,4cyclictest16407-21hddtemp_smartct00:25:213
2821499380,2cyclictest0-21swapper/300:05:133
117691380,4ptp4l216-21systemd-journal23:51:361
117691380,2ptp4l0-21swapper/321:35:323
117691380,2ptp4l0-21swapper/300:20:223
2821499373,30cyclictest27798-21irqrtprio23:40:223
2821499371,31cyclictest0-21swapper/322:25:113
2821499370,3cyclictest14618-21irqrtprio19:45:253
117691370,2ptp4l0-21swapper/322:20:203
117691370,2ptp4l0-21swapper/321:18:103
117691370,2ptp4l0-21swapper/321:18:103
117691370,2ptp4l0-21swapper/320:58:423
117691370,2ptp4l0-21swapper/320:35:313
117691370,2ptp4l0-21swapper/320:29:203
117691370,2ptp4l0-21swapper/320:20:163
117691370,2ptp4l0-21swapper/319:25:143
117691370,2ptp4l0-21swapper/319:10:323
117691360,2ptp4l0-21swapper/323:35:133
117691360,2ptp4l0-21swapper/323:27:463
117691360,2ptp4l0-21swapper/321:31:383
117691360,2ptp4l0-21swapper/320:40:383
117691360,1ptp4l0-21swapper/321:12:293
2821499350,2cyclictest0-21swapper/300:00:213
2821499340,2cyclictest0-21swapper/320:05:173
28214993310,20cyclictest11844-21cpuspeed_turbos20:50:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional