You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-27 - 17:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot2.osadl.org (updated Mon May 27, 2024 00:46:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2207425140,9sleep20-21swapper/219:05:152
360221830,8sleep02409599cyclictest00:09:100
235402141120,10sleep10-21swapper/119:06:351
1235911290,59ptp4l41-21ksoftirqd/319:06:553
1235911000,7ptp4l2409899cyclictest23:17:533
204252860,2sleep00-21swapper/021:20:010
204252860,2sleep00-21swapper/021:20:000
235742758,18sleep00-21swapper/019:07:030
24098997437,4cyclictest41-21ksoftirqd/323:00:353
24098997431,11cyclictest41-21ksoftirqd/320:10:103
24096996954,8cyclictest25-21ksoftirqd/100:15:131
24096996954,8cyclictest25-21ksoftirqd/100:15:121
220752690,2sleep10-21swapper/123:40:161
24098996634,9cyclictest41-21ksoftirqd/322:20:333
2409899654,10cyclictest10336-21grep00:20:473
24098996431,9cyclictest41-21ksoftirqd/319:30:583
24098996232,8cyclictest41-21ksoftirqd/323:07:383
24098996232,8cyclictest41-21ksoftirqd/320:29:273
24098996026,9cyclictest41-21ksoftirqd/322:45:373
24096996047,10cyclictest25-21ksoftirqd/121:50:011
211512600,6sleep2321ktimersoftd/222:30:122
24098995829,8cyclictest41-21ksoftirqd/320:33:493
24098995828,9cyclictest41-21ksoftirqd/322:50:133
24098995828,9cyclictest41-21ksoftirqd/322:50:123
57698570,2rtkit-daemon0-21swapper/121:18:411
57698570,2rtkit-daemon0-21swapper/121:18:401
31192570,3sleep33122-21irqrtprio21:50:233
24096995642,7cyclictest25-21ksoftirqd/122:35:111
24098995541,11cyclictest41-21ksoftirqd/321:25:353
24096995548,4cyclictest25-21ksoftirqd/100:40:001
24098995436,8cyclictest41-21ksoftirqd/323:43:063
24096995446,4cyclictest25-21ksoftirqd/122:10:001
24098995349,2cyclictest391rcuc/319:23:243
24098995348,3cyclictest41-21ksoftirqd/323:10:163
24098995324,9cyclictest41-21ksoftirqd/319:29:053
24096995346,4cyclictest25-21ksoftirqd/123:50:001
24096995346,3cyclictest25-21ksoftirqd/122:10:161
24096995340,10cyclictest25-21ksoftirqd/122:05:011
57698520,17rtkit-daemon25262-21snmpd21:21:190
57698520,17rtkit-daemon25262-21snmpd21:21:190
296062520,2sleep20-21swapper/222:45:342
295442520,3sleep10-21swapper/122:45:321
24098995247,3cyclictest391rcuc/319:35:593
24098995224,9cyclictest41-21ksoftirqd/300:02:253
24096995246,3cyclictest25-21ksoftirqd/120:35:011
24096995246,3cyclictest25-21ksoftirqd/120:30:011
24096995246,3cyclictest25-21ksoftirqd/100:10:001
24096995245,4cyclictest25-21ksoftirqd/122:00:001
24096995245,4cyclictest25-21ksoftirqd/100:15:011
24098995146,3cyclictest41-21ksoftirqd/321:40:353
24098995146,3cyclictest391rcuc/319:10:283
24098995123,9cyclictest41-21ksoftirqd/319:50:123
24096995144,4cyclictest25-21ksoftirqd/119:45:001
24096995144,4cyclictest25-21ksoftirqd/119:40:001
24096995144,4cyclictest25-21ksoftirqd/119:19:591
24096995144,3cyclictest25-21ksoftirqd/100:35:001
24096995143,5cyclictest1-21systemd20:08:161
24098995044,4cyclictest41-21ksoftirqd/320:55:223
24098995044,4cyclictest41-21ksoftirqd/320:35:183
24098995044,4cyclictest41-21ksoftirqd/300:25:283
24098995044,3cyclictest41-21ksoftirqd/323:20:303
24098995043,4cyclictest41-21ksoftirqd/321:45:333
24098995030,8cyclictest41-21ksoftirqd/320:17:043
24096995043,4cyclictest25-21ksoftirqd/120:20:011
24096995042,4cyclictest25-21ksoftirqd/123:15:011
24098994944,3cyclictest41-21ksoftirqd/322:05:113
24098994942,4cyclictest41-21ksoftirqd/322:00:393
2409899492,5cyclictest0-21swapper/320:50:263
24098994921,8cyclictest41-21ksoftirqd/323:50:443
24097994929,4cyclictest33-21ksoftirqd/222:20:532
24096994943,4cyclictest25-21ksoftirqd/121:05:001
24096994943,3cyclictest25-21ksoftirqd/100:00:001
24096994942,4cyclictest25-21ksoftirqd/123:00:001
24096994941,5cyclictest25-21ksoftirqd/120:50:101
2409899482,5cyclictest0-21swapper/319:43:273
24096994842,3cyclictest25-21ksoftirqd/120:40:001
123591480,1ptp4l401ktimersoftd/322:10:133
24098994742,3cyclictest41-21ksoftirqd/322:35:223
24098994742,3cyclictest41-21ksoftirqd/320:25:013
24098994742,3cyclictest41-21ksoftirqd/300:30:153
24098994741,4cyclictest41-21ksoftirqd/300:10:213
24098994741,3cyclictest41-21ksoftirqd/322:25:183
24098994741,3cyclictest41-21ksoftirqd/321:10:133
24098994728,7cyclictest41-21ksoftirqd/323:59:133
24098994720,9cyclictest41-21ksoftirqd/320:02:093
24096994742,3cyclictest25-21ksoftirqd/123:55:001
24096994741,4cyclictest25-21ksoftirqd/121:09:591
24096994741,3cyclictest25-21ksoftirqd/123:05:001
24096994741,3cyclictest25-21ksoftirqd/122:20:001
24098994641,3cyclictest41-21ksoftirqd/322:55:353
24098994641,3cyclictest41-21ksoftirqd/322:30:273
24098994640,3cyclictest41-21ksoftirqd/322:45:013
24098994640,3cyclictest41-21ksoftirqd/322:45:003
24098994639,5cyclictest41-21ksoftirqd/322:15:163
24098994639,5cyclictest41-21ksoftirqd/321:00:133
24098994639,4cyclictest41-21ksoftirqd/323:35:173
24098994639,4cyclictest41-21ksoftirqd/321:20:143
24098994639,4cyclictest41-21ksoftirqd/321:20:133
24097994626,4cyclictest33-21ksoftirqd/220:55:122
24096994640,4cyclictest25-21ksoftirqd/121:20:251
24096994640,4cyclictest25-21ksoftirqd/121:20:241
24096994640,4cyclictest25-21ksoftirqd/120:10:361
24096994640,3cyclictest25-21ksoftirqd/120:05:001
24096994640,3cyclictest25-21ksoftirqd/100:25:001
24096994639,4cyclictest25-21ksoftirqd/123:20:011
24098994541,2cyclictest391rcuc/323:30:173
24098994540,3cyclictest41-21ksoftirqd/300:05:353
24097994526,4cyclictest33-21ksoftirqd/200:38:432
24096994540,3cyclictest25-21ksoftirqd/121:55:001
24096994539,4cyclictest25-21ksoftirqd/121:10:381
24096994539,4cyclictest25-21ksoftirqd/119:15:001
24096994539,3cyclictest25-21ksoftirqd/121:35:001
24096994538,4cyclictest25-21ksoftirqd/119:35:001
123591450,1ptp4l401ktimersoftd/321:34:143
24098994439,3cyclictest41-21ksoftirqd/321:15:293
24098994439,3cyclictest41-21ksoftirqd/321:15:293
24098994439,3cyclictest41-21ksoftirqd/300:35:313
24096994439,3cyclictest25-21ksoftirqd/120:00:001
24096994439,3cyclictest25-21ksoftirqd/120:00:001
24096994438,4cyclictest25-21ksoftirqd/121:00:001
24095994437,4cyclictest9-21ksoftirqd/022:06:100
24098994338,3cyclictest41-21ksoftirqd/321:35:243
24098994338,3cyclictest41-21ksoftirqd/320:05:233
24098994338,3cyclictest41-21ksoftirqd/319:45:383
24096994337,4cyclictest25-21ksoftirqd/122:20:231
24098994238,2cyclictest391rcuc/320:41:103
24098994238,2cyclictest391rcuc/300:17:213
24098994238,2cyclictest391rcuc/300:17:213
24098994237,3cyclictest41-21ksoftirqd/320:45:283
24098994235,5cyclictest41-21ksoftirqd/321:55:163
24097994237,3cyclictest33-21ksoftirqd/223:59:592
24096994236,4cyclictest25-21ksoftirqd/122:35:001
24096994236,4cyclictest25-21ksoftirqd/121:35:251
24096994236,3cyclictest25-21ksoftirqd/122:55:001
24096994236,3cyclictest25-21ksoftirqd/122:55:001
24096994236,3cyclictest25-21ksoftirqd/120:40:211
24096994235,5cyclictest25-21ksoftirqd/122:25:321
24096994235,4cyclictest25-21ksoftirqd/100:04:591
24096994235,3cyclictest25-21ksoftirqd/123:30:221
24095994235,4cyclictest9-21ksoftirqd/023:57:420
24098994137,2cyclictest391rcuc/323:26:543
24098994135,3cyclictest41-21ksoftirqd/319:55:163
24098994135,3cyclictest41-21ksoftirqd/319:55:153
24098994116,10cyclictest41-21ksoftirqd/321:05:153
24097994134,4cyclictest33-21ksoftirqd/220:10:052
24097994133,5cyclictest33-21ksoftirqd/221:06:262
24096994135,4cyclictest25-21ksoftirqd/120:24:101
24096994135,4cyclictest25-21ksoftirqd/100:26:221
24096994135,3cyclictest25-21ksoftirqd/123:20:121
24096994135,3cyclictest25-21ksoftirqd/122:45:011
24096994135,3cyclictest25-21ksoftirqd/122:45:001
24096994133,5cyclictest25-21ksoftirqd/121:27:281
24095994134,4cyclictest9-21ksoftirqd/020:12:350
309432400,7sleep02409599cyclictest22:50:140
309432400,7sleep02409599cyclictest22:50:130
24098994014,4cyclictest41-21ksoftirqd/323:45:243
24097994033,4cyclictest33-21ksoftirqd/221:42:192
24096994035,3cyclictest25-21ksoftirqd/123:35:181
24096994033,4cyclictest25-21ksoftirqd/119:50:351
24096994033,4cyclictest25-21ksoftirqd/119:25:201
24095994034,4cyclictest9-21ksoftirqd/022:10:200
24095994034,3cyclictest9-21ksoftirqd/020:18:360
24095994033,4cyclictest9-21ksoftirqd/022:15:570
24095994033,4cyclictest9-21ksoftirqd/020:26:280
24095994033,4cyclictest9-21ksoftirqd/019:22:050
24095994033,4cyclictest9-21ksoftirqd/000:38:040
24095994031,5cyclictest9-21ksoftirqd/020:00:000
24095994031,5cyclictest9-21ksoftirqd/020:00:000
24095994019,4cyclictest9-21ksoftirqd/019:44:300
24098993934,3cyclictest41-21ksoftirqd/319:15:153
24097993934,3cyclictest33-21ksoftirqd/220:17:382
24097993932,4cyclictest33-21ksoftirqd/223:51:222
24097993932,4cyclictest33-21ksoftirqd/220:32:162
24097993931,5cyclictest33-21ksoftirqd/223:14:042
24097993931,5cyclictest33-21ksoftirqd/222:59:182
24097993931,5cyclictest33-21ksoftirqd/219:46:452
2409799390,3cyclictest121rcu_preempt21:20:522
2409799390,3cyclictest121rcu_preempt21:20:512
24096993933,3cyclictest25-21ksoftirqd/119:50:001
24096993932,4cyclictest25-21ksoftirqd/120:50:001
24095993933,3cyclictest9-21ksoftirqd/023:19:400
24095993932,4cyclictest9-21ksoftirqd/022:31:130
24095993932,4cyclictest9-21ksoftirqd/020:50:210
24095993932,4cyclictest9-21ksoftirqd/000:30:110
24097993832,3cyclictest33-21ksoftirqd/223:08:402
24097993832,3cyclictest33-21ksoftirqd/221:14:512
24097993831,4cyclictest33-21ksoftirqd/219:42:062
24097993831,4cyclictest33-21ksoftirqd/219:33:282
24097993830,5cyclictest33-21ksoftirqd/220:42:332
24096993831,4cyclictest25-21ksoftirqd/123:25:171
24096993831,4cyclictest25-21ksoftirqd/119:24:041
24095993832,4cyclictest9-21ksoftirqd/019:25:430
24095993832,4cyclictest9-21ksoftirqd/000:11:310
24095993832,3cyclictest9-21ksoftirqd/021:07:350
24095993832,3cyclictest9-21ksoftirqd/020:06:010
24095993832,3cyclictest9-21ksoftirqd/019:51:470
24095993832,3cyclictest9-21ksoftirqd/000:00:180
24095993831,4cyclictest9-21ksoftirqd/023:22:370
24095993831,4cyclictest9-21ksoftirqd/022:56:230
24095993831,4cyclictest9-21ksoftirqd/022:28:010
24095993831,4cyclictest9-21ksoftirqd/021:40:360
24095993831,4cyclictest9-21ksoftirqd/021:36:500
24095993831,4cyclictest9-21ksoftirqd/020:46:040
24095993831,4cyclictest9-21ksoftirqd/020:00:590
24097993732,3cyclictest33-21ksoftirqd/222:07:122
24097993731,3cyclictest33-21ksoftirqd/222:02:272
24097993731,3cyclictest33-21ksoftirqd/220:51:222
24097993730,4cyclictest33-21ksoftirqd/222:53:562
24097993730,4cyclictest33-21ksoftirqd/222:53:562
24097993730,4cyclictest33-21ksoftirqd/221:34:442
24097993729,5cyclictest33-21ksoftirqd/222:26:472
24095993731,4cyclictest9-21ksoftirqd/022:22:580
24095993731,4cyclictest9-21ksoftirqd/021:11:250
24095993731,3cyclictest9-21ksoftirqd/023:48:420
24095993731,3cyclictest9-21ksoftirqd/000:23:310
24097993631,3cyclictest33-21ksoftirqd/220:48:222
24097993630,3cyclictest33-21ksoftirqd/222:41:312
24097993630,3cyclictest33-21ksoftirqd/222:41:302
24097993630,3cyclictest33-21ksoftirqd/221:27:472
24097993629,4cyclictest33-21ksoftirqd/223:35:122
24097993629,4cyclictest33-21ksoftirqd/223:27:092
24097993629,4cyclictest33-21ksoftirqd/223:00:572
24097993629,4cyclictest33-21ksoftirqd/221:50:442
24097993629,4cyclictest33-21ksoftirqd/220:24:102
24097993629,4cyclictest33-21ksoftirqd/220:05:192
24097993628,5cyclictest33-21ksoftirqd/223:32:462
24097993628,5cyclictest33-21ksoftirqd/219:57:212
24097993628,5cyclictest33-21ksoftirqd/219:57:202
24096993629,4cyclictest25-21ksoftirqd/123:05:161
24095993631,3cyclictest9-21ksoftirqd/023:52:110
24095993631,3cyclictest9-21ksoftirqd/019:38:240
24095993630,3cyclictest9-21ksoftirqd/020:33:160
24095993629,4cyclictest9-21ksoftirqd/022:36:200
24095993629,4cyclictest9-21ksoftirqd/021:57:050
24095993629,4cyclictest9-21ksoftirqd/019:47:470
24097993530,3cyclictest33-21ksoftirqd/200:30:222
24097993529,4cyclictest33-21ksoftirqd/223:46:222
24097993528,4cyclictest33-21ksoftirqd/220:35:042
24097993528,4cyclictest33-21ksoftirqd/220:28:042
24097993528,4cyclictest33-21ksoftirqd/220:02:262
24097993528,4cyclictest33-21ksoftirqd/219:16:452
24097993528,4cyclictest33-21ksoftirqd/200:14:502
24097993527,5cyclictest33-21ksoftirqd/200:22:132
24097993527,4cyclictest33-21ksoftirqd/222:15:582
24096993529,4cyclictest25-21ksoftirqd/121:45:011
24095993530,3cyclictest9-21ksoftirqd/000:18:420
24095993530,3cyclictest9-21ksoftirqd/000:18:420
24095993529,3cyclictest9-21ksoftirqd/023:13:380
24095993528,4cyclictest9-21ksoftirqd/021:52:590
24095993528,4cyclictest9-21ksoftirqd/020:44:470
24095993528,4cyclictest9-21ksoftirqd/020:35:530
24095993528,4cyclictest9-21ksoftirqd/020:23:500
24095993527,4cyclictest9-21ksoftirqd/019:11:090
24097993429,3cyclictest33-21ksoftirqd/200:04:492
24097993426,4cyclictest33-21ksoftirqd/200:16:592
24097993426,4cyclictest33-21ksoftirqd/200:16:582
24095993427,4cyclictest9-21ksoftirqd/023:32:240
24095993427,4cyclictest9-21ksoftirqd/023:03:460
24095993427,4cyclictest9-21ksoftirqd/000:27:170
24095993426,5cyclictest9-21ksoftirqd/022:49:180
24097993327,3cyclictest33-21ksoftirqd/219:26:032
24097993326,4cyclictest33-21ksoftirqd/223:20:102
24097993326,4cyclictest33-21ksoftirqd/221:45:112
24097993326,4cyclictest33-21ksoftirqd/221:36:402
24097993326,4cyclictest33-21ksoftirqd/200:26:072
24095993327,4cyclictest9-21ksoftirqd/023:43:250
24095993327,4cyclictest9-21ksoftirqd/021:34:170
24095993327,3cyclictest9-21ksoftirqd/021:26:420
24097993226,4cyclictest33-21ksoftirqd/219:52:142
24097993225,4cyclictest33-21ksoftirqd/223:43:312
24097993225,4cyclictest33-21ksoftirqd/223:19:172
24097993225,4cyclictest33-21ksoftirqd/221:19:142
24097993225,4cyclictest33-21ksoftirqd/221:19:142
24095993226,3cyclictest9-21ksoftirqd/022:41:250
24095993226,3cyclictest9-21ksoftirqd/022:41:240
24095993225,4cyclictest9-21ksoftirqd/023:38:370
24095993225,4cyclictest9-21ksoftirqd/023:26:420
24097993125,3cyclictest33-21ksoftirqd/222:13:132
24097993125,3cyclictest33-21ksoftirqd/200:08:062
24097993124,4cyclictest33-21ksoftirqd/222:37:162
24097993124,4cyclictest33-21ksoftirqd/219:39:542
24095993125,3cyclictest9-21ksoftirqd/023:09:420
24095993124,4cyclictest9-21ksoftirqd/019:31:130
127062310,2sleep00-21swapper/021:00:330
24097993024,4cyclictest33-21ksoftirqd/219:10:032
24095993024,4cyclictest9-21ksoftirqd/021:49:430
24095993024,4cyclictest9-21ksoftirqd/019:15:130
24097992924,3cyclictest33-21ksoftirqd/221:57:202
24097992922,4cyclictest33-21ksoftirqd/219:23:002
24095992924,3cyclictest9-21ksoftirqd/022:02:560
24095992922,4cyclictest9-21ksoftirqd/020:58:120
24097992821,4cyclictest33-21ksoftirqd/221:01:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional