You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-22 - 06:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot4.osadl.org (updated Fri Sep 22, 2023 00:46:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2881321690,8sleep32520099cyclictest23:50:313
1299911440,116ptp4l401ktimersoftd/319:07:283
24643210483,10sleep10-21swapper/119:06:361
2485428463,10sleep20-21swapper/219:09:172
25199998171,6cyclictest33-21ksoftirqd/223:45:162
247882762,19sleep00-21swapper/019:08:260
25199997566,6cyclictest33-21ksoftirqd/200:15:172
25199997565,6cyclictest33-21ksoftirqd/200:10:202
25199997362,7cyclictest33-21ksoftirqd/219:20:202
25199997362,7cyclictest33-21ksoftirqd/200:35:172
25199997359,9cyclictest33-21ksoftirqd/222:30:202
25199997259,9cyclictest33-21ksoftirqd/221:10:182
25199997259,8cyclictest33-21ksoftirqd/219:35:202
25199997159,7cyclictest33-21ksoftirqd/219:45:202
25199997059,6cyclictest33-21ksoftirqd/222:35:192
25199996858,6cyclictest33-21ksoftirqd/222:10:192
25199996855,7cyclictest33-21ksoftirqd/222:55:182
25199996752,9cyclictest33-21ksoftirqd/220:00:202
129991670,1ptp4l401ktimersoftd/321:50:273
320662660,2sleep30-21swapper/321:40:323
25199996656,6cyclictest33-21ksoftirqd/219:40:202
60462650,2sleep30-21swapper/320:45:273
129991620,4ptp4l401ktimersoftd/319:10:003
25199995847,6cyclictest33-21ksoftirqd/220:30:202
25199995845,7cyclictest33-21ksoftirqd/220:15:182
326322570,5sleep132631-21sed21:40:381
25199995617,8cyclictest33-21ksoftirqd/220:39:592
25197995651,3cyclictest9-21ksoftirqd/023:20:180
25197995649,4cyclictest9-21ksoftirqd/021:00:160
25197995649,4cyclictest9-21ksoftirqd/021:00:160
25199995535,9cyclictest33-21ksoftirqd/219:15:342
25197995550,3cyclictest9-21ksoftirqd/023:40:000
25199995448,3cyclictest33-21ksoftirqd/220:15:002
25199995433,9cyclictest33-21ksoftirqd/223:25:362
25197995447,4cyclictest9-21ksoftirqd/020:30:000
25197995446,5cyclictest9-21ksoftirqd/022:50:150
25198995347,3cyclictest25-21ksoftirqd/121:40:001
25197995346,4cyclictest9-21ksoftirqd/023:50:170
25197995346,4cyclictest9-21ksoftirqd/021:55:190
25197995346,4cyclictest9-21ksoftirqd/020:35:160
25197995346,4cyclictest9-21ksoftirqd/020:05:180
129991530,1ptp4l391rcuc/320:14:593
2519999527,3cyclictest121rcu_preempt19:30:242
2519999527,3cyclictest121rcu_preempt19:30:232
25199995247,3cyclictest33-21ksoftirqd/220:25:002
25199995245,4cyclictest33-21ksoftirqd/200:35:002
25197995245,4cyclictest9-21ksoftirqd/022:20:180
25197995245,4cyclictest9-21ksoftirqd/000:05:200
232422520,2sleep20-21swapper/223:40:192
2519999518,6cyclictest33-21ksoftirqd/222:00:002
25199995146,3cyclictest33-21ksoftirqd/222:05:052
25197995146,3cyclictest9-21ksoftirqd/022:05:170
25197995145,4cyclictest9-21ksoftirqd/019:35:000
25197995145,4cyclictest9-21ksoftirqd/019:35:000
25197995144,4cyclictest9-21ksoftirqd/021:40:190
25197995144,4cyclictest9-21ksoftirqd/021:15:190
25197995144,4cyclictest9-21ksoftirqd/019:50:370
60062500,2sleep30-21swapper/319:35:343
2519999508,7cyclictest33-21ksoftirqd/220:50:212
25198995043,4cyclictest25-21ksoftirqd/121:20:001
25197995042,4cyclictest9-21ksoftirqd/022:40:010
129991500,1ptp4l391rcuc/320:15:073
25199994943,3cyclictest33-21ksoftirqd/223:20:002
25199994943,3cyclictest33-21ksoftirqd/222:04:592
25199994932,5cyclictest33-21ksoftirqd/222:30:002
25199994916,7cyclictest33-21ksoftirqd/223:00:202
25198994942,4cyclictest25-21ksoftirqd/122:00:001
25197994944,3cyclictest9-21ksoftirqd/022:14:590
25197994942,4cyclictest9-21ksoftirqd/019:14:590
210952490,2sleep10-21swapper/120:10:011
25199994843,3cyclictest33-21ksoftirqd/222:45:002
25199994842,3cyclictest33-21ksoftirqd/223:55:202
25199994842,3cyclictest33-21ksoftirqd/223:55:202
25199994814,4cyclictest33-21ksoftirqd/221:30:252
25199994813,5cyclictest33-21ksoftirqd/200:05:382
25197994843,3cyclictest9-21ksoftirqd/022:20:010
25197994843,3cyclictest9-21ksoftirqd/021:50:000
25197994842,4cyclictest9-21ksoftirqd/000:15:010
25197994842,3cyclictest9-21ksoftirqd/000:00:460
25197994841,4cyclictest9-21ksoftirqd/023:05:010
25197994841,4cyclictest9-21ksoftirqd/022:50:010
129991480,1ptp4l401ktimersoftd/320:33:453
2519999479,5cyclictest33-21ksoftirqd/219:15:002
25199994741,3cyclictest33-21ksoftirqd/220:44:592
25199994740,4cyclictest33-21ksoftirqd/222:15:292
25199994740,4cyclictest33-21ksoftirqd/221:20:012
25198994741,4cyclictest25-21ksoftirqd/123:20:001
25198994739,4cyclictest25-21ksoftirqd/120:30:211
25197994741,4cyclictest9-21ksoftirqd/022:35:000
25197994741,4cyclictest9-21ksoftirqd/020:20:000
25197994741,3cyclictest9-21ksoftirqd/023:00:000
25197994740,4cyclictest9-21ksoftirqd/020:45:190
25197994740,4cyclictest9-21ksoftirqd/019:15:210
25197994739,5cyclictest9-21ksoftirqd/000:25:010
25197994739,4cyclictest9-21ksoftirqd/023:20:000
25199994641,3cyclictest33-21ksoftirqd/222:45:232
25199994640,4cyclictest33-21ksoftirqd/222:55:012
25199994640,3cyclictest33-21ksoftirqd/223:55:002
25199994639,4cyclictest33-21ksoftirqd/221:20:242
25199994611,5cyclictest33-21ksoftirqd/219:50:332
25198994640,4cyclictest25-21ksoftirqd/122:30:001
25198994640,3cyclictest25-21ksoftirqd/122:55:001
25198994640,3cyclictest25-21ksoftirqd/122:40:001
25198994640,3cyclictest25-21ksoftirqd/120:00:011
25198994639,4cyclictest25-21ksoftirqd/100:10:311
25197994641,3cyclictest9-21ksoftirqd/022:30:000
25197994641,3cyclictest9-21ksoftirqd/020:55:000
25197994641,3cyclictest9-21ksoftirqd/000:25:190
129991460,1ptp4l401ktimersoftd/320:24:313
2519999457,4cyclictest121rcu_preempt22:20:382
25199994539,4cyclictest33-21ksoftirqd/223:10:012
25199994539,4cyclictest33-21ksoftirqd/221:40:002
25199994539,3cyclictest33-21ksoftirqd/221:25:272
25199994539,3cyclictest33-21ksoftirqd/221:00:232
25199994539,3cyclictest33-21ksoftirqd/221:00:222
25199994538,3cyclictest33-21ksoftirqd/220:55:232
25199994513,7cyclictest33-21ksoftirqd/219:55:322
25198994539,3cyclictest25-21ksoftirqd/119:20:211
25198994538,4cyclictest25-21ksoftirqd/100:20:011
25197994539,3cyclictest9-21ksoftirqd/023:30:000
25197994538,4cyclictest9-21ksoftirqd/023:50:000
2519999444,4cyclictest121rcu_preempt23:35:332
25199994438,3cyclictest33-21ksoftirqd/223:10:182
25199994438,3cyclictest33-21ksoftirqd/221:55:002
25199994438,3cyclictest33-21ksoftirqd/219:30:002
25199994437,4cyclictest33-21ksoftirqd/200:25:462
25199994413,7cyclictest33-21ksoftirqd/220:05:222
25198994439,3cyclictest25-21ksoftirqd/122:09:591
25198994438,4cyclictest25-21ksoftirqd/123:39:591
25198994438,4cyclictest25-21ksoftirqd/123:25:261
25198994438,3cyclictest25-21ksoftirqd/121:50:001
2519799445,4cyclictest121rcu_preempt19:35:360
25197994439,3cyclictest9-21ksoftirqd/021:40:000
25197994439,3cyclictest9-21ksoftirqd/021:30:390
25197994438,4cyclictest9-21ksoftirqd/023:55:380
25197994438,4cyclictest9-21ksoftirqd/023:55:380
25197994438,4cyclictest9-21ksoftirqd/022:45:010
25197994438,4cyclictest9-21ksoftirqd/021:05:260
25197994438,3cyclictest9-21ksoftirqd/020:20:240
25197994438,3cyclictest9-21ksoftirqd/019:50:000
25197994437,5cyclictest9-21ksoftirqd/020:32:290
25197994437,4cyclictest9-21ksoftirqd/023:10:170
25197994437,4cyclictest9-21ksoftirqd/021:30:010
25197994437,4cyclictest9-21ksoftirqd/000:30:230
129991440,1ptp4l401ktimersoftd/321:32:013
129991440,1ptp4l401ktimersoftd/319:22:303
129991440,1ptp4l401ktimersoftd/300:23:043
25200994338,3cyclictest41-21ksoftirqd/321:20:013
25200994337,4cyclictest41-21ksoftirqd/321:12:353
25200994336,4cyclictest41-21ksoftirqd/300:11:583
25199994338,3cyclictest33-21ksoftirqd/223:20:262
25199994337,4cyclictest33-21ksoftirqd/200:00:282
25199994336,4cyclictest33-21ksoftirqd/220:25:222
25199994334,5cyclictest33-21ksoftirqd/221:40:052
25198994337,3cyclictest25-21ksoftirqd/121:00:001
25198994337,3cyclictest25-21ksoftirqd/120:25:001
2519799438,5cyclictest9-21ksoftirqd/021:15:010
25197994338,3cyclictest9-21ksoftirqd/023:10:000
25197994337,4cyclictest9-21ksoftirqd/023:40:200
25197994337,3cyclictest9-21ksoftirqd/000:20:000
25197994336,4cyclictest9-21ksoftirqd/020:15:000
25200994235,4cyclictest41-21ksoftirqd/320:38:293
25199994236,4cyclictest33-21ksoftirqd/221:45:362
25199994236,4cyclictest33-21ksoftirqd/221:05:202
25199994236,3cyclictest33-21ksoftirqd/220:50:012
25198994236,4cyclictest25-21ksoftirqd/120:00:381
25198994236,3cyclictest25-21ksoftirqd/100:05:311
25198994235,4cyclictest25-21ksoftirqd/123:00:171
25198994235,4cyclictest25-21ksoftirqd/100:30:141
25198994235,3cyclictest25-21ksoftirqd/122:40:011
25197994237,3cyclictest9-21ksoftirqd/019:45:000
25197994236,4cyclictest9-21ksoftirqd/019:25:310
25197994235,4cyclictest9-21ksoftirqd/000:35:420
129991420,1ptp4l401ktimersoftd/322:39:553
129991420,1ptp4l401ktimersoftd/320:05:063
129991420,1ptp4l401ktimersoftd/300:30:283
25200994134,4cyclictest41-21ksoftirqd/323:35:143
25199994135,3cyclictest33-21ksoftirqd/200:25:002
25199994134,4cyclictest33-21ksoftirqd/223:30:462
25198994135,4cyclictest25-21ksoftirqd/100:30:001
25198994134,4cyclictest25-21ksoftirqd/122:20:001
2519799413,4cyclictest121rcu_preempt22:00:280
25197994134,4cyclictest9-21ksoftirqd/020:00:230
25200994034,4cyclictest41-21ksoftirqd/322:50:333
25200994033,4cyclictest41-21ksoftirqd/320:26:543
25198994035,3cyclictest25-21ksoftirqd/121:50:361
25198994034,4cyclictest25-21ksoftirqd/123:50:281
25198994034,3cyclictest25-21ksoftirqd/123:57:371
25198994034,3cyclictest25-21ksoftirqd/123:57:371
25198994034,3cyclictest25-21ksoftirqd/123:20:051
25198994034,3cyclictest25-21ksoftirqd/123:07:551
25198994033,4cyclictest25-21ksoftirqd/123:33:191
25198994033,4cyclictest25-21ksoftirqd/122:10:241
25198994031,5cyclictest25-21ksoftirqd/119:25:331
25197994034,4cyclictest9-21ksoftirqd/020:55:330
25197994034,3cyclictest9-21ksoftirqd/020:40:220
25197994033,4cyclictest9-21ksoftirqd/021:53:580
25197994033,4cyclictest9-21ksoftirqd/021:20:290
1767324032,3sleep125-21ksoftirqd/121:10:281
25200993933,3cyclictest41-21ksoftirqd/321:07:163
25200993932,4cyclictest41-21ksoftirqd/323:41:203
25200993932,4cyclictest41-21ksoftirqd/322:22:403
25200993932,4cyclictest41-21ksoftirqd/321:56:143
25198993934,3cyclictest25-21ksoftirqd/119:45:001
25198993932,4cyclictest25-21ksoftirqd/121:32:091
25198993932,4cyclictest25-21ksoftirqd/119:34:281
25198993932,4cyclictest25-21ksoftirqd/119:34:281
25197993933,3cyclictest9-21ksoftirqd/019:20:280
25197993932,4cyclictest9-21ksoftirqd/023:30:200
25197993931,4cyclictest9-21ksoftirqd/019:55:210
129991390,1ptp4l401ktimersoftd/321:20:213
129991390,1ptp4l401ktimersoftd/319:55:343
25200993832,3cyclictest41-21ksoftirqd/322:41:483
25200993832,3cyclictest41-21ksoftirqd/322:14:083
25200993832,3cyclictest41-21ksoftirqd/319:25:233
25200993831,4cyclictest41-21ksoftirqd/323:25:503
25200993831,4cyclictest41-21ksoftirqd/322:30:003
25200993831,4cyclictest41-21ksoftirqd/319:17:203
25198993833,3cyclictest25-21ksoftirqd/122:55:341
25198993833,3cyclictest25-21ksoftirqd/122:00:231
25198993833,3cyclictest25-21ksoftirqd/121:22:021
25198993833,3cyclictest25-21ksoftirqd/120:52:291
25198993832,4cyclictest25-21ksoftirqd/122:20:201
25198993832,4cyclictest25-21ksoftirqd/100:38:461
25198993832,3cyclictest25-21ksoftirqd/119:13:351
25198993831,4cyclictest25-21ksoftirqd/122:48:261
25198993831,4cyclictest25-21ksoftirqd/120:35:251
25198993831,4cyclictest25-21ksoftirqd/119:37:051
25198993831,4cyclictest25-21ksoftirqd/119:20:001
25198993819,8cyclictest25-21ksoftirqd/122:30:201
25200993731,4cyclictest41-21ksoftirqd/320:40:503
25200993730,4cyclictest41-21ksoftirqd/322:47:123
25200993730,4cyclictest41-21ksoftirqd/320:54:393
25200993730,4cyclictest41-21ksoftirqd/300:28:573
25198993732,3cyclictest25-21ksoftirqd/123:50:011
25198993732,3cyclictest25-21ksoftirqd/120:45:221
25198993730,4cyclictest25-21ksoftirqd/121:06:301
25198993730,4cyclictest25-21ksoftirqd/120:42:201
25198993730,4cyclictest25-21ksoftirqd/119:45:251
25200993629,4cyclictest41-21ksoftirqd/323:55:533
25200993629,4cyclictest41-21ksoftirqd/323:55:533
25200993629,4cyclictest41-21ksoftirqd/323:21:323
25200993629,4cyclictest41-21ksoftirqd/322:55:153
25200993629,4cyclictest41-21ksoftirqd/322:19:023
25200993629,4cyclictest41-21ksoftirqd/321:04:263
25200993629,4cyclictest41-21ksoftirqd/321:04:263
25200993629,4cyclictest41-21ksoftirqd/320:58:333
25200993629,4cyclictest41-21ksoftirqd/319:42:493
25200993629,4cyclictest41-21ksoftirqd/319:31:023
25200993629,4cyclictest41-21ksoftirqd/319:31:013
25198993630,4cyclictest25-21ksoftirqd/121:29:491
25198993630,4cyclictest25-21ksoftirqd/121:02:291
25198993630,4cyclictest25-21ksoftirqd/121:02:291
25198993629,4cyclictest25-21ksoftirqd/120:25:471
25198993629,4cyclictest25-21ksoftirqd/119:50:571
129991360,1ptp4l401ktimersoftd/323:30:303
25200993529,3cyclictest41-21ksoftirqd/300:04:553
25200993528,4cyclictest41-21ksoftirqd/323:12:373
25198993530,3cyclictest25-21ksoftirqd/123:10:181
25198993529,3cyclictest25-21ksoftirqd/100:21:531
2519899351,3cyclictest0-21swapper/120:15:361
129991350,1ptp4l401ktimersoftd/321:25:213
129991350,1ptp4l401ktimersoftd/319:50:333
129991350,11ptp4l401ktimersoftd/321:45:093
25200993428,3cyclictest41-21ksoftirqd/322:06:433
25198993428,3cyclictest25-21ksoftirqd/120:14:211
25200993327,3cyclictest41-21ksoftirqd/323:16:173
25200993327,3cyclictest41-21ksoftirqd/319:48:203
25198993327,4cyclictest25-21ksoftirqd/100:00:331
129991330,1ptp4l401ktimersoftd/322:32:143
129991330,1ptp4l401ktimersoftd/300:35:393
25200993226,3cyclictest41-21ksoftirqd/300:05:323
25200993225,4cyclictest41-21ksoftirqd/323:04:263
25198993223,7cyclictest25-21ksoftirqd/123:40:281
129991320,1ptp4l401ktimersoftd/300:17:513
25200993125,4cyclictest41-21ksoftirqd/323:45:053
25200993125,4cyclictest41-21ksoftirqd/320:03:573
25200993125,3cyclictest41-21ksoftirqd/322:02:213
25200993124,4cyclictest41-21ksoftirqd/321:38:193
25200993024,4cyclictest41-21ksoftirqd/323:05:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional