You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-14 - 15:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Sat Sep 14, 2024 00:46:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8255911370,108ptp4l401ktimersoftd/319:05:113
145712133110,10sleep20-21swapper/219:08:102
2775221290,8sleep01500299cyclictest19:35:220
144722824,16sleep00-21swapper/019:06:550
15002997862,9cyclictest9-21ksoftirqd/020:05:110
1467227611,10sleep10-21swapper/119:09:261
825591720,2ptp4l401ktimersoftd/319:50:233
207032690,2sleep00-21swapper/021:40:000
825591670,2ptp4l401ktimersoftd/322:10:223
64222650,1sleep00-21swapper/023:25:190
825591610,1ptp4l401ktimersoftd/322:56:413
98752590,2sleep20-21swapper/222:25:152
15002995947,8cyclictest9-21ksoftirqd/000:10:080
114642570,2sleep00-21swapper/020:10:190
15002995643,7cyclictest9-21ksoftirqd/020:35:100
15002995643,7cyclictest9-21ksoftirqd/020:35:100
15002995043,4cyclictest9-21ksoftirqd/022:00:000
175362480,2sleep317539-21tr19:15:143
15005994842,3cyclictest41-21ksoftirqd/323:40:003
15002994836,8cyclictest9-21ksoftirqd/020:15:120
1500299480,3cyclictest121rcu_preempt21:10:010
1500299480,3cyclictest121rcu_preempt19:25:250
15003994730,14cyclictest25-21ksoftirqd/122:31:361
15002994733,8cyclictest9-21ksoftirqd/000:00:120
57698460,9rtkit-daemon0-21swapper/122:41:421
15002994640,4cyclictest9-21ksoftirqd/000:10:000
15002994639,4cyclictest9-21ksoftirqd/021:50:150
15005994538,4cyclictest41-21ksoftirqd/300:40:003
15005994538,4cyclictest29149-21cron20:50:003
825591440,2ptp4l391rcuc/323:15:173
15005994438,4cyclictest41-21ksoftirqd/322:49:593
15002994438,4cyclictest9-21ksoftirqd/020:00:000
15002994438,3cyclictest9-21ksoftirqd/021:45:000
15002994431,7cyclictest9-21ksoftirqd/020:45:110
15002994430,7cyclictest9-21ksoftirqd/022:25:110
15005994338,3cyclictest2135-21apt22:10:013
15002994338,3cyclictest9-21ksoftirqd/000:24:590
15002994336,4cyclictest9-21ksoftirqd/023:50:000
15002994336,4cyclictest9-21ksoftirqd/020:50:160
825591420,1ptp4l401ktimersoftd/300:29:103
15002994237,3cyclictest9-21ksoftirqd/023:40:000
15002994237,3cyclictest9-21ksoftirqd/021:20:010
15002994236,3cyclictest9-21ksoftirqd/019:45:010
15002994235,4cyclictest9-21ksoftirqd/023:50:100
15002994235,4cyclictest9-21ksoftirqd/020:00:110
15002994235,4cyclictest9-21ksoftirqd/019:35:000
15002994235,4cyclictest9-21ksoftirqd/019:20:000
825591410,17ptp4l0-21swapper/300:10:163
15005994134,4cyclictest41-21ksoftirqd/321:00:013
15003994116,4cyclictest8947-21grep20:05:161
15002994136,3cyclictest9-21ksoftirqd/019:55:010
15005994034,3cyclictest41-21ksoftirqd/322:45:003
15004994027,10cyclictest33-21ksoftirqd/222:01:162
15004994027,10cyclictest33-21ksoftirqd/222:01:152
15003994023,14cyclictest25-21ksoftirqd/120:27:501
1500299408,4cyclictest9-21ksoftirqd/022:05:100
15002994035,3cyclictest9-21ksoftirqd/021:29:590
15002994034,3cyclictest9-21ksoftirqd/022:10:150
15002994033,4cyclictest9-21ksoftirqd/023:25:000
15002994033,4cyclictest9-21ksoftirqd/023:25:000
15002994033,4cyclictest9-21ksoftirqd/022:35:130
15002994033,3cyclictest9-21ksoftirqd/022:25:000
319912390,7sleep21500499cyclictest20:55:092
15005993933,3cyclictest41-21ksoftirqd/320:10:003
15005993932,4cyclictest41-21ksoftirqd/321:05:003
15003993932,4cyclictest25-21ksoftirqd/119:55:101
15003993917,19cyclictest24928-21iostat00:05:181
15002993933,4cyclictest9-21ksoftirqd/023:40:140
15002993933,3cyclictest9-21ksoftirqd/023:55:230
15002993933,3cyclictest9-21ksoftirqd/020:35:010
15002993933,3cyclictest9-21ksoftirqd/020:35:000
15002993931,4cyclictest9-21ksoftirqd/021:25:000
825591380,21ptp4l34992irq/88-enp1s0-T21:06:233
443423831,3sleep233-21ksoftirqd/219:55:212
15005993828,6cyclictest41-21ksoftirqd/300:10:003
15004993831,4cyclictest33-21ksoftirqd/222:24:372
15003993831,4cyclictest25-21ksoftirqd/121:35:431
15003993813,3cyclictest19875-21cat23:55:141
15003993812,4cyclictest27287-21expr20:45:131
15002993833,4cyclictest9-21ksoftirqd/019:10:180
15002993833,3cyclictest9-21ksoftirqd/022:30:050
15002993832,4cyclictest9-21ksoftirqd/000:25:110
15002993832,3cyclictest9-21ksoftirqd/023:35:010
15002993832,3cyclictest9-21ksoftirqd/023:05:120
15002993832,3cyclictest9-21ksoftirqd/022:01:590
15002993832,3cyclictest9-21ksoftirqd/022:01:590
15002993831,4cyclictest9-21ksoftirqd/022:50:270
15002993831,4cyclictest9-21ksoftirqd/022:40:110
15002993830,5cyclictest9-21ksoftirqd/022:20:000
825591370,1ptp4l401ktimersoftd/321:59:593
15005993731,4cyclictest41-21ksoftirqd/322:30:203
15005993731,4cyclictest41-21ksoftirqd/320:26:453
15005993730,4cyclictest41-21ksoftirqd/322:40:013
15005993730,4cyclictest41-21ksoftirqd/322:17:083
15005993730,4cyclictest41-21ksoftirqd/300:02:163
15004993731,3cyclictest33-21ksoftirqd/220:47:172
15004993730,4cyclictest33-21ksoftirqd/221:24:212
15004993730,4cyclictest33-21ksoftirqd/219:29:182
15004993715,20cyclictest20376-21kworker/2:020:05:222
15004993712,23cyclictest20376-21kworker/2:023:57:422
15003993731,4cyclictest25-21ksoftirqd/123:32:251
15003993731,3cyclictest25-21ksoftirqd/123:04:141
15003993730,4cyclictest25-21ksoftirqd/122:57:451
15003993730,4cyclictest25-21ksoftirqd/121:24:071
15003993730,4cyclictest25-21ksoftirqd/119:39:491
15003993729,5cyclictest25-21ksoftirqd/123:25:481
15003993729,5cyclictest25-21ksoftirqd/119:31:381
1500399372,7cyclictest0-21swapper/120:55:081
15003993718,16cyclictest25-21ksoftirqd/122:36:341
15003993718,15cyclictest25-21ksoftirqd/123:21:111
15003993718,15cyclictest25-21ksoftirqd/123:21:111
15003993712,4cyclictest12241-21cat20:10:271
15002993732,3cyclictest9-21ksoftirqd/021:35:000
15002993731,4cyclictest9-21ksoftirqd/023:00:000
15002993731,4cyclictest9-21ksoftirqd/020:55:260
15002993731,4cyclictest9-21ksoftirqd/019:25:010
15002993731,4cyclictest9-21ksoftirqd/000:35:130
15002993731,3cyclictest9-21ksoftirqd/023:17:530
15002993731,3cyclictest9-21ksoftirqd/019:45:300
15002993730,4cyclictest9-21ksoftirqd/023:05:000
15002993730,4cyclictest9-21ksoftirqd/022:45:120
15002993730,4cyclictest9-21ksoftirqd/021:50:000
15002993730,4cyclictest9-21ksoftirqd/021:10:180
15002993730,4cyclictest9-21ksoftirqd/000:20:000
15005993630,3cyclictest41-21ksoftirqd/323:25:123
15005993630,3cyclictest41-21ksoftirqd/321:12:313
15005993629,4cyclictest41-21ksoftirqd/323:43:333
15005993629,4cyclictest41-21ksoftirqd/321:49:353
15005993629,4cyclictest41-21ksoftirqd/320:52:213
15005993629,4cyclictest41-21ksoftirqd/320:39:253
15005993629,4cyclictest41-21ksoftirqd/320:39:243
15005993629,4cyclictest41-21ksoftirqd/320:24:123
15005993629,4cyclictest41-21ksoftirqd/319:56:293
15005993629,4cyclictest41-21ksoftirqd/319:49:373
15005993629,3cyclictest41-21ksoftirqd/323:54:223
15004993630,4cyclictest33-21ksoftirqd/222:41:062
15004993630,3cyclictest33-21ksoftirqd/200:17:542
15004993629,4cyclictest33-21ksoftirqd/222:10:002
15004993629,4cyclictest33-21ksoftirqd/221:54:262
15004993629,4cyclictest33-21ksoftirqd/220:43:372
15004993628,5cyclictest33-21ksoftirqd/223:53:192
15003993630,4cyclictest25-21ksoftirqd/122:16:241
15003993630,3cyclictest25-21ksoftirqd/100:24:511
15003993630,3cyclictest25-21ksoftirqd/100:00:101
15003993629,5cyclictest25-21ksoftirqd/120:04:341
15003993629,4cyclictest25-21ksoftirqd/122:13:211
15003993629,4cyclictest25-21ksoftirqd/122:07:071
15003993629,4cyclictest25-21ksoftirqd/121:47:201
15003993629,4cyclictest25-21ksoftirqd/121:45:011
15003993629,4cyclictest25-21ksoftirqd/121:32:501
15003993629,4cyclictest25-21ksoftirqd/121:29:541
15003993629,4cyclictest25-21ksoftirqd/121:09:531
15003993629,4cyclictest25-21ksoftirqd/100:25:111
15003993617,4cyclictest25-21ksoftirqd/119:19:421
15003993612,4cyclictest19308-21turbostat.cron23:55:001
15002993630,4cyclictest9-21ksoftirqd/021:05:010
15002993630,4cyclictest9-21ksoftirqd/020:30:000
15002993630,4cyclictest9-21ksoftirqd/000:30:290
825591350,1ptp4l401ktimersoftd/320:04:273
15005993529,4cyclictest41-21ksoftirqd/321:40:003
15005993529,3cyclictest41-21ksoftirqd/323:45:353
15005993529,3cyclictest41-21ksoftirqd/323:13:443
15005993529,3cyclictest41-21ksoftirqd/321:25:283
15005993529,3cyclictest41-21ksoftirqd/320:18:223
15005993529,3cyclictest41-21ksoftirqd/320:12:453
15005993529,3cyclictest41-21ksoftirqd/319:24:443
15005993528,4cyclictest41-21ksoftirqd/323:59:313
15005993528,4cyclictest41-21ksoftirqd/322:29:103
15005993528,4cyclictest41-21ksoftirqd/321:23:303
15005993528,4cyclictest41-21ksoftirqd/321:16:023
15004993529,4cyclictest33-21ksoftirqd/221:00:212
15004993529,4cyclictest33-21ksoftirqd/220:03:242
15004993529,3cyclictest33-21ksoftirqd/222:17:182
15004993529,3cyclictest33-21ksoftirqd/220:51:502
15004993529,3cyclictest33-21ksoftirqd/220:39:232
15004993529,3cyclictest33-21ksoftirqd/220:39:222
15004993528,4cyclictest33-21ksoftirqd/223:41:472
15004993528,4cyclictest33-21ksoftirqd/223:13:242
15004993528,4cyclictest33-21ksoftirqd/221:34:032
15004993528,4cyclictest33-21ksoftirqd/221:10:232
15004993528,4cyclictest33-21ksoftirqd/220:31:552
15004993528,4cyclictest33-21ksoftirqd/220:31:542
15004993528,4cyclictest33-21ksoftirqd/220:17:232
15004993528,4cyclictest33-21ksoftirqd/219:38:212
15004993528,4cyclictest33-21ksoftirqd/219:11:212
15004993528,4cyclictest33-21ksoftirqd/200:38:472
1500399357,4cyclictest0-21swapper/119:45:191
15003993529,4cyclictest25-21ksoftirqd/123:07:251
15003993529,4cyclictest25-21ksoftirqd/120:24:551
15003993528,4cyclictest25-21ksoftirqd/121:18:291
15003993528,4cyclictest25-21ksoftirqd/120:38:591
15003993528,4cyclictest25-21ksoftirqd/120:38:581
15003993528,4cyclictest25-21ksoftirqd/100:31:521
1500399351,32cyclictest0-21swapper/120:16:121
15003993511,5cyclictest13018-21fschecks_count23:40:171
15002993529,4cyclictest9-21ksoftirqd/023:10:120
15002993529,4cyclictest9-21ksoftirqd/020:40:170
15002993529,3cyclictest9-21ksoftirqd/020:25:000
825591340,1ptp4l401ktimersoftd/319:40:373
15005993429,3cyclictest41-21ksoftirqd/319:30:273
15005993428,3cyclictest41-21ksoftirqd/323:08:413
15005993428,3cyclictest41-21ksoftirqd/323:03:113
15005993428,3cyclictest41-21ksoftirqd/320:40:093
15005993427,4cyclictest41-21ksoftirqd/322:22:193
15005993427,4cyclictest41-21ksoftirqd/300:22:433
15004993428,3cyclictest33-21ksoftirqd/223:20:202
15004993428,3cyclictest33-21ksoftirqd/223:20:202
15004993428,3cyclictest33-21ksoftirqd/221:17:122
15004993428,3cyclictest33-21ksoftirqd/219:24:272
15004993428,3cyclictest33-21ksoftirqd/200:22:562
15004993427,4cyclictest33-21ksoftirqd/223:30:552
15004993427,4cyclictest33-21ksoftirqd/222:51:002
15004993427,4cyclictest33-21ksoftirqd/221:47:372
15004993427,4cyclictest33-21ksoftirqd/221:26:122
15004993427,4cyclictest33-21ksoftirqd/220:29:222
15004993427,4cyclictest33-21ksoftirqd/200:04:312
15003993428,3cyclictest25-21ksoftirqd/122:50:141
15003993427,4cyclictest25-21ksoftirqd/123:47:281
15003993427,4cyclictest25-21ksoftirqd/119:23:541
15003993427,4cyclictest25-21ksoftirqd/100:16:021
15003993426,5cyclictest25-21ksoftirqd/119:25:111
15005993328,3cyclictest41-21ksoftirqd/322:00:233
15005993328,3cyclictest41-21ksoftirqd/322:00:223
15005993327,4cyclictest41-21ksoftirqd/300:30:203
15005993327,3cyclictest41-21ksoftirqd/319:25:253
15005993326,4cyclictest41-21ksoftirqd/300:17:223
15004993327,4cyclictest33-21ksoftirqd/223:05:582
15004993327,4cyclictest33-21ksoftirqd/221:05:282
15004993327,3cyclictest33-21ksoftirqd/223:00:112
15004993326,4cyclictest33-21ksoftirqd/223:25:562
15004993326,4cyclictest33-21ksoftirqd/222:59:002
15004993326,4cyclictest33-21ksoftirqd/220:14:232
15004993326,4cyclictest33-21ksoftirqd/219:34:562
15004993326,4cyclictest33-21ksoftirqd/219:19:132
15004993326,4cyclictest33-21ksoftirqd/200:07:592
15003993326,4cyclictest25-21ksoftirqd/122:25:101
15003993326,4cyclictest25-21ksoftirqd/121:58:241
15003993326,4cyclictest25-21ksoftirqd/120:50:351
825591320,1ptp4l401ktimersoftd/323:23:523
825591320,1ptp4l401ktimersoftd/323:23:513
825591320,11ptp4l0-21swapper/319:35:303
15005993226,3cyclictest41-21ksoftirqd/319:14:553
15005993225,4cyclictest41-21ksoftirqd/321:52:443
15005993225,4cyclictest41-21ksoftirqd/320:32:063
15005993225,4cyclictest41-21ksoftirqd/320:32:053
15004993226,3cyclictest33-21ksoftirqd/222:34:012
15004993225,4cyclictest33-21ksoftirqd/219:54:152
15004993225,4cyclictest33-21ksoftirqd/200:25:102
15003993226,3cyclictest25-21ksoftirqd/120:30:551
15003993226,3cyclictest25-21ksoftirqd/120:30:551
15003993226,3cyclictest25-21ksoftirqd/119:13:231
15003993225,4cyclictest25-21ksoftirqd/123:37:121
15003993225,4cyclictest25-21ksoftirqd/121:12:031
15003993225,4cyclictest25-21ksoftirqd/119:52:091
15003993213,3cyclictest20348-21sendmail_mailst22:45:231
15005993126,3cyclictest41-21ksoftirqd/323:30:233
15005993126,3cyclictest41-21ksoftirqd/322:50:273
15005993125,3cyclictest41-21ksoftirqd/321:40:123
15005993125,3cyclictest41-21ksoftirqd/321:30:243
1500499313,6cyclictest1100-21runrttasks19:40:202
15004993126,3cyclictest33-21ksoftirqd/219:47:542
15004993125,4cyclictest33-21ksoftirqd/222:14:302
15004993125,3cyclictest33-21ksoftirqd/222:37:092
15004993124,4cyclictest33-21ksoftirqd/223:18:352
15003993124,4cyclictest25-21ksoftirqd/122:21:231
15003993124,4cyclictest25-21ksoftirqd/122:03:261
15003993124,4cyclictest25-21ksoftirqd/122:03:251
15004993025,3cyclictest33-21ksoftirqd/220:21:302
15004993023,4cyclictest33-21ksoftirqd/223:46:012
15004993023,4cyclictest33-21ksoftirqd/221:58:292
15004993023,4cyclictest33-21ksoftirqd/221:38:402
15004993023,4cyclictest33-21ksoftirqd/200:10:112
15004992923,3cyclictest33-21ksoftirqd/223:37:262
15004992922,4cyclictest33-21ksoftirqd/222:46:232
15004992922,4cyclictest33-21ksoftirqd/200:31:092
1500499292,24cyclictest20376-21kworker/2:021:40:032
15003992923,4cyclictest25-21ksoftirqd/119:43:531
15003992923,4cyclictest25-21ksoftirqd/100:35:501
15003992923,3cyclictest25-21ksoftirqd/121:52:591
15003992922,4cyclictest25-21ksoftirqd/121:02:231
15003992822,4cyclictest25-21ksoftirqd/123:15:511
15003992822,3cyclictest25-21ksoftirqd/100:14:291
15003992620,4cyclictest25-21ksoftirqd/120:42:231
15003992518,4cyclictest25-21ksoftirqd/123:12:521
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional