You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-16 - 10:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot3.osadl.org (updated Sun Jun 16, 2024 00:46:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1195521760,3sleep21998199cyclictest20:00:152
2816221460,9sleep31998299cyclictest20:35:133
2816221460,9sleep31998299cyclictest20:35:133
8255911250,51ptp4l0-21swapper/319:06:173
1946928710,21sleep20-21swapper/219:08:522
3182790,4sleep2321ktimersoftd/219:35:172
19980997742,7cyclictest25-21ksoftirqd/122:00:001
19982997264,4cyclictest41-21ksoftirqd/323:35:143
19980997235,5cyclictest25-21ksoftirqd/122:05:111
1923127251,9sleep10-21swapper/119:05:521
19982997136,7cyclictest41-21ksoftirqd/320:10:353
19982997135,5cyclictest41-21ksoftirqd/319:35:003
19980997127,9cyclictest25-21ksoftirqd/122:35:251
19982997060,6cyclictest41-21ksoftirqd/323:50:113
19982997033,4cyclictest41-21ksoftirqd/323:55:343
19982997032,7cyclictest41-21ksoftirqd/322:45:373
19982996934,10cyclictest41-21ksoftirqd/321:20:013
19982996932,5cyclictest41-21ksoftirqd/321:15:013
19982996932,5cyclictest41-21ksoftirqd/320:05:313
19982996833,15cyclictest41-21ksoftirqd/322:30:303
19982996832,5cyclictest41-21ksoftirqd/321:50:143
19982996830,7cyclictest41-21ksoftirqd/320:25:163
19980996836,9cyclictest25-21ksoftirqd/100:15:011
19982996733,4cyclictest41-21ksoftirqd/320:40:373
19982996733,4cyclictest41-21ksoftirqd/320:40:373
19982996732,4cyclictest41-21ksoftirqd/319:55:263
19982996731,4cyclictest41-21ksoftirqd/300:00:253
19982996731,10cyclictest41-21ksoftirqd/321:45:003
19982996727,10cyclictest41-21ksoftirqd/320:58:463
19980996760,4cyclictest25-21ksoftirqd/122:40:121
19980996732,5cyclictest25-21ksoftirqd/120:45:271
19980996731,9cyclictest25-21ksoftirqd/123:00:131
19980996731,7cyclictest25-21ksoftirqd/123:45:311
19982996633,10cyclictest41-21ksoftirqd/323:20:193
19982996632,5cyclictest41-21ksoftirqd/321:00:293
19982996631,6cyclictest41-21ksoftirqd/320:30:143
19982996631,5cyclictest41-21ksoftirqd/321:45:163
19982996617,3cyclictest41-21ksoftirqd/323:15:333
19980996630,9cyclictest25-21ksoftirqd/122:10:101
19980996630,9cyclictest25-21ksoftirqd/122:10:101
19980996630,10cyclictest25-21ksoftirqd/120:55:271
19982996533,8cyclictest41-21ksoftirqd/300:20:343
19982996532,5cyclictest41-21ksoftirqd/320:15:123
19982996531,5cyclictest41-21ksoftirqd/300:15:153
19982996531,4cyclictest41-21ksoftirqd/319:35:313
19982996530,5cyclictest41-21ksoftirqd/322:55:163
19982996530,5cyclictest41-21ksoftirqd/322:40:173
19982996530,5cyclictest41-21ksoftirqd/319:15:193
19982996530,5cyclictest41-21ksoftirqd/300:10:213
19982996529,5cyclictest41-21ksoftirqd/323:30:003
19982996529,10cyclictest41-21ksoftirqd/320:00:113
19982996528,8cyclictest41-21ksoftirqd/323:45:313
19982996528,10cyclictest41-21ksoftirqd/323:00:153
19982996527,8cyclictest41-21ksoftirqd/323:10:323
19982996430,9cyclictest41-21ksoftirqd/319:20:333
19982996429,5cyclictest41-21ksoftirqd/321:05:133
19982996428,7cyclictest41-21ksoftirqd/321:35:233
19982996426,9cyclictest41-21ksoftirqd/319:45:353
19982996426,8cyclictest41-21ksoftirqd/300:29:593
19980996428,5cyclictest25-21ksoftirqd/121:10:381
19980996427,10cyclictest25-21ksoftirqd/121:30:281
19982996331,8cyclictest41-21ksoftirqd/322:50:153
19982996328,4cyclictest41-21ksoftirqd/320:55:003
19982996327,9cyclictest41-21ksoftirqd/319:25:183
19980996331,9cyclictest25-21ksoftirqd/121:15:311
19980996325,8cyclictest25-21ksoftirqd/123:25:001
1998299627,9cyclictest41-21ksoftirqd/300:30:153
19982996230,4cyclictest41-21ksoftirqd/321:30:263
19982996230,10cyclictest41-21ksoftirqd/323:25:183
19982996230,10cyclictest41-21ksoftirqd/300:35:283
19982996228,9cyclictest41-21ksoftirqd/319:50:203
19982996228,7cyclictest41-21ksoftirqd/319:10:143
19982996228,7cyclictest41-21ksoftirqd/319:10:143
19982996226,8cyclictest41-21ksoftirqd/322:25:343
19982996224,7cyclictest41-21ksoftirqd/319:45:003
19982996224,4cyclictest41-21ksoftirqd/321:20:253
1998099624,8cyclictest25-21ksoftirqd/121:50:151
19980996227,9cyclictest25-21ksoftirqd/122:45:191
19980996226,7cyclictest25-21ksoftirqd/123:10:311
1998299616,9cyclictest41-21ksoftirqd/322:05:003
19982996128,9cyclictest41-21ksoftirqd/321:55:173
19982996127,7cyclictest41-21ksoftirqd/320:20:223
19982996127,4cyclictest41-21ksoftirqd/323:05:153
19982996126,7cyclictest41-21ksoftirqd/322:05:313
19980996129,4cyclictest25-21ksoftirqd/120:50:131
19980996125,8cyclictest25-21ksoftirqd/100:35:191
19980996124,8cyclictest25-21ksoftirqd/119:30:141
19980996123,8cyclictest25-21ksoftirqd/122:15:171
19982996023,7cyclictest41-21ksoftirqd/323:40:263
1998099605,8cyclictest25-21ksoftirqd/120:45:001
1998099605,8cyclictest25-21ksoftirqd/120:44:591
19980996052,4cyclictest25-21ksoftirqd/120:40:001
19980996052,4cyclictest25-21ksoftirqd/120:39:591
19980996033,8cyclictest25-21ksoftirqd/122:30:111
19980996026,5cyclictest25-21ksoftirqd/120:25:151
19980996026,4cyclictest25-21ksoftirqd/121:25:221
19980996025,7cyclictest25-21ksoftirqd/100:15:251
1998299593,11cyclictest41-21ksoftirqd/322:10:163
1998299593,11cyclictest41-21ksoftirqd/322:10:153
19982995930,9cyclictest41-21ksoftirqd/321:25:123
1998099597,4cyclictest25-21ksoftirqd/100:10:001
19980995954,3cyclictest231rcuc/120:00:281
19980995953,4cyclictest25-21ksoftirqd/123:40:041
19980995953,4cyclictest25-21ksoftirqd/119:20:051
19980995925,4cyclictest25-21ksoftirqd/100:30:261
1998099592,10cyclictest25-21ksoftirqd/119:55:351
19982995823,7cyclictest41-21ksoftirqd/322:35:243
1998099585,6cyclictest17517-21apt-get23:40:001
19980995825,5cyclictest25-21ksoftirqd/120:10:271
1998099581,8cyclictest25-21ksoftirqd/123:00:001
19980995811,3cyclictest25-21ksoftirqd/120:20:301
19981995745,7cyclictest33-21ksoftirqd/220:41:532
19981995745,7cyclictest33-21ksoftirqd/220:41:532
19980995724,4cyclictest25-21ksoftirqd/100:20:381
19980995723,3cyclictest121rcu_preempt19:46:381
19980995719,12cyclictest25-21ksoftirqd/123:25:161
19982995621,4cyclictest41-21ksoftirqd/320:45:223
19980995650,3cyclictest25-21ksoftirqd/120:20:001
19980995643,4cyclictest25-21ksoftirqd/120:30:141
19980995621,8cyclictest25-21ksoftirqd/122:05:001
19980995621,8cyclictest25-21ksoftirqd/120:05:191
1998099560,6cyclictest25-21ksoftirqd/123:30:221
1998299553,4cyclictest30093-21tr00:05:143
1998099557,3cyclictest25-21ksoftirqd/121:20:221
1998099555,7cyclictest206-21systemd-journal00:00:001
19980995549,4cyclictest25-21ksoftirqd/119:15:051
19980995519,7cyclictest25-21ksoftirqd/119:54:261
19982995423,9cyclictest41-21ksoftirqd/322:15:123
1998099549,8cyclictest25-21ksoftirqd/122:25:291
19980995426,7cyclictest25-21ksoftirqd/123:15:381
19980995419,3cyclictest121rcu_preempt19:44:251
1998099535,9cyclictest25-21ksoftirqd/121:45:251
1998099535,8cyclictest121rcu_preempt23:50:221
1998099535,7cyclictest25-21ksoftirqd/121:05:401
19980995347,3cyclictest25-21ksoftirqd/122:25:011
19980995339,4cyclictest25-21ksoftirqd/121:39:591
19980995336,4cyclictest25-21ksoftirqd/121:40:131
1998099532,8cyclictest25-21ksoftirqd/119:35:131
1998099531,9cyclictest25-21ksoftirqd/119:10:211
1998099531,9cyclictest25-21ksoftirqd/119:10:211
1998299523,4cyclictest41-21ksoftirqd/322:25:003
1998099526,4cyclictest25-21ksoftirqd/122:50:121
1998099523,7cyclictest25-21ksoftirqd/100:00:391
19980995218,7cyclictest25-21ksoftirqd/121:02:351
1998099520,5cyclictest25-21ksoftirqd/119:25:191
19981995121,5cyclictest33-21ksoftirqd/222:45:252
1998099517,3cyclictest121rcu_preempt23:05:271
1998099512,3cyclictest121rcu_preempt00:25:361
19979995144,4cyclictest9-21ksoftirqd/021:50:000
19981995043,4cyclictest33-21ksoftirqd/219:15:002
19981995043,4cyclictest33-21ksoftirqd/219:15:002
19979995044,3cyclictest12338-21cron22:20:010
1997999482,3cyclictest121rcu_preempt22:00:000
1997999481,5cyclictest3936-21chrt19:40:540
19979994741,3cyclictest9-21ksoftirqd/022:35:000
19979994740,4cyclictest9-21ksoftirqd/022:25:230
19979994713,4cyclictest9-21ksoftirqd/020:25:300
1924024615,19sleep00-21swapper/019:05:590
19979994538,4cyclictest9-21ksoftirqd/019:40:000
19979994439,3cyclictest9-21ksoftirqd/019:20:000
19979994439,3cyclictest9-21ksoftirqd/019:15:010
19979994439,3cyclictest9-21ksoftirqd/019:15:000
19981994331,7cyclictest33-21ksoftirqd/220:05:162
19979994338,3cyclictest9-21ksoftirqd/022:05:000
1997999433,7cyclictest0-21swapper/023:05:200
19979994337,4cyclictest9-21ksoftirqd/021:15:130
19979994337,3cyclictest9-21ksoftirqd/020:40:000
19979994337,3cyclictest9-21ksoftirqd/020:40:000
19979994336,4cyclictest9-21ksoftirqd/019:55:120
19979994237,3cyclictest9-21ksoftirqd/023:04:590
19979994236,4cyclictest9-21ksoftirqd/023:40:000
19979994236,4cyclictest9-21ksoftirqd/021:25:010
19979994236,4cyclictest9-21ksoftirqd/000:40:000
19979994236,3cyclictest9-21ksoftirqd/020:50:120
1997999423,5cyclictest0-21swapper/000:15:410
19979994235,4cyclictest9-21ksoftirqd/023:30:000
19979994235,4cyclictest9-21ksoftirqd/021:50:240
19979994235,4cyclictest9-21ksoftirqd/021:10:420
19981994135,4cyclictest33-21ksoftirqd/200:20:002
19979994136,3cyclictest9-21ksoftirqd/019:50:000
19979994135,3cyclictest9-21ksoftirqd/019:35:000
19979994134,4cyclictest9-21ksoftirqd/023:35:000
19979994134,4cyclictest9-21ksoftirqd/023:10:280
1997999410,3cyclictest121rcu_preempt22:05:170
19981994012,6cyclictest33-21ksoftirqd/223:50:352
19979994035,3cyclictest9-21ksoftirqd/022:20:360
19979994034,3cyclictest9-21ksoftirqd/023:20:000
19979994034,3cyclictest9-21ksoftirqd/022:40:010
19979994034,3cyclictest9-21ksoftirqd/021:40:000
19979994033,4cyclictest9-21ksoftirqd/022:50:010
19979994023,4cyclictest9-21ksoftirqd/023:55:000
19981993934,3cyclictest33-21ksoftirqd/221:55:002
19981993934,3cyclictest33-21ksoftirqd/219:35:012
19981993932,4cyclictest33-21ksoftirqd/223:45:012
19981993932,4cyclictest33-21ksoftirqd/222:25:242
19981993932,4cyclictest33-21ksoftirqd/221:06:492
19981993921,5cyclictest33-21ksoftirqd/221:34:592
1998199390,10cyclictest10047-21latency_hist22:15:002
1998199390,10cyclictest10047-21latency_hist22:14:592
19979993934,3cyclictest9-21ksoftirqd/000:25:000
19979993933,3cyclictest9-21ksoftirqd/021:00:000
19979993932,4cyclictest9-21ksoftirqd/020:55:360
19979993932,4cyclictest9-21ksoftirqd/020:10:170
19979993932,4cyclictest9-21ksoftirqd/020:10:000
19979993923,4cyclictest9-21ksoftirqd/020:05:000
19979993914,4cyclictest9-21ksoftirqd/021:30:300
19981993831,4cyclictest33-21ksoftirqd/222:05:212
1998199380,4cyclictest33-21ksoftirqd/223:20:002
1997999384,4cyclictest9-21ksoftirqd/000:05:360
19979993833,3cyclictest9-21ksoftirqd/021:05:250
19979993833,3cyclictest9-21ksoftirqd/019:25:260
19979993832,3cyclictest9-21ksoftirqd/000:15:000
19979993831,4cyclictest9-21ksoftirqd/023:45:010
19979993831,4cyclictest9-21ksoftirqd/022:45:010
19979993831,4cyclictest9-21ksoftirqd/019:51:240
1998199373,3cyclictest121rcu_preempt00:30:142
19981993731,3cyclictest33-21ksoftirqd/221:45:562
19981993731,3cyclictest33-21ksoftirqd/221:14:492
19981993731,3cyclictest33-21ksoftirqd/219:20:012
19981993730,4cyclictest33-21ksoftirqd/223:27:572
19981993730,4cyclictest33-21ksoftirqd/223:20:222
19981993730,4cyclictest33-21ksoftirqd/223:00:112
19981993730,4cyclictest33-21ksoftirqd/222:04:542
19981993730,4cyclictest33-21ksoftirqd/221:23:162
19981993730,4cyclictest33-21ksoftirqd/220:25:172
19981993730,4cyclictest33-21ksoftirqd/200:37:252
1998199371,7cyclictest0-21swapper/219:25:002
1997999374,3cyclictest121rcu_preempt21:40:340
19979993732,3cyclictest9-21ksoftirqd/020:25:000
19979993732,3cyclictest9-21ksoftirqd/020:15:150
19979993731,4cyclictest10023-21idleruntime-cro22:15:000
19979993731,4cyclictest10023-21idleruntime-cro22:14:590
19979993731,3cyclictest9-21ksoftirqd/023:45:150
19979993731,3cyclictest9-21ksoftirqd/020:50:010
19979993730,4cyclictest9-21ksoftirqd/023:55:280
19979993730,4cyclictest9-21ksoftirqd/000:30:120
19979993717,4cyclictest9-21ksoftirqd/000:25:280
1997999371,3cyclictest121rcu_preempt22:55:010
19981993631,3cyclictest33-21ksoftirqd/219:25:252
19981993631,3cyclictest33-21ksoftirqd/200:20:242
19981993630,4cyclictest33-21ksoftirqd/220:10:422
19981993630,3cyclictest33-21ksoftirqd/221:27:562
19981993629,4cyclictest33-21ksoftirqd/221:41:532
19981993629,4cyclictest33-21ksoftirqd/200:00:122
19981993623,10cyclictest33-21ksoftirqd/220:15:272
1998199361,6cyclictest29267-21cstates22:55:142
19979993631,3cyclictest9-21ksoftirqd/021:29:590
19979993631,3cyclictest9-21ksoftirqd/020:40:160
19979993631,3cyclictest9-21ksoftirqd/020:40:150
19979993631,3cyclictest9-21ksoftirqd/019:20:210
19979993630,4cyclictest9-21ksoftirqd/020:30:310
19979993624,4cyclictest9-21ksoftirqd/022:58:390
19981993530,3cyclictest33-21ksoftirqd/220:55:402
19981993530,3cyclictest33-21ksoftirqd/219:55:342
19981993529,3cyclictest33-21ksoftirqd/222:35:272
19981993529,3cyclictest33-21ksoftirqd/220:48:262
19981993529,3cyclictest33-21ksoftirqd/200:11:282
19981993528,4cyclictest33-21ksoftirqd/221:37:322
19981993528,4cyclictest33-21ksoftirqd/200:28:022
19979993529,4cyclictest9-21ksoftirqd/023:21:240
19979993528,4cyclictest9-21ksoftirqd/000:00:150
19981993429,3cyclictest33-21ksoftirqd/223:59:412
19981993429,3cyclictest33-21ksoftirqd/220:20:262
19981993429,3cyclictest33-21ksoftirqd/219:46:392
19981993428,4cyclictest33-21ksoftirqd/223:13:342
19981993428,4cyclictest33-21ksoftirqd/222:20:342
19981993428,3cyclictest33-21ksoftirqd/223:35:142
19981993428,3cyclictest33-21ksoftirqd/222:53:382
19981993427,4cyclictest33-21ksoftirqd/223:05:502
19981993427,4cyclictest33-21ksoftirqd/221:55:042
19981993327,4cyclictest33-21ksoftirqd/220:31:232
19981993327,3cyclictest33-21ksoftirqd/219:52:142
19981993326,4cyclictest33-21ksoftirqd/223:46:042
19981993326,4cyclictest33-21ksoftirqd/222:41:232
19981993326,4cyclictest33-21ksoftirqd/220:35:062
19981993326,4cyclictest33-21ksoftirqd/220:35:052
19981993325,5cyclictest33-21ksoftirqd/200:05:102
19981993227,3cyclictest33-21ksoftirqd/219:40:292
19981993125,4cyclictest33-21ksoftirqd/222:20:012
19981993125,4cyclictest33-21ksoftirqd/221:15:592
19981993024,4cyclictest33-21ksoftirqd/220:53:352
1998199290,6cyclictest121rcu_preempt23:30:122
19981992822,4cyclictest33-21ksoftirqd/222:32:242
19981992822,3cyclictest33-21ksoftirqd/221:00:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional