You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-24 - 00:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Sun Jun 23, 2024 12:46:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2912924760,7sleep20-21swapper/207:05:262
2947324710,10sleep30-21swapper/307:05:313
1819121770,8sleep03093599cyclictest09:00:140
576981250,13rtkit-daemon0-21swapper/007:06:240
85962910,2sleep30-21swapper/307:30:233
30938997870,4cyclictest41-21ksoftirqd/309:15:143
30938997767,5cyclictest41-21ksoftirqd/310:10:133
305962772,20sleep10-21swapper/107:09:261
30938997464,6cyclictest41-21ksoftirqd/311:55:103
30938997364,4cyclictest41-21ksoftirqd/307:45:133
30938997263,5cyclictest41-21ksoftirqd/308:20:133
30938997263,5cyclictest41-21ksoftirqd/307:20:093
30938996959,6cyclictest41-21ksoftirqd/312:05:133
30938996959,6cyclictest41-21ksoftirqd/310:40:103
30938996859,5cyclictest41-21ksoftirqd/309:10:113
30938996859,5cyclictest41-21ksoftirqd/307:25:133
104962670,5sleep233-21ksoftirqd/211:00:232
30938996553,8cyclictest41-21ksoftirqd/308:35:143
30938996453,6cyclictest41-21ksoftirqd/312:20:133
30938996327,5cyclictest41-21ksoftirqd/311:50:003
30938996252,5cyclictest41-21ksoftirqd/307:50:123
825591600,1ptp4l401ktimersoftd/311:53:343
825591600,1ptp4l401ktimersoftd/307:10:183
26532600,2sleep00-21swapper/009:35:220
241402590,8sleep23093799cyclictest12:40:002
30938995838,5cyclictest41-21ksoftirqd/310:15:393
30938995723,4cyclictest41-21ksoftirqd/311:05:353
57698560,2rtkit-daemon575-21rtkit-daemon12:02:422
30938995618,5cyclictest41-21ksoftirqd/309:40:013
30938995522,8cyclictest41-21ksoftirqd/308:50:303
30938995422,4cyclictest41-21ksoftirqd/310:50:283
30938995422,4cyclictest41-21ksoftirqd/310:50:283
30938995319,4cyclictest41-21ksoftirqd/311:20:013
825591520,1ptp4l401ktimersoftd/309:03:263
57698520,24rtkit-daemon9500-21iostat09:50:190
30938995220,13cyclictest41-21ksoftirqd/308:25:323
30938995219,8cyclictest41-21ksoftirqd/309:30:313
30938995145,3cyclictest41-21ksoftirqd/311:44:593
30938995119,4cyclictest41-21ksoftirqd/307:40:403
30938995118,7cyclictest41-21ksoftirqd/310:05:013
30936995144,4cyclictest25-21ksoftirqd/110:05:051
825591500,1ptp4l401ktimersoftd/309:27:023
825591500,1ptp4l401ktimersoftd/309:27:023
57698490,8rtkit-daemon0-21swapper/009:49:140
30938994942,4cyclictest41-21ksoftirqd/312:15:003
30938994942,4cyclictest41-21ksoftirqd/312:15:003
30938994942,3cyclictest41-21ksoftirqd/308:40:053
30938994937,3cyclictest41-21ksoftirqd/310:35:373
30938994919,7cyclictest41-21ksoftirqd/311:30:343
30938994917,4cyclictest41-21ksoftirqd/311:25:263
30938994915,4cyclictest41-21ksoftirqd/311:35:203
30935994942,4cyclictest9-21ksoftirqd/010:05:000
30938994843,3cyclictest41-21ksoftirqd/308:10:003
30938994835,10cyclictest41-21ksoftirqd/311:10:223
30938994815,8cyclictest41-21ksoftirqd/310:10:013
30938994815,7cyclictest41-21ksoftirqd/310:30:413
30936994842,3cyclictest25-21ksoftirqd/107:40:001
30938994740,4cyclictest41-21ksoftirqd/308:10:333
30938994640,3cyclictest41-21ksoftirqd/310:29:593
30938994640,3cyclictest41-21ksoftirqd/307:39:593
30938994639,4cyclictest41-21ksoftirqd/308:35:003
30938994638,4cyclictest41-21ksoftirqd/312:35:003
30938994634,10cyclictest41-21ksoftirqd/310:55:113
30936994641,3cyclictest25-21ksoftirqd/108:20:011
30936994640,4cyclictest25-21ksoftirqd/110:05:011
30936994640,3cyclictest25-21ksoftirqd/108:00:001
30936994640,3cyclictest25-21ksoftirqd/108:00:001
30938994540,3cyclictest41-21ksoftirqd/312:30:013
30938994539,4cyclictest41-21ksoftirqd/309:25:003
30938994539,3cyclictest41-21ksoftirqd/310:50:003
30938994538,4cyclictest41-21ksoftirqd/311:20:053
30938994538,4cyclictest41-21ksoftirqd/309:55:013
30938994538,4cyclictest41-21ksoftirqd/308:05:013
30938994537,4cyclictest41-21ksoftirqd/312:35:223
825591440,1ptp4l0-21swapper/309:06:273
30938994439,3cyclictest41-21ksoftirqd/308:59:593
30938994429,11cyclictest41-21ksoftirqd/309:40:393
30936994438,3cyclictest25-21ksoftirqd/111:20:001
30935994439,3cyclictest9-21ksoftirqd/008:59:590
3093899434,8cyclictest41-21ksoftirqd/308:50:003
30938994338,3cyclictest41-21ksoftirqd/312:00:383
30938994337,3cyclictest41-21ksoftirqd/312:20:003
30938994337,3cyclictest41-21ksoftirqd/311:05:013
30938994336,4cyclictest41-21ksoftirqd/310:00:013
30935994336,4cyclictest9-21ksoftirqd/010:24:590
30938994235,4cyclictest41-21ksoftirqd/310:24:593
30938994235,4cyclictest41-21ksoftirqd/308:20:003
30938994235,4cyclictest41-21ksoftirqd/307:20:003
30938994233,4cyclictest41-21ksoftirqd/309:45:143
30936994236,3cyclictest25-21ksoftirqd/112:10:241
30936994236,3cyclictest25-21ksoftirqd/112:10:231
30935994235,4cyclictest9-21ksoftirqd/012:35:240
30938994134,4cyclictest41-21ksoftirqd/307:55:173
30938994134,4cyclictest41-21ksoftirqd/307:55:173
30937994136,3cyclictest33-21ksoftirqd/211:20:002
30936994135,4cyclictest25-21ksoftirqd/110:55:151
30936994135,4cyclictest25-21ksoftirqd/108:05:001
30936994134,4cyclictest25-21ksoftirqd/111:39:591
30935994134,4cyclictest9-21ksoftirqd/011:40:000
3093599411,4cyclictest121rcu_preempt07:15:260
30936994035,3cyclictest25-21ksoftirqd/109:20:001
30936994033,4cyclictest28210-21kworker/1:012:05:261
30936994033,4cyclictest25-21ksoftirqd/109:50:101
30935994035,3cyclictest20476-21latency_hist10:15:000
30935994033,4cyclictest9-21ksoftirqd/012:20:000
30935994033,4cyclictest9-21ksoftirqd/011:00:000
30935994033,4cyclictest9-21ksoftirqd/010:35:340
30936993933,3cyclictest25-21ksoftirqd/111:30:001
30936993931,5cyclictest25-21ksoftirqd/110:34:491
30935993934,3cyclictest9-21ksoftirqd/012:35:010
30935993934,3cyclictest9-21ksoftirqd/008:31:420
30935993933,4cyclictest9-21ksoftirqd/009:30:000
30935993933,4cyclictest9-21ksoftirqd/009:30:000
30935993933,4cyclictest9-21ksoftirqd/009:10:220
30935993933,3cyclictest9-21ksoftirqd/012:10:010
30935993933,3cyclictest9-21ksoftirqd/011:10:160
30935993932,4cyclictest9-21ksoftirqd/009:40:120
267223931,3sleep125-21ksoftirqd/108:25:421
30936993832,4cyclictest25-21ksoftirqd/112:35:011
30936993832,4cyclictest25-21ksoftirqd/110:25:241
30936993832,3cyclictest25-21ksoftirqd/109:40:011
30936993832,3cyclictest25-21ksoftirqd/108:20:281
30936993831,5cyclictest25-21ksoftirqd/110:16:261
30936993831,4cyclictest25-21ksoftirqd/111:15:011
30936993831,4cyclictest25-21ksoftirqd/110:41:111
30936993831,4cyclictest25-21ksoftirqd/108:09:131
30935993833,3cyclictest9-21ksoftirqd/009:20:000
30935993832,4cyclictest9-21ksoftirqd/010:35:000
30935993832,4cyclictest9-21ksoftirqd/008:50:190
30935993832,3cyclictest9-21ksoftirqd/011:55:000
30935993832,3cyclictest9-21ksoftirqd/011:25:170
30935993832,3cyclictest9-21ksoftirqd/007:55:000
30935993831,4cyclictest9-21ksoftirqd/012:30:010
30935993831,4cyclictest9-21ksoftirqd/012:20:310
30935993831,4cyclictest9-21ksoftirqd/011:05:010
30935993831,4cyclictest9-21ksoftirqd/010:50:100
30935993831,4cyclictest9-21ksoftirqd/010:50:100
30935993831,4cyclictest9-21ksoftirqd/010:00:000
30935993831,4cyclictest9-21ksoftirqd/008:20:000
30935993831,4cyclictest9-21ksoftirqd/008:15:000
30937993730,4cyclictest33-21ksoftirqd/211:54:302
30937993730,4cyclictest33-21ksoftirqd/210:10:372
30936993731,3cyclictest25-21ksoftirqd/108:40:011
30936993730,4cyclictest25-21ksoftirqd/112:25:131
30936993730,4cyclictest25-21ksoftirqd/109:08:331
30935993732,3cyclictest9-21ksoftirqd/007:10:220
30935993731,4cyclictest9-21ksoftirqd/011:30:290
30935993731,3cyclictest9-21ksoftirqd/010:25:130
30935993730,4cyclictest9-21ksoftirqd/008:00:000
30935993730,4cyclictest9-21ksoftirqd/008:00:000
3093599370,4cyclictest121rcu_preempt10:40:350
30937993630,4cyclictest33-21ksoftirqd/211:36:432
30937993630,4cyclictest33-21ksoftirqd/208:50:262
30937993630,4cyclictest33-21ksoftirqd/208:25:372
30937993630,3cyclictest33-21ksoftirqd/208:22:352
30937993629,4cyclictest33-21ksoftirqd/210:15:382
30937993629,4cyclictest33-21ksoftirqd/209:09:312
30937993629,4cyclictest18049-21cron10:10:012
30937993628,5cyclictest33-21ksoftirqd/209:10:582
30936993630,4cyclictest25-21ksoftirqd/111:40:351
30936993630,3cyclictest25-21ksoftirqd/109:40:141
30936993630,3cyclictest25-21ksoftirqd/109:12:071
30936993630,3cyclictest25-21ksoftirqd/107:30:001
30936993629,4cyclictest25-21ksoftirqd/112:23:111
30936993629,4cyclictest25-21ksoftirqd/112:04:221
30936993629,4cyclictest25-21ksoftirqd/111:58:241
30936993629,4cyclictest25-21ksoftirqd/109:04:511
30936993629,4cyclictest25-21ksoftirqd/107:31:171
3093599369,5cyclictest9-21ksoftirqd/008:20:290
30935993630,4cyclictest9-21ksoftirqd/011:45:250
30935993630,4cyclictest9-21ksoftirqd/010:45:360
30935993630,4cyclictest9-21ksoftirqd/009:05:110
30935993630,4cyclictest9-21ksoftirqd/008:01:030
30935993629,4cyclictest9-21ksoftirqd/011:59:270
30935993629,4cyclictest9-21ksoftirqd/010:19:390
30935993629,4cyclictest9-21ksoftirqd/008:05:170
30937993530,3cyclictest33-21ksoftirqd/210:55:342
30937993530,3cyclictest33-21ksoftirqd/210:00:302
30937993529,4cyclictest33-21ksoftirqd/210:36:572
30937993529,4cyclictest33-21ksoftirqd/207:34:552
30937993529,3cyclictest571-21rs:main2
30937993529,3cyclictest33-21ksoftirqd/207:21:062
30937993528,4cyclictest33-21ksoftirqd/207:44:292
30936993530,3cyclictest25-21ksoftirqd/109:45:381
30936993529,4cyclictest25-21ksoftirqd/111:54:501
30936993529,4cyclictest25-21ksoftirqd/111:00:221
30936993529,4cyclictest25-21ksoftirqd/108:45:011
30936993529,4cyclictest25-21ksoftirqd/107:14:471
30936993529,3cyclictest25-21ksoftirqd/110:38:011
30936993528,4cyclictest25-21ksoftirqd/112:32:121
30936993528,4cyclictest25-21ksoftirqd/112:15:361
30935993530,3cyclictest9-21ksoftirqd/007:50:010
30935993529,4cyclictest9-21ksoftirqd/008:27:570
30935993528,4cyclictest9-21ksoftirqd/008:40:540
30935993528,4cyclictest9-21ksoftirqd/007:35:140
3093599350,4cyclictest121rcu_preempt11:05:120
30937993428,4cyclictest33-21ksoftirqd/211:46:282
30937993428,4cyclictest33-21ksoftirqd/207:56:362
30937993428,4cyclictest33-21ksoftirqd/207:56:362
30937993428,3cyclictest33-21ksoftirqd/208:11:072
30937993427,5cyclictest33-21ksoftirqd/212:07:402
30937993427,4cyclictest33-21ksoftirqd/212:20:382
30937993427,4cyclictest33-21ksoftirqd/209:34:402
30937993427,4cyclictest33-21ksoftirqd/209:28:582
30937993427,4cyclictest33-21ksoftirqd/209:28:582
30937993427,4cyclictest33-21ksoftirqd/209:17:582
30937993427,4cyclictest33-21ksoftirqd/209:00:512
30937993427,4cyclictest33-21ksoftirqd/207:15:042
30936993428,3cyclictest25-21ksoftirqd/108:49:131
30936993428,3cyclictest25-21ksoftirqd/107:42:191
30936993427,4cyclictest25-21ksoftirqd/111:33:311
30936993427,4cyclictest25-21ksoftirqd/111:21:591
30936993427,4cyclictest25-21ksoftirqd/110:52:201
30936993427,4cyclictest25-21ksoftirqd/110:52:201
30936993427,4cyclictest25-21ksoftirqd/108:57:381
3093699341,3cyclictest121rcu_preempt10:15:001
30935993429,3cyclictest9-21ksoftirqd/010:05:150
30935993429,3cyclictest9-21ksoftirqd/007:40:260
30935993428,4cyclictest9-21ksoftirqd/011:20:300
30935993428,3cyclictest9-21ksoftirqd/008:47:550
30935993427,4cyclictest9-21ksoftirqd/007:22:080
30937993328,3cyclictest33-21ksoftirqd/208:00:212
30937993327,4cyclictest33-21ksoftirqd/212:27:362
30937993327,4cyclictest33-21ksoftirqd/211:23:042
30937993327,4cyclictest33-21ksoftirqd/210:54:182
30937993327,4cyclictest33-21ksoftirqd/210:54:182
30937993327,4cyclictest33-21ksoftirqd/208:47:022
30937993327,4cyclictest33-21ksoftirqd/208:18:352
30937993327,3cyclictest33-21ksoftirqd/208:39:252
30937993327,3cyclictest33-21ksoftirqd/207:53:202
30937993326,4cyclictest33-21ksoftirqd/212:30:362
30937993326,4cyclictest33-21ksoftirqd/211:09:442
30937993326,4cyclictest33-21ksoftirqd/209:38:252
30937993326,4cyclictest33-21ksoftirqd/207:37:332
30937993325,5cyclictest33-21ksoftirqd/208:32:372
30936993327,4cyclictest25-21ksoftirqd/109:20:171
30936993327,4cyclictest25-21ksoftirqd/108:30:251
30936993327,3cyclictest25-21ksoftirqd/111:05:071
30936993327,3cyclictest25-21ksoftirqd/109:34:461
30936993327,3cyclictest25-21ksoftirqd/107:16:151
30936993326,4cyclictest25-21ksoftirqd/107:51:161
30936993325,5cyclictest25-21ksoftirqd/108:12:051
30935993328,3cyclictest9-21ksoftirqd/008:35:270
30935993327,4cyclictest9-21ksoftirqd/007:30:200
30935993327,4cyclictest9-21ksoftirqd/007:25:300
30935993327,3cyclictest9-21ksoftirqd/012:14:230
30935993327,3cyclictest9-21ksoftirqd/012:14:230
30935993326,4cyclictest9-21ksoftirqd/011:44:590
30935993326,4cyclictest9-21ksoftirqd/009:30:100
30935993326,4cyclictest9-21ksoftirqd/009:20:350
30937993227,3cyclictest33-21ksoftirqd/211:30:522
30937993226,4cyclictest33-21ksoftirqd/209:42:192
30937993226,3cyclictest33-21ksoftirqd/207:29:082
30937993225,4cyclictest33-21ksoftirqd/211:41:592
30937993225,4cyclictest33-21ksoftirqd/211:29:262
30937993225,4cyclictest33-21ksoftirqd/210:31:572
30937993225,4cyclictest33-21ksoftirqd/208:58:272
30937993223,6cyclictest33-21ksoftirqd/209:51:562
30935993226,3cyclictest9-21ksoftirqd/011:15:450
30937993126,3cyclictest33-21ksoftirqd/210:44:132
30937993125,4cyclictest33-21ksoftirqd/208:44:432
30937993125,4cyclictest33-21ksoftirqd/208:09:412
30937993124,4cyclictest33-21ksoftirqd/211:15:002
30936993126,3cyclictest25-21ksoftirqd/110:45:391
30936993125,4cyclictest25-21ksoftirqd/107:20:131
30936993125,3cyclictest25-21ksoftirqd/109:25:391
30936993125,3cyclictest25-21ksoftirqd/109:25:391
30936993124,4cyclictest25-21ksoftirqd/110:23:241
30936993124,4cyclictest25-21ksoftirqd/109:58:241
30935993124,4cyclictest9-21ksoftirqd/012:02:240
30937993025,3cyclictest33-21ksoftirqd/210:25:522
30937993025,3cyclictest33-21ksoftirqd/209:47:282
30937993023,4cyclictest33-21ksoftirqd/210:47:072
30937993023,4cyclictest33-21ksoftirqd/209:24:482
30936993022,5cyclictest25-21ksoftirqd/107:47:231
30937992923,4cyclictest33-21ksoftirqd/212:12:032
30937992923,4cyclictest33-21ksoftirqd/212:12:022
30937992923,3cyclictest33-21ksoftirqd/212:00:002
30937992820,6cyclictest33-21ksoftirqd/209:55:252
30936992821,4cyclictest25-21ksoftirqd/111:49:411
30936992821,4cyclictest25-21ksoftirqd/108:50:371
30937992618,5cyclictest33-21ksoftirqd/212:15:382
30937992418,4cyclictest33-21ksoftirqd/210:20:292
30937992116,3cyclictest33-21ksoftirqd/207:45:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional