You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-03 - 21:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Tue Oct 03, 2023 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
179191990,38ptp4l401ktimersoftd/307:30:103
179191830,1ptp4l401ktimersoftd/312:44:203
179191700,1ptp4l401ktimersoftd/311:50:023
233632650,2sleep30-21swapper/312:53:023
179191650,1ptp4l401ktimersoftd/310:56:223
134432644,10sleep00-21swapper/007:32:140
13657996350,6cyclictest33-21ksoftirqd/210:48:592
293352610,5sleep229336-21irqrtprio12:24:062
293352610,5sleep229336-21irqrtprio12:24:062
132942614,9sleep20-21swapper/207:30:182
179191590,1ptp4l401ktimersoftd/310:49:493
132822590,2sleep30-21swapper/312:41:463
13651995751,3cyclictest25-21ksoftirqd/111:33:571
184891560,1getstats0-21swapper/309:59:103
179191560,1ptp4l401ktimersoftd/311:44:213
179191560,1ptp4l401ktimersoftd/309:46:013
13657995644,6cyclictest33-21ksoftirqd/209:28:542
5672550,2sleep30-21swapper/311:54:043
13657995529,3cyclictest33-21ksoftirqd/208:14:092
13657995522,7cyclictest33-21ksoftirqd/211:09:122
323282520,1sleep00-21swapper/013:02:220
218192520,2sleep10-21swapper/111:42:061
13657995226,15cyclictest33-21ksoftirqd/211:49:042
132212524,36sleep10-21swapper/107:29:201
179191510,1ptp4l20421-21kworker/3:210:39:063
162792510,5sleep014757-21/usr/sbin/munin12:44:160
13657995144,4cyclictest33-21ksoftirqd/209:48:412
13657995141,4cyclictest33-21ksoftirqd/210:54:012
13657995126,4cyclictest33-21ksoftirqd/208:09:082
13651995144,4cyclictest25-21ksoftirqd/110:33:571
19362500,2sleep30-21swapper/310:04:203
179191500,1ptp4l401ktimersoftd/311:09:033
13657995041,5cyclictest33-21ksoftirqd/210:38:582
13657994934,3cyclictest33-21ksoftirqd/208:54:152
13657994934,3cyclictest33-21ksoftirqd/208:54:152
13657994923,4cyclictest33-21ksoftirqd/212:14:072
13657994923,4cyclictest33-21ksoftirqd/208:34:032
13657994921,6cyclictest33-21ksoftirqd/212:12:402
13657994919,7cyclictest33-21ksoftirqd/212:49:142
13657994841,4cyclictest33-21ksoftirqd/212:34:012
13657994837,4cyclictest33-21ksoftirqd/211:04:122
13657994828,17cyclictest33-21ksoftirqd/212:04:052
13657994826,7cyclictest33-21ksoftirqd/208:19:122
179191470,1ptp4l401ktimersoftd/307:34:103
13657994723,7cyclictest33-21ksoftirqd/210:13:372
13657994722,4cyclictest33-21ksoftirqd/211:59:052
13657994722,4cyclictest33-21ksoftirqd/211:39:182
179191460,1ptp4l401ktimersoftd/309:56:433
179191460,13ptp4l23497-21kworker/3:012:02:543
13657994636,4cyclictest33-21ksoftirqd/207:38:532
13657994633,3cyclictest33-21ksoftirqd/209:48:372
13657994622,7cyclictest33-21ksoftirqd/212:48:412
13657994614,8cyclictest33-21ksoftirqd/210:03:372
179191450,1ptp4l401ktimersoftd/311:21:353
179191450,13ptp4l23497-21kworker/3:012:12:213
1365799454,3cyclictest33-21ksoftirqd/210:44:202
13657994527,3cyclictest33-21ksoftirqd/212:39:072
13657994520,4cyclictest33-21ksoftirqd/209:39:052
13651994537,5cyclictest25-21ksoftirqd/109:23:571
13657994425,9cyclictest33-21ksoftirqd/208:43:352
13657994425,16cyclictest33-21ksoftirqd/211:38:402
13657994419,4cyclictest33-21ksoftirqd/209:34:582
13657994419,4cyclictest33-21ksoftirqd/208:44:092
1365799435,3cyclictest33-21ksoftirqd/212:29:062
1365799435,3cyclictest33-21ksoftirqd/212:29:062
1365799434,4cyclictest33-21ksoftirqd/207:58:572
13657994331,3cyclictest33-21ksoftirqd/211:29:052
13657994326,3cyclictest33-21ksoftirqd/210:59:102
13657994323,16cyclictest33-21ksoftirqd/212:59:072
13657994321,7cyclictest33-21ksoftirqd/211:53:582
1365799431,3cyclictest121rcu_preempt09:23:362
13657994313,4cyclictest33-21ksoftirqd/207:49:052
1365799426,3cyclictest33-21ksoftirqd/211:46:532
1365799425,7cyclictest33-21ksoftirqd/210:34:082
1365799425,3cyclictest33-21ksoftirqd/210:18:592
13657994237,2cyclictest321ktimersoftd/209:04:052
13657994231,3cyclictest33-21ksoftirqd/210:04:032
13657994219,7cyclictest33-21ksoftirqd/208:59:012
13657994217,4cyclictest33-21ksoftirqd/211:14:312
13657994217,4cyclictest33-21ksoftirqd/209:53:582
13657994216,4cyclictest33-21ksoftirqd/212:57:142
13657994211,6cyclictest33-21ksoftirqd/209:24:062
179191410,1ptp4l401ktimersoftd/309:29:133
13657994133,4cyclictest33-21ksoftirqd/211:23:592
13657994128,3cyclictest33-21ksoftirqd/210:24:032
13657994127,11cyclictest33-21ksoftirqd/211:19:092
1365799411,5cyclictest33-21ksoftirqd/210:33:372
179191400,1ptp4l401ktimersoftd/308:54:063
179191400,1ptp4l401ktimersoftd/308:54:063
1365799405,3cyclictest33-21ksoftirqd/212:19:292
1365799405,3cyclictest33-21ksoftirqd/212:19:292
1365799403,3cyclictest33-21ksoftirqd/207:44:002
1365799402,5cyclictest8532-21fschecks_count08:28:572
13657994019,7cyclictest33-21ksoftirqd/209:14:102
13657994010,7cyclictest33-21ksoftirqd/208:04:062
179191390,1ptp4l401ktimersoftd/311:26:453
179191390,1ptp4l401ktimersoftd/310:17:583
1365799397,7cyclictest33-21ksoftirqd/208:49:082
1365799397,7cyclictest33-21ksoftirqd/208:49:082
1365799396,6cyclictest33-21ksoftirqd/209:13:362
13657993911,9cyclictest33-21ksoftirqd/207:58:352
179191380,1ptp4l401ktimersoftd/312:34:423
179191380,1ptp4l401ktimersoftd/311:34:043
179191380,1ptp4l401ktimersoftd/311:03:463
179191380,1ptp4l401ktimersoftd/309:39:403
179191380,1ptp4l401ktimersoftd/309:35:343
13657993832,3cyclictest33-21ksoftirqd/210:14:022
13657993832,3cyclictest33-21ksoftirqd/207:38:342
13651993831,4cyclictest25-21ksoftirqd/108:33:541
179191370,1ptp4l401ktimersoftd/312:33:193
179191370,1ptp4l401ktimersoftd/312:33:193
179191370,1ptp4l401ktimersoftd/312:27:473
179191370,1ptp4l401ktimersoftd/312:27:473
179191370,1ptp4l401ktimersoftd/311:40:013
179191370,1ptp4l401ktimersoftd/311:02:383
179191370,1ptp4l401ktimersoftd/310:46:063
179191370,1ptp4l401ktimersoftd/310:22:583
179191370,0ptp4l401ktimersoftd/307:55:383
1365799371,3cyclictest121rcu_preempt08:24:132
179191360,1ptp4l401ktimersoftd/310:33:433
179191360,1ptp4l401ktimersoftd/309:52:443
179191360,14ptp4l401ktimersoftd/308:09:223
179191360,0ptp4l401ktimersoftd/312:22:363
179191360,0ptp4l401ktimersoftd/312:22:363
179191360,0ptp4l401ktimersoftd/310:27:033
13651993626,6cyclictest25-21ksoftirqd/110:44:001
179191350,1ptp4l401ktimersoftd/313:03:283
179191350,1ptp4l401ktimersoftd/312:05:173
1365199353,3cyclictest121rcu_preempt12:24:121
1365199353,3cyclictest121rcu_preempt12:24:121
13651993526,5cyclictest25-21ksoftirqd/109:48:561
13651993428,3cyclictest25-21ksoftirqd/112:49:091
13651993425,6cyclictest25-21ksoftirqd/107:33:551
1364799342,28cyclictest8993-21sh11:28:580
312112330,1sleep10-21swapper/111:52:051
179191330,1ptp4l401ktimersoftd/309:23:493
179191330,1ptp4l401ktimersoftd/308:46:113
13651993327,3cyclictest25-21ksoftirqd/109:18:361
13651993323,6cyclictest25-21ksoftirqd/107:48:551
13651993321,6cyclictest25-21ksoftirqd/108:18:531
179191320,1ptp4l401ktimersoftd/311:31:193
179191320,1ptp4l401ktimersoftd/310:31:233
179191320,1ptp4l401ktimersoftd/310:09:163
179191320,1ptp4l401ktimersoftd/308:52:433
179191320,1ptp4l401ktimersoftd/308:52:433
179191320,1ptp4l401ktimersoftd/308:34:283
179191320,0ptp4l401ktimersoftd/308:23:593
13651993227,3cyclictest25-21ksoftirqd/111:23:391
13651993227,3cyclictest25-21ksoftirqd/111:09:061
13651993227,3cyclictest25-21ksoftirqd/110:58:381
179191310,1ptp4l401ktimersoftd/311:15:103
179191310,1ptp4l401ktimersoftd/309:22:543
179191310,1ptp4l401ktimersoftd/308:19:253
179191310,1ptp4l401ktimersoftd/307:39:353
13651993126,3cyclictest25-21ksoftirqd/112:23:401
13651993126,3cyclictest25-21ksoftirqd/112:23:401
13651993126,3cyclictest25-21ksoftirqd/111:48:401
13651993126,3cyclictest231rcuc/112:08:571
13651993125,3cyclictest25-21ksoftirqd/110:59:231
13651993125,3cyclictest25-21ksoftirqd/108:03:341
13651993025,3cyclictest25-21ksoftirqd/109:54:041
13651993024,3cyclictest25-21ksoftirqd/112:04:081
13651993024,3cyclictest25-21ksoftirqd/109:48:371
13651993023,4cyclictest25-21ksoftirqd/108:18:341
1364799305,16cyclictest18975-21ssh11:03:550
179191290,1ptp4l401ktimersoftd/312:18:293
179191290,1ptp4l401ktimersoftd/307:50:203
179191290,10ptp4l401ktimersoftd/309:13:113
13651992924,3cyclictest25-21ksoftirqd/110:53:381
13651992924,3cyclictest25-21ksoftirqd/110:13:371
13651992924,3cyclictest25-21ksoftirqd/108:54:041
13651992924,3cyclictest25-21ksoftirqd/108:54:041
13651992924,3cyclictest25-21ksoftirqd/108:33:351
13651992924,3cyclictest25-21ksoftirqd/107:39:111
13651992923,3cyclictest25-21ksoftirqd/111:54:061
13651992923,3cyclictest25-21ksoftirqd/110:03:371
13651992923,3cyclictest25-21ksoftirqd/109:03:351
13651992923,3cyclictest25-21ksoftirqd/108:43:351
13651992921,7cyclictest25-21ksoftirqd/112:02:101
13647992922,4cyclictest9-21ksoftirqd/008:08:560
179191280,0ptp4l401ktimersoftd/309:14:023
13661992822,4cyclictest41-21ksoftirqd/307:58:563
13661992821,4cyclictest41-21ksoftirqd/307:45:293
13651992823,3cyclictest25-21ksoftirqd/109:23:361
13651992823,3cyclictest25-21ksoftirqd/108:23:581
13651992822,3cyclictest25-21ksoftirqd/113:03:411
13651992822,3cyclictest25-21ksoftirqd/109:29:031
13651992822,3cyclictest25-21ksoftirqd/108:49:051
13651992822,3cyclictest25-21ksoftirqd/108:49:051
13647992823,3cyclictest9-21ksoftirqd/012:29:130
13647992823,3cyclictest9-21ksoftirqd/012:29:130
13647992822,3cyclictest9-21ksoftirqd/008:31:300
13647992821,4cyclictest9-21ksoftirqd/008:52:180
13647992821,4cyclictest9-21ksoftirqd/008:52:180
100042280,4sleep09-21ksoftirqd/012:04:050
179191270,1ptp4l401ktimersoftd/308:32:533
13661992721,3cyclictest41-21ksoftirqd/308:05:133
13661992720,4cyclictest41-21ksoftirqd/312:56:593
1365199275,3cyclictest121rcu_preempt12:36:261
13651992722,3cyclictest25-21ksoftirqd/112:38:591
13651992722,3cyclictest25-21ksoftirqd/110:39:051
13651992722,3cyclictest25-21ksoftirqd/110:24:041
13651992722,3cyclictest25-21ksoftirqd/109:34:001
13651992722,3cyclictest25-21ksoftirqd/108:13:341
13651992722,3cyclictest25-21ksoftirqd/108:03:581
13651992722,3cyclictest25-21ksoftirqd/107:58:341
13651992722,3cyclictest25-21ksoftirqd/107:43:581
13651992721,4cyclictest25-21ksoftirqd/108:46:331
13651992721,3cyclictest25-21ksoftirqd/112:14:111
13651992721,3cyclictest25-21ksoftirqd/110:19:071
13651992721,3cyclictest25-21ksoftirqd/109:43:371
13651992720,4cyclictest28102-21grep11:14:021
13647992722,3cyclictest9-21ksoftirqd/010:03:570
13647992722,3cyclictest9-21ksoftirqd/008:05:090
13647992721,3cyclictest9-21ksoftirqd/012:02:120
13647992721,3cyclictest9-21ksoftirqd/009:13:300
13647992721,3cyclictest9-21ksoftirqd/008:58:290
13647992721,3cyclictest9-21ksoftirqd/008:58:290
13647992720,4cyclictest9-21ksoftirqd/008:41:380
13651992621,3cyclictest25-21ksoftirqd/112:29:131
13651992621,3cyclictest25-21ksoftirqd/112:29:131
13651992621,3cyclictest25-21ksoftirqd/111:24:111
13651992621,3cyclictest25-21ksoftirqd/110:18:371
13651992620,4cyclictest25-21ksoftirqd/109:09:031
13651992620,3cyclictest25-21ksoftirqd/112:44:081
13651992620,3cyclictest25-21ksoftirqd/110:04:411
13651992619,4cyclictest25-21ksoftirqd/109:05:521
13647992620,3cyclictest9-21ksoftirqd/010:53:470
13647992620,3cyclictest9-21ksoftirqd/009:06:230
13647992619,4cyclictest9-21ksoftirqd/007:41:250
118232260,2sleep00-21swapper/010:18:020
179191250,0ptp4l401ktimersoftd/308:43:263
13651992519,4cyclictest25-21ksoftirqd/111:29:031
13651992519,3cyclictest25-21ksoftirqd/110:29:031
13647992520,3cyclictest9-21ksoftirqd/010:38:590
13647992519,3cyclictest9-21ksoftirqd/009:30:100
13647992519,3cyclictest9-21ksoftirqd/009:18:110
13647992519,3cyclictest9-21ksoftirqd/009:01:490
13647992519,3cyclictest9-21ksoftirqd/007:57:420
13647992518,4cyclictest9-21ksoftirqd/011:54:070
13647992518,4cyclictest32414-21head09:19:010
1364799251,3cyclictest121rcu_preempt12:25:100
1364799251,3cyclictest121rcu_preempt12:25:100
229412240,2sleep00-21swapper/011:43:410
179191240,1ptp4l401ktimersoftd/309:04:003
179191240,1ptp4l401ktimersoftd/308:14:053
13651992419,3cyclictest25-21ksoftirqd/112:54:211
1364799242,12cyclictest23821-21ssh12:18:590
1364799242,12cyclictest23821-21ssh12:18:590
13647992419,3cyclictest9-21ksoftirqd/012:38:570
13647992419,3cyclictest9-21ksoftirqd/010:44:530
13647992419,3cyclictest9-21ksoftirqd/009:54:040
13647992418,3cyclictest9-21ksoftirqd/009:59:260
13647992417,4cyclictest24865-21sendmail_mailst11:09:110
209292230,2sleep00-21swapper/011:40:280
179191230,1ptp4l401ktimersoftd/308:58:553
13647992319,3cyclictest9-21ksoftirqd/012:10:430
13647992318,3cyclictest9-21ksoftirqd/008:34:400
13647992318,3cyclictest9-21ksoftirqd/007:50:080
13647992317,3cyclictest9-21ksoftirqd/009:34:340
13647992317,3cyclictest9-21ksoftirqd/008:16:040
13647992316,4cyclictest9-21ksoftirqd/012:37:290
13647992316,4cyclictest9-21ksoftirqd/007:48:270
13651992217,3cyclictest25-21ksoftirqd/111:04:071
13647992217,3cyclictest9-21ksoftirqd/012:53:410
13647992217,3cyclictest9-21ksoftirqd/012:14:130
13647992217,3cyclictest9-21ksoftirqd/011:24:550
13647992217,3cyclictest9-21ksoftirqd/010:59:410
13647992217,3cyclictest9-21ksoftirqd/010:49:150
13647992217,3cyclictest9-21ksoftirqd/009:43:590
13647992217,3cyclictest9-21ksoftirqd/008:18:460
13647992215,4cyclictest9-21ksoftirqd/011:19:280
13647992116,3cyclictest9-21ksoftirqd/010:30:340
13647992116,3cyclictest9-21ksoftirqd/007:59:030
13647992116,3cyclictest28599-21grep11:49:080
13647992114,4cyclictest9-21ksoftirqd/011:13:460
13647992114,4cyclictest9-21ksoftirqd/007:35:220
13647992015,3cyclictest9-21ksoftirqd/011:36:080
13647992015,3cyclictest9-21ksoftirqd/010:25:230
13647992015,3cyclictest9-21ksoftirqd/009:49:270
13647992015,3cyclictest9-21ksoftirqd/008:47:230
13647992014,3cyclictest9-21ksoftirqd/012:54:070
13647992013,4cyclictest7504-21grep08:24:120
13647992013,4cyclictest11084-21/usr/sbin/munin09:39:110
13647991914,3cyclictest9-21ksoftirqd/009:28:230
13647991912,4cyclictest26901-21timerwakeupswit10:34:150
13647991813,3cyclictest4176-21bc10:08:550
13647991813,3cyclictest13220-21cat10:19:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional