You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri May 02, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2108421660,4sleep32055299cyclictest21:26:113
1518911650,5ptp4l401ktimersoftd/321:23:153
129692780,2sleep20-21swapper/200:32:512
5042660,2sleep30-21swapper/300:20:433
240422650,4sleep22054399cyclictest22:36:242
20552996535,3cyclictest41-21ksoftirqd/302:16:163
203732654,10sleep10-21swapper/121:25:091
203252654,10sleep00-21swapper/021:24:320
20552996355,4cyclictest41-21ksoftirqd/302:11:133
20552996254,4cyclictest41-21ksoftirqd/300:01:113
202522615,11sleep20-21swapper/221:23:332
188432600,4sleep125-21ksoftirqd/102:22:511
122682600,4sleep2321ktimersoftd/202:51:582
151891570,1ptp4l401ktimersoftd/301:45:213
20552995648,4cyclictest41-21ksoftirqd/301:56:123
20552995546,5cyclictest41-21ksoftirqd/322:16:093
151891550,1ptp4l401ktimersoftd/300:40:173
20552995445,5cyclictest41-21ksoftirqd/321:36:073
20552995344,5cyclictest41-21ksoftirqd/301:21:133
151891520,1ptp4l401ktimersoftd/300:15:303
20552995040,4cyclictest41-21ksoftirqd/322:01:113
20552994925,4cyclictest41-21ksoftirqd/301:26:223
20552994842,3cyclictest41-21ksoftirqd/301:11:033
20552994824,4cyclictest41-21ksoftirqd/302:36:343
20552994736,5cyclictest41-21ksoftirqd/321:31:073
20552994725,7cyclictest41-21ksoftirqd/323:35:563
20552994722,4cyclictest41-21ksoftirqd/301:03:223
20552994722,4cyclictest41-21ksoftirqd/300:32:543
20552994720,4cyclictest41-21ksoftirqd/301:10:523
20552994720,4cyclictest41-21ksoftirqd/300:59:573
20552994622,4cyclictest41-21ksoftirqd/302:08:193
20552994621,4cyclictest41-21ksoftirqd/300:51:203
20552994620,4cyclictest41-21ksoftirqd/301:17:173
20552994532,3cyclictest41-21ksoftirqd/323:46:323
20552994521,7cyclictest41-21ksoftirqd/321:56:173
20552994521,4cyclictest41-21ksoftirqd/302:04:373
20552994520,4cyclictest41-21ksoftirqd/300:43:523
20552994519,8cyclictest41-21ksoftirqd/301:38:223
20552994519,8cyclictest41-21ksoftirqd/301:38:223
20552994519,4cyclictest41-21ksoftirqd/323:42:083
142932450,2sleep30-21swapper/302:56:013
20552994421,7cyclictest41-21ksoftirqd/323:56:303
20552994421,7cyclictest41-21ksoftirqd/323:56:303
20552994419,4cyclictest41-21ksoftirqd/323:52:423
20552994419,4cyclictest41-21ksoftirqd/301:48:553
20552994413,7cyclictest41-21ksoftirqd/322:56:183
20543994435,5cyclictest33-21ksoftirqd/201:41:122
20552994329,11cyclictest41-21ksoftirqd/321:50:543
20552994321,7cyclictest41-21ksoftirqd/321:45:543
20552994320,4cyclictest41-21ksoftirqd/323:26:303
20552994319,4cyclictest41-21ksoftirqd/302:42:123
20552994318,4cyclictest41-21ksoftirqd/301:34:243
2055299424,3cyclictest121rcu_preempt22:06:113
20552994237,3cyclictest41-21ksoftirqd/321:50:583
20552994236,3cyclictest41-21ksoftirqd/300:26:093
20552994221,6cyclictest41-21ksoftirqd/300:21:163
20552994219,4cyclictest41-21ksoftirqd/322:51:253
20552994219,3cyclictest41-21ksoftirqd/323:36:263
20552994218,4cyclictest41-21ksoftirqd/323:11:223
20552994136,3cyclictest41-21ksoftirqd/302:21:133
20552994134,3cyclictest41-21ksoftirqd/322:41:003
20552994119,7cyclictest41-21ksoftirqd/302:31:243
20552994118,4cyclictest41-21ksoftirqd/300:46:523
151891410,1ptp4l401ktimersoftd/301:53:163
2055299409,7cyclictest41-21ksoftirqd/302:46:163
20552994034,3cyclictest41-21ksoftirqd/323:16:013
20552994030,3cyclictest41-21ksoftirqd/322:46:153
20552994017,3cyclictest41-21ksoftirqd/323:21:213
20552994017,3cyclictest41-21ksoftirqd/322:21:173
20552993933,3cyclictest41-21ksoftirqd/322:40:553
2055299392,4cyclictest41-21ksoftirqd/322:31:123
20552993918,7cyclictest41-21ksoftirqd/322:11:153
20552993918,7cyclictest41-21ksoftirqd/322:11:153
2055299381,4cyclictest4836-21cut23:06:133
2055299374,3cyclictest121rcu_preempt02:30:443
20552993731,3cyclictest41-21ksoftirqd/322:26:183
20552993731,3cyclictest41-21ksoftirqd/300:06:153
20552993529,3cyclictest41-21ksoftirqd/323:01:173
20543993428,3cyclictest33-21ksoftirqd/221:50:542
20543993226,4cyclictest33-21ksoftirqd/202:26:172
20543993224,5cyclictest33-21ksoftirqd/223:11:202
57052310,1sleep00-21swapper/001:35:000
20543993126,3cyclictest33-21ksoftirqd/202:01:222
20543993126,3cyclictest33-21ksoftirqd/200:40:582
20543993123,4cyclictest33-21ksoftirqd/200:21:162
20539993126,3cyclictest25-21ksoftirqd/122:35:551
186372310,2sleep10-21swapper/100:05:031
2054399305,21cyclictest26865-21irqrtprio21:36:132
20543993026,3cyclictest33-21ksoftirqd/223:35:562
20543993025,3cyclictest33-21ksoftirqd/223:40:572
20543993024,3cyclictest33-21ksoftirqd/201:36:202
20543993024,3cyclictest33-21ksoftirqd/201:36:202
20543992924,3cyclictest33-21ksoftirqd/223:06:112
20543992924,3cyclictest33-21ksoftirqd/223:01:202
20543992924,3cyclictest33-21ksoftirqd/202:06:172
20543992923,4cyclictest33-21ksoftirqd/223:56:132
20543992923,4cyclictest33-21ksoftirqd/223:56:132
20543992923,3cyclictest33-21ksoftirqd/222:55:562
20543992923,3cyclictest33-21ksoftirqd/221:51:192
20543992923,3cyclictest33-21ksoftirqd/201:51:192
20543992923,3cyclictest33-21ksoftirqd/200:06:122
20543992915,10cyclictest33-21ksoftirqd/201:21:302
122952290,3sleep0101ktimersoftd/023:56:510
122952290,3sleep0101ktimersoftd/023:56:510
20543992823,3cyclictest33-21ksoftirqd/201:01:182
20543992822,3cyclictest33-21ksoftirqd/222:01:132
20543992822,3cyclictest33-21ksoftirqd/202:41:182
20543992821,4cyclictest33-21ksoftirqd/222:41:582
20543992821,4cyclictest33-21ksoftirqd/222:22:072
20539992823,3cyclictest25-21ksoftirqd/102:11:191
20534992822,3cyclictest9-21ksoftirqd/023:34:140
20543992722,3cyclictest33-21ksoftirqd/201:16:132
20543992722,3cyclictest33-21ksoftirqd/200:41:122
20543992721,3cyclictest33-21ksoftirqd/223:41:202
20543992721,3cyclictest33-21ksoftirqd/201:15:582
20543992720,4cyclictest33-21ksoftirqd/223:20:282
20543992720,4cyclictest33-21ksoftirqd/202:35:402
20539992722,3cyclictest25-21ksoftirqd/102:06:171
20539992721,3cyclictest25-21ksoftirqd/101:44:321
20534992720,4cyclictest9-21ksoftirqd/022:40:550
140712271,22sleep014091-21latency_hist23:25:570
20543992621,3cyclictest33-21ksoftirqd/202:21:202
20543992621,3cyclictest33-21ksoftirqd/201:46:142
20543992621,3cyclictest33-21ksoftirqd/201:31:142
20543992621,3cyclictest33-21ksoftirqd/201:00:592
20543992621,3cyclictest33-21ksoftirqd/200:16:142
20543992620,3cyclictest33-21ksoftirqd/223:26:192
20543992620,3cyclictest33-21ksoftirqd/222:34:192
20543992620,3cyclictest33-21ksoftirqd/221:41:082
20543992620,3cyclictest33-21ksoftirqd/200:05:572
20543992619,4cyclictest33-21ksoftirqd/222:08:262
20543992619,4cyclictest30572-21kworker/2:202:16:172
20539992619,4cyclictest25-21ksoftirqd/121:38:421
20534992621,3cyclictest9-21ksoftirqd/001:15:580
20534992620,3cyclictest9-21ksoftirqd/023:17:440
20534992620,3cyclictest9-21ksoftirqd/021:57:270
20534992619,4cyclictest9-21ksoftirqd/023:15:280
20543992520,3cyclictest33-21ksoftirqd/222:15:542
20543992520,3cyclictest33-21ksoftirqd/222:15:542
20543992520,3cyclictest33-21ksoftirqd/201:10:582
20543992520,3cyclictest33-21ksoftirqd/200:26:262
20543992519,3cyclictest33-21ksoftirqd/223:22:232
20543992519,3cyclictest33-21ksoftirqd/222:58:082
20543992519,3cyclictest33-21ksoftirqd/221:56:352
20543992519,3cyclictest33-21ksoftirqd/202:48:132
20543992519,3cyclictest33-21ksoftirqd/200:51:122
2054399251,21cyclictest28520-21irqstats22:46:152
20539992520,3cyclictest25-21ksoftirqd/121:35:361
20539992520,3cyclictest25-21ksoftirqd/100:40:581
20539992519,3cyclictest25-21ksoftirqd/122:42:551
20539992519,3cyclictest25-21ksoftirqd/122:26:101
2053499253,3cyclictest121rcu_preempt01:59:000
20534992520,3cyclictest9-21ksoftirqd/023:27:160
20534992520,3cyclictest9-21ksoftirqd/022:52:200
20534992520,3cyclictest9-21ksoftirqd/001:55:590
20534992520,3cyclictest9-21ksoftirqd/001:06:170
20534992519,4cyclictest9-21ksoftirqd/002:11:160
20534992519,3cyclictest9-21ksoftirqd/021:52:460
20534992518,4cyclictest9-21ksoftirqd/021:39:090
20534992513,9cyclictest14071-21sh02:55:570
20543992419,3cyclictest33-21ksoftirqd/223:51:192
20543992419,3cyclictest33-21ksoftirqd/223:46:262
20543992417,4cyclictest33-21ksoftirqd/222:17:412
2054399241,20cyclictest25904-21munin-run21:35:542
2054399240,22cyclictest0-21swapper/202:36:172
2054399240,21cyclictest8878-21ssh02:11:442
20539992419,3cyclictest25-21ksoftirqd/102:01:001
20539992418,3cyclictest25-21ksoftirqd/123:11:051
20539992418,3cyclictest25-21ksoftirqd/122:51:381
20539992418,3cyclictest25-21ksoftirqd/101:46:341
20539992418,3cyclictest25-21ksoftirqd/101:13:411
20539992418,3cyclictest25-21ksoftirqd/100:50:241
20539992417,4cyclictest25-21ksoftirqd/121:42:191
20539992417,4cyclictest25-21ksoftirqd/102:19:091
20539992417,4cyclictest25-21ksoftirqd/101:09:511
20534992419,3cyclictest9-21ksoftirqd/002:01:220
20534992418,3cyclictest9-21ksoftirqd/022:13:110
20534992418,3cyclictest9-21ksoftirqd/022:13:110
20534992418,3cyclictest9-21ksoftirqd/022:03:380
20534992417,4cyclictest9-21ksoftirqd/023:00:020
138302240,2sleep00-21swapper/000:34:260
20543992317,3cyclictest33-21ksoftirqd/221:26:512
20543992317,3cyclictest33-21ksoftirqd/200:46:112
20543992316,4cyclictest33-21ksoftirqd/222:27:002
2054399230,21cyclictest0-21swapper/201:29:322
20539992317,3cyclictest25-21ksoftirqd/122:25:461
20539992317,3cyclictest25-21ksoftirqd/102:49:281
20539992317,3cyclictest25-21ksoftirqd/101:03:011
20539992317,3cyclictest25-21ksoftirqd/100:44:061
20539992317,3cyclictest25-21ksoftirqd/100:34:461
20539992317,3cyclictest10126-21sed23:16:181
20539992316,4cyclictest25-21ksoftirqd/122:19:331
20539992311,4cyclictest26257-21sh23:37:371
20534992318,3cyclictest9-21ksoftirqd/023:45:560
20534992318,3cyclictest9-21ksoftirqd/023:36:240
20534992318,3cyclictest9-21ksoftirqd/000:36:180
20534992317,4cyclictest27340-21ls22:45:550
20534992316,4cyclictest9-21ksoftirqd/021:48:320
20534992316,4cyclictest9-21ksoftirqd/001:23:360
2054399223,16cyclictest25829-21grep01:56:172
20543992216,3cyclictest33-21ksoftirqd/200:15:042
20539992217,3cyclictest25-21ksoftirqd/101:40:591
20539992217,3cyclictest25-21ksoftirqd/101:40:591
20539992217,3cyclictest25-21ksoftirqd/100:51:271
20539992216,3cyclictest25-21ksoftirqd/123:07:501
20539992216,3cyclictest25-21ksoftirqd/121:46:041
20539992216,3cyclictest25-21ksoftirqd/121:30:421
20539992215,4cyclictest25-21ksoftirqd/123:24:121
20539992215,4cyclictest24967-21cron01:55:591
2053999221,4cyclictest2437-21snmp_o5powerctl21:51:191
20534992216,3cyclictest9-21ksoftirqd/022:19:480
20534992215,4cyclictest6398-21sh02:10:480
20534992215,4cyclictest24489-21fschecks_count00:11:150
20534992215,4cyclictest18410-21sh01:47:330
20534992214,5cyclictest13337-21unixbench_singl02:16:310
2053999212,16cyclictest18703-21turbostat.cron23:30:561
20539992116,3cyclictest25-21ksoftirqd/122:39:401
20539992116,3cyclictest25-21ksoftirqd/122:05:321
20539992116,3cyclictest25-21ksoftirqd/100:26:231
20539992116,3cyclictest2297-21sed00:56:181
20539992115,4cyclictest25-21ksoftirqd/122:56:301
20539992115,3cyclictest29909-21expr01:26:141
20539992115,3cyclictest28554-21cpuspeed_turbos23:41:141
20539992115,3cyclictest25262-21grep01:21:141
20539992114,4cyclictest391-21sh00:20:331
20539992114,4cyclictest32236-21sh02:37:381
20539992114,4cyclictest3150-21sh00:21:561
20539992114,4cyclictest26777-21sh00:12:551
20539992114,4cyclictest21644-21sh23:32:431
20539992114,4cyclictest10182-21/usr/sbin/munin23:56:121
20539992114,4cyclictest10182-21/usr/sbin/munin23:56:121
20534992115,3cyclictest9-21ksoftirqd/001:29:130
20534992115,3cyclictest9-21ksoftirqd/000:41:160
20534992114,4cyclictest9389-21sh01:03:580
20534992114,4cyclictest9-21ksoftirqd/021:42:340
20534992114,4cyclictest9-21ksoftirqd/021:27:570
20534992114,4cyclictest9034-21sh02:49:390
20534992114,4cyclictest3335-21sh00:22:170
20534992114,4cyclictest26782-21sh00:47:280
20534992114,4cyclictest24205-21sh02:29:120
20534992114,4cyclictest13066-21awk01:41:300
20534992113,5cyclictest9-21ksoftirqd/023:05:320
20534992113,5cyclictest16349-21cstates02:21:150
155492210,2sleep015720-21ssh00:01:180
2053999206,6cyclictest25-21ksoftirqd/102:31:121
2053999205,8cyclictest121rcu_preempt02:41:231
2053999202,15cyclictest21338-21grep00:06:291
20539992014,3cyclictest5600-21expr23:51:141
20539992014,3cyclictest25-21ksoftirqd/122:48:351
20539992014,3cyclictest23523-21sh01:18:491
20539992014,3cyclictest2170-21ls01:31:141
20539992014,3cyclictest11191-21kernelversion02:51:221
20539992014,3cyclictest10711-21/usr/sbin/munin22:11:091
20539992014,3cyclictest10711-21/usr/sbin/munin22:11:091
20534992015,3cyclictest9-21ksoftirqd/022:26:210
20534992014,4cyclictest9-21ksoftirqd/022:49:430
20534992014,3cyclictest5650-21basename00:26:080
20534992014,3cyclictest5273-21/usr/sbin/munin23:51:260
20534992014,3cyclictest20256-21bc22:31:100
20534992014,3cyclictest16997-21sed22:21:270
20534992014,3cyclictest1451-21expr00:56:120
20534992013,4cyclictest9919-21cat22:06:250
20534992013,4cyclictest6907-21expr01:36:150
20534992013,4cyclictest6907-21expr01:36:150
20534992013,4cyclictest583-21sh23:46:130
20534992013,4cyclictest30185-21needreboot00:51:190
20534992013,4cyclictest29759-21sh02:36:070
20534992013,4cyclictest28758-21/usr/sbin/munin00:16:140
20534992013,4cyclictest28663-21sh02:34:120
20534992013,4cyclictest23562-21sh00:10:360
20534992013,4cyclictest2204-21gltestperf02:41:180
20534992013,4cyclictest21941-21swap01:16:290
2053999193,9cyclictest3704-21apt-get21:56:131
20539991913,3cyclictest587-21/usr/sbin/munin23:46:181
20539991913,3cyclictest23151-21sh02:27:121
20539991913,3cyclictest2262-21/usr/sbin/munin23:01:211
2053499194,8cyclictest4700-21apt-get23:06:110
20534991912,4cyclictest23530-21ps21:30:570
20539991812,3cyclictest31587-21sort02:01:311
20539991811,4cyclictest10060-21unixbench_singl22:06:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional