You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 05:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Tue Jul 01, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2245121580,5sleep2778699cyclictest01:36:412
1518911040,34ptp4l401ktimersoftd/321:58:083
253122850,2sleep10-21swapper/102:17:231
229042660,2sleep00-21swapper/022:29:220
84452610,2sleep38447-21rm01:58:343
7791996154,4cyclictest41-21ksoftirqd/301:29:233
151891610,1ptp4l401ktimersoftd/300:54:543
7791995952,3cyclictest41-21ksoftirqd/300:24:233
7791995950,3cyclictest41-21ksoftirqd/302:24:243
151891580,1ptp4l401ktimersoftd/300:01:483
244252560,2sleep10-21swapper/122:29:391
151891550,1ptp4l401ktimersoftd/302:57:563
7791995345,4cyclictest41-21ksoftirqd/300:04:213
268002530,2sleep20-21swapper/200:27:512
267982530,2sleep10-21swapper/102:57:461
7791995243,4cyclictest41-21ksoftirqd/322:14:183
7791995142,5cyclictest41-21ksoftirqd/302:29:233
7775995041,5cyclictest25-21ksoftirqd/100:44:231
75282504,34sleep10-21swapper/121:57:191
7791994942,3cyclictest41-21ksoftirqd/322:39:173
7791994940,5cyclictest41-21ksoftirqd/323:44:193
7791994939,5cyclictest41-21ksoftirqd/322:44:183
7775994835,7cyclictest25-21ksoftirqd/103:24:231
76602480,2sleep20-21swapper/201:56:562
7775994635,5cyclictest25-21ksoftirqd/123:54:221
7775994633,7cyclictest25-21ksoftirqd/123:29:181
74622464,29sleep20-21swapper/221:56:272
7791994436,4cyclictest41-21ksoftirqd/303:19:163
7791994133,4cyclictest41-21ksoftirqd/323:19:213
7775994128,5cyclictest25-21ksoftirqd/101:04:251
7791994027,6cyclictest41-21ksoftirqd/323:14:213
7791994027,6cyclictest41-21ksoftirqd/322:29:233
7775994028,5cyclictest25-21ksoftirqd/101:19:241
779199397,6cyclictest41-21ksoftirqd/322:49:213
7775993931,5cyclictest4426-21awk22:59:051
151891390,1ptp4l401ktimersoftd/301:39:383
7775993824,7cyclictest25-21ksoftirqd/101:09:251
7775993824,7cyclictest25-21ksoftirqd/101:09:251
151891380,1ptp4l401ktimersoftd/303:03:493
151891380,1ptp4l401ktimersoftd/303:03:493
7791993727,5cyclictest41-21ksoftirqd/322:34:183
151891370,1ptp4l401ktimersoftd/323:44:023
151891370,1ptp4l401ktimersoftd/323:29:243
151891370,1ptp4l401ktimersoftd/303:04:353
151891370,1ptp4l401ktimersoftd/302:40:313
151891370,1ptp4l401ktimersoftd/301:23:203
151891370,1ptp4l401ktimersoftd/300:44:303
7791993631,3cyclictest41-21ksoftirqd/301:39:093
151891360,1ptp4l401ktimersoftd/302:14:233
151891360,1ptp4l401ktimersoftd/301:50:373
7786993528,4cyclictest3658-21cron00:44:032
7775993522,6cyclictest25-21ksoftirqd/101:34:241
151891350,1ptp4l401ktimersoftd/302:09:473
151891350,1ptp4l401ktimersoftd/300:31:463
151891350,0ptp4l401ktimersoftd/301:48:283
7791993425,4cyclictest41-21ksoftirqd/322:24:243
151891340,2ptp4l14847-21kworker/3:201:19:033
151891340,2ptp4l14847-21kworker/3:201:19:033
151891340,1ptp4l401ktimersoftd/302:50:363
151891340,1ptp4l401ktimersoftd/301:09:143
151891340,1ptp4l401ktimersoftd/301:09:143
151891340,12ptp4l401ktimersoftd/323:57:303
151891340,12ptp4l401ktimersoftd/302:02:163
7791993328,3cyclictest41-21ksoftirqd/302:39:103
7791993327,3cyclictest41-21ksoftirqd/323:34:113
7775993328,3cyclictest25-21ksoftirqd/101:59:231
7775993328,3cyclictest25-21ksoftirqd/100:29:081
7775993327,3cyclictest25-21ksoftirqd/101:19:081
7775993327,3cyclictest25-21ksoftirqd/101:19:081
151891330,1ptp4l401ktimersoftd/303:24:443
151891330,1ptp4l401ktimersoftd/303:12:263
151891330,1ptp4l401ktimersoftd/302:45:143
151891330,1ptp4l401ktimersoftd/300:50:083
151891330,11ptp4l401ktimersoftd/300:14:003
7791993227,3cyclictest41-21ksoftirqd/303:19:123
7791993226,3cyclictest41-21ksoftirqd/300:39:393
7791993225,4cyclictest41-21ksoftirqd/300:39:083
778699323,3cyclictest121rcu_preempt00:03:592
7786993226,3cyclictest33-21ksoftirqd/223:04:052
7775993227,3cyclictest25-21ksoftirqd/101:29:091
151891320,1ptp4l401ktimersoftd/323:50:053
151891320,1ptp4l401ktimersoftd/322:57:493
151891320,1ptp4l401ktimersoftd/301:25:313
151891320,1ptp4l401ktimersoftd/300:22:003
151891320,11ptp4l401ktimersoftd/302:22:133
151891320,10ptp4l401ktimersoftd/301:07:283
7791993126,3cyclictest41-21ksoftirqd/323:09:293
7791993125,3cyclictest41-21ksoftirqd/322:09:273
7791993125,3cyclictest41-21ksoftirqd/300:14:383
7775993125,3cyclictest25-21ksoftirqd/102:39:261
41202313,11sleep125-21ksoftirqd/101:53:431
7791993025,3cyclictest41-21ksoftirqd/322:59:233
7791993024,3cyclictest41-21ksoftirqd/323:09:063
7791993024,3cyclictest41-21ksoftirqd/322:19:203
7791993024,3cyclictest41-21ksoftirqd/300:59:373
7786993024,3cyclictest33-21ksoftirqd/223:49:062
7775993025,3cyclictest25-21ksoftirqd/102:59:261
7775993025,3cyclictest25-21ksoftirqd/102:59:261
66832305,10sleep00-21swapper/021:54:270
235372300,4sleep0777099cyclictest02:51:420
7791992923,3cyclictest41-21ksoftirqd/321:59:183
7786992922,4cyclictest33-21ksoftirqd/200:04:212
7775992924,3cyclictest25-21ksoftirqd/123:29:061
7775992924,3cyclictest25-21ksoftirqd/123:29:061
7775992924,3cyclictest25-21ksoftirqd/123:09:051
7775992924,3cyclictest25-21ksoftirqd/123:04:051
7775992924,3cyclictest25-21ksoftirqd/102:09:251
7775992924,3cyclictest25-21ksoftirqd/101:44:301
7775992923,3cyclictest25-21ksoftirqd/123:19:061
3006822922,3sleep09-21ksoftirqd/003:00:070
3006822922,3sleep09-21ksoftirqd/003:00:070
7791992822,3cyclictest41-21ksoftirqd/322:04:163
7786992822,3cyclictest33-21ksoftirqd/201:18:192
7786992822,3cyclictest33-21ksoftirqd/201:18:192
778699280,25cyclictest26565-21irqrtprio01:04:312
778699280,25cyclictest1893-21kworker/2:002:19:272
7775992823,3cyclictest25-21ksoftirqd/122:44:061
7775992823,3cyclictest25-21ksoftirqd/103:14:121
7775992823,3cyclictest25-21ksoftirqd/101:44:101
7775992823,3cyclictest25-21ksoftirqd/100:14:251
7775992822,3cyclictest25-21ksoftirqd/123:49:071
7775992822,3cyclictest25-21ksoftirqd/122:09:231
7775992822,3cyclictest25-21ksoftirqd/100:09:071
7775992815,3cyclictest25-21ksoftirqd/103:14:311
7770992823,3cyclictest9-21ksoftirqd/022:29:050
7770992822,3cyclictest9-21ksoftirqd/002:29:120
7770992821,4cyclictest9-21ksoftirqd/002:08:590
7791992722,3cyclictest41-21ksoftirqd/323:24:223
7791992722,3cyclictest41-21ksoftirqd/323:24:223
7791992722,3cyclictest41-21ksoftirqd/302:06:033
7786992722,3cyclictest33-21ksoftirqd/200:56:422
7786992721,3cyclictest33-21ksoftirqd/223:29:482
7786992721,3cyclictest33-21ksoftirqd/202:30:162
7786992721,3cyclictest33-21ksoftirqd/202:24:482
7786992721,3cyclictest33-21ksoftirqd/202:04:572
7786992720,4cyclictest33-21ksoftirqd/201:10:112
7786992720,4cyclictest33-21ksoftirqd/201:10:112
7775992722,3cyclictest25-21ksoftirqd/122:24:241
7775992722,3cyclictest25-21ksoftirqd/102:49:241
7775992722,3cyclictest25-21ksoftirqd/102:34:101
7775992722,3cyclictest25-21ksoftirqd/101:29:391
7775992721,3cyclictest25-21ksoftirqd/102:34:311
7775992721,3cyclictest25-21ksoftirqd/100:49:271
7775992719,4cyclictest25-21ksoftirqd/103:19:161
777099272,16cyclictest371-21rm01:49:220
7770992721,3cyclictest9-21ksoftirqd/023:47:450
7770992721,3cyclictest9-21ksoftirqd/002:40:420
7770992715,10cyclictest9-21ksoftirqd/000:24:380
7770992712,9cyclictest0-21swapper/023:34:190
7786992621,3cyclictest33-21ksoftirqd/202:41:422
7786992620,3cyclictest33-21ksoftirqd/223:51:032
7786992620,3cyclictest33-21ksoftirqd/202:44:302
7786992620,3cyclictest33-21ksoftirqd/202:35:582
7786992619,4cyclictest33-21ksoftirqd/223:15:002
7786992619,4cyclictest33-21ksoftirqd/223:05:092
7786992619,4cyclictest33-21ksoftirqd/202:14:472
7775992621,3cyclictest25-21ksoftirqd/122:19:051
7775992621,3cyclictest25-21ksoftirqd/103:04:291
7775992621,3cyclictest25-21ksoftirqd/100:34:081
7775992621,3cyclictest25-21ksoftirqd/100:19:371
7775992620,4cyclictest25-21ksoftirqd/123:59:231
7775992620,3cyclictest25-21ksoftirqd/122:47:411
7775992620,3cyclictest25-21ksoftirqd/102:49:111
7770992620,3cyclictest9-21ksoftirqd/001:14:260
7770992620,3cyclictest9-21ksoftirqd/001:14:260
7770992620,3cyclictest9-21ksoftirqd/000:18:460
43002260,4sleep24280-21ssh03:09:112
7786992520,3cyclictest33-21ksoftirqd/222:04:072
7786992518,4cyclictest33-21ksoftirqd/222:41:002
7786992518,4cyclictest33-21ksoftirqd/222:29:072
7786992518,4cyclictest33-21ksoftirqd/222:21:532
7786992518,4cyclictest33-21ksoftirqd/200:34:082
778699250,22cyclictest0-21swapper/203:20:232
7775992519,3cyclictest25-21ksoftirqd/102:24:251
7775992519,3cyclictest25-21ksoftirqd/102:19:281
7770992520,3cyclictest9-21ksoftirqd/001:44:020
7770992520,3cyclictest9-21ksoftirqd/001:04:370
7770992519,3cyclictest9-21ksoftirqd/023:41:590
7770992518,5cyclictest18558-21cut03:24:270
7770992518,4cyclictest9-21ksoftirqd/023:22:050
7770992518,4cyclictest9-21ksoftirqd/022:49:060
7770992517,5cyclictest9-21ksoftirqd/023:07:140
7786992419,3cyclictest33-21ksoftirqd/203:14:112
7786992419,3cyclictest13906-1kworker/u9:101:31:002
7786992418,4cyclictest33-21ksoftirqd/223:54:212
7786992418,3cyclictest33-21ksoftirqd/223:25:342
7786992418,3cyclictest33-21ksoftirqd/223:25:342
7786992418,3cyclictest33-21ksoftirqd/223:22:462
7786992418,3cyclictest33-21ksoftirqd/201:49:242
7786992417,4cyclictest33-21ksoftirqd/223:41:022
7786992417,4cyclictest33-21ksoftirqd/223:36:162
7786992417,4cyclictest33-21ksoftirqd/222:17:552
778699241,20cyclictest12101-21ssh02:02:082
778699240,22cyclictest0-21swapper/203:18:132
7775992420,3cyclictest25-21ksoftirqd/123:34:191
7775992419,3cyclictest25-21ksoftirqd/123:39:351
7775992419,3cyclictest25-21ksoftirqd/122:49:281
7775992419,3cyclictest25-21ksoftirqd/102:04:241
7775992419,3cyclictest25-21ksoftirqd/100:59:081
7775992419,3cyclictest25-21ksoftirqd/100:34:481
7775992419,3cyclictest25-21ksoftirqd/100:09:291
7775992418,4cyclictest25-21ksoftirqd/101:58:331
7775992418,3cyclictest25-21ksoftirqd/122:06:301
7775992418,3cyclictest25-21ksoftirqd/100:59:421
7770992418,3cyclictest9-21ksoftirqd/022:39:290
7770992418,3cyclictest9-21ksoftirqd/022:04:120
7770992418,3cyclictest9-21ksoftirqd/002:26:250
7770992418,3cyclictest9-21ksoftirqd/001:37:190
7770992417,4cyclictest9-21ksoftirqd/023:54:000
7770992417,4cyclictest9-21ksoftirqd/023:00:410
7770992417,4cyclictest17254-21tr00:54:240
2963622417,3sleep09-21ksoftirqd/001:44:340
169702240,2sleep00-21swapper/003:23:020
7786992318,3cyclictest33-21ksoftirqd/222:54:232
7786992318,3cyclictest33-21ksoftirqd/201:24:092
7786992317,4cyclictest20457-21ssh03:25:542
7786992317,3cyclictest33-21ksoftirqd/200:34:282
7786992317,3cyclictest33-21ksoftirqd/200:16:082
7786992316,4cyclictest33-21ksoftirqd/201:28:582
778699231,19cyclictest25494-21snmp_o5powerctl01:39:352
778699231,18cyclictest28937-21gltestperf01:44:292
7775992319,3cyclictest25-21ksoftirqd/121:59:181
7775992317,3cyclictest25-21ksoftirqd/123:19:061
7775992317,3cyclictest25-21ksoftirqd/100:39:261
777099232,13cyclictest16080-21ssh02:44:230
7770992318,3cyclictest9-21ksoftirqd/000:06:530
7770992317,3cyclictest9-21ksoftirqd/023:32:320
7770992317,3cyclictest9-21ksoftirqd/023:14:200
7770992317,3cyclictest9-21ksoftirqd/022:03:040
7770992317,3cyclictest9-21ksoftirqd/000:52:100
7770992316,4cyclictest9-21ksoftirqd/022:37:450
7786992217,3cyclictest3940-1kworker/u9:102:54:232
7786992216,3cyclictest33-21ksoftirqd/222:27:132
7786992216,3cyclictest33-21ksoftirqd/200:51:442
778699221,4cyclictest20151-21apt-get02:49:142
7786992214,3cyclictest33-21ksoftirqd/222:34:342
778699220,3cyclictest1102-21diskmemload00:47:052
778699220,20cyclictest0-21swapper/222:44:352
778699220,20cyclictest0-21swapper/200:19:222
7775992216,3cyclictest25-21ksoftirqd/123:13:221
777099222,2cyclictest121rcu_preempt02:57:340
7770992216,4cyclictest9-21ksoftirqd/002:09:550
7770992216,3cyclictest9-21ksoftirqd/023:27:230
7770992216,3cyclictest9-21ksoftirqd/023:27:230
7770992216,3cyclictest9-21ksoftirqd/022:21:040
7770992215,4cyclictest413-21sh03:04:270
7770992214,4cyclictest11605-21missed_timers00:09:310
7786992114,4cyclictest33-21ksoftirqd/222:09:562
7786992114,4cyclictest33-21ksoftirqd/202:10:092
778699210,19cyclictest0-21swapper/203:00:062
778699210,19cyclictest0-21swapper/203:00:062
7775992116,3cyclictest25-21ksoftirqd/122:34:181
777099214,11cyclictest26600-21ssh02:19:230
7770992116,3cyclictest9-21ksoftirqd/000:00:550
7770992115,4cyclictest9-21ksoftirqd/023:10:160
7770992115,4cyclictest1121-21sh01:13:180
7770992115,4cyclictest1121-21sh01:13:180
7770992115,3cyclictest9-21ksoftirqd/002:17:250
7770992115,3cyclictest8726-21sh03:14:040
7770992115,3cyclictest7683-21sh01:57:000
7770992114,4cyclictest9046-21/usr/sbin/munin01:59:280
7770992114,4cyclictest695-21uname00:34:330
7770992114,4cyclictest6369-21sh00:40:480
7770992114,4cyclictest31395-21/usr/sbin/munin23:54:360
7770992114,4cyclictest30423-21sh00:31:120
7770992114,4cyclictest23308-21cut00:24:080
7770992114,4cyclictest11446-21sh03:15:380
7786992015,3cyclictest10616-1kworker/u9:101:00:452
7786992014,4cyclictest33-21ksoftirqd/222:51:282
7786992013,4cyclictest8192-21cat21:59:192
7786992013,4cyclictest33-21ksoftirqd/223:09:102
7786992013,4cyclictest11664-21cut00:09:312
7775992015,3cyclictest25-21ksoftirqd/123:49:251
7775992013,4cyclictest18375-21expr22:19:211
7770992014,3cyclictest9-21ksoftirqd/022:16:160
7770992014,3cyclictest23640-21sh01:00:410
7770992013,4cyclictest9-21ksoftirqd/022:10:590
7770992013,4cyclictest2603-21expr22:54:190
7770992013,4cyclictest1659-21awk22:49:340
7770992013,4cyclictest10950-21sh02:38:270
7770992013,3cyclictest9-21ksoftirqd/000:44:420
7770991914,3cyclictest16632-21sh01:29:340
7770991913,3cyclictest8180-21sh01:19:410
7770991913,3cyclictest12877-21sh01:25:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional