You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-07 - 06:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri Nov 07, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
643721810,5sleep3134199cyclictest23:33:553
2520221740,4sleep2133499cyclictest22:04:132
1992221670,4sleep2133499cyclictest23:11:542
77621560,3sleep3134199cyclictest01:15:283
2903821520,4sleep1133099cyclictest22:45:471
177391970,4ptp4l401ktimersoftd/320:07:373
1334997766,6cyclictest33-21ksoftirqd/223:14:122
1334997464,6cyclictest33-21ksoftirqd/200:09:132
1334997257,8cyclictest33-21ksoftirqd/201:14:192
177391710,1ptp4l401ktimersoftd/323:55:503
177391700,1ptp4l401ktimersoftd/322:51:473
1334997036,22cyclictest33-21ksoftirqd/201:04:152
42052690,4sleep24207-21fschecks_count22:19:152
177391690,1ptp4l401ktimersoftd/301:04:533
177391690,1ptp4l401ktimersoftd/300:23:373
177391690,1ptp4l401ktimersoftd/300:23:373
177391680,1ptp4l401ktimersoftd/321:49:533
9362644,10sleep00-21swapper/020:05:190
1334996453,5cyclictest33-21ksoftirqd/222:54:112
1334996352,5cyclictest33-21ksoftirqd/201:09:152
88912620,1sleep20-21swapper/223:34:542
1334995948,5cyclictest33-21ksoftirqd/223:04:112
14242560,1sleep31422-21cut21:14:163
1334995645,6cyclictest33-21ksoftirqd/200:24:142
1323995537,3cyclictest9-21ksoftirqd/001:29:210
1323995530,3cyclictest9-21ksoftirqd/022:49:220
1323995326,4cyclictest9-21ksoftirqd/000:32:450
134199521,47cyclictest17404-21latency_hist21:48:583
1334995241,6cyclictest33-21ksoftirqd/221:09:092
1323995225,4cyclictest9-21ksoftirqd/000:17:370
1323995223,4cyclictest9-21ksoftirqd/023:44:010
1323995126,4cyclictest9-21ksoftirqd/000:28:090
1323995125,4cyclictest9-21ksoftirqd/000:03:330
132399510,3cyclictest121rcu_preempt01:04:150
177391500,14ptp4l24486-21kworker/3:022:36:193
1334995038,6cyclictest33-21ksoftirqd/220:09:092
1323995037,6cyclictest9-21ksoftirqd/001:34:340
1323995024,4cyclictest9-21ksoftirqd/000:34:410
1323995021,4cyclictest9-21ksoftirqd/001:04:030
1334994939,6cyclictest33-21ksoftirqd/223:24:112
1323994923,4cyclictest9-21ksoftirqd/000:51:460
1323994919,5cyclictest9-21ksoftirqd/020:39:120
1323994919,5cyclictest9-21ksoftirqd/020:39:120
1323994916,4cyclictest9-21ksoftirqd/022:04:240
1323994910,7cyclictest9-21ksoftirqd/022:28:590
1323994910,7cyclictest9-21ksoftirqd/022:28:590
1323994822,6cyclictest9-21ksoftirqd/022:12:440
132399477,6cyclictest9-21ksoftirqd/000:09:130
1323994735,3cyclictest9-21ksoftirqd/000:19:310
1323994735,3cyclictest9-21ksoftirqd/000:19:310
1323994723,6cyclictest9-21ksoftirqd/022:59:140
1323994722,4cyclictest9-21ksoftirqd/021:54:140
1323994722,4cyclictest9-21ksoftirqd/001:19:060
1323994722,4cyclictest9-21ksoftirqd/000:07:150
1323994720,5cyclictest9-21ksoftirqd/021:43:580
1323994720,5cyclictest9-21ksoftirqd/001:09:270
1323994719,4cyclictest9-21ksoftirqd/001:14:230
1323994717,6cyclictest9-21ksoftirqd/020:34:190
1323994717,6cyclictest9-21ksoftirqd/020:34:190
1323994717,4cyclictest9-21ksoftirqd/000:39:260
133099462,35cyclictest22003-21apt-get22:39:121
132399469,3cyclictest9-21ksoftirqd/023:49:300
1323994640,3cyclictest9-21ksoftirqd/021:14:010
1323994622,4cyclictest9-21ksoftirqd/000:46:150
1334994531,11cyclictest33-21ksoftirqd/222:34:272
1330994510,19cyclictest15871-21ls23:44:161
133099450,5cyclictest3336-21ssh22:18:451
1323994520,4cyclictest9-21ksoftirqd/000:56:390
1323994514,11cyclictest9-21ksoftirqd/020:13:570
1323994513,7cyclictest9-21ksoftirqd/022:34:150
132399445,3cyclictest9-21ksoftirqd/022:14:300
1323994433,3cyclictest9-21ksoftirqd/023:39:120
1323994428,5cyclictest9-21ksoftirqd/023:14:170
104924423,11sleep233-21ksoftirqd/220:06:422
177391430,1ptp4l401ktimersoftd/320:31:503
1334994325,5cyclictest33-21ksoftirqd/200:59:372
133099432,34cyclictest27361-21apt-get00:34:151
132399438,6cyclictest9-21ksoftirqd/022:54:130
132399433,8cyclictest9-21ksoftirqd/022:19:280
1323994332,3cyclictest9-21ksoftirqd/023:24:490
1323994313,7cyclictest9-21ksoftirqd/023:19:150
1323994312,7cyclictest9-21ksoftirqd/021:49:160
132399427,7cyclictest9-21ksoftirqd/023:34:170
132399427,6cyclictest9-21ksoftirqd/021:24:170
132399425,4cyclictest9-21ksoftirqd/020:24:170
1323994222,3cyclictest9-21ksoftirqd/021:29:230
1323994218,7cyclictest9-21ksoftirqd/020:29:180
1323994215,6cyclictest9-21ksoftirqd/001:24:160
1334994133,4cyclictest33-21ksoftirqd/200:29:152
1334994124,5cyclictest33-21ksoftirqd/201:24:152
1334994118,16cyclictest33-21ksoftirqd/223:53:312
133099411,4cyclictest25226-21ssh23:18:291
132399416,3cyclictest9-21ksoftirqd/023:29:210
1323994126,3cyclictest9-21ksoftirqd/022:39:190
1323994116,5cyclictest9-21ksoftirqd/023:06:400
177391400,1ptp4l401ktimersoftd/300:05:253
1334994034,3cyclictest33-21ksoftirqd/222:28:582
1334994034,3cyclictest33-21ksoftirqd/222:28:582
1334994028,9cyclictest33-21ksoftirqd/222:59:312
1334994014,4cyclictest33-21ksoftirqd/222:14:292
132399405,6cyclictest9-21ksoftirqd/021:19:200
132399405,3cyclictest9-21ksoftirqd/021:59:220
132399402,3cyclictest9-21ksoftirqd/022:29:110
132399402,3cyclictest9-21ksoftirqd/022:29:110
1323994023,8cyclictest1760-21runrttasks20:49:100
177391390,1ptp4l401ktimersoftd/323:11:003
177391390,1ptp4l401ktimersoftd/322:46:163
1334993934,3cyclictest33-21ksoftirqd/223:59:302
1334993916,5cyclictest33-21ksoftirqd/200:14:132
1334993910,10cyclictest33-21ksoftirqd/200:49:242
133099393,30cyclictest0-21swapper/100:54:151
133099393,29cyclictest16863-21apt-get23:09:121
133099392,29cyclictest11756-21apt-get20:29:111
133099391,3cyclictest0-21swapper/122:13:091
133099390,3cyclictest15271-21latency_hist23:44:001
132399397,6cyclictest9-21ksoftirqd/020:59:150
132399392,7cyclictest9-21ksoftirqd/022:44:230
1323993913,4cyclictest9-21ksoftirqd/023:11:390
118023920,8sleep10-21swapper/120:08:231
177391380,1ptp4l401ktimersoftd/323:35:463
177391380,1ptp4l401ktimersoftd/323:22:153
177391380,1ptp4l401ktimersoftd/322:13:353
177391380,1ptp4l401ktimersoftd/300:40:583
177391380,1ptp4l401ktimersoftd/300:31:193
1334993832,3cyclictest33-21ksoftirqd/220:23:562
1334993822,6cyclictest33-21ksoftirqd/221:04:222
1334993813,5cyclictest33-21ksoftirqd/200:34:222
133099384,26cyclictest7788-21apt-get22:59:141
133099383,28cyclictest9390-21apt-get20:24:121
133099383,27cyclictest16714-21apt-get20:39:091
133099383,27cyclictest16714-21apt-get20:39:091
133099382,28cyclictest3492-21apt-get21:19:101
1330993814,20cyclictest14489-21sh01:32:521
132399387,3cyclictest9-21ksoftirqd/021:09:160
132399384,6cyclictest9-21ksoftirqd/020:44:160
1323993833,3cyclictest9-21ksoftirqd/021:34:190
132399382,7cyclictest9-21ksoftirqd/020:54:160
1323993827,3cyclictest9-21ksoftirqd/020:10:110
132399380,5cyclictest9-21ksoftirqd/021:48:590
177391370,1ptp4l401ktimersoftd/323:05:343
177391370,1ptp4l401ktimersoftd/321:09:363
177391370,1ptp4l401ktimersoftd/301:30:403
177391370,1ptp4l401ktimersoftd/301:21:373
177391370,1ptp4l401ktimersoftd/300:59:373
177391370,1ptp4l401ktimersoftd/300:24:523
177391370,1ptp4l401ktimersoftd/300:16:543
177391370,0ptp4l401ktimersoftd/323:48:573
1334993732,3cyclictest33-21ksoftirqd/223:44:142
1334993730,4cyclictest33-21ksoftirqd/223:29:172
1334993727,3cyclictest33-21ksoftirqd/200:42:562
133099372,27cyclictest9802-21apt-get00:14:161
133099371,28cyclictest7021-21apt-get20:19:091
132399374,6cyclictest9-21ksoftirqd/020:19:270
1323993731,3cyclictest9-21ksoftirqd/021:04:140
132399372,3cyclictest9-21ksoftirqd/023:54:150
177391360,1ptp4l401ktimersoftd/322:42:173
177391360,1ptp4l401ktimersoftd/320:21:583
177391360,1ptp4l401ktimersoftd/301:36:383
177391360,1ptp4l401ktimersoftd/301:11:043
177391360,0ptp4l401ktimersoftd/300:47:563
1334993631,3cyclictest33-21ksoftirqd/200:24:022
1334993631,3cyclictest33-21ksoftirqd/200:24:022
1334993630,3cyclictest33-21ksoftirqd/220:59:132
1334993628,6cyclictest33-21ksoftirqd/200:04:152
1334993624,9cyclictest33-21ksoftirqd/223:19:042
1334993624,4cyclictest33-21ksoftirqd/220:38:562
1334993624,4cyclictest33-21ksoftirqd/220:38:562
1334993617,8cyclictest33-21ksoftirqd/222:44:252
133499361,3cyclictest121rcu_preempt22:51:242
133099363,26cyclictest2482-21apt-get23:29:131
133099362,28cyclictest5859-21apt-get21:24:111
133099362,27cyclictest4072-21apt-get00:44:141
133099361,29cyclictest0-21swapper/100:19:141
133099361,29cyclictest0-21swapper/100:19:141
133099360,4cyclictest6821-21python00:09:251
133099360,4cyclictest29491-21ssh01:11:431
133099360,3cyclictest0-21swapper/100:30:101
177391350,1ptp4l401ktimersoftd/323:39:403
177391350,1ptp4l401ktimersoftd/323:28:593
177391350,1ptp4l401ktimersoftd/321:29:203
177391350,1ptp4l401ktimersoftd/320:59:113
177391350,1ptp4l401ktimersoftd/300:54:573
133499358,17cyclictest33-21ksoftirqd/201:33:522
1334993530,3cyclictest33-21ksoftirqd/222:39:112
1334993530,3cyclictest33-21ksoftirqd/222:13:582
1334993530,3cyclictest33-21ksoftirqd/221:39:172
1334993529,3cyclictest33-21ksoftirqd/220:39:132
1334993529,3cyclictest33-21ksoftirqd/220:39:132
1334993523,3cyclictest33-21ksoftirqd/221:44:212
1334993522,6cyclictest33-21ksoftirqd/223:39:222
133499351,5cyclictest33-21ksoftirqd/221:14:282
133499350,2cyclictest121rcu_preempt01:36:162
133099353,27cyclictest0-21swapper/122:49:111
133099353,26cyclictest0-21swapper/122:19:111
133099352,27cyclictest6895-21apt-get23:34:151
1330993515,17cyclictest17750-21cat00:59:201
133099350,4cyclictest32394-21python01:14:311
133099350,4cyclictest28086-21ssh23:57:571
133099350,4cyclictest19409-21fschecks_time20:44:131
133099350,4cyclictest12685-21idleruntime-cro21:38:581
133099350,4cyclictest10878-21cron01:29:031
133099350,3cyclictest0-21swapper/120:59:171
133099350,3cyclictest0-21swapper/120:49:171
177391340,1ptp4l401ktimersoftd/320:39:203
177391340,1ptp4l401ktimersoftd/320:39:203
177391340,0ptp4l401ktimersoftd/322:56:513
1334993429,3cyclictest33-21ksoftirqd/220:14:182
1334993429,3cyclictest33-21ksoftirqd/200:54:192
1334993429,3cyclictest33-21ksoftirqd/200:44:242
1334993428,3cyclictest33-21ksoftirqd/223:54:152
1334993418,5cyclictest33-21ksoftirqd/221:49:292
133099347,24cyclictest13424-21uname23:04:201
133099345,24cyclictest1578-21if_enp1s000:04:191
133099343,25cyclictest8411-21apt-get22:24:141
133099343,25cyclictest8411-21apt-get22:24:141
133099342,26cyclictest4626-21apt-get20:14:071
133099342,26cyclictest0-21swapper/123:59:121
133099340,4cyclictest8399-21ls21:29:141
133099340,4cyclictest32677-21ssh23:25:041
133099340,4cyclictest2700-21ssh01:19:111
133099340,4cyclictest240262sleep101:04:591
133099340,4cyclictest21759-21switchtime23:49:291
133099340,4cyclictest21058-21rm00:26:061
133099340,4cyclictest18908-21snmp_o5powerctl22:34:231
133099340,3cyclictest13307-21cut22:29:151
133099340,3cyclictest13307-21cut22:29:151
133099340,30cyclictest15296-21/usr/sbin/munin01:34:221
177391330,1ptp4l401ktimersoftd/323:59:083
177391330,1ptp4l401ktimersoftd/320:09:143
177391330,1ptp4l401ktimersoftd/301:27:113
177391330,1ptp4l401ktimersoftd/300:11:013
1334993328,3cyclictest33-21ksoftirqd/221:34:132
1334993328,3cyclictest33-21ksoftirqd/220:24:282
1334993328,3cyclictest33-21ksoftirqd/201:19:352
1334993327,3cyclictest33-21ksoftirqd/222:33:592
1334993327,3cyclictest33-21ksoftirqd/222:33:592
1334993327,3cyclictest33-21ksoftirqd/222:03:582
1334993327,3cyclictest33-21ksoftirqd/220:54:212
1334993320,6cyclictest33-21ksoftirqd/221:24:202
1334993318,3cyclictest33-21ksoftirqd/221:29:292
133099339,21cyclictest7371-21latency_hist22:59:001
133099338,21cyclictest2829-21cut20:09:191
133099337,22cyclictest25573-21irqrtprio22:04:161
133099336,24cyclictest19773-21munin-run21:53:571
1330993314,16cyclictest26050-21/usr/sbin/munin23:19:211
133099331,26cyclictest0-21swapper/121:39:131
177391320,1ptp4l401ktimersoftd/300:34:453
177391320,10ptp4l401ktimersoftd/320:15:303
177391320,0ptp4l401ktimersoftd/320:26:043
1334993227,3cyclictest33-21ksoftirqd/221:58:572
1334993227,3cyclictest33-21ksoftirqd/220:48:572
1334993226,3cyclictest33-21ksoftirqd/220:49:142
133099321,4cyclictest11047-21ssh00:50:461
133099320,3cyclictest614-21grep21:13:571
133099320,3cyclictest28929-21/usr/sbin/munin21:04:171
133099320,2cyclictest0-21swapper/100:39:501
1334993126,3cyclictest33-21ksoftirqd/221:19:222
133099317,20cyclictest21501-21threads21:54:271
1330993110,18cyclictest227242sleep121:59:151
177391300,8ptp4l401ktimersoftd/323:14:073
177391300,1ptp4l401ktimersoftd/322:31:423
177391300,1ptp4l401ktimersoftd/322:31:423
1334993023,4cyclictest33-21ksoftirqd/220:29:112
1330993013,14cyclictest1760-21runrttasks20:58:361
133099300,3cyclictest2719-21sed21:14:291
133099291,4cyclictest14799-21chrt20:34:151
133099291,4cyclictest14799-21chrt20:34:151
177391280,0ptp4l401ktimersoftd/320:53:043
133099281,4cyclictest15694-21tune2fs21:44:141
177391270,1ptp4l401ktimersoftd/320:37:243
177391270,1ptp4l401ktimersoftd/320:37:243
177391260,1ptp4l401ktimersoftd/322:22:373
177391260,1ptp4l401ktimersoftd/322:18:073
177391260,0ptp4l401ktimersoftd/321:58:393
1341992619,4cyclictest41-21ksoftirqd/322:06:033
134199260,3cyclictest121rcu_preempt23:01:343
177391250,1ptp4l401ktimersoftd/321:21:563
177391250,1ptp4l401ktimersoftd/320:54:113
177391250,10ptp4l401ktimersoftd/321:05:233
177391250,0ptp4l401ktimersoftd/321:25:303
1341992518,4cyclictest41-21ksoftirqd/320:44:053
177391240,1ptp4l401ktimersoftd/323:49:053
177391240,1ptp4l401ktimersoftd/322:24:303
177391240,1ptp4l401ktimersoftd/322:24:303
177391240,1ptp4l401ktimersoftd/321:39:573
177391240,1ptp4l401ktimersoftd/300:49:163
1341992417,4cyclictest41-21ksoftirqd/321:59:003
177391230,1ptp4l401ktimersoftd/321:34:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional