You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 05:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri Nov 21, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2553621690,5sleep21750299cyclictest23:47:462
177391990,4ptp4l401ktimersoftd/320:15:373
177391700,1ptp4l401ktimersoftd/322:35:373
17490996656,6cyclictest9-21ksoftirqd/022:02:010
74772650,2sleep20-21swapper/222:48:522
121062640,2sleep30-21swapper/322:54:443
17490996351,5cyclictest9-21ksoftirqd/000:16:590
144552630,2sleep10-21swapper/100:50:121
17490996150,6cyclictest9-21ksoftirqd/001:11:590
17490996050,4cyclictest9-21ksoftirqd/023:01:590
17490996047,6cyclictest9-21ksoftirqd/021:16:590
177391590,1ptp4l401ktimersoftd/321:33:033
171412594,43sleep00-21swapper/020:13:290
170542573,9sleep20-21swapper/220:12:222
46742560,2sleep30-21swapper/322:46:453
112992540,2sleep30-21swapper/323:32:053
17490995343,5cyclictest9-21ksoftirqd/023:27:010
5602520,2sleep00-21swapper/020:46:500
17490995141,5cyclictest9-21ksoftirqd/000:06:580
17490995132,10cyclictest9-21ksoftirqd/023:22:200
17496994944,3cyclictest0-21swapper/120:16:411
17490994930,3cyclictest9-21ksoftirqd/021:52:090
17490994836,3cyclictest9-21ksoftirqd/001:17:090
17490994740,3cyclictest9-21ksoftirqd/000:36:590
17490994723,3cyclictest9-21ksoftirqd/023:15:290
17490994722,6cyclictest9-21ksoftirqd/022:47:000
17490994637,4cyclictest9-21ksoftirqd/020:36:550
17490994630,3cyclictest9-21ksoftirqd/001:42:030
17490994622,4cyclictest9-21ksoftirqd/000:32:090
17490994620,6cyclictest9-21ksoftirqd/000:44:050
17490994537,4cyclictest9-21ksoftirqd/023:17:040
17490994518,4cyclictest9-21ksoftirqd/022:40:330
177391440,9ptp4l401ktimersoftd/322:19:003
17490994419,4cyclictest9-21ksoftirqd/022:55:510
17490994335,4cyclictest9-21ksoftirqd/020:16:460
17490994332,3cyclictest9-21ksoftirqd/000:02:050
17490994318,3cyclictest9-21ksoftirqd/000:01:400
17490994236,3cyclictest9-21ksoftirqd/001:27:180
17490994234,4cyclictest9-21ksoftirqd/000:11:510
17490994232,3cyclictest9-21ksoftirqd/000:27:160
17490994232,3cyclictest9-21ksoftirqd/000:27:160
17490994219,4cyclictest9-21ksoftirqd/023:07:040
17490994217,4cyclictest9-21ksoftirqd/023:47:040
17490994217,4cyclictest9-21ksoftirqd/022:25:040
1749099421,6cyclictest14359-21taskset22:19:240
17490994216,4cyclictest9-21ksoftirqd/022:32:080
17490994117,4cyclictest9-21ksoftirqd/022:41:480
17490994117,4cyclictest9-21ksoftirqd/001:41:190
17490994116,4cyclictest9-21ksoftirqd/021:32:550
17490994116,3cyclictest9-21ksoftirqd/023:41:040
1749099410,6cyclictest9-21ksoftirqd/023:32:000
1749099407,7cyclictest9-21ksoftirqd/020:31:410
17490994027,3cyclictest9-21ksoftirqd/001:36:490
17490994018,7cyclictest9-21ksoftirqd/000:57:050
1749099400,6cyclictest26060-21fgrep01:02:120
1751099390,35cyclictest17754-21grep00:17:023
17490993933,3cyclictest9-21ksoftirqd/001:07:050
17490993932,4cyclictest9-21ksoftirqd/020:31:450
17490993930,3cyclictest9-21ksoftirqd/022:27:540
17490993930,3cyclictest9-21ksoftirqd/022:07:020
17490993921,3cyclictest9-21ksoftirqd/021:22:260
17490993911,5cyclictest9-21ksoftirqd/021:41:560
1749099390,4cyclictest0-21swapper/021:12:070
177391380,1ptp4l401ktimersoftd/323:37:343
177391380,1ptp4l401ktimersoftd/323:27:203
177391380,1ptp4l401ktimersoftd/323:14:533
177391380,1ptp4l401ktimersoftd/320:46:563
177391380,1ptp4l401ktimersoftd/301:27:513
177391380,1ptp4l401ktimersoftd/301:10:173
177391380,1ptp4l401ktimersoftd/301:02:383
177391380,1ptp4l401ktimersoftd/300:51:263
177391380,1ptp4l401ktimersoftd/300:31:293
177391380,1ptp4l401ktimersoftd/300:31:293
177391380,1ptp4l401ktimersoftd/300:23:353
177391380,1ptp4l401ktimersoftd/300:23:353
177391380,0ptp4l401ktimersoftd/301:14:223
17510993817,18cyclictest24794-21cut23:47:093
1749099388,4cyclictest9-21ksoftirqd/000:47:070
1749099386,6cyclictest121rcu_preempt21:56:570
1749099383,4cyclictest9-21ksoftirqd/021:07:130
17490993833,3cyclictest9-21ksoftirqd/001:26:480
17490993832,3cyclictest9-21ksoftirqd/021:37:050
17490993832,3cyclictest9-21ksoftirqd/000:26:460
17490993832,3cyclictest9-21ksoftirqd/000:26:460
17490993830,5cyclictest9-21ksoftirqd/023:42:000
17490993825,3cyclictest9-21ksoftirqd/020:22:040
17490993810,6cyclictest9-21ksoftirqd/020:57:030
17490993810,6cyclictest9-21ksoftirqd/020:57:030
177391370,1ptp4l401ktimersoftd/323:54:393
177391370,1ptp4l401ktimersoftd/323:23:483
177391370,1ptp4l401ktimersoftd/321:22:393
177391370,1ptp4l401ktimersoftd/301:21:453
177391370,1ptp4l401ktimersoftd/300:57:403
177391370,1ptp4l401ktimersoftd/300:52:413
177391370,1ptp4l401ktimersoftd/300:39:093
177391370,1ptp4l401ktimersoftd/300:04:133
177391370,0ptp4l401ktimersoftd/322:22:183
17502993732,3cyclictest33-21ksoftirqd/200:17:052
17490993732,3cyclictest9-21ksoftirqd/000:52:070
17490993731,3cyclictest9-21ksoftirqd/023:52:000
17490993729,5cyclictest9-21ksoftirqd/020:41:560
17490993729,3cyclictest9-21ksoftirqd/022:12:120
177391360,1ptp4l401ktimersoftd/323:08:033
177391360,1ptp4l401ktimersoftd/301:39:543
177391360,1ptp4l401ktimersoftd/301:33:013
177391360,1ptp4l401ktimersoftd/301:25:433
177391360,0ptp4l401ktimersoftd/323:43:413
177391360,0ptp4l401ktimersoftd/322:40:263
17510993620,13cyclictest41-21ksoftirqd/322:05:133
17510993619,14cyclictest41-21ksoftirqd/322:12:403
17510993611,3cyclictest5744-21tune2fs20:56:573
17510993611,3cyclictest5744-21tune2fs20:56:573
17490993631,3cyclictest9-21ksoftirqd/021:27:080
17490993630,3cyclictest9-21ksoftirqd/020:56:410
177391350,1ptp4l401ktimersoftd/323:18:213
177391350,1ptp4l401ktimersoftd/323:00:013
177391350,1ptp4l401ktimersoftd/301:43:413
177391350,0ptp4l401ktimersoftd/322:01:423
177391350,0ptp4l401ktimersoftd/300:46:223
17510993513,3cyclictest21880-21sed21:31:433
17490993523,3cyclictest9-21ksoftirqd/022:57:160
1749099351,2cyclictest121rcu_preempt21:01:550
17510993410,3cyclictest24356-21ls22:31:443
17490993428,3cyclictest9-21ksoftirqd/021:47:020
212132330,5sleep125-21ksoftirqd/101:35:371
1751099339,4cyclictest19456-21cat20:17:103
17510993310,3cyclictest613-21irqrtprio23:57:053
17502993327,4cyclictest11386-21ps23:32:062
17510993210,3cyclictest18377-21irqrtprio23:02:053
1751099318,4cyclictest27610-21irqrtprio21:42:023
1751099318,3cyclictest9066-21mailstats21:02:063
1751099318,3cyclictest13251-21expr00:12:033
17502993126,3cyclictest33-21ksoftirqd/200:11:462
17502993125,3cyclictest33-21ksoftirqd/222:27:052
17502993116,8cyclictest33-21ksoftirqd/220:51:532
314632300,4sleep231466-21latency_hist21:51:432
252322300,2sleep20-21swapper/200:25:482
252322300,2sleep20-21swapper/200:25:482
1751099309,4cyclictest521-21sh00:33:513
17510993012,4cyclictest41-21ksoftirqd/321:38:203
17510993012,3cyclictest709-21timedrift21:52:143
17510993010,3cyclictest46750irq/99-ens3-TxR22:46:523
17502993025,3cyclictest33-21ksoftirqd/201:07:022
17502993024,3cyclictest33-21ksoftirqd/222:42:022
17502993024,3cyclictest33-21ksoftirqd/221:41:562
17502993024,3cyclictest33-21ksoftirqd/200:57:072
17502993024,3cyclictest33-21ksoftirqd/200:42:452
17496993023,5cyclictest25-21ksoftirqd/123:07:001
17502992924,3cyclictest33-21ksoftirqd/223:52:052
17502992924,3cyclictest33-21ksoftirqd/222:37:012
17502992923,3cyclictest33-21ksoftirqd/200:31:542
17502992923,3cyclictest33-21ksoftirqd/200:12:112
17496992924,3cyclictest25-21ksoftirqd/122:36:591
17496992923,4cyclictest25-21ksoftirqd/101:22:031
17496992922,5cyclictest25-21ksoftirqd/122:46:571
1749699290,2cyclictest121rcu_preempt21:25:441
664822821,3sleep1241ktimersoftd/123:27:021
1751099289,3cyclictest1760-21runrttasks21:12:063
17502992823,3cyclictest33-21ksoftirqd/223:57:052
17502992823,3cyclictest33-21ksoftirqd/223:11:582
17502992823,3cyclictest33-21ksoftirqd/223:07:112
17502992823,3cyclictest33-21ksoftirqd/221:41:322
17502992823,3cyclictest33-21ksoftirqd/220:21:422
17502992822,3cyclictest33-21ksoftirqd/221:32:032
17502992822,3cyclictest33-21ksoftirqd/221:01:572
17502992821,4cyclictest33-21ksoftirqd/222:21:502
17502992821,4cyclictest33-21ksoftirqd/222:08:582
17502992821,4cyclictest33-21ksoftirqd/220:44:072
17496992823,3cyclictest25-21ksoftirqd/122:32:021
17496992823,3cyclictest25-21ksoftirqd/122:06:441
17496992822,4cyclictest25-21ksoftirqd/120:29:211
17496992822,3cyclictest25-21ksoftirqd/120:31:531
17496992821,5cyclictest25-21ksoftirqd/101:02:061
177391270,1ptp4l401ktimersoftd/321:48:323
17510992720,4cyclictest41-21ksoftirqd/322:08:593
17502992722,3cyclictest33-21ksoftirqd/220:32:012
17502992722,3cyclictest33-21ksoftirqd/201:22:182
17502992721,4cyclictest33-21ksoftirqd/222:06:442
17502992721,4cyclictest33-21ksoftirqd/200:02:062
17502992721,3cyclictest33-21ksoftirqd/223:36:462
17502992720,4cyclictest33-21ksoftirqd/220:58:122
17502992720,4cyclictest33-21ksoftirqd/220:58:122
17502992713,11cyclictest33-21ksoftirqd/223:02:172
17496992722,3cyclictest25-21ksoftirqd/100:02:021
1749699270,3cyclictest121rcu_preempt01:14:481
177391260,1ptp4l401ktimersoftd/320:27:153
17510992619,4cyclictest41-21ksoftirqd/320:54:363
17502992621,3cyclictest33-21ksoftirqd/222:32:062
17502992621,3cyclictest33-21ksoftirqd/222:11:552
17502992621,3cyclictest33-21ksoftirqd/201:37:072
17502992621,3cyclictest33-21ksoftirqd/201:27:052
17502992620,3cyclictest33-21ksoftirqd/223:22:002
17502992620,3cyclictest33-21ksoftirqd/222:58:222
17502992620,3cyclictest33-21ksoftirqd/222:01:392
17502992614,6cyclictest33-21ksoftirqd/221:26:562
17496992621,3cyclictest25-21ksoftirqd/101:07:051
17496992619,4cyclictest25-21ksoftirqd/122:01:221
17496992619,4cyclictest25-21ksoftirqd/100:17:041
177391250,1ptp4l401ktimersoftd/320:25:563
17510992519,3cyclictest41-21ksoftirqd/321:11:233
17502992520,3cyclictest33-21ksoftirqd/201:05:482
17502992519,4cyclictest33-21ksoftirqd/200:51:472
17502992519,4cyclictest33-21ksoftirqd/200:38:252
17502992519,3cyclictest33-21ksoftirqd/223:21:452
17502992519,3cyclictest33-21ksoftirqd/220:47:382
1749699253,3cyclictest121rcu_preempt00:12:141
17496992519,4cyclictest25-21ksoftirqd/120:58:431
17496992519,4cyclictest25-21ksoftirqd/120:58:431
17496992519,4cyclictest25-21ksoftirqd/120:52:531
17496992519,4cyclictest25-21ksoftirqd/120:47:231
17496992519,3cyclictest25-21ksoftirqd/101:17:031
17496992518,4cyclictest25-21ksoftirqd/120:24:071
17496992513,9cyclictest26500-21cpuspeed_turbos01:42:031
177391240,1ptp4l401ktimersoftd/320:36:563
177391240,1ptp4l401ktimersoftd/320:31:553
177391240,1ptp4l401ktimersoftd/300:07:123
17502992420,3cyclictest33-21ksoftirqd/201:21:482
17502992419,3cyclictest33-21ksoftirqd/220:26:582
17502992419,3cyclictest33-21ksoftirqd/200:52:032
17502992418,5cyclictest33-21ksoftirqd/221:22:072
17502992418,3cyclictest33-21ksoftirqd/222:52:042
17502992417,4cyclictest33-21ksoftirqd/223:31:442
17496992419,3cyclictest25-21ksoftirqd/100:32:101
17496992419,3cyclictest25-21ksoftirqd/100:06:591
17496992418,3cyclictest25-21ksoftirqd/123:47:251
177391230,1ptp4l401ktimersoftd/321:16:593
177391230,1ptp4l401ktimersoftd/320:41:553
1750299239,8cyclictest33-21ksoftirqd/221:51:582
17502992318,3cyclictest33-21ksoftirqd/222:17:132
17502992317,3cyclictest33-21ksoftirqd/221:18:332
17502992317,3cyclictest33-21ksoftirqd/220:17:052
17502992316,4cyclictest33-21ksoftirqd/221:07:192
17496992318,3cyclictest25-21ksoftirqd/123:22:021
17496992318,3cyclictest25-21ksoftirqd/100:38:481
17496992316,4cyclictest29166-21find23:52:091
17496992315,5cyclictest7061-21cut22:07:001
5592220,2sleep10-21swapper/122:41:571
1750299222,17cyclictest26864-21grep01:42:062
17502992217,3cyclictest33-21ksoftirqd/223:42:052
17496992216,4cyclictest25-21ksoftirqd/120:42:421
17496992215,4cyclictest25-21ksoftirqd/122:28:401
17496992215,4cyclictest25-21ksoftirqd/121:43:361
138182220,17sleep10-21swapper/123:35:091
17502992116,3cyclictest33-21ksoftirqd/200:27:112
17502992116,3cyclictest33-21ksoftirqd/200:27:112
17502992115,4cyclictest33-21ksoftirqd/220:41:022
17496992116,3cyclictest25-21ksoftirqd/100:57:071
17496992116,3cyclictest25-21ksoftirqd/100:22:021
17496992116,3cyclictest25-21ksoftirqd/100:22:021
17496992115,3cyclictest25-21ksoftirqd/121:41:431
17496992114,5cyclictest25-21ksoftirqd/123:12:141
17496992114,4cyclictest25-21ksoftirqd/121:36:171
17496992114,4cyclictest25-21ksoftirqd/121:19:551
17496992114,4cyclictest22502-21sh23:45:341
17496992113,5cyclictest15589-21latency_hist22:21:431
17502992016,3cyclictest33-21ksoftirqd/201:12:062
17502992015,3cyclictest33-21ksoftirqd/201:32:042
17502992014,3cyclictest12437-21/usr/sbin/munin21:12:032
17496992015,3cyclictest25-21ksoftirqd/122:52:161
17496992015,3cyclictest25-21ksoftirqd/101:37:031
17496992014,3cyclictest13555-21needreboot21:12:021
17496992013,4cyclictest29935-21cat21:47:041
1749699197,9cyclictest0-21swapper/101:31:041
1749699197,9cyclictest0-21swapper/100:44:281
1749699193,13cyclictest26859-21grep00:27:111
1749699193,13cyclictest26859-21grep00:27:111
17496991914,3cyclictest25-21ksoftirqd/123:02:051
17496991914,3cyclictest25-21ksoftirqd/100:52:451
17496991913,3cyclictest13730-21fschecks_count22:57:021
17496991912,4cyclictest7687-21/usr/sbin/munin21:02:041
17496991813,3cyclictest16031-21strings23:37:071
17496991812,3cyclictest29682-21swap20:37:091
17496991812,3cyclictest25-21ksoftirqd/123:17:071
17496991812,3cyclictest1210-21switchtime23:57:151
17496991812,3cyclictest10330-21snmp_o5powerctl22:12:101
17496991811,4cyclictest18945-21cut20:17:021
17496991811,4cyclictest16079-21expr22:21:581
17496991711,3cyclictest31965-21sh21:52:001
17496991711,3cyclictest20040-21gltestperf21:27:001
17496991710,4cyclictest10396-21expr21:06:571
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional