You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-29 - 07:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Wed Oct 29, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1414621690,5sleep21774599cyclictest23:54:292
3024621460,4sleep01772999cyclictest01:25:080
149821310,4sleep31775199cyclictest22:29:143
1631321260,4sleep31775199cyclictest23:20:573
1773911170,8ptp4l15234-21kworker/3:020:02:233
190502850,4sleep218972-21ssh23:24:222
177391720,1ptp4l401ktimersoftd/300:53:223
97012710,4sleep1231rcuc/121:59:211
284832650,2sleep10-21swapper/101:24:211
10802600,3sleep2321ktimersoftd/200:16:132
92862590,3sleep10-21swapper/100:24:351
33612530,1sleep20-21swapper/200:54:272
174362534,37sleep10-21swapper/120:01:301
174102534,37sleep20-21swapper/220:01:112
177391520,1ptp4l401ktimersoftd/323:30:383
173732524,36sleep00-21swapper/020:00:410
177391500,1ptp4l401ktimersoftd/300:29:243
177391490,2ptp4l19090-21kworker/3:100:55:113
177391470,1ptp4l401ktimersoftd/322:51:543
17745994510,4cyclictest24644-21sed21:24:162
177391450,1ptp4l401ktimersoftd/322:10:183
177391450,0ptp4l401ktimersoftd/323:15:163
177391440,2ptp4l15234-21kworker/3:021:05:003
177391440,1ptp4l401ktimersoftd/322:59:053
177391430,1ptp4l401ktimersoftd/320:26:263
1774599423,13cyclictest8181-21rm23:49:142
177391390,1ptp4l401ktimersoftd/301:22:283
177391390,0ptp4l401ktimersoftd/322:08:113
177391390,0ptp4l401ktimersoftd/300:24:023
17745993820,4cyclictest33-21ksoftirqd/220:55:032
177391380,1ptp4l401ktimersoftd/323:50:543
177391380,1ptp4l401ktimersoftd/323:46:363
177391380,1ptp4l401ktimersoftd/322:39:443
177391380,1ptp4l401ktimersoftd/321:57:003
177391380,1ptp4l401ktimersoftd/300:00:103
1774599373,10cyclictest25638-21ssh00:44:172
1774599373,10cyclictest25638-21ssh00:44:172
177391370,1ptp4l401ktimersoftd/322:18:143
177391370,1ptp4l401ktimersoftd/321:53:353
177391370,1ptp4l401ktimersoftd/320:09:273
177391370,1ptp4l401ktimersoftd/301:32:343
177391370,1ptp4l401ktimersoftd/301:13:113
177391370,1ptp4l401ktimersoftd/300:11:543
177391370,1ptp4l401ktimersoftd/300:08:063
177391370,0ptp4l401ktimersoftd/322:36:003
177391360,1ptp4l401ktimersoftd/323:41:593
177391360,1ptp4l401ktimersoftd/323:28:513
177391360,1ptp4l401ktimersoftd/300:47:353
177391360,1ptp4l401ktimersoftd/300:47:353
177391360,1ptp4l401ktimersoftd/300:26:133
177391360,0ptp4l401ktimersoftd/301:08:043
177391360,0ptp4l401ktimersoftd/301:00:463
263032350,1sleep10-21swapper/121:28:581
177391350,1ptp4l401ktimersoftd/323:57:413
177391350,0ptp4l401ktimersoftd/322:27:513
177391350,0ptp4l401ktimersoftd/320:55:373
177391350,0ptp4l401ktimersoftd/300:39:433
177391350,0ptp4l401ktimersoftd/300:34:523
17729993528,4cyclictest16806-21systemctl01:09:280
70082340,3sleep21774599cyclictest23:47:302
2826723427,3sleep09-21ksoftirqd/023:34:240
177391340,2ptp4l19090-21kworker/3:123:07:563
177391340,1ptp4l401ktimersoftd/301:14:143
177391340,11ptp4l401ktimersoftd/321:24:233
1772999341,6cyclictest121rcu_preempt01:16:020
177391330,2ptp4l19090-21kworker/3:100:17:353
177391330,1ptp4l401ktimersoftd/323:10:133
177391330,1ptp4l401ktimersoftd/322:45:073
177391330,1ptp4l401ktimersoftd/322:23:493
177391330,1ptp4l401ktimersoftd/320:44:103
177391330,1ptp4l401ktimersoftd/320:40:473
177391330,0ptp4l401ktimersoftd/320:14:033
177391320,1ptp4l401ktimersoftd/323:37:313
177391320,1ptp4l401ktimersoftd/322:55:003
177391320,1ptp4l401ktimersoftd/322:55:003
177391320,1ptp4l401ktimersoftd/320:20:123
177391310,1ptp4l401ktimersoftd/321:31:223
177391310,1ptp4l401ktimersoftd/320:52:023
177391310,1ptp4l401ktimersoftd/301:25:373
17729993124,4cyclictest9-21ksoftirqd/022:15:130
1772999312,26cyclictest7255-21cron20:48:570
17729993018,3cyclictest9-21ksoftirqd/000:19:200
292002290,4sleep0101ktimersoftd/020:24:180
1774599293,3cyclictest121rcu_preempt22:22:442
17745992923,3cyclictest33-21ksoftirqd/223:02:402
17745992922,4cyclictest33-21ksoftirqd/221:39:432
17729992924,3cyclictest9-21ksoftirqd/023:29:210
17729992922,4cyclictest9-21ksoftirqd/001:29:140
17745992821,4cyclictest33-21ksoftirqd/220:50:542
17745992821,4cyclictest33-21ksoftirqd/220:29:382
177391280,1ptp4l401ktimersoftd/320:38:353
17729992823,3cyclictest9-21ksoftirqd/000:54:030
17729992822,3cyclictest9-21ksoftirqd/022:03:040
17751992722,3cyclictest41-21ksoftirqd/320:08:573
17745992721,3cyclictest33-21ksoftirqd/221:13:402
17745992721,3cyclictest33-21ksoftirqd/221:13:402
1774599270,2cyclictest121rcu_preempt23:09:012
177391270,1ptp4l401ktimersoftd/321:39:303
177391270,1ptp4l401ktimersoftd/320:31:243
17734992721,3cyclictest25-21ksoftirqd/120:30:371
17734992720,4cyclictest25-21ksoftirqd/121:11:121
17734992720,4cyclictest25-21ksoftirqd/121:11:121
17729992720,4cyclictest9-21ksoftirqd/020:22:050
17729992720,4cyclictest9-21ksoftirqd/000:36:020
17751992620,4cyclictest41-21ksoftirqd/321:11:503
17751992620,4cyclictest41-21ksoftirqd/321:11:503
17751992620,3cyclictest41-21ksoftirqd/321:38:363
17751992619,4cyclictest41-21ksoftirqd/321:14:073
1774599263,5cyclictest121rcu_preempt23:42:402
17745992621,3cyclictest33-21ksoftirqd/222:46:002
17745992621,3cyclictest33-21ksoftirqd/220:14:122
17745992620,3cyclictest33-21ksoftirqd/220:19:382
17745992620,3cyclictest33-21ksoftirqd/200:09:142
17745992619,4cyclictest33-21ksoftirqd/222:33:512
17745992619,4cyclictest33-21ksoftirqd/221:33:332
177391260,1ptp4l401ktimersoftd/321:21:303
17734992620,4cyclictest25-21ksoftirqd/120:20:461
17734992620,3cyclictest25-21ksoftirqd/123:18:011
17729992620,3cyclictest9-21ksoftirqd/023:22:290
17729992620,3cyclictest9-21ksoftirqd/022:26:220
17729992619,4cyclictest9-21ksoftirqd/021:35:240
17729992619,4cyclictest9-21ksoftirqd/021:21:590
17729992619,4cyclictest9-21ksoftirqd/021:05:530
17729992619,4cyclictest9-21ksoftirqd/020:54:010
108932260,2sleep00-21swapper/000:27:440
321162250,5sleep11773499cyclictest00:50:001
17751992519,3cyclictest41-21ksoftirqd/320:59:003
1774599254,13cyclictest47050irq/102-ens3-Tx22:09:132
17745992520,3cyclictest33-21ksoftirqd/220:04:412
17745992519,3cyclictest33-21ksoftirqd/223:13:462
17745992519,3cyclictest33-21ksoftirqd/221:53:542
17745992519,3cyclictest33-21ksoftirqd/221:44:132
17745992519,3cyclictest33-21ksoftirqd/220:26:242
17745992518,4cyclictest33-21ksoftirqd/223:20:002
17745992518,4cyclictest33-21ksoftirqd/221:36:582
17745992518,4cyclictest33-21ksoftirqd/221:20:042
177391250,1ptp4l401ktimersoftd/322:00:243
177391250,0ptp4l401ktimersoftd/321:46:163
17734992520,3cyclictest25-21ksoftirqd/122:05:031
17734992520,3cyclictest25-21ksoftirqd/120:26:261
17734992520,3cyclictest25-21ksoftirqd/101:06:421
17734992518,4cyclictest25-21ksoftirqd/121:15:011
17734992518,4cyclictest25-21ksoftirqd/121:05:261
17734992518,4cyclictest25-21ksoftirqd/120:42:381
17734992516,6cyclictest12786-21head20:59:171
17729992519,3cyclictest9-21ksoftirqd/021:03:570
17729992519,3cyclictest9-21ksoftirqd/020:18:000
17729992519,3cyclictest9-21ksoftirqd/001:19:140
17729992518,4cyclictest9-21ksoftirqd/000:31:120
17745992419,3cyclictest33-21ksoftirqd/220:38:492
17745992418,4cyclictest33-21ksoftirqd/221:05:152
17745992418,3cyclictest33-21ksoftirqd/222:50:092
17745992418,3cyclictest33-21ksoftirqd/222:08:522
17745992418,3cyclictest33-21ksoftirqd/221:17:572
17745992418,3cyclictest33-21ksoftirqd/200:28:452
17745992417,4cyclictest33-21ksoftirqd/222:02:322
1774599240,3cyclictest121rcu_preempt00:49:462
17734992419,3cyclictest25-21ksoftirqd/101:22:551
17734992418,4cyclictest25-21ksoftirqd/100:39:531
17734992417,4cyclictest26651-21grep21:29:131
17734992417,4cyclictest25-21ksoftirqd/123:29:591
17734992417,4cyclictest25-21ksoftirqd/122:42:171
17734992417,4cyclictest25-21ksoftirqd/120:48:241
17734992417,4cyclictest25-21ksoftirqd/120:06:161
17734992417,4cyclictest25-21ksoftirqd/100:56:191
1773499241,3cyclictest121rcu_preempt00:22:411
17729992419,3cyclictest9-21ksoftirqd/021:09:160
17729992419,3cyclictest9-21ksoftirqd/021:09:160
17729992418,3cyclictest9-21ksoftirqd/022:52:230
17729992418,3cyclictest9-21ksoftirqd/021:24:040
17729992417,4cyclictest9-21ksoftirqd/021:46:040
17729992417,4cyclictest9-21ksoftirqd/021:39:530
17729992417,4cyclictest9-21ksoftirqd/020:43:330
17729992417,4cyclictest9-21ksoftirqd/020:09:570
1774599239,11cyclictest29185-21cat01:24:252
1774599234,12cyclictest6415-21rm00:59:192
17745992318,3cyclictest33-21ksoftirqd/200:07:092
17745992317,3cyclictest33-21ksoftirqd/221:57:322
17745992317,3cyclictest33-21ksoftirqd/201:04:142
17745992311,9cyclictest19820-21sh00:37:062
17734992318,3cyclictest25-21ksoftirqd/123:26:241
17734992317,4cyclictest25-21ksoftirqd/123:01:201
17734992317,3cyclictest25-21ksoftirqd/123:51:471
17734992317,3cyclictest25-21ksoftirqd/121:50:141
17734992317,3cyclictest25-21ksoftirqd/120:56:481
17734992317,3cyclictest23705-21tune2fs20:14:171
1772999234,11cyclictest26386-21ssh00:09:160
17729992317,4cyclictest9-21ksoftirqd/000:41:320
17729992317,3cyclictest9-21ksoftirqd/021:55:430
17729992317,3cyclictest9-21ksoftirqd/021:32:510
17729992316,4cyclictest9-21ksoftirqd/022:54:290
17729992316,4cyclictest9-21ksoftirqd/022:54:290
17729992316,4cyclictest12845-21cpuspeed_turbos23:54:160
17729992312,7cyclictest30883-21sh00:14:180
17745992217,3cyclictest33-21ksoftirqd/200:19:222
17745992216,4cyclictest7877-21sh22:35:022
17745992216,3cyclictest33-21ksoftirqd/201:22:132
17734992217,3cyclictest25-21ksoftirqd/122:24:191
17734992217,3cyclictest25-21ksoftirqd/101:09:171
17734992216,4cyclictest25-21ksoftirqd/121:19:471
17734992216,3cyclictest25-21ksoftirqd/121:54:241
1772999229,10cyclictest9750-21head23:14:190
1772999224,12cyclictest17213-21sh23:59:140
17729992219,2cyclictest9-21ksoftirqd/023:07:500
17729992217,3cyclictest9-21ksoftirqd/023:54:020
17729992216,3cyclictest9-21ksoftirqd/021:16:280
17729992216,3cyclictest6577-21grep23:09:320
17729992216,3cyclictest25217-21tr22:19:160
17729992215,4cyclictest9-21ksoftirqd/020:29:000
28972210,2sleep20-21swapper/201:32:332
17745992116,3cyclictest33-21ksoftirqd/200:44:032
17745992115,4cyclictest33-21ksoftirqd/220:45:362
17745992115,3cyclictest33-21ksoftirqd/220:59:592
17745992114,4cyclictest33-21ksoftirqd/223:14:062
17745992114,4cyclictest21555-21sh01:14:442
17745992114,4cyclictest21224-21sh00:03:542
17745992114,4cyclictest14313-21sh00:30:102
1774599210,18cyclictest20222-21munin-node20:09:012
1773499216,5cyclictest25-21ksoftirqd/101:16:021
1773499213,15cyclictest17585-21cut23:59:181
17734992116,3cyclictest25-21ksoftirqd/122:38:041
17734992115,4cyclictest25-21ksoftirqd/122:56:301
17734992115,4cyclictest25-21ksoftirqd/122:56:301
17734992115,3cyclictest8377-21rm00:59:541
17734992115,3cyclictest25-21ksoftirqd/120:53:141
1773499211,4cyclictest1044-21/usr/sbin/munin20:34:161
17729992115,3cyclictest9-21ksoftirqd/020:36:580
17729992114,4cyclictest9-21ksoftirqd/020:07:080
1772999211,3cyclictest31292-21ssh23:01:520
168782210,5sleep233-21ksoftirqd/201:09:322
1774599201,4cyclictest29742-21ssh23:35:562
17745992014,3cyclictest33-21ksoftirqd/220:43:452
17745992014,3cyclictest20713-21gltestperf22:14:172
17745992014,3cyclictest1760-21runrttasks22:41:132
17745992013,4cyclictest23695-21sh22:54:122
17745992013,4cyclictest23695-21sh22:54:122
1774599201,17cyclictest0-21swapper/222:24:132
1773499207,4cyclictest200392chrt00:37:321
1773499202,15cyclictest22739-21grep00:04:241
17734992015,3cyclictest25-21ksoftirqd/101:31:151
17734992014,4cyclictest25-21ksoftirqd/100:18:041
17734992014,3cyclictest924-21latency_hist21:43:591
17734992014,3cyclictest27149-21/usr/sbin/munin23:34:161
17734992014,3cyclictest25610-21/usr/sbin/munin00:44:251
17734992014,3cyclictest25610-21/usr/sbin/munin00:44:251
17734992014,3cyclictest25-21ksoftirqd/122:52:091
17734992014,3cyclictest25-21ksoftirqd/121:45:011
17734992014,3cyclictest14292-21ls23:54:311
17734992013,4cyclictest18096-21sh22:47:301
17734992013,4cyclictest15854-21cpuspeed_turbos22:09:151
1773499201,16cyclictest21321-21cut20:09:131
17729992015,3cyclictest9-21ksoftirqd/023:44:310
17729992014,4cyclictest9-21ksoftirqd/000:48:150
17729992014,4cyclictest9-21ksoftirqd/000:48:150
17729992014,3cyclictest3092-21sh23:43:380
17729992013,4cyclictest9-21ksoftirqd/022:47:460
17729992013,4cyclictest9-21ksoftirqd/020:51:560
17729992013,4cyclictest12579-21ls22:04:270
17729992010,7cyclictest2450-21gltestperf00:54:200
1774599191,15cyclictest256122sleep223:31:402
17734991914,3cyclictest13035-21kworker/1:200:09:201
17734991913,4cyclictest2841-21seq23:43:071
17734991913,3cyclictest4316-21if_enp1s0.123:44:221
17734991913,3cyclictest13360-21phc2sys-jitter00:29:241
17734991912,4cyclictest1203-21/usr/sbin/munin22:29:311
1773499191,11cyclictest20290-21ssh22:14:121
1773499191,10cyclictest46950irq/101-ens3-Tx23:09:141
17729991913,4cyclictest9-21ksoftirqd/001:01:110
17729991913,3cyclictest5093-21timerandwakeup21:49:310
17729991913,3cyclictest12280-21ptp4l01:04:260
17729991913,3cyclictest10649-21diskmemload22:29:100
17729991913,3cyclictest10204-21/usr/sbin/munin22:39:210
1772999191,2cyclictest0-21swapper/022:09:130
17729991912,4cyclictest10649-21diskmemload22:36:510
1772999191,16cyclictest0-21swapper/000:04:320
1773499185,10cyclictest2009-21cat23:04:311
17734991812,3cyclictest29090-21cstates21:34:121
17734991812,3cyclictest25102-21tune2fs22:19:151
17734991811,4cyclictest14310-21cat23:19:181
1772999181,15cyclictest0-21swapper/023:24:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional