You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 01:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Mon Jun 30, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1857621450,3sleep1431599cyclictest11:33:501
1857621450,3sleep1431599cyclictest11:33:501
2583521230,3sleep3432799cyclictest12:32:463
1518911070,38ptp4l401ktimersoftd/309:55:013
293182830,2sleep30-21swapper/311:54:163
151891670,10ptp4l401ktimersoftd/312:45:393
63872630,2sleep20-21swapper/215:14:132
40122634,10sleep00-21swapper/009:56:090
168362600,2sleep3401ktimersoftd/312:59:363
163702580,2sleep20-21swapper/212:59:192
4315995643,6cyclictest25-21ksoftirqd/109:59:001
202962560,4sleep3401ktimersoftd/311:34:213
202962560,4sleep3401ktimersoftd/311:34:213
120452530,2sleep30-21swapper/314:12:193
58062510,1sleep00-21swapper/015:14:070
21742514,34sleep20-21swapper/209:54:012
151891510,1ptp4l401ktimersoftd/313:49:393
138972510,2sleep20-21swapper/213:35:412
4315994935,7cyclictest25-21ksoftirqd/113:39:081
4315994837,6cyclictest25-21ksoftirqd/110:34:031
233082480,3sleep00-21swapper/012:29:140
151891480,1ptp4l401ktimersoftd/313:20:243
151891480,1ptp4l401ktimersoftd/313:20:243
4315994731,8cyclictest25-21ksoftirqd/114:04:061
257222460,1sleep30-21swapper/310:39:173
4315994431,6cyclictest25-21ksoftirqd/113:44:071
4315994230,6cyclictest25-21ksoftirqd/113:24:081
4315994228,7cyclictest25-21ksoftirqd/111:29:061
4315994030,5cyclictest25-21ksoftirqd/115:09:131
4315994028,5cyclictest25-21ksoftirqd/111:59:061
151891390,1ptp4l401ktimersoftd/314:33:543
151891390,1ptp4l401ktimersoftd/311:19:063
4315993832,3cyclictest25-21ksoftirqd/109:58:481
4315993827,6cyclictest25-21ksoftirqd/112:39:091
151891380,5ptp4l401ktimersoftd/314:47:023
151891380,1ptp4l401ktimersoftd/313:31:343
151891380,1ptp4l401ktimersoftd/313:10:463
151891380,1ptp4l401ktimersoftd/312:26:423
151891380,15ptp4l401ktimersoftd/313:36:183
151891370,1ptp4l401ktimersoftd/315:16:133
151891370,1ptp4l401ktimersoftd/311:23:543
151891370,1ptp4l401ktimersoftd/310:29:203
4315993631,3cyclictest25-21ksoftirqd/115:28:551
151891360,1ptp4l401ktimersoftd/315:28:553
151891360,1ptp4l401ktimersoftd/314:08:023
151891360,1ptp4l401ktimersoftd/313:16:543
151891360,1ptp4l401ktimersoftd/312:52:383
151891360,1ptp4l401ktimersoftd/312:40:583
151891360,1ptp4l401ktimersoftd/312:09:133
151891360,1ptp4l401ktimersoftd/311:17:073
151891360,1ptp4l401ktimersoftd/311:09:053
151891360,12ptp4l401ktimersoftd/314:52:583
151891360,0ptp4l401ktimersoftd/313:38:543
80852350,4sleep0430999cyclictest14:42:350
4315993529,3cyclictest25-21ksoftirqd/114:28:531
151891350,2ptp4l6463-21kworker/3:213:47:243
151891350,1ptp4l401ktimersoftd/312:34:303
151891350,11ptp4l401ktimersoftd/315:09:163
151891350,0ptp4l401ktimersoftd/313:54:573
156562340,5sleep115659-21irqrtprio12:59:141
151891340,1ptp4l401ktimersoftd/314:43:093
151891340,1ptp4l401ktimersoftd/313:28:313
151891340,1ptp4l401ktimersoftd/312:08:093
4315993327,3cyclictest25-21ksoftirqd/115:14:161
227652330,3sleep20-21swapper/210:34:102
221402330,4sleep2432299cyclictest13:44:402
151891330,1ptp4l401ktimersoftd/315:20:293
151891330,1ptp4l401ktimersoftd/314:00:013
151891330,1ptp4l401ktimersoftd/312:18:043
151891330,0ptp4l401ktimersoftd/315:05:103
151891330,0ptp4l401ktimersoftd/314:15:123
432299320,3cyclictest121rcu_preempt14:34:192
4315993226,3cyclictest25-21ksoftirqd/112:13:511
151891320,9ptp4l401ktimersoftd/311:01:563
151891320,1ptp4l401ktimersoftd/310:13:583
4315993125,3cyclictest25-21ksoftirqd/114:29:111
4315993125,3cyclictest25-21ksoftirqd/114:13:541
4315993125,3cyclictest25-21ksoftirqd/112:54:231
4315993125,3cyclictest25-21ksoftirqd/111:14:061
430999315,15cyclictest14024-21ssh14:49:080
4309993124,4cyclictest18210-21cron11:33:490
291732310,4sleep229161-21ssh15:04:132
151891310,1ptp4l401ktimersoftd/315:01:593
151891310,1ptp4l401ktimersoftd/315:01:593
151891310,1ptp4l401ktimersoftd/314:55:433
151891310,0ptp4l401ktimersoftd/314:35:403
151891310,0ptp4l401ktimersoftd/310:52:213
151891310,0ptp4l401ktimersoftd/310:10:133
4327993023,4cyclictest41-21ksoftirqd/311:39:053
4315993025,3cyclictest25-21ksoftirqd/114:23:541
4315993025,3cyclictest25-21ksoftirqd/113:23:521
4315993025,3cyclictest25-21ksoftirqd/113:23:521
4315993018,9cyclictest25-21ksoftirqd/112:44:111
4309993024,3cyclictest9-21ksoftirqd/013:58:580
4309993017,10cyclictest9-21ksoftirqd/014:38:140
151891300,1ptp4l401ktimersoftd/313:07:363
4315992924,3cyclictest25-21ksoftirqd/112:28:511
4315992924,3cyclictest25-21ksoftirqd/112:19:171
4315992924,3cyclictest25-21ksoftirqd/111:49:131
4315992924,3cyclictest25-21ksoftirqd/111:03:491
4315992923,3cyclictest25-21ksoftirqd/113:58:541
4315992923,3cyclictest25-21ksoftirqd/113:58:531
4315992923,3cyclictest25-21ksoftirqd/113:34:271
4315992922,4cyclictest25-21ksoftirqd/114:39:171
431599291,2cyclictest121rcu_preempt14:51:431
283222290,2sleep30-21swapper/310:44:223
151891290,1ptp4l401ktimersoftd/310:27:143
432299282,3cyclictest121rcu_preempt12:46:472
4322992821,4cyclictest33-21ksoftirqd/211:26:092
4315992823,3cyclictest25-21ksoftirqd/110:23:481
4315992823,3cyclictest25-21ksoftirqd/110:14:071
4315992823,2cyclictest25-21ksoftirqd/114:48:541
4315992822,3cyclictest25-21ksoftirqd/111:19:021
4315992822,3cyclictest25-21ksoftirqd/110:03:521
186062281,22sleep018728-21sed14:19:160
4327992721,3cyclictest41-21ksoftirqd/310:34:363
4327992720,4cyclictest41-21ksoftirqd/311:05:583
4322992722,3cyclictest33-21ksoftirqd/210:03:482
4322992721,3cyclictest33-21ksoftirqd/211:18:492
4322992720,4cyclictest33-21ksoftirqd/214:18:322
4322992720,4cyclictest33-21ksoftirqd/213:27:132
4322992720,4cyclictest33-21ksoftirqd/211:50:502
4315992722,3cyclictest25-21ksoftirqd/115:19:271
4315992722,3cyclictest25-21ksoftirqd/111:43:501
4315992721,3cyclictest25-21ksoftirqd/112:53:031
4315992721,3cyclictest25-21ksoftirqd/112:08:511
4309992722,3cyclictest9-21ksoftirqd/014:54:220
4309992721,3cyclictest9-21ksoftirqd/012:58:130
4309992721,3cyclictest9-21ksoftirqd/012:19:460
4309992721,3cyclictest9-21ksoftirqd/010:26:290
293352270,4sleep1431599cyclictest13:14:401
4327992620,3cyclictest41-21ksoftirqd/310:05:163
4322992620,3cyclictest33-21ksoftirqd/215:22:332
4322992620,3cyclictest33-21ksoftirqd/214:50:442
4322992619,4cyclictest33-21ksoftirqd/215:01:452
4322992619,4cyclictest33-21ksoftirqd/215:01:452
4322992619,4cyclictest33-21ksoftirqd/213:33:282
4322992619,4cyclictest33-21ksoftirqd/213:16:252
4322992619,4cyclictest33-21ksoftirqd/212:40:562
4322992619,4cyclictest33-21ksoftirqd/211:21:072
4322992619,4cyclictest33-21ksoftirqd/211:11:312
4322992619,4cyclictest33-21ksoftirqd/210:04:352
4322992618,5cyclictest33-21ksoftirqd/210:18:162
4322992612,4cyclictest5495-21interrupts14:04:122
4315992621,3cyclictest25-21ksoftirqd/115:04:121
4315992621,3cyclictest25-21ksoftirqd/113:49:091
4315992621,3cyclictest25-21ksoftirqd/113:13:521
4315992621,3cyclictest25-21ksoftirqd/112:38:521
4315992621,3cyclictest25-21ksoftirqd/110:09:061
4315992620,3cyclictest25-21ksoftirqd/112:29:101
4315992620,3cyclictest25-21ksoftirqd/112:15:501
4315992620,3cyclictest25-21ksoftirqd/111:44:151
4315992620,3cyclictest25-21ksoftirqd/111:13:491
4315992620,3cyclictest25-21ksoftirqd/110:28:481
4315992619,4cyclictest25-21ksoftirqd/110:55:081
4309992620,3cyclictest9-21ksoftirqd/010:48:010
4309992620,3cyclictest9-21ksoftirqd/010:14:530
4309992619,5cyclictest9-21ksoftirqd/013:39:380
4309992619,4cyclictest9-21ksoftirqd/010:35:280
310632260,3sleep341-21ksoftirqd/311:59:103
1590912619,3phc2sys41-21ksoftirqd/314:28:533
151891260,9ptp4l401ktimersoftd/312:22:403
151891260,1ptp4l401ktimersoftd/314:21:303
151891260,1ptp4l401ktimersoftd/312:55:553
151891260,1ptp4l401ktimersoftd/310:19:503
104872260,4sleep010486-21idleruntime-cro12:53:510
4322992518,4cyclictest33-21ksoftirqd/212:17:192
4322992518,4cyclictest33-21ksoftirqd/210:54:292
4322992518,4cyclictest33-21ksoftirqd/210:31:172
4315992521,2cyclictest25-21ksoftirqd/114:58:541
4315992520,3cyclictest25-21ksoftirqd/111:54:241
4315992520,3cyclictest25-21ksoftirqd/111:24:211
4315992520,3cyclictest25-21ksoftirqd/111:08:491
4315992519,3cyclictest25-21ksoftirqd/114:34:171
4315992519,3cyclictest25-21ksoftirqd/113:29:141
431599251,2cyclictest0-21swapper/113:04:071
4309992518,4cyclictest924-21ssh12:40:570
4309992518,4cyclictest9-21ksoftirqd/011:55:450
4309992518,4cyclictest9-21ksoftirqd/010:41:540
302202250,3sleep0101ktimersoftd/013:16:350
151891250,1ptp4l401ktimersoftd/311:49:063
4322992418,3cyclictest33-21ksoftirqd/213:07:382
4322992417,4cyclictest33-21ksoftirqd/214:20:252
4322992417,4cyclictest33-21ksoftirqd/213:23:202
4322992417,4cyclictest33-21ksoftirqd/213:23:202
4322992417,4cyclictest33-21ksoftirqd/212:27:152
4322992416,5cyclictest18820-21ssh14:53:562
4322992416,4cyclictest26086-21sh13:11:442
432299241,20cyclictest30288-21diskmemload14:40:102
432299241,20cyclictest30288-21diskmemload12:00:172
432299240,3cyclictest121rcu_preempt12:09:212
432299240,21cyclictest0-21swapper/210:59:022
4315992420,2cyclictest25-21ksoftirqd/114:14:161
4315992419,3cyclictest25-21ksoftirqd/114:59:091
4315992419,3cyclictest25-21ksoftirqd/114:59:091
4315992419,3cyclictest25-21ksoftirqd/110:39:121
4315992417,4cyclictest25-21ksoftirqd/110:49:101
4309992419,3cyclictest235-21systemd-journal11:03:430
4309992418,3cyclictest9-21ksoftirqd/013:58:230
4309992418,3cyclictest9-21ksoftirqd/013:50:290
4309992418,3cyclictest9-21ksoftirqd/011:40:480
4309992417,4cyclictest9-21ksoftirqd/011:25:340
4309992417,4cyclictest9-21ksoftirqd/010:50:260
4309992417,4cyclictest2926-21unixbench_singl15:09:300
4309992417,3cyclictest9-21ksoftirqd/010:21:140
151891240,1ptp4l401ktimersoftd/311:44:083
151891240,1ptp4l401ktimersoftd/309:59:033
432299234,16cyclictest30285-21grep13:54:252
432299232,18cyclictest28873-21awk10:48:492
4322992318,3cyclictest33-21ksoftirqd/210:08:512
4322992316,4cyclictest33-21ksoftirqd/214:09:372
4322992316,4cyclictest33-21ksoftirqd/214:01:342
4322992316,4cyclictest33-21ksoftirqd/212:38:272
4322992316,4cyclictest33-21ksoftirqd/211:42:472
4322992316,4cyclictest33-21ksoftirqd/211:33:552
4322992316,4cyclictest33-21ksoftirqd/211:33:552
4322992316,4cyclictest33-21ksoftirqd/210:49:552
4322992315,5cyclictest2490-21find15:09:232
432299231,3cyclictest0-21swapper/212:54:462
432299231,20cyclictest0-21swapper/213:51:172
432299231,19cyclictest30288-21diskmemload14:24:362
432299231,19cyclictest12941-21ssh14:47:462
4322992310,4cyclictest54002mailstats11:04:152
4322992310,10cyclictest25138-21irqrtprio10:39:122
432299230,20cyclictest0-21swapper/212:19:352
4309992318,3cyclictest9-21ksoftirqd/012:44:040
4309992318,3cyclictest9-21ksoftirqd/010:03:490
4309992317,4cyclictest1841-21kworker/0:012:09:100
4309992317,3cyclictest9-21ksoftirqd/010:01:200
4309992316,4cyclictest9-21ksoftirqd/013:23:140
4309992316,4cyclictest9-21ksoftirqd/013:23:140
4309992316,4cyclictest9-21ksoftirqd/011:46:580
4309992313,7cyclictest29174-21cat15:04:130
151891230,1ptp4l401ktimersoftd/311:29:123
151891230,1ptp4l401ktimersoftd/310:54:063
432299223,16cyclictest8163-21taskset12:49:192
432299221,4cyclictest23733-21df_inode11:44:112
432299221,19cyclictest5314-21ssh12:06:462
432299220,5cyclictest16755-21if_ens311:29:122
432299220,20cyclictest0-21swapper/214:33:532
431599221,18cyclictest21333-21tail10:29:201
4309992217,3cyclictest9-21ksoftirqd/014:29:170
4309992216,3cyclictest9-21ksoftirqd/010:09:420
430999221,18cyclictest27208-21sshd11:49:210
430999221,18cyclictest20813-21/usr/sbin/munin13:04:270
4322992115,3cyclictest28151-21/usr/sbin/munin11:54:112
4322992115,3cyclictest15305-21/usr/sbin/munin15:24:192
4322992114,4cyclictest33-21ksoftirqd/210:19:522
4322992114,4cyclictest17755-21cut10:24:052
432299211,17cyclictest23310-21smartctl12:29:142
432299210,18cyclictest15524-21apt-key13:38:532
4315992116,3cyclictest25-21ksoftirqd/110:44:091
430999213,9cyclictest23790-21ssh14:59:090
430999213,9cyclictest23790-21ssh14:59:090
4309992116,3cyclictest9-21ksoftirqd/012:25:310
4309992116,3cyclictest0-21swapper/013:09:330
4309992115,4cyclictest9-21ksoftirqd/012:18:510
4309992115,3cyclictest9-21ksoftirqd/013:46:570
4309992115,3cyclictest9-21ksoftirqd/011:16:150
4309992114,4cyclictest17779-21sh13:01:430
4309992114,4cyclictest13467-21sh15:21:130
4309992114,4cyclictest11474-21/usr/sbin/munin13:34:140
4309992114,4cyclictest10215-21sh13:31:410
430999211,3cyclictest3122-21sed12:04:130
430999211,2cyclictest0-21swapper/014:45:170
4309992112,5cyclictest15328-21acpi15:24:080
430999211,17cyclictest0-21swapper/011:04:200
271352210,5sleep027139-21gltestperf12:34:120
430999209,8cyclictest6888-21grep11:09:090
4309992014,3cyclictest6501-21sh14:04:240
4309992013,4cyclictest4033-21cut13:24:160
4309992013,4cyclictest19937-21expr10:29:040
4309992013,4cyclictest14743-21sed14:14:260
4309992012,5cyclictest30288-21diskmemload11:59:040
4309992012,5cyclictest10907-21sh14:09:270
430999200,18cyclictest0-21swapper/014:24:050
4309991912,4cyclictest32225-21cut10:54:100
4309991912,4cyclictest11440-21sh11:19:040
4309991811,4cyclictest19040-21fschecks_count11:34:080
4309991811,4cyclictest19040-21fschecks_count11:34:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional