You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-13 - 19:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri Jun 13, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
834521700,5sleep03187299cyclictest11:14:270
3090621580,3sleep10-21swapper/109:44:481
1518911070,3ptp4l401ktimersoftd/309:47:153
127792760,3sleep10-21swapper/110:14:421
151891700,1ptp4l401ktimersoftd/314:47:093
316962654,10sleep00-21swapper/009:48:280
151891650,1ptp4l401ktimersoftd/310:59:423
151891650,1ptp4l401ktimersoftd/310:59:423
130322640,5sleep33189099cyclictest13:28:233
319072630,2sleep00-21swapper/014:23:530
151891620,1ptp4l401ktimersoftd/310:23:153
100252620,2sleep00-21swapper/012:48:530
100252620,2sleep00-21swapper/012:48:530
151891580,1ptp4l401ktimersoftd/311:50:373
65772570,2sleep30-21swapper/315:04:513
151891570,1ptp4l401ktimersoftd/314:59:463
151891570,1ptp4l401ktimersoftd/314:08:443
245532540,4sleep322452-1kworker/u9:013:04:463
151891510,2ptp4l3546-21kworker/3:213:30:533
235012500,1sleep00-21swapper/011:44:460
152442480,1sleep00-21swapper/015:14:270
151891480,1ptp4l401ktimersoftd/313:52:233
151891470,1ptp4l401ktimersoftd/310:41:093
3188399450,14cyclictest30403-21gltestperf12:34:452
151891440,1ptp4l401ktimersoftd/315:18:493
151891440,1ptp4l401ktimersoftd/312:04:233
151891430,1ptp4l401ktimersoftd/313:14:123
3188399421,37cyclictest9636-21/usr/sbin/munin12:09:432
151891410,1ptp4l401ktimersoftd/310:14:363
306152403,23sleep230709-21wc09:44:462
3187299391,10cyclictest63-21kswapd013:39:410
151891390,1ptp4l401ktimersoftd/313:39:493
151891390,1ptp4l401ktimersoftd/313:23:473
151891390,1ptp4l401ktimersoftd/310:34:383
31883993820,15cyclictest33-21ksoftirqd/210:26:152
151891380,1ptp4l401ktimersoftd/314:57:023
151891380,1ptp4l401ktimersoftd/312:49:433
151891380,1ptp4l401ktimersoftd/312:49:433
151891380,1ptp4l401ktimersoftd/312:39:553
151891380,1ptp4l401ktimersoftd/312:39:553
151891380,1ptp4l401ktimersoftd/311:39:413
151891380,1ptp4l401ktimersoftd/310:44:423
151891380,1ptp4l401ktimersoftd/310:29:383
151891380,1ptp4l401ktimersoftd/310:24:483
31883993712,4cyclictest28067-21expr14:19:462
3188399370,2cyclictest0-21swapper/213:44:432
151891370,2ptp4l3546-21kworker/3:213:35:373
151891370,1ptp4l401ktimersoftd/314:02:253
151891370,1ptp4l401ktimersoftd/313:44:513
151891370,1ptp4l401ktimersoftd/313:03:593
151891370,1ptp4l401ktimersoftd/311:44:443
31883993614,4cyclictest24789-21diskmemload14:44:542
151891360,2ptp4l3546-21kworker/3:214:54:293
151891360,1ptp4l401ktimersoftd/315:13:123
151891360,1ptp4l401ktimersoftd/314:38:293
151891360,1ptp4l401ktimersoftd/311:29:533
151891360,1ptp4l401ktimersoftd/311:25:183
151891360,0ptp4l401ktimersoftd/310:58:173
31883993514,4cyclictest6051-21/usr/sbin/munin11:09:512
31883993514,3cyclictest22031-21sh13:38:272
31883993512,3cyclictest1879-21grep13:14:522
151891350,2ptp4l3546-21kworker/3:213:17:453
151891350,1ptp4l401ktimersoftd/314:28:013
151891350,1ptp4l401ktimersoftd/312:19:283
151891350,1ptp4l401ktimersoftd/310:54:223
151891350,0ptp4l401ktimersoftd/311:16:433
3188399343,8cyclictest9513-21apt-get13:24:462
31883993413,3cyclictest24789-21diskmemload15:06:022
155402340,2sleep20-21swapper/212:54:462
151891340,1ptp4l401ktimersoftd/314:31:173
151891340,1ptp4l401ktimersoftd/314:20:083
151891340,1ptp4l401ktimersoftd/314:17:003
151891340,1ptp4l401ktimersoftd/312:58:543
151891340,1ptp4l401ktimersoftd/312:35:073
151891340,1ptp4l401ktimersoftd/312:17:333
3188399333,8cyclictest24185-21apt-get14:49:472
31883993313,3cyclictest7398-21sh14:30:562
31883993313,3cyclictest22898-21/usr/sbin/munin13:39:522
31883993312,3cyclictest15884-21cstates15:14:462
31883993311,4cyclictest11397-21cat10:09:562
3188399330,2cyclictest0-21swapper/213:30:012
151891330,1ptp4l401ktimersoftd/314:12:383
151891330,1ptp4l401ktimersoftd/312:48:283
151891330,1ptp4l401ktimersoftd/312:48:283
151891330,1ptp4l401ktimersoftd/311:10:273
3188399327,9cyclictest15601-21memory10:19:452
3188399323,7cyclictest15611-21apt-get11:29:402
31883993214,4cyclictest743-21proc_pri13:49:542
31883993213,3cyclictest2534-21phc2sys-jitter10:59:492
31883993213,3cyclictest2534-21phc2sys-jitter10:59:492
31883993212,4cyclictest24789-21diskmemload12:04:052
31883993212,3cyclictest24789-21diskmemload12:32:172
31883993212,3cyclictest1505-21runrttasks12:17:382
3188399321,17cyclictest0-21swapper/214:01:582
151891320,1ptp4l401ktimersoftd/312:24:403
151891320,1ptp4l401ktimersoftd/312:11:533
151891320,1ptp4l401ktimersoftd/312:05:333
151891320,10ptp4l401ktimersoftd/311:36:403
3188399313,9cyclictest1713-21apt-get12:39:422
3188399313,9cyclictest1713-21apt-get12:39:422
31883993113,3cyclictest24789-21diskmemload12:45:382
31883993113,3cyclictest24789-21diskmemload12:45:382
151891310,1ptp4l401ktimersoftd/311:23:163
151891310,1ptp4l401ktimersoftd/309:55:143
151891310,0ptp4l401ktimersoftd/313:58:403
3188399303,8cyclictest32672-21apt-get14:24:432
3188399300,2cyclictest121rcu_preempt15:04:312
31877993025,3cyclictest25-21ksoftirqd/113:59:291
31877993024,3cyclictest25-21ksoftirqd/114:19:301
151891300,1ptp4l401ktimersoftd/312:31:583
151891300,0ptp4l401ktimersoftd/310:09:133
3188399298,7cyclictest0-21swapper/213:58:382
3188399292,8cyclictest17977-21apt-get11:34:422
3188399292,3cyclictest27542cpu09:54:402
31883992913,3cyclictest24789-21diskmemload15:11:382
3187799294,19cyclictest25088-21kworker/u8:211:49:391
31872992922,4cyclictest9-21ksoftirqd/015:02:070
222702290,1sleep10-21swapper/113:01:391
3188399288,9cyclictest0-21swapper/211:55:102
31877992822,3cyclictest25-21ksoftirqd/114:34:441
31872992822,3cyclictest9-21ksoftirqd/009:52:520
31883992720,4cyclictest33-21ksoftirqd/211:42:592
31883992720,4cyclictest33-21ksoftirqd/210:45:542
31883992720,4cyclictest33-21ksoftirqd/209:53:592
31877992721,3cyclictest25-21ksoftirqd/115:14:491
31877992721,3cyclictest25-21ksoftirqd/112:22:201
31877992721,3cyclictest25-21ksoftirqd/110:55:571
250482270,4sleep125-21ksoftirqd/112:28:431
3188399264,3cyclictest121rcu_preempt14:06:332
31883992620,3cyclictest33-21ksoftirqd/210:00:242
31883992619,4cyclictest33-21ksoftirqd/212:25:352
31883992619,4cyclictest33-21ksoftirqd/210:06:402
3188399261,22cyclictest23942-21ssh13:04:372
3187799265,12cyclictest8562-21ssh13:59:441
31877992619,4cyclictest25-21ksoftirqd/110:49:141
31872992620,3cyclictest9-21ksoftirqd/011:09:040
31872992613,6cyclictest21009-21sshd11:39:470
315152260,2sleep00-21swapper/011:55:500
3188399253,3cyclictest121rcu_preempt13:19:592
31883992519,4cyclictest33-21ksoftirqd/214:36:562
31883992519,3cyclictest33-21ksoftirqd/211:08:202
31883992518,4cyclictest33-21ksoftirqd/211:19:222
31883992518,4cyclictest33-21ksoftirqd/210:31:172
3188399251,21cyclictest13247-21apt-get11:24:422
31883992512,10cyclictest29827-21snmp_o5powerctl13:09:562
31877992520,3cyclictest25-21ksoftirqd/114:09:301
31877992519,3cyclictest25-21ksoftirqd/114:11:151
31877992519,3cyclictest25-21ksoftirqd/111:16:441
31877992518,5cyclictest25-21ksoftirqd/112:45:591
31877992518,5cyclictest25-21ksoftirqd/112:45:591
31877992518,4cyclictest315-21tr14:24:441
31872992520,3cyclictest9-21ksoftirqd/013:49:300
31872992519,3cyclictest9-21ksoftirqd/011:17:100
31872992519,3cyclictest9-21ksoftirqd/010:52:300
151891250,1ptp4l401ktimersoftd/310:11:243
151891250,1ptp4l401ktimersoftd/309:53:263
31883992417,4cyclictest33-21ksoftirqd/212:21:372
31883992417,4cyclictest33-21ksoftirqd/211:47:332
31883992417,4cyclictest33-21ksoftirqd/210:59:112
31883992417,4cyclictest33-21ksoftirqd/210:40:242
31883992417,4cyclictest33-21ksoftirqd/210:37:312
3188399241,3cyclictest121rcu_preempt11:50:112
3188399241,20cyclictest18199-21ssh14:43:102
3188399241,20cyclictest10874-21apt-get11:19:362
3187799243,18cyclictest11311-21grep15:09:481
31877992419,3cyclictest25-21ksoftirqd/114:45:021
31877992419,3cyclictest25-21ksoftirqd/110:31:481
31877992418,4cyclictest25-21ksoftirqd/113:40:301
31877992418,3cyclictest25-21ksoftirqd/113:23:391
31877992418,3cyclictest25-21ksoftirqd/111:34:311
31877992417,4cyclictest25-21ksoftirqd/111:05:001
31877992417,4cyclictest25-21ksoftirqd/110:41:481
31877992417,4cyclictest25-21ksoftirqd/110:20:561
3187799240,2cyclictest121rcu_preempt09:54:531
31872992418,3cyclictest9-21ksoftirqd/012:37:520
31872992418,3cyclictest9-21ksoftirqd/010:16:170
178712240,2sleep10-21swapper/112:56:501
151891240,1ptp4l401ktimersoftd/314:40:093
151891240,1ptp4l401ktimersoftd/311:55:003
151891240,1ptp4l401ktimersoftd/311:04:403
151891240,1ptp4l401ktimersoftd/310:03:403
3188399231,5cyclictest21452-21users13:00:002
31877992317,4cyclictest25-21ksoftirqd/111:57:111
31877992317,4cyclictest25-21ksoftirqd/110:37:421
31877992317,3cyclictest25-21ksoftirqd/114:30:331
31877992317,3cyclictest25-21ksoftirqd/111:22:241
31877992316,4cyclictest25-21ksoftirqd/114:50:321
31877992316,4cyclictest25-21ksoftirqd/113:52:021
31877992316,4cyclictest25-21ksoftirqd/111:48:241
31877992316,4cyclictest18044-21needreboot10:24:451
31877992316,4cyclictest17206-21sh12:19:271
31877992312,8cyclictest13377-21cpuspeed_turbos11:24:431
3187299233,17cyclictest29591-21tail13:09:520
31872992317,3cyclictest9-21ksoftirqd/012:40:160
31872992317,3cyclictest9-21ksoftirqd/012:40:160
31872992317,3cyclictest9-21ksoftirqd/012:00:110
31872992317,3cyclictest9-21ksoftirqd/011:22:540
31872992317,3cyclictest10261-21irqstats12:09:460
31872992316,4cyclictest9-21ksoftirqd/010:20:030
31872992316,4cyclictest9-21ksoftirqd/010:04:050
3187299231,20cyclictest0-21swapper/012:26:430
3187299231,19cyclictest23444-21chrt10:35:160
31872992311,9cyclictest22989-21sh14:48:100
3187299231,18cyclictest15183-21taskset11:27:590
31883992215,4cyclictest33-21ksoftirqd/214:56:112
3188399221,4cyclictest10972-21df_inode12:49:432
3188399221,4cyclictest10972-21df_inode12:49:432
3188399221,3cyclictest29045-21apt-get10:49:392
31877992217,3cyclictest25-21ksoftirqd/113:48:331
31877992217,3cyclictest25-21ksoftirqd/112:00:001
31877992216,3cyclictest25-21ksoftirqd/111:41:491
31877992216,3cyclictest25-21ksoftirqd/111:12:351
31877992215,4cyclictest898-21cron14:59:311
3187299222,17cyclictest24466-21grep13:04:460
31872992216,3cyclictest9-21ksoftirqd/010:48:010
31872992216,3cyclictest9-21ksoftirqd/010:11:360
31872992216,3cyclictest9-21ksoftirqd/009:57:050
31872992215,4cyclictest9-21ksoftirqd/011:04:190
31872992215,4cyclictest9-21ksoftirqd/011:04:190
31872992215,4cyclictest9-21ksoftirqd/010:57:560
31872992215,4cyclictest8846-21snmp_o5powerctl10:04:520
31872992214,4cyclictest24605-21cat14:14:580
3187299221,19cyclictest27199-21ssh14:52:100
3187299221,19cyclictest0-21swapper/013:22:520
3187299221,18cyclictest17152-21snmp_o5powerctl15:14:590
3187299221,18cyclictest12131-21snmp_o5powerctl12:49:530
3187299221,18cyclictest12131-21snmp_o5powerctl12:49:530
31883992114,4cyclictest24789-21diskmemload12:09:112
31883992114,4cyclictest19410-21cat14:09:542
31883992114,4cyclictest12154-21/usr/sbin/munin10:14:402
3188399211,2cyclictest24789-21diskmemload14:18:222
31877992116,3cyclictest25-21ksoftirqd/113:17:221
31877992116,3cyclictest25-21ksoftirqd/113:09:441
31877992116,3cyclictest25-21ksoftirqd/112:52:341
31877992116,3cyclictest25-21ksoftirqd/112:52:341
31877992116,3cyclictest25-21ksoftirqd/111:33:471
31877992114,4cyclictest9614-21cut13:24:471
31877992114,4cyclictest7168-21sh12:05:161
31877992114,4cyclictest30301-21cut12:34:451
31877992114,4cyclictest25-21ksoftirqd/111:02:551
31877992114,4cyclictest25-21ksoftirqd/111:02:551
31877992114,4cyclictest25-21ksoftirqd/110:50:511
31877992114,4cyclictest11359-21sh12:10:251
31877992112,5cyclictest241ktimersoftd/112:29:411
31872992117,2cyclictest0-21swapper/013:49:590
31872992115,3cyclictest9-21ksoftirqd/014:10:040
31872992115,3cyclictest9-21ksoftirqd/013:35:550
31872992115,3cyclictest9-21ksoftirqd/010:26:310
31872992115,3cyclictest15065-21/usr/sbin/munin12:55:000
31872992114,4cyclictest27463-21unixbench_multi12:29:580
31872992114,4cyclictest26017-21sed11:49:460
31872992114,4cyclictest24983-21cut10:39:440
3187299211,3cyclictest24789-21diskmemload14:57:540
3187299211,17cyclictest18956-21memory11:34:500
3187299211,17cyclictest183312sleep014:43:240
3187299211,17cyclictest14386-21perl13:29:440
3187299211,17cyclictest0-21swapper/010:29:480
3187299210,18cyclictest4037-21runrttasks13:54:430
3187299210,18cyclictest24789-21diskmemload13:28:560
31877992015,3cyclictest25-21ksoftirqd/114:40:431
31877992014,4cyclictest23977-21/usr/sbin/munin13:04:521
31877992014,3cyclictest9203-21vmstat10:04:561
31877992014,3cyclictest2220-21sh12:39:461
31877992014,3cyclictest2220-21sh12:39:461
31877992014,3cyclictest15864-21sh13:30:021
31877992013,4cyclictest9853-21bc10:09:381
31877992013,4cyclictest9417-21sh15:07:371
31877992013,4cyclictest7302-21ls10:04:251
31877992013,4cyclictest3471-21sh15:00:331
31877992013,4cyclictest25-21ksoftirqd/109:49:331
31877992012,4cyclictest22781-21ls13:39:301
3187799200,2cyclictest0-21swapper/114:20:111
31872992016,2cyclictest0-21swapper/014:29:500
31872992015,3cyclictest9-21ksoftirqd/012:19:340
31872992014,3cyclictest8682-21sh15:06:180
31872992014,3cyclictest15774-21cat11:29:420
31872992014,3cyclictest13479-21/usr/sbin/munin12:14:450
31872992014,3cyclictest11799-21sh14:02:360
3187299201,3cyclictest1687-21snmp_o5powerctl14:24:560
31872992013,4cyclictest5162-21/usr/sbin/munin12:05:000
31872992013,4cyclictest21480-21sh13:00:020
3187299201,17cyclictest0-21swapper/014:09:250
31872991913,3cyclictest1163-21irqrtprio13:14:470
31872991912,4cyclictest10344-21if_enp1s0.114:34:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional