You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 07:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Sun Nov 16, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2115321420,3sleep0337699cyclictest23:16:470
1501821390,5sleep0337699cyclictest23:45:170
1773911200,8ptp4l21546-21kworker/3:120:09:543
3395998470,6cyclictest41-21ksoftirqd/300:09:113
55972700,1sleep30-21swapper/322:23:593
3395996756,5cyclictest41-21ksoftirqd/300:44:143
19652670,2sleep10-21swapper/120:09:171
200762660,2sleep00-21swapper/020:44:190
3395996451,7cyclictest41-21ksoftirqd/321:04:083
31392604,44sleep00-21swapper/020:12:120
3395995944,8cyclictest41-21ksoftirqd/300:39:143
177391590,1ptp4l401ktimersoftd/323:50:013
3395995846,6cyclictest41-21ksoftirqd/301:29:163
177391580,1ptp4l401ktimersoftd/323:06:573
3383995621,11cyclictest25-21ksoftirqd/101:34:351
337699564,26cyclictest17671-21sed01:39:240
296302560,2sleep30-21swapper/322:14:113
177391560,1ptp4l401ktimersoftd/322:26:463
3395995446,4cyclictest41-21ksoftirqd/323:09:113
3383995427,7cyclictest25-21ksoftirqd/100:39:001
337699545,25cyclictest5269-21sed20:14:260
3395995343,5cyclictest41-21ksoftirqd/321:14:113
3395995341,6cyclictest41-21ksoftirqd/323:59:163
3395995340,7cyclictest41-21ksoftirqd/320:44:113
177391530,2ptp4l25145-21kworker/3:101:35:023
3383995226,4cyclictest25-21ksoftirqd/123:29:181
3383995220,7cyclictest25-21ksoftirqd/122:14:101
3383995126,4cyclictest25-21ksoftirqd/100:29:241
3383995025,4cyclictest25-21ksoftirqd/121:14:271
3383994936,4cyclictest25-21ksoftirqd/121:13:561
3383994936,3cyclictest25-21ksoftirqd/122:59:141
3383994925,7cyclictest25-21ksoftirqd/120:44:221
3383994924,4cyclictest25-21ksoftirqd/121:19:151
3383994924,4cyclictest25-21ksoftirqd/101:15:381
3383994921,5cyclictest25-21ksoftirqd/122:49:161
3383994917,8cyclictest25-21ksoftirqd/100:39:221
177391490,1ptp4l401ktimersoftd/323:03:103
3383994827,3cyclictest25-21ksoftirqd/123:24:241
3383994827,3cyclictest25-21ksoftirqd/123:24:241
3383994826,6cyclictest25-21ksoftirqd/122:04:271
3383994824,4cyclictest25-21ksoftirqd/122:44:491
3383994824,4cyclictest25-21ksoftirqd/122:35:111
3383994824,4cyclictest25-21ksoftirqd/121:44:131
3383994824,4cyclictest25-21ksoftirqd/101:05:331
3383994824,4cyclictest25-21ksoftirqd/101:05:331
3383994823,10cyclictest25-21ksoftirqd/101:09:501
3383994823,10cyclictest25-21ksoftirqd/101:09:501
3383994819,4cyclictest25-21ksoftirqd/101:34:021
337699480,3cyclictest13964-21ssh00:19:320
3383994741,3cyclictest25-21ksoftirqd/120:13:591
3383994719,5cyclictest25-21ksoftirqd/123:39:241
3383994717,9cyclictest25-21ksoftirqd/100:44:311
3383994717,5cyclictest25-21ksoftirqd/122:19:181
3383994716,11cyclictest25-21ksoftirqd/122:33:581
3383994714,8cyclictest25-21ksoftirqd/122:39:201
337699470,2cyclictest0-21swapper/022:19:180
248002470,3sleep20-21swapper/220:54:172
3383994637,4cyclictest25-21ksoftirqd/100:04:131
3383994619,4cyclictest25-21ksoftirqd/123:59:001
3383994619,4cyclictest25-21ksoftirqd/123:14:161
3383994617,4cyclictest25-21ksoftirqd/100:19:011
337699467,28cyclictest10910-21switchtime20:24:230
176191460,4getstats339599cyclictest21:29:313
176191460,4getstats339599cyclictest21:29:313
338399458,3cyclictest25-21ksoftirqd/101:24:541
338399457,7cyclictest25-21ksoftirqd/123:59:201
338399456,7cyclictest25-21ksoftirqd/100:49:321
3383994534,3cyclictest25-21ksoftirqd/123:49:161
3383994533,3cyclictest25-21ksoftirqd/120:29:161
3383994521,7cyclictest25-21ksoftirqd/100:09:211
3383994521,4cyclictest25-21ksoftirqd/123:35:141
3383994520,4cyclictest25-21ksoftirqd/122:09:131
3383994519,7cyclictest25-21ksoftirqd/120:34:261
3383994519,4cyclictest25-21ksoftirqd/100:24:211
3383994518,7cyclictest25-21ksoftirqd/122:54:291
3383994517,15cyclictest25-21ksoftirqd/120:54:131
3395994434,4cyclictest41-21ksoftirqd/322:29:103
3395994430,5cyclictest41-21ksoftirqd/300:19:133
338399448,3cyclictest25-21ksoftirqd/121:49:221
338399446,7cyclictest25-21ksoftirqd/120:28:551
3383994431,4cyclictest25-21ksoftirqd/121:29:191
3383994431,4cyclictest25-21ksoftirqd/121:29:191
3383994422,7cyclictest25-21ksoftirqd/123:09:201
3383994418,5cyclictest25-21ksoftirqd/121:39:191
3383994416,4cyclictest25-21ksoftirqd/121:54:151
337699445,24cyclictest26206-21unixbench_singl22:04:270
337699442,34cyclictest24548-21apt-get01:09:150
337699442,34cyclictest24548-21apt-get01:09:150
337699442,22cyclictest0-21swapper/023:34:140
177391440,2ptp4l21546-21kworker/3:123:56:113
3395994333,5cyclictest41-21ksoftirqd/321:49:133
338399436,4cyclictest25-21ksoftirqd/120:39:151
3383994336,4cyclictest25-21ksoftirqd/101:39:161
338399433,3cyclictest121rcu_preempt23:19:201
338399433,3cyclictest121rcu_preempt23:19:201
3383994320,3cyclictest25-21ksoftirqd/122:25:301
3376994310,21cyclictest28973-21diskmemload23:33:200
3395994234,4cyclictest41-21ksoftirqd/322:54:113
3388994233,5cyclictest3291-21latency_hist20:13:552
338399426,7cyclictest25-21ksoftirqd/100:54:131
338399424,6cyclictest25-21ksoftirqd/101:04:011
3383994232,3cyclictest25-21ksoftirqd/120:49:261
3383994231,3cyclictest25-21ksoftirqd/121:24:121
3383994217,4cyclictest25-21ksoftirqd/101:19:221
337699423,33cyclictest0-21swapper/021:09:090
337699422,32cyclictest508-21apt-get01:19:170
3376994222,17cyclictest9-21ksoftirqd/021:31:160
3376994222,17cyclictest9-21ksoftirqd/021:31:160
3395994129,6cyclictest41-21ksoftirqd/301:24:153
3388994119,13cyclictest47050irq/102-ens3-Tx23:19:112
3388994119,13cyclictest47050irq/102-ens3-Tx23:19:112
338399417,9cyclictest25-21ksoftirqd/100:19:131
3383994132,5cyclictest25-21ksoftirqd/121:34:141
3383994126,7cyclictest25-21ksoftirqd/120:18:591
3383994117,8cyclictest25-21ksoftirqd/123:44:141
337699413,30cyclictest22154-21apt-get21:59:140
338399405,7cyclictest25-21ksoftirqd/123:04:171
337699402,32cyclictest4624-21apt-get22:59:130
337699402,31cyclictest25479-21apt-get00:34:140
337699402,30cyclictest7095-21apt-get20:19:110
337699400,3cyclictest27313-21/usr/sbin/munin23:24:140
337699400,3cyclictest27313-21/usr/sbin/munin23:24:140
337699400,3cyclictest0-21swapper/020:49:120
177391400,1ptp4l401ktimersoftd/322:36:273
177391400,0ptp4l401ktimersoftd/300:36:293
3395993929,4cyclictest41-21ksoftirqd/320:49:103
338399394,4cyclictest25-21ksoftirqd/121:04:061
3383993915,8cyclictest25-21ksoftirqd/121:59:181
337699393,31cyclictest0-21swapper/001:14:180
337699390,3cyclictest2413-21fschecks_count00:44:170
177391390,0ptp4l401ktimersoftd/321:59:213
3395993829,4cyclictest41-21ksoftirqd/300:54:143
3395993828,5cyclictest41-21ksoftirqd/322:09:113
3383993820,9cyclictest25-21ksoftirqd/121:03:551
337699380,5cyclictest10287-21apt-get22:29:100
337699380,3cyclictest7033-21diskmemload00:14:000
337699380,3cyclictest14869-21date21:43:570
177391380,1ptp4l401ktimersoftd/323:39:273
177391380,1ptp4l401ktimersoftd/301:40:403
177391380,1ptp4l401ktimersoftd/300:59:343
339599373,4cyclictest41-21ksoftirqd/320:28:563
3395993731,3cyclictest41-21ksoftirqd/323:18:593
337699373,30cyclictest0-21swapper/022:44:130
337699372,29cyclictest15058-21apt-get21:44:110
3376993714,19cyclictest1760-21runrttasks23:40:080
3376993713,21cyclictest14463-21sed01:34:370
337699371,29cyclictest16621-21apt-get20:39:100
337699370,4cyclictest9915-21munin-run22:28:580
337699370,4cyclictest8611-21wc01:29:020
337699370,4cyclictest21579-21seq21:55:410
337699370,4cyclictest20194-21fschecks_time01:04:180
337699370,4cyclictest20194-21fschecks_time01:04:180
337699370,4cyclictest19568-21sed21:53:570
337699370,3cyclictest12197-21cut20:29:150
337699370,3cyclictest0-21swapper/000:59:130
226832370,5sleep322676-21apt-get23:19:113
226832370,5sleep322676-21apt-get23:19:113
177391370,1ptp4l401ktimersoftd/323:33:423
177391370,1ptp4l401ktimersoftd/323:25:363
177391370,1ptp4l401ktimersoftd/323:25:363
177391370,1ptp4l401ktimersoftd/321:09:203
177391370,1ptp4l401ktimersoftd/301:22:193
177391370,1ptp4l401ktimersoftd/301:15:263
177391370,1ptp4l401ktimersoftd/300:17:503
177391370,0ptp4l401ktimersoftd/300:05:573
115042370,4sleep09-21ksoftirqd/001:31:410
3395993631,3cyclictest41-21ksoftirqd/301:09:063
3395993631,3cyclictest41-21ksoftirqd/301:09:063
3395993630,3cyclictest41-21ksoftirqd/321:03:553
3395993630,3cyclictest41-21ksoftirqd/320:29:163
337699362,28cyclictest10308-21apt-get21:34:150
3376993614,19cyclictest26574-21sed20:59:160
3376993611,22cyclictest23727-21bc20:54:080
337699360,5cyclictest15587-21python20:34:190
337699360,4cyclictest8965-21mailstats00:14:240
337699360,4cyclictest25934-21ssh23:22:150
337699360,4cyclictest25934-21ssh23:22:150
337699360,4cyclictest10599-21snmp_o5powerctl23:04:270
337699360,3cyclictest32100-21chrt22:53:550
337699360,3cyclictest28973-21diskmemload22:41:500
337699360,3cyclictest16579-21/usr/sbin/munin00:24:250
337699360,2cyclictest0-21swapper/023:49:200
177391360,1ptp4l401ktimersoftd/323:48:203
177391360,1ptp4l401ktimersoftd/322:49:453
177391360,1ptp4l401ktimersoftd/300:27:373
177391360,0ptp4l401ktimersoftd/300:51:523
3395993530,3cyclictest41-21ksoftirqd/300:29:233
3395993529,3cyclictest41-21ksoftirqd/321:34:173
339599350,3cyclictest121rcu_preempt01:06:033
339599350,3cyclictest121rcu_preempt01:06:033
337699357,25cyclictest27083-21expr22:09:120
3376993512,20cyclictest3096-21/usr/sbin/munin21:19:270
337699350,5cyclictest16161-21snmp_o5powerctl22:34:260
337699350,4cyclictest8584-21chrt00:49:490
337699350,3cyclictest23388-21timerandwakeup23:54:320
177391350,12ptp4l401ktimersoftd/322:47:103
339599342,8cyclictest41-21ksoftirqd/321:24:173
3395993428,3cyclictest41-21ksoftirqd/320:18:583
3388993426,5cyclictest33-21ksoftirqd/222:13:572
337699347,24cyclictest29978-21cpu00:39:160
337699347,23cyclictest733-21acpi21:14:100
337699343,25cyclictest21113-21apt-get00:29:180
337699342,27cyclictest30796-21apt-get00:04:130
3376993410,21cyclictest28973-21diskmemload00:55:550
337699340,2cyclictest305042sleep021:08:320
177391340,1ptp4l401ktimersoftd/323:34:043
177391340,11ptp4l401ktimersoftd/320:54:203
3395993327,3cyclictest41-21ksoftirqd/322:43:583
3395993327,3cyclictest41-21ksoftirqd/320:34:253
337699338,22cyclictest30846-21switchtime22:14:240
337699337,23cyclictest797-21interrupts22:54:190
337699337,22cyclictest6224-21irqrtprio21:24:170
3376993313,17cyclictest1760-21runrttasks23:12:280
177391330,0ptp4l401ktimersoftd/321:39:293
339599326,4cyclictest41-21ksoftirqd/321:44:163
3395993226,4cyclictest41-21ksoftirqd/320:18:553
3388993225,4cyclictest30543-21sh21:08:552
337699323,26cyclictest26429-21cut23:59:170
177391320,1ptp4l401ktimersoftd/321:21:453
3388993126,3cyclictest33-21ksoftirqd/200:44:002
3388993119,9cyclictest33-21ksoftirqd/221:10:312
177391310,0ptp4l401ktimersoftd/320:41:533
3388993023,4cyclictest33-21ksoftirqd/220:49:072
3395992926,2cyclictest41-21ksoftirqd/322:08:573
3388992923,3cyclictest33-21ksoftirqd/221:19:542
122852290,4sleep233-21ksoftirqd/222:29:482
3395992824,3cyclictest41-21ksoftirqd/321:58:573
3388992823,3cyclictest33-21ksoftirqd/220:23:552
3388992821,4cyclictest33-21ksoftirqd/220:37:552
3388992821,4cyclictest33-21ksoftirqd/201:01:562
64902270,5sleep2338899cyclictest23:36:082
3388992720,4cyclictest33-21ksoftirqd/201:31:512
3388992621,3cyclictest33-21ksoftirqd/200:04:202
3388992620,4cyclictest33-21ksoftirqd/200:37:032
3388992620,3cyclictest33-21ksoftirqd/221:50:582
3388992620,3cyclictest33-21ksoftirqd/221:39:442
3388992620,3cyclictest33-21ksoftirqd/221:31:062
3388992620,3cyclictest33-21ksoftirqd/221:31:062
3388992620,3cyclictest33-21ksoftirqd/200:13:432
3388992619,4cyclictest33-21ksoftirqd/220:27:272
39622250,4sleep2321ktimersoftd/201:23:072
3388992519,3cyclictest33-21ksoftirqd/220:46:302
3388992518,4cyclictest30052-21ps22:14:152
338899243,13cyclictest7618-21ssh00:14:132
3388992418,4cyclictest33-21ksoftirqd/223:50:092
3388992418,4cyclictest33-21ksoftirqd/220:30:202
3388992418,4cyclictest33-21ksoftirqd/200:45:102
3388992418,3cyclictest33-21ksoftirqd/220:43:562
3388992417,4cyclictest6173-21snmp_o5powerctl01:24:272
3388992417,4cyclictest33-21ksoftirqd/223:03:242
3388992417,4cyclictest33-21ksoftirqd/222:21:332
3388992417,4cyclictest33-21ksoftirqd/221:44:552
3388992318,3cyclictest33-21ksoftirqd/222:52:342
3388992318,3cyclictest33-21ksoftirqd/221:35:362
3388992317,3cyclictest33-21ksoftirqd/222:25:452
3388992317,3cyclictest33-21ksoftirqd/222:03:382
3388992317,3cyclictest33-21ksoftirqd/221:18:042
3388992317,3cyclictest3289-21apt-get20:13:572
3388992317,3cyclictest20729-21grep21:54:182
3388992316,4cyclictest33-21ksoftirqd/201:43:272
338899231,19cyclictest8056-21snmp_o5powerctl00:49:292
3388992217,3cyclictest33-21ksoftirqd/221:24:412
3388992216,3cyclictest33-21ksoftirqd/201:09:442
3388992216,3cyclictest33-21ksoftirqd/201:09:442
3388992215,4cyclictest33-21ksoftirqd/222:08:322
3388992215,4cyclictest33-21ksoftirqd/201:14:202
338899221,4cyclictest23975-21sed01:09:012
338899221,4cyclictest23975-21sed01:09:012
3388992212,7cyclictest24585-21sh00:33:002
338899221,18cyclictest603-21hddtemp_smartct22:54:162
338899219,3cyclictest11682-21sh23:05:532
3388992115,3cyclictest33-21ksoftirqd/223:54:232
3388992115,3cyclictest33-21ksoftirqd/200:26:472
3388992115,3cyclictest32221-21grep23:29:172
338899211,3cyclictest14300-21snmp_o5powerctl01:34:342
338899211,3cyclictest0-21swapper/223:14:452
3388992015,3cyclictest33-21ksoftirqd/222:34:582
3388992013,4cyclictest27552-21sh23:24:172
3388992013,4cyclictest27552-21sh23:24:172
338899201,17cyclictest0-21swapper/223:59:102
338899201,17cyclictest0-21swapper/223:44:152
338899201,17cyclictest0-21swapper/223:13:212
338899201,17cyclictest0-21swapper/200:54:492
338899201,16cyclictest21080-21ssh22:39:382
338899201,11cyclictest8359-21rm23:39:132
3388991913,3cyclictest23459-21ssh22:44:002
3388991911,5cyclictest13167-21ssh00:19:222
338899181,4cyclictest28299-21latency_hist21:03:562
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional