You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-04 - 02:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Thu Jul 03, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1518911040,4ptp4l401ktimersoftd/309:57:493
6897997864,6cyclictest33-21ksoftirqd/214:35:462
151891710,1ptp4l401ktimersoftd/312:44:283
151891680,1ptp4l401ktimersoftd/311:26:453
6897996352,6cyclictest33-21ksoftirqd/212:45:452
64542634,10sleep10-21swapper/109:56:101
307612630,2sleep20-21swapper/211:55:442
6897996248,7cyclictest33-21ksoftirqd/213:00:442
6897996231,3cyclictest33-21ksoftirqd/215:00:512
6897996129,7cyclictest33-21ksoftirqd/214:40:552
6897996049,5cyclictest33-21ksoftirqd/213:35:462
18972600,2sleep10-21swapper/114:37:231
6897995949,5cyclictest33-21ksoftirqd/211:50:422
151891590,1ptp4l401ktimersoftd/313:32:173
6897995817,5cyclictest33-21ksoftirqd/213:50:322
254532580,3sleep00-21swapper/013:49:000
66622574,41sleep00-21swapper/009:58:510
151891570,1ptp4l401ktimersoftd/313:11:503
151891560,1ptp4l401ktimersoftd/311:55:113
6897995532,3cyclictest33-21ksoftirqd/211:15:592
6893995413,7cyclictest25-21ksoftirqd/113:37:041
689399540,13cyclictest11102-21turbostat11:15:291
6897995344,4cyclictest33-21ksoftirqd/213:55:472
6897995344,4cyclictest33-21ksoftirqd/213:55:472
184692530,2sleep10-21swapper/114:18:521
689399526,8cyclictest32553-21latency_hist12:00:291
6893995114,7cyclictest25-21ksoftirqd/111:45:511
6897995042,4cyclictest33-21ksoftirqd/212:20:432
6897995029,3cyclictest33-21ksoftirqd/210:55:472
6897994942,4cyclictest33-21ksoftirqd/213:30:362
6897994932,3cyclictest33-21ksoftirqd/214:15:482
6897994816,16cyclictest33-21ksoftirqd/212:50:462
6893994819,8cyclictest25-21ksoftirqd/113:45:081
689399474,7cyclictest190702sleep113:01:191
6893994720,7cyclictest25-21ksoftirqd/112:50:491
6897994621,4cyclictest33-21ksoftirqd/215:15:542
689799460,3cyclictest33-21ksoftirqd/215:06:052
689399465,7cyclictest32442-21diskmemload14:26:011
6897994537,4cyclictest33-21ksoftirqd/212:15:342
6897994537,4cyclictest33-21ksoftirqd/212:15:342
6897994521,4cyclictest33-21ksoftirqd/215:10:512
6897994521,4cyclictest33-21ksoftirqd/214:10:572
6897994433,4cyclictest33-21ksoftirqd/212:25:552
6897994432,3cyclictest33-21ksoftirqd/213:20:322
6897994430,11cyclictest33-21ksoftirqd/210:05:282
6897994424,7cyclictest33-21ksoftirqd/212:55:452
6897994418,4cyclictest33-21ksoftirqd/211:30:492
6897994418,10cyclictest33-21ksoftirqd/213:50:482
6897994416,4cyclictest33-21ksoftirqd/211:05:502
689399449,5cyclictest25-21ksoftirqd/115:27:381
6893994418,9cyclictest25-21ksoftirqd/112:19:311
6893994418,9cyclictest25-21ksoftirqd/112:19:311
6897994325,6cyclictest33-21ksoftirqd/213:30:322
689399435,5cyclictest25-21ksoftirqd/113:15:531
689399434,5cyclictest25-21ksoftirqd/114:01:141
689399434,5cyclictest25-21ksoftirqd/114:01:141
6893994339,2cyclictest231rcuc/114:44:351
689399433,6cyclictest25-21ksoftirqd/115:20:501
6893994310,5cyclictest25-21ksoftirqd/110:55:591
6897994235,3cyclictest33-21ksoftirqd/212:10:412
6897994235,3cyclictest33-21ksoftirqd/212:10:412
6897994232,3cyclictest33-21ksoftirqd/214:35:332
6897994227,3cyclictest33-21ksoftirqd/213:40:572
6897994219,4cyclictest33-21ksoftirqd/210:36:062
6897994217,4cyclictest33-21ksoftirqd/214:59:252
689399425,5cyclictest25-21ksoftirqd/113:10:501
689399424,6cyclictest25-21ksoftirqd/112:58:181
689399424,5cyclictest25-21ksoftirqd/113:45:471
689399423,5cyclictest25-21ksoftirqd/113:55:321
689399423,5cyclictest25-21ksoftirqd/113:20:571
6893994217,7cyclictest25-21ksoftirqd/115:11:181
6897994131,3cyclictest33-21ksoftirqd/210:25:502
6897994131,3cyclictest33-21ksoftirqd/210:25:502
6897994119,19cyclictest33-21ksoftirqd/214:05:532
6897994118,7cyclictest33-21ksoftirqd/213:15:322
6897994116,9cyclictest33-21ksoftirqd/214:55:112
6897994116,4cyclictest33-21ksoftirqd/212:05:462
689399414,5cyclictest25-21ksoftirqd/112:07:251
689399414,5cyclictest25-21ksoftirqd/110:45:421
689399413,6cyclictest25-21ksoftirqd/112:13:261
689399413,6cyclictest25-21ksoftirqd/112:13:261
689399413,5cyclictest25-21ksoftirqd/115:17:161
689399413,5cyclictest25-21ksoftirqd/114:53:491
689399413,5cyclictest25-21ksoftirqd/114:30:581
689399413,5cyclictest25-21ksoftirqd/114:07:051
689399412,6cyclictest17489-21fschecks_count14:55:541
151891410,1ptp4l401ktimersoftd/310:35:513
96772400,2sleep30-21swapper/312:10:503
96772400,2sleep30-21swapper/312:10:503
6897994030,3cyclictest33-21ksoftirqd/212:31:142
6897994021,8cyclictest33-21ksoftirqd/210:05:272
6897994018,4cyclictest33-21ksoftirqd/210:45:572
6897994016,4cyclictest33-21ksoftirqd/212:44:532
6897994011,8cyclictest33-21ksoftirqd/215:27:452
689399405,5cyclictest25-21ksoftirqd/111:00:421
689399404,5cyclictest25-21ksoftirqd/110:30:571
689399404,10cyclictest25-21ksoftirqd/112:30:501
689399403,6cyclictest25-21ksoftirqd/115:05:521
689399403,5cyclictest25-21ksoftirqd/113:57:591
689399403,5cyclictest25-21ksoftirqd/113:57:591
689399401,7cyclictest25-21ksoftirqd/112:45:461
151891400,1ptp4l401ktimersoftd/314:36:373
151891400,1ptp4l401ktimersoftd/313:25:583
151891400,0ptp4l401ktimersoftd/312:51:233
6897993934,2cyclictest321ktimersoftd/214:00:462
6897993934,2cyclictest321ktimersoftd/214:00:462
6897993929,3cyclictest33-21ksoftirqd/211:20:442
6897993916,4cyclictest33-21ksoftirqd/213:20:572
6897993914,4cyclictest33-21ksoftirqd/212:39:282
689399393,6cyclictest25-21ksoftirqd/114:23:071
689399393,5cyclictest25-21ksoftirqd/113:28:201
689399393,5cyclictest25-21ksoftirqd/112:26:221
151891390,1ptp4l401ktimersoftd/314:31:003
151891390,1ptp4l401ktimersoftd/312:20:593
151891390,16ptp4l401ktimersoftd/311:15:213
6897993824,5cyclictest33-21ksoftirqd/211:15:292
6897993820,10cyclictest33-21ksoftirqd/212:01:042
6897993814,4cyclictest33-21ksoftirqd/210:20:512
689399387,6cyclictest25-21ksoftirqd/110:10:471
689399385,5cyclictest25-21ksoftirqd/112:35:551
689399384,5cyclictest25-21ksoftirqd/114:13:581
689399383,6cyclictest25-21ksoftirqd/115:03:141
689399383,5cyclictest25-21ksoftirqd/114:45:581
689399383,5cyclictest25-21ksoftirqd/113:07:581
689399383,5cyclictest25-21ksoftirqd/110:39:511
689399383,5cyclictest25-21ksoftirqd/110:25:341
689399383,5cyclictest25-21ksoftirqd/110:25:341
151891380,1ptp4l401ktimersoftd/314:30:103
151891380,1ptp4l401ktimersoftd/312:56:403
6897993731,3cyclictest33-21ksoftirqd/214:25:482
6897993730,4cyclictest33-21ksoftirqd/215:25:342
6897993721,4cyclictest33-21ksoftirqd/214:20:572
6897993720,4cyclictest33-21ksoftirqd/210:40:532
6897993719,8cyclictest33-21ksoftirqd/211:00:402
6897993718,9cyclictest33-21ksoftirqd/213:07:422
6897993718,10cyclictest33-21ksoftirqd/210:50:402
689399379,5cyclictest25-21ksoftirqd/111:29:481
689399374,5cyclictest25-21ksoftirqd/112:44:101
689399372,5cyclictest25-21ksoftirqd/111:35:551
151891370,1ptp4l401ktimersoftd/315:10:553
151891370,1ptp4l401ktimersoftd/314:45:553
151891370,1ptp4l401ktimersoftd/314:24:513
151891370,1ptp4l401ktimersoftd/314:11:423
151891370,1ptp4l401ktimersoftd/312:27:163
151891370,1ptp4l401ktimersoftd/311:46:193
151891370,12ptp4l401ktimersoftd/310:10:313
6897993630,3cyclictest33-21ksoftirqd/214:50:342
6897993626,3cyclictest33-21ksoftirqd/211:50:292
6897993624,3cyclictest33-21ksoftirqd/210:15:392
6897993623,10cyclictest33-21ksoftirqd/211:35:492
6897993611,4cyclictest33-21ksoftirqd/210:30:502
689399363,5cyclictest25-21ksoftirqd/111:24:471
689399363,5cyclictest25-21ksoftirqd/110:06:071
689399362,5cyclictest25-21ksoftirqd/110:40:501
689399360,6cyclictest25-21ksoftirqd/111:05:461
151891360,1ptp4l401ktimersoftd/315:05:023
151891360,1ptp4l11640-21kworker/3:113:24:393
151891360,0ptp4l401ktimersoftd/314:42:293
689399353,6cyclictest25-21ksoftirqd/112:02:241
689399352,4cyclictest25-21ksoftirqd/113:30:521
151891350,13ptp4l401ktimersoftd/314:16:093
6897993420,5cyclictest33-21ksoftirqd/210:10:562
689799341,4cyclictest121rcu_preempt11:40:522
689399344,5cyclictest25-21ksoftirqd/111:18:511
151891340,1ptp4l401ktimersoftd/315:20:343
151891340,1ptp4l401ktimersoftd/314:52:083
151891340,1ptp4l401ktimersoftd/314:08:403
151891340,1ptp4l401ktimersoftd/314:01:213
151891340,1ptp4l401ktimersoftd/314:01:213
151891340,1ptp4l401ktimersoftd/314:00:283
151891340,1ptp4l401ktimersoftd/314:00:283
151891340,1ptp4l401ktimersoftd/313:50:343
151891340,1ptp4l401ktimersoftd/313:35:473
151891340,1ptp4l401ktimersoftd/313:16:123
151891340,1ptp4l401ktimersoftd/310:35:273
151891340,1ptp4l401ktimersoftd/310:27:233
151891340,1ptp4l401ktimersoftd/310:27:233
151891340,0ptp4l401ktimersoftd/312:09:083
6897993327,3cyclictest33-21ksoftirqd/211:25:462
689399332,5cyclictest25-21ksoftirqd/112:21:561
151891330,1ptp4l401ktimersoftd/315:06:463
151891330,1ptp4l401ktimersoftd/314:57:443
151891330,1ptp4l401ktimersoftd/313:00:453
151891330,1ptp4l13714-21kworker/3:012:18:413
151891330,1ptp4l13714-21kworker/3:012:18:413
151891330,11ptp4l401ktimersoftd/315:28:343
6893993216,8cyclictest25-21ksoftirqd/110:20:491
162432320,5sleep1689399cyclictest10:15:461
151891320,1ptp4l401ktimersoftd/313:08:333
151891320,1ptp4l401ktimersoftd/312:39:133
151891320,1ptp4l401ktimersoftd/312:33:203
151891320,1ptp4l401ktimersoftd/310:22:203
151891310,1ptp4l401ktimersoftd/313:47:453
151891310,1ptp4l401ktimersoftd/312:02:353
151891310,1ptp4l401ktimersoftd/311:09:493
151891310,0ptp4l401ktimersoftd/312:47:593
151891310,0ptp4l401ktimersoftd/311:33:083
689399303,5cyclictest25-21ksoftirqd/110:00:461
689399302,5cyclictest25-21ksoftirqd/111:50:591
688699303,15cyclictest47350irq/99-ens3-TxR15:15:450
151891300,1ptp4l401ktimersoftd/311:22:323
151891300,0ptp4l401ktimersoftd/310:46:293
6886992916,6cyclictest9-21ksoftirqd/014:30:460
46702295,10sleep20-21swapper/209:55:432
151891290,9ptp4l401ktimersoftd/310:44:443
151891290,1ptp4l401ktimersoftd/313:44:583
151891290,1ptp4l401ktimersoftd/311:00:213
151891290,1ptp4l401ktimersoftd/310:08:113
6893992815,4cyclictest25-21ksoftirqd/111:30:591
6886992821,4cyclictest9-21ksoftirqd/010:29:300
6886992821,4cyclictest9-21ksoftirqd/010:29:300
151891280,1ptp4l401ktimersoftd/311:03:383
6906992720,4cyclictest41-21ksoftirqd/311:56:333
6906992720,4cyclictest41-21ksoftirqd/310:18:213
6893992720,4cyclictest25-21ksoftirqd/110:50:591
6893992710,6cyclictest25-21ksoftirqd/111:44:501
6886992720,4cyclictest9-21ksoftirqd/011:16:520
688699271,21cyclictest0-21swapper/013:50:460
6886992620,3cyclictest9-21ksoftirqd/011:31:270
6886992619,4cyclictest9-21ksoftirqd/011:24:590
6886992619,4cyclictest9-21ksoftirqd/010:22:120
6886992619,4cyclictest9-21ksoftirqd/010:07:020
6886992619,4cyclictest9-21ksoftirqd/010:04:570
30512260,5sleep0688699cyclictest12:43:230
151891260,1ptp4l401ktimersoftd/311:37:183
151891260,11ptp4l401ktimersoftd/311:43:543
151891260,0ptp4l401ktimersoftd/311:19:343
6906992518,4cyclictest41-21ksoftirqd/310:02:073
6886992519,3cyclictest9-21ksoftirqd/013:59:030
6886992519,3cyclictest9-21ksoftirqd/013:59:030
6886992518,4cyclictest9-21ksoftirqd/011:41:290
6886992518,4cyclictest9-21ksoftirqd/011:08:330
6886992518,4cyclictest9-21ksoftirqd/010:51:100
181242251,2sleep00-21swapper/014:18:030
688699246,9cyclictest21746-21ssh15:00:470
6886992418,3cyclictest9-21ksoftirqd/014:22:500
6886992418,3cyclictest9-21ksoftirqd/011:04:430
6886992417,4cyclictest9-21ksoftirqd/014:45:480
6886992417,4cyclictest9-21ksoftirqd/014:44:320
6886992417,4cyclictest9-21ksoftirqd/013:39:440
6886992417,4cyclictest10261-21/usr/sbin/munin13:30:440
688699241,3cyclictest121rcu_preempt11:57:070
151891240,1ptp4l401ktimersoftd/315:21:063
1347522417,3sleep09-21ksoftirqd/010:10:450
688699234,9cyclictest0-21swapper/013:15:460
6886992318,3cyclictest9-21ksoftirqd/012:35:510
6886992317,3cyclictest9-21ksoftirqd/015:27:400
6886992317,3cyclictest9-21ksoftirqd/015:09:220
6886992317,3cyclictest9-21ksoftirqd/011:40:080
6886992317,3cyclictest9-21ksoftirqd/011:13:330
6886992316,4cyclictest9-21ksoftirqd/010:47:570
6886992316,4cyclictest9-21ksoftirqd/010:38:580
6886992315,5cyclictest47350irq/99-ens3-TxR13:25:440
6886992310,3cyclictest13375-21gltestperf14:50:500
151891230,0ptp4l401ktimersoftd/310:50:383
6886992216,3cyclictest9-21ksoftirqd/012:27:290
6886992216,3cyclictest9-21ksoftirqd/010:17:290
6886992215,4cyclictest9-21ksoftirqd/012:31:010
6886992215,4cyclictest9-21ksoftirqd/012:10:350
6886992215,4cyclictest9-21ksoftirqd/012:10:350
6886992215,4cyclictest9-21ksoftirqd/010:34:280
688699221,4cyclictest18560-21snmp_o5powerctl14:56:020
688699221,3cyclictest7864-21ssh12:09:550
688699221,3cyclictest1916-21apt-get10:55:410
688699221,18cyclictest6284-21sshd12:46:090
688699221,18cyclictest12521-21apt-get12:15:430
688699221,18cyclictest12521-21apt-get12:15:430
688699221,18cyclictest0-21swapper/013:14:140
688699221,17cyclictest18192-21cron11:30:290
6886992210,9cyclictest101ktimersoftd/015:14:230
6886992114,4cyclictest8804-21sh14:07:050
6886992114,4cyclictest26698-21sh14:29:170
6886992114,4cyclictest25870-21sh11:45:440
6886992114,4cyclictest20012-21sh12:25:280
6886992114,4cyclictest15858-21sh12:58:300
688699211,3cyclictest9729-21snmp_o5powerctl15:21:030
688699211,2cyclictest0-21swapper/011:50:560
6886992112,5cyclictest3472-21needreboot14:00:550
6886992112,5cyclictest3472-21needreboot14:00:550
688699211,18cyclictest0-21swapper/014:13:170
688699211,18cyclictest0-21swapper/012:50:460
6886992014,3cyclictest3047-21sendmail_mailst13:20:570
6886992013,4cyclictest9-21ksoftirqd/010:41:470
6886992013,4cyclictest855-21wc14:36:020
6886992013,4cyclictest19562-21sh13:02:250
688699201,17cyclictest0-21swapper/012:00:320
688699200,3cyclictest23118-21ssh13:06:120
688699200,17cyclictest18467-21df13:40:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional