You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-15 - 01:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Mon Oct 14, 2024 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1518911060,39ptp4l401ktimersoftd/307:31:023
19525996957,6cyclictest41-21ksoftirqd/310:25:373
172292654,10sleep10-21swapper/107:30:231
19525996453,6cyclictest41-21ksoftirqd/308:40:363
315792630,4sleep341-21ksoftirqd/312:20:413
230892600,2sleep20-21swapper/211:37:002
65762580,3sleep233-21ksoftirqd/210:44:492
19525995849,4cyclictest41-21ksoftirqd/307:50:343
19525995848,5cyclictest41-21ksoftirqd/308:05:323
208532570,2sleep10-21swapper/112:09:231
151891570,1ptp4l401ktimersoftd/311:12:283
193362564,40sleep00-21swapper/007:34:260
151891560,1ptp4l401ktimersoftd/312:15:543
151891560,1ptp4l401ktimersoftd/310:22:013
289362540,1sleep10-21swapper/109:00:421
151891540,1ptp4l401ktimersoftd/311:10:073
19525995328,7cyclictest41-21ksoftirqd/312:45:293
19525995226,14cyclictest41-21ksoftirqd/308:35:463
19525995024,4cyclictest41-21ksoftirqd/310:50:483
19525995024,4cyclictest41-21ksoftirqd/308:15:543
19525995021,16cyclictest41-21ksoftirqd/308:25:513
1952599500,3cyclictest121rcu_preempt10:05:473
193132504,35sleep20-21swapper/207:34:082
19525994930,3cyclictest41-21ksoftirqd/310:55:443
19525994926,12cyclictest41-21ksoftirqd/311:15:473
19525994921,9cyclictest41-21ksoftirqd/307:50:223
19525994918,7cyclictest41-21ksoftirqd/310:44:113
1952599486,3cyclictest41-21ksoftirqd/310:40:263
19525994824,4cyclictest41-21ksoftirqd/311:50:573
19525994823,4cyclictest41-21ksoftirqd/312:07:353
19525994820,4cyclictest41-21ksoftirqd/310:30:543
19525994739,4cyclictest41-21ksoftirqd/308:00:333
19525994726,7cyclictest41-21ksoftirqd/312:45:413
19525994722,9cyclictest41-21ksoftirqd/309:30:403
19525994718,4cyclictest41-21ksoftirqd/313:00:543
19525994717,8cyclictest41-21ksoftirqd/311:26:083
19525994717,8cyclictest41-21ksoftirqd/309:55:443
19525994717,8cyclictest41-21ksoftirqd/309:55:443
19525994639,3cyclictest41-21ksoftirqd/309:15:293
19525994634,3cyclictest41-21ksoftirqd/311:55:473
19525994622,4cyclictest41-21ksoftirqd/312:01:203
19525994622,4cyclictest41-21ksoftirqd/311:40:563
19525994621,4cyclictest41-21ksoftirqd/312:29:113
19525994619,10cyclictest41-21ksoftirqd/312:35:153
13402460,1sleep10-21swapper/109:10:421
1952599455,3cyclictest41-21ksoftirqd/311:05:273
1952599454,5cyclictest41-21ksoftirqd/311:39:433
19525994523,7cyclictest41-21ksoftirqd/307:35:383
19525994522,4cyclictest41-21ksoftirqd/310:46:423
19525994519,4cyclictest41-21ksoftirqd/311:45:553
19525994517,7cyclictest41-21ksoftirqd/311:20:473
19525994516,8cyclictest41-21ksoftirqd/310:03:383
19525994516,4cyclictest41-21ksoftirqd/309:52:083
19525994516,4cyclictest41-21ksoftirqd/309:52:083
1952599447,3cyclictest41-21ksoftirqd/307:40:253
19525994437,4cyclictest41-21ksoftirqd/309:45:373
19525994431,3cyclictest41-21ksoftirqd/309:10:443
19525994425,3cyclictest41-21ksoftirqd/309:40:543
19525994416,7cyclictest41-21ksoftirqd/311:33:543
1952599437,3cyclictest41-21ksoftirqd/309:35:493
19525994323,7cyclictest41-21ksoftirqd/309:05:383
19525994320,4cyclictest41-21ksoftirqd/310:17:313
19525994318,8cyclictest41-21ksoftirqd/307:55:363
19525994313,9cyclictest41-21ksoftirqd/312:36:333
1952599424,9cyclictest41-21ksoftirqd/308:10:393
1952599424,9cyclictest41-21ksoftirqd/308:10:393
19525994212,8cyclictest41-21ksoftirqd/312:13:093
19525994210,9cyclictest41-21ksoftirqd/310:12:533
1952599420,7cyclictest30413-21awk09:05:243
1952599412,8cyclictest41-21ksoftirqd/308:55:463
19525994122,4cyclictest41-21ksoftirqd/308:30:413
1952599411,7cyclictest41-21ksoftirqd/312:50:433
19525994111,8cyclictest41-21ksoftirqd/309:23:543
19525994030,3cyclictest41-21ksoftirqd/308:20:413
1952599402,7cyclictest41-21ksoftirqd/308:50:413
1952599401,3cyclictest41-21ksoftirqd/308:45:403
19525994012,8cyclictest41-21ksoftirqd/312:57:513
1952599396,3cyclictest41-21ksoftirqd/309:30:243
271082370,4sleep027105-21ssh11:40:560
19520993427,4cyclictest30396-21sh09:05:242
128032330,5sleep11951599cyclictest12:00:441
19515993225,4cyclictest25-21ksoftirqd/109:05:361
8452310,5sleep0101ktimersoftd/009:10:360
306572310,1sleep10-21swapper/112:52:351
1951199312,6cyclictest1505-21runrttasks10:20:480
19515993025,3cyclictest25-21ksoftirqd/112:45:291
19515993025,3cyclictest25-21ksoftirqd/111:10:261
19515993022,5cyclictest25-21ksoftirqd/111:40:381
19520992912,10cyclictest63-21kswapd012:15:382
19515992924,3cyclictest25-21ksoftirqd/111:35:271
19515992924,3cyclictest25-21ksoftirqd/111:00:461
19515992924,3cyclictest25-21ksoftirqd/110:15:391
19515992924,3cyclictest25-21ksoftirqd/109:40:561
19515992923,3cyclictest25-21ksoftirqd/113:00:481
19515992923,3cyclictest25-21ksoftirqd/111:55:461
19515992922,4cyclictest25-21ksoftirqd/108:20:351
19520992823,3cyclictest33-21ksoftirqd/212:25:282
19520992823,3cyclictest33-21ksoftirqd/212:02:262
19520992822,3cyclictest33-21ksoftirqd/212:45:402
19520992822,3cyclictest33-21ksoftirqd/211:25:262
19520992821,4cyclictest4013-21cpuspeed_turbos12:25:422
1952099281,24cyclictest2921-21/usr/sbin/munin11:15:492
19515992823,3cyclictest25-21ksoftirqd/110:05:251
19515992822,3cyclictest25-21ksoftirqd/111:20:581
19515992822,3cyclictest25-21ksoftirqd/109:30:421
19515992822,3cyclictest25-21ksoftirqd/109:25:441
19515992822,3cyclictest25-21ksoftirqd/108:35:421
583322720,3sleep125-21ksoftirqd/111:20:261
19520992722,3cyclictest33-21ksoftirqd/210:35:262
19520992722,3cyclictest33-21ksoftirqd/210:10:442
19520992721,3cyclictest33-21ksoftirqd/211:35:152
19520992720,4cyclictest33-21ksoftirqd/211:05:212
19520992720,4cyclictest33-21ksoftirqd/209:07:542
19520992720,4cyclictest33-21ksoftirqd/208:15:512
19515992722,3cyclictest25-21ksoftirqd/112:10:461
19515992721,3cyclictest25-21ksoftirqd/111:35:391
19515992721,3cyclictest25-21ksoftirqd/108:42:501
19520992620,4cyclictest33-21ksoftirqd/209:47:042
19520992619,4cyclictest33-21ksoftirqd/209:13:442
19520992619,4cyclictest33-21ksoftirqd/208:36:102
19520992619,4cyclictest33-21ksoftirqd/208:34:582
19520992619,4cyclictest33-21ksoftirqd/207:46:522
19515992621,3cyclictest25-21ksoftirqd/110:50:451
19515992621,3cyclictest25-21ksoftirqd/110:25:561
19515992621,3cyclictest25-21ksoftirqd/109:45:441
19515992621,3cyclictest25-21ksoftirqd/108:30:411
19515992621,3cyclictest25-21ksoftirqd/107:35:411
19515992620,3cyclictest25-21ksoftirqd/108:50:521
19515992620,3cyclictest25-21ksoftirqd/107:55:411
19515992619,4cyclictest25-21ksoftirqd/109:18:521
19515992619,4cyclictest25-21ksoftirqd/108:56:491
19515992612,10cyclictest25-21ksoftirqd/111:46:591
19511992621,3cyclictest9-21ksoftirqd/008:56:560
19511992620,3cyclictest9-21ksoftirqd/011:40:270
19511992619,4cyclictest9-21ksoftirqd/008:49:090
19511992619,4cyclictest9-21ksoftirqd/008:38:130
19511992618,5cyclictest9-21ksoftirqd/008:41:100
19520992520,3cyclictest33-21ksoftirqd/212:35:402
19520992520,3cyclictest10128-1kworker/u9:111:49:022
19520992519,3cyclictest33-21ksoftirqd/212:57:382
19520992519,3cyclictest33-21ksoftirqd/208:58:212
19520992518,4cyclictest33-21ksoftirqd/209:36:442
19520992518,4cyclictest33-21ksoftirqd/208:14:502
19520992518,4cyclictest33-21ksoftirqd/208:14:502
1952099251,21cyclictest1422-21cat08:00:502
1952099250,5cyclictest1033-21snmpd12:05:552
1952099250,22cyclictest18733-21grep12:40:452
19515992521,2cyclictest25-21ksoftirqd/109:55:431
19515992521,2cyclictest25-21ksoftirqd/109:55:431
19515992520,3cyclictest25-21ksoftirqd/110:55:571
19515992520,3cyclictest25-21ksoftirqd/108:05:391
19515992519,3cyclictest25-21ksoftirqd/109:25:231
19515992519,3cyclictest25-21ksoftirqd/107:54:441
19515992518,4cyclictest17886-21sh12:40:291
19515992511,7cyclictest25-21ksoftirqd/108:25:361
1951599250,3cyclictest121rcu_preempt10:38:491
1951199253,13cyclictest3856-21ssh12:25:400
19511992520,3cyclictest9-21ksoftirqd/009:51:240
19511992520,3cyclictest9-21ksoftirqd/009:51:240
19511992519,4cyclictest9-21ksoftirqd/008:14:320
19511992519,4cyclictest9-21ksoftirqd/008:14:320
19511992519,3cyclictest9-21ksoftirqd/010:30:370
19511992519,3cyclictest9-21ksoftirqd/008:17:050
19511992519,3cyclictest9-21ksoftirqd/007:53:150
19511992519,3cyclictest9-21ksoftirqd/007:42:220
19520992419,3cyclictest33-21ksoftirqd/211:09:552
19520992418,3cyclictest33-21ksoftirqd/209:59:382
19520992418,3cyclictest33-21ksoftirqd/209:59:382
19520992418,3cyclictest33-21ksoftirqd/208:26:252
19520992418,3cyclictest33-21ksoftirqd/208:10:172
19520992418,3cyclictest33-21ksoftirqd/207:38:032
19520992417,5cyclictest33-21ksoftirqd/210:00:362
19520992417,4cyclictest33-21ksoftirqd/208:42:522
19520992417,4cyclictest33-21ksoftirqd/208:24:302
19520992417,4cyclictest33-21ksoftirqd/207:42:022
19515992419,3cyclictest25-21ksoftirqd/112:30:291
19515992419,3cyclictest25-21ksoftirqd/111:50:471
19515992419,3cyclictest25-21ksoftirqd/110:10:541
19515992418,3cyclictest25-21ksoftirqd/112:35:091
19515992418,3cyclictest25-21ksoftirqd/112:15:391
19515992417,4cyclictest25-21ksoftirqd/108:17:501
19511992418,3cyclictest9-21ksoftirqd/013:01:170
19511992418,3cyclictest9-21ksoftirqd/009:04:300
19511992418,3cyclictest9-21ksoftirqd/008:33:470
19520992317,3cyclictest33-21ksoftirqd/209:34:212
19520992317,3cyclictest33-21ksoftirqd/208:53:222
19520992316,4cyclictest33-21ksoftirqd/213:02:042
19520992316,4cyclictest33-21ksoftirqd/210:09:282
1952099231,4cyclictest8682-21snmp_o5powerctl10:45:542
1952099231,19cyclictest4215-21ssh11:50:562
19520992311,9cyclictest18666-21snmp_o5powerctl09:40:502
1952099231,19cyclictest0-21swapper/209:20:432
1952099230,21cyclictest0-21swapper/211:43:512
19515992317,3cyclictest25-21ksoftirqd/110:30:371
19515992316,4cyclictest25-21ksoftirqd/108:12:121
19515992316,4cyclictest25-21ksoftirqd/108:12:121
1951199232,18cyclictest24766-21grep12:45:560
19511992318,3cyclictest9-21ksoftirqd/010:03:000
19511992318,3cyclictest9-21ksoftirqd/009:40:240
19511992318,3cyclictest9-21ksoftirqd/008:50:430
19511992317,3cyclictest9-21ksoftirqd/008:28:330
19511992317,3cyclictest5756-21grep09:20:380
19511992316,4cyclictest9-21ksoftirqd/012:56:400
19511992316,4cyclictest9-21ksoftirqd/012:40:020
19511992316,4cyclictest9-21ksoftirqd/009:29:390
19511992316,4cyclictest9-21ksoftirqd/008:02:440
19511992316,4cyclictest9-21ksoftirqd/007:56:090
2212922215,3sleep233-21ksoftirqd/212:10:422
19520992216,3cyclictest33-21ksoftirqd/211:59:562
19520992216,3cyclictest33-21ksoftirqd/209:52:412
19520992216,3cyclictest33-21ksoftirqd/209:52:412
1952099221,5cyclictest22057-21munin-node11:12:082
19520992215,4cyclictest33-21ksoftirqd/211:26:572
19520992215,4cyclictest33-21ksoftirqd/209:26:322
19520992215,4cyclictest33-21ksoftirqd/208:45:452
19520992215,4cyclictest33-21ksoftirqd/207:52:102
1952099221,4cyclictest11631-21apt-get10:50:382
1952099220,19cyclictest2089-21ssh10:39:252
19515992218,3cyclictest25-21ksoftirqd/111:25:501
19515992217,3cyclictest25-21ksoftirqd/112:20:471
19515992217,3cyclictest25-21ksoftirqd/110:41:041
19511992217,3cyclictest9-21ksoftirqd/012:05:560
19511992217,3cyclictest9-21ksoftirqd/011:20:470
19511992216,3cyclictest9-21ksoftirqd/009:43:440
19511992216,3cyclictest9-21ksoftirqd/008:05:450
19511992216,3cyclictest12014-21latency_hist12:00:280
19511992215,4cyclictest20346-21if_ens307:35:400
1951199220,19cyclictest12753-21tail10:50:470
11192220,17sleep10-21swapper/111:15:161
19520992116,3cyclictest33-21ksoftirqd/209:16:172
19520992115,3cyclictest33-21ksoftirqd/210:25:252
1952099211,4cyclictest8637-21cat12:30:402
19520992114,4cyclictest22949-21expr10:25:382
1952099211,3cyclictest16211-21ssh10:16:262
1952099210,19cyclictest0-21swapper/210:55:502
1951599219,6cyclictest25-21ksoftirqd/110:20:371
19515992116,3cyclictest25-21ksoftirqd/109:50:561
19515992116,3cyclictest25-21ksoftirqd/109:50:561
19515992115,3cyclictest25-21ksoftirqd/108:00:401
1951199211,6cyclictest11024-21memory10:10:460
19511992116,3cyclictest9-21ksoftirqd/012:25:280
19511992115,3cyclictest9-21ksoftirqd/011:20:270
19511992114,4cyclictest6419-21grep10:05:410
19511992114,4cyclictest28153-21expr12:50:440
19511992113,5cyclictest47350irq/99-ens3-TxR12:30:410
1951199211,17cyclictest3724-21hddtemp_smartct09:15:410
173332211,16sleep017340-21snmp_o5powerctl11:30:530
16862210,5sleep0101ktimersoftd/010:38:330
244512201,15sleep024461-21ssh12:12:160
1952099209,8cyclictest31369-21ssh12:53:512
19515992016,3cyclictest25-21ksoftirqd/112:45:511
19515992015,3cyclictest25-21ksoftirqd/112:55:511
19515992015,3cyclictest25-21ksoftirqd/108:45:391
19515992014,3cyclictest11189-21sh10:50:181
19515992013,4cyclictest27248-21sh07:50:211
1951199203,10cyclictest29771-21ssh09:55:370
1951199203,10cyclictest29771-21ssh09:55:370
19511992014,4cyclictest9-21ksoftirqd/007:47:590
19511992014,3cyclictest9-21ksoftirqd/012:45:290
19511992014,3cyclictest20659-21if_enp1s011:00:450
19511992014,3cyclictest11782-21if_enp1s0.111:25:450
19511992013,4cyclictest701-21sh11:47:460
19511992013,4cyclictest28171-21wc12:15:540
19511992011,6cyclictest23430-21cut10:25:430
19520991913,4cyclictest33-21ksoftirqd/207:58:202
19515991915,3cyclictest25-21ksoftirqd/110:05:491
19515991913,4cyclictest25-21ksoftirqd/107:42:131
19515991913,3cyclictest16050-21sh09:38:421
19511991914,3cyclictest9-21ksoftirqd/009:05:550
19511991913,4cyclictest17350-21snmp_o5powerctl10:55:530
19511991913,4cyclictest11229-21cut09:30:420
19511991913,3cyclictest9-21ksoftirqd/008:22:140
19511991913,3cyclictest31237-21sh11:11:050
19511991913,3cyclictest12421-21diskmemload10:19:210
19511991912,4cyclictest4104-21sh11:50:540
19511991912,4cyclictest27289-21sh11:07:290
19511991912,4cyclictest23646-21sh09:46:300
19511991912,4cyclictest10612-21sh10:49:070
19511991811,4cyclictest4525-21timerandwakeup10:40:530
19511991811,4cyclictest12421-21diskmemload12:01:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional