You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-15 - 00:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6.osadl.org (updated Fri Jun 14, 2024 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2252921670,4sleep2152299cyclictest13:09:432
2913321510,4sleep3152899cyclictest14:38:413
1791911270,8ptp4l19692-21kworker/3:209:51:573
1791911270,8ptp4l19692-21kworker/3:209:51:573
179191710,1ptp4l401ktimersoftd/312:04:493
176082710,2sleep00-21swapper/012:24:290
283772700,1sleep10-21swapper/112:38:231
293142680,4sleep125-21ksoftirqd/113:19:101
179191680,1ptp4l401ktimersoftd/310:21:283
55372660,4sleep3152899cyclictest11:04:503
179191660,1ptp4l401ktimersoftd/313:49:533
1522996557,4cyclictest33-21ksoftirqd/211:59:272
1522996455,4cyclictest33-21ksoftirqd/214:34:322
228902630,3sleep2152299cyclictest12:29:492
1522996354,5cyclictest33-21ksoftirqd/211:19:252
13082634,47sleep00-21swapper/009:53:020
13082634,47sleep00-21swapper/009:53:020
179191620,1ptp4l401ktimersoftd/314:33:423
1522996253,4cyclictest33-21ksoftirqd/214:39:312
13832624,10sleep20-21swapper/209:54:012
13832624,10sleep20-21swapper/209:54:012
1522996153,4cyclictest33-21ksoftirqd/214:59:322
1522996153,4cyclictest33-21ksoftirqd/211:39:282
1522996153,4cyclictest33-21ksoftirqd/211:39:282
1522996051,4cyclictest33-21ksoftirqd/213:14:332
179191590,1ptp4l401ktimersoftd/313:46:403
1522995749,4cyclictest33-21ksoftirqd/214:54:322
1522995546,5cyclictest33-21ksoftirqd/209:54:282
1522995245,3cyclictest33-21ksoftirqd/213:59:312
179191510,11ptp4l401ktimersoftd/312:04:123
1522995039,7cyclictest33-21ksoftirqd/213:24:332
1522995039,7cyclictest33-21ksoftirqd/213:24:332
1522995018,4cyclictest33-21ksoftirqd/215:15:082
1522995018,4cyclictest33-21ksoftirqd/215:15:082
1522994938,7cyclictest33-21ksoftirqd/211:34:232
1522994938,7cyclictest33-21ksoftirqd/211:34:232
152299486,3cyclictest121rcu_preempt13:39:442
1522994838,6cyclictest33-21ksoftirqd/210:19:272
1522994827,5cyclictest33-21ksoftirqd/213:34:452
1522994738,5cyclictest33-21ksoftirqd/210:24:262
1522994726,10cyclictest33-21ksoftirqd/209:59:312
179191460,1ptp4l401ktimersoftd/314:42:513
179191450,1ptp4l401ktimersoftd/315:10:313
85752440,2sleep30-21swapper/314:14:003
1522994418,4cyclictest33-21ksoftirqd/214:04:412
179191430,1ptp4l401ktimersoftd/310:00:473
1522994324,9cyclictest33-21ksoftirqd/212:19:512
1522994322,18cyclictest33-21ksoftirqd/215:04:402
1522994234,4cyclictest33-21ksoftirqd/210:39:202
1522994222,17cyclictest33-21ksoftirqd/213:09:062
1522994216,4cyclictest33-21ksoftirqd/213:29:532
1522994216,4cyclictest33-21ksoftirqd/213:29:532
1522994118,20cyclictest33-21ksoftirqd/212:49:192
1522994113,10cyclictest33-21ksoftirqd/212:34:362
179191400,1ptp4l401ktimersoftd/310:42:223
1522994015,4cyclictest33-21ksoftirqd/214:34:212
1513994033,4cyclictest25-21ksoftirqd/114:04:301
1513994032,5cyclictest25-21ksoftirqd/112:44:291
179191390,1ptp4l401ktimersoftd/312:24:493
1522993924,3cyclictest33-21ksoftirqd/214:09:452
1522993914,4cyclictest33-21ksoftirqd/215:24:222
1522993914,4cyclictest33-21ksoftirqd/215:24:222
1522993914,4cyclictest33-21ksoftirqd/211:44:352
179191380,2ptp4l19692-21kworker/3:212:59:303
179191380,1ptp4l401ktimersoftd/315:15:133
179191380,1ptp4l401ktimersoftd/315:15:133
179191380,1ptp4l401ktimersoftd/315:08:593
179191380,1ptp4l401ktimersoftd/313:59:503
179191380,1ptp4l401ktimersoftd/313:57:373
179191380,1ptp4l401ktimersoftd/313:04:553
179191380,1ptp4l401ktimersoftd/312:56:553
179191380,1ptp4l401ktimersoftd/312:21:143
179191380,1ptp4l401ktimersoftd/312:09:403
179191380,1ptp4l401ktimersoftd/310:33:083
179191380,0ptp4l401ktimersoftd/315:23:493
179191380,0ptp4l401ktimersoftd/315:23:493
179191380,0ptp4l401ktimersoftd/313:25:053
179191380,0ptp4l401ktimersoftd/313:25:053
179191380,0ptp4l401ktimersoftd/313:21:113
1522993832,4cyclictest33-21ksoftirqd/210:19:152
1522993827,3cyclictest33-21ksoftirqd/210:34:312
1513993831,4cyclictest25-21ksoftirqd/114:59:211
1513993831,4cyclictest25-21ksoftirqd/112:59:281
1513993830,4cyclictest25-21ksoftirqd/113:04:331
179191370,1ptp4l401ktimersoftd/314:05:563
179191370,1ptp4l401ktimersoftd/313:37:193
179191370,1ptp4l401ktimersoftd/312:48:593
179191370,0ptp4l401ktimersoftd/312:19:173
179191370,0ptp4l401ktimersoftd/311:55:503
152299377,5cyclictest33-21ksoftirqd/212:59:352
1522993719,3cyclictest33-21ksoftirqd/215:09:352
1522993713,4cyclictest33-21ksoftirqd/210:04:452
1522993711,4cyclictest33-21ksoftirqd/212:09:412
152299370,13cyclictest33-21ksoftirqd/210:29:422
1513993731,4cyclictest25-21ksoftirqd/113:29:281
1513993731,4cyclictest25-21ksoftirqd/113:29:281
1513993717,4cyclictest25-21ksoftirqd/113:10:531
179191360,1ptp4l401ktimersoftd/312:42:573
179191360,1ptp4l401ktimersoftd/312:37:313
179191360,0ptp4l401ktimersoftd/314:48:223
179191360,0ptp4l401ktimersoftd/312:31:553
179191360,0ptp4l401ktimersoftd/310:59:293
152299363,3cyclictest33-21ksoftirqd/211:59:172
1522993631,3cyclictest33-21ksoftirqd/212:14:372
1522993630,3cyclictest33-21ksoftirqd/212:04:222
1522993615,19cyclictest33-21ksoftirqd/211:14:432
152299360,6cyclictest10486-21run-parts14:14:462
323812352,19sleep132392-21cat09:49:401
323812352,19sleep132392-21cat09:49:401
179191350,2ptp4l13433-21kworker/3:113:40:393
179191350,1ptp4l401ktimersoftd/313:31:373
179191350,1ptp4l401ktimersoftd/313:31:373
152299355,3cyclictest121rcu_preempt14:29:212
1522993529,3cyclictest33-21ksoftirqd/214:49:362
1522993528,4cyclictest33-21ksoftirqd/210:44:302
1522993519,3cyclictest33-21ksoftirqd/210:54:502
1522993511,4cyclictest33-21ksoftirqd/214:19:392
1522993511,4cyclictest33-21ksoftirqd/212:49:312
1513993530,3cyclictest25-21ksoftirqd/112:19:181
1513993529,3cyclictest25-21ksoftirqd/115:19:331
1513993529,3cyclictest25-21ksoftirqd/115:19:331
1513993529,3cyclictest25-21ksoftirqd/112:29:181
1513993528,3cyclictest25-21ksoftirqd/115:14:341
1513993528,3cyclictest25-21ksoftirqd/115:14:341
1513993527,4cyclictest25-21ksoftirqd/112:54:291
1513993527,4cyclictest25-21ksoftirqd/112:04:311
179191340,1ptp4l401ktimersoftd/315:00:073
179191340,1ptp4l401ktimersoftd/314:23:333
179191340,1ptp4l401ktimersoftd/314:16:053
179191340,1ptp4l401ktimersoftd/313:16:163
179191340,1ptp4l401ktimersoftd/313:09:553
1522993428,3cyclictest33-21ksoftirqd/212:39:552
1522993425,5cyclictest33-21ksoftirqd/214:44:312
1522993423,9cyclictest33-21ksoftirqd/213:49:522
1513993429,3cyclictest25-21ksoftirqd/110:04:141
1513993426,4cyclictest25-21ksoftirqd/110:39:271
179191330,2ptp4l19692-21kworker/3:211:48:363
179191330,1ptp4l401ktimersoftd/312:52:553
179191330,1ptp4l401ktimersoftd/310:49:433
1522993328,3cyclictest33-21ksoftirqd/212:24:402
1522993328,3cyclictest33-21ksoftirqd/211:04:152
1522993327,3cyclictest33-21ksoftirqd/213:59:202
1522993327,3cyclictest33-21ksoftirqd/213:44:342
1522993327,3cyclictest33-21ksoftirqd/213:24:192
1513993327,4cyclictest25-21ksoftirqd/113:24:191
1513993326,4cyclictest25-21ksoftirqd/112:29:311
1513993325,4cyclictest25-21ksoftirqd/111:24:291
1507993325,6cyclictest9-21ksoftirqd/013:54:310
179191320,1ptp4l401ktimersoftd/314:50:113
179191320,1ptp4l401ktimersoftd/314:27:053
179191320,1ptp4l401ktimersoftd/310:08:143
179191320,10ptp4l401ktimersoftd/314:56:423
179191320,0ptp4l401ktimersoftd/311:41:073
179191320,0ptp4l401ktimersoftd/311:41:073
152299325,24cyclictest9231-21irqrtprio12:54:372
1522993226,3cyclictest33-21ksoftirqd/210:54:162
1522993215,5cyclictest33-21ksoftirqd/211:09:352
1513993227,3cyclictest25-21ksoftirqd/114:19:211
1513993226,3cyclictest25-21ksoftirqd/113:44:191
1507993227,3cyclictest9-21ksoftirqd/013:10:190
1507993226,3cyclictest9-21ksoftirqd/014:44:200
1507993225,4cyclictest9-21ksoftirqd/013:09:000
179191310,1ptp4l401ktimersoftd/310:48:453
1528993119,9cyclictest41-21ksoftirqd/310:15:533
1522993126,3cyclictest33-21ksoftirqd/211:54:172
1522993125,4cyclictest33-21ksoftirqd/210:09:312
1522993125,3cyclictest33-21ksoftirqd/211:24:332
1513993126,3cyclictest25-21ksoftirqd/111:04:151
1513993124,4cyclictest25-21ksoftirqd/112:09:351
179191300,1ptp4l401ktimersoftd/311:19:523
1522993024,3cyclictest33-21ksoftirqd/211:04:392
1513993025,3cyclictest25-21ksoftirqd/112:04:171
1513993023,4cyclictest25-21ksoftirqd/114:29:331
1507993023,4cyclictest9-21ksoftirqd/014:49:320
152899293,3cyclictest121rcu_preempt10:39:163
151399299,5cyclictest25-21ksoftirqd/113:34:441
1513992924,3cyclictest25-21ksoftirqd/114:24:401
1513992924,3cyclictest25-21ksoftirqd/113:49:291
1513992924,3cyclictest25-21ksoftirqd/113:24:451
1513992924,3cyclictest25-21ksoftirqd/113:24:451
1513992924,3cyclictest25-21ksoftirqd/110:34:351
1513992924,3cyclictest25-21ksoftirqd/110:24:331
1513992923,4cyclictest25-21ksoftirqd/112:24:181
1513992922,4cyclictest25-21ksoftirqd/111:58:321
1513992922,4cyclictest25-21ksoftirqd/111:39:351
1513992922,4cyclictest25-21ksoftirqd/111:39:351
1513992922,4cyclictest25-21ksoftirqd/110:59:161
1513992921,4cyclictest25-21ksoftirqd/110:09:281
150799293,3cyclictest121rcu_preempt13:34:560
1507992924,3cyclictest9-21ksoftirqd/014:44:330
1507992923,3cyclictest9-21ksoftirqd/012:29:330
1528992822,3cyclictest41-21ksoftirqd/310:14:143
1522992823,3cyclictest33-21ksoftirqd/211:34:162
1513992823,3cyclictest25-21ksoftirqd/114:34:431
1513992823,3cyclictest25-21ksoftirqd/113:44:401
1513992823,3cyclictest25-21ksoftirqd/110:44:291
1513992823,3cyclictest25-21ksoftirqd/110:19:371
1513992822,4cyclictest25-21ksoftirqd/114:04:201
1513992822,3cyclictest25-21ksoftirqd/115:04:591
1513992822,3cyclictest25-21ksoftirqd/110:19:151
1507992823,3cyclictest9-21ksoftirqd/015:09:210
1507992823,3cyclictest9-21ksoftirqd/014:09:200
1507992823,3cyclictest9-21ksoftirqd/010:44:280
1507992823,3cyclictest9-21ksoftirqd/009:59:190
1507992821,4cyclictest9-21ksoftirqd/013:23:100
1507992821,4cyclictest9-21ksoftirqd/011:07:240
179191270,1ptp4l401ktimersoftd/311:24:183
179191270,0ptp4l401ktimersoftd/311:15:423
152899273,3cyclictest121rcu_preempt11:31:233
1528992721,3cyclictest41-21ksoftirqd/311:49:473
1513992722,3cyclictest25-21ksoftirqd/114:54:211
1513992722,3cyclictest25-21ksoftirqd/111:04:371
1513992721,3cyclictest25-21ksoftirqd/114:09:471
1513992721,3cyclictest25-21ksoftirqd/112:39:281
1513992721,3cyclictest25-21ksoftirqd/109:54:281
1513992719,4cyclictest8716-21grep11:14:281
1513992719,4cyclictest25-21ksoftirqd/110:29:271
1507992721,3cyclictest9-21ksoftirqd/015:14:360
1507992721,3cyclictest9-21ksoftirqd/015:14:360
1507992721,3cyclictest9-21ksoftirqd/014:19:390
1507992721,3cyclictest9-21ksoftirqd/013:40:370
1507992721,3cyclictest9-21ksoftirqd/010:29:350
1507992721,3cyclictest9-21ksoftirqd/010:06:320
1507992720,5cyclictest9-21ksoftirqd/013:44:480
1507992720,4cyclictest9-21ksoftirqd/011:35:230
1507992720,4cyclictest9-21ksoftirqd/011:35:230
1507992719,6cyclictest9-21ksoftirqd/013:54:200
179191260,1ptp4l401ktimersoftd/311:35:233
179191260,1ptp4l401ktimersoftd/311:35:233
1528992621,3cyclictest41-21ksoftirqd/311:14:153
1513992621,3cyclictest25-21ksoftirqd/114:19:361
1513992621,3cyclictest25-21ksoftirqd/111:09:421
1513992619,4cyclictest25-21ksoftirqd/111:48:561
151399260,3cyclictest121rcu_preempt12:51:271
1507992621,3cyclictest9-21ksoftirqd/010:49:340
1507992621,3cyclictest9-21ksoftirqd/010:39:350
1507992620,3cyclictest9-21ksoftirqd/015:14:210
1507992620,3cyclictest9-21ksoftirqd/012:59:380
1507992620,3cyclictest9-21ksoftirqd/010:19:290
1507992613,10cyclictest5241-21cat12:09:170
303882250,3sleep1231rcuc/114:39:401
179191250,1ptp4l401ktimersoftd/310:54:373
179191250,0ptp4l401ktimersoftd/309:55:183
1513992520,3cyclictest25-21ksoftirqd/111:49:371
1513992520,3cyclictest25-21ksoftirqd/110:09:151
1513992519,4cyclictest25-21ksoftirqd/111:34:311
1513992519,4cyclictest25-21ksoftirqd/111:34:311
1513992519,4cyclictest25-21ksoftirqd/111:20:541
1513992518,4cyclictest25-21ksoftirqd/111:31:261
1507992519,3cyclictest9-21ksoftirqd/013:14:430
1507992519,3cyclictest9-21ksoftirqd/011:09:350
1507992518,4cyclictest9-21ksoftirqd/014:37:060
1507992518,4cyclictest9-21ksoftirqd/012:19:290
1507992516,6cyclictest28789-21/usr/sbin/munin15:20:010
1507992516,6cyclictest28789-21/usr/sbin/munin15:20:010
150799251,21cyclictest9160-21if_enp1s0.111:14:340
179191240,1ptp4l401ktimersoftd/310:24:253
1513992419,3cyclictest25-21ksoftirqd/115:09:381
1513992419,3cyclictest25-21ksoftirqd/114:44:331
1513992418,3cyclictest25-21ksoftirqd/113:54:311
1507992418,3cyclictest9-21ksoftirqd/013:59:440
1507992418,3cyclictest9-21ksoftirqd/012:12:000
1507992418,3cyclictest12287-21grep10:14:300
1507992417,4cyclictest9-21ksoftirqd/011:50:160
1507992417,4cyclictest9-21ksoftirqd/010:54:360
320232231,2sleep025521-21diskmemload12:42:360
150799233,3cyclictest10146-21ssh14:54:470
1507992318,3cyclictest9-21ksoftirqd/014:14:340
1507992318,3cyclictest9-21ksoftirqd/012:48:540
1507992318,3cyclictest9-21ksoftirqd/011:24:160
1507992318,3cyclictest9-21ksoftirqd/009:56:230
1507992317,3cyclictest9-21ksoftirqd/010:36:010
1507992316,4cyclictest9-21ksoftirqd/011:29:320
1507992316,4cyclictest9-21ksoftirqd/010:13:410
1507992312,9cyclictest8758-21awk14:14:200
1513992216,3cyclictest25-21ksoftirqd/114:59:401
1513992216,3cyclictest25-21ksoftirqd/110:49:301
1507992217,3cyclictest9-21ksoftirqd/014:29:340
1507992217,3cyclictest9-21ksoftirqd/012:34:510
1507992216,3cyclictest9-21ksoftirqd/011:41:560
1507992216,3cyclictest9-21ksoftirqd/011:41:560
1507992215,4cyclictest9-21ksoftirqd/011:27:200
1507992116,3cyclictest9-21ksoftirqd/011:44:320
1507992114,4cyclictest9-21ksoftirqd/012:53:390
1507992114,4cyclictest9-21ksoftirqd/012:18:300
1507992114,4cyclictest9-21ksoftirqd/011:55:500
1507992114,4cyclictest17969-21if_ens314:24:420
1507992113,3cyclictest9-21ksoftirqd/013:25:010
1507992113,3cyclictest9-21ksoftirqd/013:25:010
1507992015,3cyclictest9-21ksoftirqd/014:59:210
1507992014,3cyclictest9051-21idleruntime12:54:340
1507992014,3cyclictest29780-21/usr/sbin/munin11:59:400
1507992013,4cyclictest1686-21expr10:59:280
1507991912,4cyclictest18152-21sendmail_mailqu10:24:390
1507991910,3cyclictest5233-21cpuspeed_turbos13:29:300
1507991910,3cyclictest5233-21cpuspeed_turbos13:29:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional