You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 18:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6.osadl.org (updated Sun Apr 28, 2024 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1791911780,5ptp4l401ktimersoftd/309:24:373
848321640,5sleep21072799cyclictest12:15:512
3169021570,4sleep01071599cyclictest12:43:480
1140021450,3sleep01071599cyclictest14:53:520
10722998165,8cyclictest25-21ksoftirqd/113:08:371
10722996956,6cyclictest25-21ksoftirqd/111:38:341
179191670,1ptp4l401ktimersoftd/314:57:543
10722996654,5cyclictest25-21ksoftirqd/113:38:361
10722996653,6cyclictest25-21ksoftirqd/110:23:311
10727996455,5cyclictest33-21ksoftirqd/211:58:362
39072630,1sleep30-21swapper/312:09:503
39072630,1sleep30-21swapper/312:09:503
10722996250,6cyclictest25-21ksoftirqd/114:08:381
179191600,1ptp4l401ktimersoftd/313:35:063
10722996049,4cyclictest25-21ksoftirqd/110:38:311
179191590,1ptp4l401ktimersoftd/313:15:583
179191590,1ptp4l401ktimersoftd/312:52:083
179191590,1ptp4l401ktimersoftd/312:45:413
179191580,1ptp4l401ktimersoftd/314:24:533
104532584,42sleep00-21swapper/009:26:150
10722995745,5cyclictest25-21ksoftirqd/111:43:371
10722995647,5cyclictest25-21ksoftirqd/112:43:361
10722995630,9cyclictest25-21ksoftirqd/109:28:211
138242550,2sleep00-21swapper/013:01:580
179191540,1ptp4l401ktimersoftd/313:58:173
21862530,3sleep21072799cyclictest10:18:442
10722995241,5cyclictest25-21ksoftirqd/112:28:321
10722995041,5cyclictest25-21ksoftirqd/111:03:341
10722995041,4cyclictest25-21ksoftirqd/112:38:381
10722995038,6cyclictest25-21ksoftirqd/110:28:331
10722995038,5cyclictest25-21ksoftirqd/110:48:311
10727994935,7cyclictest33-21ksoftirqd/212:48:352
10722994942,3cyclictest25-21ksoftirqd/109:53:321
10722994941,4cyclictest25-21ksoftirqd/114:43:401
10722994938,5cyclictest25-21ksoftirqd/111:18:341
184891480,5getstats1073699cyclictest09:56:463
179191480,1ptp4l401ktimersoftd/312:32:533
302652470,1sleep20-21swapper/210:08:492
179191470,1ptp4l401ktimersoftd/313:52:173
179191470,1ptp4l401ktimersoftd/313:08:343
10722994618,4cyclictest25-21ksoftirqd/113:03:491
10722994435,4cyclictest25-21ksoftirqd/114:03:391
10722994434,5cyclictest25-21ksoftirqd/112:53:351
10722994332,4cyclictest25-21ksoftirqd/113:43:371
179191420,1ptp4l401ktimersoftd/313:04:443
10722994236,3cyclictest25-21ksoftirqd/112:08:281
10722994236,3cyclictest25-21ksoftirqd/112:08:281
10722994211,4cyclictest25-21ksoftirqd/114:28:541
10715994119,4cyclictest9-21ksoftirqd/010:51:380
179191400,2ptp4l3073-21kworker/3:113:38:413
10722994034,3cyclictest25-21ksoftirqd/114:13:311
179191390,1ptp4l401ktimersoftd/311:49:583
179191390,16ptp4l401ktimersoftd/314:08:493
179191390,0ptp4l401ktimersoftd/311:55:343
10727993925,7cyclictest33-21ksoftirqd/212:08:352
10727993925,7cyclictest33-21ksoftirqd/212:08:352
10722993931,2cyclictest121rcu_preempt12:18:441
104872394,23sleep20-21swapper/209:26:422
179191380,1ptp4l401ktimersoftd/314:28:323
179191380,1ptp4l401ktimersoftd/312:04:183
179191380,1ptp4l401ktimersoftd/312:04:183
179191380,0ptp4l401ktimersoftd/312:14:373
10727993827,6cyclictest33-21ksoftirqd/214:13:362
10722993824,10cyclictest25-21ksoftirqd/112:04:001
10722993824,10cyclictest25-21ksoftirqd/112:04:001
179191370,2ptp4l7502-21kworker/3:010:28:353
179191370,1ptp4l401ktimersoftd/314:53:253
179191370,1ptp4l401ktimersoftd/314:37:293
179191370,1ptp4l401ktimersoftd/314:04:183
179191370,1ptp4l401ktimersoftd/313:21:003
179191370,1ptp4l401ktimersoftd/312:02:213
179191370,1ptp4l401ktimersoftd/310:18:433
179191360,1ptp4l401ktimersoftd/314:19:033
179191360,1ptp4l401ktimersoftd/313:30:043
179191360,1ptp4l401ktimersoftd/311:03:583
179191360,1ptp4l401ktimersoftd/310:35:173
179191360,0ptp4l401ktimersoftd/311:41:323
179191350,2ptp4l14084-21kworker/3:212:36:133
179191350,1ptp4l401ktimersoftd/314:46:283
179191350,1ptp4l401ktimersoftd/313:44:173
179191350,1ptp4l401ktimersoftd/311:34:573
10727993524,8cyclictest33-21ksoftirqd/211:13:232
10727993521,5cyclictest33-21ksoftirqd/213:28:382
10722993529,3cyclictest25-21ksoftirqd/110:38:221
10722993514,3cyclictest25-21ksoftirqd/113:18:441
179191340,2ptp4l14084-21kworker/3:212:56:113
179191340,1ptp4l401ktimersoftd/314:40:263
179191340,1ptp4l401ktimersoftd/313:00:193
179191340,1ptp4l14084-21kworker/3:211:14:253
10727993427,3cyclictest33-21ksoftirqd/211:38:232
1072299344,5cyclictest121rcu_preempt11:28:491
10722993429,3cyclictest25-21ksoftirqd/114:20:591
10722993429,3cyclictest25-21ksoftirqd/111:38:231
10722993429,3cyclictest25-21ksoftirqd/110:23:221
10722993428,3cyclictest27619-21munin-run13:58:261
10722993428,3cyclictest25-21ksoftirqd/113:18:261
265262330,1sleep20-21swapper/211:13:442
179191330,1ptp4l401ktimersoftd/313:25:343
179191330,1ptp4l401ktimersoftd/312:42:453
179191330,1ptp4l401ktimersoftd/310:42:233
179191330,1ptp4l401ktimersoftd/309:52:213
179191330,0ptp4l401ktimersoftd/311:44:333
179191330,0ptp4l401ktimersoftd/310:13:403
10727993326,3cyclictest33-21ksoftirqd/214:08:412
10727993317,3cyclictest33-21ksoftirqd/214:43:302
10722993328,3cyclictest25-21ksoftirqd/113:59:021
10722993327,3cyclictest25-21ksoftirqd/114:54:021
10722993322,9cyclictest25-21ksoftirqd/114:49:051
10722993322,9cyclictest25-21ksoftirqd/111:49:021
10722993320,10cyclictest25-21ksoftirqd/113:23:571
10722993320,10cyclictest25-21ksoftirqd/112:33:361
1072299330,3cyclictest121rcu_preempt12:23:391
179191320,1ptp4l401ktimersoftd/314:00:043
179191320,1ptp4l401ktimersoftd/312:18:553
179191320,1ptp4l401ktimersoftd/310:58:563
179191320,10ptp4l401ktimersoftd/312:26:473
179191320,10ptp4l401ktimersoftd/310:57:133
10727993227,3cyclictest33-21ksoftirqd/212:38:472
10727993222,6cyclictest33-21ksoftirqd/214:23:382
10727993212,9cyclictest33-21ksoftirqd/214:34:022
10722993227,3cyclictest25-21ksoftirqd/114:33:411
10722993226,4cyclictest25-21ksoftirqd/109:33:241
10722993226,3cyclictest25-21ksoftirqd/114:24:041
10722993226,3cyclictest25-21ksoftirqd/110:53:361
10722993225,4cyclictest3951-21irqrtprio13:28:481
10722993225,4cyclictest25-21ksoftirqd/114:38:401
10722993223,6cyclictest25-21ksoftirqd/112:58:521
10722993220,10cyclictest25-21ksoftirqd/112:13:571
179191310,1ptp4l401ktimersoftd/311:25:293
179191310,1ptp4l401ktimersoftd/309:40:523
179191310,0ptp4l401ktimersoftd/314:16:223
179191310,0ptp4l401ktimersoftd/311:21:203
179191310,0ptp4l401ktimersoftd/311:09:513
10727993126,3cyclictest33-21ksoftirqd/212:23:242
10727993125,3cyclictest33-21ksoftirqd/213:28:252
10727993125,3cyclictest33-21ksoftirqd/212:03:452
10727993125,3cyclictest33-21ksoftirqd/212:03:452
10727993125,3cyclictest33-21ksoftirqd/209:28:352
10727993125,3cyclictest21093-21latency_hist11:53:232
10727993116,4cyclictest33-21ksoftirqd/212:29:422
1072299316,4cyclictest25-21ksoftirqd/113:37:551
10722993126,3cyclictest25-21ksoftirqd/112:48:371
10722993126,3cyclictest25-21ksoftirqd/109:33:211
10722993125,3cyclictest25-21ksoftirqd/113:53:261
10722993125,3cyclictest25-21ksoftirqd/111:58:381
10722993125,3cyclictest25-21ksoftirqd/111:18:231
10722993124,4cyclictest25-21ksoftirqd/109:48:511
179191300,0ptp4l401ktimersoftd/310:51:273
179191300,0ptp4l401ktimersoftd/310:24:353
179191300,0ptp4l401ktimersoftd/309:29:353
146682300,4sleep2321ktimersoftd/213:42:112
10727993025,3cyclictest33-21ksoftirqd/214:43:272
10727993025,3cyclictest33-21ksoftirqd/209:48:342
10727993024,3cyclictest33-21ksoftirqd/214:03:482
10727993024,3cyclictest33-21ksoftirqd/213:48:262
10727993024,3cyclictest33-21ksoftirqd/212:33:372
10727993024,3cyclictest33-21ksoftirqd/211:33:242
10722993025,3cyclictest25-21ksoftirqd/111:53:411
10722993025,3cyclictest25-21ksoftirqd/111:23:441
10722993024,3cyclictest25-21ksoftirqd/110:13:211
10722993024,3cyclictest25-21ksoftirqd/110:03:211
10722993024,3cyclictest25-21ksoftirqd/109:43:301
10715993024,3cyclictest9-21ksoftirqd/013:48:590
179191290,1ptp4l401ktimersoftd/311:28:263
1073699296,3cyclictest121rcu_preempt10:03:473
10727992924,3cyclictest33-21ksoftirqd/212:53:442
1072299299,7cyclictest25-21ksoftirqd/110:58:441
10722992925,3cyclictest25-21ksoftirqd/110:13:411
3196522820,3sleep09-21ksoftirqd/013:23:470
10727992823,3cyclictest33-21ksoftirqd/211:53:442
10727992822,3cyclictest33-21ksoftirqd/210:33:212
10727992821,4cyclictest33-21ksoftirqd/214:54:012
10722992823,3cyclictest25-21ksoftirqd/111:13:231
10722992823,3cyclictest25-21ksoftirqd/110:48:221
10722992823,3cyclictest25-21ksoftirqd/109:43:211
10722992822,3cyclictest25-21ksoftirqd/110:03:381
10715992821,4cyclictest9-21ksoftirqd/011:07:520
179191270,0ptp4l401ktimersoftd/310:00:363
10727992722,3cyclictest33-21ksoftirqd/214:49:052
10727992722,3cyclictest33-21ksoftirqd/213:18:262
10727992721,4cyclictest33-21ksoftirqd/214:00:302
10727992721,3cyclictest33-21ksoftirqd/213:03:452
10727992721,3cyclictest33-21ksoftirqd/210:38:332
10727992721,3cyclictest33-21ksoftirqd/210:23:392
10727992720,4cyclictest33-21ksoftirqd/210:51:122
10727992720,4cyclictest33-21ksoftirqd/209:58:012
10727992712,5cyclictest15793-21unixbench_multi12:23:552
10727992710,8cyclictest33-21ksoftirqd/211:18:542
10715992721,3cyclictest9-21ksoftirqd/011:16:590
10715992721,3cyclictest9-21ksoftirqd/010:38:090
10715992720,4cyclictest9-21ksoftirqd/011:26:350
10715992720,4cyclictest9-21ksoftirqd/010:18:060
10715992720,4cyclictest9-21ksoftirqd/009:55:500
179191260,1ptp4l401ktimersoftd/310:08:503
179191260,1ptp4l401ktimersoftd/309:43:463
1072799262,3cyclictest121rcu_preempt13:48:502
10727992621,3cyclictest33-21ksoftirqd/212:43:352
10727992621,3cyclictest33-21ksoftirqd/210:53:462
10727992621,3cyclictest33-21ksoftirqd/209:58:412
10727992621,3cyclictest33-21ksoftirqd/209:38:212
10727992620,3cyclictest33-21ksoftirqd/214:28:442
10727992620,3cyclictest33-21ksoftirqd/213:53:412
10727992620,3cyclictest33-21ksoftirqd/213:08:472
10727992620,3cyclictest33-21ksoftirqd/211:38:362
10715992621,3cyclictest9-21ksoftirqd/013:18:370
10715992621,3cyclictest9-21ksoftirqd/013:13:350
10715992620,3cyclictest9-21ksoftirqd/011:54:290
10715992620,3cyclictest9-21ksoftirqd/011:10:150
10715992620,3cyclictest9-21ksoftirqd/010:57:040
10715992620,3cyclictest9-21ksoftirqd/009:45:170
10715992619,4cyclictest9-21ksoftirqd/010:03:330
179191250,1ptp4l401ktimersoftd/309:33:303
133652250,3sleep21072799cyclictest14:18:492
10727992519,4cyclictest33-21ksoftirqd/211:43:552
10727992519,3cyclictest33-21ksoftirqd/211:26:252
10727992519,3cyclictest33-21ksoftirqd/210:58:372
10727992519,3cyclictest33-21ksoftirqd/209:48:202
10727992518,4cyclictest33-21ksoftirqd/213:20:512
10715992519,3cyclictest9-21ksoftirqd/009:38:320
10715992518,4cyclictest9-21ksoftirqd/010:42:030
10715992518,4cyclictest9-21ksoftirqd/010:20:510
10715992518,4cyclictest9-21ksoftirqd/010:10:190
95122240,3sleep01071599cyclictest12:18:140
52982240,5sleep05303-21timerwakeupswit10:23:520
10727992419,3cyclictest33-21ksoftirqd/212:59:052
10727992419,3cyclictest33-21ksoftirqd/210:13:572
10727992418,3cyclictest33-21ksoftirqd/210:48:222
10727992417,4cyclictest33-21ksoftirqd/211:03:392
10715992418,3cyclictest9-21ksoftirqd/011:30:560
10715992418,3cyclictest9-21ksoftirqd/009:58:550
10715992417,4cyclictest9-21ksoftirqd/012:52:470
10715992417,4cyclictest9-21ksoftirqd/011:18:280
10715992417,4cyclictest7939-21snmp_o5powerctl12:53:530
1071599241,20cyclictest32194-21ssh12:05:200
1071599241,20cyclictest32194-21ssh12:05:200
179191230,0ptp4l401ktimersoftd/310:44:283
10727992317,3cyclictest33-21ksoftirqd/213:33:442
1071599234,16cyclictest20976-21tail09:48:510
10715992317,3cyclictest9-21ksoftirqd/014:23:160
10715992317,3cyclictest9-21ksoftirqd/010:59:340
10715992316,4cyclictest9-21ksoftirqd/012:30:030
10715992316,4cyclictest9-21ksoftirqd/010:44:200
10715992315,4cyclictest101ktimersoftd/014:48:400
1071599231,3cyclictest23007-21ssh14:30:310
1071599230,11cyclictest139272/usr/sbin/munin09:33:440
10727992217,3cyclictest33-21ksoftirqd/209:43:212
1071599222,11cyclictest14070-21ssh12:23:330
10715992216,3cyclictest4890-21grep13:29:020
10715992216,3cyclictest1111-21apt-get12:08:280
10715992216,3cyclictest1111-21apt-get12:08:280
10715992215,4cyclictest9-21ksoftirqd/014:24:410
10715992215,4cyclictest9-21ksoftirqd/010:30:150
1071599221,3cyclictest3135-21ssh14:07:450
1071599221,3cyclictest24820-21irqstats13:53:510
1071599221,18cyclictest23023-21if_err_ens312:33:430
1071599221,18cyclictest0-21swapper/009:28:370
10727992115,3cyclictest33-21ksoftirqd/210:37:452
10715992114,4cyclictest6841-21sh14:11:440
10715992114,4cyclictest18621-21sendmail_mailtr11:48:530
10715992114,4cyclictest15391-21sh11:44:590
10715992114,4cyclictest12240-21ssh12:19:580
1071599211,3cyclictest4363-21ssh14:46:180
10715992113,4cyclictest30679-21swap14:38:580
1071599211,2cyclictest32745-21diskmemload13:39:160
1071599211,17cyclictest32745-21diskmemload14:03:010
1071599210,4cyclictest7764-21runrttasks13:33:460
10727992013,4cyclictest26708-21cat10:03:362
10715992014,3cyclictest9-21ksoftirqd/014:13:410
1071599201,3cyclictest15917-21strings13:03:470
10715992013,4cyclictest32745-21diskmemload11:59:540
10715992013,4cyclictest28896-21sh12:40:210
1071599201,16cyclictest20784-21ssh13:09:100
1071599200,3cyclictest17577-21ssh13:44:180
1071599200,17cyclictest4691-21apt-get11:33:330
10715991913,3cyclictest24699-21/usr/sbin/munin14:33:510
1071599191,15cyclictest10472-21snmp_o5powerctl11:38:560
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional