You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-18 - 18:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Thu Apr 18, 2024 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
47221740,2sleep00-21swapper/012:47:540
47221740,2sleep00-21swapper/012:47:540
1954221470,2sleep30-21swapper/314:28:303
1791911180,8ptp4l14055-21kworker/3:109:21:153
5892996958,5cyclictest33-21ksoftirqd/213:53:062
125932650,2sleep10-21swapper/114:21:411
316792640,3sleep0588199cyclictest14:43:200
152742630,3sleep30-21swapper/309:38:153
162192600,2sleep00-21swapper/013:06:530
5892995845,7cyclictest33-21ksoftirqd/212:23:062
253572580,2sleep10-21swapper/111:56:481
241202580,1sleep30-21swapper/309:58:073
588199544,13cyclictest29580-21/usr/sbin/munin11:18:030
57662535,35sleep20-21swapper/209:22:342
588199496,7cyclictest11362-21if_enp1s0.111:38:090
54352490,2sleep20-21swapper/212:13:032
5892994836,6cyclictest33-21ksoftirqd/212:58:062
588199488,36cyclictest2244-21cut14:48:120
588199487,16cyclictest19314-21awk12:28:260
588199445,7cyclictest20752-21latency_hist13:12:550
589799420,2cyclictest0-21swapper/311:57:093
588899424,11cyclictest7892sleep112:48:081
588199421,16cyclictest14660-21needreboot14:23:190
588199420,17cyclictest10407-21sed12:58:240
179191420,1ptp4l401ktimersoftd/313:09:443
589799411,26cyclictest225032sh14:33:193
5892994135,3cyclictest33-21ksoftirqd/210:22:512
5888994113,5cyclictest21163-21sendmail12:32:531
588199410,8cyclictest2504-21memory12:08:140
589799400,2cyclictest0-21swapper/312:15:453
588199403,5cyclictest11937-21ssh14:20:130
588199401,7cyclictest728-21ssh12:06:580
588199400,8cyclictest8360-21ssh14:15:290
588199400,8cyclictest12025-21ssh12:19:540
588199400,15cyclictest2463-21vmstat13:28:320
589799392,28cyclictest26092-21apt-get11:58:023
588899393,4cyclictest0-21swapper/113:18:051
588899392,6cyclictest0-21swapper/114:23:081
588899392,6cyclictest0-21swapper/110:58:041
5888993915,5cyclictest46950irq/99-ens3-TxR14:03:111
179191390,1ptp4l401ktimersoftd/312:18:053
589799382,28cyclictest22463-21apt-get11:03:043
589799382,28cyclictest22463-21apt-get11:03:043
5892993833,3cyclictest33-21ksoftirqd/212:52:542
5892993827,6cyclictest33-21ksoftirqd/214:48:112
588899382,14cyclictest28277-21strings11:13:121
5888993812,4cyclictest29736-21fschecks_time12:43:101
5888993812,4cyclictest29736-21fschecks_time12:43:101
588199383,6cyclictest9-21ksoftirqd/012:16:180
179191380,1ptp4l401ktimersoftd/314:50:093
179191380,1ptp4l401ktimersoftd/314:23:413
179191380,1ptp4l401ktimersoftd/313:44:183
179191380,1ptp4l401ktimersoftd/313:41:113
179191380,1ptp4l401ktimersoftd/313:14:173
179191380,1ptp4l401ktimersoftd/313:01:483
179191380,0ptp4l401ktimersoftd/312:52:033
179191380,0ptp4l401ktimersoftd/312:38:343
589799373,26cyclictest13592-21apt-get12:23:063
589799371,32cyclictest20527-21munin-run13:52:563
589799371,29cyclictest26068-21apt-get14:38:063
179191370,1ptp4l401ktimersoftd/314:09:143
179191370,1ptp4l401ktimersoftd/314:03:293
179191370,1ptp4l401ktimersoftd/314:01:173
179191370,1ptp4l401ktimersoftd/313:35:523
179191370,1ptp4l401ktimersoftd/313:17:573
179191370,1ptp4l401ktimersoftd/312:55:453
179191370,1ptp4l401ktimersoftd/312:07:393
179191370,1ptp4l401ktimersoftd/311:43:353
179191370,1ptp4l401ktimersoftd/311:39:553
179191370,1ptp4l401ktimersoftd/311:35:543
179191370,1ptp4l401ktimersoftd/311:31:033
589799362,27cyclictest5641-21apt-get10:28:003
589799362,26cyclictest12936-21apt-get13:03:043
588199362,5cyclictest0-21swapper/013:57:320
568423614,10sleep00-21swapper/009:21:310
179191360,1ptp4l401ktimersoftd/314:46:093
179191360,1ptp4l401ktimersoftd/314:21:073
179191360,1ptp4l401ktimersoftd/314:14:333
179191360,1ptp4l401ktimersoftd/313:28:513
179191360,1ptp4l401ktimersoftd/312:32:373
179191360,1ptp4l401ktimersoftd/311:52:013
179191360,1ptp4l401ktimersoftd/311:13:153
179191360,0ptp4l401ktimersoftd/311:24:583
179191360,0ptp4l401ktimersoftd/310:23:413
589799355,27cyclictest31641-21cron11:22:523
589799353,25cyclictest24826-21apt-get11:08:023
589799352,27cyclictest21116-21apt-get13:53:063
5892993529,3cyclictest33-21ksoftirqd/209:52:502
5892993522,11cyclictest33-21ksoftirqd/214:03:062
5892993522,10cyclictest33-21ksoftirqd/213:38:152
5888993514,3cyclictest31649-21diskmemload11:49:571
588199353,6cyclictest9-21ksoftirqd/014:41:050
589799342,25cyclictest12769-21apt-get10:43:033
5897993413,18cyclictest26555-21if_enp1s0.110:03:073
589799341,25cyclictest9176-21apt-get09:28:013
589799340,4cyclictest25064-21grep12:37:543
5892993424,5cyclictest33-21ksoftirqd/214:08:092
588899344,8cyclictest32214-21apt-get11:23:031
588899343,8cyclictest17027-21apt-get13:08:081
588899342,9cyclictest11563-21apt-get09:32:591
5888993413,3cyclictest31649-21diskmemload14:15:211
5888993413,3cyclictest31649-21diskmemload12:56:321
179191340,1ptp4l401ktimersoftd/312:45:263
179191340,1ptp4l401ktimersoftd/312:45:263
589799333,24cyclictest0-21swapper/310:38:053
5897993314,16cyclictest4542-21sh12:11:333
5897993313,17cyclictest8473-21grep10:33:073
589799330,3cyclictest217-21systemd-journal09:37:503
5892993327,3cyclictest33-21ksoftirqd/210:07:512
5892993326,3cyclictest33-21ksoftirqd/211:53:042
5892993325,5cyclictest33-21ksoftirqd/214:47:572
588899338,22cyclictest31799-21snmp_o5powerctl14:43:271
589799326,22cyclictest3044-21sed10:22:523
589799325,24cyclictest22342-21ls11:02:523
5897993211,18cyclictest30740-21bc10:13:013
589799320,5cyclictest22608-21snmp_o5powerctl09:53:183
5892993227,3cyclictest33-21ksoftirqd/213:47:562
5892993227,3cyclictest33-21ksoftirqd/212:57:552
5892993226,3cyclictest33-21ksoftirqd/211:58:242
5892993226,3cyclictest33-21ksoftirqd/209:53:022
5892993213,17cyclictest33-21ksoftirqd/214:19:272
588199322,7cyclictest809-21memory11:23:110
588199321,15cyclictest21955-21apt-get14:33:130
264512320,3sleep20-21swapper/213:58:182
5897993113,15cyclictest28278-21/usr/sbin/munin10:08:073
589799311,27cyclictest20058-21cat09:48:223
589799311,26cyclictest15498-21cpuspeed_turbos10:48:063
589799310,2cyclictest0-21swapper/313:26:193
589799310,2cyclictest0-21swapper/310:53:073
5892993126,3cyclictest33-21ksoftirqd/213:52:562
5892993125,3cyclictest33-21ksoftirqd/213:12:552
5892993125,3cyclictest33-21ksoftirqd/212:28:132
5892993125,3cyclictest33-21ksoftirqd/212:12:532
5892993123,5cyclictest33-21ksoftirqd/210:43:112
5892993120,5cyclictest33-21ksoftirqd/211:28:052
5892993117,3cyclictest33-21ksoftirqd/213:23:062
5888993113,3cyclictest31649-21diskmemload12:14:091
589799301,26cyclictest17132-21irqrtprio09:43:073
589799300,26cyclictest7736-21grep09:23:233
5892993025,3cyclictest33-21ksoftirqd/211:02:512
5892993025,3cyclictest33-21ksoftirqd/210:12:512
5892993024,3cyclictest33-21ksoftirqd/213:13:102
5892993024,3cyclictest33-21ksoftirqd/211:33:112
5892993024,3cyclictest33-21ksoftirqd/211:12:522
5892993021,5cyclictest33-21ksoftirqd/211:13:022
5892993021,4cyclictest33-21ksoftirqd/213:03:032
5892993019,5cyclictest33-21ksoftirqd/214:38:062
5892993018,10cyclictest33-21ksoftirqd/214:28:132
5892992925,2cyclictest33-21ksoftirqd/211:22:572
5892992924,3cyclictest33-21ksoftirqd/213:18:062
5892992924,3cyclictest33-21ksoftirqd/212:33:062
5892992924,3cyclictest33-21ksoftirqd/211:47:542
5892992924,3cyclictest33-21ksoftirqd/210:27:502
5892992923,3cyclictest33-21ksoftirqd/210:53:042
5892992923,3cyclictest33-21ksoftirqd/209:28:022
5892992919,5cyclictest33-21ksoftirqd/209:58:002
5888992922,4cyclictest25-21ksoftirqd/111:11:071
5888992922,4cyclictest25-21ksoftirqd/110:55:381
5881992922,4cyclictest9-21ksoftirqd/013:26:200
43752295,10sleep10-21swapper/109:18:091
5892992823,3cyclictest33-21ksoftirqd/211:22:532
5892992823,3cyclictest33-21ksoftirqd/210:38:132
5892992822,3cyclictest33-21ksoftirqd/214:23:152
5892992822,3cyclictest33-21ksoftirqd/211:48:032
5892992822,3cyclictest33-21ksoftirqd/210:13:032
588899287,4cyclictest0-21swapper/109:58:051
588199284,9cyclictest9-21ksoftirqd/014:01:080
588199282,6cyclictest101ktimersoftd/010:55:530
588199280,10cyclictest23098-21ssh13:13:500
145182280,5sleep125-21ksoftirqd/112:23:141
5892992723,3cyclictest33-21ksoftirqd/212:18:102
5892992722,3cyclictest33-21ksoftirqd/214:13:172
5892992722,3cyclictest33-21ksoftirqd/212:43:282
5892992722,3cyclictest33-21ksoftirqd/212:43:282
5892992722,3cyclictest33-21ksoftirqd/210:28:012
5892992722,3cyclictest33-21ksoftirqd/209:38:072
5892992722,3cyclictest33-21ksoftirqd/209:23:102
5892992721,3cyclictest33-21ksoftirqd/214:33:202
5892992721,3cyclictest33-21ksoftirqd/210:48:132
5888992722,3cyclictest25-21ksoftirqd/113:28:221
5888992720,4cyclictest25-21ksoftirqd/111:38:251
5881992722,3cyclictest9-21ksoftirqd/009:57:310
5881992721,3cyclictest9-21ksoftirqd/014:06:550
5881992720,4cyclictest9-21ksoftirqd/009:57:560
588199271,20cyclictest0-21swapper/012:53:060
1200722720,3sleep125-21ksoftirqd/113:42:241
5892992620,4cyclictest33-21ksoftirqd/211:38:102
5892992620,3cyclictest33-21ksoftirqd/213:37:552
5892992620,3cyclictest33-21ksoftirqd/213:28:102
5892992620,3cyclictest33-21ksoftirqd/209:43:012
5888992620,3cyclictest25-21ksoftirqd/111:29:571
5888992620,3cyclictest25-21ksoftirqd/110:24:501
5888992619,4cyclictest25-21ksoftirqd/111:43:501
5888992619,4cyclictest25-21ksoftirqd/111:06:091
5888992619,4cyclictest25-21ksoftirqd/111:06:091
588199265,6cyclictest9-21ksoftirqd/011:47:510
588199263,8cyclictest9-21ksoftirqd/012:25:220
5881992620,3cyclictest9-21ksoftirqd/013:38:200
5881992616,7cyclictest7116-21sed10:28:180
5892992519,4cyclictest33-21ksoftirqd/210:33:092
5892992519,3cyclictest33-21ksoftirqd/212:03:052
588899254,13cyclictest21967-21ssh14:33:131
5888992518,4cyclictest25-21ksoftirqd/113:59:011
5888992518,4cyclictest25-21ksoftirqd/109:49:461
588199256,6cyclictest9-21ksoftirqd/011:59:340
588199255,5cyclictest9-21ksoftirqd/013:48:020
588199255,5cyclictest9-21ksoftirqd/013:43:140
588199255,5cyclictest9-21ksoftirqd/011:47:570
588199254,7cyclictest9-21ksoftirqd/010:47:520
588199254,17cyclictest11991-21grep09:33:050
588199253,8cyclictest9-21ksoftirqd/010:23:130
588199253,6cyclictest9-21ksoftirqd/012:48:290
5881992515,7cyclictest17697-21sed09:43:180
5892992419,3cyclictest33-21ksoftirqd/209:33:142
5892992418,3cyclictest33-21ksoftirqd/211:03:112
5892992418,3cyclictest33-21ksoftirqd/211:03:112
5888992419,3cyclictest25-21ksoftirqd/110:08:021
5888992417,4cyclictest25-21ksoftirqd/110:39:001
5888992417,4cyclictest25-21ksoftirqd/110:17:201
5888992417,4cyclictest25-21ksoftirqd/109:55:081
5888992417,4cyclictest25-21ksoftirqd/109:24:121
588899240,12cyclictest151442sort10:47:521
588199245,7cyclictest9-21ksoftirqd/013:22:460
588199245,7cyclictest9-21ksoftirqd/010:58:230
588199245,6cyclictest9-21ksoftirqd/010:03:070
588199245,5cyclictest9-21ksoftirqd/011:53:050
588199245,5cyclictest9-21ksoftirqd/010:13:160
588199245,5cyclictest9-21ksoftirqd/010:08:120
588199244,5cyclictest9-21ksoftirqd/014:28:030
588199244,4cyclictest9-21ksoftirqd/009:24:560
588199243,8cyclictest9-21ksoftirqd/011:32:330
5881992418,3cyclictest9-21ksoftirqd/009:41:220
5881992417,4cyclictest9-21ksoftirqd/010:19:110
5881992412,6cyclictest7047-21apt-get11:33:040
588199240,20cyclictest13214-21cut10:43:080
588199240,14cyclictest3888-21ssh14:09:550
5888992317,3cyclictest25-21ksoftirqd/114:48:461
5888992316,4cyclictest25-21ksoftirqd/111:34:481
5888992316,4cyclictest25-21ksoftirqd/111:20:591
5888992316,4cyclictest25-21ksoftirqd/109:38:261
5888992314,6cyclictest26583-21tail11:58:071
588199235,7cyclictest9-21ksoftirqd/012:40:170
588199235,6cyclictest9-21ksoftirqd/009:48:100
588199235,6cyclictest9-21ksoftirqd/009:27:500
588199234,5cyclictest9-21ksoftirqd/013:34:500
588199234,5cyclictest9-21ksoftirqd/012:33:050
5881992313,8cyclictest11411-21sed10:38:150
5881992311,9cyclictest8187-21cpuspeed_turbos10:33:030
5892992217,3cyclictest33-21ksoftirqd/212:42:542
588899222,17cyclictest21823-21irqrtprio13:53:151
588899222,17cyclictest13621-21ps13:03:111
588899222,12cyclictest25370-21apt-get12:38:051
5888992217,3cyclictest25-21ksoftirqd/114:08:221
5888992215,4cyclictest25-21ksoftirqd/112:05:191
588199225,8cyclictest9-21ksoftirqd/011:03:030
588199225,8cyclictest9-21ksoftirqd/011:03:030
588199224,6cyclictest9-21ksoftirqd/011:13:020
588199224,3cyclictest9-21ksoftirqd/011:08:030
5888992114,4cyclictest4794-21ls13:33:081
5888992114,4cyclictest25-21ksoftirqd/114:30:571
5888992114,4cyclictest25-21ksoftirqd/112:19:481
5888992114,4cyclictest25-21ksoftirqd/110:45:301
5888992114,4cyclictest12774-21grep13:43:071
5888992114,3cyclictest26774-21irqrtprio14:38:131
5888992014,3cyclictest25-21ksoftirqd/110:33:581
5888992014,3cyclictest10116-21latency09:28:101
5888992013,4cyclictest5901-21df_inode10:28:021
5888992013,4cyclictest16456-21cat09:43:011
5888992013,3cyclictest31649-21diskmemload12:08:501
5888992012,4cyclictest17047-21fschecks_time13:48:131
588899201,16cyclictest26457-21sed10:03:061
588899193,10cyclictest679-21apt-get10:18:031
5888991913,3cyclictest29725-21if_enp1s0.113:23:111
5888991913,3cyclictest22917-21users13:13:281
5888991913,3cyclictest10103-21proc_pri12:58:181
5888991912,4cyclictest31649-21diskmemload12:34:571
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional