You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-04 - 07:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot6.osadl.org (updated Mon Dec 04, 2023 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1791911160,8ptp4l19700-21kworker/3:020:04:343
179191690,1ptp4l401ktimersoftd/322:33:573
1380996553,5cyclictest25-21ksoftirqd/121:02:571
102022640,6sleep2138599cyclictest00:43:202
76422630,2sleep10-21swapper/123:58:061
1380996353,5cyclictest25-21ksoftirqd/120:48:011
124742630,2sleep00-21swapper/020:28:040
215112610,3sleep2138599cyclictest20:48:022
179191610,1ptp4l401ktimersoftd/300:56:413
120722590,2sleep00-21swapper/021:33:160
179191570,1ptp4l401ktimersoftd/323:08:273
152422570,2sleep3139099cyclictest21:42:383
1380995645,5cyclictest25-21ksoftirqd/123:33:041
1380995627,25cyclictest25-21ksoftirqd/120:23:151
92032550,1sleep00-21swapper/000:41:210
274392540,4sleep2311rcuc/223:38:322
12322544,37sleep20-21swapper/220:07:032
1380995218,7cyclictest25-21ksoftirqd/101:07:431
1380995127,4cyclictest25-21ksoftirqd/100:13:291
1380995126,4cyclictest25-21ksoftirqd/121:23:071
1380995026,8cyclictest25-21ksoftirqd/101:23:031
1380995023,4cyclictest25-21ksoftirqd/123:42:411
179191490,1ptp4l401ktimersoftd/321:21:093
169632490,2sleep20-21swapper/200:08:232
1380994942,4cyclictest25-21ksoftirqd/101:17:481
1380994923,24cyclictest25-21ksoftirqd/122:08:131
1380994919,4cyclictest25-21ksoftirqd/101:12:431
1380994842,3cyclictest25-21ksoftirqd/100:02:451
1380994822,4cyclictest25-21ksoftirqd/122:33:031
179191470,1ptp4l401ktimersoftd/301:12:063
1380994726,7cyclictest25-21ksoftirqd/122:23:041
1380994723,4cyclictest25-21ksoftirqd/121:43:091
1380994723,4cyclictest25-21ksoftirqd/100:20:011
1380994722,4cyclictest25-21ksoftirqd/121:33:061
1380994721,4cyclictest25-21ksoftirqd/100:54:481
1380994720,4cyclictest25-21ksoftirqd/100:35:421
1380994720,4cyclictest25-21ksoftirqd/100:35:421
10232474,30sleep10-21swapper/120:04:201
1380994640,3cyclictest25-21ksoftirqd/121:07:411
1380994619,4cyclictest25-21ksoftirqd/123:52:411
1380994619,4cyclictest25-21ksoftirqd/122:58:031
179191450,2ptp4l13593-21kworker/3:101:03:193
1380994538,4cyclictest25-21ksoftirqd/121:52:431
1380994520,4cyclictest25-21ksoftirqd/100:23:081
1380994519,4cyclictest25-21ksoftirqd/122:56:431
1380994519,4cyclictest25-21ksoftirqd/121:28:121
1380994518,4cyclictest25-21ksoftirqd/101:02:431
1380994513,5cyclictest25-21ksoftirqd/123:17:411
1380994434,3cyclictest25-21ksoftirqd/101:28:271
1380994430,11cyclictest25-21ksoftirqd/123:08:081
1380994419,4cyclictest25-21ksoftirqd/122:14:031
1380994419,3cyclictest25-21ksoftirqd/120:33:111
1380994418,4cyclictest25-21ksoftirqd/120:28:071
1380994418,4cyclictest25-21ksoftirqd/120:13:051
138099441,2cyclictest241ktimersoftd/122:42:391
138099441,2cyclictest241ktimersoftd/122:42:391
179191430,1ptp4l401ktimersoftd/321:24:263
138099439,31cyclictest25-21ksoftirqd/100:48:091
1380994334,3cyclictest25-21ksoftirqd/101:37:441
1380994314,5cyclictest25-21ksoftirqd/121:38:051
1380994312,5cyclictest25-21ksoftirqd/100:08:091
179191420,1ptp4l401ktimersoftd/300:27:103
1380994234,4cyclictest25-21ksoftirqd/121:58:021
1380994221,7cyclictest25-21ksoftirqd/100:28:121
1380994221,7cyclictest25-21ksoftirqd/100:28:121
1380994220,7cyclictest25-21ksoftirqd/122:44:471
1380994220,7cyclictest25-21ksoftirqd/122:44:471
1380994217,4cyclictest25-21ksoftirqd/122:47:541
1380994216,4cyclictest25-21ksoftirqd/120:57:371
1380994216,4cyclictest25-21ksoftirqd/120:57:371
138099421,3cyclictest121rcu_preempt23:28:071
1380994128,10cyclictest25-21ksoftirqd/121:48:171
1380994128,10cyclictest25-21ksoftirqd/120:43:001
1380994120,11cyclictest25-21ksoftirqd/100:38:291
1380994119,6cyclictest25-21ksoftirqd/123:06:051
1380994115,3cyclictest25-21ksoftirqd/123:26:151
1380994113,5cyclictest25-21ksoftirqd/121:13:011
138099410,3cyclictest121rcu_preempt01:13:061
179191400,1ptp4l401ktimersoftd/300:29:193
179191400,1ptp4l401ktimersoftd/300:29:193
179191400,0ptp4l401ktimersoftd/322:47:413
138099407,8cyclictest25-21ksoftirqd/123:19:211
1380994031,7cyclictest25-21ksoftirqd/122:28:211
1380994027,3cyclictest25-21ksoftirqd/123:53:031
1380994027,10cyclictest25-21ksoftirqd/120:18:081
1380994015,4cyclictest25-21ksoftirqd/122:03:061
1380994014,4cyclictest25-21ksoftirqd/122:22:251
179191390,1ptp4l401ktimersoftd/323:38:473
179191390,1ptp4l401ktimersoftd/300:58:383
1380993911,4cyclictest25-21ksoftirqd/120:07:571
179191380,1ptp4l401ktimersoftd/323:57:393
179191380,1ptp4l401ktimersoftd/323:16:193
179191380,1ptp4l401ktimersoftd/323:02:553
179191380,1ptp4l401ktimersoftd/322:42:083
179191380,1ptp4l401ktimersoftd/322:42:083
138099380,3cyclictest25-21ksoftirqd/120:58:031
179191370,1ptp4l401ktimersoftd/323:32:013
179191370,1ptp4l401ktimersoftd/322:21:373
179191370,1ptp4l401ktimersoftd/322:09:053
179191370,1ptp4l401ktimersoftd/321:43:063
179191370,1ptp4l401ktimersoftd/321:09:033
179191370,1ptp4l401ktimersoftd/300:07:063
179191370,0ptp4l401ktimersoftd/322:54:363
179191370,0ptp4l401ktimersoftd/301:20:263
179191370,0ptp4l401ktimersoftd/301:14:363
179191370,0ptp4l401ktimersoftd/300:22:113
1380993731,3cyclictest25-21ksoftirqd/121:18:031
179191360,1ptp4l401ktimersoftd/323:59:333
179191360,1ptp4l401ktimersoftd/322:32:323
179191360,0ptp4l401ktimersoftd/301:32:363
1380993631,3cyclictest25-21ksoftirqd/120:38:071
1380993612,7cyclictest25-21ksoftirqd/100:46:451
321972353,18sleep032290-21/usr/sbin/munin20:03:060
179191350,2ptp4l19700-21kworker/3:020:15:033
179191350,2ptp4l13593-21kworker/3:100:49:313
179191350,1ptp4l401ktimersoftd/323:43:313
179191350,1ptp4l401ktimersoftd/322:43:123
179191350,1ptp4l401ktimersoftd/322:43:123
179191350,1ptp4l401ktimersoftd/300:17:063
179191340,2ptp4l19700-21kworker/3:023:33:463
179191340,1ptp4l401ktimersoftd/323:27:403
179191340,1ptp4l401ktimersoftd/322:13:073
179191340,1ptp4l401ktimersoftd/320:12:283
179191340,1ptp4l401ktimersoftd/301:27:263
179191340,1ptp4l401ktimersoftd/300:37:523
179191340,12ptp4l401ktimersoftd/322:27:273
138099343,3cyclictest121rcu_preempt23:47:411
179191330,2ptp4l19700-21kworker/3:020:37:303
179191330,1ptp4l401ktimersoftd/323:00:553
179191330,1ptp4l401ktimersoftd/321:13:033
179191320,1ptp4l401ktimersoftd/322:03:083
179191320,1ptp4l401ktimersoftd/300:45:123
179191320,10ptp4l401ktimersoftd/320:22:493
100642320,2sleep2138599cyclictest01:34:352
84252310,2sleep30-21swapper/320:18:123
179191310,9ptp4l401ktimersoftd/323:49:033
179191310,1ptp4l401ktimersoftd/320:46:343
179191310,10ptp4l401ktimersoftd/321:04:003
40582300,2sleep20-21swapper/201:24:232
179191290,1ptp4l401ktimersoftd/321:01:043
1376992923,3cyclictest9-21ksoftirqd/022:52:250
1385992823,3cyclictest33-21ksoftirqd/220:12:362
1385992822,3cyclictest33-21ksoftirqd/200:26:262
1385992822,3cyclictest33-21ksoftirqd/200:03:172
1385992821,4cyclictest33-21ksoftirqd/223:32:542
1376992821,4cyclictest9-21ksoftirqd/023:32:440
105962280,6sleep233-21ksoftirqd/200:02:382
81722270,5sleep2138599cyclictest00:38:382
179191270,1ptp4l401ktimersoftd/321:29:373
179191270,10ptp4l401ktimersoftd/323:20:483
14882270,4sleep233-21ksoftirqd/200:31:322
14882270,4sleep233-21ksoftirqd/200:31:322
1390992720,4cyclictest41-21ksoftirqd/321:52:023
1390992720,4cyclictest41-21ksoftirqd/320:28:363
1385992721,4cyclictest33-21ksoftirqd/223:48:082
1385992721,3cyclictest33-21ksoftirqd/220:54:342
1385992721,3cyclictest33-21ksoftirqd/220:54:342
1385992720,4cyclictest33-21ksoftirqd/222:47:212
1385992720,4cyclictest33-21ksoftirqd/222:47:212
1385992720,4cyclictest33-21ksoftirqd/222:12:442
1385992720,4cyclictest33-21ksoftirqd/221:14:352
1385992720,4cyclictest33-21ksoftirqd/221:09:332
1385992720,4cyclictest33-21ksoftirqd/221:01:592
1376992721,3cyclictest9-21ksoftirqd/023:48:420
1376992721,3cyclictest9-21ksoftirqd/020:22:320
1376992720,4cyclictest9-21ksoftirqd/021:26:260
179191260,1ptp4l401ktimersoftd/321:33:393
1385992621,3cyclictest33-21ksoftirqd/201:04:252
1385992620,3cyclictest33-21ksoftirqd/222:57:092
1385992619,4cyclictest33-21ksoftirqd/222:03:572
1385992619,4cyclictest33-21ksoftirqd/221:58:472
1385992619,4cyclictest33-21ksoftirqd/221:49:082
1385992619,4cyclictest33-21ksoftirqd/221:45:392
1385992619,4cyclictest33-21ksoftirqd/221:39:042
1385992619,4cyclictest33-21ksoftirqd/220:22:242
1385992618,4cyclictest33-21ksoftirqd/223:07:572
1376992621,3cyclictest9-21ksoftirqd/001:37:440
1376992620,3cyclictest9-21ksoftirqd/023:10:360
1376992620,3cyclictest9-21ksoftirqd/020:53:560
1376992620,3cyclictest9-21ksoftirqd/020:53:560
179191250,1ptp4l401ktimersoftd/301:33:403
1390992518,4cyclictest41-21ksoftirqd/300:07:443
1390992511,11cyclictest2902-21if_enp1s0.100:33:033
1390992511,11cyclictest2902-21if_enp1s0.100:33:033
1385992520,3cyclictest33-21ksoftirqd/221:03:052
1385992518,4cyclictest33-21ksoftirqd/221:34:312
1376992520,3cyclictest9-21ksoftirqd/023:23:150
1376992520,3cyclictest9-21ksoftirqd/001:20:480
1376992520,3cyclictest9-21ksoftirqd/000:06:500
1376992519,4cyclictest9-21ksoftirqd/021:05:300
1376992519,4cyclictest9-21ksoftirqd/000:32:380
1376992519,4cyclictest9-21ksoftirqd/000:32:380
1376992519,3cyclictest9-21ksoftirqd/021:29:030
1376992518,4cyclictest9-21ksoftirqd/021:55:040
179191240,1ptp4l401ktimersoftd/321:57:403
179191240,1ptp4l401ktimersoftd/321:52:583
179191240,1ptp4l401ktimersoftd/320:52:573
179191240,1ptp4l401ktimersoftd/320:52:573
179191240,1ptp4l401ktimersoftd/320:48:033
179191240,1ptp4l401ktimersoftd/320:38:043
1385992419,3cyclictest33-21ksoftirqd/220:32:362
1385992418,3cyclictest33-21ksoftirqd/200:15:542
1385992417,4cyclictest33-21ksoftirqd/223:15:522
1385992417,4cyclictest33-21ksoftirqd/221:20:582
1385992417,3cyclictest33-21ksoftirqd/222:28:022
1385992416,5cyclictest5053-21grep20:13:002
1385992412,9cyclictest9152-21cron01:32:432
137699243,3cyclictest121rcu_preempt22:57:420
1376992419,3cyclictest9-21ksoftirqd/021:17:300
1376992418,3cyclictest9-21ksoftirqd/021:19:550
1376992418,3cyclictest9-21ksoftirqd/000:51:450
1376992417,4cyclictest9-21ksoftirqd/001:11:000
1376992417,3cyclictest9-21ksoftirqd/021:37:420
138599232,18cyclictest18046-21unixbench_multi00:53:342
1385992317,3cyclictest23514-21tail00:18:102
1376992318,3cyclictest9-21ksoftirqd/001:28:170
1376992318,3cyclictest9-21ksoftirqd/000:33:190
1376992318,3cyclictest9-21ksoftirqd/000:33:190
1376992318,3cyclictest9-21ksoftirqd/000:13:270
1376992317,3cyclictest9-21ksoftirqd/023:58:130
1376992317,3cyclictest9-21ksoftirqd/022:28:520
1376992317,3cyclictest9-21ksoftirqd/022:05:070
1376992316,4cyclictest9-21ksoftirqd/021:52:310
1376992315,5cyclictest26293-21sed23:38:150
138599223,15cyclictest28149-21apt-get01:12:592
1385992217,3cyclictest33-21ksoftirqd/222:33:052
1385992216,3cyclictest33-21ksoftirqd/220:44:562
1385992215,4cyclictest33-21ksoftirqd/223:27:282
1385992215,4cyclictest33-21ksoftirqd/221:29:292
1385992214,5cyclictest31255-21cron22:12:382
1385992213,4cyclictest25163-21sh22:48:132
1385992212,6cyclictest31428-21latency_hist23:47:422
137699229,10cyclictest31612-21latency_hist01:17:430
1376992217,3cyclictest9-21ksoftirqd/020:16:040
1376992217,3cyclictest9-21ksoftirqd/001:02:130
1376992216,3cyclictest9-21ksoftirqd/023:20:480
1376992216,3cyclictest9-21ksoftirqd/020:48:520
1376992216,3cyclictest9-21ksoftirqd/020:43:100
1376992216,3cyclictest9-21ksoftirqd/020:27:080
137699220,2cyclictest121rcu_preempt00:12:200
138599214,9cyclictest9440-21apt-get20:22:572
1385992115,3cyclictest33-21ksoftirqd/223:18:032
1385992115,3cyclictest33-21ksoftirqd/221:26:382
1385992114,4cyclictest14554-21expr20:32:592
138599211,3cyclictest121rcu_preempt00:33:182
138599211,3cyclictest121rcu_preempt00:33:182
1385992112,5cyclictest6665-21cron23:57:402
137699213,11cyclictest63-21kswapd001:02:580
1376992115,3cyclictest9-21ksoftirqd/021:43:000
1376992114,4cyclictest9-21ksoftirqd/020:42:100
1376992114,4cyclictest9-21ksoftirqd/020:08:210
1376992114,4cyclictest21019-21idleruntime-cro22:42:390
1376992114,4cyclictest21019-21idleruntime-cro22:42:390
1376992114,4cyclictest17192-21sed22:37:390
1385992015,3cyclictest33-21ksoftirqd/223:28:062
1385992014,3cyclictest29781-21/usr/sbin/munin22:58:042
1385992013,4cyclictest306-21sh01:19:412
1385992013,4cyclictest17858-21open_files20:38:062
138599201,16cyclictest18492-21memory22:38:102
138599201,16cyclictest18492-21memory22:38:102
1376992015,3cyclictest9-21ksoftirqd/023:53:280
1376992015,3cyclictest9-21ksoftirqd/022:19:090
1376992015,3cyclictest9-21ksoftirqd/020:35:030
1376992014,4cyclictest24987-21latency_hist22:02:390
1376992014,3cyclictest5711-21df22:22:570
1376992013,4cyclictest31264-21idleruntime-cro22:12:380
1385991913,3cyclictest3457-21sh22:18:392
1385991913,3cyclictest33-21ksoftirqd/222:22:582
1385991913,3cyclictest20038-21sh00:57:462
1385991912,4cyclictest26970-21sh01:10:392
1385991911,4cyclictest20415-21cpuspeed_turbos21:52:592
138599190,5cyclictest13018-21/usr/sbin/munin00:48:072
1376991914,3cyclictest16210-21/usr/sbin/munin00:53:090
137699191,3cyclictest10251-21ssh00:43:260
1376991912,4cyclictest46850irq/98-ens3-TxR01:23:010
1376991912,4cyclictest32207-21if_enp1s022:13:010
1376991912,4cyclictest31161-21bc21:07:570
1376991912,4cyclictest27358-21diskmemload23:46:310
1376991912,4cyclictest27202-21expr00:23:050
1376991911,5cyclictest1779-21runrttasks23:31:110
137699190,3cyclictest26037-21ssh00:21:220
137699190,17cyclictest0-21swapper/023:04:240
137699190,17cyclictest0-21swapper/022:43:280
137699190,17cyclictest0-21swapper/022:43:280
1376991812,3cyclictest26195-21cat20:57:570
137699180,16cyclictest0-21swapper/023:13:200
137699180,16cyclictest0-21swapper/022:53:240
1385991711,3cyclictest1779-21runrttasks23:02:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional