You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 05:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

ARM Broadcom BCM2711 @1500 MHz, Linux 5.15.45-rt46-v7l (Profile)

Latency plot of shadow in rack #4, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue Jan 31, 2023 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
940721480,3sleep30-21swapper/323:07:563
940721480,3sleep30-21swapper/323:07:563
1190821370,3sleep30-21swapper/319:44:253
1190821370,3sleep30-21swapper/319:44:253
1976721340,3sleep30-21swapper/322:40:063
1976721340,3sleep30-21swapper/322:40:063
1749921260,10sleep338-21ksoftirqd/300:37:183
1749921260,10sleep338-21ksoftirqd/300:37:183
825021200,12sleep338-21ksoftirqd/321:46:453
825021200,12sleep338-21ksoftirqd/321:46:453
662721010,4sleep121051-21kworker/u8:223:44:031
662721010,4sleep121051-21kworker/u8:223:44:031
177722950,3sleep30-21swapper/319:59:233
177722950,3sleep30-21swapper/319:59:233
277922830,3sleep00-21swapper/022:10:130
277922830,3sleep00-21swapper/022:10:130
297512740,2chrt0-21swapper/320:29:293
135222700,2sleep00-21swapper/023:51:050
223302690,3chrt0-21swapper/300:44:093
223302690,3chrt0-21swapper/300:44:093
71362670,4chrt0-21swapper/023:44:220
71362670,4chrt0-21swapper/023:44:220
319742670,4sleep10-21swapper/122:54:471
319742670,4sleep10-21swapper/122:54:471
3230699663,21cyclictest141rcu_preempt20:34:182
212472660,2chrt0-21swapper/321:23:343
212472660,2chrt0-21swapper/321:23:343
215202610,9sleep231-21ksoftirqd/221:24:022
215202610,9sleep231-21ksoftirqd/221:24:022
290722600,2sleep129076-21head00:09:351
290722600,2sleep129076-21head00:09:351
3230699574,42cyclictest30171-21ssh22:14:232
3230699574,42cyclictest30171-21ssh22:14:232
3230599577,36cyclictest2820-21store00:19:231
3230599577,36cyclictest2820-21store00:19:231
229522570,3chrt0-21swapper/300:02:573
229522570,3chrt0-21swapper/300:02:573
154962570,3chrt0-21swapper/023:54:180
154962570,3chrt0-21swapper/023:54:180
3230699565,37cyclictest7038-21ssh00:24:222
3230699565,37cyclictest7038-21ssh00:24:222
301622560,3sleep00-21swapper/000:11:470
301622560,3sleep00-21swapper/000:11:470
26632560,3chrt0-21swapper/219:19:282
81412550,2chrt0-21swapper/019:34:250
234592550,2sleep00-21swapper/023:24:240
234592550,2sleep00-21swapper/023:24:240
136952550,3chrt0-21swapper/322:34:083
142032540,3chrt0-21swapper/200:33:312
142032540,3chrt0-21swapper/200:33:312
3230699527,39cyclictest26393-21ssh22:49:192
3230699527,39cyclictest26393-21ssh22:49:192
32304995129,15cyclictest52150irq/51-eth021:39:190
311232510,2chrt0-21swapper/321:34:323
311232510,2chrt0-21swapper/321:34:323
273192510,3sleep20-21swapper/220:24:302
273192510,3sleep20-21swapper/220:24:302
102382500,3sleep010235-21ssh23:09:130
102382500,3sleep010235-21ssh23:09:130
3230699494,5cyclictest141rcu_preempt20:19:192
3230699494,5cyclictest141rcu_preempt20:19:192
222952490,4sleep10-21swapper/100:44:081
222952490,4sleep10-21swapper/100:44:081
86452480,3sleep20-21swapper/223:06:342
86452480,3sleep20-21swapper/223:06:342
3230599483,34cyclictest14822-21ssh00:34:201
3230599483,34cyclictest14822-21ssh00:34:201
3230699473,6cyclictest141rcu_preempt19:59:172
3230699473,6cyclictest141rcu_preempt19:59:172
326682460,2chrt0-21swapper/022:56:030
326682460,2chrt0-21swapper/022:56:030
3230699462,4cyclictest141rcu_preempt21:14:212
3230599466,34cyclictest29944-21ssh21:34:181
3230599466,34cyclictest29944-21ssh21:34:181
3230499466,29cyclictest52150irq/51-eth020:24:190
3230499466,29cyclictest52150irq/51-eth020:24:190
304612460,3chrt0-21swapper/023:33:000
304612460,3chrt0-21swapper/023:33:000
270522460,2chrt0-21swapper/120:24:251
270522460,2chrt0-21swapper/120:24:251
26822460,2sleep30-21swapper/322:19:333
26822460,2sleep30-21swapper/322:19:333
3230699453,9cyclictest141rcu_preempt23:34:202
3230699453,9cyclictest141rcu_preempt23:34:202
294232440,2sleep20-21swapper/220:29:252
237532440,2chrt0-21swapper/122:05:161
237532440,2chrt0-21swapper/122:05:161
19162440,3chrt0-21swapper/122:19:231
19162440,3chrt0-21swapper/122:19:231
3230699432,7cyclictest141rcu_preempt23:29:162
3230699432,7cyclictest141rcu_preempt23:29:162
3230599434,33cyclictest5762-21ssh21:44:221
3230599434,33cyclictest5762-21ssh21:44:221
285702430,3chrt0-21swapper/321:32:073
285702430,3chrt0-21swapper/321:32:073
221852430,3sleep20-21swapper/221:24:262
3230699422,6cyclictest141rcu_preempt19:14:152
3230599424,30cyclictest9826-21ssh22:29:211
3230599423,33cyclictest9804-21ssh21:49:191
3230599423,33cyclictest9804-21ssh21:49:191
3230499426,25cyclictest52150irq/51-eth021:09:170
3230499426,25cyclictest52150irq/51-eth021:09:170
32304994230,10cyclictest13-21ksoftirqd/019:49:110
3230699413,25cyclictest17813-21ssh21:59:182
3230699413,25cyclictest17813-21ssh21:59:182
3230499414,24cyclictest52150irq/51-eth021:44:230
3230499414,24cyclictest52150irq/51-eth021:44:230
3230499412,35cyclictest17717-21ssh21:19:190
3230499412,35cyclictest17717-21ssh21:19:190
3230499407,24cyclictest52150irq/51-eth023:19:180
3230499407,24cyclictest52150irq/51-eth023:19:180
3230499403,33cyclictest6206-21ssh23:04:210
3230499403,33cyclictest6206-21ssh23:04:210
32304994023,4cyclictest13-21ksoftirqd/000:19:230
32304994023,4cyclictest13-21ksoftirqd/000:19:230
321902400,3sleep30-21swapper/322:15:553
321902400,3sleep30-21swapper/322:15:553
286962400,2chrt0-21swapper/122:51:181
286962400,2chrt0-21swapper/122:51:181
44112390,3sleep30-21swapper/321:42:193
3230699394,26cyclictest22414-21ssh00:44:122
3230699394,26cyclictest22414-21ssh00:44:122
3230699392,3cyclictest141rcu_preempt20:49:192
3230699392,3cyclictest141rcu_preempt20:49:192
32304993915,18cyclictest52150irq/51-eth021:49:200
32304993915,18cyclictest52150irq/51-eth021:49:200
65972380,3chrt6588-21ssh23:04:241
65972380,3chrt6588-21ssh23:04:241
3230599383,32cyclictest10902-21ssh00:29:191
3230599383,32cyclictest10902-21ssh00:29:191
3230599382,24cyclictest17806-21sh21:59:181
3230599382,24cyclictest17806-21sh21:59:181
14392370,1chrt38-21ksoftirqd/323:36:493
14392370,1chrt38-21ksoftirqd/323:36:493
133542370,3sleep00-21swapper/019:49:080
47852360,2sleep04797-21sh23:01:590
47852360,2sleep04797-21sh23:01:590
3230599365,26cyclictest1584-21ssh21:39:191
32304993620,13cyclictest13-21ksoftirqd/019:54:180
32304993620,13cyclictest13-21ksoftirqd/019:54:180
3230699353,2cyclictest141rcu_preempt23:19:192
3230699353,2cyclictest141rcu_preempt23:19:192
32305993510,19cyclictest24-21ksoftirqd/123:59:201
32305993510,19cyclictest24-21ksoftirqd/123:59:201
3230699348,20cyclictest11596-21kworker/u8:021:34:202
3230699348,20cyclictest11596-21kworker/u8:021:34:202
32305993423,7cyclictest24-21ksoftirqd/122:44:241
3230499345,19cyclictest52150irq/51-eth022:29:210
3230499343,23cyclictest52150irq/51-eth022:44:230
32304993421,4cyclictest13-21ksoftirqd/021:59:260
32304993421,4cyclictest13-21ksoftirqd/021:59:260
220222340,3sleep30-21swapper/321:24:233
177632340,2sleep217788-21cat22:39:022
177632340,2sleep217788-21cat22:39:022
172462340,2sleep00-21swapper/022:38:020
172462340,2sleep00-21swapper/022:38:020
148512340,3sleep30-21swapper/322:34:323
148512340,3sleep30-21swapper/322:34:323
123012340,3sleep3371rcuc/321:51:443
123012340,3sleep3371rcuc/321:51:443
42602330,2sleep20-21swapper/200:19:412
42602330,2sleep20-21swapper/200:19:412
3230699333,24cyclictest5770-21taskset22:24:192
3230699333,24cyclictest5770-21taskset22:24:192
3230699333,24cyclictest5770-21taskset22:24:192
3230699332,26cyclictest10327-21ssh23:09:212
3230699332,26cyclictest10327-21ssh23:09:212
3230599333,24cyclictest23934-21ssh00:04:221
3230599333,24cyclictest23934-21ssh00:04:221
3230499336,21cyclictest52150irq/51-eth023:39:210
3230499336,21cyclictest52150irq/51-eth023:39:210
32304993313,13cyclictest13-21ksoftirqd/019:19:180
283932330,2sleep30-21swapper/322:11:253
283932330,2sleep30-21swapper/322:11:253
32306993214,14cyclictest31-21ksoftirqd/222:39:172
32306993214,14cyclictest31-21ksoftirqd/222:39:172
3230499326,19cyclictest52150irq/51-eth020:09:180
3230499326,19cyclictest52150irq/51-eth020:09:180
32304993220,10cyclictest13-21ksoftirqd/000:19:100
32304993220,10cyclictest13-21ksoftirqd/000:19:100
32304993210,17cyclictest52150irq/51-eth022:19:190
32304993210,17cyclictest52150irq/51-eth022:19:190
3230699312,23cyclictest22073-21ssh22:04:202
3230699312,23cyclictest22073-21ssh22:04:202
32304993124,5cyclictest23164-21ssh21:24:360
3230499312,23cyclictest0-21swapper/000:34:200
3230499312,23cyclictest0-21swapper/000:34:200
32304993119,3cyclictest52250irq/52-eth022:39:170
32304993119,3cyclictest52250irq/52-eth022:39:170
32304993117,8cyclictest0-21swapper/019:29:180
32304993117,8cyclictest0-21swapper/019:29:180
165392310,1sleep10-21swapper/123:15:491
165392310,1sleep10-21swapper/123:15:491
81852300,2sleep30-21swapper/322:26:363
81852300,2sleep30-21swapper/322:26:363
81852300,2sleep30-21swapper/322:26:363
32304993022,4cyclictest10892-21ssh00:29:180
32304993022,4cyclictest10892-21ssh00:29:180
319272305,18sleep30-21swapper/319:11:333
174032300,2sleep017596-21gltestperf19:59:210
174032300,2sleep017596-21gltestperf19:59:210
7132290,22sleep10-21swapper/119:14:251
47632290,3sleep30-21swapper/320:49:313
47632290,3sleep30-21swapper/320:49:313
3230699293,22cyclictest27737-21ssh00:09:192
3230699293,22cyclictest27737-21ssh00:09:192
3230599291,26cyclictest11334-21ssh23:49:191
3230499297,17cyclictest13-21ksoftirqd/021:04:180
3230499297,17cyclictest13-21ksoftirqd/021:04:180
3230499297,15cyclictest0-21swapper/000:39:230
3230499297,15cyclictest0-21swapper/000:39:230
3230499292,10cyclictest19685-21ssh23:59:220
3230499292,10cyclictest19685-21ssh23:59:220
32304992919,8cyclictest13-21ksoftirqd/020:24:100
32304992919,8cyclictest13-21ksoftirqd/020:24:100
32304992911,4cyclictest141rcu_preempt23:34:200
32304992911,4cyclictest141rcu_preempt23:34:200
320842296,17sleep00-21swapper/019:13:320
320492296,17sleep20-21swapper/219:13:062
3230599284,19cyclictest13831-21ssh21:54:181
3230499282,19cyclictest14505-21ssh23:14:220
3230499282,19cyclictest14505-21ssh23:14:220
32304992821,4cyclictest13-21ksoftirqd/019:39:210
32304992821,4cyclictest13-21ksoftirqd/019:39:210
318152285,17sleep10-21swapper/119:10:101
212632280,3sleep30-21swapper/323:21:423
212632280,3sleep30-21swapper/323:21:423
16922280,3sleep20-21swapper/221:39:212
3230699276,8cyclictest141rcu_preempt20:54:192
3230699276,8cyclictest141rcu_preempt20:54:192
3230699273,19cyclictest25872-21taskset21:29:202
3230699273,19cyclictest25872-21taskset21:29:202
3230699272,20cyclictest2154-21ssh22:59:212
3230699272,20cyclictest2154-21ssh22:59:212
32304992722,3cyclictest19939-21snmpd21:14:330
3230499271,19cyclictest19939-21snmpd00:04:220
3230499271,19cyclictest19939-21snmpd00:04:220
85912260,2sleep20-21swapper/219:34:312
3230699261,22cyclictest0-21swapper/222:54:202
3230699261,22cyclictest0-21swapper/222:54:202
3230499263,17cyclictest19160-21runrttasks20:04:190
3230499263,17cyclictest19160-21runrttasks20:04:190
32304992613,8cyclictest0-21swapper/020:39:200
3230499261,23cyclictest4920-21timerandwakeup20:49:320
3230499261,23cyclictest4920-21timerandwakeup20:49:320
99042250,2sleep30-21swapper/319:39:223
99042250,2sleep30-21swapper/319:39:223
58302250,3sleep20-21swapper/219:29:212
58302250,3sleep20-21swapper/219:29:212
3230799255,14cyclictest0-21swapper/322:04:123
3230799255,14cyclictest0-21swapper/322:04:123
32306992514,8cyclictest281irq_work/200:14:212
32306992514,8cyclictest281irq_work/200:14:212
3230599256,12cyclictest24-21ksoftirqd/120:04:181
3230599256,12cyclictest24-21ksoftirqd/120:04:181
32305992519,3cyclictest24-21ksoftirqd/120:24:061
32305992519,3cyclictest24-21ksoftirqd/120:24:061
32304992520,3cyclictest13-21ksoftirqd/020:44:370
32304992519,3cyclictest13-21ksoftirqd/000:27:040
32304992519,3cyclictest13-21ksoftirqd/000:27:040
32304992518,3cyclictest13-21ksoftirqd/020:14:340
32304992518,3cyclictest13-21ksoftirqd/020:14:340
244942250,3sleep30-21swapper/322:06:433
244942250,3sleep30-21swapper/322:06:433
124262250,3sleep30-21swapper/323:11:013
124262250,3sleep30-21swapper/323:11:013
104252250,1sleep2301rcuc/219:39:292
104252250,1sleep2301rcuc/219:39:292
3230599242,5cyclictest141rcu_preempt20:39:201
32305992415,5cyclictest0-21swapper/120:09:181
32305992415,5cyclictest0-21swapper/120:09:181
3230499242,17cyclictest25868-21apt-get21:29:190
3230499242,17cyclictest25868-21apt-get21:29:190
32304992419,4cyclictest52150irq/51-eth022:14:230
32304992419,4cyclictest52150irq/51-eth022:14:230
32304992418,3cyclictest13-21ksoftirqd/022:09:020
32304992418,3cyclictest13-21ksoftirqd/022:09:020
32304992413,9cyclictest13-21ksoftirqd/022:52:500
32304992413,9cyclictest13-21ksoftirqd/022:52:500
32304992413,3cyclictest13-21ksoftirqd/019:14:260
251262240,4sleep30-21swapper/300:04:383
251262240,4sleep30-21swapper/300:04:383
148092240,3sleep30-21swapper/321:54:293
32306992313,7cyclictest32301-21cyclictest23:39:212
32306992313,7cyclictest32301-21cyclictest23:39:212
3230599236,10cyclictest24-21ksoftirqd/100:19:041
3230599236,10cyclictest24-21ksoftirqd/100:19:041
3230599233,16cyclictest24-21ksoftirqd/122:09:171
3230599233,16cyclictest24-21ksoftirqd/122:09:171
3230599233,16cyclictest18629-21sh23:19:181
3230599233,16cyclictest18629-21sh23:19:181
32305992314,7cyclictest24-21ksoftirqd/122:39:011
32305992314,7cyclictest24-21ksoftirqd/122:39:011
32305992312,8cyclictest24-21ksoftirqd/119:29:181
32305992312,8cyclictest24-21ksoftirqd/119:29:181
32305992310,11cyclictest24-21ksoftirqd/120:32:291
3230499237,14cyclictest30896-21fschecks_time20:34:210
32304992317,3cyclictest13-21ksoftirqd/020:54:190
32304992317,3cyclictest13-21ksoftirqd/020:54:190
32304992317,3cyclictest13-21ksoftirqd/019:24:190
3230699224,10cyclictest31-21ksoftirqd/220:44:222
3230699223,8cyclictest141rcu_preempt21:44:212
3230699223,8cyclictest141rcu_preempt21:44:212
3230699221,17cyclictest4764-21ls19:24:312
3230599228,8cyclictest24-21ksoftirqd/123:04:071
3230599228,8cyclictest24-21ksoftirqd/123:04:071
3230599224,9cyclictest141rcu_preempt21:15:571
3230599223,12cyclictest7142-21ssh23:44:221
3230599223,12cyclictest7142-21ssh23:44:221
32305992217,2cyclictest24-21ksoftirqd/120:14:211
32305992217,2cyclictest24-21ksoftirqd/120:14:211
3230499222,16cyclictest0-21swapper/021:04:080
32304992216,4cyclictest141rcu_preempt21:34:200
32304992216,4cyclictest141rcu_preempt21:34:200
32304992216,3cyclictest13-21ksoftirqd/021:54:170
32304992216,3cyclictest13-21ksoftirqd/020:29:180
32304992215,5cyclictest13461-21/usr/sbin/munin19:49:220
318822220,2sleep30-21swapper/322:54:373
318822220,2sleep30-21swapper/322:54:373
3230799216,11cyclictest0-21swapper/300:19:233
3230799216,11cyclictest0-21swapper/300:19:233
3230799215,13cyclictest0-21swapper/323:14:233
3230799215,13cyclictest0-21swapper/323:14:233
3230799213,12cyclictest0-21swapper/323:54:183
3230799213,12cyclictest0-21swapper/323:54:183
3230699214,13cyclictest0-21swapper/220:59:192
3230699211,16cyclictest13234-21diskmemload23:54:192
3230699211,16cyclictest13234-21diskmemload23:54:192
32306992110,8cyclictest31-21ksoftirqd/219:44:192
32306992110,8cyclictest31-21ksoftirqd/219:44:192
3230599219,9cyclictest24-21ksoftirqd/123:11:081
3230599219,9cyclictest24-21ksoftirqd/123:11:081
3230599219,3cyclictest141rcu_preempt23:58:041
3230599219,3cyclictest141rcu_preempt23:58:041
3230599214,5cyclictest17401-21seq19:59:201
3230599214,5cyclictest17401-21seq19:59:201
3230599211,9cyclictest26788-21sh23:29:021
3230599211,9cyclictest26788-21sh23:29:021
32305992114,5cyclictest9395-21ssh22:28:561
32305992114,5cyclictest9395-21ssh22:28:561
32305992114,5cyclictest9395-21ssh22:28:561
3230599211,18cyclictest22475-21ls21:24:281
3230599211,18cyclictest14001-21ls19:49:251
3230599211,17cyclictest7303-21cut00:24:261
3230599211,17cyclictest7303-21cut00:24:261
32304992115,3cyclictest13-21ksoftirqd/022:24:200
32304992115,3cyclictest13-21ksoftirqd/022:24:200
32304992115,3cyclictest13-21ksoftirqd/022:24:200
3230699201,15cyclictest9838-21ssh22:29:212
3230699201,15cyclictest19676-21ssh23:59:212
3230699201,15cyclictest19676-21ssh23:59:212
3230599202,8cyclictest141rcu_preempt23:34:421
3230599202,8cyclictest141rcu_preempt23:34:421
32305992013,5cyclictest301-21ssh22:16:591
32305992013,5cyclictest301-21ssh22:16:591
37682191,3sleep30-21swapper/319:24:163
3230699194,11cyclictest31-21ksoftirqd/219:49:182
3230699192,11cyclictest22969-21ssh23:24:202
3230699192,11cyclictest22969-21ssh23:24:202
32306991912,5cyclictest1732-21kworker/u8:121:49:332
32306991912,5cyclictest1732-21kworker/u8:121:49:332
32306991911,6cyclictest26061-21ssh00:06:162
32306991911,6cyclictest26061-21ssh00:06:162
3230699191,12cyclictest32553-21find20:39:202
3230599198,9cyclictest4034-21fschecks_count20:49:231
3230599198,9cyclictest4034-21fschecks_count20:49:231
3230599198,9cyclictest10724-21tail19:39:311
3230599198,9cyclictest10724-21tail19:39:311
3230599193,8cyclictest141rcu_preempt19:54:251
3230599193,8cyclictest141rcu_preempt19:54:251
32305991913,3cyclictest24-21ksoftirqd/121:29:341
32305991913,3cyclictest24-21ksoftirqd/121:29:341
32305991911,5cyclictest22017-21date22:44:031
32305991911,5cyclictest22017-21date22:44:031
3230599191,10cyclictest6506-21ntpq20:54:281
3230599191,10cyclictest6506-21ntpq20:54:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional