You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-15 - 06:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sun Sep 15, 2024 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3093221220,3sleep20-21swapper/222:25:192
3093221220,3sleep20-21swapper/222:25:192
993221100,3sleep30-21swapper/321:30:173
993221100,3sleep30-21swapper/321:30:173
989021040,2chrt9891-21/usr/sbin/munin20:05:120
989021040,2chrt9891-21/usr/sbin/munin20:05:120
303222880,2sleep30-21swapper/319:35:043
303222880,2sleep30-21swapper/319:35:043
2276999801,38cyclictest13176-21taskset00:30:101
2276999801,38cyclictest13176-21taskset00:30:101
172672740,3sleep20-21swapper/221:50:142
172672740,3sleep20-21swapper/221:50:142
22768997257,12cyclictest22767-21cyclictest23:30:080
22768997257,12cyclictest22767-21cyclictest23:30:080
120352680,3sleep30-21swapper/320:10:173
120352680,3sleep30-21swapper/320:10:173
304392640,3chrt0-21swapper/319:35:083
82292580,1sleep10-21swapper/120:00:191
82292580,1sleep10-21swapper/120:00:191
2276999582,46cyclictest13173-21chrt20:15:101
2276999582,46cyclictest13173-21chrt20:15:101
95932570,6sleep19596-21sed00:20:151
95932570,6sleep19596-21sed00:20:151
22768995644,5cyclictest0-21swapper/021:50:100
22768995644,5cyclictest0-21swapper/021:50:100
84452550,2sleep30-21swapper/322:50:253
84452550,2sleep30-21swapper/322:50:253
158882550,3sleep20-21swapper/221:45:192
285692490,3sleep20-21swapper/222:20:132
285692490,3sleep20-21swapper/222:20:132
22769994923,17cyclictest281ktimers/123:55:091
22769994923,17cyclictest281ktimers/123:55:091
2276899496,36cyclictest690-21gpm22:15:100
2276899496,36cyclictest690-21gpm22:15:100
22768994932,11cyclictest0-21swapper/000:05:040
22768994932,11cyclictest0-21swapper/000:05:040
311702470,2chrt31171-21/usr/sbin/munin19:35:181
304692470,4sleep20-21swapper/221:00:132
304692470,4sleep20-21swapper/221:00:132
22768994724,17cyclictest171ktimers/000:35:110
22768994724,17cyclictest171ktimers/000:35:110
169002470,4chrt0-21swapper/323:15:133
169002470,4chrt0-21swapper/323:15:133
117162460,2chrt0-21swapper/123:00:191
117162460,2chrt0-21swapper/123:00:191
2276899454,37cyclictest5641-21sed19:55:060
313332440,2sleep10-21swapper/122:25:221
313332440,2sleep10-21swapper/122:25:221
303182440,3chrt0-21swapper/322:25:123
303182440,3chrt0-21swapper/322:25:123
2276999442,32cyclictest3784-21tune2fs00:05:121
2276999442,32cyclictest3784-21tune2fs00:05:121
22768994432,8cyclictest36350irq/47-eth022:40:090
22768994432,8cyclictest36350irq/47-eth022:40:090
215332430,4sleep20-21swapper/219:10:172
215332430,4sleep20-21swapper/219:10:172
186342430,9sleep1281ktimers/123:20:051
186342430,9sleep1281ktimers/123:20:051
156802430,3sleep30-21swapper/320:20:143
156802430,3sleep30-21swapper/320:20:143
2276899424,33cyclictest18941-21runrttasks20:30:100
2276899424,33cyclictest18941-21runrttasks20:30:100
22768994225,9cyclictest36350irq/47-eth023:40:070
22768994225,9cyclictest36350irq/47-eth023:40:070
5602410,3chrt0-21swapper/122:30:251
5602410,3chrt0-21swapper/122:30:251
43742400,3sleep20-21swapper/200:05:202
43742400,3sleep20-21swapper/200:05:202
18922400,3sleep20-21swapper/219:45:132
18922400,3sleep20-21swapper/219:45:132
22768993922,12cyclictest171ktimers/023:10:080
22768993922,12cyclictest171ktimers/023:10:080
136602390,3chrt0-21swapper/123:05:181
136602390,3chrt0-21swapper/123:05:181
46122380,3chrt0-21swapper/321:15:223
46122380,3chrt0-21swapper/321:15:223
2277199384,28cyclictest3266-21chrt00:05:013
2277199384,28cyclictest3266-21chrt00:05:013
36142370,2sleep13404-21latency_hist19:50:021
36142370,2sleep13404-21latency_hist19:50:021
2276899376,20cyclictest36350irq/47-eth000:25:080
2276899374,29cyclictest799-21runrttasks19:20:090
2276899374,29cyclictest799-21runrttasks19:20:090
50052360,3sleep30-21swapper/322:44:583
50052360,3sleep30-21swapper/322:44:583
2276999368,22cyclictest693-21avahi-daemon20:55:101
2276999368,22cyclictest693-21avahi-daemon20:55:101
22768993630,4cyclictest17072-21cut23:15:140
22768993630,4cyclictest17072-21cut23:15:140
22768993615,17cyclictest9274-21apt-get00:20:120
22768993611,17cyclictest171ktimers/022:55:100
22768993611,17cyclictest171ktimers/022:55:100
15752360,2sleep20-21swapper/222:35:132
15752360,2sleep20-21swapper/222:35:132
288102350,3sleep20-21swapper/223:45:152
288102350,3sleep20-21swapper/223:45:152
2276899351,29cyclictest3595-21cpuspeed00:05:100
2276899351,29cyclictest3595-21cpuspeed00:05:100
22769993427,4cyclictest798-21systemd-logind00:40:011
22769993427,4cyclictest798-21systemd-logind00:40:011
22768993424,7cyclictest0-21swapper/020:25:090
22768993424,7cyclictest0-21swapper/020:25:090
22768993424,6cyclictest13173-21apt-get00:30:100
22768993424,6cyclictest13173-21apt-get00:30:100
22768993422,6cyclictest0-21swapper/022:25:100
22768993422,6cyclictest0-21swapper/022:25:100
2276899341,28cyclictest799-21runrttasks22:45:090
2276899341,28cyclictest799-21runrttasks22:45:090
22769993327,4cyclictest9042-21runrttasks21:29:581
22769993327,4cyclictest9042-21runrttasks21:29:581
22769993327,4cyclictest5687-21polkitd21:30:211
22769993327,4cyclictest5687-21polkitd21:30:211
22769993326,5cyclictest3086-21cron22:39:581
22769993326,5cyclictest3086-21cron22:39:581
2276899336,19cyclictest36350irq/47-eth022:05:090
22768993327,4cyclictest22767-21cyclictest20:45:130
22768993327,4cyclictest22767-21cyclictest20:45:130
2276899331,28cyclictest0-21swapper/022:10:100
22769993224,6cyclictest31852-21idleruntime-cro23:54:581
22769993224,6cyclictest31852-21idleruntime-cro23:54:581
2276899326,17cyclictest36350irq/47-eth019:50:100
2276899325,20cyclictest36350irq/47-eth000:25:100
2276899325,20cyclictest36350irq/47-eth000:25:100
22768993226,4cyclictest3250-21latency_hist21:14:580
22768993225,4cyclictest11292-21apt-get20:10:070
22768993225,4cyclictest11292-21apt-get20:10:070
22768993221,6cyclictest590-21192.168.115.40-manager22:01:170
22768993221,6cyclictest590-21192.168.115.40-manager22:01:170
22769993125,4cyclictest4770-21switchtime19:50:211
22769993125,4cyclictest4770-21switchtime19:50:211
22769993124,5cyclictest29391-21switchtime19:30:221
22769993124,5cyclictest29391-21switchtime19:30:221
2276999312,25cyclictest22796-21chrt19:15:081
2276999312,25cyclictest22796-21chrt19:15:081
2276999312,23cyclictest14998-21latency_hist21:45:071
22768993125,5cyclictest23082-21gltestperf19:15:120
22768993125,5cyclictest23082-21gltestperf19:15:120
22768993113,11cyclictest0-21swapper/000:40:100
22768993113,11cyclictest0-21swapper/000:40:100
2277199302,19cyclictest14867-21chrt23:10:103
2277199302,19cyclictest14867-21chrt23:10:103
22769993025,3cyclictest0-21swapper/120:34:571
22769993025,3cyclictest0-21swapper/120:34:571
22769993023,6cyclictest27519-21threads20:50:211
22768993024,4cyclictest799-21runrttasks19:50:050
22768993024,4cyclictest799-21runrttasks19:50:050
22768993023,5cyclictest5975-21kernelversion21:20:150
22768993023,5cyclictest5975-21kernelversion21:20:150
22768993023,5cyclictest16629-21sshd20:24:220
22768993023,5cyclictest16629-21sshd20:24:220
22768993022,6cyclictest20369-21latency_hist23:24:580
22768993022,6cyclictest20369-21latency_hist23:24:580
22768993022,6cyclictest20369-21latency_hist23:24:580
2276899302,20cyclictest10979-21taskset23:00:100
2276899302,20cyclictest10979-21taskset23:00:100
222522307,15sleep10-21swapper/119:11:461
222522307,15sleep10-21swapper/119:11:461
195852300,3sleep10-21swapper/123:20:211
195852300,3sleep10-21swapper/123:20:211
195852300,3sleep10-21swapper/123:20:211
93702290,3sleep10-21swapper/122:55:131
93702290,3sleep10-21swapper/122:55:131
22769992924,3cyclictest5687-21polkitd21:20:211
22769992924,3cyclictest5687-21polkitd21:20:211
22769992921,6cyclictest22767-21cyclictest23:34:361
22769992921,6cyclictest22767-21cyclictest23:34:361
22769992921,5cyclictest18858-21latency_hist00:45:061
22769992921,5cyclictest18858-21latency_hist00:45:061
2276899294,18cyclictest171ktimers/019:55:080
2276899294,18cyclictest171ktimers/019:55:080
22768992924,3cyclictest0-21swapper/020:50:210
22768992922,5cyclictest355-21processes22:30:230
22768992922,5cyclictest355-21processes22:30:230
2276899291,21cyclictest30414-21latency_hist19:35:070
223262296,15sleep00-21swapper/019:12:420
223262296,15sleep00-21swapper/019:12:420
313202280,2chrt0-21swapper/321:00:223
313202280,2chrt0-21swapper/321:00:223
2277199288,16cyclictest0-21swapper/300:05:083
2277199288,16cyclictest0-21swapper/300:05:083
22769992823,3cyclictest11639-21gltestperf20:10:121
22769992823,3cyclictest11639-21gltestperf20:10:121
22769992822,4cyclictest0-21swapper/121:59:571
22769992822,4cyclictest0-21swapper/121:59:571
22769992821,5cyclictest22767-21cyclictest20:09:481
22769992821,5cyclictest22767-21cyclictest20:09:481
22769992821,5cyclictest22449-21sshd20:39:211
22769992821,5cyclictest22449-21sshd20:39:211
22769992820,6cyclictest28185-21latency_hist22:20:071
22769992820,6cyclictest28185-21latency_hist22:20:071
2276899284,19cyclictest11988-21sendmail-mta21:40:090
22768992824,3cyclictest27093-21head23:40:180
22768992824,3cyclictest27093-21head23:40:180
22768992823,3cyclictest0-21swapper/021:00:210
22768992823,3cyclictest0-21swapper/021:00:210
22768992822,4cyclictest19024-21systemd-journal21:27:300
22768992822,4cyclictest19024-21systemd-journal21:27:300
22768992820,6cyclictest8536-21unixbench-2d00:15:310
22768992820,6cyclictest8536-21unixbench-2d00:15:310
22768992819,7cyclictest30693-21kernelversion23:50:140
22768992819,7cyclictest30693-21kernelversion23:50:140
22768992818,7cyclictest28445-21apt-get19:30:110
100712280,3sleep20-21swapper/220:05:142
100712280,3sleep20-21swapper/220:05:142
2277199272,17cyclictest20668-21chrt22:00:123
2277199272,17cyclictest20668-21chrt22:00:123
22769992722,4cyclictest29908-21latency_hist22:24:581
22769992722,4cyclictest29908-21latency_hist22:24:581
22769992722,3cyclictest0-21swapper/123:35:231
22769992722,3cyclictest0-21swapper/123:35:231
22769992721,5cyclictest24888-21fschecks_time20:45:131
22769992721,5cyclictest24888-21fschecks_time20:45:131
22769992721,3cyclictest0-21swapper/123:45:221
22769992721,3cyclictest0-21swapper/123:45:221
22769992720,4cyclictest22767-21cyclictest00:25:151
22769992720,4cyclictest22767-21cyclictest00:25:151
22769992719,6cyclictest27613-21ls19:25:221
22769992719,6cyclictest27613-21ls19:25:221
22769992716,3cyclictest0-21swapper/121:00:191
22769992716,3cyclictest0-21swapper/121:00:191
2276999271,15cyclictest4496-21tr21:15:211
2276999271,15cyclictest4496-21tr21:15:211
22768992719,6cyclictest5842-21gltestperf00:10:130
22768992716,6cyclictest171ktimers/020:35:090
22768992716,6cyclictest171ktimers/020:35:090
22768992710,13cyclictest0-21swapper/021:15:090
22768992710,13cyclictest0-21swapper/021:15:090
22768992710,12cyclictest171ktimers/019:35:090
224172275,16sleep30-21swapper/319:13:543
224172275,16sleep30-21swapper/319:13:543
21832270,3sleep30-21swapper/321:10:153
17352270,2sleep30-21swapper/322:35:133
17352270,2sleep30-21swapper/322:35:133
56402260,3sleep30-21swapper/322:45:143
56402260,3sleep30-21swapper/322:45:143
271762260,1sleep3431rcuc/320:50:173
22769992620,4cyclictest22767-21cyclictest22:40:071
22769992620,4cyclictest22767-21cyclictest22:40:071
22769992620,4cyclictest0-21swapper/122:50:251
22769992620,4cyclictest0-21swapper/122:50:251
22769992618,6cyclictest23730-21ls20:40:221
22769992618,6cyclictest23730-21ls20:40:221
2276899266,13cyclictest171ktimers/021:45:090
22768992621,3cyclictest0-21swapper/021:35:130
22768992621,3cyclictest0-21swapper/021:35:130
22768992619,5cyclictest24177-21sshd20:42:230
22768992619,5cyclictest24177-21sshd20:42:230
22768992619,4cyclictest0-21swapper/021:30:130
22768992619,4cyclictest0-21swapper/021:30:130
22768992618,5cyclictest0-21swapper/021:55:130
22768992618,5cyclictest0-21swapper/021:55:130
22768992617,7cyclictest32602-21ls23:55:140
22768992617,7cyclictest32602-21ls23:55:140
234142250,2sleep3431rcuc/319:15:143
234142250,2sleep3431rcuc/319:15:143
22769992521,2cyclictest0-21swapper/121:05:221
22769992521,2cyclictest0-21swapper/121:05:221
22769992521,2cyclictest0-21swapper/119:44:581
22769992519,5cyclictest15283-21fschecks_time20:20:111
22769992519,5cyclictest15283-21fschecks_time20:20:111
22769992519,4cyclictest0-21swapper/100:15:151
22769992519,4cyclictest0-21swapper/100:15:151
22768992519,5cyclictest32473-21fschecks_count19:40:130
22768992519,4cyclictest693-21avahi-daemon22:20:210
22768992519,4cyclictest693-21avahi-daemon22:20:210
22768992518,5cyclictest29804-21sshd23:47:590
22768992518,5cyclictest29804-21sshd23:47:590
22768992514,8cyclictest26570-21apt-get19:25:100
22768992514,8cyclictest26570-21apt-get19:25:100
253652240,3sleep30-21swapper/319:20:173
253652240,3sleep30-21swapper/319:20:173
2277099245,8cyclictest0-21swapper/220:15:102
2277099245,8cyclictest0-21swapper/220:15:102
22769992420,2cyclictest0-21swapper/122:00:221
22769992420,2cyclictest0-21swapper/122:00:221
22769992420,2cyclictest0-21swapper/100:04:581
22769992420,2cyclictest0-21swapper/100:04:581
22769992418,3cyclictest0-21swapper/121:35:131
22769992418,3cyclictest0-21swapper/121:35:131
22769992417,4cyclictest0-21swapper/121:45:211
22769992417,4cyclictest0-21swapper/119:20:201
22769992417,4cyclictest0-21swapper/119:20:201
22769992416,6cyclictest18019-21ls21:50:231
22769992416,6cyclictest18019-21ls21:50:231
22769992413,9cyclictest19024-21systemd-journal19:59:581
22769992413,9cyclictest19024-21systemd-journal19:59:581
2276999241,18cyclictest6863-21apt-get22:50:071
2276999241,18cyclictest6863-21apt-get22:50:071
22768992417,5cyclictest13829-21needreboot20:15:180
22768992417,5cyclictest13829-21needreboot20:15:180
22768992417,5cyclictest13217-21fschecks_time23:05:130
22768992417,5cyclictest13217-21fschecks_time23:05:130
22768992417,2cyclictest181rcu_preempt21:09:190
22768992417,2cyclictest181rcu_preempt21:09:190
22768992413,7cyclictest28397-21apt-get20:55:100
22768992413,7cyclictest28397-21apt-get20:55:100
2277099233,10cyclictest0-21swapper/220:45:112
2277099233,10cyclictest0-21swapper/220:45:112
22769992317,4cyclictest26674-21fschecks_time23:40:141
22769992317,4cyclictest26674-21fschecks_time23:40:141
22769992316,5cyclictest6001-21kernelversion00:10:151
2276999231,20cyclictest3564-21wc21:15:071
22768992316,2cyclictest181rcu_preempt22:53:090
22768992316,2cyclictest181rcu_preempt22:53:090
22768992316,2cyclictest181rcu_preempt22:40:050
22768992316,2cyclictest181rcu_preempt22:40:050
2277199221,15cyclictest5499-21chrt00:10:083
22770992214,5cyclictest263452sleep223:40:052
22770992214,5cyclictest263452sleep223:40:052
22769992216,4cyclictest0-21swapper/122:05:141
22769992216,3cyclictest0-21swapper/122:10:111
22769992215,4cyclictest0-21swapper/120:29:571
22769992215,4cyclictest0-21swapper/120:29:571
22768992215,2cyclictest181rcu_preempt23:25:100
22768992215,2cyclictest181rcu_preempt23:25:100
22768992214,2cyclictest181rcu_preempt20:01:020
22768992214,2cyclictest181rcu_preempt20:01:020
132782220,3sleep30-21swapper/320:15:123
132782220,3sleep30-21swapper/320:15:123
2277199213,9cyclictest0-21swapper/323:40:043
2277199213,9cyclictest0-21swapper/323:40:043
2277099213,9cyclictest0-21swapper/221:25:112
2277099213,9cyclictest0-21swapper/221:25:112
237952200,2sleep30-21swapper/322:05:223
2277199203,9cyclictest0-21swapper/323:45:103
2277199203,9cyclictest0-21swapper/323:45:103
2277199202,9cyclictest0-21swapper/323:50:103
2277199202,9cyclictest0-21swapper/323:50:103
2277199202,9cyclictest0-21swapper/321:35:113
2277199202,9cyclictest0-21swapper/321:35:113
2277099203,9cyclictest0-21swapper/220:40:112
2277099203,9cyclictest0-21swapper/220:40:112
2277099203,9cyclictest0-21swapper/219:50:062
2277099203,9cyclictest0-21swapper/219:50:062
2277099202,9cyclictest0-21swapper/220:20:092
2277099202,9cyclictest0-21swapper/220:20:092
2277099202,9cyclictest0-21swapper/219:30:112
2277099202,9cyclictest0-21swapper/219:30:112
2277099202,10cyclictest0-21swapper/220:55:122
2277099202,10cyclictest0-21swapper/220:55:122
2277099201,13cyclictest11296-21chrt20:10:082
2277099201,13cyclictest11296-21chrt20:10:082
22769992014,3cyclictest0-21swapper/123:25:201
22769992014,3cyclictest0-21swapper/123:25:201
2277199193,9cyclictest0-21swapper/323:05:073
2277199193,9cyclictest0-21swapper/323:05:073
2277199192,9cyclictest0-21swapper/319:50:043
2277199192,9cyclictest0-21swapper/319:50:043
2277199192,9cyclictest0-21swapper/300:15:113
2277199192,9cyclictest0-21swapper/300:15:113
2277199192,10cyclictest0-21swapper/300:40:073
2277199192,10cyclictest0-21swapper/300:40:073
2277199191,13cyclictest17044-21taskset00:40:113
2277199191,13cyclictest17044-21taskset00:40:113
2277099191,7cyclictest0-21swapper/200:30:092
2277099191,7cyclictest0-21swapper/200:30:092
2277099191,13cyclictest5498-21chrt21:20:112
2277099191,13cyclictest5498-21chrt21:20:112
2277099191,13cyclictest32296-21chrt23:55:112
2277099191,13cyclictest32296-21chrt23:55:112
22769991913,4cyclictest0-21swapper/123:10:121
22769991913,4cyclictest0-21swapper/123:10:121
176302190,4sleep30-21swapper/321:50:193
176302190,4sleep30-21swapper/321:50:193
109972190,4sleep30-21swapper/320:09:213
109972190,4sleep30-21swapper/320:09:213
2277199183,9cyclictest0-21swapper/319:50:063
2277199183,9cyclictest0-21swapper/319:50:063
2277099182,9cyclictest0-21swapper/223:20:042
2277099182,9cyclictest0-21swapper/223:20:042
2277099182,11cyclictest9102-21taskset22:55:102
2277099182,11cyclictest9102-21taskset22:55:102
2277099181,13cyclictest11177-21chrt23:00:122
2277099181,13cyclictest11177-21chrt23:00:122
2277099181,12cyclictest24660-21chrt22:10:122
2277099181,11cyclictest7100-21chrt22:50:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional