You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-23 - 21:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu May 23, 2024 12:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
858321040,3sleep00-21swapper/008:03:120
858321040,3sleep00-21swapper/008:03:120
299422970,3sleep00-21swapper/008:58:230
23152820,3sleep30-21swapper/312:03:213
23152820,3sleep30-21swapper/312:03:213
272472800,2sleep027252-21cpu10:18:180
272472800,2sleep027252-21cpu10:18:180
305682760,2sleep30-21swapper/308:58:343
261502750,3sleep30-21swapper/307:23:193
261502750,3sleep30-21swapper/307:23:193
46772710,1chrt0-21swapper/007:53:110
25692700,3sleep30-21swapper/309:13:133
25692700,3sleep30-21swapper/309:13:133
175962690,2chrt0-21swapper/311:18:153
157232680,2sleep00-21swapper/009:48:070
157232680,2sleep00-21swapper/009:48:070
141332680,3sleep20-21swapper/211:08:212
178902640,2chrt0-21swapper/111:18:211
178902640,2chrt0-21swapper/111:18:211
136092630,2chrt13607-21head08:13:370
136092630,2chrt13607-21head08:13:370
2188899614,42cyclictest25363-21sshd10:13:191
2188899614,42cyclictest25363-21sshd10:13:191
52752600,1chrt0-21swapper/012:08:330
52752600,1chrt0-21swapper/012:08:330
186822600,3sleep20-21swapper/208:28:262
186822600,3sleep20-21swapper/208:28:262
230142570,3chrt0-21swapper/007:13:350
66402560,10sleep0201rcuc/010:48:250
66402560,10sleep0201rcuc/010:48:250
54982540,3sleep00-21swapper/007:53:270
54982540,3sleep00-21swapper/007:53:270
218382540,3chrt21841-21grep10:03:230
218382540,3chrt21841-21grep10:03:230
181832530,3chrt0-21swapper/011:18:240
181832530,3chrt0-21swapper/011:18:240
136522530,2sleep013654-21cat09:43:050
136522530,2sleep013654-21cat09:43:050
213932526,15sleep00-21swapper/007:10:130
213932526,15sleep00-21swapper/007:10:130
283162480,3sleep028319-21unixbench_singl11:43:370
283162480,3sleep028319-21unixbench_singl11:43:370
2188799482,42cyclictest2597-21taskset09:13:150
2188799482,42cyclictest2597-21taskset09:13:150
207722470,2sleep120871-21mailstats07:08:331
207722470,2sleep120871-21mailstats07:08:331
152282450,3sleep0201rcuc/012:38:110
152282450,3sleep0201rcuc/012:38:110
220352430,1sleep20-21swapper/207:13:212
80072420,4sleep20-21swapper/207:58:352
80072420,4sleep20-21swapper/207:58:352
2188799427,6cyclictest181rcu_preempt11:38:180
2188799427,6cyclictest181rcu_preempt11:38:180
107962410,3sleep00-21swapper/008:08:220
107962410,3sleep00-21swapper/008:08:220
21887994030,8cyclictest0-21swapper/007:43:130
21887994024,13cyclictest21806-21lldpd09:58:150
21887994024,13cyclictest21806-21lldpd09:58:150
177852400,2sleep10-21swapper/109:53:201
177852400,2sleep10-21swapper/109:53:201
2188999395,4cyclictest0-21swapper/211:03:152
21887993930,7cyclictest0-21swapper/012:38:140
21887993930,7cyclictest0-21swapper/012:38:140
21887993920,14cyclictest171ktimers/009:53:190
21887993920,14cyclictest171ktimers/009:53:190
2188799391,31cyclictest25623-21taskset08:48:150
214632392,10sleep20-21swapper/207:11:082
214632392,10sleep20-21swapper/207:11:082
105392390,3sleep00-21swapper/012:23:360
21888993828,7cyclictest12557-21netstat11:03:271
2188799387,24cyclictest690-21gpm08:18:140
2188799387,24cyclictest690-21gpm08:18:140
285432360,1sleep127651-21/usr/sbin/munin07:28:321
285432360,1sleep127651-21/usr/sbin/munin07:28:321
2188799365,27cyclictest36350irq/47-eth010:38:160
2188799365,27cyclictest36350irq/47-eth010:38:160
218352360,2sleep121885-21cyclictest07:13:131
21888993526,7cyclictest9071-21switchtime10:53:331
21888993526,7cyclictest9071-21switchtime10:53:331
2188899351,27cyclictest16172-21sshd08:23:191
2188899351,27cyclictest16172-21sshd08:23:191
21888993429,3cyclictest16964-21cat12:43:051
21888993429,3cyclictest16964-21cat12:43:051
21888993428,4cyclictest523-21in:imuxsock12:28:041
21888993425,7cyclictest13398-21threads08:13:361
21888993425,7cyclictest13398-21threads08:13:361
21888993425,6cyclictest22083-21netstat11:28:261
21888993425,6cyclictest22083-21netstat11:28:261
2188799347,18cyclictest36350irq/47-eth010:58:180
2188799347,18cyclictest36350irq/47-eth010:58:180
2188799346,18cyclictest36350irq/47-eth009:03:160
2188799346,18cyclictest36350irq/47-eth009:03:160
21887993428,4cyclictest26111-21gltestperf07:23:190
21887993428,4cyclictest26111-21gltestperf07:23:190
2188799342,10cyclictest181rcu_preempt11:48:190
2188799342,10cyclictest181rcu_preempt11:48:190
21887993414,16cyclictest171ktimers/010:43:170
21887993414,16cyclictest171ktimers/010:43:170
159102340,2sleep30-21swapper/309:48:193
159102340,2sleep30-21swapper/309:48:193
322102330,2sleep30-21swapper/310:28:383
322102330,2sleep30-21swapper/310:28:383
21888993326,5cyclictest8486-21netstat12:18:251
2188799337,22cyclictest136-21systemd-journal11:13:160
2188799337,22cyclictest136-21systemd-journal11:13:160
21887993324,7cyclictest19752-21fschecks_time11:23:200
21887993323,5cyclictest0-21swapper/009:28:190
21887993318,13cyclictest0-21swapper/010:08:200
21887993318,13cyclictest0-21swapper/010:08:200
249952320,3sleep30-21swapper/308:43:393
240352320,5sleep20-21swapper/210:08:232
240352320,5sleep20-21swapper/210:08:232
2189099324,13cyclictest180392sleep308:28:163
2189099324,13cyclictest180392sleep308:28:163
2188999323,23cyclictest0-21swapper/209:58:152
2188999323,23cyclictest0-21swapper/209:58:152
21888993223,7cyclictest31500-21kernelversion10:28:261
21888993223,7cyclictest31500-21kernelversion10:28:261
21888993215,14cyclictest281ktimers/111:33:171
21888993215,14cyclictest281ktimers/111:33:171
21887993225,5cyclictest32647-21latency_hist10:33:050
21887993225,5cyclictest32647-21latency_hist10:33:050
2188799322,24cyclictest968-21sendmail-mta10:53:160
2188799322,24cyclictest968-21sendmail-mta10:53:160
255512310,3sleep30-21swapper/310:13:243
255512310,3sleep30-21swapper/310:13:243
21888993126,3cyclictest595-21latency_hist07:43:041
21888993126,3cyclictest595-21latency_hist07:43:041
21888993126,3cyclictest595-21latency_hist07:43:041
21888993124,5cyclictest693-21avahi-daemon11:48:341
21888993124,5cyclictest693-21avahi-daemon11:48:341
2188799316,17cyclictest16-21ksoftirqd/010:33:160
2188799314,6cyclictest181rcu_preempt09:48:180
2188799314,6cyclictest181rcu_preempt09:48:180
21887993125,4cyclictest10360-21fschecks_time09:33:200
21887993125,4cyclictest10360-21fschecks_time09:33:200
2188799312,24cyclictest15765-21snmpd08:53:160
2188799312,24cyclictest15765-21snmpd08:53:160
21887993116,8cyclictest21885-21cyclictest07:28:160
21887993116,8cyclictest21885-21cyclictest07:28:160
21887993113,14cyclictest21885-21cyclictest08:03:160
21887993113,14cyclictest21885-21cyclictest08:03:160
21887993112,12cyclictest21885-21cyclictest12:03:170
21887993112,12cyclictest21885-21cyclictest12:03:170
53312300,4sleep30-21swapper/309:18:323
53312300,4sleep30-21swapper/309:18:323
2188999305,20cyclictest0-21swapper/211:28:152
2188999305,20cyclictest0-21swapper/211:28:152
2188999305,11cyclictest0-21swapper/209:13:142
2188999305,11cyclictest0-21swapper/209:13:142
21888993024,4cyclictest7363-21kworker/u9:1-xprtiod07:23:041
21888993024,4cyclictest7363-21kworker/u9:1-xprtiod07:23:041
21888993022,6cyclictest1-21systemd11:09:061
21888993021,7cyclictest4984-21fschecks_time07:53:181
21888993021,7cyclictest4984-21fschecks_time07:53:181
21888993020,7cyclictest10240-21gltestperf10:58:231
21888993020,7cyclictest10240-21gltestperf10:58:231
2188899301,23cyclictest25799-21taskset07:23:151
2188899301,23cyclictest25799-21taskset07:23:151
2188799302,21cyclictest23903-21taskset07:18:190
2188799302,21cyclictest23903-21taskset07:18:190
21888992924,2cyclictest0-21swapper/112:13:041
21888992924,2cyclictest0-21swapper/112:13:041
21888992923,4cyclictest136-21systemd-journal08:03:051
21888992923,4cyclictest136-21systemd-journal08:03:051
21888992921,6cyclictest1250-21fschecks_time07:43:211
21887992923,3cyclictest0-21swapper/008:23:370
21887992923,3cyclictest0-21swapper/008:23:370
145942290,2sleep014644-21readlink11:08:320
21890992817,8cyclictest13631-21chrt09:43:003
21890992817,8cyclictest13631-21chrt09:43:003
2188999282,18cyclictest23903-21taskset07:18:192
2188999282,18cyclictest23903-21taskset07:18:192
21888992823,3cyclictest17526-21kworker/u9:4-xprtiod11:18:151
21888992823,3cyclictest17526-21kworker/u9:4-xprtiod11:18:151
21888992822,4cyclictest523-21in:imuxsock10:23:051
21888992822,4cyclictest523-21in:imuxsock10:23:051
21888992819,7cyclictest29437-21gltestperf10:23:211
21888992819,7cyclictest29437-21gltestperf10:23:211
2188799283,7cyclictest25358-21apt-get10:13:180
2188799283,7cyclictest25358-21apt-get10:13:180
21887992824,3cyclictest12135-21gltestperf11:03:200
214342285,16sleep30-21swapper/307:10:453
214342285,16sleep30-21swapper/307:10:453
21890992715,8cyclictest28437-21chrt11:44:323
21890992715,8cyclictest28437-21chrt11:44:323
21890992715,7cyclictest13992-21chrt08:17:503
21890992715,7cyclictest13992-21chrt08:17:503
2188999272,17cyclictest0-21swapper/208:23:192
2188999272,17cyclictest0-21swapper/208:23:192
2188999271,11cyclictest12017-21chrt09:38:172
2188999271,11cyclictest12017-21chrt09:38:172
21888992721,5cyclictest28298-21processes08:53:291
21888992721,5cyclictest28298-21processes08:53:291
21888992721,4cyclictest0-21swapper/109:23:051
21888992721,4cyclictest0-21swapper/109:23:051
21888992720,4cyclictest693-21avahi-daemon11:53:371
21888992720,4cyclictest693-21avahi-daemon11:53:371
21888992718,7cyclictest15397-21unixbench-2d08:18:341
21888992718,7cyclictest15397-21unixbench-2d08:18:341
21887992721,4cyclictest0-21swapper/011:53:370
21887992721,4cyclictest0-21swapper/011:53:370
21887992720,5cyclictest8021-21fschecks_time12:18:190
21887992717,4cyclictest0-21swapper/012:01:190
21887992717,4cyclictest0-21swapper/012:01:190
21887992713,12cyclictest0-21swapper/007:33:180
21887992713,12cyclictest0-21swapper/007:33:180
2188799271,22cyclictest976-21date07:43:140
141492270,3sleep30-21swapper/309:43:203
141492270,3sleep30-21swapper/309:43:203
21890992616,7cyclictest5417-21chrt12:09:523
21890992616,7cyclictest5417-21chrt12:09:523
21890992616,7cyclictest390-21chrt09:07:383
21890992616,7cyclictest390-21chrt09:07:383
21890992616,7cyclictest25239-21chrt07:19:293
21890992616,7cyclictest25239-21chrt07:19:293
21890992615,7cyclictest27139-21chrt08:51:433
21890992615,7cyclictest21066-21chrt11:27:153
21890992615,6cyclictest6233-21chrt07:56:153
21890992615,6cyclictest6233-21chrt07:56:153
21890992615,6cyclictest32284-21chrt11:55:503
21890992615,6cyclictest32284-21chrt11:55:503
21890992614,9cyclictest14768-21chrt12:34:123
21890992614,9cyclictest14768-21chrt12:34:123
2188999262,7cyclictest0-21swapper/211:38:182
2188999262,7cyclictest0-21swapper/211:38:182
2188999261,8cyclictest7954-21taskset10:53:102
2188999261,8cyclictest7954-21taskset10:53:102
21888992622,2cyclictest0-21swapper/109:53:051
21888992622,2cyclictest0-21swapper/109:53:051
21888992621,4cyclictest21285-21sh10:03:051
21888992621,4cyclictest21285-21sh10:03:051
21888992621,3cyclictest8622-21head09:28:241
21888992621,3cyclictest0-21swapper/107:48:211
21888992621,2cyclictest0-21swapper/108:13:041
21888992621,2cyclictest0-21swapper/108:13:041
21888992620,5cyclictest29739-21fschecks_time07:33:191
21888992620,5cyclictest29739-21fschecks_time07:33:191
21888992620,4cyclictest22214-21needreboot10:03:271
21888992620,4cyclictest22214-21needreboot10:03:271
21888992619,5cyclictest5687-21polkitd09:43:331
21888992619,5cyclictest5687-21polkitd09:43:331
21887992618,6cyclictest6169-21awk09:23:050
21887992618,6cyclictest6169-21awk09:23:050
21887992618,6cyclictest31400-21/usr/sbin/munin07:38:280
21887992618,6cyclictest31400-21/usr/sbin/munin07:38:280
21887992618,5cyclictest7110-21ntp_kernel_pll_09:23:260
21887992614,10cyclictest939-21kworker/u10:2-rpciod08:33:230
21890992516,6cyclictest9563-21chrt09:28:533
21890992515,7cyclictest31051-21chrt07:36:333
21890992515,7cyclictest31051-21chrt07:36:333
21890992515,7cyclictest24836-21chrt10:09:333
21890992515,7cyclictest24836-21chrt10:09:333
21890992515,7cyclictest20956-21chrt09:59:003
21890992515,7cyclictest20956-21chrt09:59:003
21890992515,7cyclictest17472-21chrt08:24:013
21890992515,7cyclictest17472-21chrt08:24:013
21890992515,6cyclictest9607-21chrt10:56:403
21890992515,6cyclictest9607-21chrt10:56:403
21890992515,6cyclictest8173-21chrt08:00:333
21890992515,6cyclictest8173-21chrt08:00:333
21890992514,4cyclictest0-21swapper/310:03:183
21890992514,4cyclictest0-21swapper/310:03:183
21890992513,9cyclictest23312-21chrt07:14:273
21890992512,9cyclictest2924-21chrt10:38:233
21890992512,9cyclictest2924-21chrt10:38:233
21888992520,4cyclictest799-21runrttasks09:13:161
21888992520,4cyclictest799-21runrttasks09:13:161
21888992520,3cyclictest13666-21systemctl09:43:051
21888992520,3cyclictest13666-21systemctl09:43:051
21888992520,3cyclictest0-21swapper/110:53:051
21888992520,3cyclictest0-21swapper/110:53:051
21888992520,3cyclictest0-21swapper/109:13:051
21888992520,3cyclictest0-21swapper/109:13:051
21888992517,6cyclictest12981-21sshd12:30:191
21888992517,6cyclictest12981-21sshd12:30:191
21888992516,7cyclictest20391-21kernelversion08:33:221
21888992516,7cyclictest1957-21latency_hist12:03:051
21888992516,7cyclictest1957-21latency_hist12:03:051
21887992520,3cyclictest0-21swapper/008:33:050
21887992520,3cyclictest0-21swapper/008:33:050
21890992415,6cyclictest1692-21chrt12:00:243
21890992415,6cyclictest1692-21chrt12:00:243
21890992415,6cyclictest10223-21chrt08:07:333
21890992415,6cyclictest10223-21chrt08:07:333
21890992414,7cyclictest26642-21chrt11:40:503
21890992414,7cyclictest26642-21chrt11:40:503
21890992414,7cyclictest16921-21chrt11:14:053
21890992414,6cyclictest12976-21chrt12:30:153
21890992414,6cyclictest12976-21chrt12:30:153
21890992414,6cyclictest11866-21chrt08:09:343
21890992414,6cyclictest11866-21chrt08:09:343
21890992413,7cyclictest28985-21chrt07:29:063
21890992413,7cyclictest28985-21chrt07:29:063
21890992413,7cyclictest16736-21taskset12:40:233
21890992413,7cyclictest16736-21taskset12:40:233
21890992413,7cyclictest15019-21chrt11:08:423
21890992413,7cyclictest13362-21chrt11:06:293
21890992412,8cyclictest15879-21chrt08:22:523
21890992412,8cyclictest15879-21chrt08:22:523
21890992411,9cyclictest22977-21chrt11:31:543
21890992411,9cyclictest22977-21chrt11:31:543
21890992411,8cyclictest11506-21chrt09:34:443
21890992411,8cyclictest11506-21chrt09:34:443
21888992417,5cyclictest1051-21kernelversion10:33:251
21888992415,7cyclictest25356-21fschecks_count11:38:211
21888992415,7cyclictest25356-21fschecks_count11:38:211
2188799248,9cyclictest91-1pr/ttyS012:13:170
21887992420,2cyclictest0-21swapper/011:28:310
21887992420,2cyclictest0-21swapper/011:28:310
21887992418,5cyclictest863-21fschecks_count09:08:200
21887992418,5cyclictest863-21fschecks_count09:08:200
21887992416,6cyclictest24190-21mailstats11:33:310
21887992416,6cyclictest24190-21mailstats11:33:310
21890992317,3cyclictest30450-21chrt10:24:083
21890992317,3cyclictest30450-21chrt10:24:083
21890992314,6cyclictest563-21taskset07:42:483
21890992314,6cyclictest563-21taskset07:42:483
21890992314,6cyclictest563-21taskset07:42:483
21890992312,7cyclictest5867-21taskset10:46:473
21890992312,7cyclictest5867-21taskset10:46:473
21890992311,8cyclictest28719-21chrt10:21:153
21890992311,8cyclictest28719-21chrt10:21:153
21890992311,8cyclictest23211-21chrt08:39:413
21890992311,8cyclictest23211-21chrt08:39:413
21890992311,8cyclictest1958-21chrt10:35:023
2188999234,6cyclictest0-21swapper/209:43:172
2188999234,6cyclictest0-21swapper/209:43:172
2188999233,11cyclictest0-21swapper/209:08:162
2188999233,11cyclictest0-21swapper/209:08:162
2188899232,17cyclictest31265-21apt-get09:03:171
2188899232,17cyclictest31265-21apt-get09:03:171
21888992318,2cyclictest0-21swapper/111:23:511
21888992316,5cyclictest27570-21kernelversion11:43:241
21888992316,5cyclictest27570-21kernelversion11:43:241
21888992315,6cyclictest6237-21gltestperf12:13:221
21888992314,7cyclictest19867-21latency_hist08:33:121
21887992319,2cyclictest0-21swapper/008:43:330
21887992318,3cyclictest0-21swapper/012:28:370
21887992318,3cyclictest0-21swapper/012:28:370
21887992318,2cyclictest0-21swapper/008:38:390
21887992318,2cyclictest0-21swapper/008:38:390
21887992315,6cyclictest29829-21netstat10:23:270
21887992315,6cyclictest29829-21netstat10:23:270
21890992217,2cyclictest0-21swapper/309:56:163
21890992217,2cyclictest0-21swapper/309:56:163
21890992216,4cyclictest7845-21chrt12:18:173
21890992216,3cyclictest4259-21chrt07:50:003
21890992213,6cyclictest2349-21taskset07:44:293
21890992212,7cyclictest7750-21chrt09:24:393
2188999223,9cyclictest0-21swapper/209:53:202
2188999223,9cyclictest0-21swapper/209:53:202
21888992218,2cyclictest0-21swapper/108:43:361
21888992216,4cyclictest27107-21sshd08:51:191
21888992216,4cyclictest0-21swapper/109:33:201
21888992216,4cyclictest0-21swapper/109:33:201
21888992216,4cyclictest0-21swapper/109:23:261
21888992216,3cyclictest0-21swapper/108:38:371
21888992216,3cyclictest0-21swapper/108:38:371
21888992215,5cyclictest648-21cron10:13:061
21888992215,5cyclictest648-21cron10:13:061
163302220,3chrt0-21swapper/211:13:282
163302220,3chrt0-21swapper/211:13:282
21890992111,7cyclictest6993-21chrt10:48:323
21890992111,7cyclictest6993-21chrt10:48:323
21890992111,7cyclictest28881-21chrt08:55:003
21890992111,7cyclictest28881-21chrt08:55:003
21890992111,7cyclictest1121-21chrt09:08:233
21890992111,7cyclictest1121-21chrt09:08:233
21890992111,6cyclictest30469-21chrt11:51:353
21890992111,6cyclictest30469-21chrt11:51:353
21890992111,6cyclictest19889-21chrt08:33:133
21890992110,6cyclictest24714-21chrt11:35:073
21890992110,6cyclictest24714-21chrt11:35:073
2188999215,10cyclictest0-21swapper/211:18:172
2188999215,10cyclictest0-21swapper/211:18:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional