You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 04:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Sat Jul 27, 2024 00:42:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
786922997668,4cyclictest0-21swapper/100:16:181
786923996756,6cyclictest0-21swapper/223:01:172
786921995417,20cyclictest0-21swapper/019:41:110
786921995223,8cyclictest357-21mta-sts-daemon21:48:470
786921995142,5cyclictest895253-21fschecks_count22:36:030
786922995044,3cyclictest0-21swapper/123:40:011
786922995044,3cyclictest0-21swapper/123:40:011
786921995033,14cyclictest339-21dbus-daemon22:06:210
786921995031,12cyclictest789478-21ntpq19:16:100
78692399491,43cyclictest834396-21ssh21:21:062
786922994835,8cyclictest28-21ksoftirqd/100:21:081
786923994739,5cyclictest791657-21systemd-run19:25:002
786922994737,5cyclictest0-21swapper/123:01:081
786921994741,3cyclictest0-21swapper/021:20:000
786923994637,5cyclictest0-21swapper/223:10:002
786921994616,18cyclictest0-21swapper/019:56:100
786922994537,3cyclictest0-21swapper/123:05:571
78692299446,30cyclictest928546-21ssh23:16:161
786922994436,5cyclictest1-21systemd22:50:011
786921994428,12cyclictest828796-21ssh21:15:000
786923994333,7cyclictest967781-21latency_hist00:05:022
786923994333,7cyclictest967781-21latency_hist00:05:022
786922994332,8cyclictest3586050-21snmpd23:22:351
786921994333,6cyclictest0-21swapper/021:40:020
786921994328,12cyclictest983819-21aten_r2power_po00:25:570
786921994327,10cyclictest980792-21ntpq00:21:150
786921994324,16cyclictest893512-21sh22:33:400
786921994323,11cyclictest808298-21ntpq20:16:110
786923994234,5cyclictest911650-21cut22:56:052
786923994234,5cyclictest911650-21cut22:56:052
786923994232,5cyclictest843320-21timerandwakeup21:31:512
786923994215,6cyclictest171rcu_preempt20:26:132
78692399421,4cyclictest171rcu_preempt20:16:092
786921994232,7cyclictest339-21dbus-daemon00:01:320
786921994232,7cyclictest339-21dbus-daemon00:01:320
786921994232,5cyclictest976851-21ntpq00:16:130
786921994231,5cyclictest795740-21ntpq19:36:100
786921994231,5cyclictest795740-21ntpq19:36:100
786921994230,6cyclictest973182-21ntpq00:11:160
78692199422,34cyclictest850962-21ssh21:41:150
786921994219,19cyclictest962311-21sh23:57:250
786921994217,7cyclictest957101-21ntp_states23:51:130
786921994216,7cyclictest931241-21sh23:20:080
786923994132,6cyclictest3054060-21cups-browsed22:20:002
78692299415,26cyclictest863182-21ssh21:56:151
786922994132,6cyclictest992418-21unixbench-2d00:36:211
786922994132,6cyclictest943215-21cron23:35:001
786922994130,8cyclictest794779-21sh19:35:001
786922994130,8cyclictest794779-21sh19:35:001
786921994133,5cyclictest845180-21sh21:35:000
786921994118,17cyclictest816314-21ps20:41:170
786921994116,9cyclictest938768-21ssh23:29:180
786921994116,7cyclictest869215-21sh22:04:060
786923994032,5cyclictest935117-21grep23:25:022
786923994032,5cyclictest824632-21diskmemload22:36:202
786923994031,5cyclictest821517-21systemd-run21:00:002
786923994030,6cyclictest977148-21sendmail_mailst00:16:222
786923994029,8cyclictest830579-21mailstats21:16:172
78692399402,29cyclictest899902-21ssh22:41:122
786922994033,3cyclictest0-21swapper/123:56:111
786922994032,3cyclictest0-21swapper/122:56:151
786922994032,3cyclictest0-21swapper/122:56:151
786922994031,6cyclictest842313-21fschecks_time21:31:161
786922994030,8cyclictest808913-21sendmail20:20:001
78692299402,31cyclictest859002-21ssh21:51:131
786921994022,7cyclictest919206-21ssh23:05:330
786921994022,14cyclictest806733-21ntpq20:11:100
786921994020,18cyclictest927293-21ssh23:15:240
786921994016,6cyclictest902639-21cat22:45:020
786923993932,4cyclictest807349-21systemd-run20:15:012
786923993926,10cyclictest969518-21switchtime00:06:232
786922993932,3cyclictest0-21swapper/122:01:161
786922993931,5cyclictest971574-21systemd-run00:10:001
786922993931,5cyclictest926915-21latency_hist23:15:011
786922993931,5cyclictest418-21gdbus22:35:011
786922993930,6cyclictest1-21systemd21:30:011
786922993930,6cyclictest1-21systemd20:15:011
786922993930,4cyclictest0-21swapper/121:16:081
786922993929,7cyclictest339-21dbus-daemon22:20:001
786922993929,7cyclictest3054060-21cups-browsed23:25:051
786922993924,10cyclictest849423-21latency_hist21:40:021
786921993931,5cyclictest993971-21awk00:40:000
786921993931,5cyclictest875926-21grep22:11:190
786921993931,3cyclictest814609-21ntpq20:36:130
786921993928,4cyclictest817830-21ntpq20:46:120
786921993926,9cyclictest822535-21ntpq21:01:200
786921993926,10cyclictest834584-21ntp_states21:21:120
786921993925,8cyclictest809920-21ntpq20:21:110
786921993922,6cyclictest880115-21ssh22:16:260
786921993922,6cyclictest864952-21ssh21:58:430
786921993921,8cyclictest925251-21ssh23:11:510
786921993921,7cyclictest884268-21ssh22:21:320
786921993921,15cyclictest915184-21ssh23:00:400
786921993921,15cyclictest798873-21ntpq19:46:070
786921993917,7cyclictest954980-21sh23:49:040
786921993917,10cyclictest946382-21sh23:38:130
786921993917,10cyclictest946382-21sh23:38:130
786921993915,7cyclictest913317-21sh22:57:300
786921993915,7cyclictest913317-21sh22:57:300
786921993913,10cyclictest886538-21sh22:25:310
786923993832,3cyclictest0-21swapper/221:47:172
786923993830,5cyclictest0-21swapper/223:55:002
786923993829,4cyclictest0-21swapper/223:11:082
786923993825,10cyclictest872539-21sh22:07:372
786921993829,4cyclictest0-21swapper/022:46:120
786921993826,8cyclictest819373-21ntpq20:51:110
786921993824,10cyclictest907012-21ssh22:50:340
786921993822,13cyclictest942801-21ssh23:34:120
786921993818,12cyclictest971223-21ssh00:09:190
786921993817,7cyclictest858929-21ntpq21:51:100
786921993815,7cyclictest950132-21sh23:42:320
786923993730,4cyclictest0-21swapper/221:56:162
786923993729,5cyclictest984011-21cut00:26:002
786923993728,3cyclictest0-21swapper/222:26:132
786923993727,5cyclictest0-21swapper/223:41:092
78692299374,26cyclictest952940-21ssh23:46:091
786922993729,5cyclictest797990-21latency_hist19:45:011
786922993728,6cyclictest353-21polkitd21:40:581
786922993728,5cyclictest0-21swapper/122:41:111
786922993727,6cyclictest990515-21systemd-run00:35:011
786922993713,5cyclictest28-21ksoftirqd/120:46:071
786921993727,7cyclictest803631-21ntpq20:01:110
786921993725,8cyclictest792584-21ntpq19:26:080
786921993724,9cyclictest794124-21ntpq19:31:070
786921993724,9cyclictest794124-21ntpq19:31:070
786921993724,8cyclictest820855-21ntpq20:56:090
786921993724,8cyclictest813108-21ntpq20:31:170
786921993724,8cyclictest787901-21ntpq19:11:100
786921993723,9cyclictest791124-21ntpq19:21:150
786921993715,9cyclictest838679-21needreboot21:26:320
786921993713,8cyclictest989336-21sh00:32:140
786923993628,5cyclictest866493-21cron22:01:002
786923993628,5cyclictest799503-21systemd-run19:50:002
786923993626,7cyclictest917307-21kworker/u8:2+nfsiod23:45:582
78692399361,28cyclictest846811-21ssh21:36:132
786922993628,5cyclictest791564-21unixbench_singl19:21:211
786922993628,5cyclictest419331-21systemd-journal23:55:001
786922993628,4cyclictest0-21swapper/120:51:131
786922993627,6cyclictest812595-21fschecks_count20:31:051
786922993626,6cyclictest0-21swapper/122:26:151
786921993627,4cyclictest811460-21ntpq20:26:090
786921993621,11cyclictest804740-21fschecks_count20:06:010
786921993621,10cyclictest800534-21ntpq19:51:160
78692399355,12cyclictest811-21mta-sts-daemon19:11:082
786923993529,3cyclictest0-21swapper/221:40:582
786923993529,3cyclictest0-21swapper/200:40:002
786923993520,9cyclictest903469-21/usr/sbin/munin22:46:022
786922993529,3cyclictest0-21swapper/122:51:191
786922993527,5cyclictest811993-21unixbench_singl20:26:211
786922993526,5cyclictest986840-21ssh00:30:011
786922993523,9cyclictest948852-21ntp_kernel_pll_23:41:091
786922993511,7cyclictest28-21ksoftirqd/122:22:391
786921993522,9cyclictest823987-21ntpq21:06:090
786923993428,3cyclictest0-21swapper/200:35:012
786923993428,3cyclictest0-21swapper/200:00:012
786923993426,5cyclictest805785-21systemd-run20:10:012
786923993423,7cyclictest335-21avahi-daemon23:37:022
786923993423,7cyclictest335-21avahi-daemon23:37:022
78692399342,27cyclictest908128-21sshd22:51:172
78692399342,25cyclictest838790-21ssh21:26:362
786922993425,6cyclictest354-21gpm21:14:291
786922993411,6cyclictest28-21ksoftirqd/121:21:011
786922993411,5cyclictest28-21ksoftirqd/122:06:111
786922993410,7cyclictest28-21ksoftirqd/100:14:251
786923993326,3cyclictest0-21swapper/222:31:012
786923993326,3cyclictest0-21swapper/200:11:132
786923993325,3cyclictest0-21swapper/200:21:082
78692299339,7cyclictest28-21ksoftirqd/119:46:061
786922993327,3cyclictest0-21swapper/119:40:001
786922993327,3cyclictest0-21swapper/119:40:001
786922993326,3cyclictest0-21swapper/121:46:131
786922993324,6cyclictest3054060-21cups-browsed20:40:001
786922993311,5cyclictest28-21ksoftirqd/100:01:081
786922993311,5cyclictest28-21ksoftirqd/100:01:081
786923993226,3cyclictest0-21swapper/219:16:192
786923993224,5cyclictest797941-21systemd-run19:45:002
786923993224,5cyclictest3054060-21cups-browsed22:10:562
786923993222,8cyclictest816187-21ntp_kernel_pll_20:41:122
78692399322,25cyclictest936531-21ssh23:26:072
786923993220,7cyclictest0-21swapper/223:17:212
78692299322,23cyclictest895900-21ntpq22:36:181
786922993214,7cyclictest28-21ksoftirqd/119:16:081
786922993211,6cyclictest28-21ksoftirqd/122:14:391
786922993211,5cyclictest28-21ksoftirqd/121:06:111
786921993222,7cyclictest786933-21munin-run19:10:010
786923993123,5cyclictest858879-21needreboot21:51:082
786923993123,3cyclictest791772-21kworker/u8:8-xprtiod21:10:002
786923993122,3cyclictest0-21swapper/223:31:132
78692299319,5cyclictest28-21ksoftirqd/121:01:171
786922993123,5cyclictest821467-21cron21:00:001
786923993021,5cyclictest886039-21cron22:25:002
78692399301,20cyclictest3054060-21cups-browsed21:11:082
78692299308,4cyclictest28-21ksoftirqd/120:01:151
786922993021,6cyclictest816772-21cron20:45:001
78692399293,7cyclictest171rcu_preempt20:46:102
786923992921,5cyclictest1-21systemd20:55:012
78692299299,5cyclictest28-21ksoftirqd/119:56:171
786922992921,5cyclictest804740-21fschecks_count20:06:011
786923992820,5cyclictest799989-21fschecks_count19:51:022
786923992814,10cyclictest341rcuc/219:31:092
786923992814,10cyclictest341rcuc/219:31:092
78692299287,6cyclictest28-21ksoftirqd/120:21:141
78692299287,4cyclictest28-21ksoftirqd/119:50:591
786922992816,10cyclictest3054060-21cups-browsed19:10:001
786923992717,7cyclictest802140-21ps19:56:162
78692299276,4cyclictest28-21ksoftirqd/119:26:081
78692299276,4cyclictest28-21ksoftirqd/119:11:111
786923992620,3cyclictest0-21swapper/220:25:022
786923992519,3cyclictest0-21swapper/220:35:562
786923992519,3cyclictest0-21swapper/220:05:002
786923992518,3cyclictest0-21swapper/220:31:202
786923992517,5cyclictest1-21systemd19:10:012
78692399242,17cyclictest339-21dbus-daemon19:26:122
786923992317,3cyclictest0-21swapper/221:01:232
786923992316,5cyclictest0-21swapper/219:40:002
786923992316,5cyclictest0-21swapper/219:40:002
78692499183,7cyclictest0-21swapper/300:11:103
78692499182,8cyclictest0-21swapper/323:16:123
78692499173,7cyclictest0-21swapper/321:11:133
78692499171,9cyclictest0-21swapper/300:06:043
78692499163,7cyclictest0-21swapper/321:41:133
78692499162,9cyclictest0-21swapper/322:56:043
78692499162,9cyclictest0-21swapper/322:56:043
78692499162,9cyclictest0-21swapper/322:41:073
78692499162,7cyclictest0-21swapper/321:56:093
78692499161,9cyclictest0-21swapper/321:21:133
78692499161,8cyclictest0-21swapper/321:36:143
78692499161,6cyclictest0-21swapper/320:51:053
78692499161,6cyclictest0-21swapper/319:21:083
78692499155,6cyclictest0-21swapper/323:56:113
78692499154,7cyclictest0-21swapper/323:41:123
78692499153,8cyclictest0-21swapper/323:11:093
78692499153,7cyclictest0-21swapper/322:51:173
78692499153,6cyclictest0-21swapper/322:36:123
78692499153,6cyclictest0-21swapper/321:25:563
78692499152,9cyclictest0-21swapper/323:00:563
78692499152,9cyclictest0-21swapper/322:31:013
78692499152,9cyclictest0-21swapper/321:16:123
78692499152,8cyclictest0-21swapper/323:31:173
78692499152,8cyclictest0-21swapper/323:26:003
78692499152,8cyclictest0-21swapper/323:06:113
78692499152,8cyclictest0-21swapper/322:26:203
78692499152,8cyclictest0-21swapper/322:16:113
78692499152,8cyclictest0-21swapper/322:11:083
78692499152,8cyclictest0-21swapper/300:31:123
78692499152,8cyclictest0-21swapper/300:26:143
78692499151,9cyclictest0-21swapper/323:21:153
78692499151,9cyclictest0-21swapper/300:16:143
78692499151,8cyclictest0-21swapper/322:21:113
78692499151,7cyclictest0-21swapper/323:51:083
78692499144,7cyclictest0-21swapper/322:46:123
78692499144,7cyclictest0-21swapper/300:21:083
78692499144,6cyclictest0-21swapper/300:01:123
78692499144,6cyclictest0-21swapper/300:01:123
78692499142,8cyclictest0-21swapper/323:36:113
78692499142,8cyclictest0-21swapper/323:36:113
78692499142,7cyclictest0-21swapper/323:46:003
78692499142,6cyclictest0-21swapper/320:21:153
78692499142,6cyclictest0-21swapper/320:06:203
78692499142,6cyclictest0-21swapper/319:40:003
78692499142,6cyclictest0-21swapper/319:40:003
78692499141,9cyclictest0-21swapper/321:31:303
78692499141,8cyclictest0-21swapper/322:01:043
78692499141,6cyclictest0-21swapper/320:41:113
78692499133,6cyclictest0-21swapper/319:26:133
78692499132,8cyclictest0-21swapper/300:36:013
78692499132,6cyclictest0-21swapper/320:00:013
78692499132,6cyclictest0-21swapper/319:55:013
78692499131,8cyclictest0-21swapper/321:51:093
78692499131,7cyclictest0-21swapper/321:10:013
78692499131,6cyclictest0-21swapper/321:45:553
78692499131,6cyclictest0-21swapper/320:56:153
78692499131,6cyclictest0-21swapper/319:31:113
78692499131,6cyclictest0-21swapper/319:31:113
78692499122,7cyclictest0-21swapper/322:05:593
78692499122,7cyclictest0-21swapper/321:01:173
78692499122,5cyclictest0-21swapper/320:45:583
78692499122,5cyclictest0-21swapper/320:35:583
78692499121,6cyclictest0-21swapper/320:26:073
78692499121,6cyclictest0-21swapper/320:16:113
78692499121,6cyclictest0-21swapper/320:01:153
78692499121,6cyclictest0-21swapper/319:46:063
78692499121,5cyclictest0-21swapper/319:15:023
78692499112,5cyclictest0-21swapper/320:11:203
78692499111,6cyclictest0-21swapper/319:41:013
78692499102,5cyclictest0-21swapper/319:16:003
78692499101,5cyclictest0-21swapper/320:30:133
7869249982,4cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional