You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-23 - 17:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Thu May 23, 2024 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
48658721120,2sleep2391rcuc/200:10:182
80791992925,3cyclictest0-21swapper/000:00:000
80791992724,2cyclictest495-21dbus-daemon21:00:010
2295852250,1sleep2229586-21cat21:10:002
80800992421,2cyclictest512-21rs:main3
80800992420,2cyclictest0-21swapper/321:25:013
80800992319,2cyclictest0-21swapper/323:40:003
8079699239,5cyclictest506329-21cpuspeed_turbos00:25:122
8079699234,12cyclictest428202-21latency_hist23:30:012
80794992319,3cyclictest510-21in:imuxsock22:54:591
80800992219,2cyclictest470480-21sendmail00:00:003
80800992219,2cyclictest120256-21irqcore19:40:163
8079699224,7cyclictest362876-21cat22:40:282
8079699224,6cyclictest492987-21sed00:15:212
8079699224,6cyclictest370421-21cat22:45:412
8079699224,6cyclictest297027-21cut21:55:212
8079699224,5cyclictest129924-21tr19:45:272
8079699224,12cyclictest141616-21grep19:55:232
8079699222,7cyclictest500580-21cut00:20:182
80796992218,3cyclictest491-21avahi-daemon00:05:002
80800992118,2cyclictest533-21gdbus20:20:003
80800992118,2cyclictest0-21swapper/300:30:003
8079699216,6cyclictest238542-21cut21:15:182
8079699216,6cyclictest238542-21cut21:15:182
8079699214,6cyclictest338362-21grep22:25:172
8079699214,5cyclictest353912-21grep22:35:252
8079699213,6cyclictest291535-21sed21:50:222
8079699213,6cyclictest107567-21acpi19:30:122
8079699213,6cyclictest104305-21kthreadcore19:25:222
8079699212,7cyclictest322500-21grep22:15:152
8079699212,7cyclictest220279-21cat21:00:172
80796992118,2cyclictest250953-21apt-config21:25:012
8079699211,7cyclictest440560-21kworker/u8:1+rpciod23:40:132
80800992015,4cyclictest320359-21kworker/u8:2-rpciod22:40:003
8079699204,6cyclictest470608-21date00:00:002
8079699204,6cyclictest301633-21cat22:00:182
8079699204,5cyclictest521695-21cut00:35:182
8079699204,5cyclictest430031-21cut23:30:232
8079699204,5cyclictest312957-21kthreadcore22:05:202
8079699204,5cyclictest284062-21cut21:45:212
8079699204,5cyclictest260383-21tr21:30:202
8079699204,5cyclictest215570-21grep20:55:252
8079699204,5cyclictest199575-21fschecks_time20:45:162
8079699204,5cyclictest134683-21cat19:50:222
8079699203,7cyclictest440184-21grep23:35:202
8079699203,6cyclictest483149-21sed00:05:242
8079699203,6cyclictest150158-21sed20:05:022
8079699202,7cyclictest198000-21sed20:40:252
8079699202,6cyclictest379060-21awk22:55:112
8079699202,6cyclictest336395-21latency_hist22:25:002
80794992016,2cyclictest495-21dbus-daemon00:00:001
80791992015,3cyclictest156326-21sh20:10:000
80800991915,3cyclictest0-21swapper/320:39:593
8079699195,9cyclictest373915-21grep22:50:242
8079699195,8cyclictest87517-21grep19:15:022
8079699194,5cyclictest458384-21tr23:50:222
8079699194,5cyclictest458384-21tr23:50:212
8079699194,5cyclictest344811-21irqrtprio22:30:192
8079699194,5cyclictest254147-21tr21:25:212
8079699193,5cyclictest419478-21ps23:20:262
8079699193,5cyclictest277662-21modprobe21:40:242
8079699193,5cyclictest207016-21cut20:50:182
8079699193,5cyclictest114282-21cut19:35:162
8079699192,7cyclictest166234-21tr20:15:202
8079699192,6cyclictest450900-21cut23:45:212
8079699192,6cyclictest320253-21missed_timers22:10:202
8079699192,6cyclictest190515-21cut20:35:242
8079699192,5cyclictest184349-21grep20:30:182
8079699192,5cyclictest179830-21modprobe20:25:232
8079699191,7cyclictest171668-21kthreadcore20:20:212
8079699191,7cyclictest157097-21irqcore20:10:162
8079499193,8cyclictest107303-21munin-run19:30:001
80794991916,2cyclictest506-21systemd-logind19:20:011
80794991916,2cyclictest0-21swapper/123:40:001
80791991916,2cyclictest89510-21gltestperf19:15:170
269698190,4rtkit-daemon2764-21sendmail-mta23:08:240
80800991815,2cyclictest533-21gdbus23:45:013
80800991815,2cyclictest2609-21cron19:15:003
8079699184,5cyclictest120985-21cut19:40:162
8079699183,5cyclictest235535-21ssh21:10:502
8079699182,5cyclictest265507-21/usr/sbin/munin21:35:172
8079699180,6cyclictest99155-21kthreadcore19:20:202
80794991815,2cyclictest459655-21kthreadcore23:50:231
80794991815,2cyclictest459655-21kthreadcore23:50:221
80794991814,3cyclictest503-21polkitd22:40:001
80794991814,3cyclictest251729-21gltestperf21:25:171
80791991815,2cyclictest0-21swapper/020:35:000
80791991813,4cyclictest286438-21cron21:50:000
80791991813,3cyclictest498920-21sh00:20:000
80800991714,2cyclictest491-21avahi-daemon22:00:293
80800991714,2cyclictest428136-21cron23:30:003
80800991714,2cyclictest0-21swapper/321:20:013
80800991714,2cyclictest0-21swapper/321:20:003
80800991713,3cyclictest0-21swapper/300:15:003
80800991713,2cyclictest0-21swapper/320:45:013
80800991711,5cyclictest523642-21tr00:35:213
8079699176,2cyclictest400261-21acpi23:10:142
8079699174,4cyclictest84024-21kthreadcore19:10:212
8079699174,4cyclictest150495-21/usr/sbin/munin20:05:302
8079699172,5cyclictest518266-21kthreadcore00:30:202
8079699172,5cyclictest394610-21cut23:05:212
8079699172,5cyclictest391032-21sed23:00:292
80794991714,2cyclictest84362-21kthreadcore19:10:211
80794991714,2cyclictest506-21systemd-logind21:15:011
80794991714,2cyclictest491-21avahi-daemon23:10:311
80794991714,2cyclictest293594-21apt-config21:55:011
80794991714,2cyclictest0-21swapper/120:00:001
8079199176,9cyclictest192590-21sshd20:36:180
80791991712,3cyclictest287099-21gltestperf21:50:170
80791991712,3cyclictest0-21swapper/019:40:000
80791991711,4cyclictest353-21systemd-journal21:40:010
269698170,2rtkit-daemon0-21swapper/021:04:370
8080099169,5cyclictest143515-21sshd19:55:443
8080099163,3cyclictest739-21runrttasks23:53:353
8080099163,3cyclictest739-21runrttasks23:53:343
80800991613,2cyclictest0-21swapper/320:55:003
80800991612,3cyclictest372179-21cpuspeed_turbos22:50:163
8079699160,5cyclictest0-21swapper/223:15:182
8079499163,2cyclictest191rcu_preempt20:15:291
8079499161,4cyclictest306224-21ntp_states22:00:271
80794991612,3cyclictest379778-21irqcore22:55:171
80794991612,2cyclictest0-21swapper/122:00:001
80794991611,4cyclictest244351-21gltestperf21:20:161
80791991612,3cyclictest421755-21gltestperf23:25:160
80791991612,3cyclictest256882-21unixbench_multi21:25:350
80791991611,3cyclictest0-21swapper/023:00:230
80791991610,4cyclictest477851-21cron00:05:000
80800991512,2cyclictest533-21gdbus00:00:263
80800991512,2cyclictest229536-21diskmemload22:10:003
80800991512,2cyclictest1-21systemd21:55:003
80800991512,2cyclictest0-21swapper/320:34:593
80800991511,3cyclictest2609-21cron21:30:003
80800991511,3cyclictest119498-21cron19:40:003
80794991512,2cyclictest506374-21cpuspeed_turbos00:25:121
8079499151,1cyclictest3982301needreboot23:05:251
80794991511,3cyclictest433937-21unixbench_singl23:30:361
80794991511,2cyclictest0-21swapper/100:40:011
80794991511,2cyclictest0-21swapper/100:05:001
8079199158,5cyclictest353-21systemd-journal20:21:160
80791991512,2cyclictest95677-21cut19:20:150
80791991512,2cyclictest336695-21cpuspeed_turbos22:25:100
80791991512,2cyclictest236723-21systemd-run21:15:010
80791991512,2cyclictest1-21systemd00:05:280
80791991511,3cyclictest101694-21gltestperf19:25:170
80791991511,2cyclictest0-21swapper/021:15:160
80791991511,2cyclictest0-21swapper/021:15:160
80791991510,4cyclictest80421-21kworker/0:1+kacpi_notify23:24:510
80791991510,3cyclictest1-21systemd19:34:530
80791991510,3cyclictest0-21swapper/021:25:010
8079199150,4cyclictest83889-21kthreadcore19:10:220
8080099144,2cyclictest191rcu_preempt19:20:013
8080099143,2cyclictest2981192cut21:55:223
80800991412,1cyclictest0-21swapper/322:45:003
80800991411,2cyclictest497148-21kworker/u8:3-xprtiod00:20:183
80800991411,2cyclictest478281-21cpuspeed_turbos00:05:133
80800991411,2cyclictest428661-21fschecks_count23:30:173
80800991411,2cyclictest379303-21fschecks_time22:55:153
80800991411,2cyclictest229536-21diskmemload22:10:163
80800991411,2cyclictest0-21swapper/323:45:203
80800991410,3cyclictest272274-21cron21:40:003
80800991410,2cyclictest0-21swapper/319:30:003
8079499144,2cyclictest191rcu_preempt21:00:011
8079499142,3cyclictest265925-21smartctl21:35:181
8079499141,4cyclictest130687-21grep19:45:291
80794991411,2cyclictest280071-21gltestperf21:45:151
80794991411,2cyclictest169004-21fschecks_time20:20:161
80794991411,2cyclictest0-21swapper/121:05:001
80794991410,3cyclictest301rcuc/122:25:191
80794991410,2cyclictest258889-21irqcore21:30:171
8079499140,6cyclictest421113-21idleruntime-cro23:24:591
8079499140,6cyclictest229551-21awk21:10:001
8079499140,6cyclictest0-21swapper/122:46:051
8079499140,4cyclictest451836-21cut23:45:221
8079499140,4cyclictest2021081kthreadcore20:45:211
8079499140,3cyclictest386187-21apt-get23:00:161
8079199149,4cyclictest442301-21cron23:40:000
8079199148,4cyclictest1-21systemd22:10:010
8079199147,5cyclictest353-21systemd-journal21:45:000
8079199144,8cyclictest301646-21irqcore22:00:170
80791991412,1cyclictest80421-21kworker/0:1+kacpid19:55:400
80791991411,2cyclictest385874-21idleruntime-cro22:59:590
80791991411,2cyclictest344060-21gltestperf22:30:170
80791991410,3cyclictest520988-21gltestperf00:35:160
80791991410,3cyclictest205724-21gltestperf20:50:140
80791991410,2cyclictest469394-21kworker/u8:2-events_unbound00:20:190
8079199140,5cyclictest407871-21irqcore23:15:210
748912141,8sleep00-21swapper/019:05:160
8080099139,3cyclictest0-21swapper/320:15:013
8080099136,5cyclictest533-21gdbus23:09:593
80800991310,2cyclictest199590-21gltestperf20:45:163
80800991310,2cyclictest148984-21needreboot20:00:203
8079499139,3cyclictest0-21swapper/122:10:181
8079499137,4cyclictest364662-21sshd22:44:431
80794991311,1cyclictest281irq_work/120:35:301
80794991310,2cyclictest322774-21gltestperf22:15:201
80794991310,2cyclictest196111-21tr20:40:231
8079499130,8cyclictest1-21systemd20:34:351
8079499130,6cyclictest0-21swapper/122:32:541
8079499130,4cyclictest482690-21kthreadcore00:05:211
8079499130,4cyclictest336339-21ls22:25:001
8079499130,2cyclictest4865892ps00:10:181
8079199139,3cyclictest428529-21cpuspeed_turbos23:30:160
8079199139,3cyclictest0-21swapper/022:10:260
8079199139,2cyclictest0-21swapper/022:35:380
8079199139,2cyclictest0-21swapper/021:05:310
8079199138,3cyclictest513948-21gltestperf00:30:130
8079199137,4cyclictest0-21swapper/023:55:010
8079199137,4cyclictest0-21swapper/023:55:000
8079199132,9cyclictest365063-21apt-get22:45:170
8079199131,3cyclictest61650irq/128-eno1:rx-023:10:230
80791991311,1cyclictest80421-21kworker/0:1+kacpid22:40:170
80791991311,1cyclictest80421-21kworker/0:1+kacpid21:30:220
80791991311,1cyclictest80421-21kworker/0:1+kacpid20:10:220
80791991311,1cyclictest80421-21kworker/0:1+kacpid19:49:120
8079199131,11cyclictest119804-21apt-get19:40:090
80791991310,2cyclictest0-21swapper/022:00:000
80791991310,1cyclictest0-21swapper/020:05:020
8079199130,2cyclictest195749-21kthreadcore20:40:210
8079199130,1cyclictest0-21swapper/020:45:230
8080099129,2cyclictest343801-21cpuspeed_turbos22:30:143
8080099129,2cyclictest0-21swapper/319:25:003
8080099129,1cyclictest0-21swapper/322:45:173
8080099128,3cyclictest407463-21cpuspeed_turbos23:15:153
8080099127,4cyclictest278115-21awk21:40:293
8080099127,3cyclictest137771-21latency_hist19:55:003
8080099126,4cyclictest224337-21sed21:05:203
8080099125,6cyclictest279974-21cut21:45:143
8080099121,5cyclictest707-21ntpd00:16:343
8080099120,4cyclictest739-21runrttasks23:12:483
8079499129,2cyclictest229536-21diskmemload23:25:161
8079499129,2cyclictest107694-21cpuspeed_turbos19:30:141
8079499129,2cyclictest0-21swapper/120:30:011
8079499127,4cyclictest353-21systemd-journal20:05:011
8079499126,4cyclictest533-21gdbus00:20:001
8079499125,6cyclictest301rcuc/120:10:161
8079499123,3cyclictest237938-21grep21:15:171
8079499123,3cyclictest237938-21grep21:15:171
8079499121,2cyclictest191rcu_preempt23:40:131
80794991210,1cyclictest229536-21diskmemload21:40:181
8079499120,5cyclictest4087381irqrtprio23:15:221
8079499120,3cyclictest520146-21ssh00:34:081
8079499120,3cyclictest0-21swapper/119:50:161
8079499120,3cyclictest0-21swapper/119:20:271
8079199125,6cyclictest162991-21head20:15:160
8079199121,2cyclictest485181-21apt-get00:10:090
80791991210,1cyclictest80421-21kworker/0:1+kacpid23:41:330
80791991210,1cyclictest80421-21kworker/0:1+kacpid20:25:100
8079199120,4cyclictest452048-21cut23:45:230
8079199120,4cyclictest324568-21kthreadcore22:15:240
2093822120,1sleep1209387-21kthreadcore20:50:191
8080099119,1cyclictest0-21swapper/320:25:003
8080099118,2cyclictest336928-21gltestperf22:25:153
8080099118,2cyclictest217949-21gltestperf21:00:133
8080099118,2cyclictest211615-21cpuspeed_turbos20:55:173
8080099118,2cyclictest174920-21cpuspeed_turbos20:25:123
8080099118,2cyclictest0-21swapper/323:00:323
8080099118,2cyclictest0-21swapper/321:10:123
8080099118,2cyclictest0-21swapper/319:45:183
8080099117,2cyclictest0-21swapper/321:35:013
8080099116,4cyclictest417070-21tr23:20:203
8080099116,4cyclictest109413-21tr19:30:213
8079699114,5cyclictest80652-21latency_hist19:10:012
8079499118,2cyclictest0-21swapper/120:00:151
8079499117,3cyclictest0-21swapper/100:20:191
8079499116,4cyclictest116932-21tr19:35:191
8079499114,6cyclictest301rcuc/122:05:171
8079499111,3cyclictest2695-21rtkit-daemon19:40:181
8079199117,3cyclictest61650irq/128-eno1:rx-022:20:320
8079199115,4cyclictest132207-21uniq19:50:160
8079199111,2cyclictest0-21swapper/022:50:210
8079199110,3cyclictest0-21swapper/000:27:140
8080099105,4cyclictest330160-21sed22:20:183
8080099105,4cyclictest325367-21cut22:15:253
8080099103,2cyclictest269698rtkit-daemon20:07:563
807949997,1cyclictest0-21swapper/119:10:001
808009974,2cyclictest0-21swapper/319:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional