You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-16 - 14:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  Congatec
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Mon Jul 15, 2024 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
53833099757749,3cyclictest1603210-21kworker/3:0+events10:30:233
53833099745736,4cyclictest878953-21kworker/3:2+events12:26:463
53833099743740,2cyclictest878953-21kworker/3:2+events11:41:063
53833099740733,6cyclictest878953-21kworker/3:2+events12:20:433
53833099740733,6cyclictest878953-21kworker/3:2+events12:20:423
53833099739734,4cyclictest880062-21turbostat11:24:553
53833099739731,7cyclictest1603210-21kworker/3:0+events10:55:223
53833099737734,2cyclictest878953-21kworker/3:2+events11:26:473
53833099737732,4cyclictest1603210-21kworker/3:0+events10:53:223
53833099735732,2cyclictest1603210-21kworker/3:0+events10:47:553
53832699735731,3cyclictest712071-21kworker/2:1+events09:30:432
53833099733728,4cyclictest857712-21kworker/3:1+events11:15:333
53832699733729,3cyclictest712071-21kworker/2:1+events09:25:302
53833099728725,2cyclictest1603210-21kworker/3:0+events07:54:553
53832699728723,4cyclictest645790-21kworker/2:0+events08:39:042
53832699727721,5cyclictest670871-21kworker/2:2+events08:55:532
53833099726722,3cyclictest857712-21kworker/3:1+events11:12:343
53833099726718,7cyclictest1603210-21kworker/3:0+events10:16:473
53833099725722,2cyclictest878953-21kworker/3:2+events12:13:213
53833099725722,2cyclictest1603210-21kworker/3:0+events10:37:423
53833099725721,3cyclictest1603210-21kworker/3:0+events08:07:373
53833099725721,3cyclictest1603210-21kworker/3:0+events07:41:383
53832699725721,3cyclictest608311-21kworker/2:1+events08:50:212
53832699725720,3cyclictest726893-21kworker/2:2+events09:36:252
53832699724720,3cyclictest608311-21kworker/2:1+events08:47:472
53832699723719,3cyclictest645790-21kworker/2:0+events08:42:592
53832299720715,4cyclictest1555833-21kworker/1:2+events09:10:431
53832299718714,3cyclictest1555833-21kworker/1:2+events09:05:321
53833099717713,3cyclictest726855-21turbostat09:39:553
53833099717713,3cyclictest571344-21turbostat07:39:553
53832299715710,4cyclictest755148-21kworker/1:1+events11:02:491
53833099711706,4cyclictest1603210-21kworker/3:0+events07:21:273
53833099711705,5cyclictest857671-21turbostat11:09:553
53833099711705,4cyclictest1603210-21kworker/3:0+events07:25:213
53833099708705,2cyclictest1603210-21kworker/3:0+events09:47:533
53833099708699,3cyclictest1603210-21kworker/3:0+events09:15:223
53833099706701,4cyclictest1603210-21kworker/3:0+events07:30:223
53833099706699,6cyclictest850373-21turbostat11:04:563
53833099705697,7cyclictest1603210-21kworker/3:0+events09:55:203
53833099704700,3cyclictest1603210-21kworker/3:0+events10:11:063
53833099704700,3cyclictest1603210-21kworker/3:0+events10:11:063
53832299704700,3cyclictest843140-21turbostat10:59:551
53833099703699,3cyclictest1603210-21kworker/3:0+events08:15:443
53833099703698,4cyclictest1603210-21kworker/3:0+events08:10:213
53833099702699,2cyclictest1603210-21kworker/3:0+events08:24:033
53833099702697,4cyclictest1603210-21kworker/3:0+events10:00:223
53833099702696,4cyclictest1603210-21kworker/3:0+events10:26:293
53833099701696,4cyclictest878953-21kworker/3:2+events11:56:573
53832299701696,4cyclictest1555833-21kworker/1:2+events09:22:501
53833099700695,4cyclictest1603210-21kworker/3:0+events08:00:453
53833099699695,3cyclictest1603210-21kworker/3:0+events08:30:213
53833099699693,5cyclictest1603210-21kworker/3:0+events09:00:223
53833099698695,2cyclictest1603210-21kworker/3:0+events10:07:283
53833099698694,3cyclictest878953-21kworker/3:2+events12:19:463
53833099698694,3cyclictest1603210-21kworker/3:0+events07:11:293
53833099698694,2cyclictest878953-21kworker/3:2+pm11:54:513
53833099697694,2cyclictest689481-21turbostat09:14:553
53833099695691,3cyclictest1603210-21kworker/3:0+events09:51:253
53833099694689,4cyclictest878953-21kworker/3:2+events11:47:073
53833099688681,2cyclictest878953-21kworker/3:2+events12:30:543
53832699688685,2cyclictest639721-21turbostat08:34:562
53833099684681,2cyclictest878953-21kworker/3:2+events11:36:053
53833099684680,3cyclictest878953-21kworker/3:2+events11:32:573
53833099682678,3cyclictest878953-21kworker/3:2+events12:05:213
53833099682678,3cyclictest1603210-21kworker/3:0+events10:21:063
53833099681677,3cyclictest1603210-21kworker/3:0+events07:17:453
53833099681675,5cyclictest878953-21kworker/3:2+events12:00:203
53833099680676,3cyclictest878953-21kworker/3:2+events12:39:483
53832699679674,4cyclictest704083-21turbostat09:24:562
53833099674670,3cyclictest1603210-21kworker/3:0+events10:43:553
53833099670666,3cyclictest1603210-21kworker/3:0+events09:20:533
53833099669666,2cyclictest1603210-21kworker/3:0+events09:41:373
53833099669665,3cyclictest1603210-21kworker/3:0+events08:28:293
53833099662659,2cyclictest670631-21turbostat08:59:563
53833099657651,5cyclictest1603210-21kworker/3:0+events07:48:353
53833099656650,5cyclictest1603210-21kworker/3:0+events07:58:223
53832299642638,3cyclictest676794-21turbostat09:04:551
9491922850,1sleep00-21swapper/012:05:200
538322992522,2cyclictest792335-21cron10:20:001
538322992420,3cyclictest505-21dbus-daemon11:20:011
538320992414,8cyclictest0-21swapper/008:20:010
538320992314,7cyclictest521-21in:imuxsock07:20:020
538320992218,2cyclictest0-21swapper/010:40:010
538322992118,2cyclictest75451-21packagekitd11:06:031
538320992118,2cyclictest585-21gdbus09:24:060
538330992015,4cyclictest815-21cron09:10:013
538326991916,2cyclictest777686-21sh10:10:002
538326991916,2cyclictest597996-21kthreadcore07:55:172
538326991916,2cyclictest522-21rs:main2
538326991916,2cyclictest0-21swapper/207:20:002
538326991914,3cyclictest0-21swapper/208:15:002
538322991916,2cyclictest938744-21cron12:00:001
538322991916,2cyclictest577661-21latency_hist07:40:011
538322991916,2cyclictest0-21swapper/108:40:001
538326991816,1cyclictest960465-21cron12:15:002
538326991815,2cyclictest997205-21sendmail-msp12:40:002
538326991815,2cyclictest0-21swapper/212:10:002
538326991815,2cyclictest0-21swapper/209:55:002
538322991815,2cyclictest522-21rs:main1
538322991815,2cyclictest511-21polkitd12:40:001
538322991815,2cyclictest505-21dbus-daemon07:11:531
538322991812,4cyclictest704056-21cron09:20:001
538320991814,3cyclictest755822-21cron09:55:000
538320991813,2cyclictest522-21rs:main0
538320991811,2cyclictest0-21swapper/012:20:000
538326991714,2cyclictest0-21swapper/210:45:002
538326991713,2cyclictest0-21swapper/211:22:262
538326991712,3cyclictest556073-21kthreadcore07:20:232
538326991711,5cyclictest3347873-21systemd-journal12:25:002
538326991711,5cyclictest3347873-21systemd-journal12:24:592
538322991714,2cyclictest763167-21cron09:59:591
538322991713,3cyclictest982365-21cron12:30:001
53832099179,6cyclictest0-21swapper/011:00:000
538320991714,2cyclictest815-21cron11:35:000
538320991714,2cyclictest792974-21gltestperf10:20:180
538320991714,2cyclictest558-21gdbus11:05:590
538320991710,6cyclictest0-21swapper/009:00:020
538330991612,3cyclictest651674-21unixbench_singl08:35:343
538326991613,2cyclictest784855-21sh10:15:012
538326991613,2cyclictest784855-21sh10:15:012
538326991613,2cyclictest633517-21munin-plugin-st08:25:002
538326991612,3cyclictest942132-21sed12:00:202
538326991612,3cyclictest805535-21unixbench_multi10:25:322
538326991612,2cyclictest0-21swapper/212:35:012
538322991613,2cyclictest975020-21idleruntime-cro12:25:001
538322991613,2cyclictest975020-21idleruntime-cro12:25:001
538322991613,2cyclictest830462-21kthreadcore10:45:241
538322991613,2cyclictest792945-21fschecks_time10:20:181
538322991613,2cyclictest721407-21kthreadcore09:30:221
538322991613,2cyclictest0-21swapper/110:05:321
53832299161,2cyclictest0-21swapper/109:25:121
538322991612,2cyclictest0-21swapper/108:45:191
538322991611,4cyclictest0-21swapper/108:20:011
538320991614,1cyclictest0-21swapper/009:40:010
538320991613,2cyclictest765990-21kthreadcore10:00:220
538320991613,2cyclictest0-21swapper/008:25:010
538320991612,3cyclictest902890-21grep11:35:130
538320991610,4cyclictest916941-21sh11:45:000
538330991512,2cyclictest653813-21sort08:40:213
538326991513,1cyclictest689464-21diskmemload11:05:232
538326991513,1cyclictest0-21swapper/212:30:002
538326991512,2cyclictest932145-21gltestperf11:55:182
538326991512,2cyclictest785506-21cpuspeed_turbos10:15:132
538326991512,2cyclictest0-21swapper/207:11:542
538326991511,3cyclictest603064-21gltestperf08:00:152
538326991511,3cyclictest0-21swapper/211:15:002
538326991510,4cyclictest0-21swapper/210:35:372
538322991513,1cyclictest821411-21sendmail10:40:011
538322991513,1cyclictest0-21swapper/112:30:011
538322991513,1cyclictest0-21swapper/111:45:011
538322991512,2cyclictest900738-21unixbench_multi11:30:301
538322991512,2cyclictest521-21in:imuxsock11:40:001
538322991512,2cyclictest0-21swapper/112:15:011
538322991511,2cyclictest0-21swapper/109:40:001
53832099158,5cyclictest938793-21sendmail-msp12:00:010
538320991512,2cyclictest713-21snmpd09:10:330
538320991512,2cyclictest689464-21diskmemload11:10:190
538320991512,2cyclictest652081-21idleruntime-cro08:40:000
538320991512,2cyclictest1-21systemd11:22:380
538320991512,2cyclictest0-21swapper/008:30:000
538320991510,4cyclictest3347873-21systemd-journal10:55:010
538320991510,3cyclictest783529-21grep10:10:340
538320991510,3cyclictest783529-21grep10:10:330
53832699149,3cyclictest609106-21diskstats08:05:152
538326991412,1cyclictest0-21swapper/211:30:002
538326991411,2cyclictest910965-21cut11:40:222
538326991411,2cyclictest843813-21gltestperf10:55:202
538326991411,2cyclictest577699-21sendmail-msp07:40:012
53832299149,4cyclictest967798-21cron12:19:591
538322991411,2cyclictest941402-21kthreadcore12:00:201
538322991411,2cyclictest893314-21unixbench_singl11:25:331
538322991411,2cyclictest763568-21cpuspeed_turbos10:00:141
538322991411,2cyclictest75451-21packagekitd10:40:381
53832299140,2cyclictest813895-21sh10:34:041
53832299140,13cyclictest0-21swapper/109:45:201
53832099149,4cyclictest538043-21kworker/0:1+kacpi_notify07:30:120
53832099149,4cyclictest505-21dbus-daemon09:25:030
53832099148,1cyclictest614868-21turbostat08:10:010
538320991412,1cyclictest0-21swapper/007:40:000
538320991411,2cyclictest775362-21kthreadcore10:05:260
538320991411,2cyclictest763205-21systemd-run10:00:000
538320991411,2cyclictest594181-21kthreadcore07:50:200
538320991411,2cyclictest17650irq/127-ahci[0000:00:17.0]09:10:000
538320991411,2cyclictest0-21swapper/011:54:590
538320991411,2cyclictest0-21swapper/011:29:590
538320991411,2cyclictest0-21swapper/009:30:360
538320991411,2cyclictest0-21swapper/008:45:000
538320991410,3cyclictest946048-21journal-offline12:04:590
538320991410,3cyclictest732354-21kworker/0:0+kacpi_notify09:47:440
53832699139,3cyclictest689494-21kworker/u8:3+ext4-rsv-conversion10:00:032
53832699139,3cyclictest0-21swapper/209:59:592
53832699139,2cyclictest0-21swapper/209:00:132
53832699138,4cyclictest89798rtkit-daemon10:53:552
53832699138,4cyclictest0-21swapper/210:30:122
53832699137,4cyclictest746889-21ntpq09:45:322
53832699136,2cyclictest596263-21cron07:55:002
53832699135,1cyclictest89898rtkit-daemon11:19:292
538326991310,2cyclictest0-21swapper/211:50:002
53832699130,12cyclictest0-21swapper/207:30:002
53832299139,3cyclictest547128-21gltestperf07:15:181
538322991310,2cyclictest778331-21gltestperf10:10:181
538322991310,2cyclictest778331-21gltestperf10:10:171
538322991310,2cyclictest748992-21cpuspeed_turbos09:50:141
538322991310,2cyclictest602089-21head07:55:301
538322991310,2cyclictest584221-21cpuspeed_turbos07:45:141
538322991310,2cyclictest0-21swapper/111:10:221
538322991310,1cyclictest0-21swapper/107:20:251
53832299130,4cyclictest515-21wpa_supplicant10:25:161
53832299130,12cyclictest612153-21cut08:05:231
53832299130,12cyclictest0-21swapper/109:43:251
53832099139,3cyclictest983070-21cpuspeed_turbos12:30:120
53832099139,3cyclictest62250irq/128-eno1:rx-012:20:300
53832099139,3cyclictest62250irq/128-eno1:rx-012:20:300
53832099138,4cyclictest0-21swapper/007:55:090
53832099137,5cyclictest788632-21tr10:15:210
538320991311,1cyclictest640346-21head08:30:200
538320991311,1cyclictest608349-21kworker/0:2+kacpid09:00:260
538320991310,2cyclictest995248-21needreboot12:35:250
538320991310,2cyclictest917620-21gltestperf11:45:160
538320991310,2cyclictest732354-21kworker/0:0+kacpid09:44:090
538320991310,2cyclictest689464-21diskmemload10:40:410
538320991310,2cyclictest0-21swapper/012:25:240
538320991310,2cyclictest0-21swapper/011:00:390
538320991310,2cyclictest0-21swapper/008:55:000
538320991310,2cyclictest0-21swapper/007:11:530
53833099128,2cyclictest0-21swapper/308:50:003
53832699129,2cyclictest895283-21cut11:30:132
53832699129,2cyclictest0-21swapper/211:35:122
53832699129,2cyclictest0-21swapper/207:50:002
53832699129,2cyclictest0-21swapper/207:45:002
53832699128,3cyclictest829147-21entropy10:45:182
53832699127,3cyclictest850404-21sendmail-msp11:00:022
538326991210,1cyclictest0-21swapper/209:10:172
53832699120,1cyclictest0-21swapper/212:15:182
53832699120,11cyclictest0-21swapper/211:51:152
53832299129,2cyclictest671022-21cpuspeed_turbos08:55:141
53832299129,2cyclictest559727-21irqcore07:25:191
53832299129,2cyclictest0-21swapper/107:34:591
53832299128,3cyclictest0-21swapper/107:40:221
53832299127,3cyclictest0-21swapper/110:50:121
53832299126,5cyclictest3347873-21systemd-journal08:45:011
53832299126,4cyclictest602919-21df_inode08:00:131
538322991211,1cyclictest0-21swapper/107:50:291
538322991210,1cyclictest922739-21timerwakeupswit11:45:301
538322991210,1cyclictest0-21swapper/111:22:261
53832299120,1cyclictest0-21swapper/111:52:521
53832299120,1cyclictest0-21swapper/108:26:281
53832299120,1cyclictest0-21swapper/108:14:231
53832099129,2cyclictest608214-21unixbench_multi08:00:290
53832099129,2cyclictest0-21swapper/007:20:010
53832099128,3cyclictest558959-21kworker/0:0+kacpi_notify07:45:010
53832099128,2cyclictest0-21swapper/010:30:230
53832099124,7cyclictest0-21swapper/010:48:230
53832099121,9cyclictest538043-21kworker/0:1+events_power_efficient07:30:000
53833099119,1cyclictest0-21swapper/309:25:163
53833099112,3cyclictest50-21ksoftirqd/309:30:143
53832699117,2cyclictest0-21swapper/209:15:012
53832699115,4cyclictest565444-21apt-get07:30:112
53832699111,1cyclictest89898rtkit-daemon09:05:362
53832699110,2cyclictest191rcu_preempt10:20:192
53832299110,11cyclictest0-21swapper/108:20:541
53832299110,10cyclictest0-21swapper/108:53:031
53832099119,1cyclictest0-21swapper/008:45:180
53832099118,2cyclictest608349-21kworker/0:2+kacpi_notify08:10:450
53832099118,2cyclictest584472-21gltestperf07:45:180
53832099116,4cyclictest954674-21sed12:10:240
53832099116,4cyclictest17650irq/127-ahci[0000:00:17.0]11:20:010
53832099115,5cyclictest799958-21apt-get10:25:110
89898100,4rtkit-daemon532287-21apt-get07:05:101
53833099108,1cyclictest0-21swapper/308:50:203
53832699107,2cyclictest0-21swapper/209:40:202
53832699107,2cyclictest0-21swapper/208:25:262
53832299100,3cyclictest0-21swapper/112:05:121
5380832106,2sleep30-21swapper/307:09:023
5380532102,2sleep00-21swapper/007:08:380
5379322106,2sleep20-21swapper/207:07:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional