You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 22:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Fri Apr 19, 2024 12:43:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2086993995538,14cyclictest2180611-21munin-plugin-st10:25:052
2086991995428,23cyclictest2281865-21unixbench_multi12:35:370
2086993995324,7cyclictest2273549-21needreboot12:25:242
2086991995331,19cyclictest2111603-21cron08:25:050
2086993995121,8cyclictest2104433-21ntp_kernel_pll_08:00:322
2086991995126,22cyclictest2191571-21sh10:39:240
2086993995026,5cyclictest2116472-21unixbench_singl08:35:332
2086993995020,8cyclictest2110982-21ntp_kernel_err08:20:232
2086992995032,14cyclictest2157536-21unixbench-2d09:50:361
208699299472,16cyclictest2247510-21ntpq11:50:291
2086991994720,5cyclictest412-21avahi-daemon08:05:310
2086993994622,5cyclictest2207352-21tr11:00:222
208699299462,11cyclictest435-21mta-sts-daemon12:15:261
208699299462,11cyclictest435-21mta-sts-daemon12:15:261
2086991994634,8cyclictest2270030-21mailstats12:20:360
2086993994522,4cyclictest876-21mta-sts-daemon12:15:172
2086993994522,4cyclictest876-21mta-sts-daemon12:15:172
208699199454,16cyclictest2131143-21rm09:15:270
2086991994524,18cyclictest0-21swapper/010:25:180
2086992994425,16cyclictest2204766-21unixbench-2d10:55:341
208699299441,15cyclictest2171972-21ntpq10:10:291
2086991994420,3cyclictest0-21swapper/012:25:190
208699299432,33cyclictest2193239-21ssh10:40:321
208699299421,13cyclictest2200616-21ntpq10:50:271
2086991994220,3cyclictest0-21swapper/010:40:340
2086991994215,7cyclictest2202652-21sshd10:53:560
2086991994214,7cyclictest2145816-21missed_timers09:35:210
2086993994132,5cyclictest2109993-21systemd-run08:20:062
2086993994132,5cyclictest2109993-21systemd-run08:20:062
2086992994122,16cyclictest2110572-21fschecks_time08:20:181
208699299412,13cyclictest2126978-21diskstats09:10:191
2086992994114,23cyclictest2134536-21fschecks_time09:20:181
208699299411,15cyclictest2258935-21ntpq12:05:401
208699299411,13cyclictest2088095-21ntpq07:10:281
208699299411,11cyclictest2089643-21/usr/sbin/munin07:15:271
208699299411,10cyclictest2220326-21ssh11:15:451
208699299411,10cyclictest2220326-21ssh11:15:451
2086991994132,5cyclictest2102386-21gltestperf07:55:220
208699199413,16cyclictest2227891-21ssh11:25:290
208699299407,4cyclictest2234668-21ssh11:35:041
208699299402,6cyclictest2092953-21ntpq07:25:241
2086992994021,16cyclictest2208253-21unixbench-2d11:00:391
208699299401,9cyclictest2115366-21df08:35:151
2086992994015,22cyclictest2099128-21gltestperf07:45:181
208699299401,13cyclictest2175190-21ssh10:16:071
208699299401,13cyclictest2133198-21ssh09:18:371
208699299401,12cyclictest2277505-21ntpq12:30:281
208699299401,12cyclictest2262737-21ntpq12:10:291
208699299401,12cyclictest2154354-21ssh09:46:081
208699299401,11cyclictest2227757-21ntpq11:25:251
208699299401,11cyclictest2225489-21ssh11:22:461
208699299401,11cyclictest2139581-21ssh09:26:121
208699299401,10cyclictest2256720-21ssh12:02:441
208699299400,12cyclictest2163007-21ssh09:59:031
208699199404,12cyclictest2126378-21diskmemload10:01:180
208699199404,12cyclictest2126378-21diskmemload10:01:180
2086991994028,9cyclictest2135557-21unixbench-2d09:20:330
2086993993931,5cyclictest2224318-21sed11:20:372
2086993993931,5cyclictest2206619-21latency_hist11:00:072
2086993993930,6cyclictest2263261-21grep12:10:372
208699299399,28cyclictest2244552-21ssh11:46:111
2086992993931,5cyclictest2114777-21unixbench_multi08:30:421
208699299392,8cyclictest2107715-21ntpq08:10:271
208699299391,9cyclictest2112570-21needreboot08:25:231
208699299391,8cyclictest2103637-21aten_r2power_cu08:00:161
2086992993917,18cyclictest2235023-21aten_r2power_cu11:35:141
208699299391,13cyclictest2185537-21ssh10:30:271
208699299391,11cyclictest2190802-21ssh10:37:321
208699299390,11cyclictest2275362-21ssh12:28:021
2086991993931,5cyclictest2101634-21unixbench_multi07:50:360
2086991993929,7cyclictest469-21systemd-logind08:20:060
2086991993929,7cyclictest469-21systemd-logind08:20:060
2086991993912,8cyclictest2097538-21gltestperf07:40:170
2086993993830,5cyclictest2129943-21cron09:15:052
2086993993830,5cyclictest2122997-21unixbench_multi08:55:362
208699299382,5cyclictest2151921-21sh09:44:201
208699299382,14cyclictest2269809-21ntpq12:20:291
208699299381,9cyclictest2147689-21ssh09:38:311
208699299381,5cyclictest2125785-21ntpq09:05:251
208699299381,34cyclictest2126378-21diskmemload10:21:591
208699299381,15cyclictest2091405-21ntpq07:20:321
208699299381,12cyclictest2102824-21ntpq07:55:301
208699299381,12cyclictest2097876-21ntpq07:40:241
208699299381,11cyclictest2253775-21ssh11:59:511
208699299381,11cyclictest2184216-21ssh10:29:541
208699299381,10cyclictest2216600-21ssh11:11:221
208699299381,10cyclictest2142155-21ssh09:30:231
208699299381,10cyclictest2106171-21ntpq08:05:291
2086991993830,5cyclictest2247060-21gltestperf11:50:210
2086991993829,6cyclictest2219131-21grep11:15:170
2086991993829,6cyclictest2219131-21grep11:15:170
2086991993829,6cyclictest2199428-21unin-run10:50:050
2086991993820,12cyclictest77650irq/33-end011:45:310
2086993993729,5cyclictest2215155-21gltestperf11:10:172
2086993993728,6cyclictest2196375-21gltestperf10:45:192
208699299371,9cyclictest2170172-21ssh10:08:381
208699299371,9cyclictest2120792-21/usr/sbin/munin08:50:241
208699299371,8cyclictest2164104-21/usr/sbin/munin10:00:201
208699299371,8cyclictest2164104-21/usr/sbin/munin10:00:201
208699299371,7cyclictest2213824-21ssh11:09:051
208699299371,7cyclictest2118671-21diskstats08:45:191
208699299371,6cyclictest2122449-21/usr/sbin/munin08:55:261
2086992993716,18cyclictest0-21swapper/110:45:131
2086992993713,21cyclictest2281847-21unixbench_multi12:35:371
208699299371,11cyclictest2101223-21ntpq07:50:311
208699299370,11cyclictest2241189-21ssh11:42:111
208699299370,11cyclictest2241189-21ssh11:42:111
208699199376,4cyclictest2126378-21diskmemload12:03:230
2086991993729,5cyclictest2184937-21fschecks_count10:30:180
2086991993729,5cyclictest2123017-21unixbench_singl08:55:370
2086991993727,7cyclictest2152271-21sh09:45:050
2086993993626,8cyclictest418-21dbus-daemon11:35:072
208699299361,8cyclictest2117754-21/usr/sbin/munin08:40:381
208699299361,5cyclictest2109385-21ntpq08:15:271
208699299361,5cyclictest2109385-21ntpq08:15:271
208699199363,16cyclictest2231978-21/usr/sbin/munin11:30:290
2086991993629,5cyclictest2239354-21grep11:40:190
2086991993629,5cyclictest2239354-21grep11:40:190
2086991993628,5cyclictest2108305-21cron08:15:050
2086993993527,5cyclictest2138115-21grep09:25:172
2086993993527,5cyclictest2090209-21unixbench_singl07:15:362
2086993993527,4cyclictest2124627-21unixbench_multi09:00:362
2086993993526,6cyclictest2214369-21true11:10:062
208699299351,4cyclictest2093949-21/usr/sbin/munin07:30:151
208699299350,9cyclictest2123555-21cpuspeed09:00:181
2086991993527,5cyclictest2266159-21grep12:15:200
2086991993527,5cyclictest2266159-21grep12:15:200
2086991993526,6cyclictest2253888-21cron12:00:060
2086991993526,6cyclictest2095172-21cron07:35:050
2086991993525,6cyclictest2117182-21grep08:40:190
2086993993427,4cyclictest876-21mta-sts-daemon11:57:322
2086993993425,5cyclictest284-21systemd-journal09:10:052
2086993993425,5cyclictest2094195-21gltestperf07:30:182
208699299343,4cyclictest2096222-21ntpq07:35:271
2086991993426,5cyclictest2224338-21unixbench_multi11:20:370
2086991993425,7cyclictest2144717-21sshd09:34:560
2086993993325,5cyclictest2117184-21gltestperf08:40:192
2086993993325,5cyclictest2108270-21unixbench_singl08:10:352
2086993993324,5cyclictest2126378-21diskmemload09:45:312
2086993993322,7cyclictest2148484-21unin-run09:40:062
2086991993325,5cyclictest2218399-21sh11:15:050
2086991993325,5cyclictest2089246-21gltestperf07:15:210
2086991993324,6cyclictest2127024-21fschecks_count09:10:190
2086991993323,7cyclictest2260341-21sh12:07:330
208699399324,12cyclictest2126378-21diskmemload10:19:582
2086993993224,5cyclictest2185041-21gltestperf10:30:192
2086993993224,5cyclictest2120456-21gltestperf08:50:212
2086993993223,7cyclictest2236304-21timerandwakeup11:35:342
2086993993222,8cyclictest2164570-21needreboot10:00:262
2086993993222,8cyclictest2164570-21needreboot10:00:262
208699299321,7cyclictest2087012-21latency_hist07:10:061
2086991993223,6cyclictest2178582-21grep10:20:290
2086991993222,7cyclictest2120322-21fschecks_count08:50:200
2086991993215,12cyclictest308-21systemd-udevd12:14:590
208699399314,22cyclictest2269786-21ssh12:20:282
2086993993123,5cyclictest2220199-21unixbench_singl11:15:342
2086993993123,5cyclictest2220199-21unixbench_singl11:15:342
2086993993121,7cyclictest2258990-21ntp_kernel_pll_12:05:432
2086993993121,3cyclictest0-21swapper/207:55:302
2086993993120,8cyclictest2203096-21cron10:55:052
2086991993122,6cyclictest2157584-21grep09:50:360
2086991993122,6cyclictest2118800-21grep08:45:200
208699199312,10cyclictest2168388-21ntpq10:05:300
2086993993024,3cyclictest0-21swapper/210:25:322
2086993993022,5cyclictest432-21polkitd10:40:052
2086993993020,7cyclictest2099577-21sshd07:45:292
2086993993020,6cyclictest2126378-21diskmemload11:50:302
2086993993019,7cyclictest878-21mta-sts-daemon09:30:252
208699199309,5cyclictest171rcu_preempt12:30:210
2086991993022,5cyclictest2154027-21grep09:45:350
2086991993022,5cyclictest2138213-21gltestperf09:25:180
2086991993022,5cyclictest0-21swapper/009:55:330
2086991993020,7cyclictest2235878-21ntp_kernel_pll_11:35:260
2086991993020,7cyclictest2114874-21cron08:35:060
2086993992923,3cyclictest0-21swapper/209:45:062
2086993992920,6cyclictest872-21mta-sts-daemon08:30:362
2086993992918,8cyclictest2096155-21needreboot07:35:242
2086991992919,7cyclictest2207009-21aten_r2power_po11:00:170
2086993992822,3cyclictest0-21swapper/209:15:292
2086993992821,4cyclictest876-21mta-sts-daemon09:50:102
2086993992821,3cyclictest0-21swapper/209:20:272
2086993992817,8cyclictest2160813-21ntp_kernel_pll_09:55:262
2086993992815,8cyclictest529-21gdbus12:05:062
2086991992821,4cyclictest878-21mta-sts-daemon08:35:200
2086991992820,5cyclictest2203830-21gltestperf10:55:180
208699399272,19cyclictest2227959-21ps11:25:312
208699399272,19cyclictest2193115-21ntpq10:40:282
2086993992720,4cyclictest876-21mta-sts-daemon12:38:332
2086993992719,5cyclictest418-21dbus-daemon11:50:052
2086993992717,7cyclictest2119679-21grep08:45:412
2086993992716,7cyclictest2167642-21cpuspeed10:05:162
2086991992720,5cyclictest0-21swapper/009:05:430
2086991992718,6cyclictest2104958-21grep08:00:420
208699399263,17cyclictest435-21mta-sts-daemon07:40:242
208699399262,20cyclictest2171938-21ssh10:10:272
208699399262,18cyclictest2277475-21ssh12:30:272
2086993992619,4cyclictest878-21mta-sts-daemon08:25:062
2086993992616,7cyclictest2106669-21cron08:10:062
2086991992617,6cyclictest2099007-21fschecks_count07:45:170
2086991992614,6cyclictest2126378-21diskmemload11:05:270
2086993992518,3cyclictest0-21swapper/211:40:322
2086993992518,3cyclictest0-21swapper/211:40:322
2086993992515,6cyclictest2100701-21fschecks_time07:50:212
2086993992514,7cyclictest529-21gdbus07:30:052
2086991992517,5cyclictest2124626-21unixbench_multi09:00:360
208699199251,12cyclictest2172065-21ntpq10:10:310
2086991992417,4cyclictest2088493-21unixbench_multi07:10:330
2086991992416,5cyclictest77650irq/33-end010:16:030
2086991992416,5cyclictest2092563-21gltestperf07:25:180
208699399231,17cyclictest2091300-21ntpq07:20:282
208699199222,15cyclictest2096214-21ntpq07:35:260
2086991992216,3cyclictest0-21swapper/007:20:350
2086991992213,6cyclictest2111940-21aten_r2power_fr08:25:160
208699199221,18cyclictest2087185-21date07:10:070
208699399211,15cyclictest2088145-21ps07:10:302
208699499201,4cyclictest0-21swapper/310:20:103
208699399191,13cyclictest2087051-21wc07:10:062
208699499181,5cyclictest0-21swapper/312:35:373
208699499102,5cyclictest0-21swapper/309:25:213
208699499101,6cyclictest0-21swapper/307:20:213
208699499101,4cyclictest0-21swapper/310:10:153
20869949991,6cyclictest0-21swapper/309:45:193
20869949991,5cyclictest0-21swapper/311:10:163
20869949991,4cyclictest0-21swapper/312:00:153
20869949991,4cyclictest0-21swapper/311:05:113
20869949991,4cyclictest0-21swapper/309:32:453
20869949983,4cyclictest0-21swapper/309:15:373
20869949982,5cyclictest0-21swapper/307:20:053
20869949982,5cyclictest0-21swapper/307:15:053
20869949982,4cyclictest0-21swapper/312:20:373
20869949982,4cyclictest0-21swapper/311:50:173
20869949982,4cyclictest0-21swapper/309:10:053
20869949981,6cyclictest0-21swapper/311:30:283
20869949981,6cyclictest0-21swapper/309:00:223
20869949981,6cyclictest0-21swapper/308:20:253
20869949981,5cyclictest0-21swapper/312:30:353
20869949981,5cyclictest0-21swapper/312:05:503
20869949981,5cyclictest0-21swapper/311:45:193
20869949981,5cyclictest0-21swapper/311:40:193
20869949981,5cyclictest0-21swapper/311:40:193
20869949981,5cyclictest0-21swapper/311:35:163
20869949981,5cyclictest0-21swapper/311:20:183
20869949981,5cyclictest0-21swapper/310:50:243
20869949981,5cyclictest0-21swapper/310:40:263
20869949981,5cyclictest0-21swapper/310:35:293
20869949981,5cyclictest0-21swapper/310:15:413
20869949981,5cyclictest0-21swapper/309:55:253
20869949981,5cyclictest0-21swapper/309:50:243
20869949981,5cyclictest0-21swapper/309:43:563
20869949981,5cyclictest0-21swapper/309:10:293
20869949981,5cyclictest0-21swapper/308:45:373
20869949981,4cyclictest0-21swapper/312:25:123
20869949981,4cyclictest0-21swapper/312:15:323
20869949981,4cyclictest0-21swapper/312:15:323
20869949981,4cyclictest0-21swapper/312:10:303
20869949981,4cyclictest0-21swapper/311:55:493
20869949981,4cyclictest0-21swapper/311:25:083
20869949981,4cyclictest0-21swapper/311:15:173
20869949981,4cyclictest0-21swapper/311:15:173
20869949981,4cyclictest0-21swapper/311:02:093
20869949981,4cyclictest0-21swapper/310:45:163
20869949981,4cyclictest0-21swapper/310:30:093
20869949981,4cyclictest0-21swapper/310:06:163
20869949981,4cyclictest0-21swapper/309:35:263
20869949981,4cyclictest0-21swapper/308:40:053
20869949981,4cyclictest0-21swapper/307:45:063
20869949981,4cyclictest0-21swapper/307:40:063
20869949981,3cyclictest0-21swapper/310:25:093
20869949981,3cyclictest0-21swapper/310:00:323
20869949981,3cyclictest0-21swapper/310:00:323
20869949981,3cyclictest0-21swapper/309:20:153
20869949980,4cyclictest0-21swapper/310:55:133
20869949980,3cyclictest0-21swapper/307:30:163
20869949972,4cyclictest0-21swapper/307:45:293
20869949971,5cyclictest0-21swapper/308:50:213
20869949971,5cyclictest0-21swapper/308:25:203
20869949971,5cyclictest0-21swapper/307:25:173
20869949971,4cyclictest0-21swapper/308:55:203
20869949971,4cyclictest0-21swapper/308:30:153
20869949971,4cyclictest0-21swapper/308:20:063
20869949971,4cyclictest0-21swapper/308:20:063
20869949971,4cyclictest0-21swapper/308:10:303
20869949971,4cyclictest0-21swapper/308:05:143
20869949971,4cyclictest0-21swapper/308:00:353
20869949971,4cyclictest0-21swapper/307:55:243
20869949971,4cyclictest0-21swapper/307:50:183
20869949971,3cyclictest0-21swapper/307:10:063
20869949970,3cyclictest0-21swapper/308:40:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional