You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 07:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Tue Mar 10, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17620299913330,1328cyclictest20424772sleep322:30:023
17620299912080,1204cyclictest22235472sleep300:29:563
17620299911660,1162cyclictest21330242sleep323:30:013
17620299911551,1149cyclictest1895110-21sleep20:50:003
17620299911241,1119cyclictest17837352sleep319:24:573
1762029992640,260cyclictest1943900-21turbostat21:29:553
19192382600,1sleep0221rcuc/021:05:180
173198270,11rtkit-daemon1828771-21ntpq19:55:201
1762029991713,1cyclictest0-21swapper/323:20:123
176202999171,12cyclictest2057299-21turbostat22:40:003
176202999166,8cyclictest1882036-21turbostat20:44:553
176202999166,7cyclictest2110076-21taskset23:14:353
176202999164,7cyclictest20103192sleep322:05:223
1762029991611,2cyclictest19431252sleep321:22:103
176202999161,12cyclictest1882036-21turbostat20:40:003
176202999161,11cyclictest2155669-21taskset23:45:123
176202999161,11cyclictest2033519-21taskset22:20:363
176202999161,11cyclictest1997386-21taskset22:00:123
176202999161,11cyclictest19595222sleep321:35:123
176202999161,11cyclictest1836293-21turbostat20:05:013
176202999161,10cyclictest2208637-21chrt00:20:113
19973462152,5sleep21997381-21apt-get22:00:122
176202999155,7cyclictest2080036-21taskset22:55:023
176202999155,7cyclictest1958372-21taskset21:31:423
1762029991513,0cyclictest0-21swapper/323:41:133
1762029991512,1cyclictest0-21swapper/322:48:243
1762029991512,1cyclictest0-21swapper/322:17:533
1762029991512,1cyclictest0-21swapper/321:14:433
1762029991512,1cyclictest0-21swapper/320:52:203
1762029991512,1cyclictest0-21swapper/319:43:523
1762029991512,1cyclictest0-21swapper/300:30:183
1762029991512,1cyclictest0-21swapper/300:03:513
176202999151,11cyclictest2140657-21taskset23:35:103
176202999151,11cyclictest2019202-21chrt22:13:183
176202999151,10cyclictest2236853-21taskset00:35:213
176202999145,6cyclictest17902372sleep319:29:503
176202999144,7cyclictest1972424-21taskset21:40:203
176202999141,9cyclictest21166362sleep323:16:073
176202999141,9cyclictest17973032sleep319:35:123
1762029991413,0cyclictest0-21swapper/321:19:333
1762029991413,0cyclictest0-21swapper/321:19:333
1762029991412,1cyclictest0-21swapper/320:22:443
1762029991412,0cyclictest0-21swapper/323:07:413
1762029991412,0cyclictest0-21swapper/323:02:173
1762029991412,0cyclictest0-21swapper/322:40:203
1762029991412,0cyclictest0-21swapper/320:19:283
1762029991412,0cyclictest0-21swapper/300:10:093
1762029991411,1cyclictest0-21swapper/323:29:033
1762029991411,1cyclictest0-21swapper/321:07:483
1762029991411,1cyclictest0-21swapper/321:04:493
1762029991411,1cyclictest0-21swapper/320:29:163
176202999141,10cyclictest2187439-21chrt00:05:173
176202999141,10cyclictest2169589-21taskset23:51:053
176202999141,10cyclictest2037368-21chrt22:25:173
176202999141,10cyclictest1990610-21taskset21:55:153
176202999141,10cyclictest1907879-21taskset20:55:563
176202999141,10cyclictest1849096-21chrt20:11:363
176202999141,10cyclictest1776395-21chrt19:15:233
176202999140,11cyclictest1823466-21taskset19:55:013
176202999140,11cyclictest1762170-21taskset19:10:023
176202999131,9cyclictest2072572-21taskset22:50:053
176202999131,9cyclictest1817852-21taskset19:50:173
176202999131,9cyclictest1810424-21taskset19:45:123
176202999131,8cyclictest1869256-21chrt20:30:123
176202999131,10cyclictest1981758-21turbostat21:50:003
1762029991310,1cyclictest0-21swapper/323:55:253
1762029991310,1cyclictest0-21swapper/321:50:213
176202999130,10cyclictest2201004-21taskset00:15:013
17609222131,3sleep11760971-21ntpq19:05:201
17608002131,7sleep01760920-21ntpq19:05:190
20362682124,5sleep22037367-21cut22:25:172
20113642120,9sleep12011368-21ssh22:07:051
19915252120,2sleep014-21ksoftirqd/021:55:160
18823212121,2sleep10-21swapper/120:40:121
18820132121,7sleep11882068-21sendmail-msp20:40:001
18550102121,8sleep21855053-21ntp_states20:15:252
176202999121,8cyclictest18418512sleep320:05:203
176202999121,8cyclictest1790767-21taskset19:30:093
17616212120,2sleep30-21swapper/319:06:463
173198120,7rtkit-daemon2147033-21ssh23:37:000
173198120,4rtkit-daemon2170095-21ssh23:52:551
20253692111,7sleep11921265-21diskmemload22:15:221
19664712110,8sleep01966475-21ssh21:39:100
19018932111,2sleep20-21swapper/220:55:122
173198110,6rtkit-daemon643-21snmpd19:45:201
173198110,6rtkit-daemon1776231-21ntpq19:15:202
173198110,4rtkit-daemon2124452-21ssh23:22:030
173198110,3rtkit-daemon1921265-21diskmemload00:26:490
173198110,2rtkit-daemon1921265-21diskmemload23:44:170
22008032100,7sleep22201003-21ssh00:15:012
21990392100,7sleep02199086-21/usr/sbin/munin00:10:230
21849862100,6sleep11921265-21diskmemload00:02:061
21785522101,5sleep02178712-21diskstats00:00:130
21622222100,7sleep1403499-21sshd23:47:391
20629092100,8sleep12057585-21/usr/sbin/munin22:40:181
20349802102,4sleep12035015-21apt-get22:25:121
19965982100,7sleep21921265-21diskmemload21:58:192
19734492101,5sleep01973453-21ssh21:42:020
18967502100,7sleep11898597-21tr20:50:181
18157912100,6sleep01815840-21ntpq19:45:220
173198100,6rtkit-daemon1921265-21diskmemload22:09:020
173198100,6rtkit-daemon1891958-21cut20:45:191
173198100,5rtkit-daemon2229511-21python300:30:250
173198100,5rtkit-daemon2095463-21/usr/sbin/munin23:05:110
173198100,5rtkit-daemon2058465-21sed22:40:142
173198100,2rtkit-daemon0-21swapper/023:17:200
2231332290,1sleep00-21swapper/000:35:030
2208594290,2sleep10-21swapper/100:20:091
2170928291,4sleep02170963-21apt-get23:55:130
2140617292,4sleep22140652-21apt-get23:35:102
2131952290,6sleep12131954-21ssh23:26:551
2130974290,2sleep20-21swapper/223:25:212
2093069291,4sleep12093125-21ntp_states23:00:231
2077702290,6sleep02077886-21/usr/sbin/munin22:50:190
2027442291,4sleep22027481-21ssh22:20:122
2017943290,6sleep02018030-21sendmail_mailst22:10:240
1931858290,6sleep21933779-21kthreadcore21:15:192
1931858290,6sleep21933779-21kthreadcore21:15:192
1921548292,3sleep11921581-21apt-get21:10:131
1914744290,6sleep11914982-21cat21:05:011
1909845291,6sleep01911076-21kthreadcore21:00:160
1797466290,7sleep11797588-21gltestperf19:35:131
1795978291,4sleep01796072-21ntpq19:30:190
1782795291,5sleep21782844-21ntpq19:20:192
1765431290,6sleep01767351-21sed19:10:210
17319890,5rtkit-daemon1921265-21diskmemload23:59:151
17319890,4rtkit-daemon2086162-21ssh22:55:431
17319890,4rtkit-daemon1950639-21ssh21:25:591
17319890,4rtkit-daemon1921265-21diskmemload23:12:480
2223849281,3sleep12223882-21apt-get00:30:111
2210943281,4sleep02212961-21kthreadcore00:20:160
2201077281,3sleep12201080-21apt-get00:15:121
2110446280,5sleep22110458-21acpi23:15:102
2095433280,4sleep22095471-21ssh23:05:122
2073007280,4sleep11921265-21diskmemload22:50:161
2056271280,2sleep20-21swapper/222:36:152
2055821281,4sleep12050043-21/usr/sbin/munin22:35:251
2047766280,5sleep02047910-21ntpq22:30:200
2029985280,5sleep02030545-21kthreadcore22:20:190
1987636280,4sleep11987696-21ntpq21:50:221
1974072280,5sleep11921265-21diskmemload21:44:241
1967019281,4sleep21967053-21apt-get21:40:122
1964986280,5sleep21965035-21ps21:35:242
1951669280,6sleep01921265-21diskmemload21:29:560
1914999281,3sleep11915032-21apt-get21:05:121
1894161280,5sleep21894212-21ntpq20:45:232
1889108281,4sleep01889201-21irqcore20:45:160
1882327280,5sleep21882482-21diskstats20:40:132
1849621281,3sleep01849654-21apt-get20:15:150
1835657280,5sleep01835902-21/usr/sbin/munin20:00:240
1835440280,6sleep21835545-21mailstats20:00:222
1817144280,5sleep11817270-21hddtemp_smartct19:50:171
1804211281,4sleep21805207-21irqstats19:40:152
1803554281,3sleep00-21swapper/019:40:010
1785376281,5sleep21785408-21kthreadcore19:25:162
1767771280,2sleep20-21swapper/219:10:262
17319880,4rtkit-daemon649-21ntpd20:15:151
17319880,4rtkit-daemon453-21wpa_supplicant20:04:281
17319880,4rtkit-daemon2125725-21df_inode23:25:120
17319880,4rtkit-daemon2019563-21ssh22:14:431
17319880,4rtkit-daemon14-21ksoftirqd/021:54:440
17319880,4rtkit-daemon0-21swapper/120:30:231
17319880,3rtkit-daemon1901926-21apt-get20:55:111
17319880,2rtkit-daemon2184828-21ssh00:01:302
17319880,2rtkit-daemon2161896-21ssh23:46:262
17319880,2rtkit-daemon2034304-21ssh22:23:351
17319880,1rtkit-daemon0-21swapper/021:47:260
2231354271,2sleep10-21swapper/100:35:091
2223538270,4sleep12223543-21ssh00:29:551
2208972270,5sleep22209826-21sed00:20:152
2201374270,4sleep02201661-21sed00:15:150
2192241270,4sleep12192245-21ssh00:06:151
2120767271,3sleep12122844-21grep23:20:181
2109922271,2sleep10-21swapper/123:14:011
2102686270,4sleep12102821-21sort23:10:001
2071490270,3sleep21921265-21diskmemload22:46:582
2026491270,2sleep22026495-21ssh22:17:352
2019326270,4sleep22019330-21ssh22:13:462
1951405271,4sleep21951407-21ssh21:28:542
1943879270,4sleep11943902-21munin-run21:25:001
1943316270,1sleep00-21swapper/021:22:510
1856211270,4sleep11856349-21grep20:20:131
1841712270,4sleep21841849-21ntpq20:05:192
1836753270,1sleep10-21swapper/120:05:151
1810724270,5sleep21811320-21irqrtprio19:45:162
1768139270,1sleep10-21swapper/119:10:301
1755124271,2sleep20-21swapper/219:05:012
17319870,4rtkit-daemon500-21gmain22:00:310
17319870,4rtkit-daemon500-21gmain21:35:121
17319870,4rtkit-daemon435-21avahi-daemon20:12:371
17319870,3rtkit-daemon1958503-21sshd21:32:171
17319870,3rtkit-daemon1942941-21ssh21:21:282
17319870,3rtkit-daemon1929146-21apt-get21:15:131
17319870,3rtkit-daemon1929146-21apt-get21:15:131
17319870,3rtkit-daemon1768696-21munin-node23:30:220
2237465261,3sleep22237469-21ssh00:35:542
2230493260,4sleep22230495-21ssh00:32:532
2223103260,4sleep22223107-21ssh00:28:162
2193535260,3sleep12193574-21ssh00:10:111
2192447260,1sleep20-21swapper/200:07:002
2173668262,2sleep22175764-21grep23:55:182
2168657260,3sleep02168811-21ntpq23:50:190
2155208260,3sleep12155212-21ssh23:44:281
2139361260,1sleep20-21swapper/223:31:212
2109113260,1sleep20-21swapper/223:10:572
2093781260,2sleep01921265-21diskmemload23:00:580
2070458260,3sleep02070504-21ntpq22:45:220
2064231260,4sleep00-21swapper/022:42:540
2047964260,3sleep22048019-21ntpq22:30:232
2004889260,3sleep22004927-21ssh22:05:132
1988693260,1sleep20-21swapper/221:51:552
1974742260,2sleep11974871-21ssh21:45:161
1957183260,3sleep21957367-21grep21:30:182
1929113260,3sleep00-21swapper/021:15:140
1929113260,3sleep00-21swapper/021:15:130
1922936260,3sleep21924480-21cat21:10:182
1904504261,3sleep00-21swapper/020:55:180
1901379260,1sleep00-21swapper/020:51:410
1877125260,4sleep01879038-21tr20:35:180
1862745260,4sleep11862788-21cpu20:25:141
1856175260,3sleep01856208-21apt-get20:20:130
1802738260,3sleep21802860-21/usr/sbin/munin19:35:232
1793305260,3sleep21795434-21cut19:30:172
1777437261,2sleep10-21swapper/119:20:101
1776265260,3sleep11776313-21ntp_states19:15:221
1772257260,4sleep01773605-21cut19:15:170
17319860,3rtkit-daemon647-21lldpd19:40:191
17319860,3rtkit-daemon643-21snmpd22:35:040
17319860,3rtkit-daemon500-21gmain23:45:110
17319860,3rtkit-daemon1768696-21munin-node19:31:081
17319860,2rtkit-daemon2093819-21ssh23:01:052
17319860,2rtkit-daemon2077984-21ssh22:50:202
17319860,2rtkit-daemon2042510-21ssh22:30:091
17319860,2rtkit-daemon0-21swapper/000:05:320
2194473250,2sleep20-21swapper/200:10:162
2162844250,2sleep22163338-21packagekitd23:50:012
2147089251,2sleep10-21swapper/123:37:131
2133104250,2sleep12133156-21ssh23:30:121
2118021251,2sleep20-21swapper/223:20:072
2110424250,2sleep11921265-21diskmemload23:15:051
2086628250,3sleep22086632-21ssh22:57:312
2085448250,2sleep02085492-21ntpq22:55:200
2070513251,2sleep12070540-21ssh22:45:241
2042183250,3sleep02042187-21ssh22:29:510
2025314250,2sleep00-21swapper/022:15:210
2003423250,3sleep12003427-21ssh22:00:351
1979762250,3sleep20-21swapper/221:45:212
1953405250,2sleep01955121-21cut21:30:160
1901319250,1sleep20-21swapper/220:50:552
1882607250,3sleep01882898-21irqcore20:40:150
1876023252,1sleep2421rcuc/220:35:162
1875417250,1sleep20-21swapper/220:34:332
1862709250,2sleep01862742-21apt-get20:25:130
1856353250,2sleep21856377-21/usr/sbin/munin20:20:142
1838649250,2sleep00-21swapper/020:05:180
1829558250,1sleep00-21swapper/019:57:520
1824919250,2sleep21826924-21grep19:55:172
1818901250,2sleep00-21swapper/019:50:190
1816947251,1sleep20-21swapper/219:50:142
1789959250,3sleep00-21swapper/019:26:160
1783995250,2sleep10-21swapper/119:25:111
2148107240,2sleep22148111-21ssh23:40:042
1995844240,2sleep11995848-21ssh21:55:301
1921831240,1sleep00-21swapper/021:10:160
1913898240,2sleep21913959-21processes21:00:212
1864601240,2sleep21866656-21kthreadcore20:25:192
1843070240,1sleep20-21swapper/220:10:122
1806571240,1sleep00-21swapper/019:40:170
1777665240,1sleep00-21swapper/019:20:130
1914984230,1sleep20-21swapper/221:05:012
1869403230,1sleep00-21swapper/020:30:130
1842976230,1sleep00-21swapper/020:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional