You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 16:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8s.osadl.org (updated Sun Dec 14, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17722339912691,1264cyclictest2194279-21sleep12:35:003
17722339912070,1204cyclictest18260822sleep307:49:553
17722339910920,1088cyclictest18586542sleep308:14:563
17722339910710,1067cyclictest19491592sleep309:24:553
1772233999040,901cyclictest2103833-21sleep11:25:003
1772233992522,1cyclictest0-21swapper/309:20:003
1772233992320,1cyclictest0-21swapper/311:00:153
1772233992219,1cyclictest0-21swapper/309:35:003
1772233992118,1cyclictest0-21swapper/308:35:163
177223399187,8cyclictest2200676-21turbostat12:40:003
1772233991715,1cyclictest0-21swapper/307:30:003
1772233991714,1cyclictest0-21swapper/311:50:143
177223399170,7cyclictest0-21swapper/309:40:113
301798160,12rtkit-daemon1778715-21munin-node09:55:132
18655712161,4sleep01865731-21grep08:20:150
1772233991614,1cyclictest0-21swapper/308:15:163
1772233991613,1cyclictest0-21swapper/309:15:013
177223399161,12cyclictest1897726-21taskset08:45:013
177223399161,11cyclictest2078351-21taskset11:05:123
1772233991513,1cyclictest0-21swapper/312:25:213
1772233991513,1cyclictest0-21swapper/309:30:003
1772233991512,1cyclictest0-21swapper/312:00:203
1772233991512,1cyclictest0-21swapper/308:55:163
1772233991512,1cyclictest0-21swapper/308:44:103
1772233991512,1cyclictest0-21swapper/308:10:013
1772233991512,1cyclictest0-21swapper/307:22:443
177223399151,11cyclictest2014177-21taskset10:15:123
177223399151,11cyclictest2009164-21taskset10:10:153
20352622145,7sleep12037364-21tr10:30:171
20352622145,7sleep12037364-21tr10:30:161
177223399145,6cyclictest18263792sleep307:50:133
177223399141,9cyclictest19169782sleep309:00:133
177223399141,9cyclictest18394502sleep308:00:113
1772233991412,1cyclictest0-21swapper/311:40:553
1772233991412,1cyclictest0-21swapper/311:30:303
1772233991412,1cyclictest0-21swapper/311:16:443
1772233991412,1cyclictest0-21swapper/311:11:013
1772233991412,1cyclictest0-21swapper/310:46:323
1772233991412,1cyclictest0-21swapper/310:21:233
1772233991412,0cyclictest0-21swapper/311:56:093
1772233991412,0cyclictest0-21swapper/308:22:483
1772233991411,1cyclictest0-21swapper/312:20:283
1772233991411,1cyclictest0-21swapper/312:05:253
1772233991411,1cyclictest0-21swapper/310:42:053
177223399141,10cyclictest2007308-21taskset10:08:113
177223399141,10cyclictest2000776-21chrt10:01:383
177223399141,10cyclictest1981454-21taskset09:45:513
177223399141,10cyclictest1928753-21chrt09:05:213
177223399141,10cyclictest1871956-21taskset08:25:143
177223399140,11cyclictest2071602-21chrt10:59:593
177223399140,10cyclictest1962413-21taskset09:35:133
19820332131,3sleep21982066-21apt-get09:50:122
177223399137,3cyclictest1806389-21taskset07:31:293
177223399133,7cyclictest1812952-21taskset07:36:543
177223399131,9cyclictest2168015-21taskset12:11:113
177223399131,9cyclictest2129748-21chrt11:45:033
177223399131,9cyclictest2062342-21taskset10:50:173
177223399131,9cyclictest1909958-21taskset08:50:303
177223399131,9cyclictest1878193-21taskset08:30:113
177223399131,9cyclictest1777030-21taskset07:10:143
1772233991311,1cyclictest0-21swapper/307:55:133
1772233991310,1cyclictest0-21swapper/312:20:003
1772233991310,1cyclictest0-21swapper/311:37:223
1772233991310,1cyclictest0-21swapper/311:25:163
1772233991310,1cyclictest0-21swapper/309:51:433
177223399130,10cyclictest2033400-21taskset10:30:063
177223399130,10cyclictest2033400-21taskset10:30:063
177223399130,10cyclictest1990858-21taskset09:55:173
177223399130,10cyclictest1819228-21taskset07:40:233
177223399129,1cyclictest0-21swapper/310:25:163
1772233991210,0cyclictest0-21swapper/310:36:053
177223399120,9cyclictest1786789-21chrt07:15:353
18199032111,7sleep11819936-21apt-get07:45:101
301798100,6rtkit-daemon1949178-21latency_hist09:25:000
301798100,5rtkit-daemon448-21wpa_supplicant12:05:172
301798100,5rtkit-daemon448-21wpa_supplicant11:15:152
301798100,5rtkit-daemon448-21wpa_supplicant08:50:270
301798100,5rtkit-daemon2090073-21ntp_states11:10:202
301798100,5rtkit-daemon1806237-21awk07:30:241
301798100,3rtkit-daemon636-21snmpd10:58:082
20590112101,5sleep12059043-21apt-get10:50:131
20564872101,5sleep22057724-21memory10:45:212
19362872101,6sleep00-21swapper/009:15:120
18977402101,5sleep11897773-21apt-get08:45:121
18586582101,6sleep21858669-21latency_hist08:15:002
17809792101,5sleep01781012-21apt-get07:15:130
30179890,6rtkit-daemon3200908-21packagekitd10:54:582
30179890,5rtkit-daemon636-21snmpd09:34:162
30179890,5rtkit-daemon492-21gmain12:23:282
30179890,5rtkit-daemon0-21swapper/210:40:132
30179890,4rtkit-daemon2169012-21df12:15:132
30179890,4rtkit-daemon1973088-21grep09:40:172
30179890,4rtkit-daemon1897710-21gpg-connect-age08:45:010
30179890,1rtkit-daemon0-21swapper/107:05:231
30179890,1rtkit-daemon0-21swapper/008:59:010
30179890,1rtkit-daemon0-21swapper/008:37:050
2186916291,4sleep02186988-21ntp_states12:25:190
2098087291,4sleep02099082-21irqstats11:20:170
2051992290,1sleep00-21swapper/010:40:290
2001036291,2sleep00-21swapper/010:05:000
1949421290,2sleep10-21swapper/109:25:111
1891446290,6sleep11892031-21irqrtprio08:40:151
1887952290,1sleep10-21swapper/108:35:181
1848027291,5sleep01850161-21cut08:05:170
1845849291,4sleep21845882-21apt-get08:05:112
1797404290,7sleep0151ktimers/007:25:220
1793810291,6sleep21793849-21/usr/sbin/munin07:25:002
30179880,4rtkit-daemon667-21lldpd08:17:160
30179880,4rtkit-daemon636-21snmpd12:03:102
30179880,4rtkit-daemon636-21snmpd11:49:232
30179880,4rtkit-daemon636-21snmpd10:06:242
30179880,4rtkit-daemon636-21snmpd07:51:422
30179880,4rtkit-daemon492-21gmain08:41:290
30179880,4rtkit-daemon448-21wpa_supplicant12:33:592
30179880,4rtkit-daemon448-21wpa_supplicant11:37:262
30179880,4rtkit-daemon448-21wpa_supplicant11:22:452
30179880,4rtkit-daemon448-21wpa_supplicant11:09:332
30179880,4rtkit-daemon448-21wpa_supplicant07:44:341
30179880,4rtkit-daemon413-21rpcbind07:20:111
30179880,4rtkit-daemon1964269-21kthreadcore09:35:172
30179880,4rtkit-daemon1925368-21cut09:05:170
30179880,4rtkit-daemon1778715-21munin-node12:35:312
30179880,4rtkit-daemon1778715-21munin-node09:02:390
30179880,4rtkit-daemon1778715-21munin-node08:34:430
30179880,4rtkit-daemon1778715-21munin-node07:15:451
30179880,4rtkit-daemon0-21swapper/009:30:040
30179880,3rtkit-daemon44-21ksoftirqd/210:15:172
30179880,3rtkit-daemon2128472-21memory11:40:192
2184791281,4sleep22186756-21cat12:25:172
2128940281,4sleep02129140-21users11:40:240
2109631281,4sleep22109875-21users11:25:242
2096979280,1sleep10-21swapper/111:15:251
2025816280,5sleep22025892-21ntp_states10:20:212
2019484281,4sleep02019609-21python310:15:220
2008170281,4sleep22009163-21irqstats10:10:152
2007295280,1sleep00-21swapper/010:08:010
2000124280,5sleep12000141-21netstat10:00:211
1988469280,4sleep11988502-21apt-get09:55:121
1975637280,4sleep11975793-21diskstats09:45:141
1954680280,5sleep21954738-21ntp_states09:25:202
1949165281,4sleep21949183-21munin-run09:25:002
1917324281,4sleep21917463-21sed09:00:162
1917170280,2sleep10-21swapper/109:00:151
1871803280,4sleep21871955-21df_inode08:25:142
1835728281,4sleep20-21swapper/207:55:172
1833016280,4sleep01833049-21apt-get07:55:110
1812194281,4sleep10-21swapper/107:35:211
1773580281,4sleep11774861-21grep07:10:131
1772782280,5sleep01773360-21irqrtprio07:10:120
30179870,4rtkit-daemon3200908-21packagekitd11:57:282
30179870,4rtkit-daemon0-21swapper/210:31:012
30179870,4rtkit-daemon0-21swapper/210:31:012
30179870,3rtkit-daemon636-21snmpd10:25:412
30179870,3rtkit-daemon636-21snmpd08:11:450
30179870,3rtkit-daemon430-21avahi-daemon08:00:022
30179870,3rtkit-daemon3205-21sendmail-mta12:10:302
30179870,3rtkit-daemon3205-21sendmail-mta07:25:351
30179870,3rtkit-daemon3200908-21packagekitd09:48:082
30179870,3rtkit-daemon2044804-21cut10:35:182
30179870,3rtkit-daemon1873259-21kthreadcore08:25:170
30179870,3rtkit-daemon1778715-21munin-node11:30:372
30179870,3rtkit-daemon1778715-21munin-node11:00:212
30179870,1rtkit-daemon0-21swapper/009:28:360
2196037270,5sleep12198104-21cut12:35:181
2194518270,3sleep00-21swapper/012:35:130
2162288270,4sleep12162332-21tune2fs12:10:141
2137949271,3sleep22140019-21cut11:50:162
2129443270,3sleep1636-21snmpd11:44:141
2065454270,4sleep00-21swapper/010:55:130
2052698270,5sleep12052600-21/usr/sbin/munin10:45:161
2023218270,5sleep02025400-21kthreadcore10:20:190
2003427270,4sleep12005557-21kthreadcore10:05:171
2000143270,4sleep22000201-21ntp_states10:00:222
1975165271,3sleep01975097-21apt-get09:45:010
1968381271,2sleep00-21swapper/009:40:000
1934052270,4sleep01935016-21sed09:10:190
1929889271,4sleep21930032-21df09:10:132
1929418271,4sleep11929420-21sshd09:07:481
1897221270,3sleep21897242-21apt-get08:45:012
1820884270,4sleep21821922-21grep07:45:152
1805849270,4sleep01805974-21python307:30:230
1771373270,4sleep01771636-21grep07:05:190
2181096260,1sleep10-21swapper/112:20:481
2162144260,3sleep02162287-21df12:10:130
2155461260,4sleep02155510-21latency_hist12:05:000
2135880260,1sleep00-21swapper/011:49:500
2135166261,3sleep12135278-21grep11:45:221
2117932261,3sleep10-21swapper/111:35:161
2116934261,2sleep00-21swapper/011:35:110
2091559261,2sleep00-21swapper/011:15:160
2090299260,3sleep02090543-21users11:10:230
2071428260,1sleep10-21swapper/110:57:461
2046240260,3sleep12046205-21/usr/sbin/munin10:40:111
2041986260,3sleep02044124-21cut10:35:170
2027975261,3sleep12028971-21kthreadcore10:25:171
1994602260,1sleep00-21swapper/009:59:230
1968686260,3sleep11968396-21apt-get09:40:011
1938794260,3sleep21940924-21tr09:15:182
1924012261,2sleep20-21swapper/209:05:172
1883996260,1sleep10-21swapper/108:30:461
1878191261,3sleep21878192-21munin-node08:30:112
1859581261,2sleep21860407-21kthreadcore08:15:162
1858910260,1sleep10-21swapper/108:15:071
1826737261,3sleep11827011-21irqcore07:50:151
1807267260,3sleep01807406-21irqcore07:35:150
1806916260,1sleep20-21swapper/207:35:102
1800519260,3sleep20-21swapper/207:30:132
1766001260,3sleep30-21swapper/307:05:103
2183133250,2sleep10-21swapper/112:25:161
2161366250,1sleep00-21swapper/012:05:280
2155717251,1sleep10-21swapper/112:05:131
2155163250,1sleep10-21swapper/112:01:071
2143659251,2sleep10-21swapper/111:55:151
2143221250,3sleep02143658-21cut11:55:140
2142283250,4sleep00-21swapper/011:51:180
2136422250,2sleep10-21swapper/111:50:111
2116478250,1sleep00-21swapper/011:32:230
2116466250,1sleep10-21swapper/111:32:161
2084741250,2sleep10-21swapper/111:10:121
2078662250,2sleep12078794-21ps11:05:151
2077716250,1sleep00-21swapper/011:00:330
2044126251,2sleep10-21swapper/110:35:181
2034254250,2sleep02035261-21kthreadcore10:30:160
2034254250,2sleep02035261-21kthreadcore10:30:160
2032931250,1sleep00-21swapper/010:27:120
1982227250,2sleep00-21swapper/009:50:140
1955837250,2sleep10-21swapper/109:30:121
1944574251,2sleep10-21swapper/109:20:181
1937582251,1sleep10-21swapper/109:15:171
1929853250,2sleep10-21swapper/109:10:121
1910015250,1sleep20-21swapper/208:51:142
1871767250,3sleep10-21swapper/108:25:131
1858555250,1sleep10-21swapper/108:13:431
1839487250,3sleep01839636-21df_inode08:00:120
1838322250,3sleep11838367-21proc_pri07:55:201
1819548250,1sleep20-21swapper/207:43:432
1814504250,2sleep01815777-21cut07:40:170
1788061251,1sleep00-21swapper/007:20:170
1787092250,1sleep20-21swapper/207:19:272
1774862251,2sleep20-21swapper/207:10:142
2194039240,3sleep10-21swapper/112:32:171
2190295240,2sleep00-21swapper/012:30:160
2175241240,1sleep00-21swapper/012:20:100
2105883240,2sleep02033193-21kworker/0:1+kacpid11:25:180
2104256240,2sleep10-21swapper/111:25:141
2099083240,2sleep12100518-21cut11:20:181
2053499240,2sleep00-21swapper/010:45:190
2020791241,1sleep10-21swapper/110:20:161
2020100240,1sleep10-21swapper/110:17:231
2010784240,2sleep00-21swapper/010:10:170
1970332241,1sleep00-21swapper/009:40:160
1913011240,2sleep1321rcuc/108:55:181
1904177240,1sleep10-21swapper/108:50:131
1892032240,2sleep21893136-21kthreadcore08:40:162
1865736240,2sleep11865961-21irqcore08:20:161
1865379240,1sleep20-21swapper/208:20:132
1851671240,3sleep10-21swapper/108:05:421
1825784240,2sleep01825785-21pool-udisksd07:46:100
1766945240,1sleep20-21swapper/207:05:132
2174724230,1sleep10-21swapper/112:16:551
2168864230,1sleep00-21swapper/012:15:130
2084175230,1sleep00-21swapper/011:06:100
2072074230,1sleep10-21swapper/111:00:141
2059009230,1sleep00-21swapper/010:50:120
2013250230,1sleep10-21swapper/110:10:221
1987535230,1sleep10-21swapper/109:50:231
1961970230,1sleep10-21swapper/109:35:001
1916009230,1sleep20-21swapper/208:55:232
1889693230,1sleep20-21swapper/208:35:202
1839637230,1sleep10-21swapper/108:00:131
1826336230,1sleep00-21swapper/007:50:060
1799333230,1sleep20-21swapper/207:25:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional