You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 10:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Sat Dec 27, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19078079913020,1298cyclictest20069502sleep320:24:573
19078079911800,1176cyclictest20390492sleep320:49:573
19078079911510,1147cyclictest22453752sleep323:29:563
1907807992991,295cyclictest2103527-21turbostat21:44:553
195577722420,1sleep20-21swapper/219:45:012
1907807992219,1cyclictest0-21swapper/323:00:013
1907807991916,1cyclictest0-21swapper/319:35:003
22598232180,2sleep10-21swapper/123:40:151
1907807991816,1cyclictest0-21swapper/322:50:013
190780799177,6cyclictest2103517-21turbostat21:40:003
1907807991714,1cyclictest0-21swapper/321:05:183
1907807991714,1cyclictest0-21swapper/319:40:003
190780799171,12cyclictest2329887-21taskset00:35:113
190780799161,11cyclictest2039344-21taskset20:50:133
190780799161,10cyclictest2013665-21taskset20:30:123
19751362153,7sleep21975169-21apt-get20:00:122
1907807991513,1cyclictest0-21swapper/320:18:153
1907807991513,0cyclictest0-21swapper/323:00:143
1907807991512,1cyclictest0-21swapper/323:44:553
1907807991512,1cyclictest0-21swapper/323:17:183
1907807991512,1cyclictest0-21swapper/322:15:543
1907807991512,1cyclictest0-21swapper/321:55:093
1907807991512,1cyclictest0-21swapper/319:25:233
190780799151,11cyclictest2058314-21turbostat21:05:003
301798140,5rtkit-daemon676-21runrttasks20:08:232
22648472142,8sleep02264880-21apt-get23:45:120
22135422141,4sleep12213570-21apt-get23:05:111
20778322141,4sleep22077864-21apt-get21:20:102
190780799145,6cyclictest22260892sleep323:14:453
190780799144,7cyclictest2097122-21turbostat21:35:003
190780799144,7cyclictest1987426-21taskset20:06:053
190780799142,8cyclictest1975172-21taskset20:00:123
190780799141,9cyclictest2007246-21taskset20:25:133
1907807991413,0cyclictest0-21swapper/322:24:403
1907807991413,0cyclictest0-21swapper/322:03:173
1907807991413,0cyclictest0-21swapper/321:47:543
1907807991413,0cyclictest0-21swapper/320:36:493
1907807991412,1cyclictest0-21swapper/321:53:223
1907807991412,1cyclictest0-21swapper/320:58:343
1907807991412,1cyclictest0-21swapper/320:44:113
1907807991412,1cyclictest0-21swapper/319:23:463
1907807991412,1cyclictest0-21swapper/319:15:373
1907807991412,1cyclictest0-21swapper/300:14:343
190780799141,10cyclictest2323161-21taskset00:30:023
190780799141,10cyclictest2180188-21taskset22:35:233
190780799141,10cyclictest2168319-21taskset22:30:013
190780799141,10cyclictest2148393-21chrt22:12:313
190780799141,10cyclictest2084565-21taskset21:25:113
190780799140,11cyclictest2309883-21taskset00:20:003
190780799140,11cyclictest2309883-21taskset00:20:003
190780799140,11cyclictest2286558-21taskset00:00:173
23219412130,9sleep12322055-21awk00:25:201
23219412130,9sleep12322055-21awk00:25:201
22453792131,9sleep22245389-21idleruntime-cro23:29:592
190780799134,7cyclictest1993954-21taskset20:12:303
190780799131,9cyclictest2283495-21taskset23:55:563
190780799131,9cyclictest2213730-21chrt23:05:123
190780799131,9cyclictest2161968-21taskset22:25:133
190780799131,9cyclictest1955914-21taskset19:45:103
190780799131,9cyclictest1955914-21taskset19:45:103
190780799131,9cyclictest1908568-21chrt19:10:163
190780799131,8cyclictest2290628-21taskset00:05:143
1907807991311,1cyclictest0-21swapper/323:24:583
1907807991311,1cyclictest0-21swapper/300:27:333
1907807991311,1cyclictest0-21swapper/300:27:323
190780799131,10cyclictest1949227-21taskset19:40:013
1907807991310,1cyclictest0-21swapper/322:05:163
1907807991310,1cyclictest0-21swapper/321:25:003
190780799130,10cyclictest2270838-21taskset23:48:073
190780799130,10cyclictest2200121-21chrt22:54:223
22972482121,3sleep12297281-21apt-get00:10:141
22150372121,4sleep22217049-21grep23:05:162
21283752121,8sleep22128433-21ntp_states21:55:202
190780799123,7cyclictest2181627-21taskset22:40:153
190780799121,9cyclictest2277113-21taskset23:51:183
190780799121,9cyclictest2258030-21chrt23:38:133
190780799121,9cyclictest2070956-21taskset21:12:563
190780799121,8cyclictest2071357-21taskset21:15:013
190780799121,8cyclictest1968118-21taskset19:50:303
190780799120,9cyclictest2310357-21taskset00:20:083
190780799120,9cyclictest2251429-21chrt23:30:323
190780799120,9cyclictest1973935-21taskset19:55:203
301798110,6rtkit-daemon1921937-21ntp_states19:15:202
20312772110,1sleep20-21swapper/220:40:182
19165932112,5sleep11916626-21apt-get19:15:121
301798100,7rtkit-daemon3052-21udisksd19:36:162
301798100,5rtkit-daemon2203255-21grep22:55:172
301798100,5rtkit-daemon2038213-21ntp_states20:45:202
23350922101,6sleep22335163-21ntp_states00:35:182
22124602100,1sleep22207150-21/usr/sbin/munin23:00:232
21503302101,6sleep12152177-21cut22:15:181
20899702103,5sleep12090112-21cat21:25:221
19482722100,7sleep01948466-21sed19:35:220
30179890,6rtkit-daemon492-21gmain20:37:052
30179890,5rtkit-daemon448-21wpa_supplicant19:05:202
30179890,5rtkit-daemon3205-21sendmail-mta22:48:572
30179890,5rtkit-daemon3205-21sendmail-mta00:25:482
30179890,5rtkit-daemon3205-21sendmail-mta00:25:472
30179890,5rtkit-daemon3205-21sendmail-mta00:12:582
30179890,5rtkit-daemon2148578-21cat22:14:552
30179890,5rtkit-daemon2111654-21grep21:45:172
30179890,5rtkit-daemon2090690-21munin-run21:29:592
30179890,4rtkit-daemon2238072-21ntpq23:20:182
30179890,3rtkit-daemon492-21gmain19:10:492
2329335290,6sleep02329760-21dpkg00:35:010
2303662291,4sleep02303695-21apt-get00:15:130
2303662291,4sleep02303695-21apt-get00:15:120
2258445291,4sleep02258478-21apt-get23:40:110
2233003291,5sleep12233202-21/usr/sbin/munin23:20:131
2200170290,7sleep12200291-21latency_hist22:55:011
2154220291,5sleep22154320-21sed22:15:232
2110193291,4sleep02110226-21apt-get21:45:120
2050941291,5sleep22050997-21ntp_states20:55:222
1949240291,4sleep11949273-21apt-get19:40:121
1922609290,1sleep00-21swapper/019:17:470
1909511290,1sleep01911521-21kthreadcore19:10:180
30179880,5rtkit-daemon3205-21sendmail-mta22:42:082
30179880,5rtkit-daemon3200908-21packagekitd23:31:172
30179880,4rtkit-daemon638-21ntpd20:50:402
30179880,4rtkit-daemon636-21snmpd22:28:582
30179880,4rtkit-daemon636-21snmpd22:08:242
30179880,4rtkit-daemon636-21snmpd21:30:282
30179880,4rtkit-daemon3205-21sendmail-mta22:20:332
30179880,4rtkit-daemon3205-21sendmail-mta00:32:132
30179880,4rtkit-daemon317-21systemd-udevd22:39:332
30179880,4rtkit-daemon1928351-21ntpq19:20:202
30179880,4rtkit-daemon1914311-21munin-node22:03:122
30179880,4rtkit-daemon1914311-21munin-node21:42:552
30179880,4rtkit-daemon1914311-21munin-node21:36:222
30179880,4rtkit-daemon1914311-21munin-node21:01:282
30179880,4rtkit-daemon1914311-21munin-node00:17:242
30179880,4rtkit-daemon1914311-21munin-node00:17:242
30179880,3rtkit-daemon2279036-21irqrtprio23:55:172
30179880,1rtkit-daemon0-21swapper/223:54:572
30179880,1rtkit-daemon0-21swapper/220:16:072
2312159281,4sleep22314203-21tr00:20:162
2276478280,6sleep02276545-21/usr/sbin/munin23:50:210
2238135281,5sleep02238255-21mailstats23:20:200
2226364280,4sleep12226397-21apt-get23:15:121
2194024281,4sleep22194180-21diskstats22:50:132
2181219281,4sleep02181366-21df22:40:130
2155522281,3sleep12155555-21apt-get22:20:141
2111370281,5sleep10-21swapper/121:45:171
2097711280,5sleep02097848-21irqcore21:35:180
2046073283,3sleep12046218-21sed20:55:171
1995328281,4sleep01996329-21tr20:15:170
1935553280,5sleep21935554-21sshd19:29:192
1906773281,4sleep30-21swapper/319:05:203
30179870,4rtkit-daemon667-21lldpd20:13:292
30179870,4rtkit-daemon492-21gmain21:05:252
30179870,4rtkit-daemon492-21gmain00:02:002
30179870,4rtkit-daemon430-21avahi-daemon21:10:272
30179870,4rtkit-daemon3205-21sendmail-mta19:50:332
30179870,4rtkit-daemon1914311-21munin-node23:15:022
30179870,4rtkit-daemon1914311-21munin-node20:20:292
30179870,3rtkit-daemon638-21ntpd21:53:102
30179870,3rtkit-daemon636-21snmpd23:47:102
30179870,3rtkit-daemon636-21snmpd23:42:582
30179870,3rtkit-daemon636-21snmpd23:10:102
30179870,3rtkit-daemon3200908-21packagekitd22:30:472
30179870,3rtkit-daemon1914311-21munin-node23:37:102
30179870,3rtkit-daemon1914311-21munin-node19:56:362
30179870,3rtkit-daemon1914311-21munin-node19:46:372
30179870,3rtkit-daemon1914311-21munin-node19:46:372
2329762270,3sleep12329347-21apt-get00:35:011
2290592271,3sleep22290625-21apt-get00:05:132
2277837270,4sleep12277914-21grep23:55:151
2247321271,3sleep00-21swapper/023:30:180
2149329271,3sleep02150308-21kernelversion22:15:170
2147662270,4sleep02147741-21ntp_states22:10:200
2128546271,3sleep02128655-21find21:55:210
2116651270,3sleep12116684-21apt-get21:50:101
2106049271,4sleep12106923-21kthreadcore21:40:151
2052115270,3sleep02052148-21apt-get21:00:120
2031810271,3sleep12031926-21python320:40:221
2019212270,4sleep22019397-21users20:30:262
2007400270,4sleep02007513-21perl20:25:150
2007210271,2sleep20-21swapper/220:25:132
1963790270,4sleep01965591-21tr19:50:170
1941367270,4sleep21941440-21ntp_states19:30:182
1906833270,4sleep01906928-21mailstats19:05:200
30179860,3rtkit-daemon636-21snmpd21:15:512
2323880261,2sleep10-21swapper/100:30:171
2311246261,3sleep12312156-21kthreadcore00:20:151
2213536261,2sleep00-21swapper/023:05:100
2206609261,3sleep02206673-21apt-key23:00:010
2193695260,1sleep00-21swapper/022:49:310
2183668261,2sleep10-21swapper/122:40:181
2174805260,4sleep12174770-21/usr/sbin/munin22:35:141
2174305260,1sleep00-21swapper/022:32:200
2164742261,3sleep02166924-21kthreadcore22:25:190
2144598260,4sleep12146689-21kthreadcore22:10:171
2141439260,3sleep12141638-21sed22:05:251
2138672261,2sleep00-21swapper/022:05:200
2123508260,4sleep12123661-21irqcore21:55:151
2103813260,4sleep02103942-21tr21:40:100
2103500260,1sleep1171rcu_preempt21:40:001
2090964260,3sleep02091112-21sh21:30:140
2086698260,3sleep02088814-21tr21:25:170
2083738260,1sleep00-21swapper/021:21:240
2071369260,3sleep02071400-21apt21:15:110
2058551260,3sleep00-21swapper/021:05:130
2045698261,2sleep02045731-21apt-get20:55:120
2038916260,1sleep00-21swapper/020:48:150
2036949260,3sleep12038017-21memory20:45:191
2021559260,3sleep12023595-21cut20:35:171
2001012260,4sleep02001146-21gltestperf20:20:130
1975326261,2sleep00-21swapper/020:00:140
1974052260,3sleep11974169-21python319:55:231
1970178262,2sleep00-21swapper/019:55:170
1943207261,2sleep10-21swapper/119:35:151
1942107260,1sleep00-21swapper/019:32:420
1935511260,1sleep00-21swapper/019:28:450
1931451261,3sleep11933527-21cut19:25:181
2335675250,1sleep00-21swapper/000:35:410
2322709250,1sleep00-21swapper/000:27:230
2322709250,1sleep00-21swapper/000:27:230
2310359250,2sleep02310392-21apt-get00:20:100
2303176250,1sleep00-21swapper/000:12:050
2296552250,1sleep00-21swapper/000:07:440
2290105250,1sleep00-21swapper/000:02:030
2257406251,2sleep10-21swapper/123:35:201
2253486250,3sleep02255089-21cat23:35:150
2251579250,1sleep10-21swapper/123:32:271
2241330250,3sleep12243414-21kthreadcore23:25:171
2232261250,1sleep00-21swapper/023:16:360
2225758250,1sleep00-21swapper/023:10:310
2208131250,3sleep12209072-21cut23:00:171
2201408251,2sleep10-21swapper/122:55:171
2193987251,2sleep00-21swapper/022:50:110
2193576250,1sleep10-21swapper/122:47:591
2175169250,3sleep02175631-21sed22:35:170
2168073250,2sleep10-21swapper/122:30:011
2161505250,3sleep00-21swapper/022:22:450
2135554251,2sleep00-21swapper/022:03:190
2093516251,2sleep10-21swapper/121:30:191
2070928250,1sleep00-21swapper/021:12:350
2063838250,2sleep10-21swapper/121:05:221
2041470250,3sleep02043546-21kthreadcore20:50:190
2039514251,2sleep10-21swapper/120:50:161
2020031250,2sleep00-21swapper/020:35:110
2019456250,1sleep00-21swapper/020:31:040
2013252250,1sleep10-21swapper/120:28:281
1994147250,3sleep01994285-21latency_hist20:15:010
1983734250,2sleep10-21swapper/120:05:161
1968116250,1sleep10-21swapper/119:50:301
1962050250,1sleep00-21swapper/019:49:410
1962050250,1sleep00-21swapper/019:49:400
1961999250,1sleep10-21swapper/119:49:021
1961999250,1sleep10-21swapper/119:49:011
1955113250,1sleep00-21swapper/019:41:190
1928855250,1sleep10-21swapper/119:20:411
2305120240,2sleep12306778-21kthreadcore00:15:181
2305120240,2sleep12306778-21kthreadcore00:15:181
2284154240,1sleep10-21swapper/100:00:121
2279087240,2sleep00-21swapper/023:55:180
2266304240,1sleep10-21swapper/123:45:171
2207149240,1sleep00-21swapper/023:00:120
2168332242,1sleep1376-21hwrng22:30:131
2083774240,3sleep10-21swapper/121:21:531
2065919240,2sleep12066821-21grep21:10:191
2052151241,1sleep10-21swapper/121:00:131
2027910240,2sleep00-21swapper/020:40:170
2013627240,2sleep10-21swapper/120:30:121
2000228240,3sleep10-21swapper/120:16:021
1982568240,2sleep01983040-21kthreadcore20:05:150
1901766240,1sleep10-21swapper/119:05:131
2290898230,1sleep10-21swapper/100:05:161
2272695230,1sleep10-21swapper/123:50:181
2240211230,1sleep00-21swapper/023:25:170
2220173230,1sleep10-21swapper/123:10:151
2129549230,1sleep10-21swapper/122:00:121
2116956230,1sleep00-21swapper/021:50:130
2071401230,1sleep10-21swapper/121:15:121
2001147230,1sleep10-21swapper/120:20:141
1980101231,1sleep11980369-21grep20:00:191
1941606230,1sleep10-21swapper/119:30:211
1923056230,1sleep00-21swapper/019:20:120
1987734220,1sleep10-21swapper/120:10:011
1907967220,1sleep10-21swapper/119:10:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional