You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-09 - 22:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Mon Mar 09, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21152789911020,1098cyclictest2454875-21sleep11:10:003
21152789910580,1053cyclictest2364878-21sleep10:10:003
2115278992890,285cyclictest2537489-21turbostat12:09:553
2115278992700,267cyclictest2195728-21turbostat08:14:553
24971882210,3sleep12496905-21ssh11:35:181
173198210,6rtkit-daemon0-21swapper/112:33:561
21328752180,1sleep20-21swapper/207:20:162
211527899188,7cyclictest25153122sleep311:50:123
211527899182,12cyclictest2342448-21turbostat09:55:003
211527899176,7cyclictest21422952sleep307:25:193
211527899171,13cyclictest2248694-21taskset08:50:133
211527899166,7cyclictest23706742sleep310:10:253
211527899164,8cyclictest25602262sleep312:19:493
211527899164,8cyclictest25602262sleep312:19:493
211527899164,8cyclictest21583222sleep307:40:183
2115278991613,1cyclictest0-21swapper/310:49:133
2115278991613,1cyclictest0-21swapper/307:55:573
211527899161,11cyclictest2372692-21taskset10:15:123
211527899161,10cyclictest23278152sleep309:45:123
211527899160,6cyclictest0-21swapper/311:15:203
211527899155,7cyclictest2528186-21taskset11:55:193
211527899154,7cyclictest25670792sleep312:22:213
2115278991513,1cyclictest0-21swapper/310:24:143
2115278991513,1cyclictest0-21swapper/309:02:553
2115278991512,1cyclictest0-21swapper/312:10:563
2115278991512,1cyclictest0-21swapper/311:41:373
2115278991512,1cyclictest0-21swapper/309:22:573
2115278991512,1cyclictest0-21swapper/308:06:153
2115278991512,1cyclictest0-21swapper/307:11:133
211527899151,11cyclictest2500160-21taskset11:40:013
211527899151,11cyclictest2130568-21chrt07:20:013
23726652142,8sleep22372687-21apt-get10:15:132
211527899145,7cyclictest2575222-21taskset12:29:543
211527899145,6cyclictest25147852sleep311:49:033
211527899145,6cyclictest2202721-21taskset08:15:073
211527899144,7cyclictest24251722sleep310:50:043
211527899144,7cyclictest21438942sleep307:30:123
211527899144,7cyclictest21438942sleep307:30:113
211527899141,9cyclictest2400393-21taskset10:30:183
211527899141,9cyclictest22799162sleep309:10:213
211527899141,9cyclictest21699472sleep307:50:123
2115278991412,1cyclictest0-21swapper/309:37:393
2115278991412,0cyclictest0-21swapper/312:05:003
2115278991412,0cyclictest0-21swapper/309:27:233
2115278991412,0cyclictest0-21swapper/308:49:003
2115278991411,1cyclictest0-21swapper/310:36:033
2115278991411,1cyclictest0-21swapper/310:04:393
2115278991411,1cyclictest0-21swapper/308:30:193
211527899141,10cyclictest2589376-21taskset12:36:553
211527899141,10cyclictest2470471-21taskset11:20:133
211527899141,10cyclictest2447398-21turbostat11:05:003
211527899141,10cyclictest2348989-21chrt09:56:333
211527899141,10cyclictest2312632-21taskset09:35:013
211527899141,10cyclictest2286441-21taskset09:15:173
211527899141,10cyclictest2258910-21taskset08:55:173
211527899141,10cyclictest2214602-21taskset08:20:203
211527899141,10cyclictest2189220-21taskset08:04:573
211527899140,11cyclictest2492440-21taskset11:34:563
211527899140,10cyclictest25808402sleep312:30:183
173198140,4rtkit-daemon2310389-21ntpq09:30:190
211527899131,9cyclictest2477884-21taskset11:25:093
211527899131,9cyclictest2462625-21chrt11:15:003
211527899131,9cyclictest2438058-21taskset10:55:203
211527899131,9cyclictest2241600-21taskset08:41:263
211527899131,9cyclictest22211282sleep308:25:213
211527899131,9cyclictest2155772-21taskset07:35:203
2115278991312,0cyclictest0-21swapper/309:07:333
2115278991311,1cyclictest0-21swapper/310:26:073
2115278991311,0cyclictest0-21swapper/309:41:073
2115278991311,0cyclictest0-21swapper/307:46:333
2115278991310,1cyclictest0-21swapper/310:40:463
173198130,8rtkit-daemon2253969-21ntpq08:50:201
211527899121,9cyclictest2129429-21chrt07:15:213
211527899120,9cyclictest2233496-21taskset08:35:183
21089342121,6sleep30-21swapper/307:05:113
173198120,4rtkit-daemon647-21lldpd11:11:190
24915632110,2sleep10-21swapper/111:31:171
24153672110,8sleep22415427-21ntpq10:40:212
22248042112,6sleep02226902-21cut08:30:140
173198110,7rtkit-daemon2363112-21ntp_states10:05:210
173198110,7rtkit-daemon2274424-21diskmemload10:25:510
173198110,6rtkit-daemon2443831-21tr11:00:170
173198110,6rtkit-daemon2418629-21irqrtprio10:45:152
173198110,6rtkit-daemon2143626-21cat07:30:001
25081232100,7sleep02508753-21cut11:45:150
21492592101,5sleep02149308-21ntpq07:30:210
21492592101,5sleep02149308-21ntpq07:30:210
21303032100,7sleep12130320-21munin-run07:20:011
173198100,7rtkit-daemon643-21snmpd08:31:561
173198100,5rtkit-daemon453-21wpa_supplicant07:30:211
173198100,5rtkit-daemon453-21wpa_supplicant07:30:201
173198100,5rtkit-daemon2490856-21ntpq11:30:220
173198100,5rtkit-daemon2385574-21ntp_states10:20:220
173198100,5rtkit-daemon2302943-21ntp_states09:25:200
173198100,5rtkit-daemon2263064-21irqstats09:00:161
173198100,5rtkit-daemon2162849-21users07:40:271
173198100,3rtkit-daemon453-21wpa_supplicant09:23:470
2583008291,4sleep02583010-21apt-get12:35:120
2568423290,6sleep02569031-21sed12:25:150
2483274291,5sleep22477894-21/usr/sbin/munin11:25:222
2469443290,6sleep22469445-21ssh11:17:272
2401629290,5sleep02274424-21diskmemload10:32:460
2380111291,5sleep12380146-21apt-get10:20:111
2349005290,6sleep22349007-21ssh09:56:372
2335235291,4sleep22335274-21ssh09:50:112
2312978290,6sleep02313105-21smartctl09:35:150
2108971291,4sleep02109114-21df07:05:130
17319890,5rtkit-daemon451-21systemd-logind08:56:391
17319890,5rtkit-daemon2545615-21cpuspeed_turbos12:10:120
17319890,5rtkit-daemon2503411-21ps11:40:182
17319890,5rtkit-daemon2478085-21/usr/sbin/munin11:25:140
17319890,5rtkit-daemon2274424-21diskmemload11:54:260
17319890,5rtkit-daemon2274424-21diskmemload09:50:540
17319890,4rtkit-daemon643-21snmpd09:19:230
17319890,4rtkit-daemon2539150-21irqstats12:05:160
17319890,4rtkit-daemon2202763-21apt-get08:15:121
17319890,4rtkit-daemon2169979-21apt-get07:50:121
17319890,2rtkit-daemon2431666-21ssh10:52:092
2575578281,4sleep02575734-21df_inode12:30:120
2570237281,5sleep22572281-21kthreadcore12:25:172
2566030280,6sleep12566069-21ssh12:20:221
2559319280,5sleep12559323-21ssh12:16:351
2559319280,5sleep12559323-21ssh12:16:351
2543171280,5sleep22543216-21ntp_states12:05:212
2530509280,5sleep12530640-21smartctl12:00:141
2463112280,5sleep12463139-21fschecks_count11:15:141
2455798280,5sleep12456772-21sed11:10:181
2438159281,5sleep12438206-21sh10:55:231
2432769281,4sleep02432914-21diskstats10:55:140
2422989281,4sleep02423115-21grep10:45:240
2422835280,1sleep10-21swapper/110:45:201
2394272280,6sleep12394274-21ssh10:28:181
2357710280,5sleep12357869-21diskstats10:05:131
2356330280,5sleep12356334-21ssh10:01:051
2342715280,4sleep12342754-21ssh09:55:121
2333439280,5sleep02333690-21grep09:45:250
2326292280,5sleep02274424-21diskmemload09:40:270
2304983280,4sleep22305021-21ssh09:30:122
2261409280,6sleep02261464-21sendmail-msp08:59:590
2241002281,4sleep12241041-21ntpq08:40:211
2213448281,4sleep02214406-21memory08:20:180
2115431281,3sleep20-21swapper/207:10:112
17319880,5rtkit-daemon649-21ntpd11:55:070
17319880,5rtkit-daemon500-21gmain10:16:300
17319880,5rtkit-daemon2499047-21ssh11:36:322
17319880,5rtkit-daemon0-21swapper/110:18:131
17319880,4rtkit-daemon453-21wpa_supplicant12:04:230
17319880,4rtkit-daemon453-21wpa_supplicant11:48:132
17319880,4rtkit-daemon453-21wpa_supplicant10:12:090
17319880,4rtkit-daemon453-21wpa_supplicant07:58:531
17319880,4rtkit-daemon435-21avahi-daemon08:02:071
17319880,4rtkit-daemon2401361-21ssh10:31:471
17319880,4rtkit-daemon2334860-21ssh09:49:422
17319880,4rtkit-daemon2190384-21ps08:05:141
17319880,4rtkit-daemon2119185-21grep07:10:161
17319880,4rtkit-daemon0-21swapper/108:11:381
17319880,1rtkit-daemon0-21swapper/108:37:071
2567219273,2sleep20-21swapper/212:22:562
2552222270,5sleep12274424-21diskmemload12:13:011
2551916270,4sleep22551918-21ssh12:11:542
2544008270,5sleep12544012-21ssh12:06:291
2522846270,4sleep22522885-21ssh11:55:112
2517557271,3sleep12519560-21kthreadcore11:50:181
2491638271,3sleep22491640-21ssh11:31:342
2439921270,4sleep22439925-21ssh11:00:012
2430476270,4sleep02430600-21ntpq10:50:200
2424799270,4sleep12424674-21apt-get10:50:021
2415473270,4sleep02415578-21mailstats10:40:230
2409000271,3sleep12409002-21ssh10:37:231
2408529270,1sleep00-21swapper/010:35:330
2403718271,3sleep22404869-21cut10:35:162
2355602270,4sleep22355656-21ntpq10:00:222
2297489270,3sleep22297521-21awk09:25:112
2295210270,3sleep22295237-21ssh09:20:212
2295150270,4sleep12295208-21ntpq09:20:211
2287661271,3sleep22287711-21ssh09:15:212
2273481270,5sleep02273532-21gcc09:05:210
2228049270,4sleep22228155-21python308:30:212
2176463270,4sleep22176556-21cut07:55:112
2163466270,4sleep00-21swapper/007:45:110
2156589271,4sleep2643-21snmpd07:38:292
2130584271,3sleep02130617-21apt-get07:20:120
2108924271,4sleep2403499-21sshd07:05:062
17319870,4rtkit-daemon649-21ntpd11:15:590
17319870,4rtkit-daemon643-21snmpd12:20:310
17319870,4rtkit-daemon500-21gmain10:02:420
17319870,4rtkit-daemon500-21gmain07:05:021
17319870,4rtkit-daemon435-21avahi-daemon12:38:412
17319870,4rtkit-daemon435-21avahi-daemon12:16:270
17319870,4rtkit-daemon435-21avahi-daemon12:16:260
17319870,4rtkit-daemon435-21avahi-daemon11:23:050
17319870,4rtkit-daemon2121902-21munin-node09:55:060
17319870,4rtkit-daemon2121902-21munin-node08:48:011
17319870,3rtkit-daemon649-21ntpd09:05:341
17319870,3rtkit-daemon643-21snmpd07:21:551
17319870,3rtkit-daemon2115272-21cyclictest11:06:420
17319870,2rtkit-daemon649-21ntpd07:35:261
17319870,2rtkit-daemon1730-21rtkit-daemon08:26:181
17319870,1rtkit-daemon0-21swapper/109:10:491
2582929260,1sleep12582933-21ssh12:35:011
2568117260,3sleep12568168-21cpuspeed_turbos12:25:121
2553038260,3sleep22553073-21apt-get12:15:112
2553038260,3sleep22553073-21apt-get12:15:112
2536725260,1sleep20-21swapper/212:02:132
2521582260,3sleep22521584-21ssh11:51:232
2514794260,1sleep10-21swapper/111:49:041
2505690260,3sleep02505735-21ntpq11:40:230
2476936260,1sleep10-21swapper/111:22:321
2476402260,1sleep20-21swapper/211:20:292
2453818260,4sleep22453822-21ssh11:06:022
2446183260,1sleep10-21swapper/111:00:271
2415579261,3sleep12410004-21/usr/sbin/munin10:40:241
2395030261,2sleep22395065-21apt-get10:30:102
2379796260,1sleep20-21swapper/210:20:002
2371920260,1sleep20-21swapper/210:13:242
2364179260,4sleep22364183-21ssh10:07:302
2341784260,3sleep12341786-21ssh09:52:341
2326981260,1sleep10-21swapper/109:43:041
2310523261,2sleep10-21swapper/109:30:231
2283231260,3sleep12283812-21ssh09:15:161
2280063260,3sleep02280116-21ntpq09:10:210
2260730260,1sleep20-21swapper/208:55:252
2242130261,2sleep20-21swapper/208:45:122
2237037261,2sleep00-21swapper/008:40:170
2229100261,2sleep02229133-21apt-get08:35:120
2214407260,3sleep12214547-21ntpq08:20:191
2189042260,1sleep00-21swapper/008:02:380
2182979260,1sleep20-21swapper/208:00:112
2156989260,3sleep22157022-21apt-get07:40:132
2130069260,1sleep20-21swapper/207:17:012
17319860,3rtkit-daemon649-21ntpd07:45:021
17319860,2rtkit-daemon2281875-21ssh09:14:422
2582063250,3sleep22582067-21ssh12:32:392
2529185250,2sleep12529189-21ssh11:56:581
2500286250,3sleep10-21swapper/111:40:121
2492936250,2sleep02492964-21ssh11:35:140
2484741250,3sleep12484743-21ssh11:28:371
2460801250,2sleep22460847-21ssh11:10:232
2453779250,2sleep10-21swapper/111:05:531
2393927250,3sleep20-21swapper/210:26:592
2371778250,2sleep12371782-21ssh10:12:471
2333868250,1sleep10-21swapper/109:45:581
2326413250,1sleep20-21swapper/209:40:542
2319103250,3sleep22319107-21ssh09:36:322
2313106250,2sleep12313402-21ssh09:35:161
2304092250,3sleep12304096-21ssh09:27:501
2274146251,2sleep20-21swapper/209:06:322
2267677250,3sleep00-21swapper/009:01:410
2254774250,1sleep00-21swapper/008:53:190
2248673250,2sleep20-21swapper/208:50:132
2248352250,1sleep00-21swapper/008:49:220
2241830250,1sleep20-21swapper/208:44:272
2235086250,1sleep20-21swapper/208:36:392
2216684251,2sleep20-21swapper/208:25:162
2210161250,2sleep22211322-21kthreadcore08:20:162
2208873250,3sleep00-21swapper/008:18:440
2205056250,3sleep22207232-21cut08:15:182
2196546250,3sleep22197438-21cut08:10:172
2195486250,1sleep20-21swapper/208:07:102
2194768251,2sleep00-21swapper/008:05:190
2182593250,1sleep00-21swapper/007:58:380
2175834250,1sleep20-21swapper/207:50:392
2165939250,2sleep22168109-21cut07:45:172
2155827250,2sleep00-21swapper/007:35:210
2144221250,3sleep22145207-21cut07:30:152
2144221250,3sleep22145207-21cut07:30:142
2142392251,1sleep00-21swapper/007:25:190
2121420250,1sleep00-21swapper/007:11:170
2446203240,2sleep22446207-21ssh11:00:322
2171329240,2sleep02173153-21grep07:50:170
2137293240,2sleep20-21swapper/207:25:142
2122002240,2sleep00-21swapper/007:15:030
2266155230,1sleep20-21swapper/209:00:192
2221185230,1sleep00-21swapper/008:25:230
2201852230,1sleep00-21swapper/008:10:280
2157169230,1sleep00-21swapper/007:40:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional