You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 02:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8s.osadl.org (updated Sun Sep 06, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
255976321540,3sleep02336920-21diskmemload11:30:250
2181273992825,1cyclictest0-21swapper/312:10:003
2181273992724,1cyclictest0-21swapper/309:15:013
2181273992623,1cyclictest0-21swapper/308:34:593
2181273992522,1cyclictest0-21swapper/309:40:003
2181273992410,1cyclictest0-21swapper/309:55:203
2181273992311,1cyclictest0-21swapper/312:32:503
2181273992310,1cyclictest0-21swapper/307:40:183
2181273992219,1cyclictest0-21swapper/312:30:013
2181273992212,1cyclictest0-21swapper/309:22:113
218127399217,1cyclictest0-21swapper/308:15:243
2181273992118,1cyclictest0-21swapper/308:50:133
2181273992110,1cyclictest0-21swapper/309:25:133
2181273992014,4cyclictest0-21swapper/312:00:193
2181273992011,7cyclictest0-21swapper/310:00:173
218127399199,7cyclictest2437596-21turbostat10:15:003
218127399197,8cyclictest23917502sleep309:45:163
2181273991916,1cyclictest0-21swapper/311:12:173
218127399187,8cyclictest23746732sleep309:32:173
2181273991816,1cyclictest0-21swapper/307:20:003
2181273991815,1cyclictest0-21swapper/308:45:153
2181273991815,1cyclictest0-21swapper/307:50:163
218127399172,12cyclictest0-21swapper/309:15:233
218127399172,11cyclictest2514103-21taskset11:02:443
2181273991714,1cyclictest0-21swapper/310:05:183
2181273991714,1cyclictest0-21swapper/309:10:013
218127399171,11cyclictest2638867-21turbostat12:25:003
218127399171,11cyclictest2561484-21turbostat11:35:003
218127399171,11cyclictest2467039-21taskset10:30:563
218127399171,11cyclictest2266585-21turbostat08:15:003
218127399171,11cyclictest2247699-21taskset08:00:123
26082422161,11sleep00-21swapper/012:05:130
218127399167,6cyclictest25848512sleep311:50:123
218127399167,6cyclictest25848512sleep311:50:113
218127399163,10cyclictest0-21swapper/310:46:303
218127399162,11cyclictest0-21swapper/309:54:313
218127399162,10cyclictest2661365-21taskset12:37:433
218127399162,10cyclictest2599198-21taskset11:57:253
218127399162,10cyclictest2506620-21taskset10:58:363
2181273991613,1cyclictest0-21swapper/311:20:163
2181273991613,1cyclictest0-21swapper/311:05:183
2181273991613,1cyclictest0-21swapper/310:35:183
218127399161,11cyclictest2615950-21taskset12:10:113
218127399161,11cyclictest2576419-21taskset11:43:443
218127399161,11cyclictest2476442-21taskset10:40:033
218127399161,11cyclictest2247066-21taskset07:55:593
218127399161,11cyclictest2196470-21chrt07:20:133
218127399161,10cyclictest2583142-21taskset11:45:573
218127399161,10cyclictest2553738-21taskset11:30:003
24216652151,10sleep22421669-21ssh10:03:482
218127399152,9cyclictest0-21swapper/308:20:383
218127399151,9cyclictest2215579-21chrt07:35:133
2181273991512,1cyclictest0-21swapper/311:35:273
2181273991512,1cyclictest0-21swapper/310:15:173
218127399151,10cyclictest2629769-21taskset12:16:143
218127399151,10cyclictest2530663-21taskset11:15:043
218127399151,10cyclictest2491994-21taskset10:50:013
218127399151,10cyclictest2459213-21taskset10:25:263
218127399151,10cyclictest2451680-21taskset10:20:583
218127399151,10cyclictest2389928-21taskset09:41:313
218127399151,10cyclictest2389928-21taskset09:41:303
218127399151,10cyclictest2318484-21taskset08:55:183
218127399151,10cyclictest2304770-21taskset08:42:193
218127399151,10cyclictest2298320-21taskset08:36:453
218127399151,10cyclictest2298320-21taskset08:36:453
218127399151,10cyclictest2234207-21taskset07:45:283
218127399151,10cyclictest2209170-21taskset07:30:073
218127399151,10cyclictest2202787-21taskset07:25:103
218127399151,10cyclictest2186434-21taskset07:10:193
26469532140,5sleep02646959-21ssh12:30:040
24443772140,7sleep12444383-21ssh10:17:231
218127399141,10cyclictest2324435-21taskset09:00:113
218127399141,10cyclictest2284912-21taskset08:25:223
218127399141,10cyclictest2259925-21chrt08:06:443
23383682130,10sleep02339362-21grep09:10:200
23177492130,6sleep12317817-21cat08:55:011
26004612121,7sleep12600495-21apt-get12:00:111
25978412121,7sleep02597941-21ntp_kernel_err11:55:220
24927402120,2sleep10-21swapper/110:50:151
24524562120,9sleep12452462-21ssh10:23:211
23761562121,4sleep00-21swapper/009:35:150
23393632120,5sleep12341064-21kthreadcore09:10:211
22222252120,2sleep00-21swapper/007:40:150
21751182121,5sleep10-21swapper/107:05:111
26068192114,4sleep0151ktimers/012:01:550
25909412115,3sleep02336920-21diskmemload11:50:570
25909412115,3sleep02336920-21diskmemload11:50:560
24744552110,3sleep02474650-21users10:35:280
24374732110,7sleep02336920-21diskmemload10:14:420
24079282111,7sleep12408921-21cut09:55:181
23994052110,4sleep12399604-21/usr/sbin/munin09:50:151
23837402110,3sleep10-21swapper/109:40:131
23837402110,3sleep10-21swapper/109:40:121
23194502110,8sleep02320670-21cut08:55:190
22412112110,3sleep12240945-21apt-get07:55:041
21881502111,7sleep12189636-21irqstats07:15:031
26537512100,7sleep12653759-21ssh12:33:101
26159032102,4sleep12615940-21apt-get12:10:111
25991162100,3sleep22599122-21ssh11:57:132
25844512100,6sleep02336920-21diskmemload11:49:480
24760532101,5sleep12336920-21diskmemload10:39:461
23041182100,3sleep02304149-21ntpq08:40:230
22352242101,6sleep12235430-21irqcore07:50:161
22220472100,7sleep20-21swapper/207:40:132
2657609294,3sleep12659401-21kthreadcore12:35:211
2645903290,7sleep00-21swapper/012:27:540
2639171291,4sleep22639211-21ssh12:25:122
2638660290,2sleep22638666-21ssh12:24:242
2592182292,1sleep1171rcu_preempt11:54:431
2592182292,1sleep1171rcu_preempt11:54:431
2521551290,6sleep22521557-21ssh11:06:542
2521315290,6sleep12336920-21diskmemload11:06:081
2498736290,6sleep22336920-21diskmemload10:53:022
2490431290,3sleep00-21swapper/010:46:150
2453292290,2sleep22453085-21appstreamcli10:25:022
2406922291,4sleep02406927-21apt-get09:55:120
2404540290,5sleep22404588-21ps09:50:242
2375995290,6sleep22376045-21awk09:35:132
2360716290,6sleep12360897-21gltestperf09:25:131
2360501291,4sleep22360537-21apt-get09:25:102
2265633292,3sleep12265672-21ntpq08:10:211
2201606290,5sleep02201655-21ntpq07:20:220
2196464291,4sleep22196467-21apt-get07:20:132
2638424280,2sleep12638430-21ssh12:23:471
2590174281,4sleep22590214-21ntpq11:50:232
2590174281,4sleep22590214-21ntpq11:50:222
2582231281,4sleep12582331-21ntpq11:45:201
2574699280,4sleep22574745-21ntpq11:40:232
2559391281,4sleep10-21swapper/111:30:231
2552945280,5sleep12552952-21ssh11:27:471
2552193281,4sleep22552199-21ssh11:25:402
2543812280,4sleep02543863-21ntp_states11:20:240
2538147280,5sleep12538239-21latency_hist11:20:001
2529006280,6sleep20-21swapper/211:10:562
2524716281,4sleep12526342-21cut11:10:181
2523881280,5sleep02524715-21kthreadcore11:10:170
2490465280,5sleep12490471-21ssh10:46:201
2484725280,4sleep2431rcuc/210:45:162
2476904280,5sleep02477028-21sed10:40:160
2476542281,4sleep1223-21plymouthd10:40:131
2467168280,4sleep02467174-21ssh10:31:180
2466408280,4sleep12466443-21ntpq10:30:231
2434861281,4sleep12435296-21grep10:10:221
2420582280,5sleep02420588-21ssh10:00:420
2419932280,4sleep12419975-21ntpq10:00:221
2412182280,4sleep22412226-21ntpq09:55:232
2390620280,2sleep20-21swapper/209:43:352
2390620280,2sleep20-21swapper/209:43:342
2358071280,4sleep12358116-21ntpq09:20:241
2354263281,4sleep02355836-21ssh09:20:180
2352182280,5sleep02352188-21ssh09:19:230
2329611281,4sleep12329661-21ntp_states09:00:221
2286067281,3sleep22286100-21apt-get08:30:102
2240038280,1sleep00-21swapper/007:50:230
2239939280,4sleep22239989-21ntpq07:50:212
2195038280,2sleep0171rcu_preempt07:15:220
2662154270,5sleep22662326-21latency_hist12:39:592
2660268271,3sleep02660384-21ls12:35:290
2654362270,5sleep20-21swapper/212:34:552
2615943270,3sleep20-21swapper/212:10:112
2614468270,1sleep10-21swapper/112:06:461
2594102270,4sleep12595617-21cut11:55:191
2577152270,4sleep22577313-21diskstats11:45:132
2575561270,4sleep12575567-21ssh11:41:101
2560778270,1sleep20-21swapper/211:32:582
2545894270,1sleep20-21swapper/211:24:552
2537045270,3sleep02336920-21diskmemload11:16:510
2514134270,3sleep02336920-21diskmemload11:02:510
2514071271,5sleep22514077-21ssh11:02:412
2504941271,3sleep02504984-21ntpq10:55:200
2461556270,5sleep22336920-21diskmemload10:30:162
2459800270,1sleep12459808-21ssh10:27:091
2447080272,2sleep20-21swapper/210:20:172
2405467270,1sleep00-21swapper/009:51:470
2398840270,5sleep00-21swapper/009:49:590
2368299270,3sleep02368301-21apt-get09:30:130
2359146270,2sleep20-21swapper/209:21:572
2350283271,3sleep22350333-21ntpq09:15:222
2337248270,3sleep22337285-21ssh09:10:142
2336024270,4sleep22336065-21ntp_states09:05:242
2320671270,4sleep12322572-21tr08:55:211
2311364270,4sleep22311384-21munin-run08:50:012
2298894270,3sleep12298897-21apt-get08:40:121
2284956270,4sleep00-21swapper/008:25:240
2279701270,4sleep22279858-21diskstats08:25:142
2279188270,2sleep02253551-21kworker/0:1+kacpid08:22:470
2278405271,2sleep20-21swapper/208:20:202
2273275271,2sleep12273277-21apt-get08:20:111
2252865270,3sleep12252905-21ntpq08:00:231
2222425271,3sleep10-21swapper/107:40:171
2207996270,1sleep20-21swapper/207:25:232
2200469270,4sleep12201420-21memory07:20:191
2186688271,3sleep22186730-21ntp_states07:10:232
2182329270,4sleep02183127-21kthreadcore07:10:170
2181132270,2sleep30-21swapper/307:09:543
2631873260,4sleep00-21swapper/012:20:170
2630403260,1sleep10-21swapper/112:18:051
2628837260,3sleep22628887-21ld12:15:222
2627688260,3sleep02628690-21memory12:15:190
2621131261,2sleep02621178-21ntpq12:10:220
2606756260,3sleep22606762-21ssh12:01:452
2569911260,3sleep02570478-21ps11:40:180
2568399260,3sleep22568403-21ssh11:37:472
2548127262,2sleep02549393-21kthreadcore11:25:180
2545176260,4sleep10-21swapper/111:22:541
2531549260,3sleep22532363-21cat11:15:162
2521476260,3sleep02336920-21diskmemload11:06:390
2506340260,3sleep12506346-21ssh10:57:391
2499683261,2sleep22499722-21apt-get10:55:112
2498626261,2sleep02336920-21diskmemload10:52:450
2468816260,2sleep22468822-21ssh10:35:142
2452947260,4sleep00-21swapper/010:24:530
2444789260,3sleep22444622-21kworker/u16:4+rpciod10:18:362
2435300260,3sleep22435392-21ntpq10:10:232
2423611261,2sleep20-21swapper/210:05:172
2422446261,2sleep10-21swapper/110:05:121
2397332260,1sleep20-21swapper/209:45:322
2392883260,3sleep1331rcuc/109:45:191
2383698260,3sleep02383733-21apt-get09:40:120
2383698260,3sleep02383733-21apt-get09:40:110
2383289260,2sleep10-21swapper/109:39:411
2375367260,4sleep10-21swapper/109:34:191
2370297261,3sleep20-21swapper/209:30:192
2360554260,3sleep02360715-21diskstats09:25:120
2346432260,3sleep10-21swapper/109:15:181
2330406260,1sleep00-21swapper/009:03:340
2328577260,3sleep22266520-21kworker/u16:0-kvfree_rcu_reclaim09:00:192
2316942260,3sleep22317064-21python308:50:242
2311828260,3sleep02311952-21gltestperf08:50:150
2305283261,2sleep00-21swapper/008:45:130
2291480260,3sleep02291700-21unixbench_multi08:30:260
2269507261,2sleep10-21swapper/108:15:191
2268261260,3sleep02269506-21cut08:15:180
2260641260,3sleep22260818-21gltestperf08:10:142
2260482260,2sleep00-21swapper/008:10:110
2259332260,4sleep12254055-21/usr/sbin/munin08:05:231
2254710260,4sleep20-21swapper/208:05:162
2253548260,1sleep00-21swapper/008:01:580
2242656260,3sleep22244146-21kthreadcore07:55:172
2233840260,1sleep00-21swapper/007:45:250
2221636260,1sleep10-21swapper/107:38:571
2215578261,2sleep20-21swapper/207:35:132
2215105260,1sleep20-21swapper/207:32:522
2202824260,3sleep00-21swapper/007:25:130
2183131260,3sleep12184906-21kthreadcore07:10:181
2181140260,2sleep00-21swapper/007:10:010
2645985250,3sleep10-21swapper/112:28:071
2614425250,2sleep22614431-21ssh12:06:392
2561728250,3sleep10-21swapper/111:35:051
2476437250,2sleep20-21swapper/210:40:022
2453307250,3sleep00-21swapper/010:25:050
2422413250,2sleep02422445-21apt10:05:100
2336906250,2sleep10-21swapper/109:10:001
2330826250,3sleep0221rcuc/009:05:140
2306898250,2sleep10-21swapper/108:45:181
2299967250,2sleep20-21swapper/208:40:172
2297641250,3sleep22297678-21ntpq08:35:252
2297641250,3sleep22297678-21ntpq08:35:252
2292472250,2sleep10-21swapper/108:35:161
2292472250,2sleep10-21swapper/108:35:161
2272928250,3sleep20-21swapper/208:19:412
2252907250,2sleep22252947-21ntpq08:00:242
2241210250,2sleep00-21swapper/007:55:030
2228418250,2sleep22228443-21awk07:45:122
2221680250,3sleep00-21swapper/007:39:280
2214973250,2sleep02214974-21sshd-session07:31:090
2204111250,3sleep12205144-21kthreadcore07:25:181
2176514250,2sleep20-21swapper/207:05:162
2562168240,2sleep00-21swapper/011:35:160
2509308240,2sleep12336920-21diskmemload11:00:201
2439326240,2sleep00-21swapper/010:15:170
2318019240,1sleep20-21swapper/208:55:142
2292436240,2sleep00-21swapper/008:35:150
2292436240,2sleep00-21swapper/008:35:140
2230558240,2sleep10-21swapper/107:45:191
2209175240,1sleep10-21swapper/107:30:101
2192334240,2sleep20-21swapper/207:15:202
2286053230,1sleep10-21swapper/108:30:021
2279363230,1sleep10-21swapper/108:25:011
2254053230,1sleep00-21swapper/008:05:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional