You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 21:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8s.osadl.org (updated Thu Dec 18, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21006889912831,1278cyclictest23218032sleep309:59:563
21006889912190,1214cyclictest2289485-21sleep09:35:013
210068899209,8cyclictest2412572-21turbostat11:10:003
210068899202,14cyclictest2231723-21turbostat08:50:003
2100688992017,1cyclictest0-21swapper/309:20:003
20944172202,6sleep12094450-21apt-get07:05:101
21805542172,5sleep12180587-21apt-get08:10:121
210068899177,7cyclictest24767172sleep312:00:003
210068899171,12cyclictest2380548-21taskset10:45:123
210068899171,12cyclictest2380548-21taskset10:45:113
2100688991613,1cyclictest0-21swapper/310:58:423
210068899161,11cyclictest2451104-21turbostat11:40:003
210068899155,8cyclictest2257401-21turbostat09:14:553
210068899155,7cyclictest22494722sleep309:00:193
210068899154,8cyclictest2482978-21taskset12:02:443
2100688991513,1cyclictest0-21swapper/309:06:463
2100688991513,0cyclictest0-21swapper/312:28:573
2100688991512,1cyclictest0-21swapper/311:34:173
2100688991512,1cyclictest0-21swapper/310:10:113
2100688991512,1cyclictest0-21swapper/307:29:293
210068899151,11cyclictest2519831-21taskset12:30:163
210068899151,11cyclictest2342851-21taskset10:15:143
210068899151,11cyclictest2314387-21taskset09:50:183
210068899151,11cyclictest2225314-21turbostat08:45:003
210068899151,10cyclictest2413174-21taskset11:10:153
210068899151,10cyclictest2100880-21chrt07:10:083
301798140,9rtkit-daemon2156307-21irqstats07:50:172
210068899144,8cyclictest2451104-21turbostat11:44:563
210068899141,9cyclictest2489885-21chrt12:10:133
2100688991412,1cyclictest0-21swapper/311:48:553
2100688991412,1cyclictest0-21swapper/309:22:263
2100688991412,1cyclictest0-21swapper/308:30:223
2100688991412,1cyclictest0-21swapper/307:38:503
2100688991412,0cyclictest0-21swapper/311:21:003
2100688991412,0cyclictest0-21swapper/308:19:223
2100688991411,1cyclictest0-21swapper/312:35:093
2100688991411,1cyclictest0-21swapper/311:15:163
2100688991411,1cyclictest0-21swapper/309:39:163
210068899141,10cyclictest2508852-21taskset12:25:013
210068899141,10cyclictest2502247-21taskset12:18:023
210068899141,10cyclictest2373736-21chrt10:38:543
210068899141,10cyclictest2154250-21taskset07:45:333
24064532131,4sleep12406486-21apt-get11:05:131
210068899134,6cyclictest2489287-21taskset12:06:093
210068899131,9cyclictest2360092-21taskset10:25:213
210068899131,9cyclictest2354015-21chrt10:22:113
210068899131,9cyclictest2302194-21taskset09:40:283
210068899131,9cyclictest2237772-21taskset08:50:253
210068899131,9cyclictest2183425-21taskset08:10:173
210068899131,9cyclictest2167879-21chrt08:00:123
2100688991312,0cyclictest0-21swapper/311:26:223
2100688991310,1cyclictest0-21swapper/310:50:143
2100688991310,1cyclictest0-21swapper/310:30:163
2100688991310,1cyclictest0-21swapper/309:45:153
2100688991310,1cyclictest0-21swapper/307:43:263
210068899130,10cyclictest2399740-21chrt11:00:023
210068899130,10cyclictest2378815-21chrt10:40:183
210068899130,10cyclictest2334721-21chrt10:07:253
210068899130,10cyclictest2276892-21chrt09:25:023
210068899130,10cyclictest2199599-21chrt08:24:163
210068899130,10cyclictest2180229-21taskset08:09:093
210068899130,10cyclictest2167078-21chrt07:55:353
301798120,6rtkit-daemon2510519-21irqstats12:25:152
210068899121,9cyclictest2464169-21chrt11:50:103
210068899121,9cyclictest2160739-21taskset07:51:313
210068899121,8cyclictest2212705-21chrt08:35:013
210068899121,8cyclictest2109831-21chrt07:15:123
2100688991211,0cyclictest0-21swapper/310:00:313
2100688991210,1cyclictest0-21swapper/307:30:153
210068899120,9cyclictest2244390-21chrt08:57:533
210068899120,9cyclictest2200101-21taskset08:25:173
210068899120,9cyclictest2200101-21taskset08:25:163
210068899120,10cyclictest2115863-21taskset07:20:013
301798110,6rtkit-daemon2432241-21df_inode11:25:142
301798110,5rtkit-daemon2425837-21df_inode11:20:132
301798110,4rtkit-daemon2107182-21munin-node11:57:232
24256522111,2sleep10-21swapper/111:20:121
22473262110,8sleep22249471-21tr09:00:182
301798100,3rtkit-daemon667-21lldpd12:05:122
301798100,3rtkit-daemon492-21gmain09:38:502
25021322101,6sleep0636-21snmpd12:16:360
23043922101,6sleep22306448-21kthreadcore09:45:182
22766492100,7sleep12276833-21sed09:25:021
30179890,5rtkit-daemon448-21wpa_supplicant08:48:192
30179890,5rtkit-daemon448-21wpa_supplicant07:16:542
30179890,5rtkit-daemon3205-21sendmail-mta08:37:282
30179890,5rtkit-daemon2904-21cron11:08:002
30179890,5rtkit-daemon2359956-21memory10:25:202
30179890,4rtkit-daemon667-21lldpd08:15:112
30179890,4rtkit-daemon2373332-21grep10:35:232
30179890,1rtkit-daemon0-21swapper/210:23:082
2522334290,7sleep22522526-21cut12:35:142
2464172291,4sleep12464205-21apt-get11:50:131
2453800294,2sleep12455949-21cut11:40:191
2418166291,4sleep22418291-21python311:10:232
2361650290,7sleep22362214-21irqcore10:30:172
2341585291,4sleep22341620-21apt-get10:15:102
2341027290,6sleep22341028-21sshd10:11:052
2251304290,2sleep02251460-21diskstats09:05:120
2172963291,4sleep22173018-21ntp_states08:00:202
2109446291,4sleep02109468-21apt-get07:15:100
30179880,5rtkit-daemon638-21ntpd07:59:582
30179880,5rtkit-daemon492-21gmain10:41:312
30179880,5rtkit-daemon3205-21sendmail-mta07:12:492
30179880,5rtkit-daemon3205-21sendmail-mta07:09:282
30179880,4rtkit-daemon667-21lldpd09:10:372
30179880,4rtkit-daemon667-21lldpd08:42:422
30179880,4rtkit-daemon636-21snmpd12:24:222
30179880,4rtkit-daemon636-21snmpd11:50:342
30179880,4rtkit-daemon636-21snmpd11:18:092
30179880,4rtkit-daemon636-21snmpd10:52:372
30179880,4rtkit-daemon636-21snmpd09:30:202
30179880,4rtkit-daemon636-21snmpd09:18:492
30179880,4rtkit-daemon636-21snmpd08:55:112
30179880,4rtkit-daemon636-21snmpd08:23:362
30179880,4rtkit-daemon492-21gmain11:35:062
30179880,4rtkit-daemon492-21gmain11:00:032
30179880,4rtkit-daemon448-21wpa_supplicant09:22:012
30179880,4rtkit-daemon441-21rsyslogd09:41:082
30179880,4rtkit-daemon441-21rsyslogd08:51:082
30179880,4rtkit-daemon3200908-21packagekitd10:55:202
30179880,4rtkit-daemon2322914-21irqcore10:00:162
30179880,4rtkit-daemon2251657-21sed09:05:142
30179880,4rtkit-daemon2107182-21munin-node11:48:082
30179880,4rtkit-daemon2107182-21munin-node11:30:562
30179880,4rtkit-daemon2107182-21munin-node09:27:472
30179880,4rtkit-daemon2107182-21munin-node08:32:352
30179880,4rtkit-daemon2107182-21munin-node08:12:242
30179880,4rtkit-daemon2107182-21munin-node08:06:292
30179880,4rtkit-daemon2107182-21munin-node07:35:592
30179880,4rtkit-daemon2107182-21munin-node07:23:522
30179880,3rtkit-daemon2328930-21diskstats10:05:122
30179880,1rtkit-daemon0-21swapper/212:18:052
2523560281,4sleep02525631-21grep12:35:150
2489849281,3sleep22489882-21apt-get12:10:132
2412859280,4sleep12413014-21diskstats11:10:141
2412834281,3sleep02412856-21apt-get11:10:130
2380512281,4sleep244-21ksoftirqd/210:45:112
2380512281,4sleep244-21ksoftirqd/210:45:112
2347583286,1sleep02328525-21kworker/0:3+kacpid10:17:330
2316038282,4sleep22316137-21irqcore09:55:152
2301446281,4sleep02301619-21grep09:40:180
2257643281,3sleep02257676-21apt-get09:10:130
2244554280,6sleep12244771-21latency_hist09:00:011
2238395281,3sleep02238428-21apt-get08:55:120
2237440281,4sleep12237563-21ls08:50:231
2174150281,4sleep12174299-21df_inode08:05:121
2167698281,3sleep12167733-21apt-get08:00:111
2134156280,1sleep20-21swapper/207:30:232
2121481281,4sleep02121666-21users07:20:230
30179870,4rtkit-daemon430-21avahi-daemon12:00:372
30179870,4rtkit-daemon2107182-21munin-node08:27:412
30179870,4rtkit-daemon2107182-21munin-node08:27:402
30179870,4rtkit-daemon2107182-21munin-node07:46:332
30179870,3rtkit-daemon636-21snmpd09:51:592
30179870,3rtkit-daemon636-21snmpd07:42:072
30179870,3rtkit-daemon430-21avahi-daemon12:32:512
2509062271,3sleep12509098-21apt-get12:25:111
2501496270,4sleep12501549-21ntp_states12:15:211
2494733270,4sleep12495026-21sed12:10:211
2479507271,3sleep12481661-21cut12:00:181
2438495270,3sleep02438528-21apt-get11:30:130
2373821271,3sleep02373836-21latency_hist10:40:000
2335177271,2sleep12335210-21apt-get10:10:121
2291467270,5sleep02293408-21kthreadcore09:35:180
2276906270,3sleep02276939-21apt-get09:25:120
2251012270,4sleep02251055-21munin-run09:05:000
2219180270,4sleep12219326-21df08:40:141
2174112270,3sleep02174147-21apt-get08:05:110
2150189271,3sleep02152262-21cut07:45:190
2124266271,3sleep20-21swapper/207:25:182
2115913270,4sleep12116056-21df07:20:121
2094766271,3sleep02094936-21sed07:05:130
30179860,3rtkit-daemon2107182-21munin-node11:40:462
2516522261,3sleep10-21swapper/112:30:151
2495181261,2sleep00-21swapper/012:10:240
2469229261,2sleep00-21swapper/011:50:200
2458221260,3sleep12459057-21sed11:45:161
2437996260,1sleep00-21swapper/011:26:560
2405612260,1sleep10-21swapper/111:00:531
2405596260,1sleep00-21swapper/011:00:400
2387114261,3sleep02387207-21fschecks_time10:50:150
2385837261,2sleep00-21swapper/010:45:210
2385837261,2sleep00-21swapper/010:45:210
2368637262,2sleep1321rcuc/110:35:161
2356926260,4sleep02359051-21cut10:25:180
2354818260,1sleep10-21swapper/110:25:111
2334020260,3sleep12334079-21ntp_states10:05:191
2329179260,3sleep02330010-21irqrtprio10:05:140
2322335260,4sleep1636-21snmpd10:00:041
2296389260,3sleep12296422-21apt-get09:40:111
2219585261,2sleep00-21swapper/008:40:170
2218865260,3sleep02218930-21munin-run08:40:000
2206325260,2sleep02206360-21apt-get08:30:110
2189596261,3sleep12191755-21cut08:15:171
2167080260,3sleep02167082-21sshd07:55:370
2136635260,4sleep02138459-21kthreadcore07:35:180
2134018260,3sleep02134073-21ntp_states07:30:210
2103390260,4sleep02104000-21kthreadcore07:10:130
2094610260,3sleep30-21swapper/307:05:123
2515480250,2sleep00-21swapper/012:30:100
2514941250,3sleep00-21swapper/012:26:230
2507917250,3sleep12507975-21uname12:20:221
2503077251,2sleep00-21swapper/012:20:170
2489249250,1sleep00-21swapper/012:05:380
2483409250,2sleep10-21swapper/112:05:111
2478291251,2sleep00-21swapper/012:00:170
2476492250,1sleep10-21swapper/111:57:071
2452597251,2sleep02453798-21kthreadcore11:40:180
2450972250,2sleep1636-21snmpd11:38:311
2425958250,3sleep00-21swapper/011:20:150
2425098250,1sleep00-21swapper/011:16:310
2411492250,3sleep02411608-21grep11:05:200
2399355250,1sleep00-21swapper/010:58:270
2393048250,1sleep10-21swapper/110:54:531
2386440250,1sleep10-21swapper/110:47:021
2386440250,1sleep10-21swapper/110:47:021
2380211250,1sleep00-21swapper/010:44:260
2375445251,2sleep10-21swapper/110:40:181
2361241250,1sleep00-21swapper/010:30:070
2348048250,2sleep12348081-21apt-get10:20:101
2341199250,1sleep00-21swapper/010:13:160
2328350250,1sleep00-21swapper/010:03:190
2321566250,1sleep00-21swapper/009:56:530
2311726250,2sleep12313874-21tr09:50:171
2310512250,3sleep02311725-21grep09:50:160
2308854250,1sleep00-21swapper/009:48:200
2303358250,2sleep12304389-21kthreadcore09:45:171
2284461251,2sleep00-21swapper/009:30:170
2276509250,1sleep00-21swapper/009:23:120
2265968250,3sleep02268064-21grep09:15:180
2244870250,2sleep10-21swapper/109:00:131
2232146250,2sleep02232261-21perl08:50:140
2230895250,3sleep02231013-21smartctl08:45:210
2207419251,2sleep10-21swapper/108:30:161
2199916250,2sleep12199949-21apt-get08:25:161
2199916250,2sleep12199949-21apt-get08:25:151
2199511250,2sleep02199512-21sshd08:23:100
2193948251,2sleep10-21swapper/108:20:141
2188389251,2sleep00-21swapper/008:15:160
2173694250,1sleep00-21swapper/008:02:540
2147919251,1sleep10-21swapper/107:45:001
2144033250,2sleep02146168-21kthreadcore07:40:190
2138462250,3sleep10-21swapper/107:35:191
2134572250,1sleep10-21swapper/107:30:381
2128302250,1sleep00-21swapper/007:28:090
2123271250,3sleep12124265-21grep07:25:181
2458008240,2sleep0221rcuc/011:45:160
2446387240,2sleep02447947-21kthreadcore11:35:170
2439948240,2sleep10-21swapper/111:30:191
2395494240,2sleep10-21swapper/110:55:161
2290168240,2sleep10-21swapper/109:35:151
2285698240,2sleep10-21swapper/109:30:181
2278363240,2sleep12280064-21ps09:25:171
2263522240,3sleep10-21swapper/109:11:261
2257080240,3sleep10-21swapper/109:06:111
2218768240,3sleep10-21swapper/108:38:451
2204566240,2sleep02205145-21strings08:25:220
2204566240,2sleep02205145-21strings08:25:220
2161448240,2sleep12161508-21fschecks_count07:55:141
2154853240,1sleep00-21swapper/007:50:120
2115311240,3sleep10-21swapper/107:16:191
2106354240,2sleep12106632-21unixbench_singl07:10:191
2527920230,1sleep10-21swapper/112:37:421
2470663230,1sleep00-21swapper/011:55:140
2432055230,1sleep10-21swapper/111:25:131
2419439230,1sleep10-21swapper/111:15:161
2361448230,1sleep10-21swapper/110:30:161
2353130230,1sleep02353265-21cut10:20:170
2347071230,1sleep10-21swapper/110:15:221
2315844230,1sleep10-21swapper/109:55:141
2264253230,1sleep10-21swapper/109:15:151
2225547230,1sleep10-21swapper/108:45:061
2180839230,1sleep00-21swapper/008:10:150
2156306230,1sleep10-21swapper/107:50:181
2148635230,1sleep10-21swapper/107:45:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional