You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 19:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sat Nov 29, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2091105992926,1cyclictest0-21swapper/308:20:013
209110599281,22cyclictest2111938-21turbostat07:25:003
2091105992421,1cyclictest0-21swapper/308:30:013
2091105992118,1cyclictest0-21swapper/311:20:003
2091105992111,7cyclictest2425351-21sleep11:04:593
2091105992017,1cyclictest0-21swapper/309:50:003
2091105992017,1cyclictest0-21swapper/309:25:003
2091105992017,1cyclictest0-21swapper/309:05:013
2091105992017,1cyclictest0-21swapper/308:20:163
209110599201,14cyclictest2513919-21chrt12:00:143
209110599201,14cyclictest2401238-21turbostat10:50:003
2091105991916,1cyclictest0-21swapper/312:40:013
2091105991916,1cyclictest0-21swapper/310:05:013
209110599191,14cyclictest2377689-21taskset10:35:153
209110599191,13cyclictest2290211-21taskset09:40:123
2091105991816,0cyclictest0-21swapper/308:45:243
2091105991815,1cyclictest0-21swapper/311:35:353
2091105991815,1cyclictest0-21swapper/310:10:003
2091105991815,1cyclictest0-21swapper/309:25:163
2091105991815,1cyclictest0-21swapper/309:15:013
2091105991815,1cyclictest0-21swapper/307:40:003
209110599181,13cyclictest2406665-21taskset10:50:203
209110599181,13cyclictest2161763-21chrt08:05:153
2091105991715,1cyclictest0-21swapper/311:20:173
2091105991715,1cyclictest0-21swapper/307:10:133
2091105991714,1cyclictest0-21swapper/310:10:233
2091105991714,1cyclictest0-21swapper/309:54:193
2091105991714,1cyclictest0-21swapper/309:15:203
2091105991714,1cyclictest0-21swapper/307:40:183
209110599171,13cyclictest2352556-21taskset10:17:583
209110599171,12cyclictest2543155-21taskset12:15:253
209110599171,12cyclictest2433534-21taskset11:10:043
209110599171,12cyclictest2229265-21chrt08:55:593
209110599171,12cyclictest2154897-21taskset07:55:243
209110599171,12cyclictest2118419-21taskset07:30:123
209110599171,12cyclictest2118419-21taskset07:30:113
209110599170,12cyclictest2369545-21taskset10:30:023
209110599166,7cyclictest25055782sleep311:54:583
2091105991613,1cyclictest0-21swapper/312:05:193
2091105991613,1cyclictest0-21swapper/311:44:043
2091105991613,1cyclictest0-21swapper/311:25:163
2091105991613,1cyclictest0-21swapper/310:30:163
2091105991613,1cyclictest0-21swapper/309:55:153
209110599161,12cyclictest2567836-21taskset12:31:193
209110599161,12cyclictest2210639-21taskset08:42:333
209110599161,12cyclictest2198190-21chrt08:31:313
209110599161,12cyclictest2173776-21turbostat08:15:003
209110599161,12cyclictest2161113-21taskset08:00:293
209110599161,12cyclictest2112166-21taskset07:25:033
209110599161,11cyclictest2490025-21taskset11:45:153
209110599161,11cyclictest2241975-21sleep09:10:003
209110599161,11cyclictest2204311-21taskset08:35:393
209110599160,12cyclictest2223121-21chrt08:54:563
209110599160,12cyclictest2149093-21taskset07:54:563
25765572150,8sleep12576563-21ssh12:38:081
25510382150,12sleep02551146-21sendmail_mailtr12:20:230
24813622151,11sleep02481425-21sendmail-msp11:40:010
2091105991512,1cyclictest0-21swapper/312:25:263
2091105991512,1cyclictest0-21swapper/310:40:173
209110599151,11cyclictest2545736-21taskset12:20:013
209110599151,11cyclictest2432421-21taskset11:08:043
209110599151,11cyclictest2282191-21taskset09:35:103
209110599151,11cyclictest2282191-21taskset09:35:103
209110599151,11cyclictest2276959-21taskset09:30:173
209110599151,11cyclictest2137027-21taskset07:45:063
209110599151,11cyclictest2100876-21taskset07:15:173
209110599150,12cyclictest2470948-21taskset11:30:213
209110599150,11cyclictest2409381-21chrt10:55:053
147598150,2rtkit-daemon0-21swapper/012:17:060
23936202141,10sleep12393587-21/usr/sbin/munin10:45:141
209110599141,11cyclictest2536312-21taskset12:12:243
209110599141,11cyclictest2512852-21taskset11:58:253
209110599141,11cyclictest2360393-21taskset10:22:313
147598140,9rtkit-daemon2241952-21diskmemload11:30:200
25454582131,9sleep12545529-21/usr/sbin/munin12:20:001
24278622132,8sleep12429879-21kthreadcore11:05:181
25443272120,2sleep20-21swapper/212:17:222
25221752120,8sleep12522724-21/usr/sbin/munin12:05:191
147598120,8rtkit-daemon2353369-21ssh10:19:541
147598120,5rtkit-daemon720-21snmpd08:21:470
147598120,4rtkit-daemon295-21systemd-journal08:42:430
147598120,2rtkit-daemon2168057-21diskstats08:10:160
147598120,1rtkit-daemon0-21swapper/011:53:590
25604942110,8sleep22560501-21sh12:27:552
24401092110,8sleep22440111-21ssh11:12:182
23918112110,8sleep02391819-21ssh10:41:380
22184122110,8sleep22219572-21kthreadcore08:50:192
22172452111,3sleep12217278-21apt-get08:50:141
21493582111,7sleep22149391-21apt-get07:55:132
147598110,7rtkit-daemon214-21plymouthd09:55:200
147598110,6rtkit-daemon2198757-21sshd08:35:130
25610382100,4sleep12536586-21kworker/u16:3+xprtiod12:29:101
25190872100,7sleep02519213-21ssh12:00:240
24952002100,7sleep02495330-21python311:45:260
24490132100,1sleep00-21swapper/011:19:280
24014852100,7sleep12401493-21ssh10:50:031
23833742100,7sleep12383380-21ssh10:35:371
23450182100,7sleep12345026-21ssh10:13:531
21850812100,7sleep12185222-21sed08:20:191
21360482100,7sleep02136157-21find07:40:230
21048312101,6sleep12105092-21unixbench_singl07:15:251
209110599108,1cyclictest0-21swapper/307:10:003
147598100,6rtkit-daemon2305816-21latency_hist09:50:000
147598100,6rtkit-daemon1540-21sendmail-mta10:57:580
147598100,6rtkit-daemon1540-21sendmail-mta10:47:530
147598100,6rtkit-daemon1540-21sendmail-mta07:47:490
147598100,5rtkit-daemon2537229-21ssh12:14:280
147598100,2rtkit-daemon2569270-21ssh12:34:422
147598100,2rtkit-daemon214-21plymouthd10:15:322
147598100,2rtkit-daemon214-21plymouthd08:47:590
2546214290,6sleep22546990-21irqrtprio12:20:172
2521880291,5sleep22521942-21sort12:05:152
2520906290,2sleep12520914-21ssh12:03:331
2512464290,6sleep12512472-21ssh11:57:291
2498286290,6sleep22498846-21ps11:50:162
2448913291,6sleep22448921-21ssh11:19:062
2329373291,2sleep22329381-21ssh10:04:242
2311871290,1sleep20-21swapper/209:50:462
2304582290,7sleep12304586-21ssh09:47:161
2135879290,6sleep22135935-21ntp_states07:40:212
2085091290,3sleep00-21swapper/007:05:140
14759890,6rtkit-daemon2105530-21http07:20:051
14759890,5rtkit-daemon22110-21packagekitd11:22:120
14759890,5rtkit-daemon2204553-21kworker/u16:3+rpciod09:27:000
14759890,5rtkit-daemon2143206-21apt-get07:50:130
14759890,5rtkit-daemon1540-21sendmail-mta11:01:232
14759890,5rtkit-daemon1540-21sendmail-mta08:02:380
14759890,4rtkit-daemon2505967-21apt-get11:55:140
14759890,4rtkit-daemon2282096-21sed09:35:000
14759890,4rtkit-daemon2282096-21sed09:35:000
14759890,2rtkit-daemon214-21plymouthd08:54:050
14759890,1rtkit-daemon0-21swapper/211:09:032
2556922280,5sleep02558734-21latency12:25:200
2513877281,4sleep20-21swapper/212:00:142
2503901280,1sleep10-21swapper/111:51:071
2473391281,4sleep12473444-21ssh11:35:001
2465479281,1sleep20-21swapper/211:30:002
2417731281,3sleep10-21swapper/111:00:141
2416815280,6sleep12241952-21diskmemload10:59:251
2385624281,4sleep22385785-21diskstats10:40:152
2377315281,4sleep12377414-21cat10:35:011
2330429281,4sleep02331316-21ps10:05:190
2320373281,4sleep22320381-21ssh09:57:022
2288655280,1sleep10-21swapper/109:37:111
2288655280,1sleep10-21swapper/109:37:101
2282252280,6sleep22282386-21cpuspeed_turbos09:35:152
2282252280,6sleep22282386-21cpuspeed_turbos09:35:142
2194965280,6sleep12197052-21cut08:30:181
2144065280,5sleep12145181-21cut07:50:181
2118372280,1sleep10-21swapper/107:30:021
2118372280,1sleep10-21swapper/107:30:021
2114520280,5sleep22116605-21kthreadcore07:25:192
2086423280,4sleep12088216-21grep07:05:191
14759880,4rtkit-daemon720-21snmpd07:25:231
14759880,4rtkit-daemon491-21gdbus08:20:010
14759880,4rtkit-daemon476-21wpa_supplicant08:57:400
14759880,4rtkit-daemon295-21systemd-journal09:13:190
14759880,4rtkit-daemon2452900-21kthreadcore11:20:192
14759880,4rtkit-daemon2382589-21load10:35:200
14759880,4rtkit-daemon2361784-21apt-get10:25:140
14759880,4rtkit-daemon2258520-21/usr/sbin/munin09:20:150
14759880,4rtkit-daemon214-21plymouthd10:21:080
14759880,4rtkit-daemon214-21plymouthd09:05:160
14759880,4rtkit-daemon2097367-21munin-node08:26:390
14759880,4rtkit-daemon1-21systemd08:30:150
14759880,1rtkit-daemon0-21swapper/210:13:142
14759880,1rtkit-daemon0-21swapper/012:30:100
14759880,1rtkit-daemon0-21swapper/012:07:160
14759880,1rtkit-daemon0-21swapper/011:41:540
14759880,1rtkit-daemon0-21swapper/010:52:150
14759880,1rtkit-daemon0-21swapper/009:33:500
14759880,1rtkit-daemon0-21swapper/008:07:000
14759880,1rtkit-daemon0-21swapper/007:37:040
2536160271,4sleep22536167-21ssh12:12:002
2495331270,5sleep10-21swapper/111:45:271
2481431270,1sleep10-21swapper/111:40:011
2433544270,5sleep02433552-21ssh11:10:070
2386098271,4sleep10-21swapper/110:40:181
2377651270,3sleep22377684-21apt-get10:35:152
2323853271,3sleep10-21swapper/110:00:181
2321946273,2sleep02241952-21diskmemload10:00:050
2313554270,4sleep12313562-21ssh09:54:451
2266073272,3sleep12266112-21apt-get09:25:121
2256796270,1sleep10-21swapper/109:17:421
2248984270,2sleep2214-21plymouthd09:12:582
2223842271,3sleep22223965-21hddtemp_smartct08:55:152
2216690270,1sleep20-21swapper/208:46:092
2130593271,3sleep12130615-21munin-run07:40:001
2124577271,3sleep22124610-21apt-get07:35:162
2104715270,4sleep02104830-21sort07:15:230
2099521271,3sleep22099553-21apt-get07:15:142
14759870,4rtkit-daemon2335998-21ssh10:06:201
14759870,3rtkit-daemon730-21ntpd10:20:061
14759870,3rtkit-daemon730-21ntpd09:16:550
14759870,3rtkit-daemon720-21snmpd09:40:290
14759870,3rtkit-daemon2241952-21diskmemload11:00:100
14759870,3rtkit-daemon214-21plymouthd09:50:420
14759870,3rtkit-daemon214-21plymouthd09:02:120
14759870,3rtkit-daemon214-21plymouthd07:58:170
14759870,3rtkit-daemon214-21plymouthd07:10:201
14759870,3rtkit-daemon2097367-21munin-node12:36:362
14759870,3rtkit-daemon1-21systemd10:30:170
14759870,2rtkit-daemon214-21plymouthd11:25:580
2563015261,3sleep10-21swapper/112:30:181
2552291260,4sleep10-21swapper/112:22:171
2536187260,1sleep10-21swapper/112:12:031
2490004261,2sleep20-21swapper/211:45:152
2487779260,1sleep20-21swapper/211:40:382
2481215260,3sleep12481223-21ssh11:39:411
2474221260,3sleep22475162-21cut11:35:172
2466180261,2sleep20-21swapper/211:30:172
2440927260,1sleep10-21swapper/111:14:131
2431626260,1sleep00-21swapper/011:06:050
2409380260,4sleep22222979-21kworker/u16:0+xprtiod10:55:052
2408295260,4sleep20-21swapper/210:53:012
2398763260,3sleep22398866-21mailstats10:45:242
2369346260,3sleep22369544-21date10:30:022
2362667260,3sleep12363710-21cut10:25:201
2352176260,1sleep00-21swapper/010:17:050
2343669260,1sleep00-21swapper/010:10:350
2329879260,1sleep20-21swapper/210:05:082
2314235260,4sleep12314369-21hddtemp_smartct09:55:171
2305148260,1sleep20-21swapper/209:48:332
2296455260,4sleep12296463-21ssh09:41:481
2290169261,2sleep20-21swapper/209:40:122
2267066261,3sleep20-21swapper/209:25:162
2265572260,1sleep10-21swapper/109:24:391
2258100260,3sleep22258137-21apt-get09:20:122
2256630260,1sleep20-21swapper/209:17:152
2248234260,1sleep10-21swapper/109:11:131
2236229260,1sleep20-21swapper/209:05:172
2235736260,1sleep20-21swapper/209:04:262
2210606260,4sleep20-21swapper/208:42:092
2198915261,3sleep22198720-21/usr/sbin/munin08:35:152
2192127260,1sleep10-21swapper/108:27:291
2186707261,2sleep20-21swapper/208:25:172
2179640260,1sleep20-21swapper/208:16:372
2174208260,1sleep10-21swapper/108:15:151
2155860261,2sleep2421rcuc/208:00:172
2155011260,1sleep10-21swapper/107:56:481
2148868260,1sleep20-21swapper/207:52:032
2142839260,1sleep20-21swapper/207:49:032
2142697260,1sleep10-21swapper/107:47:141
2136732260,1sleep10-21swapper/107:44:291
2124272260,1sleep00-21swapper/007:34:300
2124272260,1sleep00-21swapper/007:34:300
2106327260,3sleep22106448-21cut07:20:172
2096915260,1sleep20-21swapper/207:11:242
2096382260,3sleep02096507-21python307:10:220
14759860,3rtkit-daemon720-21snmpd11:15:121
2576114250,3sleep00-21swapper/012:37:100
2506256250,3sleep22506675-21cut11:55:182
2457339250,3sleep10-21swapper/111:24:351
2370710250,3sleep22371799-21kthreadcore10:30:172
2361041251,2sleep20-21swapper/210:24:042
2280638250,3sleep10-21swapper/109:32:411
2279634251,2sleep20-21swapper/209:30:252
2237366250,2sleep10-21swapper/109:05:201
2235781250,2sleep12235824-21/usr/sbin/munin09:05:001
2223686250,2sleep10-21swapper/108:55:141
2173526250,3sleep10-21swapper/108:11:581
2167861250,2sleep20-21swapper/208:10:152
2155526250,3sleep10-21swapper/108:00:041
2118746251,2sleep20-21swapper/207:30:162
2118746251,2sleep20-21swapper/207:30:152
2111672250,1sleep00-21swapper/007:21:520
2463670240,2sleep12463678-21ssh11:25:461
2211401240,2sleep10-21swapper/108:45:161
2204918240,3sleep10-21swapper/108:40:081
2200254240,2sleep10-21swapper/108:35:181
2192782240,3sleep20-21swapper/208:30:142
2181059240,2sleep22182049-21kthreadcore08:20:162
2167320240,2sleep1214-21plymouthd08:06:221
2161725240,1sleep20-21swapper/208:05:152
2117962240,3sleep00-21swapper/007:27:530
2090191240,1sleep20-21swapper/207:05:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional