You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 04:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Fri Dec 05, 2025 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20744422910,1sleep00-21swapper/021:40:150
1875927992522,1cyclictest0-21swapper/321:00:213
1875927992421,1cyclictest0-21swapper/321:30:003
1875927992219,1cyclictest0-21swapper/320:25:133
1875927992219,1cyclictest0-21swapper/320:00:013
1875927992219,1cyclictest0-21swapper/300:08:263
1875927992218,1cyclictest0-21swapper/320:35:013
1875927992118,1cyclictest0-21swapper/320:40:003
1875927992118,1cyclictest0-21swapper/300:00:003
1875927992117,1cyclictest60950irq/168-eno2:tx-322:20:003
187592799203,13cyclictest2251351-21turbostat23:30:003
187592799203,13cyclictest2251351-21turbostat23:30:003
1875927992017,1cyclictest0-21swapper/323:15:223
1875927992017,1cyclictest0-21swapper/322:45:163
1875927992017,1cyclictest0-21swapper/319:45:183
1875927991917,1cyclictest0-21swapper/319:15:013
1875927991916,1cyclictest0-21swapper/322:37:233
187592799191,14cyclictest2210978-21turbostat23:05:013
187592799191,13cyclictest1897247-21chrt19:25:013
1875927991815,1cyclictest0-21swapper/321:57:233
1875927991815,1cyclictest0-21swapper/319:15:003
187592799181,14cyclictest2217722-21taskset23:06:583
187592799181,13cyclictest2332545-21turbostat00:20:003
187592799181,13cyclictest2138466-21taskset22:20:013
187592799181,13cyclictest2080440-21taskset21:42:463
187592799181,12cyclictest2340995-21taskset00:25:023
1875927991714,1cyclictest0-21swapper/322:55:253
1875927991714,1cyclictest0-21swapper/322:05:193
1875927991714,1cyclictest0-21swapper/321:35:153
1875927991714,1cyclictest0-21swapper/321:10:003
1875927991714,1cyclictest0-21swapper/320:45:013
1875927991714,1cyclictest0-21swapper/319:20:213
1875927991714,1cyclictest0-21swapper/300:20:173
187592799171,12cyclictest2316916-21chrt00:10:143
187592799171,12cyclictest2306797-21taskset00:01:203
187592799171,12cyclictest2289761-21taskset23:50:233
187592799171,12cyclictest2267796-21taskset23:40:143
187592799171,12cyclictest2091843-21taskset21:50:163
187592799171,12cyclictest2006936-21taskset20:50:213
187592799170,9cyclictest1915835-21taskset19:39:573
23083992161,11sleep12308442-21sh00:05:001
21575012161,8sleep12159565-21grep22:30:231
21315672166,7sleep12132683-21cut22:15:161
187592799166,7cyclictest23550452sleep300:30:433
1875927991613,1cyclictest0-21swapper/320:20:183
1875927991612,1cyclictest0-21swapper/321:21:283
187592799161,12cyclictest2282928-21chrt23:47:503
187592799161,12cyclictest2257383-21taskset23:30:283
187592799161,12cyclictest2225768-21chrt23:11:553
187592799161,12cyclictest2191873-21taskset22:50:203
187592799161,12cyclictest2127995-21chrt22:10:403
187592799161,12cyclictest2063451-21chrt21:30:403
187592799161,12cyclictest2029325-21chrt21:10:083
187592799161,12cyclictest2016361-21taskset20:58:383
187592799161,12cyclictest1963601-21taskset20:15:183
187592799161,12cyclictest1959376-21taskset20:11:053
187592799160,13cyclictest2266676-21chrt23:38:163
187592799160,13cyclictest2043419-21chrt21:17:393
187592799160,13cyclictest2043419-21chrt21:17:383
187592799160,12cyclictest2154646-21taskset22:30:073
187592799160,12cyclictest2089446-21taskset21:49:563
187592799160,12cyclictest1947150-21taskset20:04:563
187592799157,6cyclictest23571412sleep300:35:053
187592799151,11cyclictest2241522-21taskset23:20:573
187592799151,11cyclictest2111866-21taskset22:00:383
187592799151,11cyclictest2003627-21chrt20:46:003
187592799151,11cyclictest1908987-21taskset19:30:223
187592799150,12cyclictest2176854-21taskset22:40:453
187592799150,12cyclictest1953270-21taskset20:08:053
187592799150,12cyclictest1917519-21taskset19:40:163
22113022141,10sleep12211311-21ssh23:05:131
187592799141,10cyclictest2146513-21taskset22:25:063
187592799141,10cyclictest1934250-21taskset19:50:263
21776572139,1sleep10-21swapper/122:42:421
20630532130,9sleep12063302-21grep21:30:311
147598130,8rtkit-daemon2090004-21ssh21:50:131
20439222120,9sleep12043886-21/usr/sbin/munin21:20:131
19664882121,1sleep00-21swapper/020:20:130
147598120,8rtkit-daemon2140783-21kthreadcore22:20:190
147598120,7rtkit-daemon1540-21sendmail-mta00:21:320
23488462110,8sleep02348854-21ssh00:30:000
22763462110,8sleep12276545-21hddtemp_smartct23:45:161
22363702110,8sleep22237225-21grep23:20:172
22022702111,7sleep22202276-21ssh22:58:332
21532082111,8sleep12153216-21ssh22:27:221
20344182110,8sleep12029347-21/usr/sbin/munin21:10:191
19335722110,8sleep01933722-21ntp_kernel_pll_19:50:210
19224232111,3sleep01922575-21df_inode19:45:150
147598110,7rtkit-daemon2331070-21ssh00:16:370
147598110,7rtkit-daemon2124795-21kthreadcore22:10:200
147598110,7rtkit-daemon1540-21sendmail-mta00:09:082
147598110,5rtkit-daemon214-21plymouthd20:25:271
147598110,4rtkit-daemon720-21snmpd00:13:110
23412072101,6sleep12127589-21kworker/u16:3+rpciod00:25:161
22495642106,2sleep2431ktimers/223:25:552
22495642106,2sleep2431ktimers/223:25:542
22253802101,6sleep12225386-21ssh23:10:581
21551262102,5sleep22155388-21irqcore22:30:202
21134352100,7sleep12113439-21ssh22:04:211
20355442100,7sleep22035550-21ssh21:11:252
19885472100,7sleep01990335-21cat20:35:200
18748542100,1sleep01874918-21/usr/sbin/munin19:05:200
147598100,6rtkit-daemon2116975-21grep22:05:190
147598100,6rtkit-daemon1540-21sendmail-mta20:52:381
147598100,5rtkit-daemon456-21avahi-daemon20:59:151
147598100,5rtkit-daemon214-21plymouthd21:56:192
147598100,5rtkit-daemon1965841-21users20:15:251
147598100,5rtkit-daemon1903334-21unin-run19:30:000
147598100,3rtkit-daemon720-21snmpd22:55:501
147598100,3rtkit-daemon2029027-21diskmemload21:36:251
147598100,2rtkit-daemon214-21plymouthd00:30:050
2316775290,6sleep22316912-21cpuspeed_turbos00:10:142
2177534290,1sleep20-21swapper/222:42:272
2130343292,4sleep22130452-21grep22:15:122
2017712290,6sleep22018728-21kthreadcore21:00:222
2010463291,4sleep22010496-21apt-get20:55:142
1947601290,6sleep11947674-21fschecks_time20:05:151
1916117292,4sleep21916150-21apt-get19:40:122
1892414291,4sleep21893660-21grep19:20:162
14759890,6rtkit-daemon720-21snmpd23:47:070
14759890,6rtkit-daemon720-21snmpd20:20:341
14759890,5rtkit-daemon456-21avahi-daemon19:40:551
14759890,5rtkit-daemon2017145-21hddtemp_smartct21:00:201
14759890,4rtkit-daemon2057265-21latency_hist21:30:001
14759890,4rtkit-daemon1913628-21kthreadcore19:35:181
14759890,4rtkit-daemon1887010-21cut19:15:170
14759890,3rtkit-daemon720-21snmpd20:37:331
14759890,1rtkit-daemon0-21swapper/119:33:541
14759890,1rtkit-daemon0-21swapper/023:42:540
2338758281,5sleep22029027-21diskmemload00:20:442
2260699280,6sleep02261174-21kthreadcore23:35:180
2212987280,5sleep02214884-21kthreadcore23:05:210
2204449280,6sleep22205294-21cut23:00:172
2201317281,4sleep02201325-21ssh22:56:270
2168240281,4sleep20-21swapper/222:35:242
2129834282,3sleep20-21swapper/222:15:002
2119487281,4sleep12119747-21sed22:05:261
2071432280,1sleep00-21swapper/021:35:280
2056904280,6sleep22056912-21ssh21:29:162
2037404281,4sleep22037441-21apt-get21:15:142
2037404281,4sleep22037441-21apt-get21:15:132
2012808284,2sleep0151ktimers/020:55:210
1980485280,5sleep11982257-21cut20:30:241
1952160280,5sleep21952448-21/usr/sbin/munin20:05:202
1946881280,1sleep00-21swapper/020:01:310
1940810280,1sleep20-21swapper/219:59:152
1929498281,3sleep10-21swapper/119:50:171
1898780280,1sleep20-21swapper/219:25:182
1884881283,2sleep21885544-21irqrtprio19:15:152
1876508280,6sleep01877329-21irqrtprio19:10:160
1875750280,2sleep30-21swapper/319:09:553
14759880,4rtkit-daemon476-21wpa_supplicant00:00:382
14759880,4rtkit-daemon2362515-21ntp_states00:35:250
14759880,4rtkit-daemon2265490-21ssh23:35:292
14759880,4rtkit-daemon214-21plymouthd23:25:241
14759880,4rtkit-daemon214-21plymouthd23:25:231
14759880,4rtkit-daemon2042695-21ssh21:15:231
14759880,4rtkit-daemon2042695-21ssh21:15:231
14759880,4rtkit-daemon1882294-21munin-node22:15:160
14759880,4rtkit-daemon0-21swapper/120:47:111
14759880,3rtkit-daemon2257747-21ssh23:31:131
14759880,3rtkit-daemon214-21plymouthd23:20:240
14759880,2rtkit-daemon214-21plymouthd23:15:210
14759880,1rtkit-daemon0-21swapper/123:51:171
14759880,1rtkit-daemon0-21swapper/123:22:551
14759880,1rtkit-daemon0-21swapper/023:03:450
2276134271,3sleep22276173-21apt-get23:45:132
2253099270,4sleep22254865-21grep23:30:202
2249047271,4sleep02249266-21unixbench-2d23:25:240
2249047271,4sleep02249266-21unixbench-2d23:25:240
2220231271,3sleep02221068-21cut23:10:210
2211312271,3sleep22211349-21apt-get23:05:142
2178927271,3sleep22178935-21ssh22:45:062
2171939270,4sleep02172948-21tr22:40:190
2170207270,1sleep00-21swapper/022:39:070
2123186271,3sleep12124035-21ssh22:10:191
2121433271,4sleep22121441-21ssh22:09:072
2104934270,1sleep10-21swapper/121:58:241
2103333271,3sleep02103513-21ls21:55:270
2088686270,5sleep02088690-21sh21:48:090
2024891272,3sleep02026041-21kthreadcore21:05:210
1991665271,3sleep11991698-21apt-get20:40:141
1978711270,1sleep20-21swapper/220:28:452
1972819271,3sleep01972974-21diskstats20:25:140
1960189270,3sleep21959709-21apt-get20:15:022
1953715270,5sleep01953866-21df20:10:160
1903739271,3sleep21903939-21hddtemp_smartct19:30:142
14759870,4rtkit-daemon720-21snmpd22:03:430
14759870,4rtkit-daemon515-21gmain21:40:241
14759870,4rtkit-daemon515-21gmain20:01:241
14759870,3rtkit-daemon730-21ntpd22:00:102
14759870,3rtkit-daemon2187123-21apt-get22:50:132
14759870,3rtkit-daemon1882294-21munin-node21:46:401
14759870,3rtkit-daemon1882294-21munin-node20:11:101
14759870,3rtkit-daemon1882294-21munin-node19:45:501
14759870,3rtkit-daemon1540-21sendmail-mta23:56:571
14759870,3rtkit-daemon1-21systemd21:53:232
14759870,3rtkit-daemon1-21systemd19:55:291
14759870,3rtkit-daemon1-21systemd19:31:270
14759870,3rtkit-daemon1-21systemd19:22:360
14759870,1rtkit-daemon0-21swapper/121:05:171
2364488260,1sleep10-21swapper/100:38:551
2363382260,1sleep20-21swapper/200:36:242
2356047260,4sleep22217501-21kworker/u16:0+rpciod00:32:582
2323632260,3sleep12323640-21ssh00:13:021
2307728260,1sleep00-21swapper/000:03:270
2299515260,1sleep20-21swapper/223:58:282
2298705260,1sleep00-21swapper/023:56:350
2291680260,1sleep20-21swapper/223:54:272
2274236260,1sleep10-21swapper/123:42:001
2272975261,3sleep22273058-21ntp_states23:40:222
2258141260,1sleep00-21swapper/023:32:130
2233907260,1sleep20-21swapper/223:17:002
2225261260,1sleep20-21swapper/223:10:432
2192910260,1sleep00-21swapper/022:50:370
2178979260,3sleep12179019-21/usr/sbin/munin22:45:131
2154800260,3sleep02154917-21/usr/sbin/munin22:30:170
2153430260,1sleep00-21swapper/022:27:570
2093806261,3sleep02094840-21memory21:50:180
2081750260,1sleep20-21swapper/221:45:122
2072372260,1sleep20-21swapper/221:37:412
2064882260,3sleep02064890-21ssh21:33:590
2063471260,1sleep20-21swapper/221:30:442
2056082260,4sleep02056090-21ssh21:27:260
2043346260,1sleep00-21swapper/021:16:440
2043346260,1sleep00-21swapper/021:16:440
2023030260,3sleep22023047-21apt-get21:05:162
2022574260,1sleep00-21swapper/021:02:450
2009954260,1sleep00-21swapper/020:51:510
1984788260,1sleep2214-21plymouthd20:31:062
1979110261,2sleep01979231-21cpuspeed_turbos20:30:190
1928128260,1sleep20-21swapper/219:46:572
1896681260,1sleep10-21swapper/119:20:551
1882994261,3sleep11884273-21munin-node19:15:031
14759860,3rtkit-daemon214-21plymouthd22:52:421
2348855250,3sleep10-21swapper/100:30:011
2342188250,2sleep20-21swapper/200:25:222
2334322251,2sleep10-21swapper/100:20:191
2331111251,2sleep20-21swapper/200:16:442
2325938251,2sleep10-21swapper/100:15:191
2315482250,3sleep00-21swapper/000:07:520
2308680250,2sleep10-21swapper/100:05:131
2261788250,3sleep12263748-21kthreadcore23:35:191
2234291252,1sleep10-21swapper/123:17:561
2203686250,3sleep1214-21plymouthd23:00:161
2186471250,3sleep02186478-21sh22:49:250
2168810250,1sleep10-21swapper/122:35:551
2147451251,2sleep20-21swapper/222:25:182
2145719250,3sleep20-21swapper/222:23:502
2138972251,2sleep12139444-21irqcore22:20:171
2079079250,3sleep22079194-21find21:40:222
2049548251,2sleep20-21swapper/221:20:422
2043885250,2sleep00-21swapper/021:20:120
2034776251,2sleep00-21swapper/021:10:220
2005599250,3sleep22006935-21grep20:50:212
2003709250,1sleep20-21swapper/220:47:042
1999336250,3sleep02000779-21cat20:45:190
1993064250,3sleep21994444-21cut20:40:192
1991138250,1sleep20-21swapper/220:36:502
1972399250,3sleep2214-21plymouthd20:24:092
1960600251,2sleep01960898-21sed20:15:160
1948813251,2sleep00-21swapper/020:05:180
1947101250,1sleep20-21swapper/220:04:202
1921986250,1sleep00-21swapper/019:43:140
1915145250,2sleep20-21swapper/219:35:242
1910836251,2sleep00-21swapper/019:35:170
1902957250,1sleep10-21swapper/119:25:451
1882027250,1sleep10-21swapper/119:14:021
1878500250,3sleep21880577-21cut19:10:182
1875478250,2sleep21875479-21sshd19:06:252
1871684250,2sleep10-21swapper/119:05:161
2285416240,1sleep00-21swapper/023:50:160
1997346241,1sleep014-21ksoftirqd/020:40:490
1935073240,2sleep0214-21plymouthd19:55:160
1930434240,2sleep20-21swapper/219:50:182
1953981230,1sleep20-21swapper/220:10:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional