You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 19:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Wed Nov 19, 2025 12:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1886703992623,1cyclictest0-21swapper/312:15:003
1886703992420,1cyclictest0-21swapper/311:35:013
147598220,2rtkit-daemon0-21swapper/209:17:442
1886703992118,1cyclictest0-21swapper/312:40:003
1886703992118,1cyclictest0-21swapper/310:55:183
1886703992118,1cyclictest0-21swapper/310:05:223
1886703992118,1cyclictest0-21swapper/307:50:013
188670399211,5cyclictest2120858-21sleep10:00:003
1886703992017,1cyclictest0-21swapper/309:35:193
1886703992017,1cyclictest0-21swapper/309:20:173
188670399201,14cyclictest1933048-21sleep07:45:013
188670399193,12cyclictest1907839-21turbostat07:25:013
1886703991916,1cyclictest0-21swapper/310:25:213
188670399191,14cyclictest2302500-21taskset11:50:213
188670399191,13cyclictest1901584-21turbostat07:20:003
188670399191,13cyclictest1886781-21taskset07:10:003
1886703991816,1cyclictest0-21swapper/311:40:003
1886703991816,1cyclictest0-21swapper/308:00:013
1886703991815,1cyclictest0-21swapper/311:15:173
1886703991815,1cyclictest0-21swapper/310:20:003
1886703991815,1cyclictest0-21swapper/310:10:163
188670399181,13cyclictest1977344-21sleep08:20:003
188670399181,12cyclictest2194171-21taskset10:45:133
23662112170,1sleep22368224-21kthreadcore12:30:212
188670399177,7cyclictest2298772-21chrt11:50:003
188670399177,7cyclictest20671252sleep309:25:183
1886703991714,1cyclictest0-21swapper/311:55:173
1886703991714,1cyclictest0-21swapper/311:10:253
1886703991714,1cyclictest0-21swapper/309:50:193
1886703991714,1cyclictest0-21swapper/308:50:243
188670399171,13cyclictest2177506-21chrt10:34:343
188670399171,12cyclictest2347427-21sleep12:20:013
188670399171,12cyclictest2323010-21turbostat12:05:003
188670399171,12cyclictest2264643-21taskset11:25:433
188670399171,12cyclictest2103219-21chrt09:46:253
188670399171,12cyclictest2007939-21taskset08:40:263
188670399171,12cyclictest1989834-21taskset08:29:563
1886703991614,1cyclictest0-21swapper/311:40:233
1886703991613,1cyclictest0-21swapper/312:30:183
1886703991613,1cyclictest0-21swapper/312:20:163
1886703991613,1cyclictest0-21swapper/311:00:193
1886703991613,1cyclictest0-21swapper/309:30:193
1886703991613,1cyclictest0-21swapper/309:01:483
1886703991613,1cyclictest0-21swapper/309:01:473
188670399161,13cyclictest1892070-21taskset07:10:213
188670399161,12cyclictest2362448-21chrt12:27:163
188670399161,12cyclictest2202165-21chrt10:50:053
188670399161,12cyclictest2178034-21taskset10:35:153
188670399161,12cyclictest2127037-21taskset10:00:373
188670399161,12cyclictest2095699-21chrt09:42:413
188670399161,12cyclictest2027444-21taskset08:59:363
188670399161,12cyclictest2014631-21chrt08:46:183
188670399161,12cyclictest2001891-21taskset08:35:243
188670399161,12cyclictest1912924-21taskset07:25:193
188670399160,13cyclictest2329254-21taskset12:05:563
188670399160,13cyclictest1982760-21chrt08:20:213
188670399160,12cyclictest1920575-21taskset07:35:013
21239382150,2sleep10-21swapper/110:00:191
1886703991512,1cyclictest0-21swapper/311:20:243
1886703991512,1cyclictest0-21swapper/311:05:263
1886703991512,1cyclictest0-21swapper/310:40:173
188670399151,11cyclictest2159431-21taskset10:20:353
188670399151,11cyclictest2048637-21taskset09:15:083
188670399151,11cyclictest2034249-21taskset09:05:063
188670399151,11cyclictest1995836-21taskset08:31:523
188670399151,11cyclictest1952970-21chrt08:00:173
188670399151,11cyclictest1939556-21taskset07:50:083
188670399151,11cyclictest1914525-21taskset07:30:173
188670399150,12cyclictest2040551-21taskset09:10:113
188670399150,12cyclictest1970997-21chrt08:14:003
20076862141,10sleep02007800-21awk08:40:240
188670399141,11cyclictest1964483-21taskset08:05:473
23005912130,10sleep22302498-21cut11:50:202
20942122131,9sleep22088913-21/usr/sbin/munin09:40:252
21850052121,8sleep22185011-21ssh10:38:242
21057192120,1sleep22106651-21kthreadcore09:50:192
20647782120,1sleep12040282-21diskmemload09:25:121
20500962120,9sleep02051319-21grep09:15:170
19321892120,9sleep21932311-21grep07:40:222
147598120,8rtkit-daemon2193033-21ssh10:43:120
147598120,8rtkit-daemon2047100-21ssh09:12:062
23207162110,1sleep02320964-21users12:00:250
22732042110,8sleep22273212-21ssh11:32:062
22484082110,8sleep02248416-21ssh11:15:410
22243962110,8sleep02224404-21ssh11:01:100
21871332110,8sleep12188261-21cut10:40:191
21794582111,8sleep10-21swapper/110:35:221
20985012110,2sleep12100278-21kthreadcore09:45:211
20866302110,8sleep02086638-21ssh09:35:300
147598110,7rtkit-daemon2095251-21ssh09:41:430
147598110,7rtkit-daemon1540-21sendmail-mta09:28:140
147598110,5rtkit-daemon214-21plymouthd07:17:012
147598110,3rtkit-daemon2176450-21ssh10:32:060
23390922100,3sleep22339104-21apt-get12:15:022
22259672100,8sleep22225975-21ssh11:04:492
21780392101,5sleep02178073-21apt-get10:35:160
21766882100,7sleep22176694-21ssh10:32:462
21619162101,4sleep12161949-21apt-get10:25:161
20581892100,7sleep12059970-21kthreadcore09:20:201
147598100,6rtkit-daemon295-21systemd-journal09:54:420
147598100,6rtkit-daemon2290250-21kworker/u16:1+nfsiod12:29:172
147598100,4rtkit-daemon214-21plymouthd10:12:090
147598100,3rtkit-daemon2232844-21ssh11:06:551
147598100,3rtkit-daemon214-21plymouthd09:58:340
2333791290,6sleep12335814-21grep12:10:191
2207530290,6sleep02207651-21mailstats10:50:240
2194136291,4sleep22194168-21apt-get10:45:132
2008914291,4sleep02008947-21apt-get08:45:130
1903242290,6sleep21905004-21kthreadcore07:20:192
1880608290,4sleep10-21swapper/107:05:141
14759890,6rtkit-daemon515-21gmain07:45:212
14759890,5rtkit-daemon214-21plymouthd11:40:252
14759890,4rtkit-daemon44-21ksoftirqd/212:01:342
14759890,2rtkit-daemon214-21plymouthd08:07:282
14759890,1rtkit-daemon0-21swapper/211:47:492
14759890,1rtkit-daemon0-21swapper/010:27:410
2371508281,4sleep12371516-21ssh12:34:361
2354076280,1sleep2171rcu_preempt12:21:382
2291046281,3sleep12291083-21apt-get11:45:151
2260093280,5sleep02261189-21kthreadcore11:25:180
2250587281,4sleep22250620-21apt-get11:20:152
2226437281,3sleep22226473-21apt-get11:05:162
2224153284,2sleep12224158-21sh11:00:391
2210334281,4sleep22210448-21cpuspeed_turbos10:55:142
2160494280,6sleep12160495-21sh10:23:071
2129709280,5sleep22130225-21irqcore10:05:172
2118333280,6sleep12118380-21ntpq09:55:231
2078195280,2sleep02078379-21sed09:30:250
2074176280,5sleep22075303-21kthreadcore09:30:192
2071044281,4sleep22071052-21ssh09:26:452
2040579281,3sleep12040603-21apt-get09:10:141
2005061280,1sleep20-21swapper/208:40:222
1972776285,1sleep10-21swapper/108:15:191
1908083280,4sleep01908116-21apt-get07:25:140
14759880,5rtkit-daemon2244000-21kthreadcore11:15:192
14759880,4rtkit-daemon2209301-21ssh10:53:292
14759880,4rtkit-daemon2153721-21df_inode10:20:140
14759880,4rtkit-daemon214-21plymouthd10:45:470
14759880,4rtkit-daemon214-21plymouthd08:25:372
14759880,4rtkit-daemon1893078-21munin-node07:52:002
14759880,4rtkit-daemon1-21systemd08:02:072
14759880,4rtkit-daemon1-21systemd07:30:202
14759880,4rtkit-daemon1-21systemd07:25:032
14759880,3rtkit-daemon214-21plymouthd09:45:220
14759880,2rtkit-daemon22110-21packagekitd07:57:132
14759880,2rtkit-daemon214-21plymouthd07:11:362
14759880,1rtkit-daemon0-21swapper/212:12:352
14759880,1rtkit-daemon0-21swapper/208:51:282
14759880,1rtkit-daemon0-21swapper/208:21:082
14759880,1rtkit-daemon0-21swapper/111:31:141
2346999270,4sleep02347007-21ssh12:19:030
2329429270,1sleep10-21swapper/112:06:191
2313125270,5sleep12313133-21ssh11:55:531
2305894270,5sleep00-21swapper/011:52:550
2299694270,5sleep12300590-21kthreadcore11:50:191
2274829271,3sleep10-21swapper/111:35:131
2258089270,4sleep12258097-21ssh11:24:231
2241628270,1sleep00-21swapper/011:13:440
2240589270,1sleep20-21swapper/211:11:182
2201340270,1sleep10-21swapper/110:48:441
2153728271,3sleep22153905-21gltestperf10:20:152
2150598270,4sleep02150675-21ntp_states10:15:210
2145484270,4sleep12145640-21df_inode10:15:141
2137341271,3sleep22137419-21grep10:10:132
2137297271,3sleep12137336-21apt-get10:10:121
2136873270,1sleep10-21swapper/110:09:491
2122604270,4sleep02123937-21tr10:00:180
2056755270,2sleep02056788-21apt-get09:20:150
1995049270,1sleep10-21swapper/108:30:231
1989732270,2sleep1214-21plymouthd08:28:381
1971833270,1sleep00-21swapper/008:15:180
1964559270,2sleep1214-21plymouthd08:06:471
1957668270,4sleep01957725-21open_inodes08:00:240
1954503270,4sleep11956523-21grep08:00:201
1920271270,2sleep1214-21plymouthd07:34:161
1901363271,4sleep1720-21snmpd07:17:301
1892912271,3sleep11893022-21munin-setwarn07:15:011
1880644272,2sleep21880733-21cpuspeed_turbos07:05:152
14759870,4rtkit-daemon729-21lldpd07:36:032
14759870,4rtkit-daemon214-21plymouthd12:36:562
14759870,4rtkit-daemon2031031-21kthreadcore09:00:222
14759870,4rtkit-daemon2031031-21kthreadcore09:00:222
14759870,4rtkit-daemon1893078-21munin-node10:06:420
14759870,3rtkit-daemon730-21ntpd12:07:562
14759870,3rtkit-daemon730-21ntpd09:22:012
14759870,3rtkit-daemon515-21gmain09:05:492
14759870,3rtkit-daemon2266037-21ssh11:29:041
14759870,3rtkit-daemon2234453-21ssh11:10:051
14759870,3rtkit-daemon214-21plymouthd08:55:502
14759870,3rtkit-daemon214-21plymouthd08:38:042
14759870,3rtkit-daemon1893078-21munin-node08:31:352
14759870,3rtkit-daemon1-21systemd12:39:060
14759870,3rtkit-daemon1-21systemd11:55:342
14759870,3rtkit-daemon1-21systemd11:39:592
14759870,3rtkit-daemon1-21systemd08:48:192
14759870,3rtkit-daemon1-21systemd08:15:552
14759870,3rtkit-daemon1-21systemd08:14:442
2374017261,2sleep10-21swapper/112:35:191
2363435260,1sleep00-21swapper/012:29:290
2363132260,1sleep10-21swapper/112:28:501
2353313260,1sleep00-21swapper/012:20:290
2349019260,4sleep12350013-21cut12:20:221
2347188260,1sleep10-21swapper/112:19:291
2321309260,1sleep10-21swapper/112:01:131
2313871260,1sleep00-21swapper/011:57:360
2296369260,2sleep00-21swapper/011:45:260
2284345260,3sleep12285953-21cut11:40:171
2282914260,2sleep02282950-21apt-get11:40:120
2279843260,4sleep02280033-21grep11:35:200
2253394261,2sleep00-21swapper/011:20:210
2246219260,3sleep12247599-21memory11:15:211
2210716261,2sleep12211284-21ps10:55:171
2193785260,1sleep20-21swapper/210:44:522
2177323260,1sleep10-21swapper/110:34:131
2167111260,4sleep20-21swapper/210:25:252
2152433260,4sleep22152441-21ssh10:18:202
2097246261,3sleep22097448-21grep09:45:172
2095495260,1sleep10-21swapper/109:42:161
2087558260,1sleep10-21swapper/109:37:421
2072519260,1sleep10-21swapper/109:30:021
2054917260,1sleep10-21swapper/109:16:341
2046545260,1sleep00-21swapper/009:10:490
2033873260,1sleep00-21swapper/009:03:280
2033873260,1sleep00-21swapper/009:03:270
2021907260,3sleep02022583-21sed08:55:190
2016576260,4sleep02018229-21grep08:50:170
2014613260,1sleep10-21swapper/108:46:051
2008618260,1sleep10-21swapper/108:44:341
1997744261,2sleep00-21swapper/008:35:180
1989679260,1sleep00-21swapper/008:27:570
1970707260,1sleep00-21swapper/008:10:260
1952013260,1sleep10-21swapper/107:59:531
1951721260,1sleep00-21swapper/007:56:080
1945253260,4sleep10-21swapper/107:51:351
1939043260,1sleep00-21swapper/007:46:380
1931983261,3sleep01932120-21/usr/sbin/munin07:40:200
1926656260,1sleep10-21swapper/107:39:021
1926387260,1sleep00-21swapper/007:36:520
1913988260,1sleep10-21swapper/107:29:041
1907689260,1sleep00-21swapper/007:23:210
1901840261,2sleep10-21swapper/107:20:131
1892858260,1sleep00-21swapper/007:14:190
2370311250,3sleep00-21swapper/012:31:510
2337125250,3sleep00-21swapper/012:10:310
2324687250,2sleep00-21swapper/012:05:180
2273936250,3sleep00-21swapper/011:33:430
2233801250,3sleep00-21swapper/011:09:140
2216114250,3sleep00-21swapper/010:55:320
2127222250,3sleep2214-21plymouthd10:01:002
2115367251,2sleep20-21swapper/209:55:202
2028029250,2sleep12028051-21apt-get09:00:161
2028029250,2sleep12028051-21apt-get09:00:151
2002370250,2sleep10-21swapper/108:40:001
1993837250,3sleep01995048-21memory08:30:220
1983334250,1sleep10-21swapper/108:21:371
1959759250,2sleep00-21swapper/008:05:160
1927042250,3sleep10-21swapper/107:40:131
1914323250,2sleep00-21swapper/007:30:140
1901241250,1sleep00-21swapper/007:15:560
14759850,2rtkit-daemon2258674-21ssh11:25:122
2208682240,2sleep12208684-21ssh10:52:051
2111126240,2sleep12070986-21kworker/u16:2+rpciod09:51:091
2088338240,2sleep20-21swapper/209:39:282
2040199240,3sleep00-21swapper/009:09:040
2034652240,2sleep12034855-21cut09:05:161
2022584241,1sleep10-21swapper/108:55:201
1981276240,2sleep01982564-21memory08:20:200
1970763240,2sleep1720-21snmpd08:11:031
1938981240,2sleep10-21swapper/107:45:511
1880811240,1sleep00-21swapper/007:05:180
2015363230,1sleep10-21swapper/108:50:151
1939747230,1sleep00-21swapper/007:50:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional