You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 17:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Mon Nov 24, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
255408721240,2sleep1171rcu_preempt12:20:141
2097683993121,7cyclictest2521506-21sleep12:00:003
2097683992219,1cyclictest0-21swapper/309:55:013
209768399211,17cyclictest2265213-21sleep09:20:003
209768399209,7cyclictest23857112sleep310:35:133
2097683992017,1cyclictest0-21swapper/310:00:213
209768399201,14cyclictest2425899-21chrt11:00:013
209768399192,13cyclictest2433982-21taskset11:05:143
2097683991916,1cyclictest0-21swapper/311:50:163
2097683991916,1cyclictest0-21swapper/309:10:173
2097683991916,1cyclictest0-21swapper/309:00:003
209768399191,13cyclictest2199642-21taskset08:30:013
209768399188,7cyclictest25351152sleep312:05:223
209768399183,11cyclictest2118320-21turbostat07:25:013
2097683991815,1cyclictest0-21swapper/312:10:203
2097683991815,1cyclictest0-21swapper/312:00:143
2097683991815,1cyclictest0-21swapper/310:11:443
2097683991815,1cyclictest0-21swapper/308:40:003
2097683991814,1cyclictest0-21swapper/308:10:003
209768399181,14cyclictest2384190-21taskset10:32:113
209768399181,13cyclictest2489592-21turbostat11:40:003
209768399181,13cyclictest2423153-21taskset10:55:203
209768399181,13cyclictest2321759-21taskset09:55:133
209768399181,13cyclictest2136930-21turbostat07:40:013
209768399180,13cyclictest2150071-21taskset07:50:013
2097683991714,1cyclictest0-21swapper/309:25:013
2097683991714,1cyclictest0-21swapper/308:25:163
209768399171,13cyclictest2505321-21chrt11:49:223
209768399171,13cyclictest2471870-21chrt11:26:023
209768399171,13cyclictest2398906-21taskset10:40:213
209768399171,13cyclictest2289537-21chrt09:35:133
209768399171,13cyclictest2103581-21chrt07:12:063
209768399171,12cyclictest2561807-21chrt12:25:053
209768399171,12cyclictest2489960-21taskset11:40:113
209768399171,12cyclictest2377377-21taskset10:29:553
209768399171,12cyclictest2217614-21chrt08:40:553
209768399170,13cyclictest2289356-21chrt09:35:013
209768399166,7cyclictest23035122sleep309:41:153
2097683991614,1cyclictest0-21swapper/309:05:213
2097683991614,1cyclictest0-21swapper/309:05:013
2097683991613,1cyclictest0-21swapper/311:15:163
2097683991613,1cyclictest0-21swapper/310:15:143
2097683991613,1cyclictest0-21swapper/307:50:013
2097683991612,2cyclictest2187041-21turbostat08:20:003
209768399161,13cyclictest2276907-21chrt09:25:193
209768399161,12cyclictest2583958-21taskset12:36:233
209768399161,12cyclictest2576125-21taskset12:31:423
209768399161,12cyclictest2559804-21chrt12:20:563
209768399161,12cyclictest2551973-21taskset12:16:233
209768399161,12cyclictest2480081-21chrt11:31:313
209768399161,12cyclictest2465340-21taskset11:24:293
209768399161,12cyclictest2441883-21chrt11:10:033
209768399161,12cyclictest2441883-21chrt11:10:033
209768399161,12cyclictest2415730-21chrt10:50:313
209768399161,12cyclictest2402172-21taskset10:45:143
209768399161,12cyclictest2344332-21taskset10:07:393
209768399161,12cyclictest2311161-21taskset09:45:273
209768399161,12cyclictest2230161-21chrt08:52:533
209768399161,12cyclictest2193070-21chrt08:23:113
209768399161,12cyclictest2174856-21taskset08:10:053
209768399161,12cyclictest2161910-21taskset07:56:023
209768399161,12cyclictest2130381-21taskset07:31:463
209768399161,12cyclictest2124130-21taskset07:25:253
209768399161,12cyclictest2111826-21chrt07:16:473
209768399161,11cyclictest2224146-21turbostat08:50:003
209768399160,12cyclictest2361874-21taskset10:20:133
147598160,5rtkit-daemon2337353-21ssh10:04:570
23211162151,11sleep22321125-21cron09:55:012
209768399151,11cyclictest2168276-21taskset08:03:083
209768399150,12cyclictest2143127-21chrt07:41:443
147598140,9rtkit-daemon2171789-21cut08:05:191
25832122131,9sleep02583358-21/usr/sbin/munin12:35:250
24713772130,6sleep12471620-21unixbench_singl11:25:241
23915002131,10sleep22391508-21ssh10:35:322
23530462130,1sleep12353053-21sh10:14:191
22735002131,9sleep22273660-21/usr/sbin/munin09:25:152
22658672130,4sleep02266431-21irqrtprio09:20:160
20973382130,2sleep30-21swapper/307:07:233
147598130,3rtkit-daemon2517282-21cut11:55:192
25792562110,8sleep22581065-21cut12:35:192
25291742110,8sleep12529180-21ssh12:04:161
24641012110,8sleep12464109-21ssh11:21:361
23620052111,7sleep02362340-21irqcore10:20:140
22737852111,7sleep02274092-21cut09:25:170
21482582110,1sleep00-21swapper/007:45:180
147598110,7rtkit-daemon456-21avahi-daemon10:44:100
147598110,7rtkit-daemon2489366-21ssh11:39:272
147598110,7rtkit-daemon1540-21sendmail-mta09:51:191
147598110,7rtkit-daemon1540-21sendmail-mta09:16:341
147598110,6rtkit-daemon720-21snmpd11:11:591
147598110,6rtkit-daemon720-21snmpd11:11:591
24741362100,1sleep20-21swapper/211:30:132
24733752100,5sleep22473379-21ssh11:29:302
24699152100,3sleep02470931-21memory11:25:190
24484072100,2sleep00-21swapper/011:12:210
24484072100,2sleep00-21swapper/011:12:210
24006552100,7sleep22400663-21ssh10:43:142
23058012100,7sleep12306264-21sed09:45:181
22952822100,7sleep22295290-21ssh09:35:412
22951692100,7sleep02295177-21ssh09:35:270
21748992100,7sleep12174976-21expr08:10:121
147598100,6rtkit-daemon2441507-21ssh11:09:451
147598100,5rtkit-daemon2487319-21python311:35:250
147598100,4rtkit-daemon2553121-21ssh12:19:030
147598100,4rtkit-daemon2528377-21ssh12:02:190
147598100,3rtkit-daemon729-21lldpd12:27:210
147598100,2rtkit-daemon214-21plymouthd12:22:590
147598100,1rtkit-daemon0-21swapper/012:33:260
2577866291,4sleep12577903-21apt-get12:35:141
2571203290,6sleep12572702-21kthreadcore12:30:171
2515002290,6sleep12516152-21kthreadcore11:55:181
2479116290,6sleep12479205-21sh11:30:211
2393306290,7sleep12393312-21ssh10:39:481
2361678291,4sleep12361701-21apt-get10:20:121
2281525291,5sleep22281591-21grep09:30:122
2271691291,5sleep12271699-21ssh09:21:371
2263630290,3sleep22263638-21ssh09:16:212
2125627290,6sleep22126661-21kthreadcore07:30:182
14759890,4rtkit-daemon730-21ntpd11:31:030
14759890,4rtkit-daemon2543007-21ssh12:10:220
14759890,4rtkit-daemon214-21plymouthd11:15:252
14759890,3rtkit-daemon1540-21sendmail-mta07:31:141
14759890,2rtkit-daemon2384523-21ssh10:32:542
14759890,2rtkit-daemon0-21swapper/012:05:290
2497496280,6sleep02497504-21ssh11:44:430
2490280281,4sleep2214-21plymouthd11:40:162
2454209283,3sleep12454906-21missed_timers11:15:191
2425985281,4sleep22426019-21apt-get11:00:132
2383866281,4sleep1720-21snmpd10:31:221
2369702281,3sleep02369740-21apt-get10:25:120
2336998281,4sleep22337004-21ssh10:04:062
2319244280,5sleep0214-21plymouthd09:50:300
2281481281,4sleep12281524-21ssh09:30:111
2230961280,5sleep02231853-21irqrtprio08:55:150
2198067281,4sleep22198432-21grep08:25:202
2195963280,5sleep12198066-21kthreadcore08:25:191
2187287281,3sleep12187320-21apt-get08:20:141
2156333281,4sleep12156479-21df07:55:131
2156297280,4sleep02156330-21apt-get07:55:120
2137769281,4sleep20-21swapper/207:40:162
2107930280,5sleep12109945-21kthreadcore07:15:181
14759880,4rtkit-daemon729-21lldpd07:09:161
14759880,4rtkit-daemon515-21gmain08:55:121
14759880,4rtkit-daemon2545029-21ssh12:13:552
14759880,4rtkit-daemon2351777-21sshd10:11:220
14759880,4rtkit-daemon2255991-21ssh09:12:561
14759880,4rtkit-daemon22110-21packagekitd07:20:121
14759880,4rtkit-daemon2145061-21grep07:45:161
14759880,4rtkit-daemon214-21plymouthd10:30:330
14759880,4rtkit-daemon214-21plymouthd09:56:321
14759880,4rtkit-daemon214-21plymouthd09:01:001
14759880,4rtkit-daemon214-21plymouthd08:40:441
14759880,4rtkit-daemon2103982-21munin-node11:21:450
14759880,4rtkit-daemon2103982-21munin-node09:41:360
14759880,4rtkit-daemon2103982-21munin-node08:36:441
14759880,4rtkit-daemon2103982-21munin-node07:28:381
14759880,4rtkit-daemon1-21systemd07:41:041
14759880,4rtkit-daemon1-21systemd07:35:161
14759880,4rtkit-daemon1-21systemd07:11:131
14759880,3rtkit-daemon730-21ntpd10:58:110
14759880,3rtkit-daemon2434378-21irqcore11:05:170
14759880,3rtkit-daemon2408012-21ssh10:46:050
14759880,3rtkit-daemon2281689-21diskstats09:30:130
14759880,1rtkit-daemon0-21swapper/107:50:281
2575095270,1sleep20-21swapper/212:30:222
2417956270,4sleep2214-21plymouthd10:55:122
2416808270,1sleep20-21swapper/210:52:592
2402386270,1sleep10-21swapper/110:45:171
2363286270,4sleep22365214-21ssh10:20:172
2361357270,4sleep12361617-21sed10:20:001
2352365270,4sleep22352373-21ssh10:12:442
2264018270,1sleep00-21swapper/009:17:190
2238133270,4sleep02239434-21kthreadcore09:00:160
2179793270,1sleep00-21swapper/008:10:190
2093286270,4sleep22095259-21kthreadcore07:05:172
14759870,4rtkit-daemon1-21systemd10:51:410
14759870,4rtkit-daemon1-21systemd08:15:181
14759870,3rtkit-daemon730-21ntpd11:59:360
14759870,3rtkit-daemon730-21ntpd11:01:420
14759870,3rtkit-daemon730-21ntpd09:45:090
14759870,3rtkit-daemon295-21systemd-journal11:51:122
14759870,3rtkit-daemon2162527-21apt-get08:00:121
14759870,3rtkit-daemon214-21plymouthd11:50:012
14759870,3rtkit-daemon214-21plymouthd08:30:521
14759870,3rtkit-daemon2103982-21munin-node10:06:290
14759870,3rtkit-daemon1540-21sendmail-mta10:15:230
14759870,3rtkit-daemon1540-21sendmail-mta08:51:131
14759870,3rtkit-daemon1-21systemd09:05:341
14759870,1rtkit-daemon0-21swapper/212:15:102
2567758261,3sleep12527980-21kworker/u16:0+nfsiod12:25:561
2561845260,3sleep22561882-21apt-get12:25:132
2558922261,2sleep20-21swapper/212:20:202
2553199260,3sleep12553208-21ssh12:19:151
2544891260,1sleep10-21swapper/112:13:291
2536265262,2sleep22527980-21kworker/u16:0+rpciod12:07:052
2529842261,2sleep10-21swapper/112:05:121
2529529261,2sleep20-21swapper/212:05:012
2512564260,1sleep00-21swapper/011:52:490
2506321260,1sleep10-21swapper/111:50:171
2503572260,1sleep00-21swapper/011:45:270
2503182261,3sleep10-21swapper/111:45:241
2457462260,1sleep00-21swapper/011:19:420
2433941261,2sleep20-21swapper/211:05:142
2426317261,3sleep12426502-21irqcore11:00:161
2416450260,1sleep10-21swapper/110:52:141
2407930260,1sleep20-21swapper/210:45:542
2391972260,1sleep00-21swapper/010:36:380
2372321261,2sleep20-21swapper/210:25:182
2344484260,1sleep20-21swapper/210:07:592
2343616260,1sleep10-21swapper/110:05:541
2328283260,3sleep22328291-21ssh09:57:212
2328172260,1sleep00-21swapper/009:57:070
2271985260,1sleep20-21swapper/209:22:222
2255956260,1sleep20-21swapper/209:12:532
2248609260,1sleep00-21swapper/009:06:010
2244837261,3sleep22246858-21kthreadcore09:05:192
2236428260,1sleep20-21swapper/208:58:382
2224064260,1sleep20-21swapper/208:49:202
2223784260,1sleep00-21swapper/008:45:420
2217708260,1sleep00-21swapper/008:42:080
2217638260,1sleep20-21swapper/208:41:152
2205882260,1sleep20-21swapper/208:35:142
2200282260,3sleep22201197-21cut08:30:172
2198550260,1sleep00-21swapper/008:25:220
2193099260,1sleep00-21swapper/008:23:340
2181372261,2sleep00-21swapper/008:15:160
2181091260,3sleep22181247-21diskstats08:15:132
2180643260,1sleep20-21swapper/208:13:062
2174261260,1sleep00-21swapper/008:05:300
2168329260,1sleep20-21swapper/208:03:482
2162531260,3sleep02162686-21diskstats08:00:130
2161879260,1sleep20-21swapper/207:55:382
2155345260,4sleep02150087-21/usr/sbin/munin07:50:230
2149567260,3sleep22149577-21apt-get07:50:012
2149367260,1sleep20-21swapper/207:47:252
2143149260,1sleep00-21swapper/007:42:020
2136852260,1sleep20-21swapper/207:39:152
2130893261,2sleep00-21swapper/007:35:130
2130545260,1sleep00-21swapper/007:33:520
2124195260,1sleep20-21swapper/207:26:092
2120526261,2sleep00-21swapper/007:25:190
2111978260,1sleep20-21swapper/207:18:442
2111879260,1sleep00-21swapper/007:17:250
14759860,3rtkit-daemon730-21ntpd11:13:522
14759860,3rtkit-daemon730-21ntpd11:13:522
14759860,3rtkit-daemon214-21plymouthd08:45:161
2495267251,2sleep10-21swapper/111:40:311
2486020250,3sleep12486950-21sed11:35:181
2458623250,3sleep22459423-21tr11:20:162
2398263250,3sleep10-21swapper/110:40:201
2359569250,3sleep22359573-21ssh10:15:522
2312744250,2sleep20-21swapper/209:49:032
2303875250,3sleep10-21swapper/109:42:011
2303688250,2sleep20-21swapper/209:41:382
2289719250,3sleep12289847-21hddtemp_smartct09:35:161
2274094250,2sleep12274989-21kthreadcore09:25:181
2255660251,2sleep00-21swapper/009:12:060
2242689250,3sleep20-21swapper/209:04:102
2205250250,3sleep00-21swapper/008:30:430
2188639251,2sleep20-21swapper/208:20:192
2117623251,2sleep00-21swapper/007:20:220
2117458251,2sleep20-21swapper/207:20:202
2097848250,2sleep00-21swapper/007:10:120
2091994250,2sleep00-21swapper/007:05:150
2423736240,2sleep12248926-21diskmemload10:55:351
2375505240,2sleep12375513-21ssh10:25:331
2336167240,2sleep12336175-21ssh10:02:131
2225229240,2sleep00-21swapper/008:50:140
2224369240,2sleep2214-21plymouthd08:50:082
2206106240,2sleep00-21swapper/008:35:160
2168681240,2sleep20-21swapper/208:05:122
2099661240,2sleep22101668-21kthreadcore07:10:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional