You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-07 - 02:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Mon Jul 07, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2336928991412,1cyclictest0-21swapper/323:00:163
2336928991311,1cyclictest0-21swapper/321:25:143
2336928991211,0cyclictest0-21swapper/323:10:123
2336928991210,1cyclictest0-21swapper/322:45:123
2336928991210,0cyclictest0-21swapper/300:30:143
233692899120,11cyclictest0-21swapper/323:30:153
233692899120,11cyclictest0-21swapper/322:55:183
233692899120,11cyclictest0-21swapper/321:50:133
233692899120,11cyclictest0-21swapper/321:35:133
233692899120,11cyclictest0-21swapper/321:00:253
233692899120,11cyclictest0-21swapper/320:50:143
233692899114,5cyclictest0-21swapper/323:55:153
2336928991111,0cyclictest0-21swapper/321:10:213
2336928991110,0cyclictest0-21swapper/319:15:143
233692899110,8cyclictest0-21swapper/300:20:153
233692899110,11cyclictest0-21swapper/322:05:173
233692899110,10cyclictest0-21swapper/322:30:193
233692899110,10cyclictest0-21swapper/319:35:123
233692899110,0cyclictest0-21swapper/323:05:173
233692899110,0cyclictest0-21swapper/321:20:193
233692899110,0cyclictest0-21swapper/320:35:153
233692899110,0cyclictest0-21swapper/320:00:013
233692899110,0cyclictest0-21swapper/300:16:273
233692899110,0cyclictest0-21swapper/300:05:133
233692899109,0cyclictest0-21swapper/319:15:003
2336928991010,0cyclictest0-21swapper/321:15:153
2336928991010,0cyclictest0-21swapper/320:15:163
2336928991010,0cyclictest0-21swapper/319:25:123
2336928991010,0cyclictest0-21swapper/319:20:133
2336928991010,0cyclictest0-21swapper/300:25:393
233692899100,9cyclictest0-21swapper/322:55:013
233692899100,9cyclictest0-21swapper/320:10:203
233692899100,0cyclictest0-21swapper/319:45:133
233692899100,0cyclictest0-21swapper/300:10:173
23369289999,0cyclictest0-21swapper/300:00:153
23369289998,0cyclictest0-21swapper/323:15:143
23369289998,0cyclictest0-21swapper/322:41:443
23369289998,0cyclictest0-21swapper/321:49:143
23369289997,0cyclictest0-21swapper/320:05:193
23369289990,8cyclictest2415101-21taskset22:24:173
23369289990,8cyclictest0-21swapper/320:25:133
2335869291,5sleep30-21swapper/319:05:213
23369289988,0cyclictest0-21swapper/322:25:143
23369289988,0cyclictest0-21swapper/322:15:193
23369289988,0cyclictest0-21swapper/322:12:593
23369289988,0cyclictest0-21swapper/321:30:143
23369289988,0cyclictest0-21swapper/319:40:163
23369289987,0cyclictest0-21swapper/323:50:213
23369289981,6cyclictest2451268-21taskset23:49:113
23369289980,7cyclictest0-21swapper/322:36:293
23369289980,7cyclictest0-21swapper/321:05:133
23369289977,0cyclictest2447032-21taskset23:38:533
23369289977,0cyclictest0-21swapper/322:00:133
23369289977,0cyclictest0-21swapper/321:55:133
23369289977,0cyclictest0-21swapper/320:40:173
23369289977,0cyclictest0-21swapper/319:50:123
23369289970,0cyclictest0-21swapper/321:43:123
23369289970,0cyclictest0-21swapper/319:30:143
13989870,0rtkit-daemon1397-21rtkit-daemon22:18:192
23369289966,0cyclictest0-21swapper/323:25:113
23369289966,0cyclictest0-21swapper/320:00:173
23369289965,0cyclictest0-21swapper/300:36:083
23369289964,1cyclictest0-21swapper/323:40:153
23369289960,0cyclictest0-21swapper/323:20:183
23369289955,0cyclictest0-21swapper/320:30:133
23369289950,4cyclictest0-21swapper/320:55:133
23369289950,4cyclictest0-21swapper/320:45:023
23369289950,0cyclictest0-21swapper/320:20:143
2336452251,0sleep00-21swapper/019:05:590
13989850,3rtkit-daemon2372460-21tr20:40:182
13989850,2rtkit-daemon0-21swapper/219:05:102
2464879240,1sleep22465018-21ntp_states00:20:202
2402173240,0sleep00-21swapper/021:51:170
2378007240,4sleep20-21swapper/220:52:432
2376002242,1sleep02356572-21kworker/0:2+events20:49:570
2336478242,1sleep10-21swapper/119:06:201
13989840,3rtkit-daemon760-21snmpd20:21:112
13989840,2rtkit-daemon762-21ntpd21:15:552
13989840,2rtkit-daemon1-21systemd22:06:592
2458364230,1sleep02458448-21irqstats00:05:170
2423829230,1sleep02423855-21apt-get22:45:120
2407242230,1sleep12407488-21diskstats22:05:141
2377097230,2sleep12376520-21/usr/sbin/munin20:50:181
13989830,2rtkit-daemon762-21ntpd19:25:192
13989830,2rtkit-daemon760-21snmpd23:00:372
13989830,2rtkit-daemon760-21snmpd21:43:282
13989830,2rtkit-daemon614-21wpa_supplicant21:54:352
13989830,2rtkit-daemon2338970-21munin-node22:35:042
13989830,2rtkit-daemon2338970-21munin-node21:37:572
13989830,2rtkit-daemon1399-21sendmail-mta22:58:292
13989830,2rtkit-daemon1-21systemd21:22:422
13989830,2rtkit-daemon1-21systemd21:05:302
13989830,1rtkit-daemon762-21ntpd23:55:182
13989830,1rtkit-daemon762-21ntpd22:21:092
13989830,1rtkit-daemon762-21ntpd22:12:422
13989830,1rtkit-daemon760-21snmpd23:48:062
13989830,1rtkit-daemon760-21snmpd23:22:242
13989830,1rtkit-daemon760-21snmpd22:51:352
13989830,1rtkit-daemon760-21snmpd22:25:022
13989830,1rtkit-daemon760-21snmpd19:21:342
13989830,1rtkit-daemon614-21wpa_supplicant21:13:432
13989830,1rtkit-daemon614-21wpa_supplicant20:45:512
13989830,1rtkit-daemon614-21wpa_supplicant20:07:502
13989830,1rtkit-daemon331-21plymouthd23:51:212
13989830,1rtkit-daemon331-21plymouthd23:30:202
13989830,1rtkit-daemon331-21plymouthd21:59:152
13989830,1rtkit-daemon331-21plymouthd00:25:342
13989830,1rtkit-daemon2468167-21kworker/u16:1+xprtiod00:30:122
13989830,1rtkit-daemon2378757-21cpuspeed_turbos20:55:152
13989830,1rtkit-daemon2338970-21munin-node23:27:542
13989830,1rtkit-daemon2338970-21munin-node23:15:382
13989830,1rtkit-daemon2338970-21munin-node23:09:532
13989830,1rtkit-daemon1-21systemd22:48:312
13989830,1rtkit-daemon1-21systemd22:40:122
13989830,1rtkit-daemon1-21systemd21:49:232
13989830,1rtkit-daemon1-21systemd19:58:342
13989830,1rtkit-daemon1-21systemd19:46:512
13989830,0rtkit-daemon331-21plymouthd00:18:322
2462864220,1sleep12462914-21open_inodes00:15:191
2462650220,1sleep00-21swapper/000:15:180
2456287220,1sleep10-21swapper/100:00:181
2453166220,1sleep00-21swapper/023:52:290
2451142220,1sleep02451144-21ssh23:48:050
2448057220,1sleep02448212-21ntp_states23:40:190
2443735220,1sleep12443834-21proc_pri23:30:201
2434932220,1sleep02435087-21ntp_states23:10:180
2431117220,1sleep02431340-21/usr/sbin/munin23:00:250
2429346222,0sleep00-21swapper/022:55:330
2420405220,0sleep00-21swapper/022:35:190
2419371220,1sleep12419461-21sed22:35:011
2402264220,0sleep10-21swapper/121:52:061
2393824220,1sleep00-21swapper/021:30:230
2390725220,1sleep22390959-21df21:25:162
2386556220,1sleep00-21swapper/021:15:180
2385024220,1sleep02385196-21python321:10:220
2382408220,1sleep10-21swapper/121:05:151
2378434220,1sleep02378460-21apt-get20:55:140
2362005220,1sleep12362006-21sshd20:11:281
2349284220,1sleep12349535-21diskstats19:40:171
2349144220,1sleep02349281-21aten2.4-expect19:40:160
2342307220,1sleep02342458-21grep19:20:200
13989820,1rtkit-daemon765-21lldpd19:30:042
13989820,1rtkit-daemon760-21snmpd21:30:112
13989820,1rtkit-daemon760-21snmpd19:35:412
13989820,1rtkit-daemon684-21gmain21:01:362
13989820,1rtkit-daemon331-21plymouthd22:01:002
13989820,1rtkit-daemon2338970-21munin-node20:30:092
13989820,1rtkit-daemon1-21systemd23:35:102
13989820,1rtkit-daemon1-21systemd19:11:182
13989820,1rtkit-daemon1-21systemd00:00:252
13989820,0rtkit-daemon331-21plymouthd23:10:132
13989820,0rtkit-daemon331-21plymouthd20:35:042
13989820,0rtkit-daemon2457929-21diskmemload00:05:122
13989820,0rtkit-daemon1-21systemd20:25:062
13989820,0rtkit-daemon0-21swapper/223:40:152
13989820,0rtkit-daemon0-21swapper/222:31:042
13989820,0rtkit-daemon0-21swapper/220:15:072
13989820,0rtkit-daemon0-21swapper/220:10:212
13989820,0rtkit-daemon0-21swapper/220:00:052
13989820,0rtkit-daemon0-21swapper/219:50:182
13989820,0rtkit-daemon0-21swapper/219:40:042
13989820,0rtkit-daemon0-21swapper/219:15:012
13989820,0rtkit-daemon0-21swapper/200:35:232
13989820,0rtkit-daemon0-21swapper/200:10:142
2470918210,0sleep10-21swapper/100:35:211
2470671210,0sleep00-21swapper/000:35:190
2469018210,0sleep10-21swapper/100:30:191
2468853210,0sleep00-21swapper/000:30:190
2466779210,0sleep00-21swapper/000:25:350
2466328210,0sleep10-21swapper/100:25:161
2464731210,0sleep10-21swapper/100:20:191
2464659210,0sleep00-21swapper/000:20:180
2461361210,0sleep10-21swapper/100:10:391
2459769210,1sleep00-21swapper/000:10:020
2457931210,0sleep10-21swapper/100:05:141
2455559210,0sleep00-21swapper/000:00:010
2455395210,0sleep00-21swapper/023:58:400
2454565210,0sleep10-21swapper/123:55:221
2453215210,0sleep10-21swapper/123:52:531
2451310210,0sleep10-21swapper/123:49:341
2449006210,0sleep10-21swapper/123:42:401
2446912210,0sleep00-21swapper/023:37:520
2445392210,0sleep10-21swapper/123:35:131
2442984210,0sleep00-21swapper/023:30:150
2442670210,0sleep00-21swapper/023:29:380
2441336210,0sleep10-21swapper/123:25:191
2439862210,0sleep10-21swapper/123:20:401
2438018210,0sleep00-21swapper/023:18:020
2436918210,0sleep10-21swapper/123:15:201
2435648210,0sleep10-21swapper/123:10:341
2434016210,0sleep10-21swapper/123:09:391
2432811210,0sleep00-21swapper/023:05:220
2431767210,0sleep10-21swapper/123:03:181
2428015210,0sleep10-21swapper/122:55:141
2427510210,0sleep10-21swapper/122:52:501
2425924210,0sleep00-21swapper/022:50:130
2424511210,0sleep10-21swapper/122:45:171
2423430210,0sleep10-21swapper/122:43:451
2422105210,0sleep00-21swapper/022:40:160
2420003210,0sleep10-21swapper/122:35:161
2419010210,0sleep00-21swapper/022:31:520
2416976210,1sleep00-21swapper/022:27:230
2415624210,0sleep10-21swapper/122:25:161
2414102210,0sleep10-21swapper/122:20:191
2413904210,0sleep00-21swapper/022:20:180
2412691210,0sleep10-21swapper/122:16:441
2411231210,0sleep00-21swapper/022:15:150
2410830210,0sleep10-21swapper/122:13:441
2409304210,0sleep00-21swapper/022:10:140
2407117210,0sleep00-21swapper/022:05:130
2406717210,0sleep00-21swapper/022:04:180
2405023210,0sleep10-21swapper/122:00:151
2402853210,0sleep02402879-21apt-get21:55:120
2402599210,0sleep10-21swapper/121:55:011
2399844210,0sleep00-21swapper/021:45:210
2398664210,0sleep10-21swapper/121:45:101
2397988210,0sleep10-21swapper/121:41:161
2397892210,0sleep00-21swapper/021:40:230
2396293210,0sleep10-21swapper/121:39:571
2394799210,0sleep00-21swapper/021:35:160
2393825210,0sleep10-21swapper/121:30:251
2391159210,0sleep10-21swapper/121:25:191
2389953210,0sleep10-21swapper/121:21:281
2388556210,0sleep00-21swapper/021:20:190
2384199210,0sleep10-21swapper/121:10:071
2378463210,0sleep10-21swapper/120:55:151
2376963210,0sleep00-21swapper/020:50:160
2372197210,0sleep10-21swapper/120:40:181
2372168210,0sleep02372194-21apt-get20:40:170
2370601210,0sleep10-21swapper/120:35:161
2368771210,0sleep10-21swapper/120:30:171
2366756210,0sleep00-21swapper/020:25:160
2365274210,0sleep00-21swapper/020:20:180
2364159210,0sleep10-21swapper/120:19:281
2363426210,0sleep00-21swapper/020:15:190
2359144210,0sleep10-21swapper/120:05:221
2356814210,0sleep02356943-21aten_r1power_vo20:00:140
2356490210,0sleep00-21swapper/019:59:410
2355465210,0sleep10-21swapper/119:55:181
2353481210,0sleep00-21swapper/019:50:180
2352542211,0sleep00-21swapper/019:48:130
2348708210,0sleep00-21swapper/019:38:290
2346914210,0sleep10-21swapper/119:35:021
2346556210,0sleep00-21swapper/019:30:280
2345683210,0sleep10-21swapper/119:30:171
2343758210,0sleep00-21swapper/019:25:150
2343078210,0sleep10-21swapper/119:25:001
2341855210,0sleep10-21swapper/119:20:171
2438501200,0sleep00-21swapper/023:20:030
2390518200,0sleep00-21swapper/021:25:030
2386245200,0sleep10-21swapper/121:15:031
2382040200,0sleep00-21swapper/021:05:020
2380358200,0sleep10-21swapper/121:00:021
2380104200,0sleep00-21swapper/021:00:010
2373832200,0sleep10-21swapper/120:45:011
2370213200,0sleep00-21swapper/020:35:030
2368296200,0sleep00-21swapper/020:30:040
2366378200,0sleep10-21swapper/120:25:051
2364463200,0sleep10-21swapper/120:20:031
2360604200,0sleep00-21swapper/020:10:030
2358686200,0sleep00-21swapper/020:05:010
2356772200,0sleep10-21swapper/120:00:031
2352917200,0sleep10-21swapper/119:50:011
2351000200,0sleep10-21swapper/119:45:021
2339457200,0sleep10-21swapper/119:15:041
2339456200,0sleep00-21swapper/019:15:020
2337074200,0sleep10-21swapper/119:10:031
2337073200,0sleep00-21swapper/019:10:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional