You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 06:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Tue Nov 18, 2025 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2381050991710,6cyclictest0-21swapper/320:15:133
238105099150,13cyclictest0-21swapper/322:50:123
2381050991211,1cyclictest69450irq/121-eno123:00:143
238105099120,11cyclictest0-21swapper/323:45:123
238105099120,11cyclictest0-21swapper/321:05:013
238105099120,11cyclictest0-21swapper/319:25:133
238105099120,11cyclictest0-21swapper/300:25:133
238105099120,10cyclictest0-21swapper/300:10:113
2381050991111,0cyclictest0-21swapper/323:40:173
2381050991111,0cyclictest0-21swapper/300:30:133
238105099110,11cyclictest0-21swapper/322:25:193
238105099110,11cyclictest0-21swapper/319:10:203
238105099110,10cyclictest69450irq/121-eno119:50:163
238105099110,10cyclictest0-21swapper/321:55:013
238105099110,10cyclictest0-21swapper/321:25:243
238105099110,10cyclictest0-21swapper/319:35:183
238105099110,0cyclictest0-21swapper/323:50:233
238105099110,0cyclictest0-21swapper/323:10:133
238105099110,0cyclictest0-21swapper/320:00:133
238105099109,0cyclictest0-21swapper/322:45:013
238105099109,0cyclictest0-21swapper/300:15:143
2381050991010,0cyclictest69450irq/121-eno122:13:073
2381050991010,0cyclictest0-21swapper/323:33:103
2381050991010,0cyclictest0-21swapper/322:05:143
2381050991010,0cyclictest0-21swapper/322:00:123
2381050991010,0cyclictest0-21swapper/320:05:173
2381050991010,0cyclictest0-21swapper/319:30:173
238105099100,9cyclictest69450irq/121-eno123:35:153
238105099100,9cyclictest69450irq/121-eno121:15:493
238105099100,9cyclictest69450irq/121-eno100:04:003
238105099100,9cyclictest0-21swapper/320:25:203
238105099100,8cyclictest0-21swapper/320:50:013
23810509999,0cyclictest69450irq/121-eno123:25:183
23810509999,0cyclictest69450irq/121-eno122:45:183
23810509999,0cyclictest69450irq/121-eno122:35:183
23810509999,0cyclictest69450irq/121-eno121:44:283
23810509999,0cyclictest69450irq/121-eno121:12:483
23810509999,0cyclictest69450irq/121-eno120:33:103
23810509999,0cyclictest69450irq/121-eno120:20:203
23810509999,0cyclictest69450irq/121-eno100:35:233
23810509999,0cyclictest69450irq/121-eno100:05:183
23810509998,0cyclictest0-21swapper/323:05:153
23810509997,2cyclictest69450irq/121-eno119:20:153
23810509997,1cyclictest69450irq/121-eno119:40:153
23810509990,8cyclictest69450irq/121-eno121:47:123
23810509990,8cyclictest69450irq/121-eno121:33:363
23810509990,8cyclictest0-21swapper/321:50:203
23810509988,0cyclictest69450irq/121-eno123:56:313
23810509988,0cyclictest69450irq/121-eno123:15:143
23810509988,0cyclictest69450irq/121-eno121:35:183
23810509988,0cyclictest69450irq/121-eno121:06:373
23810509988,0cyclictest69450irq/121-eno120:40:153
23810509987,1cyclictest69450irq/121-eno123:20:203
23810509987,0cyclictest0-21swapper/322:25:013
23810509985,2cyclictest0-21swapper/300:20:133
23810509980,0cyclictest0-21swapper/321:00:013
23810509977,0cyclictest69450irq/121-eno122:55:033
23810509977,0cyclictest69450irq/121-eno122:15:013
23810509977,0cyclictest69450irq/121-eno120:35:163
23810509977,0cyclictest69450irq/121-eno120:10:183
23810509977,0cyclictest69450irq/121-eno119:55:073
23810509977,0cyclictest0-21swapper/322:30:203
23810509977,0cyclictest0-21swapper/319:15:173
23810509970,7cyclictest0-21swapper/320:50:173
23810509970,5cyclictest0-21swapper/319:45:163
2380575261,1sleep10-21swapper/119:07:061
23810509951,4cyclictest69450irq/121-eno121:24:353
2378892251,2sleep30-21swapper/319:05:013
2397439240,1sleep12397465-21apt-get19:50:141
2379128242,1sleep20-21swapper/219:05:032
2459981230,1sleep02460011-21apt-get22:25:150
2454722230,2sleep12454734-21ssh22:10:231
2427212230,1sleep02427365-21memory21:05:180
2418809230,2sleep22418896-21sh20:45:142
2414714230,2sleep12414716-21cron20:35:011
2407314230,2sleep02407441-21basename20:15:150
2379126231,1sleep00-21swapper/019:05:010
2506340220,1sleep00-21swapper/000:15:010
2501900220,1sleep02502000-21cat00:05:000
2497187220,1sleep12497193-21ssh23:50:371
2474237220,1sleep02474240-21sh22:58:480
2468367220,0sleep12468397-21apt-get22:45:171
2467587220,0sleep00-21swapper/022:40:270
2451343220,1sleep12451369-21apt-get22:05:141
2449781220,1sleep02449987-21ntpq22:00:160
2446582220,0sleep20-21swapper/221:52:232
2424889220,1sleep22425015-21/usr/sbin/munin21:00:152
2409407220,0sleep00-21swapper/020:20:150
2396921220,1sleep00-21swapper/019:46:370
2395962220,1sleep22396046-21irqstats19:45:182
2394413220,1sleep12394586-21smartctl19:40:211
2515798210,0sleep20-21swapper/200:35:212
2515512210,0sleep00-21swapper/000:35:190
2515236210,0sleep10-21swapper/100:35:121
2513921210,0sleep00-21swapper/000:30:190
2513145210,0sleep10-21swapper/100:30:121
2513134210,0sleep20-21swapper/200:30:052
2512510210,0sleep10-21swapper/100:26:391
2511840210,0sleep20-21swapper/200:25:192
2511545210,0sleep00-21swapper/000:25:180
2509760210,0sleep20-21swapper/200:20:202
2509492210,0sleep00-21swapper/000:20:180
2508105210,0sleep10-21swapper/100:15:221
2506992210,0sleep20-21swapper/200:15:162
2503989210,0sleep00-21swapper/000:10:010
2502837210,0sleep20-21swapper/200:05:192
2502658210,0sleep10-21swapper/100:05:181
2502156210,0sleep00-21swapper/000:05:130
2501384210,0sleep20-21swapper/200:00:302
2498912210,0sleep00-21swapper/023:55:200
2498657210,0sleep20-21swapper/223:55:182
2497929210,0sleep10-21swapper/123:55:051
2497392210,0sleep20-21swapper/223:52:262
2495861210,0sleep00-21swapper/023:50:160
2495449210,0sleep00-21swapper/023:48:400
2494742210,0sleep10-21swapper/123:45:211
2494348210,0sleep20-21swapper/223:45:172
2492911210,0sleep10-21swapper/123:42:051
2491141210,0sleep20-21swapper/223:40:012
2490814210,0sleep10-21swapper/123:37:121
2489490210,0sleep00-21swapper/023:35:140
2489304210,0sleep20-21swapper/223:35:132
2488645210,1sleep00-21swapper/023:31:310
2488381210,0sleep20-21swapper/223:30:212
2485927210,0sleep00-21swapper/023:25:220
2485748210,0sleep20-21swapper/223:25:202
2485595210,0sleep10-21swapper/123:25:191
2483685210,0sleep10-21swapper/123:20:181
2483529210,0sleep00-21swapper/023:20:170
2483188210,0sleep20-21swapper/223:20:152
2482485210,0sleep00-21swapper/023:17:380
2480983210,0sleep20-21swapper/223:15:162
2480924210,1sleep10-21swapper/123:15:151
2479543210,0sleep10-21swapper/123:10:191
2479017210,0sleep20-21swapper/223:10:162
2478829210,0sleep00-21swapper/023:10:140
2478442210,0sleep10-21swapper/123:08:501
2477190210,0sleep20-21swapper/223:05:182
2476822210,0sleep00-21swapper/023:05:170
2476059210,0sleep20-21swapper/223:01:192
2476013210,0sleep00-21swapper/023:00:530
2475788210,0sleep10-21swapper/123:00:221
2473652210,0sleep20-21swapper/222:55:232
2470788210,0sleep00-21swapper/022:50:160
2470478210,0sleep20-21swapper/222:50:142
2470449210,0sleep12470475-21apt-get22:50:131
2468790210,0sleep00-21swapper/022:45:200
2468400210,0sleep20-21swapper/222:45:182
2467761210,0sleep20-21swapper/222:42:012
2466800210,0sleep10-21swapper/122:40:201
2465997210,0sleep20-21swapper/222:40:022
2464777210,0sleep00-21swapper/022:35:190
2464284210,0sleep10-21swapper/122:35:161
2463373210,0sleep00-21swapper/022:30:230
2462495210,0sleep20-21swapper/222:30:172
2462227210,0sleep10-21swapper/122:30:161
2460603210,0sleep10-21swapper/122:25:191
2457786210,0sleep00-21swapper/022:20:140
2457627210,0sleep20-21swapper/222:20:122
2456144210,0sleep00-21swapper/022:15:210
2455899210,0sleep20-21swapper/222:15:202
2455503210,0sleep10-21swapper/122:15:071
2453668210,0sleep20-21swapper/222:10:152
2453171210,0sleep00-21swapper/022:10:020
2452789210,0sleep20-21swapper/222:06:392
2452672210,1sleep00-21swapper/022:05:370
2450767210,0sleep20-21swapper/222:02:152
2448924210,0sleep20-21swapper/221:59:352
2447126210,0sleep00-21swapper/021:55:050
2445848210,0sleep10-21swapper/121:50:211
2445741210,0sleep00-21swapper/021:50:200
2444745210,0sleep00-21swapper/021:49:320
2444337210,0sleep10-21swapper/121:45:561
2442714210,0sleep20-21swapper/221:45:012
2441160210,0sleep00-21swapper/021:40:160
2440927210,0sleep10-21swapper/121:40:131
2440230210,0sleep10-21swapper/121:35:361
2438904210,0sleep00-21swapper/021:35:140
2438647210,0sleep20-21swapper/221:35:012
2438255210,1sleep00-21swapper/021:30:550
2438008210,0sleep20-21swapper/221:30:202
2437324210,0sleep10-21swapper/121:30:161
2436651210,0sleep20-21swapper/221:30:012
2435352210,0sleep10-21swapper/121:25:201
2435081210,0sleep00-21swapper/021:25:190
2432848210,0sleep10-21swapper/121:20:151
2432720210,0sleep00-21swapper/021:20:140
2432680210,0sleep20-21swapper/221:20:092
2430817210,0sleep10-21swapper/121:15:151
2430722210,0sleep00-21swapper/021:15:140
2429707210,0sleep20-21swapper/221:10:242
2429097210,0sleep10-21swapper/121:10:191
2428413210,0sleep00-21swapper/021:10:020
2426773210,0sleep10-21swapper/121:05:141
2426339210,0sleep00-21swapper/021:03:010
2424830210,0sleep10-21swapper/121:00:141
2423155210,0sleep20-21swapper/220:55:192
2422900210,0sleep00-21swapper/020:55:170
2422540210,0sleep10-21swapper/120:55:021
2422300210,0sleep00-21swapper/020:53:570
2422019210,0sleep20-21swapper/220:50:222
2420720210,0sleep10-21swapper/120:50:141
2418425211,0sleep2754-21snmpd20:43:182
2417130210,0sleep00-21swapper/020:40:150
2415397210,0sleep00-21swapper/020:35:200
2414995210,0sleep20-21swapper/220:35:182
2414966210,0sleep10-21swapper/120:35:171
2413471210,0sleep00-21swapper/020:30:150
2413075210,0sleep20-21swapper/220:30:132
2412067210,0sleep20-21swapper/220:25:202
2411164210,0sleep00-21swapper/020:25:150
2409221210,0sleep20-21swapper/220:20:132
2408868210,0sleep20-21swapper/220:18:572
2407443210,0sleep10-21swapper/120:15:161
2406166210,0sleep20-21swapper/220:10:192
2405374210,0sleep00-21swapper/020:10:140
2403553210,0sleep20-21swapper/220:05:162
2403463210,0sleep10-21swapper/120:05:151
2403446210,0sleep00-21swapper/020:05:020
2401900210,0sleep00-21swapper/020:00:170
2401652210,0sleep20-21swapper/220:00:162
2401007210,0sleep20-21swapper/219:59:562
2400696210,0sleep00-21swapper/019:55:570
2400284210,0sleep10-21swapper/119:55:221
2398085210,0sleep20-21swapper/219:50:192
2397191210,0sleep00-21swapper/019:50:010
2396326210,0sleep10-21swapper/119:45:211
2394587210,0sleep20-21swapper/219:40:222
2394334210,0sleep00-21swapper/019:40:200
2391433210,0sleep10-21swapper/119:35:011
2391420210,0sleep00-21swapper/019:34:520
2389517210,0sleep10-21swapper/119:30:011
2388298210,0sleep10-21swapper/119:25:161
2388138210,0sleep00-21swapper/019:25:150
2386461210,0sleep00-21swapper/019:20:180
2386001210,0sleep10-21swapper/119:20:151
2385408210,0sleep20-21swapper/219:20:012
2384707210,0sleep1328-21plymouthd19:15:201
2383925210,0sleep00-21swapper/019:15:150
2383030210,0sleep20-21swapper/219:15:012
2381882210,0sleep00-21swapper/019:10:190
2380803210,0sleep22380825-21apt-get19:10:012
2508953200,0sleep10-21swapper/100:20:031
2504484200,0sleep20-21swapper/200:10:032
2504482200,0sleep10-21swapper/100:10:021
2499791200,0sleep10-21swapper/100:00:011
2491399200,0sleep00-21swapper/023:40:030
2487194200,0sleep10-21swapper/123:30:041
2472529200,0sleep10-21swapper/122:55:061
2459964200,0sleep20-21swapper/222:25:042
2457612200,0sleep10-21swapper/122:20:031
2448978200,0sleep10-21swapper/122:00:011
2446890200,0sleep10-21swapper/121:55:021
2440658200,0sleep20-21swapper/221:40:022
2430651200,0sleep20-21swapper/221:15:042
2426735200,0sleep20-21swapper/221:05:032
2418797200,0sleep00-21swapper/020:45:040
2418561200,0sleep10-21swapper/120:45:011
2416626200,0sleep10-21swapper/120:40:001
2411122200,0sleep10-21swapper/120:25:031
2409210200,0sleep10-21swapper/120:20:041
2405360200,0sleep10-21swapper/120:10:031
2401273200,0sleep10-21swapper/120:00:021
2391669200,0sleep00-21swapper/019:35:030
2391666200,0sleep20-21swapper/219:35:022
2389752200,0sleep20-21swapper/219:30:012
2387640200,0sleep20-21swapper/219:25:012
2381353200,0sleep10-21swapper/119:10:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional