You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 06:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Thu Nov 20, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
237575099140,12cyclictest0-21swapper/321:35:123
2375750991211,0cyclictest69450irq/121-eno122:07:493
237575099120,11cyclictest69450irq/121-eno123:08:313
237575099120,11cyclictest69450irq/121-eno121:31:203
237575099120,11cyclictest0-21swapper/323:50:203
237575099120,11cyclictest0-21swapper/323:25:003
237575099120,11cyclictest0-21swapper/321:50:133
237575099111,9cyclictest69450irq/121-eno123:43:253
2375750991111,0cyclictest69450irq/121-eno100:10:173
2375750991111,0cyclictest0-21swapper/320:00:013
2375750991110,1cyclictest69450irq/121-eno120:18:183
237575099110,10cyclictest0-21swapper/323:15:193
237575099110,10cyclictest0-21swapper/322:20:003
237575099110,10cyclictest0-21swapper/320:05:203
237575099110,10cyclictest0-21swapper/300:35:143
237575099110,10cyclictest0-21swapper/300:30:173
237575099110,0cyclictest0-21swapper/322:32:553
237575099108,1cyclictest0-21swapper/300:00:123
2375750991010,0cyclictest0-21swapper/323:10:123
2375750991010,0cyclictest0-21swapper/322:40:013
2375750991010,0cyclictest0-21swapper/321:55:133
2375750991010,0cyclictest0-21swapper/321:20:103
2375750991010,0cyclictest0-21swapper/321:10:213
2375750991010,0cyclictest0-21swapper/320:05:003
2375750991010,0cyclictest0-21swapper/319:35:003
237575099100,9cyclictest69450irq/121-eno123:35:113
237575099100,9cyclictest69450irq/121-eno123:29:023
237575099100,9cyclictest69450irq/121-eno122:57:183
237575099100,9cyclictest69450irq/121-eno100:00:003
237575099100,9cyclictest0-21swapper/320:45:013
237575099100,9cyclictest0-21swapper/319:25:003
237575099100,10cyclictest0-21swapper/300:05:213
237575099100,0cyclictest0-21swapper/322:40:153
23757509999,0cyclictest69450irq/121-eno123:46:563
23757509999,0cyclictest69450irq/121-eno122:25:353
23757509999,0cyclictest69450irq/121-eno121:40:183
23757509999,0cyclictest69450irq/121-eno121:03:093
23757509999,0cyclictest69450irq/121-eno120:45:123
23757509999,0cyclictest69450irq/121-eno119:53:123
23757509999,0cyclictest0-21swapper/320:25:013
23757509998,1cyclictest0-21swapper/320:30:163
23757509990,8cyclictest69450irq/121-eno120:50:213
23757509990,8cyclictest69450irq/121-eno119:20:013
23757509990,8cyclictest0-21swapper/300:20:183
23757509990,1cyclictest0-21swapper/322:10:093
23757509990,0cyclictest0-21swapper/320:35:193
23757509988,0cyclictest69450irq/121-eno119:49:183
23757509988,0cyclictest69450irq/121-eno119:14:573
23757509988,0cyclictest0-21swapper/323:00:193
23757509988,0cyclictest0-21swapper/322:20:123
23757509988,0cyclictest0-21swapper/321:45:103
23757509988,0cyclictest0-21swapper/321:25:213
23757509988,0cyclictest0-21swapper/321:10:013
23757509988,0cyclictest0-21swapper/320:25:183
23757509987,1cyclictest69450irq/121-eno122:52:203
23757509980,7cyclictest69450irq/121-eno123:30:163
23757509977,0cyclictest69450irq/121-eno122:00:203
23757509977,0cyclictest69450irq/121-eno121:15:163
23757509977,0cyclictest69450irq/121-eno100:19:453
23757509966,0cyclictest69450irq/121-eno100:27:293
23757509960,5cyclictest69450irq/121-eno122:45:133
23757509960,5cyclictest0-21swapper/320:55:103
23757509960,5cyclictest0-21swapper/320:10:003
23757509955,0cyclictest69450irq/121-eno119:39:573
23757509950,4cyclictest0-21swapper/319:30:013
2374373251,3sleep30-21swapper/319:05:173
2460776240,2sleep22460802-21apt-get23:05:112
23757509940,3cyclictest2380143-21chrt19:40:433
2375581242,1sleep10-21swapper/119:09:481
2375487242,1sleep20-21swapper/219:08:322
2374443240,2sleep02374567-21/usr/sbin/munin19:05:190
2486204230,1sleep02486230-21apt-get00:05:130
2439479230,2sleep12439729-21diskstats22:15:151
2496272220,1sleep00-21swapper/000:28:470
2494583220,1sleep22494609-21apt-get00:25:122
2489633220,1sleep00-21swapper/000:10:420
2483608220,0sleep00-21swapper/023:58:100
2480089220,1sleep12480336-21diskstats23:50:171
2477260220,0sleep00-21swapper/023:42:250
2465425220,1sleep22465578-21memory23:15:172
2458717220,0sleep00-21swapper/023:00:140
2458334220,1sleep02458339-21sh22:59:210
2446299220,1sleep02446545-21diskstats22:30:150
2441129220,0sleep22441144-21apt-get22:20:012
2440940220,0sleep20-21swapper/222:18:202
2437917220,0sleep10-21swapper/122:10:161
2429605220,1sleep20-21swapper/221:50:192
2427533220,1sleep02427705-21python321:45:170
2425618220,1sleep22425890-21/usr/sbin/munin21:40:192
2423410220,1sleep22423582-21smart_sda21:35:172
2419935220,1sleep00-21swapper/021:25:240
2407019220,0sleep00-21swapper/020:55:130
2405117220,1sleep12405265-21sed20:50:191
2403189220,1sleep20-21swapper/220:45:152
2385956220,1sleep22385963-21ntp_states20:00:242
2381331220,1sleep00-21swapper/019:50:090
2500208210,0sleep00-21swapper/000:36:400
2499608210,0sleep10-21swapper/100:35:211
2498505210,0sleep20-21swapper/200:35:022
2498317210,0sleep10-21swapper/100:33:241
2496865210,0sleep00-21swapper/000:30:190
2496155210,0sleep10-21swapper/100:27:441
2494160210,1sleep12494162-21ssh00:23:361
2493016210,0sleep20-21swapper/200:20:172
2492727210,0sleep00-21swapper/000:20:150
2491115210,0sleep00-21swapper/000:15:180
2490818210,0sleep20-21swapper/200:15:162
2490571210,0sleep10-21swapper/100:15:151
2488661210,0sleep20-21swapper/200:10:162
2487701210,0sleep10-21swapper/100:07:071
2487579210,0sleep20-21swapper/200:06:002
2485432210,1sleep00-21swapper/000:00:300
2484975210,0sleep20-21swapper/200:00:192
2484231210,0sleep10-21swapper/100:00:141
2482777210,0sleep20-21swapper/223:55:192
2482028210,0sleep10-21swapper/123:55:141
2480878210,0sleep20-21swapper/223:50:222
2480626210,0sleep00-21swapper/023:50:200
2479182210,0sleep00-21swapper/023:45:570
2477811210,0sleep20-21swapper/223:45:142
2477375210,0sleep20-21swapper/223:43:272
2476158210,0sleep10-21swapper/123:40:131
2473733210,0sleep20-21swapper/223:35:132
2473606210,1sleep00-21swapper/023:35:110
2471320210,0sleep00-21swapper/023:30:160
2471255210,0sleep20-21swapper/223:30:142
2469927210,0sleep20-21swapper/223:25:212
2469750210,0sleep10-21swapper/123:25:201
2469167210,0sleep00-21swapper/023:25:140
2467842210,0sleep20-21swapper/223:20:162
2467686210,0sleep12467836-21ssh23:20:151
2467518210,0sleep00-21swapper/023:20:150
2465734210,0sleep00-21swapper/023:15:190
2465338210,0sleep10-21swapper/123:15:161
2463835210,0sleep10-21swapper/123:10:181
2463662210,0sleep00-21swapper/023:10:170
2462865210,0sleep20-21swapper/223:10:112
2460934210,0sleep00-21swapper/023:05:140
2460376210,0sleep2491rcuog/223:03:442
2459458210,0sleep10-21swapper/123:00:191
2456585210,0sleep20-21swapper/222:55:142
2455916210,0sleep20-21swapper/222:51:232
2455137210,0sleep00-21swapper/022:50:170
2454675210,0sleep10-21swapper/122:50:141
2454129210,1sleep00-21swapper/022:49:040
2453050210,0sleep10-21swapper/122:45:181
2452523210,0sleep20-21swapper/222:45:152
2451768210,1sleep00-21swapper/022:41:410
2451707210,0sleep10-21swapper/122:41:091
2450297210,0sleep20-21swapper/222:40:062
2449507210,0sleep20-21swapper/222:35:222
2449209210,0sleep00-21swapper/022:35:200
2447949210,0sleep10-21swapper/122:35:011
2447085210,0sleep10-21swapper/122:30:201
2446629210,0sleep20-21swapper/222:30:172
2444568210,0sleep00-21swapper/022:25:160
2444010210,0sleep10-21swapper/122:25:091
2443503210,0sleep20-21swapper/222:25:012
2443172210,1sleep00-21swapper/022:22:070
2441667210,0sleep10-21swapper/122:20:121
2440016210,0sleep00-21swapper/022:15:180
2437380210,0sleep20-21swapper/222:10:132
2437205210,0sleep00-21swapper/022:10:110
2436152210,0sleep20-21swapper/222:05:202
2435399210,0sleep10-21swapper/122:05:151
2435098210,0sleep00-21swapper/022:05:050
2434766210,0sleep20-21swapper/222:04:112
2433919210,1sleep00-21swapper/022:00:210
2433024210,0sleep10-21swapper/122:00:141
2432232210,0sleep20-21swapper/221:55:282
2431595210,0sleep00-21swapper/021:55:180
2431069210,0sleep10-21swapper/121:55:151
2430145210,1sleep00-21swapper/021:50:280
2430130210,0sleep10-21swapper/121:50:211
2428390210,0sleep10-21swapper/121:48:251
2427351210,0sleep20-21swapper/221:45:142
2426382210,0sleep00-21swapper/021:44:090
2424830210,0sleep10-21swapper/121:40:141
2423851210,0sleep00-21swapper/021:35:190
2420646210,0sleep00-21swapper/021:30:120
2417143210,0sleep00-21swapper/021:20:140
2416810210,0sleep20-21swapper/221:20:122
2416716210,0sleep10-21swapper/121:20:111
2416303211,0sleep10-21swapper/121:19:241
2416088210,1sleep00-21swapper/021:17:030
2414699210,0sleep20-21swapper/221:15:132
2412964210,0sleep00-21swapper/021:10:180
2412710210,0sleep20-21swapper/221:10:172
2412436210,0sleep10-21swapper/121:10:151
2411226210,0sleep10-21swapper/121:05:191
2410861210,0sleep20-21swapper/221:05:162
2409486210,0sleep20-21swapper/221:00:202
2407154210,0sleep10-21swapper/120:55:141
2405535210,0sleep00-21swapper/020:50:220
2404673210,0sleep20-21swapper/220:50:162
2402942210,0sleep10-21swapper/120:45:141
2402793210,0sleep00-21swapper/020:45:120
2401281210,0sleep00-21swapper/020:40:160
2400573210,0sleep10-21swapper/120:40:011
2399034210,0sleep20-21swapper/220:35:152
2398935210,0sleep10-21swapper/120:35:141
2398902210,0sleep00-21swapper/020:35:090
2397746210,0sleep10-21swapper/120:30:201
2397234210,0sleep20-21swapper/220:30:182
2397001210,0sleep00-21swapper/020:30:150
2396384210,0sleep20-21swapper/220:25:212
2396047210,0sleep00-21swapper/020:25:200
2395083210,0sleep10-21swapper/120:25:121
2394074210,0sleep20-21swapper/220:20:222
2393159210,1sleep00-21swapper/020:20:080
2392554210,0sleep00-21swapper/020:16:190
2391626210,0sleep20-21swapper/220:15:162
2389982210,0sleep10-21swapper/120:10:201
2389270210,0sleep00-21swapper/020:10:150
2388745210,1sleep00-21swapper/020:09:540
2387093210,0sleep20-21swapper/220:05:132
2386787210,0sleep10-21swapper/120:04:191
2385169210,0sleep00-21swapper/020:00:060
2383270210,0sleep20-21swapper/219:55:082
2383241210,0sleep12383267-21apt-get19:55:071
2383046210,0sleep00-21swapper/019:55:020
2381481210,0sleep20-21swapper/219:50:322
2381365210,0sleep10-21swapper/119:50:181
2380439210,0sleep20-21swapper/219:44:402
2379009210,0sleep20-21swapper/219:32:192
2378378210,0sleep20-21swapper/219:27:072
2377690210,0sleep00-21swapper/019:21:070
2377351210,0sleep10-21swapper/119:20:011
2376272210,0sleep20-21swapper/219:15:022
2376260210,0sleep10-21swapper/119:14:561
2375603210,0sleep20-21swapper/219:10:022
2496652200,0sleep20-21swapper/200:30:052
2488274200,0sleep10-21swapper/100:10:031
2477555200,0sleep10-21swapper/123:45:021
2473593200,0sleep10-21swapper/123:35:041
2471240200,0sleep10-21swapper/123:30:051
2460761200,0sleep10-21swapper/123:05:031
2456561200,0sleep10-21swapper/122:55:011
2422366200,0sleep10-21swapper/121:35:001
2420628200,0sleep20-21swapper/221:30:012
2420393200,0sleep10-21swapper/121:30:011
2418619200,0sleep20-21swapper/221:25:062
2418618200,0sleep10-21swapper/121:25:051
2410201200,0sleep00-21swapper/021:05:030
2408500200,0sleep10-21swapper/121:00:031
2408245200,0sleep00-21swapper/021:00:020
2406567200,0sleep20-21swapper/220:55:032
2400827200,0sleep20-21swapper/220:40:022
2393155200,0sleep10-21swapper/120:20:051
2391165200,0sleep10-21swapper/120:15:031
2389253200,0sleep20-21swapper/220:10:052
2387078200,0sleep10-21swapper/120:05:041
2380703200,0sleep20-21swapper/219:45:032
2380702200,0sleep10-21swapper/119:45:021
2380469200,0sleep00-21swapper/019:45:020
2380086200,0sleep10-21swapper/119:40:021
2379832200,0sleep00-21swapper/019:40:010
2379459200,0sleep00-21swapper/019:35:040
2379456200,0sleep20-21swapper/219:35:022
2379222200,0sleep10-21swapper/119:35:011
2378841200,0sleep00-21swapper/019:30:050
2378604200,0sleep10-21swapper/119:30:021
2378226200,0sleep00-21swapper/019:25:030
2377989200,0sleep10-21swapper/119:25:011
2377611200,0sleep10-21swapper/119:20:041
2377605200,0sleep20-21swapper/219:20:012
2376970200,0sleep00-21swapper/019:15:040
2375892200,0sleep00-21swapper/019:10:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional