You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 02:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Mon Nov 24, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2345638991311,1cyclictest0-21swapper/321:30:123
234563899120,1cyclictest0-21swapper/320:25:133
234563899120,11cyclictest69450irq/121-eno123:45:163
234563899120,11cyclictest0-21swapper/322:15:013
234563899120,11cyclictest0-21swapper/319:45:143
234563899120,11cyclictest0-21swapper/319:25:143
2345638991111,0cyclictest69450irq/121-eno122:20:143
2345638991111,0cyclictest0-21swapper/323:10:013
2345638991111,0cyclictest0-21swapper/321:44:563
2345638991111,0cyclictest0-21swapper/300:35:133
2345638991110,1cyclictest69450irq/121-eno121:10:123
2345638991110,1cyclictest0-21swapper/322:45:113
2345638991110,0cyclictest0-21swapper/319:50:133
2345638991110,0cyclictest0-21swapper/300:20:013
234563899110,8cyclictest0-21swapper/322:55:193
234563899110,10cyclictest69450irq/121-eno123:05:153
234563899110,10cyclictest69450irq/121-eno122:31:013
234563899110,10cyclictest69450irq/121-eno122:02:573
234563899110,10cyclictest0-21swapper/300:05:223
234563899110,0cyclictest0-21swapper/323:20:163
234563899110,0cyclictest0-21swapper/320:45:183
234563899109,0cyclictest0-21swapper/319:30:133
234563899108,1cyclictest0-21swapper/322:40:123
2345638991010,0cyclictest69450irq/121-eno122:25:233
2345638991010,0cyclictest69450irq/121-eno121:25:213
2345638991010,0cyclictest69450irq/121-eno119:55:133
2345638991010,0cyclictest69450irq/121-eno100:00:203
2345638991010,0cyclictest0-21swapper/322:05:113
2345638991010,0cyclictest0-21swapper/321:55:143
2345638991010,0cyclictest0-21swapper/321:45:123
2345638991010,0cyclictest0-21swapper/320:30:183
2345638991010,0cyclictest0-21swapper/320:05:183
234563899100,9cyclictest69450irq/121-eno123:27:513
234563899100,9cyclictest69450irq/121-eno120:51:133
234563899100,9cyclictest69450irq/121-eno100:12:383
234563899100,9cyclictest0-21swapper/323:15:183
234563899100,9cyclictest0-21swapper/321:20:133
23456389999,0cyclictest69450irq/121-eno123:02:573
23456389999,0cyclictest69450irq/121-eno122:50:133
23456389999,0cyclictest69450irq/121-eno122:35:143
23456389999,0cyclictest69450irq/121-eno122:16:253
23456389999,0cyclictest69450irq/121-eno119:35:353
23456389999,0cyclictest69450irq/121-eno119:20:143
23456389999,0cyclictest69450irq/121-eno119:20:143
23456389999,0cyclictest69450irq/121-eno100:20:173
23456389999,0cyclictest0-21swapper/323:55:183
23456389999,0cyclictest0-21swapper/323:50:133
23456389999,0cyclictest0-21swapper/323:40:013
23456389999,0cyclictest0-21swapper/323:30:203
23456389999,0cyclictest0-21swapper/319:15:013
23456389998,0cyclictest0-21swapper/321:40:013
23456389990,8cyclictest69450irq/121-eno100:27:083
23456389988,0cyclictest69450irq/121-eno123:35:273
23456389988,0cyclictest69450irq/121-eno121:51:143
23456389988,0cyclictest69450irq/121-eno121:15:163
23456389988,0cyclictest69450irq/121-eno100:30:173
23456389988,0cyclictest0-21swapper/321:10:003
23456389987,0cyclictest0-21swapper/320:10:143
23456389977,0cyclictest0-21swapper/320:20:203
23456389966,0cyclictest69450irq/121-eno120:57:133
23456389964,1cyclictest0-21swapper/319:10:143
2343851261,3sleep10-21swapper/119:05:121
23456389955,0cyclictest69450irq/121-eno120:40:163
23456389955,0cyclictest69450irq/121-eno119:40:143
23456389951,2cyclictest0-21swapper/320:00:133
2344626250,3sleep30-21swapper/319:05:183
23456389940,3cyclictest2390335-21chrt21:00:293
23456389940,3cyclictest2371471-21chrt20:15:063
23456389940,2cyclictest0-21swapper/320:35:133
2343880241,1sleep20-21swapper/219:05:132
2453327230,1sleep12453346-21apt-get23:35:011
2415348230,1sleep02415374-21apt-get22:05:110
2402571230,2sleep12402575-21ssh21:34:341
2400599230,2sleep02400631-21systemd-run21:30:000
2387522230,2sleep00-21swapper/020:55:140
2375592230,1sleep02375618-21apt-get20:25:120
2344754231,0sleep00-21swapper/019:05:190
2481345220,1sleep12481573-21latency_hist00:40:021
2472708220,1sleep22472719-21munin-run00:20:012
2472696220,1sleep10-21swapper/100:19:561
2468942220,1sleep02469215-21df_inode00:10:190
2461473220,1sleep00-21swapper/023:50:210
2455666220,0sleep00-21swapper/023:39:570
2453077220,0sleep00-21swapper/023:32:520
2451488220,0sleep12451514-21apt-get23:30:131
2449397220,0sleep12449423-21apt-get23:25:131
2447753220,1sleep02447839-21irqstats23:20:200
2440047220,0sleep00-21swapper/023:01:020
2439248220,1sleep22439418-21ntpq23:00:162
2437113220,0sleep00-21swapper/022:55:180
2415970220,1sleep12416118-21ntp_states22:05:161
2415095220,1sleep22415131-21munin-run22:05:012
2406255220,1sleep12406260-21sshd21:40:581
2399839220,1sleep12400050-21unixbench-2d21:25:211
2384160220,1sleep12384308-21find20:45:191
2380040220,1sleep12380189-21ntp_states20:35:181
2373146220,1sleep00-21swapper/020:20:000
2365178220,1sleep00-21swapper/019:56:150
2358206220,1sleep22358493-21df19:40:162
2352060220,1sleep00-21swapper/019:25:010
2352060220,1sleep00-21swapper/019:25:010
2346313220,1sleep22346452-21sed19:10:182
2479632210,0sleep20-21swapper/200:35:142
2479506210,0sleep00-21swapper/000:35:120
2479073210,1sleep00-21swapper/000:33:280
2478906210,0sleep20-21swapper/200:31:582
2477933210,0sleep10-21swapper/100:30:171
2476776210,0sleep20-21swapper/200:26:382
2476639210,0sleep00-21swapper/000:25:240
2475520210,0sleep10-21swapper/100:25:171
2474812210,1sleep10-21swapper/100:22:451
2473679210,0sleep00-21swapper/000:20:150
2473334210,0sleep20-21swapper/200:20:132
2470865210,1sleep00-21swapper/000:15:110
2469216210,0sleep10-21swapper/100:10:201
2468787210,0sleep20-21swapper/200:10:172
2468039210,0sleep10-21swapper/100:05:431
2466984210,0sleep00-21swapper/000:05:190
2465050210,0sleep20-21swapper/200:00:162
2464598210,0sleep00-21swapper/000:00:100
2463930210,0sleep10-21swapper/123:56:391
2463098210,0sleep00-21swapper/023:55:180
2462768210,0sleep20-21swapper/223:55:162
2459611210,0sleep20-21swapper/223:45:232
2458590210,0sleep10-21swapper/123:45:141
2458397210,0sleep00-21swapper/023:45:130
2456217210,0sleep00-21swapper/023:40:130
2456200210,0sleep10-21swapper/123:40:061
2454775210,0sleep20-21swapper/223:35:182
2451273210,0sleep20-21swapper/223:30:022
2449396210,0sleep00-21swapper/023:25:120
2448674210,0sleep20-21swapper/223:20:542
2447841210,0sleep10-21swapper/123:20:211
2445975210,0sleep20-21swapper/223:15:172
2445843210,0sleep10-21swapper/123:15:161
2445195210,0sleep00-21swapper/023:15:110
2444509210,0sleep20-21swapper/223:11:132
2444468210,0sleep00-21swapper/023:10:520
2443105210,0sleep10-21swapper/123:10:121
2442156210,0sleep20-21swapper/223:06:132
2442137210,0sleep10-21swapper/123:06:041
2440739210,1sleep00-21swapper/023:05:030
2439114210,0sleep10-21swapper/123:00:151
2438200210,0sleep10-21swapper/122:58:191
2436818210,0sleep20-21swapper/222:55:162
2435863210,0sleep10-21swapper/122:51:111
2434887210,0sleep20-21swapper/222:50:162
2434493210,0sleep00-21swapper/022:50:140
2433347210,0sleep10-21swapper/122:45:181
2432545210,0sleep00-21swapper/022:45:130
2432379210,0sleep20-21swapper/222:45:112
2431224210,0sleep20-21swapper/222:40:192
2430445210,0sleep10-21swapper/122:40:141
2430351210,0sleep00-21swapper/022:40:130
2428793210,0sleep20-21swapper/222:35:192
2428468210,0sleep00-21swapper/022:35:170
2428178210,0sleep10-21swapper/122:35:141
2426619210,0sleep00-21swapper/022:30:170
2426325210,0sleep20-21swapper/222:30:142
2426181210,0sleep10-21swapper/122:30:131
2424721210,0sleep00-21swapper/022:25:200
2423484210,0sleep12423501-21apt-get22:25:011
2423000210,0sleep10-21swapper/122:20:491
2422178210,0sleep20-21swapper/222:20:182
2421884210,0sleep00-21swapper/022:20:160
2421103210,0sleep10-21swapper/122:17:411
2419952210,0sleep00-21swapper/022:15:150
2419524210,0sleep20-21swapper/222:15:092
2417882210,0sleep20-21swapper/222:10:172
2417678210,0sleep10-21swapper/122:10:161
2417516210,0sleep00-21swapper/022:10:150
2414764210,0sleep00-21swapper/022:02:070
2414569210,0sleep10-21swapper/122:00:231
2412572210,0sleep00-21swapper/021:56:220
2411575210,0sleep20-21swapper/221:55:162
2411277210,0sleep10-21swapper/121:55:151
2410031210,0sleep22410249-21unixbench-2d21:50:202
2409783210,0sleep00-21swapper/021:50:190
2409246210,0sleep10-21swapper/121:50:151
2407940210,0sleep20-21swapper/221:45:192
2407772210,0sleep10-21swapper/121:45:181
2407033210,0sleep00-21swapper/021:45:130
2406299210,0sleep20-21swapper/221:41:192
2406281210,0sleep00-21swapper/021:41:090
2403491210,0sleep10-21swapper/121:35:191
2402992210,0sleep20-21swapper/221:35:152
2402867210,0sleep00-21swapper/021:35:130
2402151210,0sleep00-21swapper/021:30:200
2401275210,0sleep20-21swapper/221:30:142
2400052210,0sleep20-21swapper/221:25:222
2396903210,0sleep20-21swapper/221:20:152
2396874210,0sleep10-21swapper/121:20:131
2395836210,0sleep00-21swapper/021:15:200
2394962210,0sleep20-21swapper/221:15:142
2393536210,0sleep20-21swapper/221:10:172
2393283210,0sleep00-21swapper/021:10:150
2392852210,0sleep10-21swapper/121:10:121
2391712210,1sleep00-21swapper/021:05:190
2390690210,0sleep20-21swapper/221:05:012
2389089210,0sleep12389273-21cat21:00:161
2389029210,0sleep00-21swapper/021:00:150
2388756210,1sleep20-21swapper/221:00:012
2387808210,0sleep20-21swapper/220:55:162
2387090210,0sleep10-21swapper/120:55:111
2386844210,0sleep20-21swapper/220:55:002
2385271210,0sleep00-21swapper/020:50:140
2383732210,0sleep20-21swapper/220:45:162
2383370210,0sleep00-21swapper/020:45:140
2382123210,0sleep10-21swapper/120:40:181
2380190210,0sleep20-21swapper/220:35:192
2379174210,0sleep00-21swapper/020:35:010
2378476210,0sleep20-21swapper/220:30:192
2377257210,0sleep00-21swapper/020:30:010
2375745210,0sleep20-21swapper/220:25:142
2374262210,0sleep00-21swapper/020:20:200
2373298210,0sleep10-21swapper/120:20:011
2372606210,0sleep20-21swapper/220:15:222
2371904210,0sleep10-21swapper/120:15:171
2369566210,0sleep20-21swapper/220:10:142
2369564210,1sleep00-21swapper/020:10:120
2369100210,0sleep20-21swapper/220:07:132
2368162210,0sleep12368353-21needreboot20:05:161
2368085210,0sleep00-21swapper/020:05:150
2367008210,0sleep20-21swapper/220:00:222
2366717210,0sleep10-21swapper/120:00:201
2362290210,0sleep10-21swapper/119:50:151
2362016210,0sleep00-21swapper/019:50:140
2360374210,0sleep20-21swapper/219:45:162
2360107210,0sleep10-21swapper/119:45:151
2360008210,0sleep00-21swapper/019:45:140
2358750210,0sleep12358850-21open_files19:40:191
2358070210,0sleep00-21swapper/019:40:140
2356629210,0sleep20-21swapper/219:35:152
2356557210,0sleep10-21swapper/119:35:141
2355889210,0sleep00-21swapper/019:35:020
2355664210,0sleep20-21swapper/219:32:112
2354939210,0sleep10-21swapper/119:30:181
2354221210,0sleep00-21swapper/019:30:130
2353279210,1sleep00-21swapper/019:25:210
2353039210,0sleep20-21swapper/219:25:192
2352095210,0sleep10-21swapper/119:25:021
2351502210,0sleep20-21swapper/219:20:232
2351502210,0sleep20-21swapper/219:20:232
2348266210,0sleep00-21swapper/019:15:120
2348090210,0sleep20-21swapper/219:15:022
2347482210,0sleep10-21swapper/119:15:011
2347241210,1sleep00-21swapper/019:11:560
2347192210,1sleep10-21swapper/119:11:171
2466675200,0sleep20-21swapper/200:05:042
2464585200,0sleep10-21swapper/100:00:031
2460378200,0sleep20-21swapper/223:50:032
2460377200,0sleep10-21swapper/123:50:031
2456196200,0sleep20-21swapper/223:40:032
2449148200,0sleep20-21swapper/223:25:022
2423979200,0sleep20-21swapper/222:25:022
2415336200,0sleep20-21swapper/222:05:052
2396863200,0sleep00-21swapper/021:20:040
2394606200,0sleep10-21swapper/121:15:011
2390926200,0sleep10-21swapper/121:05:041
2385167200,0sleep10-21swapper/120:50:031
2381343200,0sleep20-21swapper/220:40:042
2381341200,0sleep00-21swapper/020:40:010
2377492200,0sleep10-21swapper/120:30:021
2375577200,0sleep10-21swapper/120:25:011
2373402200,0sleep20-21swapper/220:20:022
2369555200,0sleep10-21swapper/120:10:051
2365728200,0sleep00-21swapper/020:00:030
2363796200,0sleep20-21swapper/219:55:052
2363795200,0sleep10-21swapper/119:55:041
2361883200,0sleep20-21swapper/219:50:042
2349865200,0sleep10-21swapper/119:20:011
2349865200,0sleep10-21swapper/119:20:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional