You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 05:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Sat Nov 22, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
238950699140,13cyclictest0-21swapper/323:35:133
2389506991312,1cyclictest69450irq/121-eno122:40:143
2389506991311,1cyclictest0-21swapper/323:05:123
238950699130,11cyclictest0-21swapper/300:35:143
2389506991210,0cyclictest0-21swapper/320:10:013
238950699120,11cyclictest69450irq/121-eno100:05:143
238950699120,11cyclictest0-21swapper/323:40:153
238950699120,11cyclictest0-21swapper/322:00:193
238950699120,11cyclictest0-21swapper/322:00:003
238950699120,11cyclictest0-21swapper/320:40:163
238950699120,11cyclictest0-21swapper/300:00:193
238950699120,10cyclictest0-21swapper/320:00:153
238950699120,0cyclictest0-21swapper/323:30:123
238950699119,0cyclictest0-21swapper/319:15:133
2389506991111,0cyclictest0-21swapper/322:15:123
2389506991111,0cyclictest0-21swapper/321:35:003
2389506991110,1cyclictest69450irq/121-eno120:30:123
2389506991110,1cyclictest69450irq/121-eno100:30:163
2389506991110,1cyclictest69450irq/121-eno100:30:153
2389506991110,1cyclictest0-21swapper/322:30:123
238950699110,9cyclictest0-21swapper/320:50:113
238950699110,10cyclictest0-21swapper/300:15:013
238950699110,0cyclictest0-21swapper/321:45:113
238950699110,0cyclictest0-21swapper/321:10:003
238950699109,0cyclictest0-21swapper/320:50:003
2389506991010,0cyclictest69450irq/121-eno123:00:143
2389506991010,0cyclictest69450irq/121-eno121:54:453
2389506991010,0cyclictest69450irq/121-eno100:15:153
2389506991010,0cyclictest0-21swapper/319:25:153
238950699100,9cyclictest69450irq/121-eno123:55:143
238950699100,9cyclictest69450irq/121-eno123:27:433
238950699100,9cyclictest69450irq/121-eno123:15:143
238950699100,9cyclictest69450irq/121-eno122:53:313
238950699100,9cyclictest69450irq/121-eno121:05:143
238950699100,10cyclictest0-21swapper/322:20:173
238950699100,0cyclictest0-21swapper/323:20:193
238950699100,0cyclictest0-21swapper/322:45:153
23895069999,0cyclictest69450irq/121-eno123:52:513
23895069999,0cyclictest69450irq/121-eno121:20:233
23895069999,0cyclictest69450irq/121-eno100:25:133
23895069999,0cyclictest0-21swapper/322:05:183
23895069999,0cyclictest0-21swapper/321:40:173
23895069998,0cyclictest0-21swapper/321:00:123
23895069997,2cyclictest69450irq/121-eno120:35:143
23895069996,2cyclictest69450irq/121-eno122:35:133
23895069990,9cyclictest0-21swapper/321:30:003
23895069990,8cyclictest69450irq/121-eno121:15:193
23895069990,8cyclictest69450irq/121-eno120:12:533
23895069990,8cyclictest0-21swapper/320:55:173
23895069990,0cyclictest0-21swapper/320:20:153
23895069988,0cyclictest69450irq/121-eno122:59:393
23895069988,0cyclictest69450irq/121-eno122:29:143
23895069987,0cyclictest0-21swapper/322:10:133
23895069980,7cyclictest69450irq/121-eno119:10:123
23895069980,0cyclictest0-21swapper/323:45:123
2387193281,4sleep30-21swapper/319:05:013
23895069977,0cyclictest69450irq/121-eno123:10:243
23895069977,0cyclictest69450irq/121-eno121:35:193
23895069977,0cyclictest0-21swapper/319:35:113
23895069975,1cyclictest0-21swapper/300:20:123
23895069966,0cyclictest69450irq/121-eno119:40:203
23895069960,5cyclictest69450irq/121-eno120:27:213
23895069960,5cyclictest69450irq/121-eno120:15:183
23895069960,5cyclictest69450irq/121-eno119:55:203
23895069960,5cyclictest69450irq/121-eno119:55:203
23895069950,4cyclictest0-21swapper/319:20:203
2389312251,3sleep2451ktimers/219:09:202
23895069943,1cyclictest69450irq/121-eno119:45:103
23895069940,3cyclictest69450irq/121-eno119:51:433
23895069940,3cyclictest0-21swapper/319:30:133
2388677241,1sleep00-21swapper/019:05:180
2388313241,1sleep10-21swapper/119:05:151
2512559230,2sleep02512709-21ntp_states00:10:170
2503299230,2sleep12503333-21munin-run23:50:011
2471870230,2sleep22471871-21/usr/sbin/munin22:35:132
2392201230,2sleep02392472-21df_inode19:15:160
2523759220,0sleep00-21swapper/000:35:470
2515044220,1sleep02515326-21users00:15:210
2514800220,1sleep22514891-21ps00:15:202
2511650220,0sleep00-21swapper/000:09:420
2508587220,1sleep22508737-21python300:00:192
2502930220,0sleep00-21swapper/023:46:440
2499097220,2sleep2754-21snmpd23:39:582
2493760220,1sleep12493871-21ntp_states23:25:201
2493592220,1sleep02493759-21sed23:25:190
2484802220,1sleep02477398-21kworker/u16:1+rpciod23:05:130
2482621220,1sleep12482651-21apt-get23:00:141
2480510220,1sleep02480597-21tail22:55:120
2471484220,1sleep12471486-21ssh22:33:531
2462888220,0sleep00-21swapper/022:12:260
2455231220,1sleep02455496-21diskstats21:55:170
2438464220,1sleep00-21swapper/021:15:140
2432516220,1sleep12432781-21diskstats21:00:141
2430550220,1sleep12430837-21df20:55:151
2428500220,0sleep20-21swapper/220:50:112
2427347220,1sleep22427480-21awk20:45:182
2424410220,1sleep12424420-21latency_hist20:40:011
2418916220,1sleep00-21swapper/020:25:110
2407393220,0sleep20-21swapper/219:55:122
2407393220,0sleep20-21swapper/219:55:112
2405574220,1sleep12405767-21cpuspeed_turbos19:50:141
2405484220,1sleep00-21swapper/019:50:130
2390562220,0sleep20-21swapper/219:10:162
2522565210,0sleep10-21swapper/100:35:161
2522043210,0sleep20-21swapper/200:34:062
2522043210,0sleep20-21swapper/200:34:052
2521885210,0sleep10-21swapper/100:32:451
2521885210,0sleep10-21swapper/100:32:441
2521644210,0sleep00-21swapper/000:30:350
2521644210,0sleep00-21swapper/000:30:340
2519848210,1sleep00-21swapper/000:28:100
2518227210,0sleep10-21swapper/100:25:111
2517558210,0sleep20-21swapper/200:21:242
2517534210,0sleep10-21swapper/100:21:111
2515864210,0sleep00-21swapper/000:20:020
2514059210,0sleep10-21swapper/100:15:151
2512096210,0sleep10-21swapper/100:10:141
2511932210,0sleep20-21swapper/200:10:072
2510533210,0sleep10-21swapper/100:05:191
2509989210,0sleep20-21swapper/200:05:152
2508298210,0sleep00-21swapper/000:00:170
2506959210,0sleep00-21swapper/023:55:280
2506577210,0sleep12506776-21/usr/sbin/munin23:55:171
2505640210,0sleep20-21swapper/223:55:102
2503837210,0sleep20-21swapper/223:50:152
2503674210,0sleep10-21swapper/123:50:141
2503581210,0sleep00-21swapper/023:50:130
2501497210,0sleep20-21swapper/223:45:142
2500968210,0sleep10-21swapper/123:42:521
2499619210,0sleep20-21swapper/223:40:172
2499386210,0sleep00-21swapper/023:40:160
2497705210,0sleep10-21swapper/123:35:161
2496691210,0sleep00-21swapper/023:32:110
2496348210,0sleep20-21swapper/223:30:212
2496144210,0sleep10-21swapper/123:30:201
2492402210,0sleep00-21swapper/023:21:140
2492037210,0sleep10-21swapper/123:20:191
2490998210,0sleep20-21swapper/223:20:122
2488884210,0sleep20-21swapper/223:15:122
2488873210,0sleep00-21swapper/023:15:060
2487700210,0sleep22487841-21switchtime23:10:242
2485678210,0sleep20-21swapper/223:05:192
2484945210,0sleep10-21swapper/123:05:141
2483981210,0sleep20-21swapper/223:00:512
2483051210,0sleep00-21swapper/023:00:170
2480598210,0sleep10-21swapper/122:55:141
2479563210,0sleep00-21swapper/022:51:160
2479133210,0sleep20-21swapper/222:50:222
2477902210,0sleep10-21swapper/122:50:011
2477704210,0sleep00-21swapper/022:48:170
2477489210,0sleep10-21swapper/122:46:261
2476965210,0sleep20-21swapper/222:45:222
2475673210,0sleep00-21swapper/022:43:480
2474956210,0sleep10-21swapper/122:40:201
2473633210,0sleep10-21swapper/122:39:241
2472040210,0sleep00-21swapper/022:35:150
2470462210,0sleep20-21swapper/222:30:182
2470205210,0sleep00-21swapper/022:30:160
2468939210,0sleep20-21swapper/222:25:202
2468490210,0sleep00-21swapper/022:25:180
2467038210,0sleep10-21swapper/122:21:311
2466454210,0sleep00-21swapper/022:20:190
2463874210,0sleep10-21swapper/122:15:161
2463622210,0sleep00-21swapper/022:15:140
2462985210,0sleep10-21swapper/122:13:191
2461335210,0sleep20-21swapper/222:10:082
2461064210,0sleep10-21swapper/122:09:471
2459724210,0sleep20-21swapper/222:05:152
2457947210,0sleep20-21swapper/222:00:192
2457792210,0sleep10-21swapper/122:00:181
2456892210,0sleep00-21swapper/022:00:010
2455061210,1sleep20-21swapper/221:55:152
2454359210,0sleep20-21swapper/221:51:072
2452974210,0sleep00-21swapper/021:50:130
2452284210,0sleep00-21swapper/021:46:120
2451628210,0sleep10-21swapper/121:45:171
2450864210,0sleep20-21swapper/221:45:022
2450148210,0sleep20-21swapper/221:40:462
2450107210,0sleep00-21swapper/021:40:240
2448073210,1sleep00-21swapper/021:35:470
2445833210,0sleep20-21swapper/221:30:212
2444849210,0sleep00-21swapper/021:30:150
2443693210,0sleep20-21swapper/221:25:212
2442962210,0sleep10-21swapper/121:25:161
2442819210,0sleep00-21swapper/021:25:160
2440985210,0sleep10-21swapper/121:20:151
2440197210,0sleep20-21swapper/221:20:012
2438493210,0sleep10-21swapper/121:15:151
2437422210,0sleep20-21swapper/221:10:212
2437190210,0sleep00-21swapper/021:10:190
2436681210,0sleep10-21swapper/121:10:161
2434684210,0sleep10-21swapper/121:05:141
2434386210,0sleep00-21swapper/021:05:130
2433857210,0sleep20-21swapper/221:02:592
2432380210,0sleep00-21swapper/021:00:130
2432072210,0sleep20-21swapper/220:59:562
2428928210,0sleep10-21swapper/120:50:141
2428256210,1sleep00-21swapper/020:50:010
2428131210,0sleep10-21swapper/120:48:261
2426344210,0sleep00-21swapper/020:45:010
2425493210,0sleep00-21swapper/020:40:160
2425111210,0sleep10-21swapper/120:40:131
2424402210,0sleep00-21swapper/020:39:560
2422499210,0sleep20-21swapper/220:35:022
2422211210,0sleep20-21swapper/220:31:222
2421448210,0sleep12421605-21ntpq20:30:171
2421311210,0sleep00-21swapper/020:30:160
2419710210,0sleep20-21swapper/220:25:172
2417192210,0sleep20-21swapper/220:20:172
2416070210,0sleep00-21swapper/020:15:180
2415808210,0sleep20-21swapper/220:15:172
2415065210,0sleep10-21swapper/120:15:121
2413151210,0sleep00-21swapper/020:10:100
2411607210,0sleep10-21swapper/120:05:161
2411333210,0sleep00-21swapper/020:05:150
2410987210,0sleep20-21swapper/220:04:572
2410622210,0sleep10-21swapper/120:00:221
2409777210,0sleep00-21swapper/020:00:170
2408186210,0sleep00-21swapper/019:55:180
2408186210,0sleep00-21swapper/019:55:170
2407824210,0sleep10-21swapper/119:55:151
2407824210,0sleep10-21swapper/119:55:141
2404472210,0sleep10-21swapper/119:45:181
2404050210,0sleep20-21swapper/219:45:152
2403693210,0sleep00-21swapper/019:45:130
2403324210,0sleep00-21swapper/019:45:010
2402526210,0sleep20-21swapper/219:40:232
2401753210,0sleep10-21swapper/119:40:181
2400478210,0sleep00-21swapper/019:35:160
2400165210,0sleep20-21swapper/219:35:142
2398702210,0sleep00-21swapper/019:30:210
2397245210,0sleep10-21swapper/119:26:001
2396360210,0sleep20-21swapper/219:25:182
2396011210,0sleep00-21swapper/019:25:150
2395021210,0sleep22395274-21users19:20:212
2394350210,0sleep10-21swapper/119:20:161
2394075210,0sleep00-21swapper/019:20:150
2393707210,0sleep10-21swapper/119:19:571
2391331210,0sleep22391975-21memory19:15:022
2390958210,0sleep00-21swapper/019:10:180
2389754210,0sleep10-21swapper/119:10:111
2522392200,0sleep20-21swapper/200:35:052
2518213200,0sleep20-21swapper/200:25:042
2507495200,0sleep10-21swapper/100:00:011
2497249200,0sleep00-21swapper/023:35:030
2493074200,0sleep20-21swapper/223:25:042
2488869200,0sleep10-21swapper/123:15:031
2486780200,0sleep10-21swapper/123:10:031
2486547200,0sleep00-21swapper/023:10:020
2480493200,0sleep20-21swapper/222:55:032
2473707200,0sleep20-21swapper/222:40:022
2467674200,0sleep10-21swapper/122:25:031
2465585200,0sleep20-21swapper/222:20:042
2463420200,0sleep20-21swapper/222:15:052
2459008200,0sleep00-21swapper/022:05:020
2455041200,0sleep10-21swapper/121:55:021
2452754200,0sleep10-21swapper/121:50:021
2448524200,0sleep10-21swapper/121:40:011
2446713200,0sleep20-21swapper/221:35:022
2446480200,0sleep10-21swapper/121:35:011
2444708200,0sleep10-21swapper/121:30:041
2440716200,0sleep00-21swapper/021:20:020
2438451200,0sleep20-21swapper/221:15:042
2434252200,0sleep20-21swapper/221:05:032
2430169200,0sleep00-21swapper/020:55:010
2424533200,0sleep20-21swapper/220:40:022
2418907200,0sleep10-21swapper/120:25:041
2416993200,0sleep10-21swapper/120:20:041
2416992200,0sleep00-21swapper/020:20:030
2413143200,0sleep20-21swapper/220:10:042
2413142200,0sleep10-21swapper/120:10:031
2411230200,0sleep20-21swapper/220:05:042
2405471200,0sleep20-21swapper/219:50:032
2399478200,0sleep10-21swapper/119:35:011
2397796200,0sleep20-21swapper/219:30:022
2397560200,0sleep10-21swapper/119:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional