You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-31 - 08:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Sun Aug 31, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
241895199141,12cyclictest0-21swapper/321:45:133
241895199140,13cyclictest0-21swapper/322:30:123
241895199140,11cyclictest0-21swapper/320:17:223
241895199140,11cyclictest0-21swapper/320:17:213
2418951991310,1cyclictest0-21swapper/323:45:123
241895199130,11cyclictest0-21swapper/323:40:123
2418951991211,1cyclictest69450irq/121-eno100:00:143
241895199120,11cyclictest69450irq/121-eno123:20:203
241895199120,11cyclictest69450irq/121-eno123:17:303
241895199120,11cyclictest0-21swapper/321:55:133
241895199120,11cyclictest0-21swapper/321:35:013
241895199120,0cyclictest0-21swapper/321:05:163
241895199119,1cyclictest69450irq/121-eno122:25:003
2418951991111,0cyclictest69450irq/121-eno120:47:533
2418951991110,0cyclictest0-21swapper/320:55:123
241895199110,10cyclictest69450irq/121-eno121:20:123
241895199110,10cyclictest0-21swapper/323:59:593
241895199110,10cyclictest0-21swapper/322:55:143
241895199110,10cyclictest0-21swapper/322:45:193
241895199110,10cyclictest0-21swapper/322:25:173
241895199110,10cyclictest0-21swapper/322:10:193
241895199110,10cyclictest0-21swapper/321:40:133
241895199110,10cyclictest0-21swapper/320:35:013
241895199110,10cyclictest0-21swapper/319:19:043
241895199110,10cyclictest0-21swapper/300:25:133
241895199110,0cyclictest0-21swapper/321:05:013
241895199110,0cyclictest0-21swapper/300:15:123
241895199109,1cyclictest69450irq/121-eno122:40:133
241895199109,0cyclictest69450irq/121-eno123:31:323
241895199108,1cyclictest0-21swapper/322:35:123
2418951991010,0cyclictest69450irq/121-eno119:14:483
2418951991010,0cyclictest69450irq/121-eno100:31:363
2418951991010,0cyclictest0-21swapper/323:25:123
2418951991010,0cyclictest0-21swapper/320:50:133
241895199100,9cyclictest69450irq/121-eno123:50:183
241895199100,9cyclictest69450irq/121-eno123:01:213
241895199100,9cyclictest69450irq/121-eno121:39:573
241895199100,9cyclictest69450irq/121-eno100:36:313
241895199100,0cyclictest0-21swapper/322:55:013
241895199100,0cyclictest0-21swapper/321:10:153
24189519999,0cyclictest69450irq/121-eno121:26:553
24189519999,0cyclictest69450irq/121-eno120:20:103
24189519999,0cyclictest69450irq/121-eno120:09:293
24189519999,0cyclictest69450irq/121-eno100:23:313
24189519999,0cyclictest0-21swapper/323:09:393
24189519999,0cyclictest0-21swapper/321:54:263
24189519999,0cyclictest0-21swapper/320:35:123
24189519990,8cyclictest69450irq/121-eno122:15:453
24189519990,8cyclictest0-21swapper/319:35:003
24189519988,0cyclictest69450irq/121-eno121:15:163
24189519988,0cyclictest69450irq/121-eno120:02:173
24189519988,0cyclictest69450irq/121-eno119:25:073
24189519988,0cyclictest0-21swapper/320:45:013
24189519980,8cyclictest69450irq/121-eno120:25:023
24189519980,8cyclictest0-21swapper/322:00:113
24189519980,7cyclictest69450irq/121-eno123:35:163
24189519980,7cyclictest0-21swapper/322:05:133
24189519980,3cyclictest0-21swapper/319:35:323
24189519980,0cyclictest0-21swapper/320:11:113
24189519977,0cyclictest69450irq/121-eno123:10:153
24189519977,0cyclictest69450irq/121-eno100:10:103
2418716272,1sleep20-21swapper/219:08:402
24189519960,0cyclictest0-21swapper/300:05:143
24189519950,4cyclictest69450irq/121-eno119:21:393
24189519950,4cyclictest0-21swapper/319:50:003
24189519950,0cyclictest0-21swapper/320:00:013
2534915240,0sleep12535132-21awk00:30:151
2527416243,1sleep02509012-21kworker/0:2+events00:11:130
2447894240,0sleep00-21swapper/021:01:090
24189519940,3cyclictest0-21swapper/319:40:153
2418540242,1sleep10-21swapper/119:06:221
2418442241,2sleep30-21swapper/319:05:043
2532299230,1sleep22532325-21apt-get00:25:132
2503064230,2sleep22503263-21cpuspeed_turbos23:15:152
2460585230,1sleep12460611-21apt-get21:35:131
2436818230,2sleep22437089-21df_inode20:35:132
2436665230,1sleep02436691-21apt-get20:35:110
24189519930,2cyclictest69450irq/121-eno119:50:063
2418375231,1sleep00-21swapper/019:05:010
2532923220,1sleep00-21swapper/000:25:180
2529755220,1sleep00-21swapper/000:18:220
2521276220,0sleep20-21swapper/223:57:422
2507244220,1sleep02507430-21cpuspeed_turbos23:25:140
2505673220,1sleep02505823-21ntp_states23:20:180
2504387220,1sleep00-21swapper/023:16:370
2500911220,0sleep20-21swapper/223:10:152
2497306220,1sleep02497522-21sed23:00:160
2483345220,1sleep02483349-21ssh22:28:020
2479221221,1sleep02475431-21kworker/u16:0+xprtiod22:18:430
2477201220,1sleep22477202-21sshd22:14:202
2472841220,0sleep02472859-21apt-get22:05:010
2464396220,0sleep00-21swapper/021:44:270
2457383220,1sleep02456607-21/usr/sbin/munin21:25:180
2455922220,0sleep00-21swapper/021:20:270
2453651220,1sleep02453902-21users21:15:180
2443155220,1sleep12443225-21grep20:50:171
2432839220,0sleep22432865-21apt-get20:25:132
2422433220,1sleep12422527-21latency_hist19:35:001
2537867210,0sleep20-21swapper/200:36:082
2537530210,0sleep00-21swapper/000:35:260
2534825210,0sleep00-21swapper/000:30:140
2534508210,0sleep20-21swapper/200:30:122
2533077210,0sleep10-21swapper/100:25:201
2530599210,0sleep20-21swapper/200:20:192
2528206210,0sleep20-21swapper/200:15:152
2527939210,0sleep10-21swapper/100:15:021
2526389210,0sleep20-21swapper/200:10:162
2525471210,0sleep10-21swapper/100:07:291
2524084210,0sleep00-21swapper/000:05:160
2522603210,0sleep00-21swapper/000:00:210
2521842210,0sleep20-21swapper/200:00:152
2521565210,0sleep10-21swapper/100:00:021
2520471211,0sleep12450381-21diskmemload23:55:171
2519725210,0sleep00-21swapper/023:55:120
2518099210,0sleep10-21swapper/123:50:161
2518037210,0sleep00-21swapper/023:50:160
2517673210,0sleep20-21swapper/223:50:132
2516815210,0sleep00-21swapper/023:45:190
2516266210,0sleep10-21swapper/123:45:171
2515107210,0sleep00-21swapper/023:43:350
2514873210,0sleep20-21swapper/223:41:332
2514742210,0sleep10-21swapper/123:40:241
2512301210,0sleep00-21swapper/023:35:190
2512066210,0sleep20-21swapper/223:35:162
2511852210,0sleep10-21swapper/123:35:161
2511004210,0sleep00-21swapper/023:34:260
2510518210,0sleep20-21swapper/223:30:202
2508551210,0sleep20-21swapper/223:26:202
2507431210,0sleep10-21swapper/123:25:151
2506363210,0sleep10-21swapper/123:20:231
2500852210,0sleep10-21swapper/123:10:141
2500301210,0sleep20-21swapper/223:07:282
2500114210,1sleep00-21swapper/023:05:490
2500062210,0sleep10-21swapper/123:05:211
2496850210,0sleep10-21swapper/123:00:131
2495007210,0sleep10-21swapper/122:55:181
2494293210,0sleep00-21swapper/022:55:130
2494009210,0sleep10-21swapper/122:54:451
2493920210,1sleep20-21swapper/222:53:582
2493619210,1sleep00-21swapper/022:51:200
2491590210,0sleep10-21swapper/122:46:521
2491012210,0sleep00-21swapper/022:45:190
2489865210,0sleep20-21swapper/222:45:012
2488861210,0sleep00-21swapper/022:40:200
2488462210,0sleep10-21swapper/122:40:171
2487752210,0sleep20-21swapper/222:40:022
2486446210,0sleep20-21swapper/222:35:172
2486356210,0sleep10-21swapper/122:35:161
2486148210,0sleep00-21swapper/022:35:150
2485384210,0sleep00-21swapper/022:32:350
2484356210,0sleep20-21swapper/222:30:162
2483158210,0sleep10-21swapper/122:26:241
2483125210,0sleep20-21swapper/222:26:092
2481175210,0sleep10-21swapper/122:22:231
2480411210,0sleep20-21swapper/222:20:202
2480096210,0sleep00-21swapper/022:20:180
2477765210,0sleep20-21swapper/222:15:152
2477658210,0sleep10-21swapper/122:15:151
2475472210,0sleep00-21swapper/022:10:130
2473478210,0sleep20-21swapper/222:05:152
2473337210,0sleep10-21swapper/122:05:021
2472525210,0sleep10-21swapper/122:02:181
2471004210,0sleep20-21swapper/222:00:112
2470730210,0sleep00-21swapper/022:00:010
2470536210,0sleep20-21swapper/221:58:182
2470285210,1sleep00-21swapper/021:56:080
2468903210,0sleep10-21swapper/121:55:131
2467825210,0sleep10-21swapper/121:50:211
2466803210,0sleep00-21swapper/021:50:120
2465461210,0sleep20-21swapper/221:45:182
2465247210,0sleep10-21swapper/121:45:171
2465153210,0sleep00-21swapper/021:45:150
2464270210,0sleep20-21swapper/221:43:212
2462930210,0sleep10-21swapper/121:40:161
2460952210,0sleep00-21swapper/021:35:160
2460572210,0sleep20-21swapper/221:35:052
2459925210,0sleep00-21swapper/021:30:380
2459033210,0sleep20-21swapper/221:30:172
2458760210,0sleep10-21swapper/121:30:151
2456606210,0sleep20-21swapper/221:25:122
2456596210,0sleep10-21swapper/121:25:071
2456107210,0sleep10-21swapper/121:22:281
2455410210,0sleep20-21swapper/221:20:212
2452674210,0sleep20-21swapper/221:15:122
2452614210,0sleep10-21swapper/121:15:111
2451947210,0sleep10-21swapper/121:10:341
2451795210,0sleep20-21swapper/221:10:232
2450785210,0sleep00-21swapper/021:10:170
2450023210,0sleep00-21swapper/021:05:330
2449176210,0sleep20-21swapper/221:05:202
2449088210,0sleep10-21swapper/121:05:191
2447259210,0sleep20-21swapper/221:00:152
2444785210,0sleep20-21swapper/220:55:142
2444641210,0sleep10-21swapper/120:55:141
2443228210,0sleep20-21swapper/220:50:192
2442944210,0sleep00-21swapper/020:50:160
2440677210,0sleep20-21swapper/220:45:142
2440541210,0sleep10-21swapper/120:45:131
2440512210,0sleep00-21swapper/020:45:120
2440263210,0sleep20-21swapper/220:44:592
2439032210,0sleep00-21swapper/020:40:160
2438601210,0sleep10-21swapper/120:40:131
2435182210,0sleep00-21swapper/020:30:190
2434786210,0sleep20-21swapper/220:30:172
2434757210,0sleep10-21swapper/120:30:161
2431364210,0sleep20-21swapper/220:20:122
2431012210,0sleep00-21swapper/020:20:100
2429700210,0sleep10-21swapper/120:15:151
2429700210,0sleep10-21swapper/120:15:151
2429025210,0sleep00-21swapper/020:15:110
2429025210,0sleep00-21swapper/020:15:100
2428413210,0sleep20-21swapper/220:11:402
2428067210,0sleep10-21swapper/120:11:231
2427024210,0sleep00-21swapper/020:10:100
2426621210,1sleep00-21swapper/020:07:580
2426146211,0sleep2451ktimers/220:04:512
2425859210,1sleep10-21swapper/120:01:061
2424652210,1sleep00-21swapper/019:51:410
2423000210,1sleep20-21swapper/219:39:272
2420238210,1sleep00-21swapper/019:15:460
2536460200,0sleep10-21swapper/100:35:031
2530196200,0sleep10-21swapper/100:20:021
2529940200,0sleep00-21swapper/000:20:010
2525760200,0sleep10-21swapper/100:10:021
2523905200,0sleep20-21swapper/200:05:022
2515271200,0sleep20-21swapper/223:45:022
2509213200,0sleep10-21swapper/123:30:031
2505037200,0sleep20-21swapper/223:20:042
2502924200,0sleep10-21swapper/123:15:021
2500597200,0sleep00-21swapper/023:10:020
2496386200,0sleep20-21swapper/223:00:022
2494276200,0sleep20-21swapper/222:55:022
2483809200,0sleep10-21swapper/122:30:031
2475425200,0sleep10-21swapper/122:10:021
2466782200,0sleep20-21swapper/221:50:022
2446267200,0sleep10-21swapper/121:00:021
2444591200,0sleep00-21swapper/020:55:050
2436656200,0sleep10-21swapper/120:35:041
2432828200,0sleep10-21swapper/120:25:041
2432827200,0sleep00-21swapper/020:25:030
2430914200,0sleep10-21swapper/120:20:031
2428927200,0sleep20-21swapper/220:15:052
2428927200,0sleep20-21swapper/220:15:042
2426395200,0sleep20-21swapper/220:05:032
2426394200,0sleep10-21swapper/120:05:031
2425523200,0sleep00-21swapper/020:00:010
2425143200,0sleep20-21swapper/219:55:032
2425142200,0sleep10-21swapper/119:55:021
2424910200,0sleep00-21swapper/019:55:010
2424529200,0sleep20-21swapper/219:50:032
2424296200,0sleep10-21swapper/119:50:021
2423918200,0sleep00-21swapper/019:45:040
2423915200,0sleep20-21swapper/219:45:022
2423683200,0sleep10-21swapper/119:45:011
2423304200,0sleep00-21swapper/019:40:050
2423301200,0sleep20-21swapper/219:40:022
2423046200,0sleep10-21swapper/119:40:011
2422669200,0sleep10-21swapper/119:35:051
2422668200,0sleep00-21swapper/019:35:030
2422053200,0sleep00-21swapper/019:30:030
2421816200,0sleep20-21swapper/219:30:012
2421438200,0sleep10-21swapper/119:25:051
2421437200,0sleep00-21swapper/019:25:040
2421202200,0sleep20-21swapper/219:25:012
2420823200,0sleep10-21swapper/119:20:041
2420822200,0sleep00-21swapper/019:20:020
2420565200,0sleep20-21swapper/219:20:012
2420185200,0sleep20-21swapper/219:15:042
2420184200,0sleep10-21swapper/119:15:031
2419107200,0sleep20-21swapper/219:10:052
2419106200,0sleep10-21swapper/119:10:041
2419105200,0sleep00-21swapper/019:10:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional