You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 23:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Mon Dec 29, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253412239223,11sleep10-21swapper/107:06:221
254672189174,11sleep30-21swapper/307:08:013
253352184168,12sleep00-21swapper/007:06:170
254462182165,12sleep20-21swapper/207:07:432
258379981,1cyclictest15116-21awk11:05:150
258379981,1cyclictest13983-21dump-pmu-power08:54:590
258379980,7cyclictest16960-21tr09:00:120
258379980,7cyclictest0-21swapper/011:35:120
258379980,3cyclictest0-21swapper/012:05:000
258379980,2cyclictest9249-21latency_hist09:50:010
258379980,1cyclictest28997-21apt10:30:000
258379980,1cyclictest28763-21munin-run11:35:000
258379980,1cyclictest26524-21apt10:25:000
258379980,1cyclictest21329-21munin-run11:20:000
258379980,1cyclictest16760-21/usr/sbin/munin12:15:190
258379980,1cyclictest1614-21munin-run08:30:000
258509971,3cyclictest0-21swapper/110:00:131
258379972,1cyclictest16810-21cut07:55:130
258379972,0cyclictest8986-21sort12:00:000
258379971,3cyclictest16346-21awk12:15:000
258379971,1cyclictest774-21snmpd11:47:160
258379971,1cyclictest774-21snmpd11:42:160
258379971,1cyclictest774-21snmpd10:35:310
258379971,1cyclictest774-21snmpd09:53:550
258379971,1cyclictest774-21snmpd09:36:160
258379971,1cyclictest774-21snmpd09:13:280
258379971,1cyclictest774-21snmpd08:46:090
258379971,1cyclictest774-21snmpd08:37:420
258379971,1cyclictest774-21snmpd08:24:330
258379971,1cyclictest774-21snmpd08:17:150
258379971,1cyclictest774-21snmpd08:08:380
258379971,1cyclictest28397-21cat07:15:000
258379971,1cyclictest2755-21cat08:30:170
258379971,1cyclictest25266-21cat08:10:160
258379971,1cyclictest22463-21fw_packets12:25:130
258379971,1cyclictest10989-21unixbench_singl10:55:230
258379971,1cyclictest0-21swapper/009:40:130
258379970,7cyclictest0-21swapper/010:45:130
258379970,3cyclictest0-21swapper/009:15:130
258379970,3cyclictest0-21swapper/007:30:120
258379970,2cyclictest921-21timerandwakeup09:30:220
258379970,2cyclictest24634-21ls12:30:130
258379970,2cyclictest21626-21basename09:10:010
258379970,1cyclictest7326-21df_inode08:40:150
258379970,1cyclictest22095-21df11:20:130
258379970,1cyclictest20087-21hddtemp_smartct12:20:140
258379970,1cyclictest1886-21/usr/sbin/munin07:25:150
258379970,1cyclictest17447-21hddtemp_smartct11:10:140
258379970,1cyclictest15772-21sensors_temp07:50:180
258379970,1cyclictest14911-21df10:00:140
258379970,1cyclictest14135-21munin-run10:00:000
258379970,1cyclictest14030-21munin-run07:49:590
258379970,1cyclictest13856-21munin-run12:10:000
258379970,1cyclictest10587-21ntp_states07:40:180
258379970,0cyclictest0-21swapper/008:00:200
258509961,3cyclictest0-21swapper/112:05:111
258509961,3cyclictest0-21swapper/111:20:121
258509961,3cyclictest0-21swapper/110:05:121
258379961,1cyclictest32428-21grep07:20:140
258379960,1cyclictest7359-21diskstats07:35:120
258379960,1cyclictest6904-21grep10:50:110
258379960,1cyclictest4711-21df11:50:140
258379960,1cyclictest30549-21ntp_states09:25:170
258379960,1cyclictest30549-21ntp_states09:25:170
258379960,1cyclictest29764-21diskstats10:30:160
258379960,1cyclictest29301-21ntp_states07:15:010
258379960,1cyclictest27905-21/usr/sbin/munin12:35:170
258379960,1cyclictest27341-21diskstats09:20:130
258379960,1cyclictest2616-21/usr/sbin/munin10:40:170
258379960,1cyclictest24563-21df11:25:140
258379960,1cyclictest22535-21perl10:15:150
258379960,1cyclictest19850-21df_inode10:10:140
258379960,1cyclictest17691-21hddtemp_smartct10:05:150
258379960,1cyclictest14958-21fw_packets08:55:150
258379960,1cyclictest12758-21load11:00:190
258609954,1cyclictest14256-21kworker/3:011:33:333
258609950,0cyclictest0-21swapper/312:15:013
258559954,1cyclictest31-21ksoftirqd/209:00:002
258559950,5cyclictest0-21swapper/208:00:202
258509952,2cyclictest0-21swapper/108:45:111
258509951,3cyclictest0-21swapper/111:15:101
258509951,3cyclictest0-21swapper/109:50:131
258509951,3cyclictest0-21swapper/109:40:131
258509951,3cyclictest0-21swapper/108:55:131
258509951,2cyclictest0-21swapper/111:30:121
258509951,2cyclictest0-21swapper/111:10:111
258509951,2cyclictest0-21swapper/111:05:101
258509951,2cyclictest0-21swapper/111:00:141
258509951,2cyclictest0-21swapper/109:55:121
258509951,2cyclictest0-21swapper/109:25:121
258509951,2cyclictest0-21swapper/109:25:111
258509951,2cyclictest0-21swapper/108:20:111
258509951,2cyclictest0-21swapper/107:35:111
258509950,5cyclictest0-21swapper/108:53:351
258609944,0cyclictest14256-21kworker/3:012:07:073
258609944,0cyclictest14256-21kworker/3:011:20:533
258609944,0cyclictest0-21swapper/311:15:393
258609943,1cyclictest23605-21sed09:10:213
258609943,1cyclictest11966-21cpuspeed08:50:123
258609942,1cyclictest774-21snmpd09:58:373
258609942,1cyclictest774-21snmpd09:20:343
258609942,1cyclictest774-21snmpd08:20:063
258609942,1cyclictest22929-21ntpq08:05:173
258609942,1cyclictest10999-21vmstat12:00:233
258609941,3cyclictest774-21snmpd09:39:223
258609940,4cyclictest0-21swapper/311:50:133
258609940,4cyclictest0-21swapper/311:25:243
258609940,4cyclictest0-21swapper/311:00:143
258609940,4cyclictest0-21swapper/309:30:133
258609940,4cyclictest0-21swapper/309:05:163
258609940,4cyclictest0-21swapper/309:04:463
258609940,4cyclictest0-21swapper/308:55:133
258609940,4cyclictest0-21swapper/307:50:113
258609940,3cyclictest9082-21sed12:00:003
258609940,3cyclictest28352-21latency_hist07:15:003
258609940,3cyclictest19214-21cat10:10:003
258609940,3cyclictest1486-21latency_hist11:45:003
258609940,3cyclictest14680-21fschecks_count12:10:143
258609940,3cyclictest14017-21latency_hist07:50:003
258609940,3cyclictest0-21swapper/310:55:143
258609940,3cyclictest0-21swapper/307:30:123
258559944,0cyclictest16728-21apt-get07:55:122
258559944,0cyclictest0-21swapper/209:19:572
258559941,1cyclictest0-21swapper/211:40:142
258559940,4cyclictest16859-21apt-get10:05:122
258559940,4cyclictest11901-21apt-get09:55:122
258559940,4cyclictest0-21swapper/209:45:022
258559940,4cyclictest0-21swapper/208:50:112
258559940,4cyclictest0-21swapper/208:35:112
258559940,4cyclictest0-21swapper/208:10:012
258559940,4cyclictest0-21swapper/208:05:122
258559940,4cyclictest0-21swapper/207:40:122
258559940,3cyclictest9986-21hddtemp_smartct12:00:172
258559940,3cyclictest9067-21munin-run07:40:002
258559940,3cyclictest32566-21perl07:20:152
258559940,3cyclictest32282-21diskstats09:30:152
258559940,3cyclictest26813-21apt-get09:20:122
258559940,3cyclictest26640-21cat12:35:012
258559940,3cyclictest24035-21dump-pmu-power10:20:002
258559940,3cyclictest2247-21df_inode11:45:132
258559940,3cyclictest20989-21grep10:10:212
258559940,3cyclictest16516-21cat12:15:012
258559940,3cyclictest14389-21/usr/sbin/munin10:00:142
258559940,3cyclictest11618-21wc11:00:002
258559940,1cyclictest22552-21hddtemp_smartct12:25:132
258509941,2cyclictest0-21swapper/112:15:131
258509941,2cyclictest0-21swapper/111:55:111
258509941,2cyclictest0-21swapper/111:25:131
258509941,2cyclictest0-21swapper/110:50:101
258509941,2cyclictest0-21swapper/110:40:141
258509941,2cyclictest0-21swapper/110:35:111
258509941,2cyclictest0-21swapper/110:30:141
258509941,2cyclictest0-21swapper/110:25:131
258509941,2cyclictest0-21swapper/110:15:121
258509941,2cyclictest0-21swapper/109:45:121
258509941,2cyclictest0-21swapper/108:25:121
258509941,2cyclictest0-21swapper/108:05:121
258509941,2cyclictest0-21swapper/108:00:111
258509941,2cyclictest0-21swapper/107:45:121
258509941,2cyclictest0-21swapper/107:25:121
258509941,2cyclictest0-21swapper/107:20:121
258509940,2cyclictest0-21swapper/110:10:121
258509940,1cyclictest0-21swapper/107:15:121
258609933,0cyclictest40-21ksoftirqd/308:10:003
258609933,0cyclictest40-21ksoftirqd/307:15:003
258609932,1cyclictest774-21snmpd07:40:113
258609932,1cyclictest774-21snmpd07:20:113
258609931,1cyclictest6820-21dpkg09:45:013
258609931,1cyclictest0-21swapper/310:50:103
258609930,3cyclictest9909-21cstates09:50:143
258609930,3cyclictest4975-21perl10:45:143
258609930,3cyclictest26765-21apt-get10:25:133
258609930,3cyclictest0-21swapper/312:35:123
258609930,3cyclictest0-21swapper/312:30:423
258609930,3cyclictest0-21swapper/312:25:103
258609930,3cyclictest0-21swapper/312:20:123
258609930,3cyclictest0-21swapper/311:45:113
258609930,3cyclictest0-21swapper/311:35:113
258609930,3cyclictest0-21swapper/311:10:113
258609930,3cyclictest0-21swapper/311:05:113
258609930,3cyclictest0-21swapper/310:40:143
258609930,3cyclictest0-21swapper/310:35:133
258609930,3cyclictest0-21swapper/310:31:173
258609930,3cyclictest0-21swapper/310:20:103
258609930,3cyclictest0-21swapper/310:15:023
258609930,3cyclictest0-21swapper/310:10:103
258609930,3cyclictest0-21swapper/310:00:013
258609930,3cyclictest0-21swapper/309:40:133
258609930,3cyclictest0-21swapper/309:25:063
258609930,3cyclictest0-21swapper/309:25:063
258609930,3cyclictest0-21swapper/309:15:043
258609930,3cyclictest0-21swapper/308:45:113
258609930,3cyclictest0-21swapper/308:40:143
258609930,3cyclictest0-21swapper/308:35:043
258609930,3cyclictest0-21swapper/308:30:143
258609930,3cyclictest0-21swapper/308:25:123
258609930,3cyclictest0-21swapper/308:15:013
258609930,3cyclictest0-21swapper/308:00:113
258609930,3cyclictest0-21swapper/307:55:013
258609930,3cyclictest0-21swapper/307:35:113
258609930,3cyclictest0-21swapper/307:25:123
258559932,1cyclictest774-21snmpd10:20:012
258559931,1cyclictest9826-21grep08:45:132
258559931,1cyclictest774-21snmpd12:35:012
258559931,1cyclictest0-21swapper/209:00:112
258559930,3cyclictest6201-21users07:30:212
258559930,3cyclictest4189-21/usr/sbin/munin11:50:132
258559930,3cyclictest31796-21apt08:25:122
258559930,3cyclictest2318-21df09:35:132
258559930,3cyclictest2299-21diskstats10:40:152
258559930,3cyclictest21688-21grep11:20:122
258559930,3cyclictest1957-21grep08:30:142
258559930,3cyclictest19251-21apt12:20:122
258559930,3cyclictest0-21swapper/212:15:132
258559930,3cyclictest0-21swapper/212:05:102
258559930,3cyclictest0-21swapper/211:55:112
258559930,3cyclictest0-21swapper/211:35:122
258559930,3cyclictest0-21swapper/211:30:122
258559930,3cyclictest0-21swapper/211:25:122
258559930,3cyclictest0-21swapper/211:15:102
258559930,3cyclictest0-21swapper/211:05:112
258559930,3cyclictest0-21swapper/211:00:142
258559930,3cyclictest0-21swapper/210:50:102
258559930,3cyclictest0-21swapper/210:45:112
258559930,3cyclictest0-21swapper/210:35:062
258559930,3cyclictest0-21swapper/210:30:142
258559930,3cyclictest0-21swapper/210:25:132
258559930,3cyclictest0-21swapper/209:50:122
258559930,3cyclictest0-21swapper/209:40:132
258559930,3cyclictest0-21swapper/209:25:112
258559930,3cyclictest0-21swapper/209:25:112
258559930,3cyclictest0-21swapper/209:10:122
258559930,3cyclictest0-21swapper/209:05:112
258559930,3cyclictest0-21swapper/208:40:042
258559930,3cyclictest0-21swapper/208:20:112
258559930,3cyclictest0-21swapper/208:15:122
258559930,3cyclictest0-21swapper/207:45:042
258559930,3cyclictest0-21swapper/207:25:132
258559930,3cyclictest0-21swapper/207:15:002
258559930,3cyclictest0-21swapper/207:10:012
258559930,2cyclictest14237-21date07:50:002
258559930,2cyclictest0-21swapper/211:10:112
258509933,0cyclictest0-21swapper/109:16:181
258509931,1cyclictest0-21swapper/112:35:111
258509931,1cyclictest0-21swapper/112:25:101
258509931,1cyclictest0-21swapper/112:20:121
258509931,1cyclictest0-21swapper/112:10:121
258509931,1cyclictest0-21swapper/111:50:131
258509931,1cyclictest0-21swapper/111:45:111
258509931,1cyclictest0-21swapper/109:35:131
258509931,1cyclictest0-21swapper/109:20:121
258509931,1cyclictest0-21swapper/109:10:121
258509931,1cyclictest0-21swapper/109:05:111
258509931,1cyclictest0-21swapper/109:00:011
258509931,1cyclictest0-21swapper/108:40:141
258509931,1cyclictest0-21swapper/108:30:141
258509931,1cyclictest0-21swapper/108:15:121
258509931,1cyclictest0-21swapper/108:10:011
258509931,1cyclictest0-21swapper/107:40:121
258509931,1cyclictest0-21swapper/107:30:121
258509931,1cyclictest0-21swapper/107:10:011
258509930,3cyclictest0-21swapper/112:01:181
258509930,2cyclictest0-21swapper/110:20:101
258509930,2cyclictest0-21swapper/109:30:131
258509930,2cyclictest0-21swapper/108:35:121
258509930,2cyclictest0-21swapper/107:50:111
258509930,1cyclictest0-21swapper/111:35:121
258509921,1cyclictest0-21swapper/111:40:011
258509921,0cyclictest0-21swapper/112:30:111
258509920,1cyclictest4604-21chrt10:45:111
258509920,1cyclictest0-21swapper/110:55:141
258509920,1cyclictest0-21swapper/107:55:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional