You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 04:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Dec 25, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
308412203187,11sleep30-21swapper/319:06:583
307272203187,12sleep10-21swapper/119:05:311
310392189173,12sleep00-21swapper/019:09:310
31073211499,11sleep20-21swapper/219:09:582
50452470,0sleep10-21swapper/122:35:121
80752420,0sleep08028-21gltestperf21:35:150
312529971,3cyclictest7178-21munin-run22:40:010
312529971,1cyclictest3-21ksoftirqd/022:45:180
312529971,1cyclictest0-21swapper/020:10:010
312529971,1cyclictest0-21swapper/019:15:000
312529971,0cyclictest0-21swapper/021:20:010
312529970,1cyclictest3-21ksoftirqd/021:20:130
312529970,1cyclictest14357-21latency_hist19:40:000
312529970,1cyclictest0-21swapper/019:45:180
312529964,1cyclictest3-21ksoftirqd/020:45:210
312529964,1cyclictest3-21ksoftirqd/020:45:200
312529964,0cyclictest3-21ksoftirqd/000:20:170
312529962,1cyclictest3-21ksoftirqd/023:05:130
312529962,1cyclictest3-21ksoftirqd/021:00:130
312529962,1cyclictest3-21ksoftirqd/019:25:120
312529961,3cyclictest3-21ksoftirqd/000:05:130
312529961,2cyclictest0-21swapper/000:00:150
312529961,1cyclictest3-21ksoftirqd/021:50:190
312529961,1cyclictest3-21ksoftirqd/021:45:170
312529961,1cyclictest3-21ksoftirqd/021:30:200
312529961,1cyclictest3-21ksoftirqd/020:00:190
312529961,1cyclictest3-21ksoftirqd/019:30:140
312529961,1cyclictest27294-21apt-get21:10:130
312529961,1cyclictest0-21swapper/020:50:220
312529961,0cyclictest0-21swapper/023:20:160
312529960,2cyclictest0-21swapper/023:10:190
312529960,1cyclictest3-21ksoftirqd/023:45:120
312529960,1cyclictest3-21ksoftirqd/022:05:160
312529960,1cyclictest3-21ksoftirqd/022:00:150
312529960,1cyclictest3-21ksoftirqd/020:30:010
312529960,1cyclictest3-21ksoftirqd/019:50:110
312529960,1cyclictest3-21ksoftirqd/019:40:140
312529960,1cyclictest3-21ksoftirqd/000:35:160
312529960,1cyclictest3-21ksoftirqd/000:30:160
312529960,1cyclictest0-21swapper/023:20:010
312669951,4cyclictest1386-21kworker/3:020:40:103
312669950,5cyclictest29402-21/usr/sbin/munin20:10:133
312669950,5cyclictest0-21swapper/323:17:303
312669950,5cyclictest0-21swapper/322:30:153
312619950,5cyclictest0-21swapper/220:30:182
312619950,4cyclictest0-21swapper/222:25:022
312579951,2cyclictest0-21swapper/119:50:101
312579951,2cyclictest0-21swapper/100:10:131
312579950,5cyclictest0-21swapper/123:40:141
312529955,0cyclictest41ktimersoftd/022:50:200
312529954,0cyclictest3-21ksoftirqd/022:20:000
312529952,1cyclictest3-21ksoftirqd/022:10:110
312529951,2cyclictest31881-21apt-get20:15:110
312529951,1cyclictest3-21ksoftirqd/023:50:170
312529951,1cyclictest3-21ksoftirqd/022:15:140
312529951,1cyclictest3-21ksoftirqd/021:55:180
312529951,1cyclictest3-21ksoftirqd/021:05:190
312529951,1cyclictest3-21ksoftirqd/019:20:130
312529951,1cyclictest3-21ksoftirqd/000:15:130
312529951,1cyclictest3-21ksoftirqd/000:10:140
312529950,4cyclictest4986-21sort23:40:130
312529950,2cyclictest3-21ksoftirqd/022:25:100
312529950,1cyclictest3-21ksoftirqd/023:55:010
312529950,1cyclictest3-21ksoftirqd/023:35:130
312529950,1cyclictest3-21ksoftirqd/022:40:120
312529950,1cyclictest3-21ksoftirqd/022:30:190
312529950,1cyclictest3-21ksoftirqd/020:35:130
312529950,1cyclictest3-21ksoftirqd/020:25:130
312529950,1cyclictest3-21ksoftirqd/019:10:110
312529950,1cyclictest0-21swapper/023:30:190
312529950,1cyclictest0-21swapper/022:59:560
312529950,0cyclictest0-21swapper/020:20:000
312669944,0cyclictest0-21swapper/322:55:233
312669943,1cyclictest462-21rs:main3
312669942,1cyclictest0-21swapper/321:00:123
312669941,3cyclictest774-21snmpd00:04:193
312669941,2cyclictest12037-21cut19:35:013
312669941,2cyclictest0-21swapper/322:00:123
312669941,2cyclictest0-21swapper/319:50:113
312669941,1cyclictest0-21swapper/319:20:113
312669940,4cyclictest19234-21sshd21:58:213
312669940,4cyclictest0-21swapper/323:50:113
312669940,4cyclictest0-21swapper/323:33:203
312669940,4cyclictest0-21swapper/323:25:133
312669940,4cyclictest0-21swapper/323:07:093
312669940,4cyclictest0-21swapper/322:05:103
312669940,4cyclictest0-21swapper/321:40:123
312669940,4cyclictest0-21swapper/321:15:083
312669940,4cyclictest0-21swapper/321:10:133
312669940,4cyclictest0-21swapper/321:05:123
312669940,4cyclictest0-21swapper/320:20:103
312669940,4cyclictest0-21swapper/319:35:113
312669940,4cyclictest0-21swapper/319:10:113
312669940,4cyclictest0-21swapper/300:10:123
312669940,3cyclictest30894-21ntp_states00:30:173
312669940,3cyclictest29655-21dpkg22:20:013
312669940,3cyclictest29358-21sort20:10:013
312669940,3cyclictest20585-21perl20:55:133
312669940,3cyclictest19791-21sed20:55:013
312669940,3cyclictest15310-21perl19:40:143
312669940,1cyclictest8381-21sed21:35:183
312619941,2cyclictest0-21swapper/222:15:102
312619941,2cyclictest0-21swapper/220:35:122
312619941,1cyclictest0-21swapper/221:25:102
312619941,1cyclictest0-21swapper/220:55:112
312619940,4cyclictest0-21swapper/223:40:122
312619940,4cyclictest0-21swapper/221:30:122
312619940,4cyclictest0-21swapper/220:00:132
312619940,4cyclictest0-21swapper/219:15:122
312619940,4cyclictest0-21swapper/200:05:122
312619940,3cyclictest8315-21head19:25:142
312619940,3cyclictest27819-21df_inode21:10:152
312619940,3cyclictest19600-21date22:00:012
312619940,3cyclictest17380-21apt-get20:50:022
312619940,3cyclictest17208-21cat23:00:002
312619940,3cyclictest1293-21munin-node19:15:012
312619940,3cyclictest1046-21timerandwakeup20:15:202
312619940,3cyclictest10414-21diskstats22:45:142
312619940,1cyclictest7777-21cut22:40:132
312619940,1cyclictest5455-21diskstats22:35:132
312619940,1cyclictest21548-21sed00:10:222
312579942,1cyclictest0-21swapper/121:50:121
312579941,2cyclictest0-21swapper/123:45:111
312579941,2cyclictest0-21swapper/123:25:141
312579941,2cyclictest0-21swapper/123:00:111
312579941,2cyclictest0-21swapper/122:55:121
312579941,2cyclictest0-21swapper/122:50:131
312579941,2cyclictest0-21swapper/122:30:151
312579941,2cyclictest0-21swapper/122:20:111
312579941,2cyclictest0-21swapper/122:10:111
312579941,2cyclictest0-21swapper/121:55:111
312579941,2cyclictest0-21swapper/121:45:111
312579941,2cyclictest0-21swapper/121:05:131
312579941,2cyclictest0-21swapper/120:45:121
312579941,2cyclictest0-21swapper/120:45:121
312579941,2cyclictest0-21swapper/120:20:121
312579941,2cyclictest0-21swapper/120:15:111
312579941,2cyclictest0-21swapper/120:05:141
312579941,2cyclictest0-21swapper/119:55:121
312579941,2cyclictest0-21swapper/119:25:111
312579941,1cyclictest0-21swapper/119:45:121
312579940,4cyclictest0-21swapper/119:35:211
312579940,2cyclictest0-21swapper/123:30:131
312579940,2cyclictest0-21swapper/120:55:101
312579940,2cyclictest0-21swapper/120:10:111
312529943,0cyclictest3-21ksoftirqd/021:25:130
312529941,2cyclictest3-21ksoftirqd/023:25:130
312529941,1cyclictest3-21ksoftirqd/020:55:110
312529941,1cyclictest3-21ksoftirqd/020:40:110
312529940,3cyclictest9731-21apt21:40:120
312529940,3cyclictest30100-21perl20:10:150
312529940,2cyclictest3-21ksoftirqd/023:00:000
312529940,2cyclictest3-21ksoftirqd/019:55:140
312529940,0cyclictest0-21swapper/000:25:120
312669932,1cyclictest774-21snmpd21:50:023
312669932,1cyclictest774-21snmpd21:20:073
312669931,1cyclictest0-21swapper/321:25:123
312669931,1cyclictest0-21swapper/300:25:123
312669930,3cyclictest7770-21fschecks_time19:25:133
312669930,3cyclictest5215-21df_inode23:40:143
312669930,3cyclictest22504-21tr00:15:113
312669930,3cyclictest1555-21df19:15:003
312669930,3cyclictest14722-21munin-node20:45:123
312669930,3cyclictest14722-21munin-node20:45:113
312669930,3cyclictest0-21swapper/323:55:023
312669930,3cyclictest0-21swapper/323:45:103
312669930,3cyclictest0-21swapper/323:35:123
312669930,3cyclictest0-21swapper/323:00:123
312669930,3cyclictest0-21swapper/322:50:133
312669930,3cyclictest0-21swapper/322:45:113
312669930,3cyclictest0-21swapper/322:40:113
312669930,3cyclictest0-21swapper/322:35:123
312669930,3cyclictest0-21swapper/322:25:013
312669930,3cyclictest0-21swapper/322:15:113
312669930,3cyclictest0-21swapper/322:10:113
312669930,3cyclictest0-21swapper/321:45:163
312669930,3cyclictest0-21swapper/321:30:133
312669930,3cyclictest0-21swapper/320:30:123
312669930,3cyclictest0-21swapper/320:25:133
312669930,3cyclictest0-21swapper/320:15:113
312669930,3cyclictest0-21swapper/320:00:133
312669930,3cyclictest0-21swapper/319:55:143
312669930,3cyclictest0-21swapper/319:45:123
312669930,3cyclictest0-21swapper/300:35:093
312669930,3cyclictest0-21swapper/300:20:103
312669930,3cyclictest0-21swapper/300:05:043
312669930,2cyclictest27194-21latency_hist23:20:013
312669930,1cyclictest0-21swapper/323:10:113
312619932,1cyclictest15214-21expr00:00:152
312619931,1cyclictest4623-21apt-get20:25:122
312619931,1cyclictest0-21swapper/223:30:122
312619931,1cyclictest0-21swapper/221:45:102
312619931,1cyclictest0-21swapper/219:35:122
312619931,1cyclictest0-21swapper/219:20:112
312619930,3cyclictest32106-21apt-get00:35:102
312619930,3cyclictest30257-21df_inode22:20:142
312619930,3cyclictest27143-21date00:25:012
312619930,3cyclictest25818-21ntpq22:10:162
312619930,3cyclictest22101-21apt-get22:05:112
312619930,3cyclictest20297-21df23:05:132
312619930,3cyclictest15100-21diskstats19:40:132
312619930,3cyclictest0-21swapper/223:55:002
312619930,3cyclictest0-21swapper/223:50:102
312619930,3cyclictest0-21swapper/223:45:112
312619930,3cyclictest0-21swapper/223:35:302
312619930,3cyclictest0-21swapper/223:26:232
312619930,3cyclictest0-21swapper/223:20:112
312619930,3cyclictest0-21swapper/223:15:042
312619930,3cyclictest0-21swapper/223:10:112
312619930,3cyclictest0-21swapper/223:00:122
312619930,3cyclictest0-21swapper/222:50:122
312619930,3cyclictest0-21swapper/222:30:142
312619930,3cyclictest0-21swapper/222:00:142
312619930,3cyclictest0-21swapper/221:50:112
312619930,3cyclictest0-21swapper/221:40:132
312619930,3cyclictest0-21swapper/221:35:132
312619930,3cyclictest0-21swapper/221:20:112
312619930,3cyclictest0-21swapper/221:15:132
312619930,3cyclictest0-21swapper/221:05:052
312619930,3cyclictest0-21swapper/221:00:122
312619930,3cyclictest0-21swapper/220:45:002
312619930,3cyclictest0-21swapper/220:45:002
312619930,3cyclictest0-21swapper/220:40:102
312619930,3cyclictest0-21swapper/220:20:022
312619930,3cyclictest0-21swapper/220:10:112
312619930,3cyclictest0-21swapper/220:05:132
312619930,3cyclictest0-21swapper/219:55:132
312619930,3cyclictest0-21swapper/219:50:112
312619930,3cyclictest0-21swapper/219:45:112
312619930,3cyclictest0-21swapper/219:30:102
312619930,3cyclictest0-21swapper/200:30:132
312619930,3cyclictest0-21swapper/200:20:092
312619930,3cyclictest0-21swapper/200:15:042
312579933,0cyclictest0-21swapper/119:20:131
312579932,1cyclictest0-21swapper/121:30:121
312579931,1cyclictest0-21swapper/123:55:021
312579931,1cyclictest0-21swapper/123:50:121
312579931,1cyclictest0-21swapper/123:35:121
312579931,1cyclictest0-21swapper/123:10:121
312579931,1cyclictest0-21swapper/123:05:121
312579931,1cyclictest0-21swapper/122:45:001
312579931,1cyclictest0-21swapper/122:25:111
312579931,1cyclictest0-21swapper/121:35:121
312579931,1cyclictest0-21swapper/121:20:111
312579931,1cyclictest0-21swapper/121:15:121
312579931,1cyclictest0-21swapper/121:10:121
312579931,1cyclictest0-21swapper/120:50:131
312579931,1cyclictest0-21swapper/120:40:101
312579931,1cyclictest0-21swapper/120:35:111
312579931,1cyclictest0-21swapper/120:30:121
312579931,1cyclictest0-21swapper/120:25:131
312579931,1cyclictest0-21swapper/119:15:121
312579931,1cyclictest0-21swapper/119:10:101
312579931,1cyclictest0-21swapper/100:30:131
312579931,1cyclictest0-21swapper/100:25:111
312579931,1cyclictest0-21swapper/100:20:091
312579931,1cyclictest0-21swapper/100:05:111
312579930,3cyclictest0-21swapper/123:20:271
312579930,3cyclictest0-21swapper/121:27:161
312579930,3cyclictest0-21swapper/100:17:121
312579930,2cyclictest320932sleep100:35:031
312579930,2cyclictest0-21swapper/123:15:121
312579930,2cyclictest0-21swapper/122:45:121
312579930,2cyclictest0-21swapper/122:05:121
312579930,2cyclictest0-21swapper/122:00:131
312579930,2cyclictest0-21swapper/121:40:131
312579930,2cyclictest0-21swapper/119:30:091
312579930,0cyclictest0-21swapper/119:43:221
312579921,1cyclictest0-21swapper/122:15:101
312579921,1cyclictest0-21swapper/100:00:141
312579920,1cyclictest0-21swapper/121:00:131
312579920,1cyclictest0-21swapper/120:00:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional