You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 11:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Sun Dec 14, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
100872202186,11sleep10-21swapper/119:08:421
101832197162,12sleep30-21swapper/319:09:563
99442187171,12sleep00-21swapper/019:06:530
101822179163,12sleep20-21swapper/219:09:552
308972460,0sleep030899-21vmstat21:55:190
248022110,0sleep024805-21grep21:45:140
1035999102,4cyclictest23751-21grep20:40:010
103679970,6cyclictest0-21swapper/321:50:113
103609971,4cyclictest0-21swapper/119:50:121
103679965,1cyclictest40-21ksoftirqd/322:05:013
103609962,2cyclictest0-21swapper/100:05:121
9643250,0sleep30-21swapper/320:10:123
7408250,0sleep30-21swapper/300:25:133
103679952,2cyclictest774-21snmpd19:56:343
103679951,2cyclictest0-21swapper/321:15:133
103679950,5cyclictest0-21swapper/322:30:123
103679950,5cyclictest0-21swapper/319:35:143
103679950,0cyclictest0-21swapper/319:25:173
103609951,2cyclictest0-21swapper/123:55:111
103609951,2cyclictest0-21swapper/122:15:111
103609951,2cyclictest0-21swapper/121:40:111
103609951,2cyclictest0-21swapper/120:55:101
103609951,2cyclictest0-21swapper/100:25:111
103599951,1cyclictest0-21swapper/021:35:110
103599950,5cyclictest24343-21diskstats19:35:140
103599950,4cyclictest29001-21apt-get23:00:110
103599950,4cyclictest28768-21munin-run23:00:010
103679942,2cyclictest774-21snmpd21:44:083
103679942,1cyclictest774-21snmpd23:45:083
103679942,1cyclictest774-21snmpd22:05:053
103679942,1cyclictest774-21snmpd20:50:043
103679941,3cyclictest0-21swapper/300:05:113
103679941,2cyclictest0-21swapper/322:15:113
103679941,2cyclictest0-21swapper/320:30:133
103679941,2cyclictest0-21swapper/300:20:113
103679941,2cyclictest0-21swapper/300:10:113
103679940,4cyclictest14115-21apt-get23:35:013
103679940,4cyclictest12923-21ntp_kernel_pll_22:25:163
103679940,4cyclictest0-21swapper/322:40:153
103679940,4cyclictest0-21swapper/321:35:113
103679940,4cyclictest0-21swapper/321:20:123
103679940,4cyclictest0-21swapper/300:30:123
103679940,3cyclictest8987-21apt-get23:25:123
103679940,3cyclictest26474-21cat21:50:013
103679940,3cyclictest1557-21apt-get23:10:123
103679940,3cyclictest13940-21cat23:35:003
103679940,3cyclictest12518-21perl00:35:143
103679940,3cyclictest0-21swapper/323:20:123
103679940,3cyclictest0-21swapper/322:35:113
103629944,0cyclictest31-21ksoftirqd/220:25:002
103629944,0cyclictest31-21ksoftirqd/219:35:012
103629944,0cyclictest31-21ksoftirqd/219:35:012
103629943,1cyclictest14622-21cut21:25:152
103629941,2cyclictest0-21swapper/221:15:132
103629941,1cyclictest0-21swapper/222:25:102
103629941,1cyclictest0-21swapper/220:05:122
103629940,4cyclictest0-21swapper/220:40:092
103629940,4cyclictest0-21swapper/220:15:132
103629940,4cyclictest0-21swapper/219:55:102
103629940,3cyclictest6901-21df_inode21:10:122
103629940,3cyclictest3941-21cat22:10:012
103629940,3cyclictest23911-21cat20:40:002
103629940,3cyclictest19049-21cut21:35:122
103629940,3cyclictest19011-21/usr/sbin/munin20:30:172
103629940,3cyclictest16922-21cat20:25:102
103629940,3cyclictest0-21swapper/200:20:102
103629940,0cyclictest1257-21apt-get00:15:012
103609944,0cyclictest0-21swapper/120:53:251
103609942,2cyclictest0-21swapper/120:25:091
103609941,3cyclictest0-21swapper/121:50:121
103609941,2cyclictest0-21swapper/123:45:111
103609941,2cyclictest0-21swapper/123:30:091
103609941,2cyclictest0-21swapper/123:25:121
103609941,2cyclictest0-21swapper/123:20:101
103609941,2cyclictest0-21swapper/122:55:111
103609941,2cyclictest0-21swapper/122:25:111
103609941,2cyclictest0-21swapper/122:20:121
103609941,2cyclictest0-21swapper/121:45:121
103609941,2cyclictest0-21swapper/121:00:111
103609941,2cyclictest0-21swapper/120:45:131
103609941,2cyclictest0-21swapper/120:40:091
103609941,2cyclictest0-21swapper/120:35:101
103609941,2cyclictest0-21swapper/120:20:101
103609941,2cyclictest0-21swapper/119:55:011
103609941,2cyclictest0-21swapper/119:40:101
103609941,2cyclictest0-21swapper/119:25:111
103609941,2cyclictest0-21swapper/100:20:111
103609941,1cyclictest0-21swapper/122:00:111
103609940,4cyclictest0-21swapper/123:16:181
103609940,4cyclictest0-21swapper/122:49:051
103609940,4cyclictest0-21swapper/119:38:281
103609940,3cyclictest0-21swapper/121:30:101
103609940,2cyclictest0-21swapper/122:40:131
103609940,2cyclictest0-21swapper/121:35:111
103599943,1cyclictest18857-21grep22:40:010
103599940,4cyclictest0-21swapper/023:50:090
103599940,4cyclictest0-21swapper/020:45:130
103599940,4cyclictest0-21swapper/019:40:180
103599940,4cyclictest0-21swapper/000:35:120
103599940,3cyclictest8992-21cat22:20:010
103599940,3cyclictest8618-21latency_hist21:15:010
103599940,3cyclictest6384-21cat22:15:010
103599940,3cyclictest32145-21perl00:10:130
103599940,3cyclictest24024-21apt-get23:55:120
103599940,3cyclictest21582-21dpkg21:40:010
103599940,3cyclictest18208-21ls20:25:170
103599940,3cyclictest15974-21users23:35:200
103599940,1cyclictest7781-21ntp_states23:20:160
103599940,1cyclictest23964-21/usr/sbin/munin20:40:140
103599940,1cyclictest19109-21/usr/sbin/munin22:40:190
103599940,1cyclictest1554-21/usr/sbin/munin23:10:130
103599940,1cyclictest1429-21/usr/sbin/munin21:00:130
103599940,1cyclictest11454-21/usr/sbin/munin23:30:100
103679932,1cyclictest9442-21grep22:20:133
103679932,1cyclictest774-21snmpd23:15:053
103679932,1cyclictest774-21snmpd21:00:083
103679932,1cyclictest774-21snmpd20:55:043
103679932,1cyclictest774-21snmpd20:35:043
103679932,1cyclictest21577-21apt-get22:45:103
103679932,1cyclictest13047-21fschecks_count19:15:013
103679932,1cyclictest0-21swapper/319:10:073
103679931,2cyclictest12864-21kworker/3:219:20:143
103679931,1cyclictest774-21snmpd00:00:083
103679931,1cyclictest2218-21df_inode00:15:133
103679930,3cyclictest5237-21ntp_states20:00:163
103679930,3cyclictest29385-21cstates23:00:123
103679930,3cyclictest26440-21apt-get20:45:133
103679930,3cyclictest24540-21df23:55:133
103679930,3cyclictest21553-21apt-get23:50:093
103679930,3cyclictest17006-21df_inode21:30:113
103679930,3cyclictest0-21swapper/323:40:023
103679930,3cyclictest0-21swapper/323:05:113
103679930,3cyclictest0-21swapper/322:55:123
103679930,3cyclictest0-21swapper/322:50:093
103679930,3cyclictest0-21swapper/322:50:093
103679930,3cyclictest0-21swapper/322:10:103
103679930,3cyclictest0-21swapper/321:10:113
103679930,3cyclictest0-21swapper/321:05:053
103679930,3cyclictest0-21swapper/320:40:093
103679930,3cyclictest0-21swapper/320:25:113
103679930,3cyclictest0-21swapper/320:20:103
103679930,3cyclictest0-21swapper/320:15:003
103679930,3cyclictest0-21swapper/320:05:113
103679930,3cyclictest0-21swapper/319:50:113
103679930,3cyclictest0-21swapper/319:45:093
103679930,3cyclictest0-21swapper/319:40:123
103679930,3cyclictest0-21swapper/319:30:113
103679930,3cyclictest0-21swapper/319:30:113
103679930,1cyclictest0-21swapper/321:55:093
103679930,1cyclictest0-21swapper/321:25:123
103629932,1cyclictest774-21snmpd22:35:082
103629931,1cyclictest0-21swapper/223:30:092
103629931,1cyclictest0-21swapper/223:25:132
103629931,1cyclictest0-21swapper/222:50:092
103629931,1cyclictest0-21swapper/222:50:092
103629931,1cyclictest0-21swapper/222:10:102
103629931,1cyclictest0-21swapper/221:45:122
103629931,1cyclictest0-21swapper/220:50:112
103629931,1cyclictest0-21swapper/219:45:122
103629930,3cyclictest9949-21gltestperf00:30:152
103629930,3cyclictest9568-21cut20:10:122
103629930,3cyclictest7923-21ntp_states00:25:172
103629930,3cyclictest4429-21df_inode21:05:152
103629930,3cyclictest31534-21apt-get22:00:112
103629930,3cyclictest29568-21df21:55:112
103629930,3cyclictest29505-21df_inode00:05:132
103629930,3cyclictest21664-21cut23:50:112
103629930,3cyclictest19266-21grep23:45:122
103629930,3cyclictest13093-21dpkg19:15:012
103629930,3cyclictest0-21swapper/223:55:122
103629930,3cyclictest0-21swapper/223:40:042
103629930,3cyclictest0-21swapper/223:35:112
103629930,3cyclictest0-21swapper/223:20:102
103629930,3cyclictest0-21swapper/223:15:022
103629930,3cyclictest0-21swapper/223:10:122
103629930,3cyclictest0-21swapper/223:05:052
103629930,3cyclictest0-21swapper/223:00:112
103629930,3cyclictest0-21swapper/222:55:132
103629930,3cyclictest0-21swapper/222:45:102
103629930,3cyclictest0-21swapper/222:40:052
103629930,3cyclictest0-21swapper/222:30:042
103629930,3cyclictest0-21swapper/222:20:012
103629930,3cyclictest0-21swapper/222:15:112
103629930,3cyclictest0-21swapper/221:50:112
103629930,3cyclictest0-21swapper/221:40:112
103629930,3cyclictest0-21swapper/221:30:012
103629930,3cyclictest0-21swapper/221:00:122
103629930,3cyclictest0-21swapper/220:55:112
103629930,3cyclictest0-21swapper/220:45:132
103629930,3cyclictest0-21swapper/220:00:102
103629930,3cyclictest0-21swapper/219:50:112
103629930,3cyclictest0-21swapper/219:40:102
103629930,3cyclictest0-21swapper/219:35:122
103629930,3cyclictest0-21swapper/219:25:032
103629930,3cyclictest0-21swapper/219:20:112
103629930,3cyclictest0-21swapper/219:10:072
103629930,3cyclictest0-21swapper/200:35:002
103629930,3cyclictest0-21swapper/200:10:002
103629930,3cyclictest0-21swapper/200:00:102
103629930,1cyclictest0-21swapper/221:20:122
103609933,0cyclictest0-21swapper/123:11:471
103609933,0cyclictest0-21swapper/120:10:201
103609933,0cyclictest0-21swapper/100:19:441
103609931,2cyclictest0-21swapper/123:35:111
103609931,2cyclictest0-21swapper/123:00:111
103609931,2cyclictest0-21swapper/119:15:111
103609931,1cyclictest0-21swapper/123:50:091
103609931,1cyclictest0-21swapper/123:40:111
103609931,1cyclictest0-21swapper/123:05:111
103609931,1cyclictest0-21swapper/122:50:091
103609931,1cyclictest0-21swapper/122:50:091
103609931,1cyclictest0-21swapper/122:35:111
103609931,1cyclictest0-21swapper/122:30:121
103609931,1cyclictest0-21swapper/121:25:121
103609931,1cyclictest0-21swapper/121:10:111
103609931,1cyclictest0-21swapper/121:05:131
103609931,1cyclictest0-21swapper/120:30:131
103609931,1cyclictest0-21swapper/120:15:001
103609931,1cyclictest0-21swapper/119:30:111
103609931,1cyclictest0-21swapper/119:30:111
103609931,1cyclictest0-21swapper/100:35:011
103609931,1cyclictest0-21swapper/100:00:101
103609930,2cyclictest0-21swapper/122:05:121
103609930,2cyclictest0-21swapper/121:20:121
103609930,2cyclictest0-21swapper/120:05:121
103609930,2cyclictest0-21swapper/119:45:121
103609930,2cyclictest0-21swapper/119:20:101
103609930,2cyclictest0-21swapper/100:30:121
103609930,2cyclictest0-21swapper/100:10:111
103599931,2cyclictest57050irq/130-eth022:25:100
103599931,1cyclictest13264-21cut19:15:010
103599931,1cyclictest11001-21df19:10:090
103599930,3cyclictest6800-21tr20:05:130
103599930,3cyclictest5016-21hddtemp_smartct00:20:130
103599930,3cyclictest4309-21expr21:05:140
103599930,3cyclictest31521-21cat19:50:120
103599930,3cyclictest29606-21hddtemp_smartct19:45:140
103599930,3cyclictest28979-21apt00:05:110
103599930,3cyclictest28905-21apt-get20:50:110
103599930,3cyclictest27841-21ntp_states21:50:170
103599930,3cyclictest27499-21irqstats00:00:150
103599930,3cyclictest2240-21cut22:05:150
103599930,3cyclictest1998-21df19:55:120
103599930,3cyclictest16878-21grep23:40:110
103599930,3cyclictest16465-21rm21:30:010
103599930,3cyclictest14380-21grep21:25:140
103599930,3cyclictest11142-21apt-get20:15:000
103599930,3cyclictest0-21swapper/023:45:110
103599930,3cyclictest0-21swapper/023:25:120
103599930,3cyclictest0-21swapper/023:15:090
103599930,3cyclictest0-21swapper/023:05:110
103599930,3cyclictest0-21swapper/022:45:100
103599930,3cyclictest0-21swapper/022:30:120
103599930,3cyclictest0-21swapper/022:20:010
103599930,3cyclictest0-21swapper/022:00:110
103599930,3cyclictest0-21swapper/021:20:120
103599930,3cyclictest0-21swapper/021:15:120
103599930,3cyclictest0-21swapper/020:55:040
103599930,3cyclictest0-21swapper/020:30:130
103599930,3cyclictest0-21swapper/020:20:100
103599930,3cyclictest0-21swapper/020:10:100
103599930,3cyclictest0-21swapper/020:00:100
103599930,3cyclictest0-21swapper/019:30:120
103599930,3cyclictest0-21swapper/019:30:110
103599930,3cyclictest0-21swapper/019:25:110
103599930,3cyclictest0-21swapper/019:20:100
103599930,3cyclictest0-21swapper/000:30:120
103599930,3cyclictest0-21swapper/000:25:110
103599930,3cyclictest0-21swapper/000:15:000
103599930,1cyclictest24044-21apt-get22:50:090
103599930,1cyclictest24044-21apt-get22:50:090
103609921,1cyclictest0-21swapper/122:10:101
103609921,1cyclictest0-21swapper/121:55:091
103609920,2cyclictest109602sleep121:18:331
103609920,2cyclictest0-21swapper/119:10:071
103609920,1cyclictest0-21swapper/120:00:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional