You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-01 - 13:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot2.osadl.org (updated Sat Nov 01, 2025 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
101812196179,11sleep10-21swapper/119:09:571
98932193176,12sleep00-21swapper/019:06:130
98862184166,13sleep30-21swapper/319:06:083
9843210284,13sleep20-21swapper/219:05:362
298322400,0sleep20-21swapper/222:25:522
151662390,0sleep10-21swapper/122:19:201
1037499113,4cyclictest8299-21munin-run20:10:000
1037499113,4cyclictest8299-21munin-run20:10:000
32730290,0sleep10-21swapper/123:49:231
103749992,3cyclictest12850irq/132-ahci[0021:05:000
103749981,3cyclictest15936-21munin-run20:25:010
103849961,1cyclictest0-21swapper/200:09:292
103849960,5cyclictest0-21swapper/223:15:122
103749965,1cyclictest0-21swapper/000:30:120
103749962,4cyclictest3610-21perf21:25:000
103749962,4cyclictest26371-21munin-run00:20:000
103749960,5cyclictest218182sleep022:55:020
21327250,0sleep00-21swapper/022:05:220
103919955,0cyclictest6505-21kworker/3:323:17:393
103919955,0cyclictest0-21swapper/323:21:593
103919955,0cyclictest0-21swapper/322:56:323
103919950,5cyclictest0-21swapper/323:50:173
103919950,5cyclictest0-21swapper/322:04:003
103919950,3cyclictest17475-21ssh23:40:583
103849955,0cyclictest0-21swapper/200:10:122
103849950,5cyclictest0-21swapper/223:57:412
103849950,4cyclictest408850ssh21:25:102
103849950,4cyclictest0-21swapper/219:10:142
103849950,3cyclictest9475-21ssh23:20:342
103849950,0cyclictest0-21swapper/222:31:072
103849950,0cyclictest0-21swapper/221:32:022
103789951,3cyclictest0-21swapper/120:25:141
103789950,5cyclictest0-21swapper/123:13:111
103789950,5cyclictest0-21swapper/122:52:061
103789950,5cyclictest0-21swapper/121:27:071
103749955,0cyclictest0-21swapper/021:37:130
103749951,2cyclictest0-21swapper/020:00:110
103749950,5cyclictest0-21swapper/022:42:230
103749950,5cyclictest0-21swapper/022:25:130
103749950,5cyclictest0-21swapper/022:19:060
103749950,5cyclictest0-21swapper/021:57:270
103749950,0cyclictest6666-21ssh22:46:540
103749950,0cyclictest0-21swapper/021:46:570
103749950,0cyclictest0-21swapper/000:28:450
103919944,0cyclictest6505-21kworker/3:320:07:193
103919944,0cyclictest6505-21kworker/3:320:07:193
103919944,0cyclictest6505-21kworker/3:319:56:093
103919944,0cyclictest6505-21kworker/3:319:44:563
103919944,0cyclictest6505-21kworker/3:319:11:233
103919943,1cyclictest55950irq/130-eth022:25:023
103919943,1cyclictest20868-21apt20:35:003
103919943,1cyclictest15148-21grep20:20:213
103919942,2cyclictest714-21snmpd22:53:293
103919942,1cyclictest9613-21/usr/sbin/munin20:10:173
103919942,1cyclictest714-21snmpd00:25:213
103919942,1cyclictest4216-21sh22:30:043
103919942,1cyclictest19378-21/usr/sbin/munin22:05:183
103919941,3cyclictest0-21swapper/321:25:103
103919941,2cyclictest0-21swapper/321:00:103
103919941,0cyclictest27531-21if_eth021:20:163
103919940,4cyclictest7568-21df00:10:093
103919940,4cyclictest567-21ssh22:44:213
103919940,4cyclictest32315-21ntp_states19:50:203
103919940,4cyclictest30670-21ssh23:48:043
103919940,4cyclictest25434-21needreboot00:35:163
103919940,4cyclictest0-21swapper/323:59:143
103919940,4cyclictest0-21swapper/323:36:143
103919940,4cyclictest0-21swapper/323:07:353
103919940,4cyclictest0-21swapper/322:20:123
103919940,4cyclictest0-21swapper/322:18:033
103919940,4cyclictest0-21swapper/322:10:113
103919940,4cyclictest0-21swapper/321:47:003
103919940,4cyclictest0-21swapper/319:30:123
103919940,3cyclictest8516-21sh21:10:273
103919940,3cyclictest4437-21ssh21:40:423
103919940,3cyclictest29384-21sh23:30:353
103919940,3cyclictest24000-21expr20:40:123
103919940,3cyclictest23075-21ntpq00:00:173
103919940,3cyclictest2211-21ssh22:45:143
103919940,3cyclictest21553-21ssh21:50:013
103919940,3cyclictest21284-21sh23:10:193
103919940,3cyclictest19034-21/usr/sbin/munin00:15:193
103919940,3cyclictest17516-21head20:25:203
103919940,3cyclictest13052-21munin-node19:15:003
103919940,1cyclictest3542-21/usr/sbin/munin21:05:173
103919940,1cyclictest31841-21/usr/sbin/munin21:55:193
103919940,1cyclictest28528-21/usr/sbin/munin20:50:143
103919940,1cyclictest26944-21/usr/sbin/munin00:20:223
103919940,1cyclictest23609-21/usr/sbin/munin19:35:213
103919940,1cyclictest17582-21df23:25:153
103919940,1cyclictest15284-21if_eth400:30:153
103919940,1cyclictest14448-21/usr/sbin/munin22:35:163
103849944,0cyclictest0-21swapper/222:55:072
103849944,0cyclictest0-21swapper/221:23:112
103849943,1cyclictest25051-21grep23:45:142
103849942,1cyclictest3115-21ssh22:45:172
103849942,1cyclictest27558-21ssh00:20:162
103849941,2cyclictest0-21swapper/222:00:112
103849940,4cyclictest3586-21apt-get20:00:122
103849940,4cyclictest31002-21apt-get20:55:132
103849940,4cyclictest16990-21apt-get00:15:112
103849940,4cyclictest0-21swapper/223:50:242
103849940,4cyclictest0-21swapper/223:40:122
103849940,4cyclictest0-21swapper/223:35:122
103849940,4cyclictest0-21swapper/223:30:072
103849940,4cyclictest0-21swapper/223:25:122
103849940,4cyclictest0-21swapper/223:00:112
103849940,4cyclictest0-21swapper/222:50:452
103849940,4cyclictest0-21swapper/222:16:582
103849940,4cyclictest0-21swapper/222:10:202
103849940,4cyclictest0-21swapper/222:09:262
103849940,4cyclictest0-21swapper/221:55:052
103849940,4cyclictest0-21swapper/221:44:392
103849940,4cyclictest0-21swapper/221:35:052
103849940,4cyclictest0-21swapper/221:18:042
103849940,4cyclictest0-21swapper/219:58:282
103849940,4cyclictest0-21swapper/219:30:122
103849940,4cyclictest0-21swapper/219:20:142
103849940,4cyclictest0-21swapper/200:36:452
103849940,4cyclictest0-21swapper/200:31:172
103849940,3cyclictest3542-21/usr/sbin/munin21:05:182
103849940,3cyclictest23159-21/usr/sbin/munin00:00:192
103849940,3cyclictest13618-21apt-config20:20:002
103849940,3cyclictest0-21swapper/221:45:132
103849940,0cyclictest0-21swapper/223:10:072
103849940,0cyclictest0-21swapper/222:21:222
103789944,0cyclictest0-21swapper/123:00:221
103789944,0cyclictest0-21swapper/121:33:491
103789941,2cyclictest0-21swapper/122:55:101
103789941,2cyclictest0-21swapper/121:50:141
103789941,2cyclictest0-21swapper/121:10:131
103789941,2cyclictest0-21swapper/120:00:111
103789941,2cyclictest0-21swapper/119:50:131
103789941,2cyclictest0-21swapper/119:25:131
103789941,2cyclictest0-21swapper/100:10:081
103789941,1cyclictest0-21swapper/121:40:121
103789940,4cyclictest0-21swapper/122:36:131
103789940,4cyclictest0-21swapper/120:43:351
103789940,2cyclictest0-21swapper/100:00:121
103789940,0cyclictest0-21swapper/122:00:081
103749944,0cyclictest0-21swapper/023:06:240
103749944,0cyclictest0-21swapper/021:31:590
103749944,0cyclictest0-21swapper/000:08:050
103749943,1cyclictest2773-21gltestperf23:50:180
103749942,1cyclictest28307-21munin-run20:50:000
103749941,2cyclictest27207-21tr00:20:160
103749941,2cyclictest0-21swapper/020:55:120
103749940,4cyclictest5784-21diskmemload23:56:160
103749940,4cyclictest21102-21apt-get20:35:120
103749940,4cyclictest0-21swapper/023:45:120
103749940,4cyclictest0-21swapper/023:21:230
103749940,4cyclictest0-21swapper/023:16:400
103749940,4cyclictest0-21swapper/023:10:120
103749940,4cyclictest0-21swapper/022:20:180
103749940,4cyclictest0-21swapper/022:00:120
103749940,4cyclictest0-21swapper/021:40:130
103749940,4cyclictest0-21swapper/021:16:370
103749940,4cyclictest0-21swapper/020:10:460
103749940,4cyclictest0-21swapper/019:50:070
103749940,4cyclictest0-21swapper/019:43:240
103749940,4cyclictest0-21swapper/000:13:500
103749940,3cyclictest24286-21perl20:40:130
103749940,3cyclictest21052-21grep19:30:010
103749940,3cyclictest182692sleep023:41:290
103749940,3cyclictest18231-21memory23:25:180
103749940,3cyclictest12798-21/usr/sbin/munin22:50:150
103749940,3cyclictest1101-21ntp_states23:00:180
103749940,3cyclictest0-21swapper/023:35:020
103749940,3cyclictest0-21swapper/022:10:110
103749940,1cyclictest5790-21munin-run21:10:010
103749940,1cyclictest13249-21latency_hist20:20:010
103749940,1cyclictest12981-21diskstats19:15:000
103749940,0cyclictest0-21swapper/022:37:530
103749940,0cyclictest0-21swapper/021:14:570
103749940,0cyclictest0-21swapper/020:25:360
103919932,1cyclictest714-21snmpd20:45:083
103919932,1cyclictest714-21snmpd20:00:103
103919932,1cyclictest28559-21taskset19:45:043
103919930,3cyclictest23981-21ssh21:35:053
103919930,3cyclictest22187-21cut20:35:153
103919930,3cyclictest16646-21expr19:20:163
103919930,3cyclictest16135-21sh21:15:023
103919930,3cyclictest14166-21apt-get21:30:123
103919930,3cyclictest0-21swapper/323:00:033
103919930,3cyclictest0-21swapper/320:15:113
103919930,3cyclictest0-21swapper/319:25:053
103919930,3cyclictest0-21swapper/300:05:023
103919930,0cyclictest31002-21apt-get20:55:123
103849933,0cyclictest12895-21kworker/2:120:50:052
103849933,0cyclictest12895-21kworker/2:120:40:042
103849933,0cyclictest12895-21kworker/2:120:25:052
103849933,0cyclictest12895-21kworker/2:119:15:052
103849932,1cyclictest714-21snmpd22:35:032
103849931,1cyclictest0-21swapper/221:00:112
103849931,1cyclictest0-21swapper/220:05:112
103849931,1cyclictest0-21swapper/220:05:102
103849930,3cyclictest6151-21ssh21:10:062
103849930,3cyclictest32208-21sed19:50:182
103849930,3cyclictest0-21swapper/223:05:062
103849930,3cyclictest0-21swapper/222:40:022
103849930,3cyclictest0-21swapper/221:50:142
103849930,3cyclictest0-21swapper/220:45:042
103849930,3cyclictest0-21swapper/220:35:112
103849930,3cyclictest0-21swapper/220:30:012
103849930,3cyclictest0-21swapper/220:10:122
103849930,3cyclictest0-21swapper/219:45:102
103849930,3cyclictest0-21swapper/219:35:132
103849930,3cyclictest0-21swapper/219:25:122
103849930,3cyclictest0-21swapper/200:25:072
103849930,2cyclictest26100-21/usr/sbin/munin19:40:122
103849930,0cyclictest10998-21apt-get20:15:102
103789933,0cyclictest0-21swapper/123:17:421
103789933,0cyclictest0-21swapper/120:20:181
103789933,0cyclictest0-21swapper/100:31:191
103789933,0cyclictest0-21swapper/100:20:591
103789931,2cyclictest0-21swapper/122:25:011
103789931,1cyclictest0-21swapper/123:55:091
103789931,1cyclictest0-21swapper/123:50:141
103789931,1cyclictest0-21swapper/123:40:121
103789931,1cyclictest0-21swapper/123:25:121
103789931,1cyclictest0-21swapper/122:45:151
103789931,1cyclictest0-21swapper/122:20:131
103789931,1cyclictest0-21swapper/122:10:111
103789931,1cyclictest0-21swapper/121:45:121
103789931,1cyclictest0-21swapper/121:20:121
103789931,1cyclictest0-21swapper/121:15:111
103789931,1cyclictest0-21swapper/121:00:121
103789931,1cyclictest0-21swapper/120:35:121
103789931,1cyclictest0-21swapper/119:40:121
103789931,1cyclictest0-21swapper/119:35:121
103789931,1cyclictest0-21swapper/100:15:111
103789930,3cyclictest0-21swapper/120:48:061
103789930,2cyclictest85102sleep122:31:361
103789930,2cyclictest6382-21taskset21:58:261
103789930,2cyclictest0-21swapper/123:30:111
103789930,2cyclictest0-21swapper/122:05:121
103789930,2cyclictest0-21swapper/120:10:131
103789930,2cyclictest0-21swapper/119:55:101
103789930,1cyclictest0-21swapper/120:15:101
103749932,1cyclictest714-21snmpd19:35:040
103749932,1cyclictest509-21nscd23:30:110
103749932,0cyclictest21691-21apt-get00:00:120
103749930,3cyclictest6489-21users22:30:210
103749930,3cyclictest4610-21ssh21:25:110
103749930,3cyclictest21140-21apt-get19:30:110
103749930,3cyclictest13166-21munin-node19:15:010
103749930,3cyclictest0-21swapper/021:50:030
103749930,3cyclictest0-21swapper/020:50:110
103749930,3cyclictest0-21swapper/020:30:140
103749930,3cyclictest0-21swapper/019:55:170
103749930,3cyclictest0-21swapper/019:45:100
103749930,3cyclictest0-21swapper/019:20:150
103749930,3cyclictest0-21swapper/000:35:010
103789921,1cyclictest0-21swapper/121:05:131
103789921,1cyclictest0-21swapper/119:20:141
103789920,1cyclictest1604-21chrt00:06:491
103789920,1cyclictest0-21swapper/123:35:111
103789920,1cyclictest0-21swapper/123:20:131
103789920,1cyclictest0-21swapper/123:05:111
103789920,1cyclictest0-21swapper/122:40:011
103789920,1cyclictest0-21swapper/121:35:121
103789920,1cyclictest0-21swapper/120:55:121
103789920,1cyclictest0-21swapper/120:50:111
103789920,1cyclictest0-21swapper/120:30:011
103789920,1cyclictest0-21swapper/119:45:131
103789920,1cyclictest0-21swapper/119:30:111
103789920,1cyclictest0-21swapper/119:15:121
103789920,1cyclictest0-21swapper/119:10:141
103789920,1cyclictest0-21swapper/100:35:121
103789920,1cyclictest0-21swapper/100:25:091
103789910,1cyclictest0-21swapper/120:05:011
103789910,1cyclictest0-21swapper/120:05:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional