You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 18:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Nov 13, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14152197181,11sleep10-21swapper/107:08:231
13352191173,13sleep30-21swapper/307:07:223
14092181164,12sleep00-21swapper/007:08:180
317532160141,14sleep20-21swapper/207:05:112
93132480,0sleep10-21swapper/111:40:181
258192440,0sleep00-21swapper/007:55:130
17219981,3cyclictest2341-21idleruntime-cro08:15:000
17219971,3cyclictest26710-21idleruntime-cro10:45:010
17259961,3cyclictest0-21swapper/112:10:121
17219962,3cyclictest5835-21cat10:50:160
17219960,5cyclictest20551-21perl08:50:130
17219960,1cyclictest4373-21ssh12:10:200
20219250,0sleep10-21swapper/112:18:491
17349950,5cyclictest0-21swapper/312:04:323
17349950,5cyclictest0-21swapper/311:23:233
17349950,5cyclictest0-21swapper/309:36:253
17349950,4cyclictest19703-21munin-run07:45:013
17309950,5cyclictest0-21swapper/212:29:182
17309950,5cyclictest0-21swapper/212:04:512
17309950,5cyclictest0-21swapper/209:39:052
17309950,5cyclictest0-21swapper/208:40:432
17309950,4cyclictest27561-21apt-get08:00:122
17309950,0cyclictest0-21swapper/209:56:402
17259955,0cyclictest0-21swapper/111:29:181
17259952,2cyclictest0-21swapper/108:30:131
17259952,2cyclictest0-21swapper/107:30:111
17259951,3cyclictest0-21swapper/111:05:151
17259951,2cyclictest0-21swapper/111:50:111
17259951,2cyclictest0-21swapper/110:55:131
17259951,2cyclictest0-21swapper/110:25:121
17259951,2cyclictest0-21swapper/109:10:121
17259951,2cyclictest0-21swapper/107:55:121
17259951,1cyclictest0-21swapper/112:30:111
17259950,0cyclictest0-21swapper/109:28:491
17219951,4cyclictest0-21swapper/009:10:120
17219951,3cyclictest714-21snmpd12:30:490
17219950,4cyclictest0-21swapper/012:00:010
17219950,0cyclictest29558-21diskmemload12:25:190
19678240,0sleep30-21swapper/307:45:003
17349944,0cyclictest4389-21kworker/3:209:06:043
17349944,0cyclictest4389-21kworker/3:208:54:513
17349944,0cyclictest4389-21kworker/3:208:10:053
17349944,0cyclictest4389-21kworker/3:207:36:283
17349944,0cyclictest16302-21kworker/3:107:14:083
17349944,0cyclictest0-21swapper/312:35:423
17349944,0cyclictest0-21swapper/311:54:563
17349943,1cyclictest22352-21/usr/sbin/munin08:55:193
17349942,1cyclictest714-21snmpd12:18:063
17349942,1cyclictest714-21snmpd12:05:093
17349942,1cyclictest714-21snmpd10:15:253
17349942,1cyclictest14539-21ssh09:18:153
17349942,0cyclictest0-21swapper/310:50:133
17349940,4cyclictest30056-21apt-get09:10:123
17349940,4cyclictest30028-21apt-get08:05:123
17349940,4cyclictest2557-21apt-get08:15:123
17349940,4cyclictest22534-21apt-get12:20:093
17349940,4cyclictest0-21swapper/311:35:123
17349940,4cyclictest0-21swapper/311:14:333
17349940,4cyclictest0-21swapper/310:41:363
17349940,4cyclictest0-21swapper/310:00:123
17349940,4cyclictest0-21swapper/310:00:123
17349940,4cyclictest0-21swapper/309:29:443
17349940,3cyclictest9986-21/usr/sbin/munin08:30:143
17349940,3cyclictest13994-21ssh11:26:233
17349940,3cyclictest0-21swapper/308:40:133
17349940,1cyclictest7675-21/usr/sbin/munin11:40:203
17349940,1cyclictest5070-21/usr/sbin/munin07:15:213
17349940,1cyclictest5046-21/usr/sbin/munin08:20:153
17349940,1cyclictest27236-21/usr/sbin/munin10:45:153
17349940,1cyclictest22598-21/usr/sbin/munin07:50:153
17349940,1cyclictest17574-21/usr/sbin/munin11:45:173
17349940,1cyclictest1567-21ntp_states12:25:193
17349940,1cyclictest10025-21/usr/sbin/munin07:25:173
17349940,1cyclictest0-21swapper/310:10:143
17349940,0cyclictest0-21swapper/309:48:123
17309944,0cyclictest0-21swapper/210:10:382
17309943,1cyclictest27803-21ssh11:00:452
17309943,1cyclictest27069-21ssh12:05:212
17309943,1cyclictest24052-21grep07:50:202
17309943,1cyclictest15606-21ssh11:10:522
17309943,1cyclictest12991-21ssh09:33:342
17309943,1cyclictest1-21systemd10:57:592
17309942,2cyclictest16565-21ssh11:28:012
17309942,1cyclictest1114-21ssh11:36:092
17309942,1cyclictest10280-21ssh10:36:002
17309941,3cyclictest31140-21awk09:10:172
17309941,3cyclictest19834-21ssh10:40:412
17309940,4cyclictest28092-21apt-get09:25:132
17309940,4cyclictest2606-21ssh11:05:112
17309940,4cyclictest1843-21apt-get07:10:142
17309940,4cyclictest0-21swapper/212:20:102
17309940,4cyclictest0-21swapper/211:55:142
17309940,4cyclictest0-21swapper/211:46:352
17309940,4cyclictest0-21swapper/211:31:052
17309940,4cyclictest0-21swapper/211:15:352
17309940,4cyclictest0-21swapper/210:46:292
17309940,4cyclictest0-21swapper/210:30:142
17309940,4cyclictest0-21swapper/210:00:132
17309940,4cyclictest0-21swapper/210:00:132
17309940,4cyclictest0-21swapper/209:40:132
17309940,4cyclictest0-21swapper/209:20:132
17309940,4cyclictest0-21swapper/208:50:112
17309940,3cyclictest8940-21latency_hist10:20:012
17309940,3cyclictest6117-21needreboot10:50:182
17309940,3cyclictest6038-21irqstats08:20:162
17309940,3cyclictest420-21cstates08:10:132
17309940,3cyclictest29558-21diskmemload12:15:402
17309940,3cyclictest28077-21ssh11:50:142
17309940,3cyclictest26640-21ssh10:28:332
17309940,3cyclictest22765-21ssh09:54:442
17309940,3cyclictest19914-21ssh10:09:122
17309940,3cyclictest16249-21ssh11:44:302
17309940,3cyclictest13646-21ssh12:31:202
17309940,3cyclictest13153-21munin-run09:50:012
17309940,3cyclictest12043-21rm09:16:442
17309940,2cyclictest0-21swapper/208:15:202
17309940,1cyclictest8402-21hddtemp_smartct07:20:162
17309940,1cyclictest14269-21grep08:35:222
17259944,0cyclictest0-21swapper/112:35:561
17259944,0cyclictest0-21swapper/112:01:451
17259944,0cyclictest0-21swapper/111:14:361
17259944,0cyclictest0-21swapper/109:35:311
17259944,0cyclictest0-21swapper/107:50:091
17259942,1cyclictest0-21swapper/107:15:121
17259941,3cyclictest0-21swapper/112:05:121
17259941,2cyclictest0-21swapper/112:25:141
17259941,2cyclictest0-21swapper/111:45:121
17259941,2cyclictest0-21swapper/111:30:121
17259941,2cyclictest0-21swapper/111:20:121
17259941,2cyclictest0-21swapper/111:15:111
17259941,2cyclictest0-21swapper/110:40:111
17259941,2cyclictest0-21swapper/110:35:131
17259941,2cyclictest0-21swapper/110:30:141
17259941,2cyclictest0-21swapper/109:20:141
17259941,2cyclictest0-21swapper/109:15:121
17259941,2cyclictest0-21swapper/108:40:131
17259941,2cyclictest0-21swapper/108:35:131
17259941,2cyclictest0-21swapper/108:20:111
17259941,2cyclictest0-21swapper/108:05:111
17259941,2cyclictest0-21swapper/107:25:091
17259941,2cyclictest0-21swapper/107:20:121
17259940,4cyclictest0-21swapper/108:56:311
17259940,3cyclictest0-21swapper/109:55:121
17259940,2cyclictest0-21swapper/109:45:131
17259940,2cyclictest0-21swapper/108:15:121
17219944,0cyclictest0-21swapper/011:00:200
17219941,1cyclictest0-21swapper/012:20:090
17219940,4cyclictest29562-21ssh10:30:130
17219940,4cyclictest29558-21diskmemload11:30:030
17219940,4cyclictest23945-21ssh12:36:350
17219940,4cyclictest23021-21perl08:55:130
17219940,4cyclictest1735-21ntp_states11:20:180
17219940,4cyclictest10029-21apt-get07:25:090
17219940,4cyclictest0-21swapper/012:15:110
17219940,4cyclictest0-21swapper/012:09:070
17219940,4cyclictest0-21swapper/011:55:130
17219940,4cyclictest0-21swapper/011:50:550
17219940,4cyclictest0-21swapper/011:48:000
17219940,4cyclictest0-21swapper/011:16:140
17219940,4cyclictest0-21swapper/011:10:140
17219940,4cyclictest0-21swapper/011:05:130
17219940,4cyclictest0-21swapper/010:48:540
17219940,4cyclictest0-21swapper/010:25:120
17219940,4cyclictest0-21swapper/010:20:130
17219940,4cyclictest0-21swapper/010:15:160
17219940,4cyclictest0-21swapper/010:12:120
17219940,4cyclictest0-21swapper/009:55:130
17219940,4cyclictest0-21swapper/009:50:180
17219940,4cyclictest0-21swapper/009:30:130
17219940,4cyclictest0-21swapper/009:25:140
17219940,4cyclictest0-21swapper/009:25:000
17219940,4cyclictest0-21swapper/008:35:130
17219940,4cyclictest0-21swapper/008:05:120
17219940,4cyclictest0-21swapper/007:30:120
17219940,3cyclictest9983-21ls07:25:000
17219940,3cyclictest9090-21ssh10:35:210
17219940,3cyclictest3609-21/usr/sbin/munin09:45:170
17219940,3cyclictest28551-21irqstats08:00:160
17219940,3cyclictest15460-21ssh10:55:150
17219940,3cyclictest15004-21grep08:40:140
17219940,3cyclictest12813-21if_eth410:05:180
17219940,3cyclictest0-21swapper/011:35:120
17219940,3cyclictest0-21swapper/007:55:000
17219940,1cyclictest3695-21sed08:15:160
27583230,0sleep10-21swapper/109:40:201
17349933,0cyclictest12497-21apt-get07:30:103
17349933,0cyclictest0-21swapper/308:45:033
17349932,1cyclictest9328-21ssh10:20:083
17349932,1cyclictest5654-21ssh09:30:103
17349932,1cyclictest25764-21ssh09:40:053
17349932,1cyclictest13417-21ssh09:50:033
17349931,1cyclictest714-21snmpd11:00:003
17349931,1cyclictest25071-21apt-get07:55:113
17349930,3cyclictest12458-21apt-get08:35:143
17349930,3cyclictest0-21swapper/311:30:113
17349930,3cyclictest0-21swapper/311:05:073
17349930,3cyclictest0-21swapper/310:35:023
17349930,3cyclictest0-21swapper/310:30:143
17349930,3cyclictest0-21swapper/310:25:023
17349930,3cyclictest0-21swapper/310:05:153
17349930,3cyclictest0-21swapper/309:55:133
17349930,3cyclictest0-21swapper/309:20:033
17349930,3cyclictest0-21swapper/309:00:053
17349930,3cyclictest0-21swapper/308:25:423
17349930,3cyclictest0-21swapper/308:00:123
17349930,3cyclictest0-21swapper/307:20:123
17349930,1cyclictest4914-21ssh11:55:083
17349930,1cyclictest2615-21ssh12:10:093
17349930,1cyclictest22654-21ssh11:15:103
17349930,1cyclictest14869-21ssh10:55:133
17349930,1cyclictest0-21swapper/312:30:153
17309932,1cyclictest714-21snmpd08:45:122
17309932,1cyclictest714-21snmpd07:55:022
17309932,1cyclictest714-21snmpd07:40:052
17309932,1cyclictest714-21snmpd07:30:052
17309932,1cyclictest2426-21ssh12:10:022
17309930,3cyclictest4301-21munin-node07:15:012
17309930,3cyclictest30028-21apt-get08:05:112
17309930,3cyclictest22980-21grep08:55:132
17309930,3cyclictest15027-21wget07:35:132
17309930,3cyclictest0-21swapper/212:35:022
17309930,3cyclictest0-21swapper/211:20:012
17309930,3cyclictest0-21swapper/210:20:032
17309930,3cyclictest0-21swapper/209:05:132
17309930,3cyclictest0-21swapper/209:00:122
17309930,3cyclictest0-21swapper/208:30:132
17309930,3cyclictest0-21swapper/208:25:122
17309930,3cyclictest0-21swapper/207:45:122
17309930,3cyclictest0-21swapper/207:25:022
17259933,0cyclictest211ktimersoftd/107:35:011
17259933,0cyclictest0-21swapper/108:00:301
17259931,1cyclictest194042chrt08:46:581
17259931,1cyclictest0-21swapper/110:45:131
17259931,1cyclictest0-21swapper/110:15:151
17259931,1cyclictest0-21swapper/110:00:121
17259931,1cyclictest0-21swapper/110:00:121
17259931,1cyclictest0-21swapper/109:05:141
17259931,1cyclictest0-21swapper/108:10:111
17259931,0cyclictest0-21swapper/112:20:081
17259930,2cyclictest15059-21chrt10:06:111
17259930,2cyclictest0-21swapper/110:20:131
17259930,2cyclictest0-21swapper/108:50:111
17259930,2cyclictest0-21swapper/108:25:131
17259930,0cyclictest0-21swapper/107:46:571
17219932,1cyclictest25953-21ssh09:40:120
17219931,2cyclictest714-21snmpd09:00:090
17219931,1cyclictest714-21snmpd11:40:040
17219931,1cyclictest4371-21if_eth107:15:010
17219931,1cyclictest0-21swapper/007:45:120
17219930,3cyclictest8144-21expr09:15:130
17219930,3cyclictest1843-21apt-get07:10:140
17219930,3cyclictest15664-21ssh09:35:050
17219930,3cyclictest0-21swapper/010:00:030
17219930,3cyclictest0-21swapper/010:00:030
17219930,3cyclictest0-21swapper/009:05:130
17219930,3cyclictest0-21swapper/008:45:010
17219930,3cyclictest0-21swapper/008:30:140
17219930,3cyclictest0-21swapper/008:25:010
17219930,3cyclictest0-21swapper/008:20:110
17219930,3cyclictest0-21swapper/007:40:020
17219930,3cyclictest0-21swapper/007:35:130
17219930,2cyclictest9990-21ssh11:25:000
17259921,1cyclictest0-21swapper/109:00:121
17259920,2cyclictest21572-21taskset10:10:071
17259920,1cyclictest0-21swapper/111:55:131
17259920,1cyclictest0-21swapper/111:35:131
17259920,1cyclictest0-21swapper/111:00:141
17259920,1cyclictest0-21swapper/110:50:121
17259920,1cyclictest0-21swapper/109:50:121
17259920,1cyclictest0-21swapper/109:30:121
17259920,1cyclictest0-21swapper/107:40:121
17259920,1cyclictest0-21swapper/107:10:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional