You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 06:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Nov 13, 2025 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3642203187,11sleep10-21swapper/119:07:561
3872200183,12sleep00-21swapper/019:08:110
4652187171,11sleep30-21swapper/319:09:103
370211395,13sleep20-21swapper/219:08:012
172482510,0sleep00-21swapper/000:02:240
168962460,0sleep10-21swapper/122:56:591
125562450,0sleep10-21swapper/123:10:521
55382430,0sleep10-21swapper/123:24:211
57072410,1sleep05708-21tune2fs22:35:160
266042380,0sleep20-21swapper/222:29:542
62792360,0sleep10-21swapper/122:03:151
7359971,3cyclictest19111-21perf23:15:000
7359960,6cyclictest0-21swapper/000:19:550
7359960,5cyclictest0-21swapper/019:25:160
7359960,3cyclictest21492-21perf21:55:000
7449950,5cyclictest0-21swapper/323:50:123
7449950,4cyclictest6532-21munin-run20:25:003
7449950,4cyclictest0-21swapper/319:30:013
7449950,2cyclictest0-21swapper/323:15:153
7449950,0cyclictest0-21swapper/321:48:203
7449950,0cyclictest0-21swapper/321:28:413
7399951,2cyclictest0-21swapper/219:50:132
7399950,5cyclictest0-21swapper/223:57:512
7399950,5cyclictest0-21swapper/223:29:552
7399950,5cyclictest0-21swapper/222:42:212
7399950,5cyclictest0-21swapper/200:37:362
7399950,0cyclictest0-21swapper/221:28:262
7369951,3cyclictest0-21swapper/120:05:121
7369950,5cyclictest0-21swapper/122:47:251
7369950,5cyclictest0-21swapper/100:03:571
7359955,0cyclictest0-21swapper/022:33:250
7359950,5cyclictest0-21swapper/022:23:400
7359950,5cyclictest0-21swapper/022:02:340
7359950,5cyclictest0-21swapper/021:58:470
7359950,5cyclictest0-21swapper/021:39:090
7359950,5cyclictest0-21swapper/021:27:040
7359950,5cyclictest0-21swapper/000:35:380
7359950,5cyclictest0-21swapper/000:30:240
7359950,5cyclictest0-21swapper/000:25:100
7359950,4cyclictest4528-21ssh21:30:160
7359950,0cyclictest0-21swapper/023:53:350
30700250,0sleep20-21swapper/220:05:212
7449944,0cyclictest20707-21kworker/3:000:19:503
7449944,0cyclictest13204-21kworker/3:223:12:403
7449944,0cyclictest0-21swapper/323:09:053
7449944,0cyclictest0-21swapper/322:00:243
7449944,0cyclictest0-21swapper/300:25:113
7449943,1cyclictest55950irq/130-eth021:50:013
7449941,2cyclictest0-21swapper/319:15:103
7449941,1cyclictest0-21swapper/300:00:113
7449940,4cyclictest7183-21/usr/sbin/munin23:25:193
7449940,4cyclictest61-21kswapd023:55:143
7449940,4cyclictest338-21ntp_states20:10:193
7449940,4cyclictest21212-21ntp_states22:10:193
7449940,4cyclictest1602-21perl19:10:153
7449940,4cyclictest0-21swapper/323:35:133
7449940,4cyclictest0-21swapper/322:50:243
7449940,4cyclictest0-21swapper/322:45:503
7449940,4cyclictest0-21swapper/322:20:133
7449940,4cyclictest0-21swapper/322:05:133
7449940,4cyclictest0-21swapper/321:30:163
7449940,4cyclictest0-21swapper/321:20:123
7449940,4cyclictest0-21swapper/321:14:153
7449940,4cyclictest0-21swapper/320:50:123
7449940,4cyclictest0-21swapper/320:50:123
7449940,4cyclictest0-21swapper/320:15:183
7449940,4cyclictest0-21swapper/300:35:393
7449940,4cyclictest0-21swapper/300:30:253
7449940,3cyclictest7404-21df_inode21:15:123
7449940,3cyclictest3945-21sh00:11:583
7449940,3cyclictest30909-21sh21:43:123
7449940,3cyclictest30328-21perl23:20:143
7449940,3cyclictest26146-21sh00:06:453
7449940,3cyclictest2421-21taskset22:17:153
7449940,3cyclictest23442-21users20:55:223
7449940,3cyclictest22790-21df23:00:143
7449940,3cyclictest18798-21python23:30:233
7449940,3cyclictest17401-21runrttasks22:40:403
7449940,3cyclictest16697-21/usr/sbin/munin19:40:143
7449940,3cyclictest11072-21rm23:43:083
7449940,1cyclictest6764-21/usr/sbin/munin20:25:243
7449940,1cyclictest6594-21/usr/sbin/munin19:20:183
7449940,1cyclictest27297-21perl21:05:153
7449940,1cyclictest10341-21ntp_states19:25:223
7399944,0cyclictest0-21swapper/223:21:382
7399944,0cyclictest0-21swapper/223:13:202
7399944,0cyclictest0-21swapper/222:35:302
7399944,0cyclictest0-21swapper/221:36:432
7399943,1cyclictest5737-21memory21:30:212
7399941,2cyclictest5076-21sh21:46:042
7399941,2cyclictest0-21swapper/222:30:152
7399941,2cyclictest0-21swapper/219:40:142
7399941,2cyclictest0-21swapper/219:30:112
7399941,2cyclictest0-21swapper/219:20:132
7399941,1cyclictest0-21swapper/220:55:132
7399941,1cyclictest0-21swapper/220:50:122
7399941,1cyclictest0-21swapper/220:50:122
7399940,4cyclictest4097-21apt-get19:15:102
7399940,4cyclictest29046-21ssh00:25:112
7399940,4cyclictest12655-21expr22:55:132
7399940,4cyclictest0-21swapper/223:54:282
7399940,4cyclictest0-21swapper/223:45:112
7399940,4cyclictest0-21swapper/223:36:552
7399940,4cyclictest0-21swapper/223:17:322
7399940,4cyclictest0-21swapper/223:05:022
7399940,4cyclictest0-21swapper/223:00:102
7399940,4cyclictest0-21swapper/222:45:082
7399940,4cyclictest0-21swapper/222:05:012
7399940,4cyclictest0-21swapper/222:04:092
7399940,4cyclictest0-21swapper/221:55:122
7399940,4cyclictest0-21swapper/221:50:132
7399940,4cyclictest0-21swapper/221:21:052
7399940,4cyclictest0-21swapper/221:16:172
7399940,4cyclictest0-21swapper/221:00:172
7399940,4cyclictest0-21swapper/220:35:152
7399940,4cyclictest0-21swapper/200:30:132
7399940,4cyclictest0-21swapper/200:20:132
7399940,4cyclictest0-21swapper/200:10:122
7399940,4cyclictest0-21swapper/200:05:532
7399940,3cyclictest29301-21ssh21:10:132
7399940,3cyclictest23389-21ssh23:33:052
7399940,3cyclictest1797-21apt-get20:15:142
7399940,3cyclictest11952-21ssh00:00:112
7399940,3cyclictest10725-21rm22:54:212
7399940,3cyclictest0-21swapper/222:10:202
7399940,1cyclictest9149-21ssh23:41:542
7369944,0cyclictest0-21swapper/121:23:191
7369944,0cyclictest0-21swapper/121:10:311
7369944,0cyclictest0-21swapper/100:16:461
7369942,1cyclictest0-21swapper/123:45:111
7369942,1cyclictest0-21swapper/123:30:151
7369941,2cyclictest0-21swapper/122:40:121
7369941,2cyclictest0-21swapper/122:15:131
7369941,2cyclictest0-21swapper/122:05:131
7369941,2cyclictest0-21swapper/121:35:131
7369941,2cyclictest0-21swapper/121:05:131
7369941,2cyclictest0-21swapper/120:35:151
7369941,2cyclictest0-21swapper/120:25:161
7369941,2cyclictest0-21swapper/120:20:121
7369941,2cyclictest0-21swapper/119:40:141
7369941,2cyclictest0-21swapper/100:30:131
7369941,1cyclictest0-21swapper/119:30:111
7369940,4cyclictest0-21swapper/123:08:401
7369940,4cyclictest0-21swapper/121:44:341
7369940,4cyclictest0-21swapper/121:30:101
7369940,3cyclictest0-21swapper/100:05:121
7369940,2cyclictest0-21swapper/123:25:161
7369940,2cyclictest0-21swapper/122:25:141
7369940,2cyclictest0-21swapper/120:00:121
7369940,0cyclictest0-21swapper/123:04:531
7369940,0cyclictest0-21swapper/122:54:161
7359943,1cyclictest8841-21munin-run19:25:000
7359941,1cyclictest21851-21ssh00:05:120
7359941,1cyclictest0-21swapper/021:10:130
7359940,4cyclictest32271-21perl20:10:150
7359940,4cyclictest27125-21diskstats20:00:140
7359940,4cyclictest19169-21apt-get19:45:150
7359940,4cyclictest0-21swapper/023:42:000
7359940,4cyclictest0-21swapper/023:36:050
7359940,4cyclictest0-21swapper/023:30:150
7359940,4cyclictest0-21swapper/023:22:100
7359940,4cyclictest0-21swapper/023:05:130
7359940,4cyclictest0-21swapper/022:15:130
7359940,4cyclictest0-21swapper/022:10:130
7359940,4cyclictest0-21swapper/022:05:130
7359940,4cyclictest0-21swapper/021:15:110
7359940,4cyclictest0-21swapper/020:30:100
7359940,4cyclictest0-21swapper/019:57:000
7359940,4cyclictest0-21swapper/019:32:500
7359940,4cyclictest0-21swapper/000:10:120
7359940,3cyclictest3649-21ntp_states19:15:010
7359940,3cyclictest27080-21df_inode21:05:140
7359940,3cyclictest2676-21df_inode23:55:150
7359940,3cyclictest25463-21diskstats22:45:180
7359940,3cyclictest23945-21rm23:16:470
7359940,3cyclictest22435-21hddtemp_smartct20:55:160
7359940,3cyclictest20152-21ssh21:21:060
7359940,3cyclictest1777-21apt-get20:15:010
7359940,3cyclictest16234-21ntp_states22:40:180
7359940,3cyclictest13922-21cron20:40:010
27565240,0sleep10-21swapper/123:19:051
7449932,1cyclictest26960-21cpuspeed_turbos20:00:133
7449932,1cyclictest22115-21expr19:50:143
7449932,1cyclictest21975-21ssh21:55:123
7449931,2cyclictest0-21swapper/300:20:173
7449930,3cyclictest9759-21diskstats20:30:143
7449930,3cyclictest4795-21ssh22:35:093
7449930,3cyclictest20004-21hddtemp_smartct19:45:173
7449930,3cyclictest17281-21sh22:25:103
7449930,3cyclictest16657-21apt-get20:45:113
7449930,3cyclictest14442-21ssh23:45:013
7449930,3cyclictest0-21swapper/321:00:043
7449930,3cyclictest0-21swapper/320:40:123
7449930,3cyclictest0-21swapper/320:35:043
7449930,3cyclictest0-21swapper/320:05:063
7449930,3cyclictest0-21swapper/319:55:093
7449930,3cyclictest0-21swapper/319:35:133
7449930,1cyclictest27376-21ssh22:30:153
7449930,1cyclictest14408-21ssh21:35:133
7449930,1cyclictest12842-21diskstats22:55:143
7399931,1cyclictest0-21swapper/220:45:112
7399930,3cyclictest9131-21ssh00:15:082
7399930,3cyclictest24202-21rm21:40:062
7399930,3cyclictest0-21swapper/222:20:052
7399930,3cyclictest0-21swapper/222:15:142
7399930,3cyclictest0-21swapper/221:05:072
7399930,3cyclictest0-21swapper/220:40:122
7399930,3cyclictest0-21swapper/220:30:122
7399930,3cyclictest0-21swapper/220:25:022
7399930,3cyclictest0-21swapper/220:20:042
7399930,3cyclictest0-21swapper/220:00:122
7399930,3cyclictest0-21swapper/219:55:092
7399930,3cyclictest0-21swapper/219:45:062
7399930,3cyclictest0-21swapper/219:35:132
7399930,3cyclictest0-21swapper/219:25:172
7399930,3cyclictest0-21swapper/219:10:122
7399930,0cyclictest0-21swapper/220:10:082
7369933,0cyclictest0-21swapper/100:35:321
7369933,0cyclictest0-21swapper/100:21:161
7369931,1cyclictest0-21swapper/123:55:141
7369931,1cyclictest0-21swapper/123:50:121
7369931,1cyclictest0-21swapper/123:40:091
7369931,1cyclictest0-21swapper/122:30:151
7369931,1cyclictest0-21swapper/122:20:131
7369931,1cyclictest0-21swapper/121:55:121
7369931,1cyclictest0-21swapper/120:15:011
7369931,1cyclictest0-21swapper/119:55:091
7369931,1cyclictest0-21swapper/119:25:161
7369931,1cyclictest0-21swapper/119:20:131
7369931,1cyclictest0-21swapper/119:10:131
7369930,2cyclictest0-21swapper/123:35:151
7369930,2cyclictest0-21swapper/122:10:131
7369930,2cyclictest0-21swapper/121:50:011
7369930,2cyclictest0-21swapper/121:45:141
7369930,2cyclictest0-21swapper/121:00:111
7369930,1cyclictest0-21swapper/122:35:141
7369930,1cyclictest0-21swapper/100:10:121
7359933,0cyclictest0-21swapper/019:35:010
7359932,1cyclictest714-21snmpd21:40:060
7359931,2cyclictest7571-21kworker/0:119:10:020
7359930,3cyclictest2131-21ssh22:50:040
7359930,3cyclictest14705-21ssh23:45:110
7359930,3cyclictest0-21swapper/023:00:130
7359930,3cyclictest0-21swapper/022:55:120
7359930,3cyclictest0-21swapper/022:25:050
7359930,3cyclictest0-21swapper/021:45:070
7359930,3cyclictest0-21swapper/021:00:140
7359930,3cyclictest0-21swapper/020:50:130
7359930,3cyclictest0-21swapper/020:50:120
7359930,3cyclictest0-21swapper/020:45:110
7359930,3cyclictest0-21swapper/020:35:150
7359930,3cyclictest0-21swapper/020:25:170
7359930,3cyclictest0-21swapper/020:20:120
7359930,3cyclictest0-21swapper/020:05:120
7359930,3cyclictest0-21swapper/019:50:030
7359930,3cyclictest0-21swapper/019:40:140
7359930,3cyclictest0-21swapper/000:20:130
7359930,2cyclictest6919-21ssh23:25:050
7369921,1cyclictest0-21swapper/121:25:141
7369921,1cyclictest0-21swapper/121:15:111
7369921,1cyclictest0-21swapper/120:55:131
7369921,1cyclictest0-21swapper/120:50:121
7369921,1cyclictest0-21swapper/120:50:121
7369921,1cyclictest0-21swapper/120:45:111
7369921,1cyclictest0-21swapper/120:40:121
7369921,1cyclictest0-21swapper/119:50:121
7369920,2cyclictest9220-21taskset20:30:061
7369920,1cyclictest28926-21chrt00:25:071
7369920,1cyclictest0-21swapper/120:10:131
7369920,1cyclictest0-21swapper/119:45:151
7369920,1cyclictest0-21swapper/119:35:131
7369910,1cyclictest0-21swapper/119:15:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional