You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 14:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Mon Nov 24, 2025 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
153572199183,11sleep10-21swapper/119:08:321
152402198163,12sleep30-21swapper/319:07:013
154232183167,12sleep00-21swapper/019:09:230
15296210890,13sleep20-21swapper/219:07:452
242222450,0sleep10-21swapper/122:53:191
53282430,0sleep10-21swapper/122:27:241
315362100,0sleep20-21swapper/220:45:122
7324260,0sleep10-21swapper/121:40:121
156619960,6cyclictest0-21swapper/223:09:182
156579961,3cyclictest0-21swapper/123:35:111
156569965,1cyclictest25408-21sh21:49:230
156569960,5cyclictest0-21swapper/020:20:130
26093250,0sleep20-21swapper/223:10:172
156669955,0cyclictest23423-21kworker/3:222:18:403
156669955,0cyclictest23423-21kworker/3:221:11:323
156669950,5cyclictest0-21swapper/323:36:053
156669950,5cyclictest0-21swapper/321:22:233
156669950,0cyclictest0-21swapper/322:47:563
156619955,0cyclictest0-21swapper/221:33:082
156619955,0cyclictest0-21swapper/200:38:212
156619954,1cyclictest20195-21rm21:46:052
156619950,5cyclictest0-21swapper/221:11:542
156619950,4cyclictest20997-21ssh00:30:112
156619950,4cyclictest0-21swapper/223:00:012
156619950,0cyclictest0-21swapper/223:28:222
156579951,3cyclictest0-21swapper/123:40:121
156579951,3cyclictest0-21swapper/121:00:131
156579951,2cyclictest0-21swapper/121:20:131
156579951,2cyclictest0-21swapper/120:50:131
156579950,5cyclictest0-21swapper/123:06:101
156579950,5cyclictest0-21swapper/121:56:271
156569955,0cyclictest0-21swapper/023:19:350
156569955,0cyclictest0-21swapper/023:13:280
156569955,0cyclictest0-21swapper/021:58:330
156569955,0cyclictest0-21swapper/021:34:060
156569951,4cyclictest1169-21munin-run20:50:000
156569950,5cyclictest0-21swapper/023:28:450
156569950,5cyclictest0-21swapper/023:22:380
156569950,5cyclictest0-21swapper/022:50:120
156569950,5cyclictest0-21swapper/000:28:240
156569950,4cyclictest0-21swapper/019:25:130
156569950,0cyclictest0-21swapper/023:34:520
26820240,0sleep00-21swapper/000:15:560
26429240,0sleep00-21swapper/000:00:030
156669944,0cyclictest0-21swapper/323:26:553
156669944,0cyclictest0-21swapper/319:10:153
156669944,0cyclictest0-21swapper/300:05:383
156669943,1cyclictest21994-21sed22:35:223
156669943,1cyclictest10161-21cpuspeed22:30:123
156669941,3cyclictest55950irq/130-eth022:00:193
156669941,3cyclictest30379-21awk21:35:173
156669940,4cyclictest315932chrt00:02:103
156669940,4cyclictest20496-21munin-run00:30:003
156669940,4cyclictest0-21swapper/323:50:123
156669940,4cyclictest0-21swapper/323:45:113
156669940,4cyclictest0-21swapper/323:20:153
156669940,4cyclictest0-21swapper/323:11:543
156669940,4cyclictest0-21swapper/321:30:113
156669940,4cyclictest0-21swapper/321:25:143
156669940,4cyclictest0-21swapper/321:15:323
156669940,4cyclictest0-21swapper/300:30:123
156669940,3cyclictest9301-21ssh00:24:103
156669940,3cyclictest31860-21sh23:30:013
156669940,3cyclictest29899-21sh22:40:043
156669940,3cyclictest27200-21ssh23:43:563
156669940,3cyclictest26904-21latency_hist22:55:013
156669940,3cyclictest26750-21date21:50:013
156669940,3cyclictest26129-21ssh00:15:293
156669940,3cyclictest19863-21sh23:07:043
156669940,3cyclictest19280-21sh21:45:303
156669940,3cyclictest14015-21sh00:10:133
156669940,3cyclictest1346-21wc20:50:003
156669940,3cyclictest0-21swapper/319:55:123
156669940,1cyclictest4817-21dpkg23:00:003
156669940,1cyclictest2996-21diskstats23:15:123
156669940,1cyclictest22490-21ssh22:20:143
156669940,1cyclictest16289-21/usr/sbin/munin20:15:183
156619944,0cyclictest0-21swapper/222:26:322
156619944,0cyclictest0-21swapper/222:11:152
156619944,0cyclictest0-21swapper/219:20:162
156619944,0cyclictest0-21swapper/219:13:172
156619942,2cyclictest27588-21grep19:30:172
156619941,1cyclictest0-21swapper/223:55:122
156619940,4cyclictest7548-21apt-get22:45:112
156619940,4cyclictest26227-21ls19:30:002
156619940,4cyclictest22928-21ssh23:41:112
156619940,4cyclictest0-21swapper/223:49:162
156619940,4cyclictest0-21swapper/223:30:122
156619940,4cyclictest0-21swapper/223:21:192
156619940,4cyclictest0-21swapper/222:15:122
156619940,4cyclictest0-21swapper/222:00:132
156619940,4cyclictest0-21swapper/221:50:122
156619940,4cyclictest0-21swapper/221:40:112
156619940,4cyclictest0-21swapper/221:37:122
156619940,4cyclictest0-21swapper/221:15:052
156619940,4cyclictest0-21swapper/220:40:122
156619940,4cyclictest0-21swapper/220:35:002
156619940,4cyclictest0-21swapper/220:13:492
156619940,4cyclictest0-21swapper/220:05:002
156619940,4cyclictest0-21swapper/219:55:122
156619940,4cyclictest0-21swapper/200:25:132
156619940,4cyclictest0-21swapper/200:15:162
156619940,4cyclictest0-21swapper/200:00:112
156619940,3cyclictest7159-21ssh21:55:352
156619940,3cyclictest714-21snmpd22:30:342
156619940,3cyclictest5045-21ssh00:05:182
156619940,3cyclictest4365-21/usr/sbin/munin23:15:192
156619940,3cyclictest28997-21ssh22:06:372
156619940,3cyclictest23208-21tune2fs22:20:152
156619940,3cyclictest21241-21latency_hist19:20:012
156619940,3cyclictest19507-21perl20:20:152
156619940,3cyclictest17969-21ssh23:39:202
156619940,3cyclictest11455-21ssh21:25:232
156619940,3cyclictest10229-21ssh00:24:472
156579944,0cyclictest0-21swapper/100:04:031
156579942,1cyclictest0-21swapper/123:15:101
156579942,1cyclictest0-21swapper/100:30:121
156579941,2cyclictest0-21swapper/123:45:111
156579941,2cyclictest0-21swapper/123:25:121
156579941,2cyclictest0-21swapper/123:00:111
156579941,2cyclictest0-21swapper/122:55:131
156579941,2cyclictest0-21swapper/122:30:111
156579941,2cyclictest0-21swapper/122:10:131
156579941,2cyclictest0-21swapper/121:50:121
156579941,2cyclictest0-21swapper/121:35:131
156579941,2cyclictest0-21swapper/120:45:111
156579941,2cyclictest0-21swapper/120:35:131
156579941,2cyclictest0-21swapper/120:20:131
156579941,2cyclictest0-21swapper/120:00:121
156579941,2cyclictest0-21swapper/119:55:121
156579941,2cyclictest0-21swapper/119:30:131
156579941,2cyclictest0-21swapper/119:20:131
156579941,2cyclictest0-21swapper/119:10:141
156579941,2cyclictest0-21swapper/100:25:131
156579940,3cyclictest0-21swapper/120:55:101
156579940,0cyclictest0-21swapper/121:25:541
156569944,0cyclictest0-21swapper/022:16:530
156569941,2cyclictest0-21swapper/021:15:120
156569941,2cyclictest0-21swapper/020:35:130
156569940,4cyclictest7811-21munin-run00:40:000
156569940,4cyclictest18995-21apt-get19:15:110
156569940,4cyclictest14758-21apt-get22:00:130
156569940,4cyclictest12703-21ssh22:47:180
156569940,4cyclictest11071-21diskmemload23:55:380
156569940,4cyclictest11071-21diskmemload22:07:150
156569940,4cyclictest0-21swapper/023:50:560
156569940,4cyclictest0-21swapper/023:40:120
156569940,4cyclictest0-21swapper/023:37:550
156569940,4cyclictest0-21swapper/023:05:120
156569940,4cyclictest0-21swapper/022:55:130
156569940,4cyclictest0-21swapper/022:40:020
156569940,4cyclictest0-21swapper/022:23:250
156569940,4cyclictest0-21swapper/021:50:030
156569940,4cyclictest0-21swapper/021:27:170
156569940,4cyclictest0-21swapper/019:59:570
156569940,4cyclictest0-21swapper/019:20:120
156569940,4cyclictest0-21swapper/000:34:170
156569940,4cyclictest0-21swapper/000:10:170
156569940,3cyclictest5719-21users20:55:190
156569940,3cyclictest4434-21ssh00:21:040
156569940,3cyclictest3949-21ssh21:38:280
156569940,3cyclictest31378-21taskset19:40:060
156569940,3cyclictest30306-21ssh23:45:140
156569940,3cyclictest28820-21cat19:35:000
156569940,3cyclictest17261-21if_eth420:15:170
156569940,3cyclictest0-21swapper/022:35:000
156569940,0cyclictest0-21swapper/023:01:150
156569940,0cyclictest0-21swapper/022:37:320
156569940,0cyclictest0-21swapper/022:10:460
156569940,0cyclictest0-21swapper/021:43:160
156669932,1cyclictest6991-21ssh21:40:123
156669932,1cyclictest30770-21ssh00:35:103
156669932,1cyclictest11453-21tr20:05:133
156669931,1cyclictest0-21swapper/319:30:133
156669930,3cyclictest32210-21sh22:25:033
156669930,3cyclictest29208-21df_inode20:40:133
156669930,3cyclictest23969-21cpuspeed20:30:113
156669930,3cyclictest19512-21df19:15:123
156669930,3cyclictest18784-21/usr/sbin/munin20:20:143
156669930,3cyclictest16584-21sh23:55:053
156669930,3cyclictest0-21swapper/322:55:103
156669930,3cyclictest0-21swapper/322:10:133
156669930,3cyclictest0-21swapper/322:05:023
156669930,3cyclictest0-21swapper/321:55:063
156669930,3cyclictest0-21swapper/321:05:073
156669930,3cyclictest0-21swapper/321:00:133
156669930,3cyclictest0-21swapper/320:55:103
156669930,3cyclictest0-21swapper/320:50:053
156669930,3cyclictest0-21swapper/320:35:153
156669930,3cyclictest0-21swapper/320:25:093
156669930,3cyclictest0-21swapper/320:10:133
156669930,3cyclictest0-21swapper/320:00:083
156669930,3cyclictest0-21swapper/319:45:133
156669930,3cyclictest0-21swapper/319:40:053
156669930,3cyclictest0-21swapper/319:35:123
156669930,3cyclictest0-21swapper/319:25:133
156669930,3cyclictest0-21swapper/319:20:053
156669930,1cyclictest3911-21/usr/sbin/munin19:50:143
156619933,0cyclictest17508-21apt-get22:50:122
156619932,1cyclictest13696-21ssh00:10:022
156619930,3cyclictest6756-21ssh23:50:072
156619930,3cyclictest6369-21apt-get21:00:132
156619930,3cyclictest29961-21rm22:40:062
156619930,3cyclictest27331-21ssh22:55:082
156619930,3cyclictest19936-21ssh22:35:122
156619930,3cyclictest1707-21expr20:50:132
156619930,3cyclictest1434-21/usr/sbin/munin19:45:132
156619930,3cyclictest0-21swapper/221:20:132
156619930,3cyclictest0-21swapper/221:05:182
156619930,3cyclictest0-21swapper/220:55:042
156619930,3cyclictest0-21swapper/220:35:122
156619930,3cyclictest0-21swapper/220:25:112
156619930,3cyclictest0-21swapper/220:15:132
156619930,3cyclictest0-21swapper/220:05:082
156619930,3cyclictest0-21swapper/219:50:082
156619930,3cyclictest0-21swapper/219:40:042
156619930,3cyclictest0-21swapper/219:35:112
156579933,0cyclictest0-21swapper/123:12:151
156579933,0cyclictest0-21swapper/122:20:101
156579933,0cyclictest0-21swapper/121:12:571
156579931,2cyclictest0-21swapper/122:45:111
156579931,1cyclictest0-21swapper/123:50:121
156579931,1cyclictest0-21swapper/123:30:121
156579931,1cyclictest0-21swapper/123:20:151
156579931,1cyclictest0-21swapper/122:35:131
156579931,1cyclictest0-21swapper/122:05:021
156579931,1cyclictest0-21swapper/122:00:131
156579931,1cyclictest0-21swapper/121:30:121
156579931,1cyclictest0-21swapper/120:30:111
156579931,1cyclictest0-21swapper/120:05:121
156579931,1cyclictest0-21swapper/119:35:111
156579931,1cyclictest0-21swapper/119:25:141
156579931,1cyclictest0-21swapper/100:35:111
156579931,1cyclictest0-21swapper/100:20:111
156579931,1cyclictest0-21swapper/100:10:151
156579931,1cyclictest0-21swapper/100:05:151
156579930,3cyclictest0-21swapper/120:11:231
156579930,2cyclictest21696-21chrt20:25:131
156579930,2cyclictest0-21swapper/122:15:121
156579930,2cyclictest0-21swapper/120:15:131
156579930,2cyclictest0-21swapper/119:50:121
156579930,2cyclictest0-21swapper/119:45:131
156579930,2cyclictest0-21swapper/119:15:101
156569932,1cyclictest714-21snmpd20:25:000
156569932,1cyclictest714-21snmpd20:10:060
156569932,1cyclictest3981-21ssh00:05:080
156569932,1cyclictest29354-21cat19:35:120
156569931,1cyclictest0-21swapper/019:50:120
156569930,3cyclictest16444-21tune2fs19:10:160
156569930,3cyclictest0-21swapper/022:25:070
156569930,3cyclictest0-21swapper/021:20:230
156569930,3cyclictest0-21swapper/021:10:070
156569930,3cyclictest0-21swapper/021:05:130
156569930,3cyclictest0-21swapper/021:00:030
156569930,3cyclictest0-21swapper/020:50:120
156569930,3cyclictest0-21swapper/020:40:120
156569930,3cyclictest0-21swapper/020:30:030
156569930,3cyclictest0-21swapper/020:05:120
156569930,3cyclictest0-21swapper/020:00:130
156569930,3cyclictest0-21swapper/019:45:130
156579921,1cyclictest237672chrt00:15:091
156579921,1cyclictest0-21swapper/123:55:121
156579921,1cyclictest0-21swapper/121:15:121
156579921,1cyclictest0-21swapper/119:40:131
156579920,1cyclictest0-21swapper/122:40:011
156579920,1cyclictest0-21swapper/121:45:121
156579920,1cyclictest0-21swapper/121:05:131
156579920,1cyclictest0-21swapper/120:40:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional