You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 03:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot2.osadl.org (updated Sat Aug 30, 2025 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
219552205190,10sleep10-21swapper/119:07:081
220062181164,12sleep00-21swapper/019:07:470
199502178162,11sleep30-21swapper/319:05:043
220482176158,13sleep20-21swapper/219:08:212
219202570,0sleep20-21swapper/221:27:212
230812480,1sleep0111rcuc/021:11:450
188742480,0sleep10-21swapper/121:41:571
130072480,0sleep00-21swapper/023:16:320
146392470,0sleep10-21swapper/119:55:141
69362460,0sleep10-21swapper/121:35:451
27552440,0sleep10-21swapper/100:17:021
77282430,0sleep10-21swapper/122:41:141
254672120,1sleep1211ktimersoftd/121:13:151
2233999103,3cyclictest5829-21basename23:30:000
223399982,3cyclictest27990-21perf19:20:000
223399980,4cyclictest30871-21munin-run20:30:000
223399973,4cyclictest3422-21basename20:40:000
223399970,4cyclictest27176-21munin-run00:30:000
223399970,3cyclictest18275-21diskmemload23:15:000
223449960,5cyclictest1137-21/usr/sbin/munin20:35:172
223399963,3cyclictest0-21swapper/022:25:140
223399963,3cyclictest0-21swapper/020:05:140
223399960,6cyclictest22604-21taskset21:44:180
223399960,6cyclictest0-21swapper/019:10:140
223399960,3cyclictest2964-21munin-run19:35:000
223489955,0cyclictest18275-21diskmemload23:33:213
223489952,3cyclictest11116-21grep23:15:213
223489951,3cyclictest29836-21ssh23:58:093
223489951,2cyclictest0-21swapper/319:10:133
223489950,5cyclictest0-21swapper/322:58:173
223489950,5cyclictest0-21swapper/322:08:323
223489950,5cyclictest0-21swapper/321:44:583
223489950,4cyclictest11233-21apt-get19:50:013
223489950,0cyclictest18275-21diskmemload22:34:353
223489950,0cyclictest18275-21diskmemload00:22:153
223449951,4cyclictest0-21swapper/221:50:142
223449950,5cyclictest0-21swapper/222:25:042
223449950,5cyclictest0-21swapper/221:20:132
223449950,4cyclictest31097-21apt-get20:30:122
223449950,4cyclictest28743-21irqstats00:30:152
223409950,5cyclictest0-21swapper/122:05:161
223409950,5cyclictest0-21swapper/100:12:001
223399952,3cyclictest32412-21ssh21:16:100
223399952,3cyclictest0-21swapper/023:54:180
223399952,3cyclictest0-21swapper/023:35:180
223399952,3cyclictest0-21swapper/023:30:180
223399952,3cyclictest0-21swapper/021:25:180
223399952,3cyclictest0-21swapper/021:22:580
223399952,3cyclictest0-21swapper/000:31:450
223399952,3cyclictest0-21swapper/000:00:180
223399950,5cyclictest19178-21ssh21:58:420
223399950,5cyclictest19178-21ssh21:58:420
223399950,5cyclictest10132-21ssh22:59:180
223399950,5cyclictest0-21swapper/023:22:460
223399950,5cyclictest0-21swapper/023:05:130
223399950,5cyclictest0-21swapper/022:41:490
223399950,5cyclictest0-21swapper/022:35:180
223399950,5cyclictest0-21swapper/022:33:580
223399950,5cyclictest0-21swapper/022:20:020
223399950,5cyclictest0-21swapper/022:12:220
223399950,5cyclictest0-21swapper/022:06:500
223399950,5cyclictest0-21swapper/022:00:060
223399950,5cyclictest0-21swapper/021:30:220
223399950,5cyclictest0-21swapper/000:24:100
223399950,5cyclictest0-21swapper/000:15:180
223399950,0cyclictest6450-21ssh23:45:500
223399950,0cyclictest12441-21ssh23:00:140
223399950,0cyclictest0-21swapper/023:41:340
223399950,0cyclictest0-21swapper/022:50:220
223399950,0cyclictest0-21swapper/021:46:220
223399950,0cyclictest0-21swapper/019:25:180
223489944,0cyclictest0-21swapper/322:50:093
223489944,0cyclictest0-21swapper/321:21:583
223489944,0cyclictest0-21swapper/319:40:143
223489943,1cyclictest30997-21snmpd21:30:223
223489942,1cyclictest31320-21ssh23:10:013
223489942,1cyclictest28610-21ssh23:25:003
223489941,2cyclictest0-21swapper/300:05:163
223489941,1cyclictest0-21swapper/322:20:103
223489940,4cyclictest3196-21apt-get19:35:133
223489940,4cyclictest28213-21df_inode00:30:113
223489940,4cyclictest18275-21diskmemload23:03:013
223489940,4cyclictest18275-21diskmemload21:59:013
223489940,4cyclictest18275-21diskmemload21:59:013
223489940,4cyclictest0-21swapper/323:45:063
223489940,4cyclictest0-21swapper/323:40:043
223489940,4cyclictest0-21swapper/323:36:543
223489940,4cyclictest0-21swapper/322:48:283
223489940,4cyclictest0-21swapper/322:40:123
223489940,4cyclictest0-21swapper/322:25:133
223489940,4cyclictest0-21swapper/322:17:213
223489940,4cyclictest0-21swapper/321:39:423
223489940,4cyclictest0-21swapper/321:10:123
223489940,4cyclictest0-21swapper/320:40:133
223489940,4cyclictest0-21swapper/319:15:403
223489940,4cyclictest0-21swapper/300:35:123
223489940,4cyclictest0-21swapper/300:15:123
223489940,4cyclictest0-21swapper/300:12:443
223489940,4cyclictest0-21swapper/300:00:123
223489940,3cyclictest9307-21ssh22:10:123
223489940,3cyclictest9118-21diskstats20:50:113
223489940,3cyclictest29473-21ntp_states19:20:183
223489940,3cyclictest29104-21/usr/sbin/munin21:15:223
223489940,3cyclictest20939-21latency_hist20:09:593
223489940,3cyclictest19907-21sh21:26:053
223489940,3cyclictest1987-21ntp_states19:30:183
223489940,3cyclictest17568-21ssh00:25:023
223489940,3cyclictest17502-21mailstats21:05:193
223489940,3cyclictest11068-21apt20:55:143
223489940,3cyclictest0-21swapper/319:25:113
223449944,0cyclictest0-21swapper/223:27:032
223449944,0cyclictest0-21swapper/222:31:022
223449944,0cyclictest0-21swapper/221:17:242
223449944,0cyclictest0-21swapper/200:16:492
223449944,0cyclictest0-21swapper/200:04:442
223449943,1cyclictest31-21ksoftirqd/223:00:122
223449942,2cyclictest0-21swapper/223:15:122
223449942,1cyclictest8903-21ssh23:30:402
223449942,1cyclictest29111-21cat19:20:152
223449942,1cyclictest19208-21/usr/sbin/munin22:15:122
223449940,4cyclictest32534-21perl22:05:142
223449940,4cyclictest24311-21sh22:50:102
223449940,4cyclictest20641-21apt-get00:10:142
223449940,4cyclictest18696-21/usr/sbin/munin20:05:132
223449940,4cyclictest0-21swapper/222:40:122
223449940,4cyclictest0-21swapper/220:10:122
223449940,4cyclictest0-21swapper/200:25:132
223449940,4cyclictest0-21swapper/200:06:522
223449940,3cyclictest9091-21sh22:10:042
223449940,3cyclictest4917-21sh00:35:042
223449940,3cyclictest4908-21ntp_states20:40:172
223449940,3cyclictest30598-21ssh23:41:502
223449940,3cyclictest29153-21diskstats20:25:132
223449940,3cyclictest27775-21/usr/sbin/munin22:35:172
223449940,3cyclictest26782-21aten2_r5power_e21:30:142
223449940,3cyclictest25287-21diskstats19:15:012
223449940,3cyclictest2487-21diskstats22:55:162
223449940,3cyclictest24329-21/usr/sbin/munin21:45:172
223449940,3cyclictest23096-21ssh23:55:012
223449940,3cyclictest22629-21perl22:00:152
223449940,3cyclictest22611-21which23:05:152
223449940,3cyclictest21928-21sh21:11:032
223449940,3cyclictest15046-21perl21:40:142
223449940,3cyclictest14952-21df_inode22:45:132
223449940,3cyclictest1211-21grep23:10:222
223449940,3cyclictest11773-21df19:50:132
223449940,3cyclictest0-21swapper/222:20:102
223449940,3cyclictest0-21swapper/219:40:012
223449940,1cyclictest4265-21/usr/sbin/munin21:35:172
223449940,1cyclictest3633-21/usr/sbin/munin23:45:162
223449940,1cyclictest23653-21/usr/sbin/munin20:15:242
223449940,1cyclictest13561-21/usr/sbin/munin21:00:142
223449940,0cyclictest0-21swapper/200:20:362
223409944,0cyclictest0-21swapper/123:45:311
223409944,0cyclictest0-21swapper/122:28:241
223409944,0cyclictest0-21swapper/119:47:281
223409944,0cyclictest0-21swapper/100:28:351
223409941,2cyclictest0-21swapper/123:00:121
223409941,2cyclictest0-21swapper/122:00:131
223409941,2cyclictest0-21swapper/119:30:121
223409941,2cyclictest0-21swapper/119:15:111
223409940,4cyclictest0-21swapper/123:22:581
223409940,4cyclictest0-21swapper/121:47:301
223409940,4cyclictest0-21swapper/121:27:271
223409940,4cyclictest0-21swapper/120:54:501
223409940,4cyclictest0-21swapper/120:42:111
223409940,2cyclictest0-21swapper/120:35:121
223409940,0cyclictest0-21swapper/122:52:161
223409940,0cyclictest0-21swapper/121:33:251
223399944,0cyclictest0-21swapper/000:06:150
223399942,2cyclictest0-21swapper/022:16:180
223399941,3cyclictest0-21swapper/022:46:060
223399941,3cyclictest0-21swapper/021:35:140
223399941,3cyclictest0-21swapper/020:45:180
223399941,3cyclictest0-21swapper/019:35:210
223399941,3cyclictest0-21swapper/000:36:290
223399941,2cyclictest0-21swapper/021:05:130
223399940,4cyclictest10842-21munin-run20:55:000
223399940,4cyclictest0-21swapper/023:56:500
223399940,4cyclictest0-21swapper/020:15:160
223399940,4cyclictest0-21swapper/020:00:130
223399940,4cyclictest0-21swapper/019:45:100
223399940,4cyclictest0-21swapper/000:10:150
223399940,3cyclictest8324-21cat19:45:000
223399940,3cyclictest28384-21latency_hist20:25:000
223399940,3cyclictest16009-21sed21:05:000
223399940,3cyclictest0-21swapper/021:50:200
3759230,0sleep10-21swapper/100:34:291
27171230,0sleep10-21swapper/123:40:151
223489931,1cyclictest0-21swapper/320:20:123
223489930,3cyclictest24100-21ls20:15:173
223489930,3cyclictest21765-21ssh22:00:113
223489930,3cyclictest1597-21ssh21:50:043
223489930,3cyclictest0-21swapper/323:50:133
223489930,3cyclictest0-21swapper/323:20:073
223489930,3cyclictest0-21swapper/323:05:123
223489930,3cyclictest0-21swapper/321:45:163
223489930,3cyclictest0-21swapper/320:45:133
223489930,3cyclictest0-21swapper/320:35:123
223489930,3cyclictest0-21swapper/320:30:133
223489930,3cyclictest0-21swapper/320:25:123
223489930,3cyclictest0-21swapper/320:10:123
223489930,3cyclictest0-21swapper/320:00:133
223489930,3cyclictest0-21swapper/319:55:123
223489930,3cyclictest0-21swapper/319:45:013
223489930,2cyclictest13561-21/usr/sbin/munin21:00:193
223489930,1cyclictest26773-21apt-get22:35:143
223449932,1cyclictest22753-21cat19:10:142
223449931,1cyclictest0-21swapper/219:55:122
223449930,3cyclictest8985-21expr19:45:112
223449930,3cyclictest16614-21expr20:00:142
223449930,3cyclictest0-21swapper/223:50:112
223449930,3cyclictest0-21swapper/221:55:132
223449930,3cyclictest0-21swapper/221:55:132
223449930,3cyclictest0-21swapper/221:05:172
223449930,3cyclictest0-21swapper/220:55:572
223449930,3cyclictest0-21swapper/220:50:092
223449930,3cyclictest0-21swapper/220:45:102
223449930,3cyclictest0-21swapper/220:20:092
223449930,3cyclictest0-21swapper/219:35:132
223449930,3cyclictest0-21swapper/219:30:122
223449930,3cyclictest0-21swapper/219:25:062
223449930,2cyclictest16081-21ssh23:35:042
223449930,0cyclictest19082-21apt-get23:20:152
223409933,0cyclictest0-21swapper/121:56:241
223409933,0cyclictest0-21swapper/121:56:241
223409933,0cyclictest0-21swapper/120:15:161
223409933,0cyclictest0-21swapper/120:14:321
223409933,0cyclictest0-21swapper/100:20:181
223409933,0cyclictest0-21swapper/100:08:131
223409931,1cyclictest0-21swapper/123:50:101
223409931,1cyclictest0-21swapper/123:35:111
223409931,1cyclictest0-21swapper/123:30:131
223409931,1cyclictest0-21swapper/123:10:131
223409931,1cyclictest0-21swapper/123:05:121
223409931,1cyclictest0-21swapper/122:45:121
223409931,1cyclictest0-21swapper/122:35:141
223409931,1cyclictest0-21swapper/122:20:101
223409931,1cyclictest0-21swapper/121:50:141
223409930,3cyclictest0-21swapper/120:48:091
223409930,2cyclictest9064-21chrt00:36:321
223409930,2cyclictest0-21swapper/123:55:121
223409930,2cyclictest0-21swapper/122:55:151
223409930,2cyclictest0-21swapper/122:30:131
223409930,2cyclictest0-21swapper/120:25:121
223409930,2cyclictest0-21swapper/119:35:131
223409930,1cyclictest0-21swapper/120:20:111
223409930,0cyclictest0-21swapper/119:10:571
223399930,3cyclictest0-21swapper/020:55:100
223399930,3cyclictest0-21swapper/020:40:090
223399930,3cyclictest0-21swapper/020:30:100
223399930,3cyclictest0-21swapper/020:10:210
223399930,3cyclictest0-21swapper/019:55:120
223399930,3cyclictest0-21swapper/019:50:000
223399930,3cyclictest0-21swapper/019:20:000
223409921,1cyclictest287562chrt23:25:051
223409921,1cyclictest0-21swapper/122:15:101
223409921,1cyclictest0-21swapper/122:10:141
223409921,1cyclictest0-21swapper/121:00:121
223409921,1cyclictest0-21swapper/119:40:141
223409920,1cyclictest538-21chrt00:00:011
223409920,1cyclictest0-21swapper/123:15:121
223409920,1cyclictest0-21swapper/121:20:131
223409920,1cyclictest0-21swapper/121:15:031
223409920,1cyclictest0-21swapper/121:05:131
223409920,1cyclictest0-21swapper/120:55:141
223409920,1cyclictest0-21swapper/120:30:121
223409920,1cyclictest0-21swapper/120:05:121
223409920,1cyclictest0-21swapper/120:00:131
223409920,1cyclictest0-21swapper/119:50:011
223409920,1cyclictest0-21swapper/119:25:111
223409920,1cyclictest0-21swapper/119:20:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional