You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-22 - 03:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Wed May 22, 2024 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
177602202187,10sleep10-21swapper/119:09:281
176252193177,12sleep00-21swapper/019:07:420
175022192176,11sleep30-21swapper/319:06:083
174812186168,13sleep20-21swapper/219:05:522
241002440,0sleep10-21swapper/122:34:451
146452430,0sleep10-21swapper/123:07:441
1797699102,4cyclictest1676-21awk23:20:010
1797699102,4cyclictest1676-21awk23:20:010
31889290,0sleep10-21swapper/122:39:211
179769982,3cyclictest23365-21awk20:25:010
179769981,3cyclictest31007-21munin-run19:35:010
179769981,3cyclictest15917-21munin-run20:10:000
179769973,4cyclictest24916-21ssh22:55:010
179769962,4cyclictest61-21kswapd023:15:010
179769960,5cyclictest0-21swapper/000:00:120
179769960,3cyclictest30732-21idleruntime-cro21:40:010
179769960,1cyclictest8058-21ssh22:05:140
9026250,1sleep1211ktimersoftd/123:43:461
179899950,5cyclictest0-21swapper/323:27:553
179899950,5cyclictest0-21swapper/322:40:563
179899950,5cyclictest0-21swapper/322:38:363
179899950,5cyclictest0-21swapper/322:27:073
179899950,5cyclictest0-21swapper/322:10:133
179899950,5cyclictest0-21swapper/321:05:153
179899950,5cyclictest0-21swapper/320:20:223
179899950,4cyclictest9625-21ssh23:05:073
179899950,4cyclictest1782-21diskstats23:00:153
179899950,4cyclictest0-21swapper/322:55:143
179899950,0cyclictest0-21swapper/321:36:553
179859955,0cyclictest0-21swapper/223:05:172
179859952,3cyclictest3602-21snmpd22:21:042
179859950,5cyclictest0-21swapper/223:23:452
179859950,5cyclictest0-21swapper/222:06:392
179859950,5cyclictest0-21swapper/200:37:402
179859950,4cyclictest1995-21irqstats22:40:262
179859950,4cyclictest0-21swapper/220:35:092
179859950,0cyclictest0-21swapper/222:31:142
179809952,1cyclictest0-21swapper/121:10:101
179809951,3cyclictest0-21swapper/100:15:121
179809951,2cyclictest0-21swapper/123:55:151
179809951,2cyclictest0-21swapper/121:50:101
179809951,2cyclictest0-21swapper/100:05:121
179809950,5cyclictest0-21swapper/122:06:241
179769955,0cyclictest0-21swapper/022:36:470
179769951,4cyclictest9069-21awk23:05:000
179769951,3cyclictest22078-21ssh23:51:000
179769950,5cyclictest0-21swapper/021:53:520
179769950,5cyclictest0-21swapper/000:23:430
179769950,5cyclictest0-21swapper/000:11:040
179769950,4cyclictest9483-21apt-get23:05:010
179769950,4cyclictest0-21swapper/021:10:110
179769950,4cyclictest0-21swapper/019:25:110
14655250,0sleep00-21swapper/023:27:070
179899944,0cyclictest0-21swapper/323:41:373
179899944,0cyclictest0-21swapper/323:34:463
179899944,0cyclictest0-21swapper/300:13:203
179899943,1cyclictest27712-21ssh23:55:153
179899942,1cyclictest5683-21grep00:00:403
179899942,1cyclictest3602-21snmpd20:42:153
179899942,1cyclictest3602-21snmpd20:08:383
179899942,1cyclictest3602-21snmpd19:32:003
179899942,1cyclictest28012-21ssh00:15:143
179899942,1cyclictest19080-21awk19:10:243
179899942,1cyclictest18946-21cat22:50:313
179899942,1cyclictest12621-21ssh00:05:263
179899940,4cyclictest15184-21diskstats21:30:173
179899940,4cyclictest0-21swapper/322:49:123
179899940,4cyclictest0-21swapper/322:20:093
179899940,4cyclictest0-21swapper/322:15:143
179899940,4cyclictest0-21swapper/322:05:113
179899940,4cyclictest0-21swapper/321:20:133
179899940,4cyclictest0-21swapper/321:02:423
179899940,4cyclictest0-21swapper/319:45:103
179899940,4cyclictest0-21swapper/300:30:073
179899940,4cyclictest0-21swapper/300:25:093
179899940,3cyclictest8680-21cut19:55:013
179899940,3cyclictest7111-21cut21:45:133
179899940,3cyclictest32670-21ntp_states21:40:253
179899940,3cyclictest29348-21hddtemp_smartct20:35:153
179899940,3cyclictest27018-21ssh23:35:123
179899940,3cyclictest26572-21diskstats20:30:113
179899940,3cyclictest24912-21memory19:20:183
179899940,3cyclictest23560-21/usr/sbin/munin21:55:173
179899940,3cyclictest22111-21/usr/sbin/munin21:15:233
179899940,3cyclictest2047-21irqstats20:45:213
179899940,3cyclictest19434-21ntp_states23:10:223
179899940,3cyclictest19359-21perl20:15:183
179899940,3cyclictest19212-21/usr/sbin/munin23:50:323
179899940,3cyclictest15941-21ssh21:10:263
179899940,3cyclictest15812-21df_inode21:50:153
179899940,3cyclictest13190-21diskmemload23:23:593
179899940,3cyclictest13190-21diskmemload23:15:263
179899940,3cyclictest13190-21diskmemload23:15:263
179899940,3cyclictest1295-21aten2_r5power_c19:40:113
179899940,3cyclictest11197-21apt-get20:00:113
179899940,3cyclictest0-21swapper/323:45:033
179899940,3cyclictest0-21swapper/321:25:013
179899940,3cyclictest0-21swapper/320:55:103
179899940,3cyclictest0-21swapper/320:50:113
179859944,0cyclictest0-21swapper/223:45:522
179859944,0cyclictest0-21swapper/220:25:392
179859942,2cyclictest57250irq/125-eth000:23:402
179859942,2cyclictest3602-21snmpd23:03:132
179859942,1cyclictest509-21nscd22:25:142
179859940,4cyclictest0-21swapper/223:50:122
179859940,4cyclictest0-21swapper/223:42:032
179859940,4cyclictest0-21swapper/223:35:582
179859940,4cyclictest0-21swapper/223:18:222
179859940,4cyclictest0-21swapper/223:18:212
179859940,4cyclictest0-21swapper/223:12:582
179859940,4cyclictest0-21swapper/221:40:112
179859940,4cyclictest0-21swapper/221:35:112
179859940,4cyclictest0-21swapper/220:44:582
179859940,4cyclictest0-21swapper/220:00:122
179859940,4cyclictest0-21swapper/219:40:122
179859940,4cyclictest0-21swapper/219:30:122
179859940,4cyclictest0-21swapper/219:20:082
179859940,4cyclictest0-21swapper/200:25:002
179859940,4cyclictest0-21swapper/200:13:052
179859940,3cyclictest813-21sh21:21:022
179859940,3cyclictest653-21/usr/sbin/munin19:35:352
179859940,3cyclictest22583-21sed21:35:002
179859940,3cyclictest21774-21cut00:30:302
179859940,3cyclictest21104-21/usr/sbin/munin20:20:262
179859940,3cyclictest19891-21ntp_states20:15:262
179859940,3cyclictest18734-21apt-get23:30:142
179859940,3cyclictest12816-21users21:05:372
179859940,3cyclictest0-21swapper/222:15:132
179859940,3cyclictest0-21swapper/200:00:112
179859940,1cyclictest6165-21/usr/sbin/munin21:25:252
179859940,1cyclictest13832-21cut21:10:112
179859940,1cyclictest13662-21/usr/sbin/munin20:05:102
179859940,1cyclictest11509-21apt-get00:05:132
179859940,0cyclictest0-21swapper/200:19:472
179809944,0cyclictest0-21swapper/122:48:091
179809944,0cyclictest0-21swapper/100:28:591
179809941,2cyclictest0-21swapper/123:50:121
179809941,2cyclictest0-21swapper/123:30:151
179809941,2cyclictest0-21swapper/123:25:131
179809941,2cyclictest0-21swapper/123:20:131
179809941,2cyclictest0-21swapper/122:15:141
179809941,2cyclictest0-21swapper/121:45:131
179809941,2cyclictest0-21swapper/121:25:111
179809941,2cyclictest0-21swapper/120:20:091
179809941,2cyclictest0-21swapper/120:10:121
179809941,2cyclictest0-21swapper/120:05:101
179809941,2cyclictest0-21swapper/119:45:111
179809941,2cyclictest0-21swapper/119:20:101
179809941,2cyclictest0-21swapper/100:20:111
179809941,2cyclictest0-21swapper/100:00:121
179809941,1cyclictest0-21swapper/122:25:131
179809940,4cyclictest0-21swapper/121:35:151
179809940,2cyclictest0-21swapper/121:20:141
179809940,0cyclictest0-21swapper/122:01:441
179769944,0cyclictest0-21swapper/023:45:180
179769944,0cyclictest0-21swapper/022:25:170
179769944,0cyclictest0-21swapper/021:58:220
179769944,0cyclictest0-21swapper/000:17:450
179769943,1cyclictest16453-21cut22:10:180
179769942,1cyclictest5514-21ssh22:03:430
179769941,2cyclictest0-21swapper/020:35:100
179769941,2cyclictest0-21swapper/000:35:120
179769941,1cyclictest0-21swapper/019:40:110
179769940,4cyclictest24453-21munin-run22:35:000
179769940,4cyclictest19961-21apt-get00:30:130
179769940,4cyclictest13190-21diskmemload22:15:140
179769940,4cyclictest0-21swapper/022:55:120
179769940,4cyclictest0-21swapper/022:44:180
179769940,4cyclictest0-21swapper/021:40:100
179769940,4cyclictest0-21swapper/000:09:000
179769940,3cyclictest9665-21perl22:45:180
179769940,3cyclictest3808-21/usr/sbin/munin23:40:170
179769940,3cyclictest3764-21ssh22:21:410
179769940,3cyclictest31007-21/usr/sbin/munin20:40:090
179769940,3cyclictest26906-21apt-get23:35:100
179769940,3cyclictest24256-21perl20:25:210
179769940,3cyclictest19854-21awk20:15:240
179769940,3cyclictest15769-21/usr/sbin/munin21:30:220
179769940,3cyclictest1229-21cat19:40:010
179769940,3cyclictest11538-21ssh00:25:050
179769940,3cyclictest0-21swapper/021:21:160
179769940,1cyclictest2402-21grep20:45:260
22562230,0sleep10-21swapper/122:14:001
179899932,1cyclictest3602-21snmpd20:10:093
179899930,3cyclictest28095-21apt00:35:123
179899930,3cyclictest13190-21diskmemload00:20:023
179899930,3cyclictest0-21swapper/322:30:053
179899930,3cyclictest0-21swapper/322:00:013
179899930,3cyclictest0-21swapper/320:25:143
179899930,3cyclictest0-21swapper/319:35:133
179899930,3cyclictest0-21swapper/319:25:053
179899930,3cyclictest0-21swapper/319:15:013
179899930,2cyclictest86952sleep319:55:053
179899930,2cyclictest86952sleep319:55:053
179859933,0cyclictest23572-21apt-get21:55:122
179859933,0cyclictest0-21swapper/220:45:162
179859933,0cyclictest0-21swapper/219:15:102
179859932,1cyclictest16084-21apt-get22:10:142
179859931,2cyclictest57250irq/125-eth021:15:022
179859931,2cyclictest502-21irqbalance22:35:012
179859930,3cyclictest5047-21python20:50:262
179859930,3cyclictest3863-21cut19:45:122
179859930,3cyclictest18001-21users20:10:302
179859930,3cyclictest15837-21entropy21:50:152
179859930,3cyclictest0-21swapper/223:55:002
179859930,3cyclictest0-21swapper/223:25:022
179859930,3cyclictest0-21swapper/222:55:042
179859930,3cyclictest0-21swapper/222:00:132
179859930,3cyclictest0-21swapper/221:00:202
179859930,3cyclictest0-21swapper/220:55:152
179859930,3cyclictest0-21swapper/220:30:042
179859930,3cyclictest0-21swapper/219:55:132
179859930,3cyclictest0-21swapper/219:55:132
179859930,3cyclictest0-21swapper/219:50:092
179859930,3cyclictest0-21swapper/219:25:102
179859930,3cyclictest0-21swapper/219:10:142
179859930,1cyclictest6787-21ssh21:45:022
179859930,1cyclictest0-21swapper/222:45:092
179859930,0cyclictest17096-21apt-get22:50:112
179809933,0cyclictest0-21swapper/119:35:381
179809933,0cyclictest0-21swapper/100:34:131
179809931,2cyclictest0-21swapper/119:50:101
179809931,1cyclictest0-21swapper/123:45:121
179809931,1cyclictest0-21swapper/123:35:091
179809931,1cyclictest0-21swapper/123:10:091
179809931,1cyclictest0-21swapper/122:55:131
179809931,1cyclictest0-21swapper/122:50:111
179809931,1cyclictest0-21swapper/122:20:081
179809931,1cyclictest0-21swapper/120:55:111
179809931,1cyclictest0-21swapper/120:50:111
179809931,1cyclictest0-21swapper/120:45:101
179809931,1cyclictest0-21swapper/120:40:081
179809931,1cyclictest0-21swapper/120:30:091
179809931,1cyclictest0-21swapper/120:25:151
179809931,1cyclictest0-21swapper/119:40:121
179809931,1cyclictest0-21swapper/119:25:111
179809931,1cyclictest0-21swapper/100:35:111
179809931,1cyclictest0-21swapper/100:10:131
179809930,2cyclictest29827-21chrt21:19:551
179809930,2cyclictest234112sleep121:55:061
179809930,2cyclictest0-21swapper/123:15:131
179809930,2cyclictest0-21swapper/123:15:121
179809930,2cyclictest0-21swapper/121:00:121
179769932,1cyclictest18539-21ssh23:30:050
179769930,3cyclictest20619-21cat19:15:010
179769930,3cyclictest0-21swapper/023:55:100
179769930,3cyclictest0-21swapper/023:20:110
179769930,3cyclictest0-21swapper/021:45:120
179769930,3cyclictest0-21swapper/021:25:110
179769930,3cyclictest0-21swapper/021:15:010
179769930,3cyclictest0-21swapper/021:05:150
179769930,3cyclictest0-21swapper/021:00:120
179769930,3cyclictest0-21swapper/020:55:100
179769930,3cyclictest0-21swapper/020:50:100
179769930,3cyclictest0-21swapper/020:30:090
179769930,3cyclictest0-21swapper/020:10:120
179769930,3cyclictest0-21swapper/020:00:110
179769930,3cyclictest0-21swapper/019:55:130
179769930,3cyclictest0-21swapper/019:55:130
179769930,3cyclictest0-21swapper/019:50:100
179769930,3cyclictest0-21swapper/019:45:110
179769930,3cyclictest0-21swapper/019:20:130
179769930,3cyclictest0-21swapper/019:10:130
179809921,1cyclictest0-21swapper/122:40:131
179809921,1cyclictest0-21swapper/121:40:111
179809921,1cyclictest0-21swapper/120:35:101
179809921,1cyclictest0-21swapper/119:30:111
179809920,2cyclictest8698-21taskset19:55:061
179809920,2cyclictest8698-21taskset19:55:061
179809920,1cyclictest0-21swapper/123:00:121
179809920,1cyclictest0-21swapper/121:30:131
179809920,1cyclictest0-21swapper/121:05:141
179809920,1cyclictest0-21swapper/120:15:131
179809920,1cyclictest0-21swapper/120:00:131
179809920,1cyclictest0-21swapper/119:15:101
179809920,1cyclictest0-21swapper/119:10:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional