You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-10 - 21:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Thu Oct 10, 2024 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
290162195179,11sleep10-21swapper/107:07:361
290602186167,14sleep00-21swapper/007:08:110
291152178161,12sleep30-21swapper/307:08:543
291562175157,13sleep20-21swapper/207:09:242
100262450,0sleep30-21swapper/309:18:013
172092430,0sleep30-21swapper/312:24:563
23052420,0sleep10-21swapper/110:34:491
22242420,0sleep20-21swapper/209:30:132
22242420,0sleep20-21swapper/209:30:132
306542410,0sleep30-21swapper/312:33:133
306542410,0sleep30-21swapper/312:33:123
136312120,0sleep10-21swapper/110:55:391
100662100,0sleep10-21swapper/109:50:131
293799981,5cyclictest0-21swapper/308:50:123
293669960,5cyclictest0-21swapper/011:18:060
293669960,5cyclictest0-21swapper/010:45:110
293669960,3cyclictest29357-21cyclictest12:15:000
15293260,0sleep00-21swapper/010:56:420
4818250,0sleep10-21swapper/111:07:521
293799955,0cyclictest40-21ksoftirqd/311:05:003
293799955,0cyclictest0-21swapper/311:59:593
293799954,1cyclictest40-21ksoftirqd/311:25:103
293799954,1cyclictest40-21ksoftirqd/308:05:103
293799954,1cyclictest40-21ksoftirqd/308:04:593
293799952,1cyclictest25833-21ssh09:41:273
293799950,3cyclictest4787-21ssh11:40:143
293759955,0cyclictest0-21swapper/212:07:062
293759955,0cyclictest0-21swapper/211:21:072
293759955,0cyclictest0-21swapper/207:55:132
293759954,1cyclictest31-21ksoftirqd/208:20:002
293759950,5cyclictest0-21swapper/212:39:592
293759950,5cyclictest0-21swapper/211:28:502
293759950,5cyclictest0-21swapper/209:22:232
293759950,5cyclictest0-21swapper/208:50:122
293759950,4cyclictest18204-21apt-get08:55:012
293759950,0cyclictest0-21swapper/211:03:222
293709951,3cyclictest0-21swapper/111:45:111
293709951,2cyclictest0-21swapper/110:00:101
293709950,5cyclictest0-21swapper/112:16:481
293709950,5cyclictest0-21swapper/110:05:251
293669951,3cyclictest30997-21snmpd08:54:130
293669951,3cyclictest30589-21ssh10:00:110
293669950,5cyclictest0-21swapper/012:07:100
293669950,5cyclictest0-21swapper/012:01:180
293669950,5cyclictest0-21swapper/009:00:010
293669950,5cyclictest0-21swapper/007:15:010
293669950,4cyclictest21218-21perl07:55:130
293669950,4cyclictest14050-21apt-get11:45:110
293669950,4cyclictest0-21swapper/010:40:100
293669950,4cyclictest0-21swapper/010:35:110
293669950,4cyclictest0-21swapper/007:30:110
293669950,1cyclictest30634-21perf11:05:000
3504240,0sleep20-21swapper/209:15:072
293799944,0cyclictest40-21ksoftirqd/311:35:103
293799944,0cyclictest40-21ksoftirqd/310:25:123
293799944,0cyclictest40-21ksoftirqd/310:10:113
293799944,0cyclictest40-21ksoftirqd/310:10:003
293799944,0cyclictest40-21ksoftirqd/310:00:113
293799944,0cyclictest40-21ksoftirqd/309:40:013
293799944,0cyclictest40-21ksoftirqd/308:55:113
293799944,0cyclictest40-21ksoftirqd/307:30:113
293799944,0cyclictest0-21swapper/310:32:063
293799944,0cyclictest0-21swapper/309:52:413
293799944,0cyclictest0-21swapper/309:25:013
293799943,1cyclictest2135-21tr09:30:133
293799943,1cyclictest2135-21tr09:30:133
293799942,2cyclictest40-21ksoftirqd/311:17:193
293799942,2cyclictest40-21ksoftirqd/307:15:013
293799942,1cyclictest10932-21df_inode07:35:113
293799941,3cyclictest0-21swapper/310:17:563
293799941,2cyclictest0-21swapper/309:10:143
293799940,4cyclictest0-21swapper/312:39:523
293799940,4cyclictest0-21swapper/312:28:273
293799940,4cyclictest0-21swapper/311:20:013
293799940,4cyclictest0-21swapper/311:05:113
293799940,4cyclictest0-21swapper/310:55:103
293799940,4cyclictest0-21swapper/310:40:503
293799940,4cyclictest0-21swapper/310:20:113
293799940,4cyclictest0-21swapper/309:45:123
293799940,4cyclictest0-21swapper/309:20:113
293799940,4cyclictest0-21swapper/308:25:103
293799940,4cyclictest0-21swapper/307:40:113
293799940,3cyclictest8566-21sh12:19:363
293799940,3cyclictest7856-21sort07:30:003
293799940,3cyclictest411-21ls08:20:003
293799940,3cyclictest29494-21apt-get07:10:113
293799940,3cyclictest22922-21wc08:00:003
293799940,3cyclictest1308-21date12:15:013
293799940,3cyclictest13059-21apt-get08:45:013
293799940,3cyclictest1291-21apt-config11:55:013
293799940,1cyclictest593-21cut08:20:123
293799940,1cyclictest4387-21if_eth410:35:153
293799940,1cyclictest17083-21grep11:30:143
293799940,0cyclictest0-21swapper/310:49:083
293759944,0cyclictest27236-21ssh09:42:192
293759943,1cyclictest31-21ksoftirqd/207:15:012
293759943,1cyclictest28227-21wc11:35:182
293759941,3cyclictest30997-21snmpd10:10:052
293759941,2cyclictest0-21swapper/210:30:122
293759940,4cyclictest27948-21apt-get08:10:112
293759940,4cyclictest25257-21munin-run08:05:002
293759940,4cyclictest11924-21ssh11:11:032
293759940,4cyclictest0-21swapper/212:25:272
293759940,4cyclictest0-21swapper/212:16:302
293759940,4cyclictest0-21swapper/212:11:032
293759940,4cyclictest0-21swapper/211:46:512
293759940,4cyclictest0-21swapper/211:30:122
293759940,4cyclictest0-21swapper/211:15:112
293759940,4cyclictest0-21swapper/210:45:112
293759940,4cyclictest0-21swapper/210:25:122
293759940,4cyclictest0-21swapper/210:16:482
293759940,4cyclictest0-21swapper/210:05:442
293759940,4cyclictest0-21swapper/209:50:462
293759940,4cyclictest0-21swapper/209:45:112
293759940,4cyclictest0-21swapper/209:11:142
293759940,4cyclictest0-21swapper/208:20:112
293759940,4cyclictest0-21swapper/207:50:122
293759940,4cyclictest0-21swapper/207:45:102
293759940,4cyclictest0-21swapper/207:35:102
293759940,4cyclictest0-21swapper/207:30:112
293759940,3cyclictest7177-21latency_hist10:05:002
293759940,3cyclictest6003-21df_inode07:25:132
293759940,3cyclictest4122-21ssh11:40:122
293759940,3cyclictest30481-21ssh11:53:082
293759940,3cyclictest2996-21dpkg10:35:012
293759940,3cyclictest28656-21ssh12:31:572
293759940,3cyclictest28656-21ssh12:31:572
293759940,3cyclictest26611-21ssh09:25:372
293759940,3cyclictest25576-21ssh09:10:012
293759940,3cyclictest14186-21perl10:40:142
293759940,3cyclictest11562-21ssh10:22:532
293759940,3cyclictest0-21swapper/207:10:112
293759940,1cyclictest1620-21df_inode10:50:122
293709944,0cyclictest0-21swapper/112:11:251
293709944,0cyclictest0-21swapper/112:02:591
293709944,0cyclictest0-21swapper/111:22:151
293709944,0cyclictest0-21swapper/109:41:331
293709944,0cyclictest0-21swapper/109:28:281
293709944,0cyclictest0-21swapper/109:23:051
293709941,2cyclictest0-21swapper/111:35:101
293709941,2cyclictest0-21swapper/111:15:121
293709941,2cyclictest0-21swapper/111:00:121
293709941,2cyclictest0-21swapper/110:45:111
293709941,2cyclictest0-21swapper/110:10:111
293709941,2cyclictest0-21swapper/109:55:111
293709941,2cyclictest0-21swapper/109:15:111
293709941,2cyclictest0-21swapper/109:05:111
293709941,2cyclictest0-21swapper/109:00:091
293709941,2cyclictest0-21swapper/108:45:101
293709941,2cyclictest0-21swapper/108:35:111
293709941,2cyclictest0-21swapper/108:30:111
293709941,2cyclictest0-21swapper/108:15:121
293709941,2cyclictest0-21swapper/107:50:121
293709941,2cyclictest0-21swapper/107:45:101
293709940,4cyclictest0-21swapper/112:39:041
293709940,2cyclictest0-21swapper/111:50:121
293709940,2cyclictest0-21swapper/109:10:141
293709940,2cyclictest0-21swapper/107:15:101
293709940,2cyclictest0-21swapper/107:10:111
293709940,0cyclictest0-21swapper/110:37:171
293709940,0cyclictest0-21swapper/109:36:091
293669944,0cyclictest0-21swapper/012:31:010
293669944,0cyclictest0-21swapper/012:31:000
293669944,0cyclictest0-21swapper/008:35:170
293669942,1cyclictest0-21swapper/008:40:110
293669941,3cyclictest24046-21/usr/sbin/munin09:25:180
293669941,2cyclictest0-21swapper/010:05:110
293669941,1cyclictest0-21swapper/010:29:550
293669940,4cyclictest7685-21munin-run08:35:000
293669940,4cyclictest12908-21apt-get07:40:110
293669940,4cyclictest0-21swapper/011:35:100
293669940,4cyclictest0-21swapper/011:28:230
293669940,4cyclictest0-21swapper/010:50:110
293669940,4cyclictest0-21swapper/009:55:110
293669940,4cyclictest0-21swapper/009:49:500
293669940,4cyclictest0-21swapper/009:30:470
293669940,4cyclictest0-21swapper/009:30:470
293669940,4cyclictest0-21swapper/009:19:060
293669940,4cyclictest0-21swapper/008:55:090
293669940,4cyclictest0-21swapper/008:15:120
293669940,3cyclictest9577-21sh12:20:050
293669940,3cyclictest8761-21basename11:10:100
293669940,3cyclictest31106-21apt-get11:05:110
293669940,3cyclictest28907-21if_eth408:10:150
293669940,3cyclictest27047-21irqstats09:10:180
293669940,3cyclictest2573-21ssh12:15:460
293669940,3cyclictest25298-21ssh12:29:570
293669940,3cyclictest23176-21apt09:05:110
293669940,3cyclictest21805-21rm09:40:060
293669940,3cyclictest13791-21apt-get09:20:110
293669940,3cyclictest1194-21ssh10:17:410
293669940,3cyclictest11883-21ssh09:35:120
293669940,3cyclictest0-21swapper/011:30:110
293669940,3cyclictest0-21swapper/008:20:110
293669940,3cyclictest0-21swapper/008:05:100
293799933,0cyclictest40-21ksoftirqd/308:10:113
293799932,1cyclictest9763-21ssh12:00:093
293799932,1cyclictest20936-21grep09:00:093
293799932,0cyclictest13831-21ssh11:45:033
293799931,2cyclictest57250irq/125-eth010:50:053
293799930,3cyclictest5967-21diskstats08:30:123
293799930,3cyclictest0-21swapper/311:10:113
293799930,3cyclictest0-21swapper/309:05:023
293799930,3cyclictest0-21swapper/308:40:103
293799930,3cyclictest0-21swapper/308:35:113
293799930,3cyclictest0-21swapper/307:50:113
293799930,3cyclictest0-21swapper/307:45:013
293799930,3cyclictest0-21swapper/307:20:113
293799930,2cyclictest19988-21/usr/sbin/munin09:55:113
293799930,1cyclictest18055-21ssh12:05:153
293759931,1cyclictest30997-21snmpd07:20:402
293759930,3cyclictest9527-21ssh12:20:032
293759930,3cyclictest30844-21ssh11:05:012
293759930,3cyclictest26200-21perl08:05:132
293759930,3cyclictest1007-21apt-get11:55:012
293759930,3cyclictest0-21swapper/212:00:112
293759930,3cyclictest0-21swapper/210:55:052
293759930,3cyclictest0-21swapper/209:55:022
293759930,3cyclictest0-21swapper/209:35:122
293759930,3cyclictest0-21swapper/209:00:082
293759930,3cyclictest0-21swapper/208:45:012
293759930,3cyclictest0-21swapper/208:40:112
293759930,3cyclictest0-21swapper/208:35:112
293759930,3cyclictest0-21swapper/208:30:112
293759930,3cyclictest0-21swapper/208:25:102
293759930,3cyclictest0-21swapper/207:40:052
293709931,2cyclictest0-21swapper/110:50:111
293709931,2cyclictest0-21swapper/109:30:111
293709931,2cyclictest0-21swapper/109:30:111
293709931,2cyclictest0-21swapper/107:30:111
293709931,1cyclictest0-21swapper/111:55:011
293709931,1cyclictest0-21swapper/111:40:121
293709931,1cyclictest0-21swapper/111:30:111
293709931,1cyclictest0-21swapper/111:10:111
293709931,1cyclictest0-21swapper/110:40:111
293709931,1cyclictest0-21swapper/110:20:111
293709931,1cyclictest0-21swapper/108:40:111
293709931,1cyclictest0-21swapper/108:25:101
293709931,1cyclictest0-21swapper/108:05:101
293709931,1cyclictest0-21swapper/107:55:111
293709931,1cyclictest0-21swapper/107:35:101
293709931,1cyclictest0-21swapper/107:20:101
293709930,3cyclictest0-21swapper/108:10:271
293709930,2cyclictest25793-21chrt12:30:071
293709930,2cyclictest25793-21chrt12:30:071
293709930,2cyclictest12465-21chrt12:21:541
293709930,2cyclictest0-21swapper/111:25:101
293709930,2cyclictest0-21swapper/110:15:101
293709930,2cyclictest0-21swapper/108:50:121
293709930,2cyclictest0-21swapper/108:20:111
293709930,2cyclictest0-21swapper/108:00:111
293709930,1cyclictest0-21swapper/109:45:121
293669932,1cyclictest3518-21cut08:25:120
293669932,1cyclictest23875-21ssh11:50:060
293669930,3cyclictest9530-21apt-config09:50:020
293669930,3cyclictest25426-21diskmemload11:40:120
293669930,3cyclictest0-21swapper/012:35:030
293669930,3cyclictest0-21swapper/011:55:010
293669930,3cyclictest0-21swapper/011:20:010
293669930,3cyclictest0-21swapper/010:30:100
293669930,3cyclictest0-21swapper/010:20:060
293669930,3cyclictest0-21swapper/010:10:110
293669930,3cyclictest0-21swapper/008:45:010
293669930,3cyclictest0-21swapper/008:00:110
293669930,3cyclictest0-21swapper/007:50:110
293669930,3cyclictest0-21swapper/007:45:010
293669930,3cyclictest0-21swapper/007:35:100
293669930,3cyclictest0-21swapper/007:25:120
293669930,3cyclictest0-21swapper/007:20:110
293669930,3cyclictest0-21swapper/007:10:110
293709922,0cyclictest0-21swapper/112:25:151
293709921,1cyclictest0-21swapper/108:55:011
293709921,1cyclictest0-21swapper/107:40:111
293709921,1cyclictest0-21swapper/107:25:121
293709920,1cyclictest17732-21chrt12:05:051
293709920,1cyclictest0-21swapper/110:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional