You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 23:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Fri Apr 26, 2024 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
69491899122110,9cyclictest722474-21latency_hist08:40:011
6949159911599,5cyclictest701217-21kworker/u8:0+flush-179:008:15:010
6949159911599,5cyclictest701217-21kworker/u8:0+flush-179:008:15:010
69491599110102,6cyclictest698029-21kworker/u8:1+flush-179:007:25:010
694915991100,107cyclictest1-21systemd11:40:000
69491599109101,6cyclictest705479-21kworker/u8:1+events_unbound07:45:030
69491599108102,4cyclictest748162-21kworker/u8:1+flush-179:012:15:250
6949189910799,5cyclictest748202-21apt-get10:00:031
6949159910595,7cyclictest750047-21latency_hist10:05:010
6949189910494,7cyclictest702828-21latency_hist07:35:011
69491599104100,3cyclictest701217-21kworker/u8:0+flush-179:008:15:270
6949159910394,6cyclictest748162-21kworker/u8:1+flush-179:010:00:000
694915991030,100cyclictest1-21systemd12:35:000
6949189910294,6cyclictest748162-21kworker/u8:1+events_unbound10:05:181
6949189910294,5cyclictest739377-21kworker/u8:2+flush-179:010:30:241
6949189910194,4cyclictest768029-21kworker/u8:3+flush-179:011:00:261
6949189910094,5cyclictest736841-21kworker/u8:0+flush-179:009:25:001
6949189910090,7cyclictest701217-21kworker/u8:0+flush-179:007:40:001
694918999992,5cyclictest529-21rs:main1
694915999991,6cyclictest702863-21kworker/u8:2+flush-179:007:40:240
694918999893,4cyclictest748162-21kworker/u8:1+flush-179:011:40:011
694918999887,8cyclictest725655-21latency_hist08:50:011
694915999792,4cyclictest739377-21kworker/u8:2+events_unbound10:05:300
694915999688,6cyclictest720925-21kworker/u8:3+flush-179:009:50:010
694915999687,7cyclictest748162-21kworker/u8:1+events_unbound11:55:000
694915999687,7cyclictest748162-21kworker/u8:1+events_unbound11:54:590
694915999587,6cyclictest748162-21kworker/u8:1+events_unbound12:25:250
694915999285,5cyclictest710775-21threads07:55:290
694918999183,6cyclictest790572-21kworker/u8:3+flush-179:012:35:281
694918999182,5cyclictest701217-21kworker/u8:0+flush-179:008:05:261
694918999175,15cyclictest772870-21kworker/u8:2+flush-179:011:35:001
694915999185,4cyclictest769694-21kworker/u8:0+flush-179:011:15:010
694915999182,6cyclictest748162-21kworker/u8:1+flush-179:011:40:210
694915999179,5cyclictest797005-21kworker/u8:2+events_unbound12:40:010
694918999084,4cyclictest739377-21kworker/u8:2+flush-179:009:30:251
694915999083,6cyclictest691813-21kworker/u8:3+events_unbound07:20:010
694915999081,5cyclictest739377-21kworker/u8:2+flush-179:009:50:020
694918998983,4cyclictest701217-21kworker/u8:0+flush-179:008:15:231
694915998983,4cyclictest780837-21kworker/u8:0+flush-179:011:45:240
694915998981,6cyclictest788759-21apt-get12:05:000
694918998880,5cyclictest748162-21kworker/u8:1+flush-179:012:15:001
694918998879,6cyclictest720925-21kworker/u8:3+events_unbound09:15:261
694915998881,5cyclictest701217-21kworker/u8:0+events_unbound08:20:280
694915998878,8cyclictest732256-21/usr/sbin/munin09:10:250
694918998779,6cyclictest762439-21kworker/u8:0+flush-179:010:40:271
694918998779,6cyclictest720925-21kworker/u8:3+flush-179:009:40:201
694918998779,6cyclictest720925-21kworker/u8:3+flush-179:008:40:291
694918998778,7cyclictest768029-21kworker/u8:3+flush-179:011:00:001
694918998777,8cyclictest709449-21kworker/u8:3+flush-179:008:00:001
694918998775,9cyclictest708141-21apt-get07:50:101
694915998782,4cyclictest748162-21kworker/u8:1+flush-179:010:20:260
694915998780,5cyclictest748162-21kworker/u8:1+flush-179:012:10:220
694918998680,4cyclictest728888-21kworker/u8:4+flush-179:009:15:011
694918998675,6cyclictest777139-21kworker/u8:3+flush-179:011:45:001
694915998678,6cyclictest776023-21latency_hist11:25:010
694915998678,5cyclictest748162-21kworker/u8:1+events_unbound11:15:140
694918998578,5cyclictest762439-21kworker/u8:0+flush-179:010:45:231
694918998578,4cyclictest790572-21kworker/u8:3+events_unbound12:20:151
694915998578,5cyclictest713329-21kworker/u8:1+flush-179:009:30:210
694915998477,5cyclictest709449-21kworker/u8:3+events_unbound08:05:120
694918998375,6cyclictest720925-21kworker/u8:3+flush-179:008:55:151
694915998377,4cyclictest762439-21kworker/u8:0+flush-179:010:45:270
694918998175,4cyclictest739377-21kworker/u8:2+flush-179:009:50:271
694918998074,3cyclictest691813-21kworker/u8:3+events_unbound07:10:201
694918998072,5cyclictest748162-21kworker/u8:1+flush-179:011:20:111
694915998075,4cyclictest768029-21kworker/u8:3+flush-179:011:05:280
694915998074,4cyclictest777139-21kworker/u8:3+flush-179:011:30:270
694915997974,3cyclictest728888-21kworker/u8:4+events_unbound09:05:130
694915997973,4cyclictest702863-21kworker/u8:2+flush-179:007:35:280
694918997868,8cyclictest720925-21kworker/u8:3+events_unbound09:50:011
694918997772,3cyclictest790572-21kworker/u8:3+flush-179:012:25:141
694918997769,6cyclictest769694-21kworker/u8:0+flush-179:011:20:001
694915997772,4cyclictest691813-21kworker/u8:3+flush-179:007:25:270
694918997670,4cyclictest792217-21kworker/u8:0+flush-179:012:15:131
694915997669,4cyclictest720925-21kworker/u8:3+flush-179:009:00:110
694918997569,4cyclictest748162-21kworker/u8:1+events_unbound10:50:251
694918997569,4cyclictest748162-21kworker/u8:1+events_unbound10:50:251
694918997569,4cyclictest713329-21kworker/u8:1+flush-179:008:34:551
694918997569,4cyclictest713329-21kworker/u8:1+flush-179:008:30:011
694918997568,5cyclictest705479-21kworker/u8:1+flush-179:007:45:261
694918997568,4cyclictest720925-21kworker/u8:3+flush-179:009:30:011
694918997565,7cyclictest782641-21apt-get11:45:091
694915997569,4cyclictest701217-21kworker/u8:0+flush-179:007:50:130
694915997566,7cyclictest753731-21apt-get10:15:110
694915997566,7cyclictest701497-21apt-get07:30:100
694918997467,5cyclictest739377-21kworker/u8:2+flush-179:010:30:001
694918997460,6cyclictest713329-21kworker/u8:1+events_unbound09:05:251
694915997468,4cyclictest756705-21kworker/u8:3+events_unbound10:25:130
694915997468,4cyclictest748162-21kworker/u8:1+flush-179:010:50:230
694915997468,4cyclictest748162-21kworker/u8:1+flush-179:010:50:220
694915997466,5cyclictest739377-21kworker/u8:2+events_unbound10:30:210
694918997362,8cyclictest755320-21/usr/sbin/munin10:20:181
694915997367,5cyclictest713329-21kworker/u8:1+flush-179:009:35:310
694918997266,3cyclictest756705-21kworker/u8:3+events_unbound10:35:121
694918997263,6cyclictest739377-21kworker/u8:2+flush-179:010:15:251
694915997268,3cyclictest756705-21kworker/u8:3+flush-179:010:35:290
694915997266,4cyclictest790572-21kworker/u8:3+flush-179:012:20:210
694915997166,3cyclictest711114-21kworker/u8:2+flush-179:008:05:000
694915997164,5cyclictest768029-21kworker/u8:3+events_unbound11:00:250
694915997160,9cyclictest789266-21apt-get12:05:090
694918997058,5cyclictest739377-21kworker/u8:2+events_unbound10:10:211
694918996964,3cyclictest713329-21kworker/u8:1+flush-179:009:35:221
694918996963,4cyclictest701217-21kworker/u8:0+flush-179:008:10:161
694918996963,4cyclictest701217-21kworker/u8:0+flush-179:008:10:161
694915996965,3cyclictest728888-21kworker/u8:4+flush-179:009:20:270
694915996964,4cyclictest720925-21kworker/u8:3+flush-179:009:25:270
694918996863,4cyclictest713329-21kworker/u8:1+flush-179:008:20:251
694918996862,4cyclictest789247-21kworker/u8:0+flush-179:012:05:121
694915996862,5cyclictest777139-21kworker/u8:3+flush-179:011:25:320
694915996761,4cyclictest720925-21kworker/u8:3+flush-179:008:50:230
694915996759,6cyclictest713329-21kworker/u8:1+events_unbound08:30:200
694918996660,4cyclictest691813-21kworker/u8:3+events_unbound07:25:151
694918996659,4cyclictest748162-21kworker/u8:1+flush-179:012:05:001
694915996554,9cyclictest733860-21apt-get09:15:120
69491599651,62cyclictest1-21systemd10:57:510
694918996459,3cyclictest746577-21kworker/u8:0+flush-179:009:55:211
694918996458,4cyclictest709449-21kworker/u8:3+flush-179:008:00:191
694918996457,4cyclictest674161-21kworker/u8:0+flush-179:007:15:241
694915996458,4cyclictest720925-21kworker/u8:3+flush-179:008:45:150
694918996358,4cyclictest691813-21kworker/u8:3+flush-179:007:24:551
694918996155,5cyclictest768029-21kworker/u8:3+flush-179:011:05:301
694918996152,7cyclictest729086-21/usr/sbin/munin09:00:241
694915996054,4cyclictest720925-21kworker/u8:3+events_unbound08:55:180
694915996052,6cyclictest2158010-21systemd-journal11:56:500
694923995956,2cyclictest0-21swapper/211:58:002
694918995955,3cyclictest706347-21latency_hist07:45:011
694915995852,4cyclictest717479-21kworker/u8:2+events_unbound08:35:120
694915995849,7cyclictest739377-21kworker/u8:2+events_unbound09:40:110
694918995650,4cyclictest769694-21kworker/u8:0+flush-179:011:25:151
694918995550,3cyclictest748162-21kworker/u8:1+flush-179:011:10:181
694918995549,4cyclictest748162-21kworker/u8:1+events_unbound11:55:121
694923995452,1cyclictest0-21swapper/212:09:582
694915995447,5cyclictest691813-21kworker/u8:3+flush-179:007:10:200
694915995348,4cyclictest739377-21kworker/u8:2+events_unbound10:10:260
694915995348,4cyclictest720925-21kworker/u8:3+events_unbound08:40:270
694927995250,1cyclictest0-21swapper/308:08:593
4652991510,14ptp4l441ktimers/307:10:013
4652991510,14ptp4l441ktimers/307:10:003
694915994840,5cyclictest748162-21kworker/u8:1+flush-179:010:40:120
694923994340,2cyclictest0-21swapper/208:08:592
694918994338,4cyclictest780837-21kworker/u8:0+flush-179:011:53:511
694918994338,4cyclictest780837-21kworker/u8:0+flush-179:011:53:501
694918994336,6cyclictest713329-21kworker/u8:1+flush-179:008:55:001
69492799410,5cyclictest777614-21turbostat11:30:003
69492799410,39cyclictest730445-21turbostat09:05:003
69492399400,2cyclictest0-21swapper/208:34:592
694923993937,1cyclictest0-21swapper/209:44:592
694927993835,2cyclictest0-21swapper/312:30:003
69492399380,36cyclictest0-21swapper/209:20:132
694927993734,2cyclictest0-21swapper/309:17:593
694927993734,1cyclictest0-21swapper/310:11:003
69492799370,36cyclictest0-21swapper/308:37:583
69492799370,1cyclictest0-21swapper/310:00:013
694923993735,1cyclictest0-21swapper/207:59:592
694923993734,2cyclictest0-21swapper/211:48:002
694923993734,2cyclictest0-21swapper/211:07:592
694923993734,2cyclictest0-21swapper/210:57:592
694923993734,2cyclictest0-21swapper/207:32:592
69492399370,1cyclictest0-21swapper/210:02:592
694927993634,1cyclictest0-21swapper/310:03:583
694927993634,1cyclictest0-21swapper/309:51:593
694927993633,2cyclictest0-21swapper/311:21:593
694927993629,6cyclictest756676-21turbostat10:25:013
69492799360,35cyclictest0-21swapper/311:03:593
69492799360,35cyclictest0-21swapper/310:53:003
69492799360,35cyclictest0-21swapper/310:52:593
69492799360,35cyclictest0-21swapper/310:49:543
69492799360,35cyclictest0-21swapper/309:37:593
69492799360,34cyclictest0-21swapper/309:47:593
69492799360,1cyclictest0-21swapper/311:10:153
694923993633,2cyclictest0-21swapper/212:31:002
694923993633,2cyclictest0-21swapper/212:19:562
694923993633,2cyclictest0-21swapper/210:21:592
694923993633,2cyclictest0-21swapper/210:00:012
694923993633,2cyclictest0-21swapper/207:36:592
694923993633,2cyclictest0-21swapper/207:27:592
69492399360,1cyclictest0-21swapper/211:24:552
694927993534,1cyclictest0-21swapper/312:19:553
694927993533,1cyclictest0-21swapper/310:27:003
694923993532,2cyclictest0-21swapper/211:32:002
694923993525,2cyclictest0-21swapper/209:25:162
69492399350,1cyclictest0-21swapper/212:26:592
4652991350,3ptp4l441ktimers/307:30:123
694927993432,1cyclictest0-21swapper/311:55:583
694927993432,1cyclictest0-21swapper/308:50:593
694927993432,1cyclictest0-21swapper/307:52:593
69492799340,5cyclictest719043-21turbostat08:25:003
4653091340,3getstats0-21swapper/312:20:293
694927993331,1cyclictest0-21swapper/311:15:583
694927993330,2cyclictest0-21swapper/310:55:023
694923993331,1cyclictest0-21swapper/211:10:142
694923993331,1cyclictest0-21swapper/209:05:002
694923993331,1cyclictest0-21swapper/208:45:112
694923993330,2cyclictest0-21swapper/208:37:592
69492399330,32cyclictest0-21swapper/210:35:112
694927993229,2cyclictest0-21swapper/310:40:133
69492799320,30cyclictest0-21swapper/311:50:153
69492799320,30cyclictest0-21swapper/311:50:143
69492799320,30cyclictest0-21swapper/308:40:133
694923993229,2cyclictest0-21swapper/211:04:002
694923993229,2cyclictest0-21swapper/210:53:002
694923993229,2cyclictest0-21swapper/210:52:592
694923993229,2cyclictest0-21swapper/210:49:552
694923993229,2cyclictest0-21swapper/209:50:032
694923993229,2cyclictest0-21swapper/209:47:582
694923993229,2cyclictest0-21swapper/209:37:592
694923993229,2cyclictest0-21swapper/207:50:112
69492399320,30cyclictest0-21swapper/211:19:002
694915993229,2cyclictest725-21Xorg08:30:000
694927993129,1cyclictest0-21swapper/312:39:593
694927993127,2cyclictest0-21swapper/310:16:583
69492799310,2cyclictest0-21swapper/312:05:123
69492799310,28cyclictest0-21swapper/311:05:123
694923993126,2cyclictest0-21swapper/208:40:132
694927993028,1cyclictest0-21swapper/307:55:593
694927993027,2cyclictest0-21swapper/311:30:153
694927993027,2cyclictest0-21swapper/310:38:593
694927993027,2cyclictest0-21swapper/309:30:003
694927993027,2cyclictest0-21swapper/308:55:143
694927993027,2cyclictest0-21swapper/307:23:593
69492799300,2cyclictest0-21swapper/312:05:003
69492799300,28cyclictest0-21swapper/308:45:113
69492799300,28cyclictest0-21swapper/307:25:113
694923993028,1cyclictest0-21swapper/207:15:132
694923993027,2cyclictest0-21swapper/212:20:142
694923993027,2cyclictest0-21swapper/211:50:142
694923993027,2cyclictest0-21swapper/211:50:142
694923993027,2cyclictest0-21swapper/208:11:592
694923993027,2cyclictest0-21swapper/208:11:592
69492399300,2cyclictest0-21swapper/208:55:142
69492399300,2cyclictest0-21swapper/208:05:012
69492399300,28cyclictest0-21swapper/210:33:592
69492399300,28cyclictest0-21swapper/210:05:022
69492399300,28cyclictest0-21swapper/208:23:592
69492399300,23cyclictest0-21swapper/211:40:012
694927992927,1cyclictest0-21swapper/310:35:003
694927992927,1cyclictest0-21swapper/309:40:103
694927992927,1cyclictest0-21swapper/309:20:133
694927992927,1cyclictest0-21swapper/307:43:593
69492799290,28cyclictest0-21swapper/308:15:013
69492799290,28cyclictest0-21swapper/308:15:013
69492799290,28cyclictest0-21swapper/307:10:113
69492799290,27cyclictest0-21swapper/308:15:133
69492799290,1cyclictest0-21swapper/310:05:033
694923992927,1cyclictest0-21swapper/210:18:592
694923992926,2cyclictest0-21swapper/211:30:002
694923992926,2cyclictest0-21swapper/209:05:132
694923992926,2cyclictest0-21swapper/208:30:012
69492399290,2cyclictest0-21swapper/207:20:012
69492399290,28cyclictest0-21swapper/210:40:122
69492399290,28cyclictest0-21swapper/207:45:152
69492399290,28cyclictest0-21swapper/207:10:112
69492399290,27cyclictest0-21swapper/211:40:122
69492399290,27cyclictest0-21swapper/210:25:112
69492399290,27cyclictest0-21swapper/208:15:132
69492399290,27cyclictest0-21swapper/207:40:212
69492399290,1cyclictest0-21swapper/212:40:012
4652991290,7ptp4l441ktimers/312:15:013
4652991290,7ptp4l441ktimers/311:45:013
694927992825,2cyclictest0-21swapper/311:45:193
694927992825,2cyclictest0-21swapper/307:40:023
694927992823,4cyclictest798552-21turbostat12:35:003
69492799280,2cyclictest0-21swapper/307:15:143
69492799280,27cyclictest0-21swapper/309:30:163
69492799280,27cyclictest0-21swapper/309:05:133
69492799280,27cyclictest0-21swapper/308:30:013
69492799280,26cyclictest0-21swapper/309:10:223
69492799280,26cyclictest0-21swapper/307:45:153
694923992826,1cyclictest0-21swapper/209:10:222
694923992825,2cyclictest0-21swapper/210:11:002
694923992825,2cyclictest0-21swapper/209:17:592
69492399280,2cyclictest0-21swapper/212:10:142
69492399280,27cyclictest0-21swapper/212:05:002
69492399280,27cyclictest0-21swapper/209:30:152
69492399280,27cyclictest0-21swapper/208:50:132
4652991280,6ptp4l441ktimers/311:40:003
4652991280,6ptp4l441ktimers/308:35:013
69492799270,1cyclictest0-21swapper/308:02:593
694918992218,3cyclictest0-21swapper/107:10:011
694918992218,3cyclictest0-21swapper/107:10:011
176399220,13rtkit-daemon506-21gpm07:07:050
176399220,13rtkit-daemon506-21gpm07:07:040
6949239930,2cyclictest0-21swapper/207:10:012
6949239930,2cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional