You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-13 - 09:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot4.osadl.org (updated Sun Oct 13, 2024 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37292502300257,27sleep10-21swapper/119:07:201
37293392254213,27sleep00-21swapper/019:08:170
372963699671,45cyclictest3790062-21apt-get21:25:110
372963699661,27cyclictest3908710-21munin-run00:00:000
372963699658,25cyclictest3939806-21date00:40:000
372963699631,30cyclictest3920041-21python300:15:010
372963699631,29cyclictest3757865-21perf20:20:010
372963699621,41cyclictest3901363-40apt-check23:50:120
372963699620,29cyclictest3755946-21cat20:15:010
3729636996012,26cyclictest3760141-21tr20:25:130
372963699600,39cyclictest3920006-21apt-get00:15:060
372963699591,39cyclictest3874374-21apt-get23:15:130
372963699591,38cyclictest3797456-21apt-get21:35:060
372963699590,28cyclictest3777751-21diskmemload23:24:030
372963699581,28cyclictest3813270-21date21:55:000
372963699575,27cyclictest3741151-21grep19:35:230
372963699570,28cyclictest3736049-21cat19:25:010
372963699570,26cyclictest3746226-21apt-key19:50:010
372963699570,25cyclictest3847257-21date22:40:000
372963699570,24cyclictest3820638-21latency_hist22:05:000
372963699561,28cyclictest3768187-21apt-get20:45:120
3729636995612,33cyclictest3868857-21seq23:07:050
372963699560,27cyclictest3835785-21sed22:25:000
372963699551,37cyclictest3786295-21apt-get21:20:130
372963699551,30cyclictest3782277-40apt-check21:15:110
372963699551,28cyclictest3859194-21apt-get22:55:130
372963699551,28cyclictest3855885-21/usr/sbin/munin22:50:230
372963699551,28cyclictest3764950-21grep20:35:230
372963699550,29cyclictest3897257-21apt-get23:45:110
372963699550,26cyclictest3754105-21date20:10:000
372963699550,25cyclictest3839638-21sed22:30:000
372963699550,25cyclictest3734117-21wc19:20:000
372963699550,24cyclictest3912663-21latency_hist00:05:010
113399550,4rtkit-daemon1132-21rtkit-daemon20:43:590
3729636995412,30cyclictest3914948-21sh00:06:510
372963699540,30cyclictest3813285-21taskset21:55:020
372963699540,28cyclictest3933603-21sed00:30:240
372963699540,25cyclictest3843466-21latency_hist22:35:010
372963699530,40cyclictest3873230-21ssh23:13:120
372963699530,37cyclictest3886116-21apt-get23:30:130
372963699530,37cyclictest3793798-21apt-get21:30:120
372963699530,37cyclictest3777751-21diskmemload22:40:470
372963699530,30cyclictest3820895-21apt-get22:05:120
372963699530,28cyclictest3743844-21sh19:45:000
372963699530,27cyclictest3881867-21apt-get23:25:120
372963699530,25cyclictest3737960-21/usr/sbin/munin19:30:010
372963699530,24cyclictest3928212-21apt-config00:25:010
372963699525,23cyclictest0-21swapper/023:38:530
372963699522,30cyclictest3745795-21python319:50:010
372963699520,36cyclictest3828496-21apt-get22:15:140
372963699520,36cyclictest3824709-21apt-get22:10:120
372963699520,29cyclictest3924964-21sed00:20:180
372963699520,28cyclictest3750148-21date20:00:010
372963699520,27cyclictest3864049-21grep23:00:250
113399520,3rtkit-daemon1132-21rtkit-daemon21:45:220
113399520,3rtkit-daemon1132-21rtkit-daemon21:45:220
372963699511,34cyclictest3802001-21apt-get21:40:110
3729636995110,30cyclictest861-21runrttasks20:00:500
372963699510,40cyclictest3781163-21ssh21:13:520
372963699510,31cyclictest3739461-21taskset19:30:280
372963699510,23cyclictest3851432-40dpkg22:45:030
372963699501,27cyclictest3758411-21grep20:20:160
372963699500,30cyclictest38949052chrt23:40:320
372963699490,27cyclictest3775074-21swap21:00:240
372963699490,27cyclictest37714582sleep020:50:340
372963699480,34cyclictest3777582-21sshd21:08:180
372963699480,32cyclictest3729753-21apt-get19:10:130
372963699480,27cyclictest3772350-21grep20:55:180
372963699480,27cyclictest3762843-21ps20:30:240
113399470,4rtkit-daemon1132-21rtkit-daemon19:12:201
113399420,3rtkit-daemon1132-21rtkit-daemon19:23:141
38284982410,3sleep13828495-21apt22:15:111
113399410,3rtkit-daemon0-21swapper/000:34:211
113399380,3rtkit-daemon0-21swapper/123:47:151
113399380,3rtkit-daemon0-21swapper/121:00:311
113399360,3rtkit-daemon0-21swapper/120:37:391
113399360,3rtkit-daemon0-21swapper/022:13:111
3729639993532,1cyclictest3855240-21ssh22:50:051
113399350,6rtkit-daemon3936155-21apt-get00:35:121
113399350,3rtkit-daemon0-21swapper/121:08:411
113399350,3rtkit-daemon0-21swapper/020:54:211
113399340,3rtkit-daemon0-21swapper/121:47:301
113399340,3rtkit-daemon0-21swapper/121:47:301
113399330,3rtkit-daemon3837249-21ssh22:25:251
113399330,3rtkit-daemon1132-21rtkit-daemon20:00:491
113399320,4rtkit-daemon1132-21rtkit-daemon23:09:201
113399320,3rtkit-daemon1132-21rtkit-daemon20:41:531
113399320,3rtkit-daemon0-21swapper/022:22:411
113399320,3rtkit-daemon0-21swapper/020:49:291
113399310,4rtkit-daemon1132-21rtkit-daemon21:12:051
113399310,3rtkit-daemon0-21swapper/021:33:321
113399310,2rtkit-daemon1132-21rtkit-daemon20:19:291
372963999300,18cyclictest3793549-21turbostat21:30:011
113399300,3rtkit-daemon0-21swapper/000:23:381
113399290,4rtkit-daemon1132-21rtkit-daemon19:16:101
113399290,3rtkit-daemon0-21swapper/023:30:201
113399290,3rtkit-daemon0-21swapper/023:20:251
113399290,3rtkit-daemon0-21swapper/022:00:351
113399290,3rtkit-daemon0-21swapper/021:58:021
113399290,3rtkit-daemon0-21swapper/021:41:081
113399290,3rtkit-daemon0-21swapper/000:11:391
372963999281,22cyclictest3851503-21apt-get22:45:111
113399280,3rtkit-daemon0-21swapper/023:58:001
113399280,3rtkit-daemon0-21swapper/023:54:321
113399280,3rtkit-daemon0-21swapper/023:38:081
113399280,3rtkit-daemon0-21swapper/022:44:191
113399280,3rtkit-daemon0-21swapper/022:06:521
113399280,3rtkit-daemon0-21swapper/021:35:451
113399280,3rtkit-daemon0-21swapper/020:58:561
113399280,3rtkit-daemon0-21swapper/019:59:371
113399270,3rtkit-daemon0-21swapper/021:22:461
113399270,3rtkit-daemon0-21swapper/019:47:151
113399270,3rtkit-daemon0-21swapper/019:33:211
113399270,3rtkit-daemon0-21swapper/000:16:071
113399270,21rtkit-daemon3729628-21cyclictest19:54:101
113399260,3rtkit-daemon0-21swapper/020:28:481
113399260,21rtkit-daemon3729628-21cyclictest23:19:061
113399250,20rtkit-daemon3729628-21cyclictest20:31:081
113399250,20rtkit-daemon3729628-21cyclictest19:39:121
372963999242,15cyclictest3754152-21apt-get20:10:151
3729639992421,2cyclictest65950irq/132-enp2s020:06:271
3729639992419,4cyclictest3806566-1kworker/u9:021:50:331
3729639992417,5cyclictest26-21ksoftirqd/123:30:011
3729639992411,3cyclictest26-21ksoftirqd/123:45:001
372963999240,7cyclictest3782712-21cut21:15:171
372963999240,6cyclictest0-21swapper/100:02:431
113399240,19rtkit-daemon1132-21rtkit-daemon00:27:161
3729639992310,12cyclictest26-21ksoftirqd/123:05:001
113399230,14rtkit-daemon0-21swapper/122:55:151
372963999224,16cyclictest3736514-21tune2fs19:25:161
113399220,3rtkit-daemon0-21swapper/123:13:011
372963999213,17cyclictest3742920-21awk19:40:211
372963999212,13cyclictest3839787-21apt-get22:30:141
3729639991911,4cyclictest3777751-21diskmemload00:05:071
3729639991813,3cyclictest3844955-21unixbench_singl22:35:231
113399180,6rtkit-daemon3758588-21irqstats20:20:181
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional