You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 20:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Wed Dec 10, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
399694899140,13cyclictest0-21swapper/308:10:123
399694899130,1cyclictest0-21swapper/312:20:113
399694899130,12cyclictest69450irq/121-eno108:50:113
399694899130,12cyclictest0-21swapper/307:10:013
399694899130,11cyclictest0-21swapper/310:25:113
399694899120,1cyclictest0-21swapper/312:00:213
399694899120,11cyclictest69450irq/121-eno108:05:253
399694899120,11cyclictest0-21swapper/312:25:123
399694899120,11cyclictest0-21swapper/311:30:123
399694899119,1cyclictest0-21swapper/308:15:153
3996948991111,0cyclictest69450irq/121-eno112:35:153
3996948991111,0cyclictest69450irq/121-eno107:25:013
3996948991110,0cyclictest0-21swapper/307:40:133
399694899110,11cyclictest0-21swapper/309:45:133
399694899110,10cyclictest69450irq/121-eno111:14:063
399694899110,10cyclictest69450irq/121-eno110:50:163
399694899110,10cyclictest0-21swapper/310:15:153
399694899110,10cyclictest0-21swapper/310:05:323
399694899110,10cyclictest0-21swapper/308:35:133
399694899110,0cyclictest0-21swapper/308:40:153
3996948991010,0cyclictest69450irq/121-eno111:46:153
3996948991010,0cyclictest69450irq/121-eno111:20:173
3996948991010,0cyclictest69450irq/121-eno111:05:163
3996948991010,0cyclictest69450irq/121-eno110:20:193
3996948991010,0cyclictest0-21swapper/310:45:013
3996948991010,0cyclictest0-21swapper/309:40:133
3996948991010,0cyclictest0-21swapper/308:50:003
3996948991010,0cyclictest0-21swapper/307:50:013
399694899100,9cyclictest69450irq/121-eno111:00:173
399694899100,9cyclictest69450irq/121-eno110:30:153
399694899100,9cyclictest69450irq/121-eno109:35:223
399694899100,9cyclictest69450irq/121-eno108:20:133
399694899100,9cyclictest0-21swapper/308:30:123
399694899100,8cyclictest0-21swapper/311:00:013
399694899100,0cyclictest0-21swapper/308:55:403
39969489999,0cyclictest69450irq/121-eno110:10:183
39969489999,0cyclictest69450irq/121-eno109:17:593
39969489999,0cyclictest0-21swapper/307:15:143
39969489998,0cyclictest0-21swapper/307:35:133
39969489990,9cyclictest0-21swapper/312:30:203
39969489990,8cyclictest69450irq/121-eno112:15:443
39969489990,8cyclictest69450irq/121-eno112:08:433
39969489990,8cyclictest69450irq/121-eno111:25:153
39969489990,8cyclictest69450irq/121-eno111:25:153
39969489990,8cyclictest69450irq/121-eno109:29:093
39969489990,8cyclictest69450irq/121-eno107:45:063
39969489990,8cyclictest69450irq/121-eno107:25:163
39969489990,8cyclictest0-21swapper/311:50:153
39969489988,0cyclictest69450irq/121-eno111:40:163
39969489988,0cyclictest69450irq/121-eno110:45:133
39969489988,0cyclictest69450irq/121-eno109:59:443
39969489988,0cyclictest69450irq/121-eno109:30:233
39969489980,7cyclictest69450irq/121-eno112:11:053
39969489980,0cyclictest0-21swapper/310:00:123
39969489980,0cyclictest0-21swapper/309:10:123
39969489977,0cyclictest69450irq/121-eno111:35:233
39969489977,0cyclictest0-21swapper/311:15:143
39969489977,0cyclictest0-21swapper/308:25:173
39969489970,7cyclictest69450irq/121-eno109:00:133
39969489966,0cyclictest69450irq/121-eno111:56:203
39969489966,0cyclictest0-21swapper/310:35:213
39969489966,0cyclictest0-21swapper/309:50:203
39969489966,0cyclictest0-21swapper/309:05:123
39969489965,0cyclictest0-21swapper/308:00:123
39969489955,0cyclictest69450irq/121-eno109:20:013
39969489944,0cyclictest0-21swapper/307:30:063
39969489940,3cyclictest69450irq/121-eno107:55:183
3996581241,0sleep00-21swapper/007:07:240
3996573242,1sleep20-21swapper/207:07:182
3995112241,2sleep30-21swapper/307:05:013
4132749230,2sleep04132764-21munin-run12:40:010
4128833230,1sleep14128859-21apt-get12:30:131
4126226230,2sleep14126354-21latency_hist12:25:011
4125149230,1sleep24125166-21ntp_states12:20:172
4116045230,1sleep04116073-21apt-get12:00:140
4082010230,2sleep04082011-21sshd10:39:130
4046324230,2sleep14046352-21true09:15:011
4027722230,0sleep10-21swapper/108:25:181
4017189230,1sleep14017215-21apt-get08:00:121
4014113230,2sleep14014127-21open_files07:50:191
3996032231,1sleep10-21swapper/107:05:241
4126601220,1sleep20-21swapper/212:25:142
4119018220,1sleep24119169-21awk12:05:202
4113167220,0sleep00-21swapper/011:50:340
4111589220,1sleep04111623-21munin-run11:50:010
4105687220,1sleep24105942-21cstates11:35:152
4096935220,1sleep24096964-21systemd-run11:15:012
4089627220,1sleep24089739-21processes10:55:202
4087322220,1sleep14087532-21/usr/sbin/munin10:50:191
4084206220,1sleep04084215-21apt-get10:45:010
4070592220,1sleep00-21swapper/010:10:230
4063426220,2sleep14063428-21ssh09:55:031
4051340220,1sleep14051446-21/usr/sbin/munin09:25:171
4045314220,1sleep24045366-21/usr/sbin/munin09:10:172
4045012220,0sleep00-21swapper/009:10:150
4042061220,1sleep10-21swapper/109:00:401
4041359220,1sleep04041513-21/usr/sbin/munin09:00:190
4019552220,0sleep00-21swapper/008:05:190
4011876220,1sleep04012023-21sed07:45:180
4004300220,0sleep20-21swapper/207:25:192
3999997220,1sleep24000199-21sed07:15:182
3998755220,1sleep13999228-21munin-node07:15:011
4130922210,0sleep20-21swapper/212:35:132
4130665210,0sleep10-21swapper/112:35:011
4129683210,0sleep00-21swapper/012:30:200
4129416210,0sleep20-21swapper/212:30:182
4127100210,0sleep10-21swapper/112:25:171
4126478210,0sleep00-21swapper/012:25:120
4125297210,0sleep00-21swapper/012:20:190
4122711210,0sleep20-21swapper/212:15:172
4122438210,0sleep10-21swapper/112:15:161
4122276210,0sleep00-21swapper/012:15:110
4120717210,0sleep24120914-21strings12:10:172
4120638210,0sleep10-21swapper/112:10:161
4120390210,0sleep00-21swapper/012:10:140
4118308210,0sleep10-21swapper/112:05:151
4117867210,0sleep00-21swapper/012:05:020
4117702210,0sleep20-21swapper/212:03:362
4116669210,0sleep10-21swapper/112:00:191
4115586210,0sleep20-21swapper/211:58:272
4115499210,0sleep00-21swapper/011:57:420
4113995210,0sleep10-21swapper/111:55:151
4111876210,0sleep20-21swapper/211:50:152
4111843210,0sleep14111871-21apt-get11:50:141
4110807210,0sleep10-21swapper/111:45:221
4110377210,0sleep20-21swapper/211:45:192
4109101210,0sleep20-21swapper/211:41:312
4107661210,1sleep00-21swapper/011:40:090
4107395210,0sleep10-21swapper/111:40:021
4105565210,0sleep00-21swapper/011:35:130
4105310210,0sleep10-21swapper/111:35:021
4104929210,0sleep10-21swapper/111:31:411
4104241210,0sleep20-21swapper/211:30:182
4103474210,0sleep00-21swapper/011:30:110
4102190210,0sleep00-21swapper/011:25:200
4102190210,0sleep00-21swapper/011:25:200
4101912210,0sleep20-21swapper/211:25:182
4101912210,0sleep20-21swapper/211:25:182
4101388210,0sleep10-21swapper/111:25:131
4101388210,0sleep10-21swapper/111:25:131
4100848210,0sleep10-21swapper/111:22:321
4100823210,0sleep00-21swapper/011:22:200
4100353210,0sleep20-21swapper/211:20:222
4098721210,0sleep00-21swapper/011:17:190
4098620210,0sleep20-21swapper/211:16:292
4098506210,0sleep10-21swapper/111:15:281
4096275210,0sleep10-21swapper/111:10:201
4094431210,0sleep10-21swapper/111:06:201
4093180210,0sleep00-21swapper/011:05:150
4093009210,0sleep20-21swapper/211:05:052
4092280210,0sleep00-21swapper/011:00:420
4092244210,0sleep10-21swapper/111:00:231
4090936210,0sleep20-21swapper/211:00:122
4090221210,0sleep10-21swapper/110:55:591
4088852210,0sleep04088842-21ssh10:55:130
4086932210,0sleep20-21swapper/210:50:162
4086796210,0sleep00-21swapper/010:50:140
4086112210,0sleep10-21swapper/110:46:101
4085244210,0sleep20-21swapper/210:45:192
4083685210,0sleep10-21swapper/110:40:251
4082371210,0sleep00-21swapper/010:40:130
4082361210,0sleep20-21swapper/210:40:072
4080370210,0sleep20-21swapper/210:35:152
4078616210,0sleep00-21swapper/010:30:160
4078286210,0sleep20-21swapper/210:30:142
4077937210,0sleep10-21swapper/110:30:011
4076618210,0sleep10-21swapper/110:25:171
4076114210,0sleep00-21swapper/010:25:120
4075896210,0sleep20-21swapper/210:25:022
4075776210,0sleep10-21swapper/110:24:171
4074121210,0sleep20-21swapper/210:20:142
4073346210,0sleep10-21swapper/110:16:241
4072095210,0sleep20-21swapper/210:15:172
4071930210,0sleep00-21swapper/010:15:140
4071430210,0sleep10-21swapper/110:12:521
4069554210,0sleep20-21swapper/210:10:012
4069414210,0sleep20-21swapper/210:09:132
4067669210,1sleep00-21swapper/010:05:030
4067184210,0sleep20-21swapper/210:02:532
4065635210,0sleep00-21swapper/010:00:140
4065531210,0sleep10-21swapper/110:00:061
4065118210,0sleep20-21swapper/209:58:442
4063450210,0sleep00-21swapper/009:55:140
4062100210,0sleep20-21swapper/209:50:202
4061889210,0sleep10-21swapper/109:50:191
4061140210,0sleep00-21swapper/009:50:020
4060934210,0sleep20-21swapper/209:48:312
4059027210,0sleep00-21swapper/009:45:010
4057408210,0sleep20-21swapper/209:40:152
4057300210,0sleep10-21swapper/109:40:141
4056968210,0sleep00-21swapper/009:40:010
4055596210,0sleep20-21swapper/209:35:192
4055211210,0sleep00-21swapper/009:35:130
4053976210,0sleep20-21swapper/209:31:272
4053295210,0sleep10-21swapper/109:30:181
4052565210,0sleep00-21swapper/009:30:130
4051447210,0sleep20-21swapper/209:25:182
4051208210,0sleep00-21swapper/009:25:160
4049291210,0sleep10-21swapper/109:20:171
4049094210,0sleep04049286-21strings09:20:160
4048744210,0sleep20-21swapper/209:20:142
4047429210,0sleep10-21swapper/109:15:211
4046575210,0sleep20-21swapper/209:15:142
4042808210,0sleep00-21swapper/009:05:150
4042675210,0sleep20-21swapper/209:05:122
4040323210,0sleep20-21swapper/208:58:132
4039451210,0sleep10-21swapper/108:55:391
4039297210,0sleep00-21swapper/008:55:380
4037654210,0sleep00-21swapper/008:50:180
4034984210,0sleep10-21swapper/108:45:151
4034424210,0sleep10-21swapper/108:41:061
4032667210,0sleep00-21swapper/008:40:010
4031645210,0sleep20-21swapper/208:35:192
4030872210,0sleep00-21swapper/008:35:130
4029847210,0sleep20-21swapper/208:30:192
4029570210,0sleep00-21swapper/008:30:170
4027197210,0sleep20-21swapper/208:25:142
4027043210,0sleep04027074-21aten_r1power_cu08:25:130
4026064210,0sleep00-21swapper/008:20:200
4025841210,0sleep20-21swapper/208:20:182
4024157210,0sleep20-21swapper/208:15:222
4023185210,0sleep00-21swapper/008:15:080
4022678210,0sleep10-21swapper/108:15:011
4022599210,0sleep20-21swapper/208:14:022
4022501210,1sleep00-21swapper/008:12:480
4021014210,0sleep10-21swapper/108:10:131
4020406210,0sleep20-21swapper/208:05:252
4019102210,0sleep10-21swapper/108:05:121
4017630210,0sleep00-21swapper/008:00:230
4016920210,0sleep20-21swapper/208:00:012
4015008210,0sleep20-21swapper/207:55:012
4014810210,1sleep00-21swapper/007:52:350
4014642210,0sleep20-21swapper/207:50:242
4011459210,0sleep10-21swapper/107:45:151
4010562210,0sleep10-21swapper/107:40:231
4009772210,0sleep20-21swapper/207:40:162
4009518210,0sleep00-21swapper/007:40:140
4008201210,0sleep10-21swapper/107:35:181
4007736210,0sleep20-21swapper/207:35:152
4007583210,0sleep00-21swapper/007:35:120
4005660210,0sleep00-21swapper/007:30:170
4005506210,0sleep20-21swapper/207:30:152
4005006210,1sleep00-21swapper/007:26:530
4003613210,0sleep10-21swapper/107:25:141
4002173210,0sleep10-21swapper/107:20:211
4001487210,0sleep00-21swapper/007:20:170
3999664210,0sleep00-21swapper/007:15:160
3997609210,0sleep20-21swapper/207:10:182
3997276210,0sleep00-21swapper/007:10:160
4095083200,0sleep00-21swapper/011:10:030
4080023200,0sleep10-21swapper/110:35:021
4074011200,0sleep00-21swapper/010:20:040
4067670200,0sleep10-21swapper/110:05:041
4059260200,0sleep10-21swapper/109:45:021
4055175200,0sleep10-21swapper/109:35:021
4046559200,0sleep00-21swapper/009:15:040
4042639200,0sleep10-21swapper/109:05:041
4040468200,0sleep20-21swapper/209:00:012
4036880200,0sleep20-21swapper/208:50:042
4036879200,0sleep10-21swapper/108:50:031
4034968200,0sleep20-21swapper/208:45:042
4034966200,0sleep00-21swapper/008:45:020
4033054200,0sleep20-21swapper/208:40:032
4030856200,0sleep10-21swapper/108:35:021
4028941200,0sleep10-21swapper/108:30:021
4024859200,0sleep10-21swapper/108:20:011
4015246200,0sleep10-21swapper/107:55:041
4015243200,0sleep00-21swapper/007:55:030
4011417200,0sleep20-21swapper/207:45:042
4005488200,0sleep10-21swapper/107:30:021
4001399200,0sleep20-21swapper/207:20:032
3997079200,0sleep10-21swapper/107:10:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional