You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 14:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Tue Dec 02, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
409267699140,13cyclictest0-21swapper/311:50:143
409267699120,11cyclictest0-21swapper/308:55:013
409267699119,1cyclictest0-21swapper/312:25:133
4092676991111,0cyclictest69450irq/121-eno111:25:123
4092676991111,0cyclictest0-21swapper/311:10:153
4092676991111,0cyclictest0-21swapper/309:45:133
4092676991111,0cyclictest0-21swapper/307:50:103
4092676991110,1cyclictest0-21swapper/309:25:133
4092676991110,0cyclictest0-21swapper/307:35:013
409267699110,8cyclictest0-21swapper/309:55:173
409267699110,11cyclictest0-21swapper/311:15:213
409267699110,10cyclictest69450irq/121-eno112:35:163
409267699110,10cyclictest69450irq/121-eno112:11:423
409267699110,10cyclictest69450irq/121-eno111:05:133
409267699110,10cyclictest0-21swapper/312:30:143
409267699110,10cyclictest0-21swapper/311:00:143
409267699110,10cyclictest0-21swapper/310:55:143
409267699110,10cyclictest0-21swapper/309:00:003
409267699109,1cyclictest69450irq/121-eno111:35:143
409267699109,1cyclictest69450irq/121-eno110:00:113
409267699109,1cyclictest0-21swapper/307:15:013
409267699109,0cyclictest0-21swapper/310:05:143
409267699108,1cyclictest0-21swapper/307:55:183
4092676991010,0cyclictest69450irq/121-eno112:05:163
4092676991010,0cyclictest69450irq/121-eno110:50:313
4092676991010,0cyclictest69450irq/121-eno109:21:043
4092676991010,0cyclictest0-21swapper/310:45:133
4092676991010,0cyclictest0-21swapper/310:26:333
4092676991010,0cyclictest0-21swapper/309:15:133
409267699100,9cyclictest69450irq/121-eno112:15:203
409267699100,9cyclictest69450irq/121-eno111:30:143
409267699100,9cyclictest69450irq/121-eno108:25:183
409267699100,9cyclictest0-21swapper/310:10:203
409267699100,10cyclictest0-21swapper/308:05:203
409267699100,0cyclictest0-21swapper/310:45:003
409267699100,0cyclictest0-21swapper/310:20:133
409267699100,0cyclictest0-21swapper/308:45:153
409267699100,0cyclictest0-21swapper/307:15:183
40926769999,0cyclictest69450irq/121-eno112:20:223
40926769999,0cyclictest69450irq/121-eno111:55:143
40926769999,0cyclictest69450irq/121-eno111:40:163
40926769999,0cyclictest69450irq/121-eno110:35:193
40926769999,0cyclictest69450irq/121-eno110:15:173
40926769999,0cyclictest69450irq/121-eno109:40:263
40926769999,0cyclictest69450irq/121-eno108:30:183
40926769999,0cyclictest69450irq/121-eno108:15:153
40926769999,0cyclictest69450irq/121-eno108:00:033
40926769999,0cyclictest69450irq/121-eno107:45:123
40926769999,0cyclictest0-21swapper/307:35:193
40926769990,8cyclictest69450irq/121-eno107:29:253
40926769990,8cyclictest0-21swapper/309:50:133
40926769990,8cyclictest0-21swapper/308:10:183
40926769990,8cyclictest0-21swapper/307:20:183
40926769990,0cyclictest0-21swapper/310:30:123
40926769990,0cyclictest0-21swapper/308:45:003
40926769988,0cyclictest69450irq/121-eno112:00:163
40926769988,0cyclictest69450irq/121-eno111:20:113
40926769988,0cyclictest69450irq/121-eno108:38:193
40926769988,0cyclictest0-21swapper/311:45:143
40926769980,0cyclictest0-21swapper/308:25:013
40926769977,0cyclictest69450irq/121-eno109:35:133
40926769977,0cyclictest0-21swapper/309:05:193
40926769970,6cyclictest69450irq/121-eno109:10:143
40926769966,0cyclictest0-21swapper/309:30:293
40926769954,0cyclictest0-21swapper/307:40:123
4091318251,2sleep30-21swapper/307:05:183
40926769941,2cyclictest0-21swapper/309:00:133
4091160241,1sleep20-21swapper/207:05:172
4192759230,2sleep04192913-21grep11:15:180
4177511230,1sleep14177537-21apt-get10:40:131
4169865230,2sleep04169134-21/usr/sbin/munin10:20:190
4142425230,2sleep24142489-21cat09:15:212
4138402230,2sleep04138540-21cpu09:05:140
4128198230,1sleep14128217-21apt-get08:40:021
4090899231,0sleep00-21swapper/007:05:150
4090858231,1sleep10-21swapper/107:05:041
4191677220,0sleep00-21swapper/011:13:090
4184419220,1sleep24184545-21ntp_states10:55:182
4176853220,1sleep00-21swapper/010:36:360
4175844220,1sleep24175406-21/usr/sbin/munin10:35:182
4167470220,1sleep14167554-21irqstats10:15:191
4165130220,0sleep20-21swapper/210:10:162
4162576220,0sleep04162352-21apt-get10:05:010
4156496220,1sleep24156743-21/usr/sbin/munin09:50:142
4155710220,0sleep20-21swapper/209:46:552
4153140220,1sleep24122163-21kworker/u16:0+xprtiod09:40:262
4139975220,1sleep24139994-21/usr/sbin/munin09:10:002
4136409220,1sleep00-21swapper/009:00:140
4131074220,1sleep00-21swapper/008:45:200
4126286220,1sleep14126342-21latency_hist08:35:001
4118979220,1sleep14119277-21df08:15:161
4118946220,1sleep00-21swapper/008:15:150
4111511220,0sleep10-21swapper/107:55:231
4107252220,1sleep14107526-21df_inode07:45:141
4105863220,1sleep00-21swapper/007:40:170
31281220,0sleep00-21swapper/012:30:580
23664220,0sleep00-21swapper/012:15:140
22892220,0sleep00-21swapper/012:10:420
17278220,1sleep017549-21df_inode12:00:130
11075220,1sleep00-21swapper/011:45:160
10585220,1sleep11-21systemd11:45:011
9219210,1sleep00-21swapper/011:40:200
8861210,0sleep20-21swapper/211:40:182
7988210,0sleep00-21swapper/011:36:080
7398210,1sleep14139982-21diskmemload11:35:201
7038210,0sleep20-21swapper/211:35:172
5822210,0sleep10-21swapper/111:30:281
5304210,0sleep00-21swapper/011:30:190
4514210,0sleep20-21swapper/211:30:132
4193039210,0sleep20-21swapper/211:15:202
4191509210,0sleep10-21swapper/111:11:381
4191428210,0sleep20-21swapper/211:10:562
4189792210,0sleep20-21swapper/211:09:562
4187970210,0sleep10-21swapper/111:05:151
4187255210,0sleep20-21swapper/211:00:592
4185881210,0sleep10-21swapper/111:00:141
4185601210,0sleep00-21swapper/011:00:010
4184193210,0sleep00-21swapper/010:55:170
4183769210,0sleep10-21swapper/110:55:131
4182116210,0sleep00-21swapper/010:50:170
4181712210,0sleep10-21swapper/110:50:141
4180674210,0sleep10-21swapper/110:45:211
4180279210,0sleep20-21swapper/210:45:182
4177930210,0sleep00-21swapper/010:40:160
4177540210,0sleep20-21swapper/210:40:132
4176203210,0sleep14176381-21smartctl10:35:211
4174221210,0sleep14174424-21/usr/sbin/munin10:30:201
4173751210,0sleep00-21swapper/010:30:150
4172767210,1sleep14172771-21ssh10:27:281
4172024210,0sleep24172085-21ps10:25:212
4171745210,0sleep00-21swapper/010:25:190
4169363210,0sleep10-21swapper/110:20:161
4169129210,1sleep2328-21plymouthd10:20:132
4168665210,0sleep20-21swapper/210:18:202
4167222210,0sleep00-21swapper/010:15:190
4166611210,0sleep00-21swapper/010:13:340
4166566210,0sleep10-21swapper/110:13:111
4162980210,0sleep20-21swapper/210:05:162
4162834210,0sleep10-21swapper/110:05:031
4160560210,1sleep00-21swapper/010:00:140
4160492210,0sleep20-21swapper/210:00:082
4159851210,1sleep00-21swapper/009:56:410
4158841210,0sleep20-21swapper/209:55:152
4158658210,0sleep10-21swapper/109:55:141
4157607210,0sleep10-21swapper/109:50:211
4157390210,0sleep00-21swapper/009:50:200
4155039210,0sleep00-21swapper/009:45:210
4153595210,1sleep00-21swapper/009:41:000
4152836210,0sleep10-21swapper/109:40:171
4151540210,0sleep00-21swapper/009:35:360
4150656210,0sleep10-21swapper/109:35:171
4150215210,0sleep20-21swapper/209:35:132
4149019210,0sleep20-21swapper/209:30:342
4148852210,0sleep00-21swapper/009:30:240
4147974210,0sleep10-21swapper/109:30:011
4147768210,1sleep00-21swapper/009:27:470
4147628210,0sleep20-21swapper/209:26:212
4147218210,0sleep14147489-21grep09:25:201
4144248210,0sleep10-21swapper/109:20:121
4143977210,0sleep20-21swapper/209:20:012
4143546210,0sleep00-21swapper/009:15:310
4142384210,0sleep10-21swapper/109:15:161
4141199210,0sleep10-21swapper/109:10:221
4140234210,0sleep00-21swapper/009:10:130
4137707210,0sleep20-21swapper/209:00:282
4134704210,0sleep10-21swapper/108:55:191
4134592210,0sleep00-21swapper/008:55:180
4134469210,0sleep20-21swapper/208:55:152
4133879210,0sleep10-21swapper/108:50:381
4132554210,0sleep00-21swapper/008:50:130
4131268210,0sleep20-21swapper/208:45:232
4130395210,0sleep10-21swapper/108:45:021
4129077210,0sleep00-21swapper/008:40:170
4127365210,0sleep20-21swapper/208:35:262
4127067210,0sleep00-21swapper/008:35:240
4126533210,0sleep10-21swapper/108:35:131
4125126210,0sleep00-21swapper/008:30:150
4124371210,0sleep20-21swapper/208:30:012
4123223210,0sleep10-21swapper/108:25:171
4123138210,0sleep00-21swapper/008:25:160
4122797210,0sleep20-21swapper/208:25:142
4121584210,0sleep20-21swapper/208:20:172
4120790210,0sleep00-21swapper/008:20:110
4117386210,0sleep20-21swapper/208:10:172
4116406210,0sleep20-21swapper/208:06:212
4116001210,0sleep00-21swapper/008:05:210
4115031210,0sleep10-21swapper/108:05:151
4114095210,0sleep10-21swapper/108:00:191
4113960210,0sleep04114094-21/usr/sbin/munin08:00:180
4113729210,0sleep20-21swapper/208:00:162
4111033210,0sleep20-21swapper/207:55:202
4109619210,0sleep10-21swapper/107:50:141
4109094210,0sleep20-21swapper/207:50:112
4108998210,1sleep00-21swapper/007:50:050
4108457210,0sleep20-21swapper/207:46:072
4105609210,0sleep20-21swapper/207:40:152
4105338210,0sleep10-21swapper/107:40:141
4104644210,0sleep00-21swapper/007:36:330
4103153210,0sleep20-21swapper/207:35:142
4102425210,0sleep00-21swapper/007:30:360
4101516210,0sleep20-21swapper/207:30:302
4101382210,0sleep10-21swapper/107:30:291
4099427210,0sleep20-21swapper/207:25:142
4099324210,0sleep00-21swapper/007:25:110
4099074210,0sleep10-21swapper/107:25:011
4097931210,0sleep10-21swapper/107:20:171
4097848210,0sleep00-21swapper/007:20:160
4095628210,0sleep20-21swapper/207:15:132
4095504210,0sleep10-21swapper/107:15:121
4095475210,0sleep04095501-21apt-get07:15:110
4092836210,0sleep00-21swapper/007:10:100
4092828210,0sleep10-21swapper/107:10:071
4092534210,0sleep20-21swapper/207:10:012
384210,0sleep20-21swapper/211:20:162
32451210,0sleep00-21swapper/012:35:190
32063210,0sleep10-21swapper/112:35:161
30347210,0sleep10-21swapper/112:30:151
29909210,0sleep20-21swapper/212:30:132
29641210,0sleep20-21swapper/212:29:572
27979210,0sleep10-21swapper/112:25:161
27880210,0sleep00-21swapper/012:25:150
27097210,0sleep20-21swapper/212:20:532
26886210,0sleep00-21swapper/012:20:230
25799210,0sleep10-21swapper/112:20:161
2505210,0sleep20-21swapper/211:25:132
2415210,0sleep10-21swapper/111:25:121
24060210,0sleep20-21swapper/212:15:152
2405210,0sleep00-21swapper/011:25:060
22898210,0sleep10-21swapper/112:10:471
21592210,0sleep20-21swapper/212:10:162
19700210,0sleep20-21swapper/212:05:202
19628210,0sleep10-21swapper/112:05:191
19195210,1sleep00-21swapper/012:05:100
18593210,0sleep10-21swapper/112:01:501
1743210,0sleep10-21swapper/111:21:201
1672210,0sleep00-21swapper/011:20:430
16381210,0sleep00-21swapper/011:55:530
15762210,0sleep20-21swapper/211:55:192
15018210,0sleep10-21swapper/111:55:141
13691210,0sleep00-21swapper/011:50:200
12930210,0sleep20-21swapper/211:50:152
12920210,0sleep10-21swapper/111:50:091
11817210,0sleep10-21swapper/111:45:211
10618210,0sleep20-21swapper/211:45:022
4192124200,0sleep10-21swapper/111:15:031
4187714200,0sleep00-21swapper/011:05:020
4181666200,0sleep20-21swapper/210:50:032
4179580200,0sleep00-21swapper/010:45:030
4173056200,0sleep20-21swapper/210:30:022
4160484200,0sleep10-21swapper/110:00:031
4154012200,0sleep10-21swapper/109:45:021
4144233200,0sleep00-21swapper/009:20:030
4140217200,0sleep20-21swapper/209:10:032
4138299200,0sleep10-21swapper/109:05:031
4136386200,0sleep10-21swapper/109:00:031
4132541200,0sleep20-21swapper/208:50:032
4128714200,0sleep20-21swapper/208:40:032
4120781200,0sleep10-21swapper/108:20:041
4118844200,0sleep20-21swapper/208:15:042
4116928200,0sleep10-21swapper/108:10:041
4116927200,0sleep00-21swapper/008:10:030
4110674200,0sleep00-21swapper/007:55:020
4106848200,0sleep00-21swapper/007:45:010
4102902200,0sleep10-21swapper/107:35:021
4097141200,0sleep20-21swapper/207:20:022
31986200,0sleep20-21swapper/212:35:052
23616200,0sleep10-21swapper/112:15:021
17110200,0sleep20-21swapper/212:00:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional