You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-14 - 07:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Tue Oct 14, 2025 00:44:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38142950,0sleep13813-21bash23:18:141
268492910,1sleep326846-21bash23:53:103
267432910,1sleep126729-21sshd22:20:361
211622860,0sleep221161-21id23:31:402
98012790,0sleep19773-21sshd21:20:391
262612730,1sleep01506-21nfsd00:27:200
302826523,9sleep30-21swapper/319:05:093
210932640,0sleep121091-21bash23:58:351
205752620,0sleep220573-21bash21:36:152
292352600,0sleep129236-21munin-node23:50:221
234142570,0sleep323391-21sshd21:36:323
219802570,1sleep31722-21runrttasks00:04:423
178342570,0sleep00-21swapper/023:46:210
91712560,0sleep09158-21sshd23:51:290
64002560,0sleep30-21swapper/300:35:243
199282560,0sleep227065-21diskmemload21:45:082
101802560,0sleep00-21swapper/021:26:310
79442550,0sleep33358-21kworker/3:321:49:543
66332550,0sleep26617-21sshd23:45:182
6312550,0sleep00-21swapper/022:30:090
494625523,7sleep10-21swapper/119:07:181
259812550,0sleep225979-21bash00:33:582
15602540,0sleep00-21swapper/022:27:120
15602540,0sleep00-21swapper/022:27:120
129242530,0sleep20-21swapper/221:59:022
66522520,0sleep26638-21sshd23:21:232
64802520,0sleep3381ktimersoftd/322:18:543
283922520,0sleep30-21swapper/322:23:473
146112520,0sleep20-21swapper/223:25:112
315062510,0sleep339-21ksoftirqd/321:10:283
196722510,0sleep10-21swapper/122:14:191
72072500,1sleep07208-21sshd23:27:310
480024928,18sleep00-21swapper/019:05:290
302724926,19sleep20-21swapper/219:05:072
164752490,0sleep30-21swapper/322:34:373
266702480,0sleep30-21swapper/322:44:263
250642480,1sleep228-21rcuc/219:50:002
215702480,1sleep121566-21bash21:15:471
121422480,0sleep312136-21cp22:28:133
121422480,0sleep312136-21cp22:28:123
115922480,2sleep2542199cyclictest22:04:472
234562470,0sleep00-21swapper/022:02:530
169532460,0sleep20-21swapper/200:04:142
133772460,0sleep113358-21sshd23:13:091
77462450,0sleep30-21swapper/323:42:283
27512450,0sleep12704-21sshd21:52:161
208332450,0sleep337-21rcuc/321:21:413
108462450,1sleep1201ktimersoftd/122:40:031
277532430,0sleep127752-21bash00:14:271
255492410,0sleep20-21swapper/222:20:292
542199352,33cyclictest0-21swapper/219:43:262
542199340,34cyclictest0-21swapper/223:07:552
542199340,34cyclictest0-21swapper/220:37:152
542199340,33cyclictest8104-21sshd22:54:362
542199340,33cyclictest0-21swapper/200:25:182
542199332,30cyclictest0-21swapper/219:23:522
301642290,0sleep130165-21bash22:56:341
542199280,28cyclictest0-21swapper/223:02:002
162552260,0sleep316225-21sshd23:25:163
542499250,2cyclictest12530-21cp23:19:023
5414992220,1cyclictest8751-21sshd22:48:360
542199210,21cyclictest0-21swapper/219:57:142
5414992120,1cyclictest32107-21sshd23:59:390
5419992018,1cyclictest9401-21sshd22:45:401
5421991917,1cyclictest8210-21sshd00:22:252
541999190,18cyclictest0-21swapper/100:24:251
242462190,0sleep21507-21nfsd22:44:142
219552190,1sleep221900-21sshd23:10:532
5424991816,1cyclictest9357-21sshd23:00:433
5414991816,1cyclictest2235-21sshd23:18:040
137232180,1sleep213713-21sshd21:29:502
90792170,0sleep29076-21sshd22:27:542
90792170,0sleep29076-21sshd22:27:542
5421991716,1cyclictest30368-21sshd22:06:232
541499170,16cyclictest24252-21bash21:24:590
542499160,15cyclictest0-21swapper/300:25:363
541499165,5cyclictest0-21swapper/023:06:450
541499161,12cyclictest0-21swapper/022:21:540
541499160,13cyclictest29479-21sshd21:31:110
53602160,0sleep35358-21bash22:01:113
325872160,1sleep332580-21sshd23:47:453
542499159,5cyclictest0-21swapper/300:10:273
542499151,11cyclictest0-21swapper/320:25:173
5421991513,1cyclictest0-21swapper/222:30:282
541999159,5cyclictest0-21swapper/121:12:451
541999150,14cyclictest0-21swapper/121:47:251
541499159,5cyclictest0-21swapper/000:03:060
541499152,10cyclictest0-21swapper/021:54:240
5414991512,1cyclictest0-21swapper/021:39:110
5414991510,4cyclictest3222-21sshd23:35:560
541499150,6cyclictest19302-21sshd00:20:160
541499150,14cyclictest0-21swapper/022:09:280
541499150,12cyclictest0-21swapper/021:41:050
174832150,0sleep217470-21sshd23:43:222
75702140,0sleep10-21swapper/100:35:301
5424991412,1cyclictest13908-21sshd22:55:073
5424991411,2cyclictest17404-21sshd21:33:063
542499140,13cyclictest0-21swapper/321:53:183
542499140,13cyclictest0-21swapper/300:18:493
5421991411,3cyclictest115950irq/25-eth023:51:552
542199140,2cyclictest23648-21sshd21:21:562
542199140,2cyclictest16463-21sshd23:58:112
541999149,4cyclictest6045-21sshd21:40:511
541999140,5cyclictest0-21swapper/100:02:551
541999140,13cyclictest32234-21sshd23:38:431
541999140,13cyclictest0-21swapper/123:45:131
541999140,13cyclictest0-21swapper/123:26:491
541999140,13cyclictest0-21swapper/100:16:061
541499144,6cyclictest0-21swapper/023:00:470
541499142,1cyclictest26597-21sshd22:56:130
541499142,11cyclictest3-21ksoftirqd/021:17:390
541499141,6cyclictest0-21swapper/023:21:190
5414991412,1cyclictest11388-21sshd22:51:420
541499141,12cyclictest0-21swapper/023:31:200
541499140,3cyclictest21517-21sshd23:40:400
541499140,1cyclictest0-21swapper/021:13:210
541499140,14cyclictest0-21swapper/000:07:460
541499140,13cyclictest0-21swapper/000:13:560
541499140,11cyclictest0-21swapper/022:15:040
233242140,1sleep023326-21cpuspeed_turbos22:35:140
233242140,1sleep023326-21cpuspeed_turbos22:35:140
542499139,3cyclictest0-21swapper/319:20:163
542499139,2cyclictest0-21swapper/300:22:453
542499139,1cyclictest115950irq/25-eth021:27:063
542499139,1cyclictest0-21swapper/322:49:003
542499131,11cyclictest0-21swapper/321:56:303
542499130,2cyclictest0-21swapper/323:35:043
542499130,13cyclictest0-21swapper/323:08:083
542499130,12cyclictest32079-21sshd23:56:363
542499130,12cyclictest14430-21cstates20:35:163
542499130,12cyclictest0-21swapper/322:10:483
542499130,12cyclictest0-21swapper/300:05:333
542199138,1cyclictest0-21swapper/222:18:252
542199131,11cyclictest0-21swapper/200:09:442
542199130,4cyclictest0-21swapper/200:12:562
542199130,12cyclictest22436-21bash22:11:342
542199130,12cyclictest0-21swapper/222:55:542
542199130,12cyclictest0-21swapper/221:41:342
541999139,1cyclictest115950irq/25-eth022:50:491
541999139,1cyclictest0-21swapper/121:32:371
541999138,4cyclictest12933-21sshd22:25:161
541999138,4cyclictest12933-21sshd22:25:161
541999138,4cyclictest0-21swapper/100:31:271
541999133,9cyclictest14971-21sshd00:10:001
541999131,11cyclictest0-21swapper/119:55:171
541999131,11cyclictest0-21swapper/119:50:181
541999131,11cyclictest0-21swapper/119:40:161
541999130,4cyclictest18826-21sshd22:05:211
541999130,4cyclictest0-21swapper/122:16:271
541999130,2cyclictest0-21swapper/122:37:551
541999130,2cyclictest0-21swapper/122:37:551
541999130,12cyclictest548-21sshd21:57:541
541999130,12cyclictest13552-21sshd23:40:011
541999130,12cyclictest0-21swapper/123:31:481
541999130,12cyclictest0-21swapper/121:35:481
541999130,12cyclictest0-21swapper/100:25:411
541999130,10cyclictest26410-21sshd21:25:101
541999130,10cyclictest0-21swapper/123:02:291
541499138,4cyclictest0-21swapper/022:43:230
541499131,9cyclictest0-21swapper/022:10:130
5414991310,2cyclictest0-21swapper/000:35:460
541499130,12cyclictest31279-21sshd00:34:370
541499130,12cyclictest26287-21sshd21:45:350
541499130,12cyclictest13131-21sshd00:16:090
541499130,12cyclictest0-21swapper/020:30:140
325302130,0sleep30-21swapper/321:40:203
255312130,1sleep325528-21bash23:11:143
231902130,1sleep31507-21nfsd21:15:573
542499129,2cyclictest0-21swapper/322:35:013
542499129,2cyclictest0-21swapper/322:35:013
542499129,2cyclictest0-21swapper/321:05:113
542499129,2cyclictest0-21swapper/320:00:163
542499129,2cyclictest0-21swapper/319:45:163
542499129,2cyclictest0-21swapper/319:40:153
542499128,3cyclictest0-21swapper/300:31:533
542499121,2cyclictest0-21swapper/319:25:123
542499121,10cyclictest0-21swapper/320:30:153
542499121,10cyclictest0-21swapper/320:20:163
542499120,9cyclictest0-21swapper/322:05:273
542499120,3cyclictest0-21swapper/323:30:583
542499120,11cyclictest0-21swapper/322:50:303
542499120,10cyclictest115950irq/25-eth023:23:083
542199129,2cyclictest0-21swapper/220:15:142
542199129,2cyclictest0-21swapper/220:10:162
542199128,1cyclictest0-21swapper/222:45:542
542199121,10cyclictest0-21swapper/223:15:212
542199121,10cyclictest0-21swapper/221:30:332
5421991210,1cyclictest1324-21sshd23:38:512
542199120,9cyclictest0-21swapper/221:51:302
542199120,11cyclictest19386-21sshd21:15:322
542199120,11cyclictest0-21swapper/222:35:262
542199120,11cyclictest0-21swapper/222:35:262
542199120,11cyclictest0-21swapper/221:14:152
542199120,11cyclictest0-21swapper/200:35:402
542199120,11cyclictest0-21swapper/200:17:352
541999129,2cyclictest0-21swapper/120:15:121
541999129,2cyclictest0-21swapper/120:05:171
541999122,1cyclictest115950irq/25-eth023:05:401
541999121,2cyclictest0-21swapper/119:15:001
541999120,3cyclictest0-21swapper/122:30:251
541999120,11cyclictest0-21swapper/123:20:071
541999120,11cyclictest0-21swapper/122:00:091
541499129,2cyclictest0-21swapper/023:10:270
541499129,2cyclictest0-21swapper/020:45:090
541499129,2cyclictest0-21swapper/020:15:160
541499129,2cyclictest0-21swapper/019:25:140
541499129,2cyclictest0-21swapper/019:20:150
541499123,5cyclictest17805-21munin-run19:35:000
541499121,2cyclictest0-21swapper/021:00:160
541499121,2cyclictest0-21swapper/020:25:160
541499121,2cyclictest0-21swapper/019:10:200
541499121,10cyclictest0-21swapper/019:50:240
541499120,8cyclictest0-21swapper/021:55:140
541499120,12cyclictest0-21swapper/020:00:150
541499120,11cyclictest0-21swapper/020:50:150
541499120,11cyclictest0-21swapper/020:10:270
542499119,1cyclictest7976-21munin-node19:15:023
542499119,1cyclictest0-21swapper/319:55:243
542499118,2cyclictest0-21swapper/321:00:083
542199119,1cyclictest0-21swapper/221:00:102
542199119,1cyclictest0-21swapper/220:30:162
542199119,1cyclictest0-21swapper/220:05:152
542199119,1cyclictest0-21swapper/219:50:172
542199118,2cyclictest0-21swapper/220:45:162
542199110,2cyclictest0-21swapper/220:25:132
542199110,2cyclictest0-21swapper/219:35:142
542199110,1cyclictest0-21swapper/220:55:212
542199110,11cyclictest0-21swapper/220:02:142
542199110,10cyclictest7791-21fw_forwarded_lo20:20:192
542199110,10cyclictest0-21swapper/220:50:152
542199110,10cyclictest0-21swapper/219:30:162
542199110,10cyclictest0-21swapper/219:25:152
541999119,1cyclictest0-21swapper/120:20:181
541999119,1cyclictest0-21swapper/120:10:181
541999110,2cyclictest0-21swapper/120:45:081
541999110,10cyclictest31179-21ntp_states20:00:211
541999110,10cyclictest14150-21apache_processe20:35:131
541999110,10cyclictest0-21swapper/121:05:201
541999110,10cyclictest0-21swapper/121:00:141
541999110,10cyclictest0-21swapper/120:50:211
541999110,10cyclictest0-21swapper/119:45:241
541499119,1cyclictest0-21swapper/019:35:150
541499118,2cyclictest0-21swapper/020:05:180
541499118,2cyclictest0-21swapper/019:45:150
541499110,8cyclictest0-21swapper/020:37:300
541499110,2cyclictest0-21swapper/019:15:010
541499110,11cyclictest0-21swapper/019:41:230
541499110,10cyclictest0-21swapper/020:40:590
541499110,10cyclictest0-21swapper/020:20:200
542499108,1cyclictest0-21swapper/320:50:133
542499107,2cyclictest0-21swapper/320:15:213
542499100,9cyclictest5824-21df19:10:153
542499100,9cyclictest3984-21unixbench_singl20:10:283
542499100,9cyclictest0-21swapper/320:45:083
542499100,9cyclictest0-21swapper/319:35:163
542499100,1cyclictest596-21fw_conntrack20:05:183
542199109,1cyclictest0-21swapper/220:41:102
542199107,2cyclictest0-21swapper/219:10:132
542199100,9cyclictest8943-21df_inode19:15:152
542199100,9cyclictest0-21swapper/221:05:122
541999108,1cyclictest18385-21expr19:35:141
541999100,9cyclictest9379-21runrttasks20:25:131
541999100,1cyclictest15661-21apache_volume19:30:141
541999100,1cyclictest12781-21memory20:30:181
541499100,1cyclictest28286-21conntrack19:55:170
541499100,10cyclictest0-21swapper/021:05:520
54249990,9cyclictest0-21swapper/319:50:223
54199998,1cyclictest0-21swapper/119:10:161
54199990,9cyclictest0-21swapper/119:20:131
54199988,0cyclictest0-21swapper/119:25:191
54199980,1cyclictest0-21swapper/120:44:121
54149987,1cyclictest0-21swapper/020:56:130
54249975,1cyclictest16795-21chrt20:43:353
54249971,6cyclictest0-21swapper/319:30:173
54199960,6cyclictest0-21swapper/120:57:261
54249950,5cyclictest0-21swapper/320:55:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional