You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 19:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackaslot0.osadl.org (updated Sat Nov 29, 2025 12:44:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1023821010,0sleep310240-21id09:36:403
315512900,1sleep00-21swapper/012:36:100
2970326025,19sleep20-21swapper/207:09:332
138232580,0sleep10-21swapper/110:33:231
2964025730,9sleep00-21swapper/007:08:460
96822560,0sleep30-21swapper/312:12:253
2959225627,15sleep10-21swapper/107:08:111
2969925533,18sleep30-21swapper/307:09:303
149602550,0sleep314939-21sshd12:05:363
106042550,0sleep20-21swapper/211:53:402
113202540,0sleep30-21swapper/310:13:023
110342540,1sleep31819-21runrttasks09:24:343
193892530,1sleep122702-21diskmemload09:54:221
112902530,0sleep10-21swapper/111:29:481
194882520,0sleep20-21swapper/210:42:062
248812510,1sleep08-21rcu_preempt12:06:450
246252510,0sleep20-21swapper/211:35:182
123372510,0sleep010-21rcuc/010:05:180
223912500,0sleep230-21ksoftirqd/209:21:532
221022490,0sleep10-21swapper/111:02:361
196702460,0sleep00-21swapper/010:30:090
195472450,0sleep20-21swapper/209:29:382
203702440,0sleep20-21swapper/211:22:472
310542430,0sleep20-21swapper/211:59:452
182402420,1sleep018236-21bash10:21:530
179592420,0sleep10-21swapper/112:28:051
31092400,0sleep10-21swapper/110:24:061
14152270,0sleep31416-21sshd10:43:553
185702250,0sleep10-21swapper/111:14:261
141772250,0sleep114178-21id12:05:301
3000799230,22cyclictest0-21swapper/307:58:053
30004992321,1cyclictest12630-21sshd09:37:000
3000799220,21cyclictest0-21swapper/311:58:503
3000799220,21cyclictest0-21swapper/310:05:193
3000799220,21cyclictest0-21swapper/309:59:053
3000799220,21cyclictest0-21swapper/308:27:053
3000799220,21cyclictest0-21swapper/307:44:053
30004992220,1cyclictest31496-21sshd10:19:360
3000499220,21cyclictest0-21swapper/011:40:280
3000499220,21cyclictest0-21swapper/010:00:170
30007992119,1cyclictest0-21swapper/310:50:333
3000799211,19cyclictest0-21swapper/308:43:053
3000799210,20cyclictest0-21swapper/310:18:173
3000799210,20cyclictest0-21swapper/308:49:043
3000799210,20cyclictest0-21swapper/308:33:203
3000799210,20cyclictest0-21swapper/307:11:503
30006992120,1cyclictest0-21swapper/211:49:202
3000699210,20cyclictest0-21swapper/209:57:052
3000699210,20cyclictest0-21swapper/207:50:182
3000599210,21cyclictest0-21swapper/111:06:061
3000599210,20cyclictest0-21swapper/111:20:201
3000599210,20cyclictest0-21swapper/111:15:171
3000599210,20cyclictest0-21swapper/110:51:061
3000499214,16cyclictest22702-21diskmemload12:23:510
3000499212,18cyclictest0-21swapper/009:59:030
3000499211,19cyclictest0-21swapper/011:36:490
3000499210,20cyclictest0-21swapper/007:15:160
3000499210,17cyclictest0-21swapper/011:56:210
3000499210,16cyclictest0-21swapper/009:32:550
72652200,1sleep00-21swapper/011:21:060
34102200,2sleep13000599cyclictest10:44:091
304012200,1sleep00-21swapper/011:52:110
3000799200,20cyclictest0-21swapper/308:54:493
3000799200,19cyclictest0-21swapper/307:49:503
3000599200,17cyclictest0-21swapper/110:55:181
3000499203,16cyclictest24087-21sshd10:42:400
3000499203,14cyclictest0-21swapper/011:04:270
3000499203,13cyclictest3555-21sshd09:19:270
3000499202,17cyclictest0-21swapper/012:26:490
3000499200,20cyclictest0-21swapper/008:41:350
255122200,0sleep20-21swapper/209:14:122
3000799190,18cyclictest0-21swapper/308:57:193
3000799190,18cyclictest0-21swapper/308:38:353
3000799190,18cyclictest0-21swapper/307:36:203
3000799190,17cyclictest0-21swapper/309:29:193
3000699190,18cyclictest0-21swapper/207:45:162
3000499194,9cyclictest21321-21sshd11:30:510
3000499192,9cyclictest0-21swapper/010:52:430
3000499192,6cyclictest0-21swapper/012:17:470
3000499190,19cyclictest0-21swapper/008:28:350
3000499190,14cyclictest0-21swapper/009:48:370
3000799180,17cyclictest0-21swapper/311:25:213
3000799180,17cyclictest0-21swapper/309:46:203
3000799180,17cyclictest0-21swapper/308:19:343
3000699180,17cyclictest0-21swapper/212:15:182
3000599180,17cyclictest0-21swapper/112:02:511
3000599180,17cyclictest0-21swapper/107:50:171
3000499187,9cyclictest0-21swapper/011:25:250
3000499184,13cyclictest5950-21sshd12:30:150
3000499184,13cyclictest16129-21cp10:57:410
3000499183,14cyclictest0-21swapper/012:03:090
30004991812,5cyclictest26351-21sshd09:14:180
3000499181,14cyclictest122450irq/25-eth010:47:380
3000499180,14cyclictest11132-21sshd10:25:070
214982180,2sleep20-21swapper/212:10:112
200712180,0sleep10-21swapper/110:06:121
50312170,0sleep35028-21sshd11:53:013
30007991715,1cyclictest12555-21bash09:16:243
30007991712,1cyclictest39-21ksoftirqd/310:37:003
3000799170,16cyclictest0-21swapper/307:50:203
3000799170,16cyclictest0-21swapper/307:33:503
3000699170,16cyclictest0-21swapper/209:35:512
3000499179,3cyclictest0-21swapper/011:10:100
3000499175,4cyclictest9680-21bash10:12:510
3000499173,7cyclictest0-21swapper/009:54:320
3000499173,13cyclictest30416-21sshd09:43:220
3000499173,13cyclictest11304-21sshd12:12:360
3000499172,14cyclictest0-21swapper/011:17:430
30004991712,4cyclictest24275-21sshd11:47:320
3000499170,2cyclictest0-21swapper/009:27:070
3000499170,16cyclictest0-21swapper/009:21:520
258942170,0sleep10-21swapper/109:59:031
145022170,0sleep3381ktimersoftd/310:25:253
83102160,1sleep337-21rcuc/312:27:033
3000799162,1cyclictest122450irq/25-eth011:02:023
3000799160,1cyclictest122450irq/25-eth011:13:083
3000799160,15cyclictest0-21swapper/308:22:203
3000699160,15cyclictest0-21swapper/208:05:192
3000599160,15cyclictest0-21swapper/112:10:191
3000499163,2cyclictest29114-21sshd10:35:170
30004991610,6cyclictest0-21swapper/011:07:180
56122150,0sleep20-21swapper/209:52:382
3162150,1sleep20-21swapper/211:11:582
3000799157,1cyclictest12248-21sshd12:20:123
3000799155,1cyclictest31161-21sshd11:40:103
3000799154,10cyclictest22261-21id11:06:313
30007991514,1cyclictest39-21ksoftirqd/308:10:163
30007991513,1cyclictest39-21ksoftirqd/311:49:243
30007991513,1cyclictest22289-21sshd12:38:393
30007991513,1cyclictest22249-21sshd11:19:023
30007991512,2cyclictest0-21swapper/309:32:103
30007991511,1cyclictest122450irq/25-eth010:33:393
3000699150,14cyclictest0-21swapper/207:55:172
3000699150,14cyclictest0-21swapper/207:25:172
3000699150,14cyclictest0-21swapper/207:15:162
3000499154,10cyclictest22700-21latency_hist09:10:010
3000499153,3cyclictest4673-21fschecks_time08:30:150
3000499153,1cyclictest18617-21fschecks_count09:00:160
3000499153,10cyclictest1819-21runrttasks07:31:370
30004991513,2cyclictest30022-21munin-node07:10:140
30004991513,1cyclictest6285-21apache_processe08:35:130
50102140,1sleep11819-21runrttasks09:35:581
3000799145,1cyclictest37-21rcuc/310:24:413
3000799144,9cyclictest39-21ksoftirqd/312:31:043
3000799144,9cyclictest39-21ksoftirqd/310:57:493
3000799144,3cyclictest39-21ksoftirqd/311:34:373
3000799144,1cyclictest39-21ksoftirqd/309:10:013
3000799143,1cyclictest39-21ksoftirqd/311:39:303
3000799142,10cyclictest39-21ksoftirqd/309:54:173
3000799140,13cyclictest0-21swapper/310:01:573
3000799140,13cyclictest0-21swapper/307:27:343
3000799140,13cyclictest0-21swapper/307:16:343
3000699141,12cyclictest0-21swapper/212:04:172
3000699140,3cyclictest16709-21sshd10:45:382
3000699140,13cyclictest0-21swapper/212:23:352
3000699140,13cyclictest0-21swapper/212:07:352
3000699140,13cyclictest0-21swapper/211:34:352
3000699140,13cyclictest0-21swapper/209:45:562
3000699140,13cyclictest0-21swapper/209:00:182
3000599149,2cyclictest0-21swapper/111:32:481
3000599149,2cyclictest0-21swapper/109:43:141
30005991412,1cyclictest14626-21sshd09:12:511
3000599140,13cyclictest0-21swapper/111:40:421
3000599140,13cyclictest0-21swapper/110:35:201
3000499146,7cyclictest15459-21fschecks_count07:45:150
3000499142,11cyclictest0-21swapper/007:55:220
3000499140,13cyclictest15773-21apache_volume08:55:130
3000499140,13cyclictest0-21swapper/007:51:350
30007991312,1cyclictest39-21ksoftirqd/312:03:083
30007991312,1cyclictest39-21ksoftirqd/310:45:313
3000799130,1cyclictest0-21swapper/312:15:393
3000799130,12cyclictest10787-21sshd11:21:343
3000799130,12cyclictest0-21swapper/309:43:203
3000699139,3cyclictest0-21swapper/209:41:352
3000699138,4cyclictest12315-21sshd11:41:482
3000699138,4cyclictest0-21swapper/210:13:142
3000699138,2cyclictest25189-21sshd11:02:592
3000699138,2cyclictest0-21swapper/210:16:512
3000699137,4cyclictest0-21swapper/210:32:002
30006991311,1cyclictest0-21swapper/212:34:212
3000699131,11cyclictest0-21swapper/211:28:412
30006991311,1cyclictest0-21swapper/209:30:442
3000699131,11cyclictest0-21swapper/207:35:192
3000699131,10cyclictest0-21swapper/210:35:402
3000699130,4cyclictest7903-21bash10:56:392
3000699130,12cyclictest29817-21perl08:15:162
3000699130,12cyclictest0-21swapper/212:28:262
3000699130,12cyclictest0-21swapper/211:09:172
3000699130,12cyclictest0-21swapper/210:29:482
3000699130,10cyclictest0-21swapper/209:19:052
3000599139,4cyclictest0-21swapper/112:20:501
3000599139,1cyclictest19108-21sshd11:58:211
3000599139,1cyclictest0-21swapper/112:17:051
3000599138,2cyclictest0-21swapper/110:25:181
3000599131,1cyclictest122450irq/25-eth012:30:531
30005991311,1cyclictest22702-21diskmemload10:46:111
3000599131,11cyclictest0-21swapper/111:50:561
3000599131,11cyclictest0-21swapper/111:45:151
3000599131,11cyclictest0-21swapper/110:19:271
30005991311,1cyclictest0-21swapper/109:24:111
3000599131,11cyclictest0-21swapper/107:35:191
3000599130,4cyclictest0-21swapper/109:34:041
3000599130,13cyclictest0-21swapper/109:26:481
3000599130,12cyclictest0-21swapper/110:03:551
3000599130,10cyclictest10150irq/24-ahci[00012:35:481
3000599130,10cyclictest0-21swapper/109:49:511
3000499132,10cyclictest28542-21unixbench_singl08:10:260
3000499130,13cyclictest0-21swapper/007:23:350
3000499130,12cyclictest0-21swapper/008:00:130
3000799120,11cyclictest0-21swapper/309:00:343
3000699129,2cyclictest0-21swapper/212:35:172
3000699129,2cyclictest0-21swapper/211:15:132
3000699129,2cyclictest0-21swapper/210:05:252
3000699129,2cyclictest0-21swapper/208:55:132
3000699129,2cyclictest0-21swapper/208:10:172
3000699128,1cyclictest18219-21sshd10:50:012
3000699121,10cyclictest0-21swapper/207:40:212
3000699121,10cyclictest0-21swapper/207:20:182
3000699120,11cyclictest0-21swapper/210:20:372
3000699120,11cyclictest0-21swapper/210:00:092
3000699120,11cyclictest0-21swapper/208:20:122
3000699120,11cyclictest0-21swapper/207:10:132
3000599129,2cyclictest0-21swapper/109:15:231
3000599129,2cyclictest0-21swapper/108:55:161
3000599129,2cyclictest0-21swapper/107:30:231
3000599128,3cyclictest0-21swapper/111:35:161
3000599121,2cyclictest0-21swapper/108:40:231
3000599121,10cyclictest0-21swapper/109:05:151
3000599120,11cyclictest0-21swapper/110:10:541
3000599120,11cyclictest0-21swapper/107:20:141
3000499129,2cyclictest0-21swapper/008:50:130
3000499121,2cyclictest0-21swapper/007:35:250
3000499121,10cyclictest0-21swapper/007:40:130
3000499121,10cyclictest0-21swapper/007:25:150
3000499120,11cyclictest12699-21unixbench_multi08:45:240
3000499120,11cyclictest0-21swapper/008:20:150
3000799110,2cyclictest0-21swapper/308:05:223
3000799110,10cyclictest0-21swapper/307:20:143
3000699118,2cyclictest0-21swapper/208:25:162
3000699110,2cyclictest0-21swapper/208:45:152
3000699110,2cyclictest0-21swapper/208:40:132
3000699110,2cyclictest0-21swapper/208:30:152
3000699110,10cyclictest0-21swapper/209:05:152
3000699110,10cyclictest0-21swapper/208:35:132
3000599119,1cyclictest0-21swapper/108:00:151
3000599118,2cyclictest0-21swapper/108:25:141
3000599118,2cyclictest0-21swapper/108:10:151
30005991110,1cyclictest13172-21munin-plugin-st08:50:001
3000599110,2cyclictest0-21swapper/108:50:221
3000599110,11cyclictest0-21swapper/107:13:161
3000599110,10cyclictest20335-21grep07:55:151
3000599110,10cyclictest0-21swapper/109:00:241
3000599110,10cyclictest0-21swapper/108:30:151
3000599110,10cyclictest0-21swapper/108:05:161
3000599110,10cyclictest0-21swapper/107:25:131
3000499114,6cyclictest26571-21latency_hist08:10:000
30004991110,1cyclictest0-21swapper/008:15:140
3000799100,9cyclictest0-21swapper/309:05:153
3000699108,1cyclictest7819-21apache_processe07:30:112
3000699100,1cyclictest22071-21apache_volume08:00:142
3000699100,1cyclictest0-21swapper/208:50:142
3000599108,1cyclictest0-21swapper/107:40:161
3000599100,9cyclictest32766-21awk08:20:201
3000599100,9cyclictest0-21swapper/108:35:151
3000599100,9cyclictest0-21swapper/108:15:161
3000599100,9cyclictest0-21swapper/107:15:011
3000599100,10cyclictest0-21swapper/107:45:211
300079990,9cyclictest0-21swapper/308:00:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional