You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-09 - 10:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackaslot0.osadl.org (updated Sun Nov 09, 2025 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
63762570,1sleep06364-21sshd21:34:200
73532560,1sleep22627399cyclictest22:27:462
293002560,0sleep029284-21sshd23:46:160
44352550,0sleep34429-21sshd21:30:153
225112550,1sleep022507-21sshd22:10:190
28742540,1sleep126207-21diskmemload22:38:521
288712530,1sleep228-21rcuc/222:15:002
215902530,1sleep321586-21bash22:21:463
2590625226,8sleep00-21swapper/019:09:140
2564425229,19sleep20-21swapper/219:07:242
228572520,0sleep31722-21runrttasks00:13:193
216282520,1sleep00-21swapper/021:58:520
169812520,0sleep20-21swapper/222:44:282
89142510,0sleep00-21swapper/023:06:230
2594425128,19sleep10-21swapper/119:09:321
296942490,1sleep30-21swapper/321:52:103
191932490,1sleep21722-21runrttasks22:36:512
300682480,0sleep10-21swapper/100:01:551
272892480,0sleep339-21ksoftirqd/321:59:353
2556824825,19sleep30-21swapper/319:06:523
5172460,1sleep32627499cyclictest21:25:543
252102460,0sleep10-21swapper/121:28:581
142082450,0sleep30-21swapper/321:46:293
289222440,0sleep00-21swapper/023:57:540
238442440,1sleep11722-21runrttasks21:59:101
241992310,1sleep20-21swapper/223:38:172
163622280,0sleep316361-21sshd22:51:543
26274992422,1cyclictest0-21swapper/322:13:293
79902220,1sleep20-21swapper/200:15:272
26272992220,1cyclictest29532-21sshd22:22:451
26272992016,3cyclictest10135-21idleruntime-cro20:40:001
26269992018,1cyclictest4202-21sshd00:02:440
26269992018,1cyclictest15035-21sshd21:35:160
37442190,2sleep00-21swapper/022:08:090
26269991812,1cyclictest23880-21bash21:40:140
192982180,0sleep20-21swapper/223:22:502
26274991714,1cyclictest39-21ksoftirqd/321:38:273
2627499170,1cyclictest39-21ksoftirqd/300:08:413
2626999170,16cyclictest0-21swapper/021:47:040
4132160,1sleep18-21rcu_preempt22:50:091
327222160,1sleep132701-21sshd22:00:131
2627499167,3cyclictest1591-21sshd22:27:043
26274991614,1cyclictest4172-21sshd22:08:123
26274991614,1cyclictest27849-21sshd22:49:333
26274991613,1cyclictest39-21ksoftirqd/322:31:203
2627499160,2cyclictest0-21swapper/300:36:373
2626999169,3cyclictest0-21swapper/022:33:520
2626999168,4cyclictest23328-21bash22:41:130
2626999166,9cyclictest0-21swapper/000:05:420
26269991615,1cyclictest15054-21sshd23:22:200
2626999160,6cyclictest8055-21bash00:28:270
2626999160,15cyclictest14811-21sshd00:33:440
2626999160,15cyclictest0-21swapper/022:21:270
2626999160,12cyclictest0-21swapper/022:27:470
2627499157,1cyclictest0-21swapper/323:22:443
2627499155,9cyclictest39-21ksoftirqd/300:18:113
2627499153,9cyclictest115950irq/25-eth021:21:243
26274991512,1cyclictest39-21ksoftirqd/300:00:103
2627499151,1cyclictest1138-21bash22:38:393
2627299158,4cyclictest0-21swapper/121:38:291
2627299151,2cyclictest0-21swapper/123:31:131
2627299151,11cyclictest0-21swapper/100:13:031
2626999150,1cyclictest28277-21bash22:03:260
241272150,0sleep00-21swapper/023:15:480
241272150,0sleep00-21swapper/023:15:480
220142150,1sleep021990-21sshd23:11:550
2627499149,3cyclictest381ktimersoftd/300:25:143
2627499148,5cyclictest0-21swapper/321:15:553
2627499145,9cyclictest39-21ksoftirqd/322:00:103
2627499145,9cyclictest39-21ksoftirqd/300:30:553
2627499143,9cyclictest115950irq/25-eth023:10:273
2627499142,1cyclictest3847-21sshd23:32:123
26274991413,1cyclictest39-21ksoftirqd/300:20:303
26274991413,1cyclictest381ktimersoftd/322:55:333
2627499141,2cyclictest115950irq/25-eth022:43:053
2627499140,1cyclictest37-21rcuc/323:40:433
2627499140,13cyclictest20990-21sshd22:17:533
2627499140,13cyclictest0-21swapper/323:35:573
2627399149,4cyclictest0-21swapper/223:03:282
2627399148,5cyclictest0-21swapper/221:42:212
2627399148,4cyclictest0-21swapper/222:51:102
2627399141,9cyclictest12050irq/23-ehci_hcd00:05:432
26273991411,2cyclictest0-21swapper/221:35:162
2627399140,2cyclictest31404-21sshd21:33:262
2627399140,2cyclictest0-21swapper/223:29:092
2627399140,1cyclictest115950irq/25-eth022:06:082
2627399140,13cyclictest0-21swapper/200:28:292
2627299148,5cyclictest0-21swapper/123:00:121
2627299141,4cyclictest0-21swapper/100:30:371
26272991412,1cyclictest8620-21sshd00:37:141
26272991411,1cyclictest115950irq/25-eth023:58:481
2627299140,13cyclictest0-21swapper/123:54:361
2627299140,13cyclictest0-21swapper/123:48:551
2627299140,13cyclictest0-21swapper/123:37:471
2627299140,13cyclictest0-21swapper/123:13:001
2627299140,13cyclictest0-21swapper/100:21:121
2627299140,11cyclictest0-21swapper/123:42:191
2626999148,5cyclictest8347-21perl20:35:150
2626999148,2cyclictest12523-21sshd00:11:550
2626999147,2cyclictest0-21swapper/023:41:420
2626999144,10cyclictest0-21swapper/021:29:020
2626999143,10cyclictest13024-21cp23:25:480
2626999140,5cyclictest30218-21bash21:21:460
2626999140,14cyclictest13241-21cp23:33:200
2626999140,13cyclictest0-21swapper/023:50:110
2626999140,13cyclictest0-21swapper/000:35:300
2626999140,13cyclictest0-21swapper/000:20:290
2626999140,11cyclictest0-21swapper/022:58:230
2626999140,11cyclictest0-21swapper/022:46:170
222962140,0sleep1201ktimersoftd/100:25:471
127392140,0sleep112738-21bash22:55:181
2627499138,4cyclictest0-21swapper/321:00:223
2627499137,1cyclictest0-21swapper/323:05:433
2627499133,9cyclictest39-21ksoftirqd/321:10:013
2627499133,1cyclictest16422-21sshd23:56:203
2627499131,2cyclictest11661-21sshd23:02:523
26274991312,1cyclictest39-21ksoftirqd/323:50:423
26274991312,1cyclictest39-21ksoftirqd/323:46:553
26274991312,1cyclictest39-21ksoftirqd/323:15:423
26274991312,1cyclictest39-21ksoftirqd/323:15:413
2627499131,1cyclictest28652-21id21:40:373
2627499130,12cyclictest0-21swapper/323:25:023
2627399138,5cyclictest0-21swapper/200:14:472
2627399138,4cyclictest22402-21bash00:21:252
2627399138,4cyclictest0-21swapper/221:54:142
26273991311,1cyclictest0-21swapper/200:02:442
2627399130,3cyclictest0-21swapper/223:41:502
2627399130,2cyclictest16268-21rm22:01:592
2627399130,1cyclictest0-21swapper/223:45:362
2627399130,1cyclictest0-21swapper/223:07:492
2627399130,13cyclictest0-21swapper/221:13:192
2627399130,12cyclictest17486-21sshd23:56:282
2627399130,12cyclictest0-21swapper/223:30:262
2627399130,12cyclictest0-21swapper/222:55:092
2627399130,12cyclictest0-21swapper/222:48:292
2627399130,12cyclictest0-21swapper/221:59:082
2627399130,12cyclictest0-21swapper/221:23:082
2627399130,12cyclictest0-21swapper/221:16:342
2627299139,3cyclictest0-21swapper/122:15:521
2627299139,3cyclictest0-21swapper/121:00:111
2627299139,2cyclictest0-21swapper/122:33:241
2627299131,11cyclictest0-21swapper/123:24:201
2627299131,11cyclictest0-21swapper/123:05:151
2627299131,11cyclictest0-21swapper/121:12:301
26272991311,1cyclictest0-21swapper/120:10:161
2627299130,4cyclictest14601-21sshd22:05:301
2627299130,2cyclictest0-21swapper/122:11:291
2627299130,12cyclictest9907-21sshd00:07:221
2627299130,12cyclictest20942-21bash22:25:281
2627299130,12cyclictest0-21swapper/123:25:441
2627299130,12cyclictest0-21swapper/121:53:131
2627299130,12cyclictest0-21swapper/121:33:351
2627299130,12cyclictest0-21swapper/121:15:201
2627299130,10cyclictest2404-21sshd22:46:271
2627299130,10cyclictest15555-21munin-node21:20:111
2626999136,3cyclictest0-21swapper/023:00:130
2626999130,4cyclictest24360-21sshd21:17:190
2626999130,4cyclictest0-21swapper/022:16:420
2626999130,1cyclictest0-21swapper/021:10:250
2626999130,12cyclictest363-21sshd23:35:270
2626999130,12cyclictest16481-21cp22:51:560
2626999130,12cyclictest0-21swapper/020:30:130
2626999130,10cyclictest0-21swapper/021:50:040
219252130,0sleep121924-21sshd00:17:141
2627499129,2cyclictest0-21swapper/320:35:143
2627499129,2cyclictest0-21swapper/319:20:223
2627499129,2cyclictest0-21swapper/319:10:153
2627499121,2cyclictest0-21swapper/320:15:163
2627499121,10cyclictest0-21swapper/319:55:133
2627499120,1cyclictest0-21swapper/319:50:163
2627499120,12cyclictest0-21swapper/319:30:153
2627499120,11cyclictest0-21swapper/319:40:513
2627399129,2cyclictest0-21swapper/222:32:452
2627399129,2cyclictest0-21swapper/220:00:132
2627399129,2cyclictest0-21swapper/219:40:162
2627399129,2cyclictest0-21swapper/219:15:012
2627399128,4cyclictest0-21swapper/221:49:302
2627399128,1cyclictest23810-21sshd23:15:452
2627399128,1cyclictest23810-21sshd23:15:452
2627399128,1cyclictest0-21swapper/222:20:492
2627399120,9cyclictest1149-21sshd22:11:352
2627399120,2cyclictest2901-21sshd00:36:272
2627399120,1cyclictest0-21swapper/221:27:172
2627399120,11cyclictest5592-21sshd23:10:012
2627399120,10cyclictest0-21swapper/200:30:112
2627299129,2cyclictest0-21swapper/121:40:451
2627299129,2cyclictest0-21swapper/120:40:151
2627299129,2cyclictest0-21swapper/120:30:141
2627299129,2cyclictest0-21swapper/119:50:151
2627299121,10cyclictest0-21swapper/121:45:171
2627299121,10cyclictest0-21swapper/119:30:191
2627299120,9cyclictest0-21swapper/123:15:391
2627299120,9cyclictest0-21swapper/123:15:391
2627299120,12cyclictest0-21swapper/120:20:171
2627299120,11cyclictest0-21swapper/122:40:021
2627299120,11cyclictest0-21swapper/119:40:131
2627299120,11cyclictest0-21swapper/119:10:161
2626999128,4cyclictest0-21swapper/000:17:060
2626999127,5cyclictest0-21swapper/021:06:090
2626999121,2cyclictest0-21swapper/021:00:140
2626999121,10cyclictest0-21swapper/019:30:160
2626999121,10cyclictest0-21swapper/019:25:230
26269991210,1cyclictest27170-21entropy20:10:160
2626999120,11cyclictest5787-21kworker/0:122:35:350
2627499119,1cyclictest5048-21apache_volume20:30:133
2627499119,1cyclictest0-21swapper/320:50:003
2627499118,2cyclictest0-21swapper/320:40:213
2627499118,2cyclictest0-21swapper/320:25:223
2627499111,9cyclictest0-21swapper/320:55:153
2627499110,2cyclictest0-21swapper/320:10:133
2627499110,1cyclictest0-21swapper/319:28:323
2627499110,11cyclictest0-21swapper/320:46:513
2627499110,11cyclictest0-21swapper/320:01:323
2627499110,10cyclictest0-21swapper/319:35:153
2627499110,10cyclictest0-21swapper/319:15:003
2627399119,2cyclictest0-21swapper/220:30:162
2627399119,2cyclictest0-21swapper/219:55:152
2627399110,2cyclictest0-21swapper/223:50:022
2627399110,1cyclictest0-21swapper/219:14:202
2627399110,11cyclictest0-21swapper/220:42:242
2627399110,10cyclictest0-21swapper/221:07:572
2627399110,10cyclictest0-21swapper/221:00:132
2627399110,10cyclictest0-21swapper/220:45:152
2627399110,10cyclictest0-21swapper/220:35:132
2627399110,10cyclictest0-21swapper/220:20:132
2627399110,10cyclictest0-21swapper/220:15:172
2627399110,10cyclictest0-21swapper/220:10:142
2627399110,10cyclictest0-21swapper/220:05:192
2627399110,10cyclictest0-21swapper/219:45:142
2627399110,10cyclictest0-21swapper/219:35:182
2627299119,1cyclictest0-21swapper/120:05:171
2627299119,1cyclictest0-21swapper/119:40:001
2627299119,1cyclictest0-21swapper/119:15:151
2627299118,2cyclictest0-21swapper/120:00:161
2627299111,9cyclictest0-21swapper/120:45:141
2627299110,1cyclictest0-21swapper/119:25:191
2627299110,10cyclictest0-21swapper/121:05:141
2627299110,10cyclictest0-21swapper/120:50:181
2626999119,2cyclictest0-21swapper/020:15:140
2626999119,2cyclictest0-21swapper/019:15:000
2626999117,4cyclictest0-21swapper/019:50:150
2626999112,8cyclictest380-21cut19:20:160
2626999110,2cyclictest13326-21apache_processe19:45:120
2626999110,2cyclictest0-21swapper/020:20:220
2626999110,10cyclictest0-21swapper/020:45:140
2626999110,10cyclictest0-21swapper/020:05:190
2626999110,10cyclictest0-21swapper/020:00:230
2626999110,10cyclictest0-21swapper/019:55:120
2627499109,1cyclictest0-21swapper/319:49:063
2627499100,9cyclictest381ktimersoftd/320:20:143
2627499100,9cyclictest24047-21apache_processe20:05:153
2627499100,10cyclictest0-21swapper/321:08:213
2627399109,1cyclictest0-21swapper/220:50:242
2627399109,1cyclictest0-21swapper/219:21:112
2627399108,2cyclictest0-21swapper/219:50:172
2627399108,2cyclictest0-21swapper/219:25:152
2627399100,9cyclictest5326-21apache_processe19:30:162
2627299108,1cyclictest32719-21cstates19:20:161
2627299108,1cyclictest19748-21minicom19:55:181
2627299100,9cyclictest13608-21cstates19:45:131
2627299100,9cyclictest0-21swapper/120:55:111
2627299100,1cyclictest29398-21apache_processe20:15:141
2627299100,1cyclictest2341-21apache_processe20:25:141
2626999108,1cyclictest0-21swapper/019:35:270
2626999100,9cyclictest26749-21diskstats19:10:140
2626999100,9cyclictest20817-21latency_hist21:00:000
2626999100,9cyclictest0-21swapper/019:40:130
2626999100,1cyclictest17013-21ntp_states20:50:240
2626999100,1cyclictest11822-21smartctl20:40:230
262739990,9cyclictest0-21swapper/220:55:152
262739990,9cyclictest0-21swapper/220:25:212
262699990,1cyclictest0-21swapper/020:25:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional