You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 23:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Fri Nov 21, 2025 12:45:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
441723000,6sleep1181rcuc/107:05:391
352022880,6sleep225-21ksoftirqd/207:05:172
410022510,2sleep30-21swapper/307:05:263
516798230224,4cyclictest17983-21kworker/u8:9807:46:552
516098207198,6cyclictest18011-21kworker/u8:12607:46:550
516598184178,4cyclictest17986-21kworker/u8:10107:46:551
5170989991,5cyclictest31-21ksoftirqd/308:52:263
5170989991,5cyclictest31-21ksoftirqd/308:52:263
5167989892,4cyclictest10293-21kworker/u8:2008:52:262
5167989892,4cyclictest10293-21kworker/u8:2008:52:262
313362800,2sleep330392-21kworker/u8:1011:50:153
5170986557,5cyclictest31-21ksoftirqd/308:47:193
5170986557,5cyclictest31-21ksoftirqd/308:02:163
5167986357,4cyclictest23621-21kworker/u8:708:02:162
5167986257,3cyclictest6461-21kworker/u8:808:47:192
128712580,3sleep20-21swapper/208:55:192
27082520,1chrt0-21swapper/308:26:403
5165985146,3cyclictest8418-21kworker/u8:7708:52:261
5165985146,3cyclictest8418-21kworker/u8:7708:52:261
5160984132,6cyclictest23671-21kworker/u8:5608:02:160
274472410,16sleep119-21ksoftirqd/108:07:361
165852410,2sleep30-21swapper/307:40:203
165852410,2sleep30-21swapper/307:40:203
5160984032,6cyclictest8426-21kworker/u8:8508:47:190
111632400,2sleep10-21swapper/111:08:031
517098353,4cyclictest121rcu_preempt10:25:173
517098331,3cyclictest121rcu_preempt09:55:123
35462330,3sleep22828-21/usr/sbin/munin09:45:252
276212320,7sleep223006-1kworker/u9:009:29:422
247032320,9sleep331-21ksoftirqd/311:35:283
247032320,9sleep331-21ksoftirqd/311:35:283
517098311,3cyclictest121rcu_preempt11:00:163
86952300,8sleep331-21ksoftirqd/307:18:043
517098301,3cyclictest121rcu_preempt12:00:173
47652300,9sleep225-21ksoftirqd/208:34:162
291072300,6sleep331-21ksoftirqd/310:38:063
265972300,2sleep30-21swapper/311:40:223
209252300,2sleep20-21swapper/212:35:182
209252300,2sleep20-21swapper/212:35:182
125122300,18sleep331-21ksoftirqd/307:29:183
71302290,2chrt0-21swapper/207:15:022
71302290,2chrt0-21swapper/207:15:022
67432290,6sleep331-21ksoftirqd/307:12:133
67432290,6sleep331-21ksoftirqd/307:12:123
516798291,4cyclictest121rcu_preempt11:05:132
241752290,8sleep21990-21bootmenu10:27:312
234232290,17sleep30-21swapper/311:33:583
122092290,3sleep30-21swapper/312:15:403
110122290,7sleep31990-21bootmenu11:07:213
78562280,2sleep30-21swapper/308:40:363
76612280,1sleep16464-21kworker/u8:1008:40:261
69002280,9sleep225-21ksoftirqd/209:52:242
65562280,3sleep31990-21bootmenu10:59:213
60472280,7sleep2251ksoftirqd/210:56:352
516598283,5cyclictest19-21ksoftirqd/109:05:211
238102280,7sleep21987-21bootmenu07:58:572
158892280,5sleep2251ksoftirqd/212:25:122
152822280,5sleep331-21ksoftirqd/312:23:133
517098272,5cyclictest31-21ksoftirqd/307:35:183
516798273,4cyclictest121rcu_preempt10:30:322
295642270,2sleep20-21swapper/209:32:102
283382270,15sleep225-21ksoftirqd/211:44:272
19322270,1sleep21931-21ssh09:41:432
19322270,1sleep21931-21ssh09:41:432
182502270,2sleep30-21swapper/311:22:173
164722270,8sleep21990-21bootmenu10:11:312
164722270,8sleep21990-21bootmenu10:11:302
86062260,2sleep20-21swapper/211:02:182
79132260,7sleep119-21ksoftirqd/111:00:441
78372260,2sleep20-21swapper/212:07:082
66232260,2sleep21990-21bootmenu08:39:102
39742260,2sleep20-21swapper/210:53:162
318132260,2sleep30-21swapper/310:44:383
318132260,2sleep30-21swapper/310:44:373
313402260,2sleep30-21swapper/308:16:433
307962260,2sleep223623-1kworker/u9:308:15:422
284272260,15sleep127977-21kworker/u8:111:44:541
28352260,4sleep21990-21bootmenu08:28:122
179462260,5sleep331-21ksoftirqd/312:29:443
178662260,2sleep30-21swapper/309:08:553
160362260,6sleep25157-21cyclictest07:37:092
158402260,2sleep20-21swapper/209:01:342
155202260,8sleep2251ksoftirqd/212:24:292
106652260,2sleep21990-21bootmenu07:24:182
7322250,2sleep30-21swapper/308:21:093
7322250,2sleep30-21swapper/308:21:093
517098254,4cyclictest31-21ksoftirqd/310:20:223
517098254,3cyclictest121rcu_preempt11:10:183
517098254,3cyclictest121rcu_preempt11:10:173
516098255,6cyclictest119750irq/29-4f00000.07:38:590
5160982513,8cyclictest19489-21timerandwakeup12:30:440
48042250,2sleep30-21swapper/309:49:003
313502250,2sleep20-21swapper/210:42:072
313502250,2sleep20-21swapper/210:42:062
287752250,7sleep331-21ksoftirqd/309:30:353
273092250,2sleep30-21swapper/308:06:093
231622250,1sleep219816-21kworker/u8:309:20:162
223612250,14sleep222281-21kworker/u8:009:17:302
204802250,2sleep331-21ksoftirqd/311:26:233
201022250,8sleep1191ksoftirqd/112:33:231
165662250,5sleep119-21ksoftirqd/110:11:591
165662250,5sleep119-21ksoftirqd/110:11:581
161012250,2sleep20-21swapper/211:18:452
161012250,2sleep20-21swapper/211:18:452
120382250,2sleep31990-21bootmenu10:03:513
107762250,2sleep30-21swapper/312:14:573
97492240,2sleep20-21swapper/209:59:412
9192240,12sleep129321-21kworker/u8:5308:23:211
9192240,12sleep129321-21kworker/u8:5308:23:211
87142240,2sleep20-21swapper/207:18:182
84352240,13sleep28353-21kworker/u8:708:42:242
67082240,2sleep10-21swapper/107:11:591
67082240,2sleep10-21swapper/107:11:591
516798244,7cyclictest274362kworker/u8:1808:10:332
516798242,4cyclictest25-21ksoftirqd/212:30:312
516798241,4cyclictest11183-21ssh12:15:182
48002240,13sleep12738-21kworker/u8:708:34:391
305252240,13sleep330391-21kworker/u8:911:48:223
274782240,1sleep223664-21kworker/u8:4908:08:012
257402240,2sleep20-21swapper/211:38:322
257402240,2sleep20-21swapper/211:38:322
182602240,2sleep21990-21bootmenu11:22:202
182172240,1sleep28352-21kworker/u8:509:10:022
122582240,1sleep29245-21kworker/u8:110:04:592
105882240,2sleep30-21swapper/307:23:193
90742230,2sleep1121rcu_preempt09:56:091
78022230,12sleep30-21swapper/312:07:013
64402230,1sleep34594-21kworker/u8:208:36:583
517098234,4cyclictest31-21ksoftirqd/310:46:423
517098234,4cyclictest31-21ksoftirqd/309:39:133
516798235,4cyclictest121rcu_preempt07:50:242
516798231,5cyclictest25-21ksoftirqd/211:53:372
516098231,8cyclictest225182ssh12:38:370
516098231,8cyclictest225182ssh12:38:370
41502230,2sleep31990-21bootmenu10:54:193
307342230,12sleep230392-21kworker/u8:1011:49:302
265372230,2sleep320141-1kworker/u9:310:32:103
25572230,1sleep331-21ksoftirqd/309:44:583
25572230,1sleep331-21ksoftirqd/309:44:583
235452230,1sleep3301rcuc/307:56:213
182542230,2sleep20-21swapper/207:44:582
182542230,2sleep20-21swapper/207:44:572
150352230,12sleep112693-21kworker/u8:312:21:541
141662230,2sleep21990-21bootmenu07:31:502
101742230,1sleep17823-21kworker/u8:012:11:491
101532230,2sleep20-21swapper/212:11:412
69532220,1sleep36827-21kworker/u8:1009:52:413
517098223,4cyclictest121rcu_preempt12:35:363
517098223,4cyclictest121rcu_preempt12:35:363
517098221,4cyclictest121rcu_preempt10:10:293
517098221,4cyclictest121rcu_preempt10:10:293
516098221,7cyclictest5463-21irqrtprio08:35:230
5160982216,3cyclictest10-21ksoftirqd/009:35:160
5160982213,7cyclictest119750irq/29-4f00000.07:57:150
286732220,12sleep119-21ksoftirqd/110:35:461
24642220,4sleep1121rcu_preempt11:55:411
245002220,2sleep124499-21ssh09:20:591
218982220,2sleep30-21swapper/307:53:553
216612220,1sleep216653-21kworker/u8:010:22:012
210302220,2sleep220643-21kworker/u8:2811:29:112
197912220,1sleep317959-21kworker/u8:7407:46:033
157382220,1sleep33806-21kworker/u8:411:16:543
157382220,1sleep33806-21kworker/u8:411:16:533
139892220,5sleep331-21ksoftirqd/308:56:493
131702220,1sleep21144-21kworker/u8:011:10:582
131702220,1sleep21144-21kworker/u8:011:10:572
85192210,11sleep119-21ksoftirqd/107:16:211
517098213,3cyclictest121rcu_preempt12:30:203
516798213,7cyclictest92452kworker/u8:110:05:422
516798213,7cyclictest92452kworker/u8:110:05:412
516798212,8cyclictest105192kworker/u8:1407:25:352
516798212,3cyclictest121rcu_preempt12:00:242
516798211,3cyclictest121rcu_preempt10:16:002
516798211,10cyclictest28259-21ntp_states10:35:332
516598218,3cyclictest19-21ksoftirqd/109:48:511
516598216,4cyclictest121rcu_preempt08:35:141
516598216,12cyclictest121rcu_preempt11:39:411
516598216,12cyclictest121rcu_preempt11:39:401
516598215,10cyclictest72612chrt09:54:161
516598214,12cyclictest19-21ksoftirqd/112:05:181
516598211,10cyclictest19-21ksoftirqd/107:30:331
516098217,12cyclictest119750irq/29-4f00000.08:28:590
516098214,12cyclictest0-21swapper/009:04:590
38732210,5sleep1191ksoftirqd/110:52:431
326832210,10sleep129523-1kworker/u9:211:50:591
321782210,11sleep225-21ksoftirqd/209:38:142
31952210,11sleep331-21ksoftirqd/311:58:273
300132210,4sleep1121rcu_preempt08:15:161
293892210,11sleep331-21ksoftirqd/308:13:253
271322210,11sleep331-21ksoftirqd/309:27:123
270862210,10sleep124739-21kworker/u8:509:26:581
223772210,11sleep331-21ksoftirqd/309:17:353
206732210,11sleep11990-21bootmenu11:27:181
197452210,2sleep34845-21kworker/3:109:11:363
188652210,11sleep331-21ksoftirqd/310:16:233
181712210,10sleep117982-21kworker/u8:9707:43:561
181712210,10sleep117982-21kworker/u8:9707:43:561
142772210,2sleep30-21swapper/307:33:153
141882210,5sleep1191ksoftirqd/110:07:201
141882210,5sleep1191ksoftirqd/110:07:191
517098201,3cyclictest0-21swapper/310:05:263
517098201,3cyclictest0-21swapper/310:05:253
516798205,5cyclictest25-21ksoftirqd/210:45:252
516798201,3cyclictest0-21swapper/208:20:262
516798201,3cyclictest0-21swapper/208:20:262
5167982013,4cyclictest21575-21aten2.4-expect11:30:172
516598205,12cyclictest164952chrt12:25:241
516598204,6cyclictest19-21ksoftirqd/108:27:271
516598203,3cyclictest229792sleep111:31:441
516598202,7cyclictest29642-21latency_hist08:15:011
5165982014,4cyclictest20716-21aten2_rfpower_e12:35:161
5165982014,4cyclictest20716-21aten2_rfpower_e12:35:151
5165982014,3cyclictest4600-21sshd12:00:291
5165982013,4cyclictest18770-21sh10:15:481
516098208,6cyclictest16541-21sh10:11:510
516098208,6cyclictest16541-21sh10:11:510
5160982012,6cyclictest2081-21sh11:55:280
22562200,10sleep119-21ksoftirqd/109:43:241
22562200,10sleep119-21ksoftirqd/109:43:231
219962200,10sleep119-21ksoftirqd/110:23:441
219282200,10sleep11990-21bootmenu07:54:171
178862200,10sleep225-21ksoftirqd/209:09:102
139052200,1sleep110331-21kworker/u8:5708:55:461
133652200,10sleep119-21ksoftirqd/111:11:581
133652200,10sleep119-21ksoftirqd/111:11:581
104752200,10sleep11990-21bootmenu08:49:071
517098191,4cyclictest0-21swapper/308:30:283
5170981912,4cyclictest23134-21/usr/sbin/munin09:20:163
516598191,8cyclictest218012kworker/u8:910:30:001
5165981913,4cyclictest14519-21/usr/sbin/munin09:00:401
5165981912,4cyclictest28725-21/usr/sbin/munin11:45:201
5165981912,4cyclictest11120-21aten2_rfpower_e12:15:181
5165981911,4cyclictest1945-21runrttasks10:32:221
516098199,8cyclictest5953-21cron12:05:010
516098199,8cyclictest19610-21ssh09:10:590
516098199,8cyclictest11882-21sh10:03:000
516098195,11cyclictest0-21swapper/011:00:020
5160981914,3cyclictest8874-21cron07:20:000
5160981914,3cyclictest6999-21ssh11:00:160
5160981911,6cyclictest1945-21runrttasks11:10:320
5160981911,6cyclictest1945-21runrttasks11:10:310
516098191,16cyclictest119750irq/29-4f00000.08:13:590
294572190,9sleep119-21ksoftirqd/109:31:381
235072190,9sleep11990-21bootmenu07:55:501
225222190,9sleep119-21ksoftirqd/109:18:221
146812190,9sleep15157-21cyclictest07:35:151
114682190,9sleep11990-21bootmenu10:00:561
517098180,3cyclictest121rcu_preempt09:05:023
5167981810,5cyclictest1335-21/usr/sbin/munin11:55:272
516598183,9cyclictest123282sleep107:26:541
516598183,9cyclictest106782chrt07:24:261
5165981812,3cyclictest14260-21aten2_rfpower_e11:15:161
5165981812,3cyclictest14260-21aten2_rfpower_e11:15:151
5165981811,4cyclictest5633-21sendmail_mailtr10:55:381
5165981811,4cyclictest536-21ntpq10:45:291
5165981811,4cyclictest18237-21/usr/sbin/munin09:10:391
516098189,3cyclictest28136-21ssh11:43:240
516098188,6cyclictest30193-21interrupts10:40:280
516098188,6cyclictest30193-21interrupts10:40:280
516098186,6cyclictest110350irq/20-fttdcc0109:15:220
516098185,4cyclictest0-21swapper/008:21:590
516098185,4cyclictest0-21swapper/008:21:590
516098182,3cyclictest0-21swapper/008:56:590
516098182,13cyclictest19594-21apt-get10:20:150
5160981813,3cyclictest7045-21ssh12:05:290
5160981813,3cyclictest26458-21ssh09:25:360
5160981812,4cyclictest10-21ksoftirqd/007:50:170
5160981812,3cyclictest576-21ntpq10:45:300
5160981812,3cyclictest10-21ksoftirqd/008:15:490
5160981811,5cyclictest32229-21sh11:50:460
5160981811,5cyclictest17644-21sh10:15:200
5160981811,5cyclictest16636-21/usr/sbin/munin11:20:220
516098181,11cyclictest2564-21cron09:45:010
516098181,11cyclictest2564-21cron09:45:000
5160981810,6cyclictest3022-21ntp_kernel_pll_10:50:330
5160981810,6cyclictest19966-21sh11:25:380
5160981810,5cyclictest7031-21aten2_rfpower_e08:40:180
5160981810,5cyclictest23577-21sh11:34:490
315262180,8sleep15157-21cyclictest10:43:071
315262180,8sleep15157-21cyclictest10:43:061
255692180,8sleep11990-21bootmenu08:02:301
5165981711,3cyclictest17976-21diskmemload11:22:571
516098179,6cyclictest28393-21irqrtprio09:30:310
516098179,6cyclictest1945-21runrttasks11:17:460
516098179,6cyclictest1945-21runrttasks11:17:450
516098179,5cyclictest9823-21missed_timers07:20:240
516098179,5cyclictest14230-21sh10:07:310
516098179,5cyclictest14230-21sh10:07:310
516098176,8cyclictest8980-21idleruntime12:10:240
516098174,11cyclictest13104-21hddtemp_smartct07:30:210
516098173,8cyclictest11179-21aten2.4-expect12:15:180
5160981712,3cyclictest14645-21ssh12:20:440
5160981712,3cyclictest10-21ksoftirqd/009:20:150
5160981710,5cyclictest84682sleep009:55:300
5160981710,5cyclictest6981-21latency_hist07:15:020
5160981710,5cyclictest6981-21latency_hist07:15:010
5160981710,5cyclictest4154-21open_files08:30:420
5160981710,5cyclictest27341-21/usr/sbin/munin10:35:220
5160981710,5cyclictest23882-21sh11:35:100
5160981710,5cyclictest23882-21sh11:35:090
5160981710,5cyclictest22514-21/usr/sbin/munin10:25:340
5160981710,5cyclictest16814-21forks07:40:240
5160981710,5cyclictest16814-21forks07:40:240
5160981710,5cyclictest16688-21if_err_eth009:05:280
303582170,7sleep119-21ksoftirqd/109:35:061
516098169,5cyclictest29040-21idleruntime11:45:230
516098168,6cyclictest5264-21sh09:50:110
516098167,3cyclictest26820-21collect208:05:260
5160981611,3cyclictest16590-21/usr/sbin/munin12:25:240
5160981611,3cyclictest11078-21/usr/sbin/munin08:50:230
5160981611,3cyclictest11078-21/usr/sbin/munin08:50:230
5160981610,3cyclictest119750irq/29-4f00000.09:45:140
5160981610,3cyclictest10-21ksoftirqd/010:30:330
516098157,6cyclictest9482-21aten2_rfpower_f11:05:180
516098151,7cyclictest11114-21aten2_rfpower_p07:25:150
516098151,12cyclictest5230-21latency_hist07:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional