You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 23:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Sat Dec 06, 2025 12:45:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
105822900,1sleep231898-21kworker/u8:2207:05:392
103122660,1sleep131898-21kworker/u8:2207:05:381
3247922630,2sleep30-21swapper/307:05:033
194098206199,4cyclictest28881-21kworker/u8:911:56:531
193698175164,8cyclictest10-21ksoftirqd/011:56:530
194198169161,5cyclictest24102-21kworker/u8:011:56:532
194098118110,5cyclictest31888-21kworker/u8:1307:12:131
194098118110,5cyclictest31888-21kworker/u8:1307:12:131
2920721050,2sleep30-21swapper/311:53:153
19369810492,9cyclictest10-21ksoftirqd/008:11:360
102182980,2sleep210217-21ssh11:13:532
1941989488,4cyclictest22387-21kworker/u8:3708:11:362
1940989184,4cyclictest12489-21kworker/u8:4709:06:551
1940989184,4cyclictest12489-21kworker/u8:4709:06:551
1936988675,8cyclictest10-21ksoftirqd/007:12:130
1936988675,8cyclictest10-21ksoftirqd/007:12:130
1941987771,4cyclictest31898-21kworker/u8:2207:12:132
1941987771,4cyclictest31898-21kworker/u8:2207:12:132
1940987467,4cyclictest27889-21kworker/u8:3508:27:111
1940987467,4cyclictest27889-21kworker/u8:3508:27:101
1936986049,8cyclictest10-21ksoftirqd/009:06:540
1936986049,8cyclictest10-21ksoftirqd/009:06:540
1941985245,5cyclictest5010-21kworker/u8:709:06:552
1941985245,5cyclictest5010-21kworker/u8:709:06:542
1940984841,3cyclictest13687-21kworker/u8:512:37:011
62782460,15sleep10-21swapper/112:11:311
70872440,3sleep15092-21kworker/u8:908:49:171
1936984432,9cyclictest10-21ksoftirqd/008:27:100
1936984432,9cyclictest10-21ksoftirqd/008:27:100
186882430,3sleep1181rcuc/111:30:331
266002410,3chrt0-21swapper/108:15:181
107372400,2sleep12628-21kworker/u8:1611:15:171
211032360,13sleep119-21ksoftirqd/108:00:181
1943983631,3cyclictest22378-21kworker/u8:1508:11:373
45122350,2sleep30-21swapper/311:00:433
265222350,11sleep20-21swapper/208:15:042
1941983529,4cyclictest24160-21kworker/u8:4108:27:112
1941983529,4cyclictest24160-21kworker/u8:4108:27:102
1940983416,4cyclictest19-21ksoftirqd/109:30:471
163322330,4sleep20-21swapper/211:25:482
228242320,20sleep217067-21kworker/u8:1111:40:192
194098324,3cyclictest121rcu_preempt10:25:141
1940983225,4cyclictest1638-21kworker/u8:6207:26:331
100462320,2sleep27745-21kworker/u8:010:05:492
194398312,4cyclictest121rcu_preempt08:05:403
194098312,3cyclictest121rcu_preempt10:20:311
1936983123,6cyclictest10-21ksoftirqd/009:45:170
1936983123,6cyclictest10-21ksoftirqd/009:45:170
1936983121,7cyclictest10-21ksoftirqd/009:25:150
304412300,18sleep20-21swapper/210:48:562
287522300,6sleep331-21ksoftirqd/310:45:193
194198301,5cyclictest121rcu_preempt08:00:152
1940983025,3cyclictest14894-21kworker/u8:2607:47:021
1940983014,3cyclictest19-21ksoftirqd/109:40:151
147822300,6sleep331-21ksoftirqd/311:22:513
82142290,16sleep23211-21kworker/u8:008:50:352
45622290,2sleep20-21swapper/208:40:342
318682290,1sleep218068-21kworker/u8:810:50:412
30402290,2sleep10-21swapper/112:05:321
30402290,2sleep10-21swapper/112:05:311
236172290,2sleep20-21swapper/209:27:102
194198296,5cyclictest25-21ksoftirqd/209:45:312
194198296,5cyclictest25-21ksoftirqd/209:45:302
194098296,4cyclictest121rcu_preempt09:55:171
194098296,4cyclictest121rcu_preempt09:55:171
193672290,2sleep10-21swapper/107:55:241
10782290,6sleep1191ksoftirqd/110:55:061
62502280,2sleep20-21swapper/212:11:242
194198285,4cyclictest121rcu_preempt08:50:002
194198282,3cyclictest121rcu_preempt10:00:152
194098287,3cyclictest121rcu_preempt09:20:141
194098281,17cyclictest191ksoftirqd/111:40:151
171362280,16sleep2664-21kworker/u8:410:20:402
76382270,3sleep37636-21ssh11:07:433
52402270,5sleep331-21ksoftirqd/308:44:173
325382270,2sleep10-21swapper/110:52:251
287252270,2sleep20-21swapper/211:51:052
27892270,15sleep2658-21kworker/u8:309:50:442
27892270,15sleep2658-21kworker/u8:309:50:432
265902270,4sleep126589-21ssh11:47:181
237952270,2sleep10-21swapper/109:28:111
213582270,2sleep20-21swapper/209:22:442
194398275,5cyclictest31-21ksoftirqd/311:26:413
194398271,6cyclictest17265-21sed12:35:433
194398271,4cyclictest0-21swapper/311:45:293
187382270,5sleep1191ksoftirqd/107:53:471
186122270,1sleep216258-21kworker/u8:209:15:562
186122270,1sleep216258-21kworker/u8:209:15:562
172232270,2sleep20-21swapper/207:50:072
126442270,3sleep20-21swapper/211:19:162
119092270,1sleep19288-21kworker/u8:1007:35:211
7312260,2sleep10-21swapper/109:47:171
7312260,2sleep10-21swapper/109:47:161
72222260,5sleep3121rcu_preempt12:15:163
59442260,5sleep2251ksoftirqd/209:59:322
59442260,5sleep2251ksoftirqd/209:59:322
43062260,2sleep331-21ksoftirqd/312:09:563
43062260,2sleep331-21ksoftirqd/312:09:563
324802260,2sleep10-21swapper/108:30:191
306732260,3sleep2251ksoftirqd/209:41:392
299852260,2sleep20-21swapper/208:21:312
29062260,3sleep3311ksoftirqd/310:58:063
287352260,7sleep1191ksoftirqd/111:51:081
206392260,2sleep20-21swapper/210:27:212
194398264,5cyclictest31-21ksoftirqd/312:03:593
194398264,4cyclictest121rcu_preempt08:33:433
194198264,4cyclictest121rcu_preempt09:30:232
194198261,3cyclictest121rcu_preempt07:25:002
1940982620,4cyclictest31353-21kworker/u8:1012:26:391
168202260,2sleep20-21swapper/207:48:012
133372260,2sleep1664-21kworker/u8:410:14:161
130072260,2sleep20-21swapper/210:12:322
109892260,13sleep30-21swapper/310:09:283
109602260,2sleep20-21swapper/212:20:452
50312250,1sleep227776-21kworker/u8:411:01:352
250772250,12sleep119-21ksoftirqd/110:35:441
234112250,2sleep10-21swapper/110:34:301
194398251,7cyclictest9575-21idleruntime-cro07:30:003
194398251,6cyclictest2238-21irqrtprio08:35:233
194198256,4cyclictest76702cut12:15:272
194198251,8cyclictest10651-21ntpq07:30:352
194198251,3cyclictest121rcu_preempt11:05:152
194198251,3cyclictest121rcu_preempt09:10:162
194098252,8cyclictest121rcu_preempt10:00:371
194098251,3cyclictest121rcu_preempt12:20:161
1936982517,5cyclictest10-21ksoftirqd/010:55:250
127242250,3sleep20-21swapper/209:04:502
127062250,2sleep10-21swapper/109:04:371
106212250,2sleep10-21swapper/110:07:321
103742250,3sleep20-21swapper/208:55:432
77942240,2sleep10-21swapper/111:08:341
301742240,2sleep10-21swapper/108:23:521
283202240,1sleep121295-21kworker/u8:809:36:561
281512240,12sleep225-21ksoftirqd/209:36:002
216832240,3sleep2251ksoftirqd/211:36:292
216032240,2sleep10-21swapper/111:36:041
194398246,3cyclictest30000-21kworker/u8:107:15:003
194398246,3cyclictest30000-21kworker/u8:107:15:003
194398244,4cyclictest121rcu_preempt08:00:243
194398243,3cyclictest278792kworker/u8:2408:19:593
194198248,6cyclictest121rcu_preempt12:35:332
194098248,3cyclictest19-21ksoftirqd/111:25:501
194098244,4cyclictest121rcu_preempt07:15:211
194098244,4cyclictest121rcu_preempt07:15:211
194098244,3cyclictest121rcu_preempt11:20:331
1940982415,4cyclictest19-21ksoftirqd/110:40:181
194098241,3cyclictest121rcu_preempt12:30:351
1936982418,4cyclictest10-21ksoftirqd/008:20:220
17382240,5sleep2251ksoftirqd/212:04:052
157422240,13sleep331-21ksoftirqd/312:30:483
106532240,1sleep19282-21kworker/u8:507:30:351
92392230,12sleep225-21ksoftirqd/207:26:092
33732230,5sleep1191ksoftirqd/108:39:201
271092230,3chrt27074-21ssh11:50:002
256262230,2sleep20-21swapper/210:38:432
194398234,3cyclictest121rcu_preempt12:10:033
194398231,9cyclictest10246-21ssh12:20:243
194198232,3cyclictest121rcu_preempt11:20:402
194198231,5cyclictest0-21swapper/212:10:012
194198231,5cyclictest0-21swapper/212:10:012
194098238,3cyclictest19-21ksoftirqd/111:10:191
194098233,3cyclictest121rcu_preempt10:15:521
194098233,3cyclictest121rcu_preempt08:10:161
194098232,3cyclictest121rcu_preempt12:15:371
194098232,3cyclictest121rcu_preempt09:10:301
194098232,3cyclictest121rcu_preempt08:05:321
194098231,3cyclictest121rcu_preempt12:00:341
193698232,15cyclictest0-21swapper/011:35:140
1936982312,8cyclictest13241-21cron07:40:000
187232230,5sleep3311ksoftirqd/307:53:373
148442230,2sleep20-21swapper/207:41:422
148442230,2sleep20-21swapper/207:41:422
32442220,2sleep20-21swapper/208:37:402
323492220,2sleep20-21swapper/208:30:092
243692220,1sleep220479-21kworker/u8:1908:09:162
207982220,3sleep3311ksoftirqd/310:28:143
194398223,3cyclictest121rcu_preempt09:45:263
194398223,3cyclictest121rcu_preempt09:45:253
194398222,3cyclictest194602kworker/u8:011:35:183
194398221,6cyclictest1406-21rs:main3
194398221,4cyclictest121rcu_preempt09:50:383
194398221,4cyclictest121rcu_preempt09:50:383
194398221,3cyclictest0-21swapper/309:39:333
194198221,5cyclictest12284-21df12:25:212
194098223,3cyclictest121rcu_preempt10:45:161
194098222,3cyclictest121rcu_preempt08:55:191
194098222,3cyclictest121rcu_preempt08:50:211
194098221,5cyclictest55322kworker/u8:1607:20:171
194098221,3cyclictest121rcu_preempt11:00:271
194098221,3cyclictest121rcu_preempt09:50:121
194098221,3cyclictest121rcu_preempt09:50:111
194098221,3cyclictest121rcu_preempt09:15:161
194098221,3cyclictest121rcu_preempt09:15:161
193698227,11cyclictest10-21ksoftirqd/008:00:150
1936982216,4cyclictest10-21ksoftirqd/011:00:310
1936982216,4cyclictest10-21ksoftirqd/010:30:190
1936982216,4cyclictest10-21ksoftirqd/008:40:160
1936982216,4cyclictest10-21ksoftirqd/008:15:280
1936982215,4cyclictest10-21ksoftirqd/010:15:280
193698220,13cyclictest0-21swapper/010:05:130
122802220,11sleep331-21ksoftirqd/311:17:123
54842210,10sleep331-21ksoftirqd/307:15:533
54842210,10sleep331-21ksoftirqd/307:15:533
305862210,10sleep331-21ksoftirqd/311:55:283
194398212,5cyclictest15146-21munin-run07:45:003
194398212,5cyclictest15146-21munin-run07:45:003
194398211,5cyclictest14739-21sed09:10:023
194398211,5cyclictest14739-21sed09:10:013
194398211,5cyclictest0-21swapper/310:23:313
194398211,5cyclictest0-21swapper/310:18:553
1943982114,4cyclictest8479-21latency_hist10:05:013
1943982114,4cyclictest2081-21runrttasks08:25:403
1943982114,4cyclictest2081-21runrttasks08:25:403
1943982114,4cyclictest15735-21sh09:10:333
194398211,3cyclictest121rcu_preempt09:25:263
194198210,4cyclictest0-21swapper/210:34:292
194098211,3cyclictest121rcu_preempt07:40:171
194098211,3cyclictest121rcu_preempt07:40:161
1936982116,3cyclictest20750-21sendmail-msp08:00:010
1936982115,3cyclictest10-21ksoftirqd/012:10:160
1936982115,3cyclictest10-21ksoftirqd/010:40:320
1936982111,8cyclictest20356-21latency09:20:270
1936982111,8cyclictest1405-21sshd10:02:430
74462200,10sleep331-21ksoftirqd/307:21:443
48202200,9sleep331-21ksoftirqd/309:55:323
48202200,9sleep331-21ksoftirqd/309:55:323
194398208,9cyclictest86072chrt11:10:203
194398204,3cyclictest121rcu_preempt10:40:273
194398201,9cyclictest318962kworker/u9:007:30:513
194398201,3cyclictest121rcu_preempt10:50:143
194398201,3cyclictest0-21swapper/309:40:273
194398201,3cyclictest0-21swapper/309:00:003
1943982013,4cyclictest14614-21diskmemload10:35:453
1943982013,4cyclictest13139-21sh10:13:153
1943982010,6cyclictest26469-21sshd09:34:423
194198207,9cyclictest4225-21apt-get07:15:192
194198207,9cyclictest4225-21apt-get07:15:192
1941982013,4cyclictest12037-21irqrtprio07:35:262
194098201,3cyclictest121rcu_preempt08:40:171
1936982015,3cyclictest11661-21/usr/sbin/munin10:10:270
1936982014,4cyclictest10-21ksoftirqd/009:15:170
1936982014,4cyclictest10-21ksoftirqd/009:15:160
1936982013,4cyclictest10-21ksoftirqd/009:10:160
1936982012,6cyclictest6795-21ntp_kernel_pll_11:05:320
1936982012,6cyclictest32209-21/usr/sbin/munin12:00:240
1936982012,6cyclictest27506-21aten2.4-expect11:50:170
1936982012,6cyclictest18243-21irqrtprio11:30:240
1936982012,6cyclictest1821-21/usr/sbin/munin08:35:220
1936982011,6cyclictest20553-21sh10:26:550
1936982010,8cyclictest8655-21sshd-session12:16:300
186692200,9sleep31934-21cyclictest11:30:313
172422200,2sleep3121rcu_preempt09:15:053
172422200,2sleep3121rcu_preempt09:15:053
168472200,8sleep331-21ksoftirqd/307:48:223
301542190,8sleep331-21ksoftirqd/308:23:383
239872190,8sleep331-21ksoftirqd/311:40:573
199532190,6sleep2241rcuc/207:55:382
194398192,4cyclictest121rcu_preempt08:50:313
1943981912,4cyclictest21413-21/usr/sbin/munin10:30:263
1943981912,4cyclictest14614-21diskmemload12:25:123
1943981912,4cyclictest11962-21gcc09:00:373
1943981911,4cyclictest5733-21cpu08:45:213
194398190,3cyclictest121rcu_preempt09:21:563
194198191,3cyclictest121rcu_preempt10:56:312
1941981912,4cyclictest27662-21sh10:41:372
193698199,8cyclictest10-21ksoftirqd/009:35:200
1936981914,3cyclictest29332-21ntpq10:45:300
1936981914,3cyclictest25908-21ssh11:45:390
1936981914,3cyclictest2044-21snmpd07:30:220
1936981914,3cyclictest18892-21latency_hist07:55:010
1936981914,3cyclictest10-21ksoftirqd/012:25:350
1936981914,3cyclictest10-21ksoftirqd/010:35:160
1936981913,3cyclictest10-21ksoftirqd/010:20:120
1936981913,3cyclictest10-21ksoftirqd/009:40:290
1936981912,5cyclictest25450-21processes09:30:470
1936981912,5cyclictest23878-21swap08:05:420
1936981912,4cyclictest10-21ksoftirqd/009:00:190
1936981911,6cyclictest31203-21entropy10:50:230
1936981911,6cyclictest17136-21sh12:35:380
1936981911,6cyclictest13786-21entropy07:40:210
1936981911,6cyclictest13786-21entropy07:40:210
1936981911,6cyclictest10-21ksoftirqd/012:05:410
1936981911,6cyclictest10-21ksoftirqd/012:05:410
1936981911,6cyclictest10-21ksoftirqd/007:20:160
1936981911,3cyclictest11105-21ssh12:21:330
1936981910,7cyclictest10-21ksoftirqd/011:20:180
193672190,8sleep225-21ksoftirqd/211:31:552
194198188,7cyclictest15142-21memory12:30:282
194198188,7cyclictest15012-21wc10:15:422
193698189,7cyclictest8671-21missed_timers07:25:260
193698189,7cyclictest23308-21latency11:40:260
193698188,7cyclictest118150irq/29-4f00000.09:55:160
193698188,7cyclictest118150irq/29-4f00000.09:55:150
193698183,6cyclictest8791-21irqrtprio11:10:260
1936981813,3cyclictest14889-1kworker/u9:307:45:390
1936981813,3cyclictest10-21ksoftirqd/009:50:280
1936981813,3cyclictest10-21ksoftirqd/009:50:280
1936981812,3cyclictest10-21ksoftirqd/008:55:190
1936981810,6cyclictest32403-21aten2_rfpower_e08:30:190
1936981810,6cyclictest14440-21sh12:30:180
1936981810,6cyclictest11077-21interrupts11:15:260
194398172,3cyclictest186082kworker/u8:907:55:183
193698177,8cyclictest109050irq/20-fttdcc0108:45:180
1936981712,3cyclictest10-21ksoftirqd/011:25:310
1936981712,3cyclictest10-21ksoftirqd/007:15:230
1936981712,3cyclictest10-21ksoftirqd/007:15:230
1936981710,4cyclictest10-21ksoftirqd/008:50:280
193698146,6cyclictest10-21ksoftirqd/007:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional