You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 19:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Mon Jul 06, 2026 12:45:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2980221240,4chrt0-21swapper/207:10:562
2980221240,4chrt0-21swapper/207:10:562
858621050,7sleep012-21ksoftirqd/011:47:380
858621050,7sleep012-21ksoftirqd/011:47:380
283121040,3sleep00-21swapper/009:44:310
283121040,3sleep00-21swapper/009:44:310
283121040,3sleep00-21swapper/009:44:310
2169621040,3sleep3321rcuc/310:05:563
874921020,2sleep30-21swapper/311:07:253
874921020,2sleep30-21swapper/311:07:253
874921020,2sleep30-21swapper/311:07:253
109332960,4sleep10-21swapper/107:46:001
109332960,4sleep10-21swapper/107:46:001
109332960,4sleep10-21swapper/107:46:001
94412950,3chrt0-21swapper/007:41:040
94412950,3chrt0-21swapper/007:41:040
208492950,4sleep00-21swapper/010:05:090
208492950,4sleep00-21swapper/010:05:090
299122940,2chrt0-21swapper/010:55:410
16822940,2sleep1201rcuc/111:39:591
16822940,2sleep1201rcuc/111:39:591
16822940,2sleep1201rcuc/111:39:591
110942940,2sleep012-21ksoftirqd/010:32:420
110942940,2sleep012-21ksoftirqd/010:32:420
29622920,4sleep10-21swapper/108:51:061
29622920,4sleep10-21swapper/108:51:061
29622920,4sleep10-21swapper/108:51:061
111882890,3sleep10-21swapper/109:54:001
156532880,2sleep00-21swapper/011:55:540
26762850,3sleep30-21swapper/311:00:543
26762850,3sleep30-21swapper/311:00:543
26762850,3sleep30-21swapper/311:00:543
239212850,5sleep012-21ksoftirqd/011:26:070
239212850,5sleep012-21ksoftirqd/011:26:070
239212850,5sleep012-21ksoftirqd/011:26:070
27272790,3chrt0-21swapper/110:21:581
27272790,3chrt0-21swapper/110:21:581
27272790,3chrt0-21swapper/110:21:581
16402720,9sleep012-21ksoftirqd/011:39:540
16402720,9sleep012-21ksoftirqd/011:39:540
16402720,9sleep012-21ksoftirqd/011:39:540
139812710,2sleep213999-21latency_hist07:55:502
139812710,2sleep213999-21latency_hist07:55:502
139812710,2sleep213999-21latency_hist07:55:502
112972700,2sleep010918-21/usr/sbin/munin11:50:560
47362670,2sleep30-21swapper/308:56:073
47362670,2sleep30-21swapper/308:56:073
250352640,4sleep125028-21ntp_kernel_pll_12:06:041
250352640,4sleep125028-21ntp_kernel_pll_12:06:041
135362640,3sleep30-21swapper/311:52:553
135362640,3sleep30-21swapper/311:52:553
200962600,2sleep00-21swapper/008:10:590
200962600,2sleep00-21swapper/008:10:590
93292590,2sleep10-21swapper/110:30:581
93292590,2sleep10-21swapper/110:30:581
77872560,11sleep012-21ksoftirqd/010:29:000
77872560,11sleep012-21ksoftirqd/010:29:000
77872560,11sleep012-21ksoftirqd/010:29:000
137802560,3chrt0-21swapper/111:53:171
137802560,3chrt0-21swapper/111:53:171
244032550,8sleep012-21ksoftirqd/009:29:320
244032550,8sleep012-21ksoftirqd/009:29:320
244032550,8sleep012-21ksoftirqd/009:29:320
242212550,2sleep10-21swapper/111:26:261
242212550,2sleep10-21swapper/111:26:261
242212550,2sleep10-21swapper/111:26:261
104472550,3sleep010442-21ssh09:11:070
104472550,3sleep010442-21ssh09:11:070
104472550,3sleep010442-21ssh09:11:070
312802530,3chrt0-21swapper/012:14:140
312802530,3chrt0-21swapper/012:14:140
170442510,3sleep10-21swapper/112:36:061
170442510,3sleep10-21swapper/112:36:061
154932500,2sleep10-21swapper/111:16:001
154932500,2sleep10-21swapper/111:16:001
154932500,2sleep10-21swapper/111:16:001
20922480,4sleep30-21swapper/308:50:563
20922480,4sleep30-21swapper/308:50:563
20922480,4sleep30-21swapper/308:50:563
137912480,3sleep00-21swapper/010:36:030
137912480,3sleep00-21swapper/010:36:030
137912480,3sleep00-21swapper/010:36:030
313432470,3chrt0-21swapper/109:38:531
313432470,3chrt0-21swapper/109:38:531
313432470,3chrt0-21swapper/109:38:531
214402460,3sleep10-21swapper/110:05:541
214402460,3sleep10-21swapper/110:05:541
126142460,3sleep30-21swapper/310:35:343
126142460,3sleep30-21swapper/310:35:343
20712450,3sleep30-21swapper/311:00:223
20712450,3sleep30-21swapper/311:00:223
138672440,2sleep30-21swapper/312:32:063
138672440,2sleep30-21swapper/312:32:063
138672440,2sleep30-21swapper/312:32:063
242742430,2sleep30-21swapper/311:26:313
242742430,2sleep30-21swapper/311:26:313
242742430,2sleep30-21swapper/311:26:313
303102420,3sleep30-21swapper/309:36:343
303102420,3sleep30-21swapper/309:36:343
303102420,3sleep30-21swapper/309:36:343
299322420,2sleep129583-21ls07:11:001
299322420,2sleep129583-21ls07:11:001
223512400,3sleep30-21swapper/310:06:043
223512400,3sleep30-21swapper/310:06:043
223512400,3sleep30-21swapper/310:06:043
105762400,2sleep210395-21/usr/sbin/munin07:45:582
105762400,2sleep210395-21/usr/sbin/munin07:45:582
105762400,2sleep210395-21/usr/sbin/munin07:45:582
236532360,2sleep223661-21ssh12:04:572
236532360,2sleep223661-21ssh12:04:572
20342350,2sleep22074-21fschecks_count08:50:562
20342350,2sleep22074-21fschecks_count08:50:562
20342350,2sleep22074-21fschecks_count08:50:562
3105899342,23cyclictest13117-21ssh10:35:562
3105899342,23cyclictest13117-21ssh10:35:562
282622340,4sleep00-21swapper/009:35:020
282622340,4sleep00-21swapper/009:35:020
282622340,4sleep00-21swapper/009:35:020
282622340,4sleep00-21swapper/009:35:020
280042340,3sleep00-21swapper/010:13:410
280042340,3sleep00-21swapper/010:13:410
212282340,2sleep021239-21latency_hist09:25:510
212282340,2sleep021239-21latency_hist09:25:510
212282340,2sleep021239-21latency_hist09:25:510
140832330,3sleep30-21swapper/309:56:113
140832330,3sleep30-21swapper/309:56:113
135862330,2sleep213594-21rm12:31:342
135862330,2sleep213594-21rm12:31:342
135862330,2sleep213594-21rm12:31:342
103992330,3sleep10-21swapper/111:10:331
103992330,3sleep10-21swapper/111:10:331
103992330,3sleep10-21swapper/111:10:331
3105699328,16cyclictest38150irq/55-eth011:15:530
3105699328,16cyclictest38150irq/55-eth011:15:530
3105699328,16cyclictest38150irq/55-eth011:15:530
277872320,2sleep30-21swapper/310:52:343
224572300,2sleep122465-21ssh12:02:431
224572300,2sleep122465-21ssh12:02:431
3105699283,9cyclictest9161-21tail09:51:060
306552282,16sleep30-21swapper/307:11:103
306552282,16sleep30-21swapper/307:11:103
173962280,3sleep30-21swapper/311:18:393
173962280,3sleep30-21swapper/311:18:393
173962280,3sleep30-21swapper/311:18:393
3105899260,23cyclictest29055-21ssh12:11:022
3105899260,23cyclictest29055-21ssh12:11:022
31057992613,11cyclictest13282-21ssh11:13:231
31057992613,11cyclictest13282-21ssh11:13:231
31057992613,11cyclictest13282-21ssh11:13:231
308132260,12sleep121-21ksoftirqd/110:16:231
308132260,12sleep121-21ksoftirqd/110:16:231
308132260,12sleep121-21ksoftirqd/110:16:231
302812264,13sleep029583-21ls07:11:030
302812264,13sleep029583-21ls07:11:030
31058992513,8cyclictest22214-21grep10:46:072
31058992513,8cyclictest22214-21grep10:46:072
31057992518,5cyclictest20097-21memory08:10:591
31057992518,5cyclictest20097-21memory08:10:591
31057992516,6cyclictest7636-21idleruntime-cro09:50:451
31057992516,6cyclictest7636-21idleruntime-cro09:50:451
3105699251,19cyclictest28492-21cut12:10:560
31058992417,5cyclictest1324-21ssh10:59:162
31058992417,5cyclictest1324-21ssh10:59:162
3105899241,18cyclictest12808-21ssh09:55:552
3105899241,18cyclictest12808-21ssh09:55:552
3105799241,19cyclictest3786-21ls11:01:061
3105799241,19cyclictest3786-21ls11:01:061
3105799241,19cyclictest3786-21ls11:01:061
3105699249,12cyclictest0-21swapper/010:21:560
3105699249,12cyclictest0-21swapper/010:21:560
3105699249,12cyclictest0-21swapper/010:21:560
183682240,2sleep20-21swapper/210:01:052
183682240,2sleep20-21swapper/210:01:052
3105899231,18cyclictest29339-21find10:15:532
3105899231,18cyclictest29339-21find10:15:532
3105799231,16cyclictest26022-21ssh10:51:001
31056992314,7cyclictest6533-21cut11:45:550
31056992314,7cyclictest6533-21cut11:45:550
3105699231,11cyclictest14311-21fschecks_time07:55:580
3105699231,11cyclictest14311-21fschecks_time07:55:580
52292220,3chrt0-21swapper/309:46:513
52292220,3chrt0-21swapper/309:46:513
3105899221,3cyclictest131rcu_preempt11:15:532
3105899221,3cyclictest131rcu_preempt11:15:532
3105899221,3cyclictest131rcu_preempt11:15:532
31058992213,6cyclictest0-21swapper/210:45:502
31058992213,6cyclictest0-21swapper/210:45:502
31058992213,6cyclictest0-21swapper/210:45:502
31058992212,7cyclictest15675-21sh08:00:432
31058992212,7cyclictest15675-21sh08:00:432
3105899221,18cyclictest7626-21uniq09:05:562
3105899221,18cyclictest7626-21uniq09:05:562
3105899221,18cyclictest29851-21ls09:36:052
3105899221,18cyclictest29851-21ls09:36:052
3105899221,18cyclictest29851-21ls09:36:052
3105899221,14cyclictest15696-21find11:55:572
3105899221,14cyclictest15696-21find11:55:572
3105899221,14cyclictest11086-21uniq11:50:542
3105899221,14cyclictest11086-21uniq11:50:542
3105799221,13cyclictest19509-21latency_hist08:10:511
3105799221,13cyclictest19509-21latency_hist08:10:511
3105799221,12cyclictest25205-21latency_hist10:50:441
3105799221,12cyclictest25205-21latency_hist10:50:441
3105699227,7cyclictest12117-21sed12:30:550
3105699227,7cyclictest12117-21sed12:30:550
3105699227,5cyclictest0-21swapper/010:40:590
3105699227,5cyclictest0-21swapper/010:40:590
3105699227,5cyclictest0-21swapper/010:40:590
3105699222,9cyclictest25090-21taskset10:50:340
3105699222,9cyclictest25090-21taskset10:50:340
31056992214,6cyclictest1112-21sshd10:58:570
31056992214,6cyclictest1112-21sshd10:58:570
31056992213,6cyclictest3403-21ntp_states11:01:020
31056992213,6cyclictest3403-21ntp_states11:01:020
31056992213,6cyclictest3403-21ntp_states11:01:020
31056992213,6cyclictest0-21swapper/008:31:060
3105699221,14cyclictest0-21swapper/012:24:570
3105699221,14cyclictest0-21swapper/012:24:570
3105699221,14cyclictest0-21swapper/012:24:570
3105699220,17cyclictest30539-21ls08:40:470
3105699220,17cyclictest30539-21ls08:40:470
6642210,3sleep10-21swapper/110:58:191
6642210,3sleep10-21swapper/110:58:191
3105899212,17cyclictest817-21runrttasks12:26:062
3105899212,17cyclictest817-21runrttasks12:26:062
3105899212,17cyclictest817-21runrttasks12:26:062
31058992113,6cyclictest28883-21df_inode09:35:552
31058992113,6cyclictest28883-21df_inode09:35:552
31058992113,6cyclictest28883-21df_inode09:35:552
31058992113,6cyclictest28883-21df_inode09:35:552
31058992110,8cyclictest30131-21cat10:55:502
3105899210,18cyclictest16685-21latency_hist10:40:552
3105899210,18cyclictest16685-21latency_hist10:40:552
3105899210,18cyclictest16685-21latency_hist10:40:552
31057992114,5cyclictest8928-21ssh11:48:071
31057992114,5cyclictest8928-21ssh11:48:071
3105799211,17cyclictest7322-21ls09:05:461
3105799211,17cyclictest7322-21ls09:05:461
3105799211,17cyclictest4318-21ls12:20:581
3105799211,17cyclictest4318-21ls12:20:581
3105799211,17cyclictest4318-21ls12:20:581
3105799211,15cyclictest25730-21ssh09:30:591
3105799211,15cyclictest25730-21ssh09:30:591
3105799211,15cyclictest25730-21ssh09:30:591
3105799211,15cyclictest12990-21ls12:31:051
3105799211,15cyclictest12990-21ls12:31:051
3105799211,15cyclictest12990-21ls12:31:051
3105799211,11cyclictest5520-21cat09:00:491
3105799211,11cyclictest5520-21cat09:00:491
3105699212,5cyclictest22978-21grep11:25:570
3105699211,5cyclictest0-21swapper/008:00:550
3105699211,5cyclictest0-21swapper/008:00:550
31056992114,5cyclictest674-21snmpd11:56:000
31056992114,5cyclictest674-21snmpd11:56:000
31056992114,5cyclictest24341-21/usr/sbin/munin12:06:070
3105699211,18cyclictest24907-21ls08:25:430
3105699211,18cyclictest24907-21ls08:25:430
3105699211,17cyclictest2479-21ls08:50:590
3105699211,17cyclictest2479-21ls08:50:590
3105699211,17cyclictest2479-21ls08:50:590
31056992111,7cyclictest134-21systemd-journal12:20:460
31056992111,7cyclictest134-21systemd-journal12:20:460
259782210,3sleep231055-21cyclictest12:06:492
259782210,3sleep231055-21cyclictest12:06:492
3105999201,13cyclictest0-21swapper/310:05:543
3105899206,12cyclictest27674-21sensors11:31:052
3105899206,12cyclictest27674-21sensors11:31:052
3105899206,12cyclictest27674-21sensors11:31:052
31058992013,5cyclictest3509-21ssh10:23:252
31058992013,5cyclictest3509-21ssh10:23:252
31058992013,5cyclictest3509-21ssh10:23:252
31058992012,6cyclictest2476-21/usr/sbin/munin11:40:552
31058992012,6cyclictest2476-21/usr/sbin/munin11:40:552
31058992012,6cyclictest2476-21/usr/sbin/munin11:40:552
3105899201,10cyclictest31069-21cut08:40:582
3105899201,10cyclictest31069-21cut08:40:582
31058992010,7cyclictest31781-21awk07:15:562
31058992010,7cyclictest31781-21awk07:15:562
3105799201,6cyclictest29352-21timerandwakeup12:11:061
3105799201,6cyclictest29352-21timerandwakeup12:11:061
31057992013,5cyclictest0-21swapper/109:31:061
31057992013,5cyclictest0-21swapper/109:31:061
31057992013,5cyclictest0-21swapper/109:31:061
31057992013,5cyclictest0-21swapper/109:31:061
31057992012,5cyclictest20676-21latency_hist10:45:541
31057992012,5cyclictest20676-21latency_hist10:45:541
31057992012,5cyclictest20676-21latency_hist10:45:541
31057992012,5cyclictest19526-21sh11:21:031
31057992012,5cyclictest19526-21sh11:21:031
3105799201,16cyclictest25467-21df_inode10:10:551
3105799201,16cyclictest25467-21df_inode10:10:551
3105799201,16cyclictest25467-21df_inode10:10:551
31057992011,6cyclictest134-21systemd-journal08:25:431
31057992011,6cyclictest134-21systemd-journal08:25:431
31057992011,6cyclictest12859-21taskset09:55:561
31057992011,6cyclictest12859-21taskset09:55:561
3105799200,15cyclictest4569-21latency_hist07:30:521
3105799200,15cyclictest4569-21latency_hist07:30:521
3105799200,15cyclictest4569-21latency_hist07:30:521
3105699206,4cyclictest12-21ksoftirqd/011:20:430
3105699206,4cyclictest12-21ksoftirqd/011:20:430
3105699206,4cyclictest12-21ksoftirqd/011:20:430
31056992013,5cyclictest0-21swapper/009:01:070
31056992013,5cyclictest0-21swapper/009:01:070
31056992012,6cyclictest0-21swapper/012:39:590
31056992012,6cyclictest0-21swapper/012:39:590
31056992012,5cyclictest12538-21ssh12:30:590
31056992012,5cyclictest12538-21ssh12:30:590
31056992012,5cyclictest12538-21ssh12:30:590
31056992011,7cyclictest134-21systemd-journal11:32:310
31056992011,7cyclictest134-21systemd-journal11:32:310
31056992011,7cyclictest134-21systemd-journal11:32:310
31056992011,6cyclictest32677-21fschecks_time09:40:560
31056992011,6cyclictest32677-21fschecks_time09:40:560
31056992011,6cyclictest32677-21fschecks_time09:40:560
3105699201,10cyclictest3903-21df_inode08:55:570
3105699201,10cyclictest3903-21df_inode08:55:570
3105699201,10cyclictest1120-21/usr/sbin/munin07:20:530
3105699201,10cyclictest1120-21/usr/sbin/munin07:20:530
209432201,3sleep30-21swapper/309:25:303
209432201,3sleep30-21swapper/309:25:303
209432201,3sleep30-21swapper/309:25:303
3105999191,14cyclictest0-21swapper/311:21:073
3105999191,14cyclictest0-21swapper/311:21:073
3105999191,13cyclictest0-21swapper/308:40:583
3105999191,13cyclictest0-21swapper/308:40:583
3105999191,12cyclictest0-21swapper/310:10:583
3105999191,12cyclictest0-21swapper/310:10:583
3105999191,12cyclictest0-21swapper/309:45:563
3105999191,12cyclictest0-21swapper/309:45:563
3105999191,12cyclictest0-21swapper/309:45:563
3105999191,11cyclictest0-21swapper/312:16:063
3105999191,11cyclictest0-21swapper/312:16:063
3105899199,8cyclictest7103-21sh10:27:402
3105899199,8cyclictest7103-21sh10:27:402
3105899199,8cyclictest7103-21sh10:27:402
3105899191,6cyclictest7627-21/usr/sbin/munin11:46:062
3105899191,6cyclictest7627-21/usr/sbin/munin11:46:062
31058991912,4cyclictest27-21ksoftirqd/210:06:002
31058991912,4cyclictest27-21ksoftirqd/210:06:002
31058991912,4cyclictest27-21ksoftirqd/210:06:002
31058991911,5cyclictest27-21ksoftirqd/212:18:362
31058991911,5cyclictest27-21ksoftirqd/212:18:362
31058991911,5cyclictest18745-21kworker/u8:1011:06:062
31058991911,5cyclictest18745-21kworker/u8:1011:06:062
31058991911,5cyclictest18745-21kworker/u8:1011:06:062
3105899191,14cyclictest24091-21grep08:21:052
3105899191,14cyclictest24091-21grep08:21:052
3105899191,14cyclictest23393-21cut11:26:012
3105899191,14cyclictest23393-21cut11:26:012
3105899191,14cyclictest23393-21cut11:26:012
3105899191,11cyclictest4582-21ls07:30:432
3105899191,11cyclictest4582-21ls07:30:432
3105899191,11cyclictest4582-21ls07:30:432
31058991910,7cyclictest4160-21tune2fs12:20:572
31058991910,7cyclictest4160-21tune2fs12:20:572
31058991910,7cyclictest4160-21tune2fs12:20:572
3105799199,3cyclictest131rcu_preempt10:15:531
3105799199,3cyclictest131rcu_preempt10:15:531
3105799198,8cyclictest13516-21cat09:15:551
3105799198,8cyclictest13516-21cat09:15:551
3105799194,12cyclictest2929-21latency_hist07:25:521
3105799194,12cyclictest2929-21latency_hist07:25:521
31057991912,5cyclictest8697-21/usr/sbin/munin09:06:071
31057991912,5cyclictest8697-21/usr/sbin/munin09:06:071
31057991911,6cyclictest25919-21tr08:26:051
31057991911,5cyclictest28115-21ssh11:31:121
31057991911,5cyclictest28115-21ssh11:31:121
31057991911,5cyclictest28115-21ssh11:31:121
31057991911,5cyclictest18528-21grep09:21:071
31057991911,5cyclictest18528-21grep09:21:071
31057991911,5cyclictest18528-21grep09:21:071
3105799191,15cyclictest13852-21latency_hist07:55:431
3105799191,15cyclictest13852-21latency_hist07:55:431
3105799191,15cyclictest13852-21latency_hist07:55:431
3105799191,12cyclictest3106-21sh11:41:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional