You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 15:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Thu Jun 25, 2026 12:45:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2698021670,3sleep00-21swapper/007:10:490
2698021670,3sleep00-21swapper/007:10:490
76922780,4sleep20-21swapper/211:57:382
76922780,4sleep20-21swapper/211:57:382
76922780,4sleep20-21swapper/211:57:382
191982720,2sleep20-21swapper/209:26:382
191982720,2sleep20-21swapper/209:26:382
117862720,3chrt0-21swapper/210:40:502
117862720,3chrt0-21swapper/210:40:502
294032710,2sleep30-21swapper/310:22:303
294032710,2sleep30-21swapper/310:22:303
294032710,2sleep30-21swapper/310:22:303
161232670,3sleep20-21swapper/210:45:562
161232670,3sleep20-21swapper/210:45:562
161232670,3sleep20-21swapper/210:45:562
292482660,2sleep129362-21mailstats07:15:531
292482660,2sleep129362-21mailstats07:15:531
97652640,4chrt0-21swapper/307:50:553
97652640,4chrt0-21swapper/307:50:553
97652640,4chrt0-21swapper/307:50:553
158202590,3chrt0-21swapper/209:22:412
158202590,3chrt0-21swapper/209:22:412
284972580,3chrt0-21swapper/210:20:562
284972580,3chrt0-21swapper/210:20:562
284972580,3chrt0-21swapper/210:20:562
7112540,4sleep30-21swapper/310:27:083
7112540,4sleep30-21swapper/310:27:083
13762510,3sleep20-21swapper/211:09:232
13762510,3sleep20-21swapper/211:09:232
303722500,4sleep30-21swapper/312:25:573
303722500,4sleep30-21swapper/312:25:573
303722500,4sleep30-21swapper/312:25:573
303722500,4sleep30-21swapper/312:25:573
154632500,2sleep215470-21sh10:03:332
154632500,2sleep215470-21sh10:03:332
154632500,2sleep215470-21sh10:03:332
269262490,2chrt0-21swapper/209:35:472
269262490,2chrt0-21swapper/209:35:472
203752480,8sleep220482-21latency10:10:492
203752480,8sleep220482-21latency10:10:492
203752480,8sleep220482-21latency10:10:492
66872470,3sleep10-21swapper/109:10:541
66872470,3sleep10-21swapper/109:10:541
21122470,2sleep12128-21cat11:10:401
21122470,2sleep12128-21cat11:10:401
112862470,3sleep30-21swapper/309:57:023
112862470,3sleep30-21swapper/309:57:023
112862470,3sleep30-21swapper/309:57:023
273952460,4sleep10-21swapper/111:00:501
273952460,4sleep10-21swapper/111:00:501
273952460,4sleep10-21swapper/111:00:501
305012450,3sleep00-21swapper/010:24:400
305012450,3sleep00-21swapper/010:24:400
305012450,3sleep00-21swapper/010:24:400
263042440,2sleep30-21swapper/311:00:163
263042440,2sleep30-21swapper/311:00:163
263042440,2sleep30-21swapper/311:00:163
6832410,3sleep00-21swapper/010:27:050
6832410,3sleep00-21swapper/010:27:050
142242400,3sleep1549-21avahi-daemon12:05:491
142242400,3sleep1549-21avahi-daemon12:05:491
76392390,3sleep00-21swapper/011:57:320
76392390,3sleep00-21swapper/011:57:320
76392390,3sleep00-21swapper/011:57:320
220782390,8sleep333-21ksoftirqd/310:54:373
220782390,8sleep333-21ksoftirqd/310:54:373
34342380,3sleep20-21swapper/207:35:422
34342380,3sleep20-21swapper/207:35:422
34342380,3sleep20-21swapper/207:35:422
106252370,3sleep00-21swapper/011:20:470
106252370,3sleep00-21swapper/011:20:470
53262360,3sleep10-21swapper/111:55:371
53262360,3sleep10-21swapper/111:55:371
53262360,3sleep10-21swapper/111:55:371
187832360,3sleep20-21swapper/211:30:502
187832360,3sleep20-21swapper/211:30:502
267762356,17sleep20-21swapper/207:10:482
267762356,17sleep20-21swapper/207:10:482
67052340,3sleep30-21swapper/311:15:483
44792340,4sleep30-21swapper/310:31:513
44792340,4sleep30-21swapper/310:31:513
4182340,2sleep0457-21ps07:25:530
4182340,2sleep0457-21ps07:25:530
278502343,20sleep30-21swapper/307:11:013
278502343,20sleep30-21swapper/307:11:013
30462330,8sleep333-21ksoftirqd/311:51:213
30462330,8sleep333-21ksoftirqd/311:51:213
30462330,8sleep333-21ksoftirqd/311:51:213
274622330,2sleep127584-21timerandwakeup09:35:551
274622330,2sleep127584-21timerandwakeup09:35:551
211502330,2sleep021160-21sh11:34:140
211502330,2sleep021160-21sh11:34:140
172722330,3sleep00-21swapper/010:05:510
172722330,3sleep00-21swapper/010:05:510
323482320,4sleep30-21swapper/311:47:553
323482320,4sleep30-21swapper/311:47:553
323482320,4sleep30-21swapper/311:47:553
272992325,14sleep10-21swapper/107:10:551
272992325,14sleep10-21swapper/107:10:551
271862320,3sleep20-21swapper/208:40:452
271862320,3sleep20-21swapper/208:40:452
261352320,4sleep20-21swapper/212:20:542
261352320,4sleep20-21swapper/212:20:542
151812320,3sleep20-21swapper/208:05:532
151812320,3sleep20-21swapper/208:05:532
170612310,2sleep10-21swapper/111:28:571
170612310,2sleep10-21swapper/111:28:571
60632300,3sleep00-21swapper/007:40:550
60632300,3sleep00-21swapper/007:40:550
60632300,3sleep00-21swapper/007:40:550
27927992916,10cyclictest20298-21ssh09:28:401
27927992916,10cyclictest20298-21ssh09:28:401
236282290,3sleep20-21swapper/209:31:372
231382280,2sleep00-21swapper/012:16:500
231382280,2sleep00-21swapper/012:16:500
109702270,3sleep30-21swapper/310:40:393
109702270,3sleep30-21swapper/310:40:393
81272250,4sleep30-21swapper/309:13:093
81272250,4sleep30-21swapper/309:13:093
79212250,2sleep30-21swapper/311:58:043
79212250,2sleep30-21swapper/311:58:043
79212250,2sleep30-21swapper/311:58:043
76652250,2sleep00-21swapper/007:45:490
76652250,2sleep00-21swapper/007:45:490
76652250,2sleep00-21swapper/007:45:490
2792699259,12cyclictest0-21swapper/007:35:520
2792699259,12cyclictest0-21swapper/007:35:520
2792699259,12cyclictest0-21swapper/007:35:520
81892240,3chrt0-21swapper/207:45:552
81892240,3chrt0-21swapper/207:45:552
81892240,3chrt0-21swapper/207:45:552
283112240,3sleep20-21swapper/211:01:282
283112240,3sleep20-21swapper/211:01:282
283112240,3sleep20-21swapper/211:01:282
2792899241,19cyclictest31266-21sed11:45:552
2792899241,19cyclictest31266-21sed11:45:552
2792899241,19cyclictest31266-21sed11:45:552
27927992416,6cyclictest24208-21ntp_states10:15:521
27927992413,8cyclictest21-21ksoftirqd/110:40:461
27927992413,8cyclictest21-21ksoftirqd/110:40:461
27927992412,9cyclictest31545-21perl09:40:461
27927992412,9cyclictest31545-21perl09:40:461
27927992412,9cyclictest31545-21perl09:40:461
27926992410,11cyclictest38250irq/56-eth010:55:400
27926992410,11cyclictest38250irq/56-eth010:55:400
164922240,19sleep016608-21df10:05:440
291942230,2sleep30-21swapper/309:37:573
291942230,2sleep30-21swapper/309:37:573
2792899231,18cyclictest9105-21cut07:50:462
2792899231,18cyclictest9105-21cut07:50:462
2792899231,18cyclictest9105-21cut07:50:462
27928992310,10cyclictest32707-21rm12:30:162
27928992310,10cyclictest32707-21rm12:30:162
27928992310,10cyclictest32707-21rm12:30:162
27928992310,10cyclictest32707-21rm12:30:162
2792799232,18cyclictest9842-21timerandwakeup07:50:561
2792799232,18cyclictest9842-21timerandwakeup07:50:561
2792799232,18cyclictest9842-21timerandwakeup07:50:561
27927992314,7cyclictest11653-21ssh09:57:511
27927992314,7cyclictest11653-21ssh09:57:511
27927992314,7cyclictest11653-21ssh09:57:511
27927992313,7cyclictest13736-21df_inode12:05:451
27927992313,7cyclictest13736-21df_inode12:05:451
2792699238,5cyclictest38250irq/56-eth010:46:470
2792699238,5cyclictest38250irq/56-eth010:46:470
2792699238,5cyclictest38250irq/56-eth010:46:470
2792699238,12cyclictest38250irq/56-eth012:05:350
2792699238,12cyclictest38250irq/56-eth012:05:350
27926992311,8cyclictest38150irq/55-eth011:15:460
27926992311,8cyclictest38150irq/55-eth011:15:460
27926992311,8cyclictest38150irq/55-eth011:15:460
2792999221,13cyclictest0-21swapper/310:50:453
2792999221,13cyclictest0-21swapper/310:50:453
2792899228,10cyclictest16474-21fschecks_time08:10:462
2792899228,10cyclictest16474-21fschecks_time08:10:462
27928992215,4cyclictest27-21ksoftirqd/209:15:472
27928992215,4cyclictest27-21ksoftirqd/209:15:472
27928992212,7cyclictest0-21swapper/208:55:542
27928992212,7cyclictest0-21swapper/208:55:542
2792899221,17cyclictest14586-21ls11:25:482
2792899221,17cyclictest14586-21ls11:25:482
2792899221,16cyclictest25305-21sshd12:20:442
2792899221,16cyclictest25305-21sshd12:20:442
2792899221,14cyclictest4568-21find12:35:442
2792899221,14cyclictest4568-21find12:35:442
2792899221,14cyclictest4568-21find12:35:442
2792799221,16cyclictest24441-21ls08:30:541
2792799221,16cyclictest24441-21ls08:30:541
2792799220,16cyclictest1770-21cut07:30:451
2792799220,16cyclictest1770-21cut07:30:451
2792799220,16cyclictest1770-21cut07:30:451
2792699228,12cyclictest10552-21ssh09:15:540
2792699228,12cyclictest10552-21ssh09:15:540
2792999211,12cyclictest0-21swapper/307:45:453
2792999211,12cyclictest0-21swapper/307:45:453
2792999211,12cyclictest0-21swapper/307:45:453
2792899211,3cyclictest2161-21sort09:00:452
2792899211,3cyclictest2161-21sort09:00:452
27928992113,6cyclictest4026-21vmstat10:30:582
27928992113,6cyclictest4026-21vmstat10:30:582
27928992113,6cyclictest11149-21rm09:56:432
27928992113,6cyclictest11149-21rm09:56:432
27928992113,6cyclictest11149-21rm09:56:432
2792899211,17cyclictest31342-21cpuspeed09:40:442
2792899211,17cyclictest31342-21cpuspeed09:40:442
2792899211,17cyclictest31342-21cpuspeed09:40:442
2792899211,15cyclictest1915-21ls11:50:482
2792899211,15cyclictest1915-21ls11:50:482
2792899211,15cyclictest1915-21ls11:50:482
27928992110,5cyclictest0-21swapper/212:05:522
27928992110,5cyclictest0-21swapper/212:05:522
2792799219,3cyclictest131rcu_preempt10:12:151
2792799219,3cyclictest131rcu_preempt10:12:151
27927992112,7cyclictest12378-21ssh11:22:331
27927992112,7cyclictest12378-21ssh11:22:331
2792799211,16cyclictest22563-21ssh09:30:521
2792799210,5cyclictest1910-21ssh10:29:281
2792799210,5cyclictest1910-21ssh10:29:281
2792699211,9cyclictest32383-21cron08:55:330
2792699211,9cyclictest32383-21cron08:55:330
2792699211,9cyclictest32383-21cron08:55:330
27926992114,5cyclictest1404-21ntp_states12:30:510
27926992114,5cyclictest1404-21ntp_states12:30:510
27926992114,5cyclictest1404-21ntp_states12:30:510
27926992112,6cyclictest0-21swapper/011:29:440
27926992112,6cyclictest0-21swapper/011:29:440
27926992112,6cyclictest0-21swapper/009:35:410
27926992111,7cyclictest11753-21needreboot10:40:500
27926992111,7cyclictest11753-21needreboot10:40:500
27926992111,7cyclictest0-21swapper/008:30:430
27926992111,7cyclictest0-21swapper/008:30:430
206732210,2sleep10-21swapper/111:33:181
206732210,2sleep10-21swapper/111:33:181
147402210,2sleep00-21swapper/008:05:460
147402210,2sleep00-21swapper/008:05:460
86172200,3sleep10-21swapper/111:18:071
86172200,3sleep10-21swapper/111:18:071
86172200,3sleep10-21swapper/111:18:071
86172200,3sleep10-21swapper/111:18:071
2792999201,14cyclictest0-21swapper/311:25:453
2792999201,14cyclictest0-21swapper/311:25:453
2792999201,13cyclictest0-21swapper/307:20:473
2792999201,13cyclictest0-21swapper/307:20:473
2792999201,13cyclictest0-21swapper/307:20:473
2792899202,3cyclictest131rcu_preempt10:59:462
2792899202,3cyclictest131rcu_preempt10:59:462
2792899202,3cyclictest131rcu_preempt10:59:462
27928992013,5cyclictest11864-21ssh11:21:322
27928992013,5cyclictest11864-21ssh11:21:322
27928992013,5cyclictest0-21swapper/209:55:502
27928992013,5cyclictest0-21swapper/209:55:502
27928992011,6cyclictest0-21swapper/208:35:432
27928992011,6cyclictest0-21swapper/208:35:432
2792899201,11cyclictest19762-21latency_hist08:20:382
2792899201,10cyclictest21700-21/usr/sbin/munin08:25:512
2792899201,10cyclictest21700-21/usr/sbin/munin08:25:512
2792899200,3cyclictest6742snmpd07:44:492
2792899200,3cyclictest6742snmpd07:44:492
2792899200,3cyclictest6742snmpd07:44:492
2792799205,8cyclictest26890-21ssh11:00:461
2792799205,8cyclictest26890-21ssh11:00:461
2792799201,5cyclictest14368-21ntpq09:20:521
2792799201,5cyclictest14368-21ntpq09:20:521
27927992012,6cyclictest23715-21sh11:36:331
27927992012,6cyclictest23715-21sh11:36:331
2792799201,16cyclictest9925-21cut09:55:491
2792799201,16cyclictest9925-21cut09:55:491
2792799201,16cyclictest9925-21cut09:55:491
2792699209,9cyclictest38250irq/56-eth012:13:230
2792699209,9cyclictest38250irq/56-eth012:13:230
2792699208,9cyclictest30743-21grep11:05:430
2792699208,9cyclictest30743-21grep11:05:430
2792699208,9cyclictest30743-21grep11:05:430
2792699208,9cyclictest0-21swapper/010:35:420
2792699208,9cyclictest0-21swapper/010:35:420
2792699208,3cyclictest38250irq/56-eth011:50:520
2792699208,3cyclictest38250irq/56-eth011:50:520
2792699208,3cyclictest38250irq/56-eth011:50:520
2792699208,10cyclictest38250irq/56-eth012:07:000
2792699208,10cyclictest38250irq/56-eth012:07:000
2792699208,10cyclictest38250irq/56-eth009:20:560
2792699208,10cyclictest38250irq/56-eth009:20:560
2792699207,4cyclictest38250irq/56-eth009:30:380
2792699207,4cyclictest38250irq/56-eth009:30:380
2792699207,4cyclictest38150irq/55-eth010:10:520
2792699206,12cyclictest38250irq/56-eth012:40:350
2792699206,12cyclictest38250irq/56-eth012:40:350
2792699206,12cyclictest38250irq/56-eth012:40:350
2792699203,8cyclictest25972-21netstat12:20:510
2792699203,8cyclictest25972-21netstat12:20:510
2792699202,6cyclictest12-21ksoftirqd/009:52:330
2792699202,6cyclictest12-21ksoftirqd/009:52:330
2792699202,6cyclictest12-21ksoftirqd/009:52:330
2792699201,7cyclictest10815-21wc10:40:340
2792699201,7cyclictest10815-21wc10:40:340
27926992014,4cyclictest151rcuc/011:45:390
27926992014,4cyclictest151rcuc/011:45:390
27926992014,4cyclictest151rcuc/011:45:390
27926992012,6cyclictest9255-21ssh11:19:200
27926992012,6cyclictest9255-21ssh11:19:200
27926992012,6cyclictest26870-21cron08:40:330
27926992012,6cyclictest26870-21cron08:40:330
27926992011,6cyclictest0-21swapper/011:20:490
27926992011,6cyclictest0-21swapper/011:20:490
320952190,4sleep1201rcuc/112:29:041
320952190,4sleep1201rcuc/112:29:041
320952190,4sleep1201rcuc/112:29:041
320952190,4sleep1201rcuc/112:29:041
2792999191,14cyclictest0-21swapper/308:15:363
2792999191,14cyclictest0-21swapper/308:15:363
2792999191,13cyclictest0-21swapper/309:40:463
2792999191,13cyclictest0-21swapper/309:40:463
2792999191,13cyclictest0-21swapper/309:40:463
2792999191,13cyclictest0-21swapper/308:55:483
2792999191,13cyclictest0-21swapper/308:55:483
2792999191,13cyclictest0-21swapper/308:05:483
2792999191,13cyclictest0-21swapper/308:05:483
2792999191,12cyclictest14191-21taskset09:20:493
2792999191,12cyclictest14191-21taskset09:20:493
2792999191,12cyclictest0-21swapper/311:40:393
2792999191,12cyclictest0-21swapper/311:40:393
2792999191,12cyclictest0-21swapper/309:10:413
2792999191,12cyclictest0-21swapper/309:10:413
2792899198,9cyclictest73-21kswapd009:50:452
2792899198,9cyclictest73-21kswapd009:50:452
2792899198,9cyclictest73-21kswapd009:50:452
2792899198,9cyclictest73-21kswapd009:50:452
2792899196,11cyclictest4330-21missed_timers09:05:492
2792899196,11cyclictest4330-21missed_timers09:05:492
2792899195,11cyclictest3476-21grep11:10:562
2792899195,11cyclictest3476-21grep11:10:562
2792899195,11cyclictest3476-21grep11:10:562
2792899191,9cyclictest10023-21latency12:00:482
2792899191,9cyclictest10023-21latency12:00:482
27928991913,4cyclictest0-21swapper/209:50:542
27928991912,5cyclictest0-21swapper/210:35:552
27928991912,5cyclictest0-21swapper/210:35:552
27928991911,6cyclictest536-21dbus-daemon08:45:532
27928991911,6cyclictest536-21dbus-daemon08:45:532
27928991911,6cyclictest134-21systemd-journal11:18:002
27928991911,6cyclictest134-21systemd-journal11:18:002
27928991911,6cyclictest134-21systemd-journal11:18:002
27928991911,6cyclictest134-21systemd-journal11:18:002
2792899191,14cyclictest19785-21cat10:50:532
2792899191,14cyclictest19785-21cat10:50:532
27928991910,7cyclictest23242-21cron10:15:332
27928991910,7cyclictest23242-21cron10:15:332
27928991910,7cyclictest23242-21cron10:15:332
27928991910,6cyclictest0-21swapper/208:25:412
27928991910,6cyclictest0-21swapper/208:25:412
2792799199,7cyclictest16485-21/usr/sbin/munin10:05:511
2792799199,7cyclictest16485-21/usr/sbin/munin10:05:511
2792799198,9cyclictest16541-21ssh10:46:241
2792799198,9cyclictest16541-21ssh10:46:241
2792799198,9cyclictest16541-21ssh10:46:241
2792799195,11cyclictest25701-21kernelversion08:35:471
2792799195,11cyclictest25701-21kernelversion08:35:471
2792799191,9cyclictest21670-21sh10:53:491
2792799191,9cyclictest21670-21sh10:53:491
2792799191,8cyclictest458-21tr08:55:471
2792799191,8cyclictest458-21tr08:55:471
27927991913,4cyclictest19644-21cat08:20:331
27927991912,5cyclictest0-21swapper/108:55:441
27927991912,5cyclictest0-21swapper/108:55:441
27927991911,6cyclictest7104-21kworker/u8:311:57:021
27927991911,6cyclictest7104-21kworker/u8:311:57:021
27927991911,6cyclictest7104-21kworker/u8:311:57:021
27927991911,6cyclictest3751-21sed10:30:561
27927991911,6cyclictest3751-21sed10:30:561
27927991911,6cyclictest24994-21kworker/u8:310:22:581
27927991911,6cyclictest24994-21kworker/u8:310:22:581
27927991911,6cyclictest24994-21kworker/u8:310:22:581
27927991911,6cyclictest11312-21kworker/u8:809:47:321
27927991911,6cyclictest11312-21kworker/u8:809:47:321
27927991911,6cyclictest11312-21kworker/u8:809:47:321
27927991911,6cyclictest11312-21kworker/u8:809:47:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional