You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 00:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1.osadl.org (updated Tue Dec 16, 2025 13:38:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
831423800,15sleep227-21ksoftirqd/207:10:282
831423800,15sleep227-21ksoftirqd/207:10:282
256142690,3chrt0-21swapper/209:25:342
256142690,3chrt0-21swapper/209:25:342
104882650,3sleep00-21swapper/007:16:450
104882650,3sleep00-21swapper/007:16:450
152332640,3sleep30-21swapper/308:56:503
152332640,3sleep30-21swapper/308:56:503
146992630,2sleep214808-21fschecks_time08:56:462
146992630,2sleep214808-21fschecks_time08:56:462
180302620,3chrt18029-21fschecks_time12:01:460
83192610,3sleep00-21swapper/007:10:310
83192610,3sleep00-21swapper/007:10:310
191472610,9sleep227-21ksoftirqd/210:36:462
191472610,9sleep227-21ksoftirqd/210:36:462
302592590,3chrt0-21swapper/009:36:530
302592590,3chrt0-21swapper/009:36:530
79742570,3sleep30-21swapper/311:31:563
79742570,3sleep30-21swapper/311:31:563
224432570,3chrt0-21swapper/007:46:550
224432570,3chrt0-21swapper/007:46:550
310702550,2sleep1201rcuc/111:06:551
310702550,2sleep1201rcuc/111:06:551
3922520,3sleep30-21swapper/311:11:553
3922520,3sleep30-21swapper/311:11:553
235492520,1sleep223622-21/usr/sbin/munin07:51:482
267472490,2sleep126788-21latency_hist12:25:031
313252460,3chrt0-21swapper/309:41:463
313252460,3chrt0-21swapper/309:41:463
303682450,2sleep00-21swapper/012:35:010
303682450,2sleep00-21swapper/012:35:010
125962430,4sleep10-21swapper/108:50:051
269922410,4sleep30-21swapper/312:26:453
269922410,4sleep30-21swapper/312:26:453
189842410,3chrt0-21swapper/109:06:521
189842410,3chrt0-21swapper/109:06:521
205802390,3sleep30-21swapper/310:40:043
205802390,3sleep30-21swapper/310:40:043
61402380,2sleep20-21swapper/208:31:542
61402380,2sleep20-21swapper/208:31:542
175722350,3sleep10-21swapper/112:00:031
55162340,4sleep30-21swapper/308:31:463
55162340,4sleep30-21swapper/308:31:463
249522330,2sleep125093-21missed_timers10:51:491
206242330,11sleep333-21ksoftirqd/309:11:483
206242330,11sleep333-21ksoftirqd/309:11:483
9712320,2sleep00-21swapper/008:16:570
9712320,2sleep00-21swapper/008:16:570
56522320,3sleep00-21swapper/008:31:470
56522320,3sleep00-21swapper/008:31:470
121442320,2sleep212252-21df_inode07:21:462
43772300,3sleep30-21swapper/309:56:453
43772300,3sleep30-21swapper/309:56:453
101452300,3chrt0-21swapper/011:40:010
101452300,3chrt0-21swapper/011:40:010
835899292,22cyclictest26421-21taskset09:26:520
835899292,22cyclictest26421-21taskset09:26:520
31802280,2sleep13181-21sshd08:24:301
31802280,2sleep13181-21sshd08:24:301
836099279,11cyclictest21-21ksoftirqd/110:47:031
836099279,11cyclictest21-21ksoftirqd/110:47:031
37302270,2sleep23925-21tail08:26:482
37302270,2sleep23925-21tail08:26:482
116042270,2sleep30-21swapper/311:41:523
116042270,2sleep30-21swapper/311:41:523
836099268,11cyclictest21-21ksoftirqd/110:30:591
836099267,10cyclictest21-21ksoftirqd/111:00:251
836099267,10cyclictest21-21ksoftirqd/111:00:251
836099266,12cyclictest21-21ksoftirqd/108:11:521
8360992610,10cyclictest21-21ksoftirqd/108:40:001
8360992610,10cyclictest21-21ksoftirqd/108:40:001
106302260,3chrt0-21swapper/008:45:010
87542250,2sleep30-21swapper/307:11:463
87542250,2sleep30-21swapper/307:11:463
836099255,6cyclictest21-21ksoftirqd/112:11:501
836099255,6cyclictest21-21ksoftirqd/112:11:501
835899251,22cyclictest20860-21vmstat12:06:560
16742250,2sleep10-21swapper/109:46:541
16742250,2sleep10-21swapper/109:46:541
84132240,4chrt0-21swapper/110:06:471
84132240,4chrt0-21swapper/110:06:471
836099246,11cyclictest21-21ksoftirqd/110:14:561
836099246,11cyclictest21-21ksoftirqd/110:14:561
836099245,9cyclictest21-21ksoftirqd/110:20:391
836099245,9cyclictest21-21ksoftirqd/110:20:391
836099243,6cyclictest21-21ksoftirqd/112:10:011
835899241,12cyclictest29762-21latency_hist11:05:030
835899241,12cyclictest29762-21latency_hist11:05:030
8361992312,9cyclictest28300-21/usr/sbin/munin09:31:542
836099238,6cyclictest131rcu_preempt08:30:521
836099238,6cyclictest131rcu_preempt08:30:521
836099236,8cyclictest21-21ksoftirqd/112:25:471
836099236,8cyclictest21-21ksoftirqd/112:25:471
8360992313,3cyclictest131rcu_preempt09:17:591
8360992313,3cyclictest131rcu_preempt09:17:591
835899231,11cyclictest13153-21sendmail10:20:000
835899231,11cyclictest13153-21sendmail10:20:000
83132234,12sleep10-21swapper/107:10:281
83132234,12sleep10-21swapper/107:10:281
322742230,2sleep30-21swapper/312:40:033
304262230,2sleep10-21swapper/109:36:541
304262230,2sleep10-21swapper/109:36:541
836099229,6cyclictest131rcu_preempt07:32:221
836099229,6cyclictest131rcu_preempt07:32:221
836099228,2cyclictest131rcu_preempt07:41:411
836099226,9cyclictest21-21ksoftirqd/111:52:081
836099225,9cyclictest21-21ksoftirqd/110:02:391
836099225,9cyclictest21-21ksoftirqd/110:02:391
8360992213,7cyclictest201rcuc/109:40:571
8360992213,7cyclictest201rcuc/109:40:571
8360992211,4cyclictest131rcu_preempt08:45:021
836199211,18cyclictest20312-21cut09:11:462
836199211,18cyclictest20312-21cut09:11:462
836199211,16cyclictest7796-21ls11:31:552
836199211,16cyclictest7796-21ls11:31:552
836199211,16cyclictest22144-21cut09:16:452
836199211,16cyclictest22144-21cut09:16:452
836199211,14cyclictest3268-21cut11:21:472
836099219,7cyclictest21-21ksoftirqd/109:52:001
836099219,7cyclictest21-21ksoftirqd/109:52:001
836099219,4cyclictest21-21ksoftirqd/111:16:451
836099219,4cyclictest21-21ksoftirqd/111:16:451
836099219,10cyclictest21311-21/usr/sbin/munin07:46:531
836099219,10cyclictest21311-21/usr/sbin/munin07:46:531
836099217,4cyclictest131rcu_preempt07:23:401
836099214,9cyclictest21-21ksoftirqd/111:41:481
836099214,9cyclictest21-21ksoftirqd/111:41:481
836099214,7cyclictest21-21ksoftirqd/109:56:541
836099214,7cyclictest21-21ksoftirqd/109:56:541
836099213,7cyclictest21-21ksoftirqd/110:27:181
836099213,7cyclictest21-21ksoftirqd/110:27:181
836099213,10cyclictest21-21ksoftirqd/108:55:031
836099213,10cyclictest21-21ksoftirqd/108:55:031
8360992113,6cyclictest19688-21ntpq10:36:521
8360992113,6cyclictest19688-21ntpq10:36:521
835899211,16cyclictest10382-21ls10:11:490
835899211,16cyclictest10382-21ls10:11:490
326242210,3chrt0-21swapper/111:11:531
326242210,3chrt0-21swapper/111:11:531
836199208,10cyclictest30486-21/usr/sbin/munin08:11:562
836199201,16cyclictest30479-21ls12:35:042
836199201,16cyclictest30479-21ls12:35:042
836199201,16cyclictest11898-21timerandwakeup08:46:552
836199201,15cyclictest18602-21timerandwakeup07:36:542
836199201,15cyclictest18602-21timerandwakeup07:36:542
836199201,14cyclictest10576-21latency_hist08:45:022
8361992010,8cyclictest23910-21df_inode09:21:462
836099209,3cyclictest131rcu_preempt12:02:341
836099209,3cyclictest131rcu_preempt10:40:411
836099208,5cyclictest131rcu_preempt08:08:061
836099208,5cyclictest131rcu_preempt08:08:061
836099208,4cyclictest21-21ksoftirqd/107:55:011
836099207,2cyclictest131rcu_preempt08:16:061
836099207,2cyclictest131rcu_preempt08:16:061
836099206,7cyclictest21-21ksoftirqd/107:40:021
836099206,7cyclictest21-21ksoftirqd/107:40:021
836099205,7cyclictest21-21ksoftirqd/111:40:021
836099205,7cyclictest21-21ksoftirqd/111:40:021
836099205,6cyclictest21-21ksoftirqd/111:30:211
836099205,6cyclictest21-21ksoftirqd/111:30:211
836099204,4cyclictest21-21ksoftirqd/111:26:551
8360992010,3cyclictest131rcu_preempt10:58:491
8360992010,3cyclictest131rcu_preempt10:58:491
836099200,12cyclictest3890-21gltestperf08:26:481
836099200,12cyclictest3890-21gltestperf08:26:481
835899206,11cyclictest677-21ls09:46:440
835899206,11cyclictest677-21ls09:46:440
835899203,13cyclictest23427-21cron09:20:000
835899203,13cyclictest23427-21cron09:20:000
8358992016,3cyclictest10234-21find08:21:540
8358992016,3cyclictest10234-21find08:21:540
8358992013,5cyclictest3772-21/usr/sbin/munin11:21:510
835899201,11cyclictest535-21snmpd12:14:460
835899201,11cyclictest535-21snmpd12:14:460
835899200,11cyclictest697-21runrttasks07:33:170
835899200,11cyclictest697-21runrttasks07:33:170
836299191,14cyclictest0-21swapper/312:05:023
836299191,14cyclictest0-21swapper/308:21:453
836299191,14cyclictest0-21swapper/308:21:453
836299191,13cyclictest0-21swapper/310:01:493
836299191,13cyclictest0-21swapper/310:01:493
836299191,13cyclictest0-21swapper/307:20:003
836299191,13cyclictest0-21swapper/307:20:003
836199197,10cyclictest13379-21grep11:46:552
836199197,10cyclictest13379-21grep11:46:552
836199191,8cyclictest24439-21grep12:16:552
836199191,8cyclictest21677-21mailstats10:41:542
836199191,4cyclictest131rcu_preempt07:41:452
836199191,4cyclictest0-21swapper/211:56:522
836199191,15cyclictest25175-21cut07:56:462
836199191,15cyclictest25175-21cut07:56:462
836199191,12cyclictest984-21ls09:46:472
836199191,12cyclictest984-21ls09:46:472
836199191,10cyclictest5927-21cat11:26:532
836199190,16cyclictest22736-21ls10:46:452
836199190,16cyclictest22736-21ls10:46:452
836199190,15cyclictest17411-21timerandwakeup09:01:552
836199190,15cyclictest17411-21timerandwakeup09:01:552
836099199,3cyclictest131rcu_preempt11:21:181
836099199,3cyclictest131rcu_preempt09:31:341
836099198,4cyclictest21-21ksoftirqd/109:24:361
836099197,5cyclictest131rcu_preempt08:55:391
836099197,5cyclictest131rcu_preempt08:55:391
836099197,3cyclictest131rcu_preempt12:16:421
836099196,4cyclictest131rcu_preempt07:17:051
836099196,4cyclictest131rcu_preempt07:17:051
836099195,4cyclictest131rcu_preempt09:05:021
836099195,4cyclictest131rcu_preempt09:05:021
836099194,3cyclictest131rcu_preempt12:35:071
8360991911,6cyclictest12788-21unixbench_singl10:16:551
8360991911,6cyclictest12788-21unixbench_singl10:16:551
8360991911,3cyclictest0-21swapper/109:11:541
8360991911,3cyclictest0-21swapper/109:11:541
835899197,10cyclictest30806-21grep12:36:460
835899192,6cyclictest12-21ksoftirqd/008:06:510
835899192,6cyclictest12-21ksoftirqd/008:06:510
835899191,9cyclictest3756-21fschecks_count08:26:470
835899191,9cyclictest3756-21fschecks_count08:26:470
835899191,8cyclictest23629-21tail12:16:470
8358991911,6cyclictest0-21swapper/012:21:540
835899191,10cyclictest983-21latency_hist11:15:040
835899191,10cyclictest983-21latency_hist11:15:040
835899191,10cyclictest13758-21cron11:50:000
835899191,10cyclictest13758-21cron11:50:000
835899190,10cyclictest23611-21sort10:46:560
835899190,10cyclictest23611-21sort10:46:560
4482190,3sleep00-21swapper/009:45:050
836299181,14cyclictest0-21swapper/311:50:033
836299181,14cyclictest0-21swapper/311:50:033
836299181,13cyclictest0-21swapper/309:31:473
836299181,12cyclictest0-21swapper/311:06:483
836299181,12cyclictest0-21swapper/311:06:483
836199188,8cyclictest14118-21sshd08:53:302
836199188,8cyclictest14118-21sshd08:53:302
836199185,11cyclictest17298-21fschecks_count10:31:472
836199183,6cyclictest27-21ksoftirqd/207:16:272
836199183,6cyclictest27-21ksoftirqd/207:16:272
836199181,6cyclictest0-21swapper/209:36:502
836199181,6cyclictest0-21swapper/209:36:502
836199181,15cyclictest697-21runrttasks11:19:392
836199181,15cyclictest697-21runrttasks11:19:392
836199181,15cyclictest10828-21ls11:41:442
836199181,15cyclictest10828-21ls11:41:442
836199181,10cyclictest1851-21df08:21:452
836199181,10cyclictest1851-21df08:21:452
836099188,3cyclictest131rcu_preempt12:31:311
836099188,3cyclictest131rcu_preempt12:31:311
836099188,3cyclictest131rcu_preempt08:04:581
836099184,4cyclictest21-21ksoftirqd/107:26:541
836099184,4cyclictest21-21ksoftirqd/107:26:541
836099181,9cyclictest21-21ksoftirqd/107:56:491
836099181,9cyclictest21-21ksoftirqd/107:56:491
836099181,14cyclictest13905-21cat11:50:051
836099181,14cyclictest13905-21cat11:50:051
835899188,8cyclictest7035-21perl11:31:460
835899188,8cyclictest7035-21perl11:31:460
835899186,10cyclictest7603-21cut08:36:470
835899186,10cyclictest7603-21cut08:36:470
835899186,10cyclictest697-21runrttasks11:41:510
835899186,10cyclictest697-21runrttasks11:41:510
835899185,10cyclictest19992-21grep07:41:470
835899183,13cyclictest1918-21ntpq11:16:500
835899183,13cyclictest1918-21ntpq11:16:500
835899181,8cyclictest14111-21/usr/sbin/munin11:51:550
835899181,8cyclictest12394-21sort07:21:480
835899181,15cyclictest27011-21grep10:56:530
835899181,15cyclictest27011-21grep10:56:530
305952180,4chrt12-21ksoftirqd/008:11:460
836299171,14cyclictest0-21swapper/309:55:033
836299171,14cyclictest0-21swapper/309:55:033
836299171,13cyclictest0-21swapper/309:36:463
836299171,13cyclictest0-21swapper/309:36:463
836299171,12cyclictest0-21swapper/308:11:453
836299171,11cyclictest0-21swapper/311:56:453
836299171,11cyclictest0-21swapper/308:51:463
836299171,11cyclictest0-21swapper/308:51:463
836299171,11cyclictest0-21swapper/308:46:453
836199179,6cyclictest25817-21nfs4_client12:21:512
836199179,6cyclictest25215-21open_files10:51:522
836199179,6cyclictest10455-21awk10:11:512
836199179,6cyclictest10455-21awk10:11:512
836199179,6cyclictest0-21swapper/212:11:522
836199179,6cyclictest0-21swapper/212:11:522
836199178,7cyclictest31533-21sensors_temp12:36:542
836199178,7cyclictest27714-21sensors_temp08:01:542
836199178,7cyclictest15782-21tr10:26:492
836199178,7cyclictest15782-21tr10:26:492
836199178,7cyclictest14859-21sensors_temp07:26:532
836199178,7cyclictest14859-21sensors_temp07:26:532
836199178,6cyclictest9165-21grep10:06:552
836199178,6cyclictest9165-21grep10:06:552
836199177,8cyclictest31662-21irqstats09:41:492
836199177,8cyclictest31662-21irqstats09:41:492
836199177,3cyclictest0-21swapper/207:30:432
836199177,3cyclictest0-21swapper/207:30:432
836199175,10cyclictest9424-21grep11:36:532
836199175,10cyclictest9424-21grep11:36:532
8361991711,4cyclictest19763-21idleruntime-cro09:10:002
8361991711,4cyclictest19763-21idleruntime-cro09:10:002
836199171,13cyclictest27742-21wc12:26:532
836199171,13cyclictest27742-21wc12:26:532
836199171,13cyclictest19870-21grep12:06:462
836199171,13cyclictest15008-21taskset10:25:012
836199171,13cyclictest15008-21taskset10:25:012
836199171,12cyclictest32475-21tune2fs08:16:462
836199171,12cyclictest32475-21tune2fs08:16:462
836199171,12cyclictest12202-21missed_timers10:16:492
836199171,12cyclictest12202-21missed_timers10:16:492
8361991710,4cyclictest27-21ksoftirqd/208:06:552
8361991710,4cyclictest27-21ksoftirqd/208:06:552
836099175,5cyclictest131rcu_preempt09:25:021
8360991711,4cyclictest0-21swapper/109:26:471
8360991711,4cyclictest0-21swapper/109:26:471
835899177,8cyclictest23423-21perl07:51:460
835899173,6cyclictest30351-21gltestperf11:06:470
835899173,6cyclictest30351-21gltestperf11:06:470
835899172,12cyclictest5803-21awk10:00:000
835899172,12cyclictest5803-21awk10:00:000
835899171,8cyclictest32364-21grep09:41:560
835899171,7cyclictest27816-21tune2fs09:31:470
835899171,7cyclictest12956-21fschecks_count08:51:460
835899171,7cyclictest12956-21fschecks_count08:51:460
835899171,7cyclictest12053-21grep08:46:560
835899171,6cyclictest13679-21fschecks_count10:21:470
835899171,6cyclictest13679-21fschecks_count10:21:470
835899171,14cyclictest24184-21idleruntime09:21:480
835899171,14cyclictest17139-21ntp_states09:01:520
835899171,14cyclictest17139-21ntp_states09:01:520
835899171,13cyclictest8480-21grep10:06:480
835899171,13cyclictest8480-21grep10:06:480
835899171,13cyclictest4029-21grep09:55:020
835899171,13cyclictest4029-21grep09:55:020
835899171,13cyclictest19860-21latency_hist09:10:030
835899171,13cyclictest19860-21latency_hist09:10:030
835899171,13cyclictest19615-21cut10:36:500
835899171,13cyclictest19615-21cut10:36:500
835899171,12cyclictest14215-21chrt07:26:460
835899171,12cyclictest14215-21chrt07:26:460
8358991710,5cyclictest5988-21cat11:26:530
8358991710,5cyclictest28157-21grep12:26:560
8358991710,5cyclictest28157-21grep12:26:560
8358991710,5cyclictest20477-21cut09:11:470
8358991710,5cyclictest20477-21cut09:11:470
8358991710,5cyclictest18081-21/usr/sbin/munin10:31:560
8358991710,5cyclictest10234-21find07:36:440
8358991710,5cyclictest10234-21find07:36:440
835899170,8cyclictest26965-21fschecks_count08:01:460
41412170,3sleep30-21swapper/311:21:553
836299169,5cyclictest33-21ksoftirqd/307:25:123
836299169,5cyclictest33-21ksoftirqd/307:25:123
836299161,12cyclictest0-21swapper/308:01:493
836299161,12cyclictest0-21swapper/307:41:443
836299161,11cyclictest0-21swapper/310:46:463
836299161,11cyclictest0-21swapper/310:46:463
836299161,10cyclictest0-21swapper/312:31:473
836299161,10cyclictest0-21swapper/312:31:473
836299161,10cyclictest0-21swapper/311:16:443
836299161,10cyclictest0-21swapper/311:16:443
836299161,10cyclictest0-21swapper/308:45:003
836199168,6cyclictest8750-21sendmail08:40:002
836199168,6cyclictest8750-21sendmail08:40:002
836199167,6cyclictest0-21swapper/209:56:532
836199167,6cyclictest0-21swapper/209:56:532
836199165,4cyclictest28315-21fschecks_count11:01:472
836199165,4cyclictest28315-21fschecks_count11:01:472
836199162,12cyclictest18269-21kernelversion12:01:482
836199161,8cyclictest859-21taskset11:14:472
836199161,8cyclictest859-21taskset11:14:472
836199161,12cyclictest697-21runrttasks10:55:192
836199161,12cyclictest697-21runrttasks10:55:192
836199161,12cyclictest6614-21cat10:01:492
836199161,12cyclictest6614-21cat10:01:492
836199161,12cyclictest3077-21cut09:51:502
836199161,12cyclictest3077-21cut09:51:502
836199161,12cyclictest14780-21grep11:51:512
836199161,11cyclictest21443-21grep07:46:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional