You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 17:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot4.osadl.org (updated Sat Mar 14, 2026 12:44:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71640rcu_preempt0-21swapper/011:42:140
71640rcu_preempt0-21swapper/011:42:140
71640rcu_preempt0-21swapper/011:42:140
71610rcu_preempt0-21swapper/108:16:461
71610rcu_preempt0-21swapper/108:16:461
71560rcu_preempt15361-21apt-get08:01:562
71560rcu_preempt15361-21apt-get08:01:562
31550ksoftirqd/09677-1kworker/0:2H09:26:490
31550ksoftirqd/09677-1kworker/0:2H09:26:490
71530rcu_preempt0-21swapper/210:31:302
71530rcu_preempt0-21swapper/210:31:302
71490rcu_preempt0-21swapper/212:31:552
71490rcu_preempt0-21swapper/212:31:552
46050470irq/122-QManpo7812-2110:48:550
46050470irq/122-QManpo7812-2110:48:550
46050470irq/122-QManpo7812-2110:48:550
137399473cyclictest0-21swapper/311:04:013
137399473cyclictest0-21swapper/311:04:013
137399473cyclictest0-21swapper/311:04:013
137399469cyclictest10652-21ssh09:26:213
137399469cyclictest10652-21ssh09:26:213
137399452cyclictest18294-21diskstats12:32:023
137399452cyclictest18294-21diskstats12:32:023
46050440irq/122-QManpo23230-2110:48:550
46050440irq/122-QManpo23230-2110:48:550
137399444cyclictest0-21swapper/310:30:273
137399444cyclictest0-21swapper/310:30:273
137399443cyclictest0-21swapper/309:16:573
137399443cyclictest0-21swapper/309:16:573
137399442cyclictest7029-21diskstats12:12:003
137399442cyclictest7029-21diskstats12:12:003
137399442cyclictest13103-21ntp_states12:22:113
137399442cyclictest13103-21ntp_states12:22:113
137399442cyclictest13103-21ntp_states12:22:113
137399442cyclictest0-21swapper/311:37:133
137399442cyclictest0-21swapper/311:37:133
137399442cyclictest0-21swapper/311:37:133
46050430irq/122-QManpo26480-2110:48:550
46050430irq/122-QManpo26480-2110:48:550
46050430irq/122-QManpo0-210
46050430irq/122-QManpo0-210
46050430irq/122-QManpo0-210
137399434cyclictest0-21swapper/311:48:033
137399434cyclictest0-21swapper/311:48:033
137399434cyclictest0-21swapper/311:12:043
137399434cyclictest0-21swapper/311:12:043
137399434cyclictest0-21swapper/310:48:343
137399434cyclictest0-21swapper/310:48:343
137399433cyclictest0-21swapper/312:06:443
137399433cyclictest0-21swapper/312:06:443
137399433cyclictest0-21swapper/312:06:443
137399433cyclictest0-21swapper/308:52:003
137399433cyclictest0-21swapper/308:52:003
137399432cyclictest18811-21ssh10:37:123
137399432cyclictest18811-21ssh10:37:123
137399432cyclictest18811-21ssh10:37:123
137399432cyclictest14266-21memory11:27:083
137399432cyclictest14266-21memory11:27:083
137299432cyclictest5881-21df_inode07:27:002
137299432cyclictest5881-21df_inode07:27:002
137299432cyclictest5881-21df_inode07:27:002
137299432cyclictest4402-21meminfo10:12:032
137299432cyclictest4402-21meminfo10:12:032
137299432cyclictest27000-21ntp_states08:42:092
137299432cyclictest27000-21ntp_states08:42:092
137299432cyclictest10427-21sendmail_mailqu07:42:132
137299432cyclictest10427-21sendmail_mailqu07:42:132
137299432cyclictest10427-21sendmail_mailqu07:42:132
137299431cyclictest15233-21apt-get10:31:562
137299431cyclictest15233-21apt-get10:31:562
46050420irq/122-QManpo23626-2110:48:550
46050420irq/122-QManpo23626-2110:48:550
137399424cyclictest0-21swapper/309:47:123
137399424cyclictest0-21swapper/309:47:123
137399423cyclictest0-21swapper/311:25:363
137399423cyclictest0-21swapper/311:25:363
137399423cyclictest0-21swapper/311:00:593
137399423cyclictest0-21swapper/311:00:593
137399423cyclictest0-21swapper/311:00:593
137399423cyclictest0-21swapper/310:52:063
137399423cyclictest0-21swapper/310:52:063
137399422cyclictest4125-21munin-run07:21:443
137399422cyclictest4125-21munin-run07:21:443
137399422cyclictest3117-21ntp_states11:07:113
137399422cyclictest3117-21ntp_states11:07:113
137399421cyclictest22235-1kworker/3:0H11:45:063
137399421cyclictest22235-1kworker/3:0H11:45:063
137399421cyclictest22235-1kworker/3:0H11:45:063
137299424cyclictest0-21swapper/207:56:572
137299424cyclictest0-21swapper/207:56:572
137299423cyclictest21184-21diskstats08:22:012
137299423cyclictest21184-21diskstats08:22:012
137299423cyclictest0-21swapper/212:25:212
137299423cyclictest0-21swapper/212:25:212
137299423cyclictest0-21swapper/212:25:212
137299423cyclictest0-21swapper/210:21:562
137299423cyclictest0-21swapper/210:21:562
137299422cyclictest31903-21munin-run09:01:452
137299422cyclictest31903-21munin-run09:01:452
137299422cyclictest31903-21munin-run09:01:452
137299422cyclictest22457-21aten_r4power_cu11:41:582
137299422cyclictest22457-21aten_r4power_cu11:41:582
137299422cyclictest22457-21aten_r4power_cu11:41:582
71410rcu_preempt1434-21munin-node07:11:540
71410rcu_preempt1434-21munin-node07:11:540
71410rcu_preempt0-21swapper/211:22:562
71410rcu_preempt0-21swapper/211:22:562
71410rcu_preempt0-21swapper/009:35:000
71410rcu_preempt0-21swapper/009:35:000
46250410irq/120-QManpo1276-2110:48:551
46250410irq/120-QManpo1276-2110:48:551
46250410irq/120-QManpo1276-2110:48:551
137399414cyclictest0-21swapper/310:46:183
137399414cyclictest0-21swapper/310:46:183
137399413cyclictest0-21swapper/309:57:023
137399413cyclictest0-21swapper/309:57:023
137399413cyclictest0-21swapper/309:57:023
137399413cyclictest0-21swapper/309:46:443
137399413cyclictest0-21swapper/309:46:443
137399413cyclictest0-21swapper/309:46:443
137399413cyclictest0-21swapper/307:42:123
137399413cyclictest0-21swapper/307:42:123
137399413cyclictest0-21swapper/307:42:123
137399412cyclictest0-21swapper/310:33:143
137399412cyclictest0-21swapper/310:33:143
137399411cyclictest0-21swapper/308:57:123
137399411cyclictest0-21swapper/308:57:123
137399411cyclictest0-21swapper/308:57:123
1373994118cyclictest0-21swapper/308:21:553
1373994118cyclictest0-21swapper/308:21:553
137299414cyclictest0-21swapper/211:06:582
137299414cyclictest0-21swapper/211:06:582
137299413cyclictest0-21swapper/211:53:132
137299413cyclictest0-21swapper/211:53:132
137299413cyclictest0-21swapper/211:53:132
137299413cyclictest0-21swapper/211:14:092
137299413cyclictest0-21swapper/211:14:092
137299413cyclictest0-21swapper/209:42:082
137299413cyclictest0-21swapper/209:42:082
137299413cyclictest0-21swapper/209:42:082
137299413cyclictest0-21swapper/209:34:462
137299413cyclictest0-21swapper/209:34:462
137299413cyclictest0-21swapper/209:29:492
137299413cyclictest0-21swapper/209:29:492
137299413cyclictest0-21swapper/208:26:582
137299413cyclictest0-21swapper/208:26:582
137299413cyclictest0-21swapper/207:41:452
137299413cyclictest0-21swapper/207:41:452
137299413cyclictest0-21swapper/207:41:452
137299413cyclictest0-21swapper/207:32:062
137299413cyclictest0-21swapper/207:32:062
137299413cyclictest0-21swapper/207:32:062
137299412cyclictest32518-21diskstats11:02:022
137299412cyclictest32518-21diskstats11:02:022
137299412cyclictest32518-21diskstats11:02:022
1372994117cyclictest10094-21memory12:17:052
1372994117cyclictest10094-21memory12:17:052
1372994117cyclictest10094-21memory12:17:052
71400rcu_preempt0-21swapper/308:17:113
71400rcu_preempt0-21swapper/308:17:113
71400rcu_preempt0-21swapper/308:17:113
71400rcu_preempt0-21swapper/109:38:311
71400rcu_preempt0-21swapper/109:38:311
137399406cyclictest0-21swapper/310:07:053
137399406cyclictest0-21swapper/310:07:053
137399402cyclictest16695-21/usr/sbin/munin09:37:043
137399402cyclictest16695-21/usr/sbin/munin09:37:043
137399402cyclictest0-21swapper/311:36:453
137399402cyclictest0-21swapper/311:36:453
137399402cyclictest0-21swapper/309:13:283
137399402cyclictest0-21swapper/309:13:283
137399401cyclictest855-21munin-plugin-st09:06:443
137399401cyclictest855-21munin-plugin-st09:06:443
1373994016cyclictest8824-21ntp_states11:17:063
1373994016cyclictest8824-21ntp_states11:17:063
1373994016cyclictest4813-1kworker/3:2H10:25:103
1373994016cyclictest4813-1kworker/3:2H10:25:103
1373994012cyclictest14728-21grep09:32:123
1373994012cyclictest14728-21grep09:32:123
137299404cyclictest0-21swapper/210:38:172
137299404cyclictest0-21swapper/210:38:172
137299404cyclictest0-21swapper/210:38:172
137299404cyclictest0-21swapper/210:00:442
137299404cyclictest0-21swapper/210:00:442
137299404cyclictest0-21swapper/210:00:442
137299404cyclictest0-21swapper/209:37:012
137299404cyclictest0-21swapper/209:37:012
137299403cyclictest26940-21meminfo10:52:052
137299403cyclictest26940-21meminfo10:52:052
137299403cyclictest0-21swapper/211:30:482
137299403cyclictest0-21swapper/211:30:482
137299403cyclictest0-21swapper/209:52:112
137299403cyclictest0-21swapper/209:52:112
137299403cyclictest0-21swapper/209:51:392
137299403cyclictest0-21swapper/209:51:392
137299403cyclictest0-21swapper/209:21:582
137299403cyclictest0-21swapper/209:21:582
137299403cyclictest0-21swapper/208:47:012
137299403cyclictest0-21swapper/208:47:012
137299403cyclictest0-21swapper/208:07:062
137299403cyclictest0-21swapper/208:07:062
137299403cyclictest0-21swapper/207:52:072
137299403cyclictest0-21swapper/207:52:072
137299403cyclictest0-21swapper/207:47:072
137299403cyclictest0-21swapper/207:47:072
137299403cyclictest0-21swapper/207:47:072
137299402cyclictest5585-21sed09:16:582
137299402cyclictest5585-21sed09:16:582
137299402cyclictest4195-21diskstats12:07:002
137299402cyclictest4195-21diskstats12:07:002
137299402cyclictest32272-21diskstats09:01:592
137299402cyclictest32272-21diskstats09:01:592
137299402cyclictest2821-21ssh12:03:582
137299402cyclictest2821-21ssh12:03:582
137299402cyclictest2821-21ssh12:03:582
137299402cyclictest26333-21munin-run08:41:452
137299402cyclictest26333-21munin-run08:41:452
137299402cyclictest21416-21meminfo10:42:052
137299402cyclictest21416-21meminfo10:42:052
137299401cyclictest31374-21ssh11:57:112
137299401cyclictest31374-21ssh11:57:112
1372994018cyclictest8752-21sh12:14:532
1372994018cyclictest8752-21sh12:14:532
1372994018cyclictest0-21swapper/208:36:432
1372994018cyclictest0-21swapper/208:36:432
71390rcu_preempt17930-21latency_hist12:31:492
71390rcu_preempt17930-21latency_hist12:31:492
71390rcu_preempt17930-21latency_hist12:31:492
137399394cyclictest0-21swapper/312:41:463
137399394cyclictest0-21swapper/312:41:463
137399394cyclictest0-21swapper/312:41:463
137399393cyclictest0-21swapper/310:12:103
137399393cyclictest0-21swapper/310:12:103
137399393cyclictest0-21swapper/308:06:583
137399393cyclictest0-21swapper/308:06:583
137399392cyclictest30403-21ssh11:56:143
137399392cyclictest30403-21ssh11:56:143
137399392cyclictest30403-21ssh11:56:143
137399392cyclictest1900-21munin-node07:11:533
137399392cyclictest1900-21munin-node07:11:533
1373993916cyclictest0-21swapper/308:02:093
1373993916cyclictest0-21swapper/308:02:093
1373993915cyclictest4398-21memory12:07:073
1373993915cyclictest4398-21memory12:07:073
137299393cyclictest0-21swapper/212:37:102
137299393cyclictest0-21swapper/212:37:102
137299393cyclictest0-21swapper/212:37:102
137299393cyclictest0-21swapper/211:46:562
137299393cyclictest0-21swapper/211:46:562
137299393cyclictest0-21swapper/208:11:572
137299393cyclictest0-21swapper/208:11:572
137299392cyclictest29828-21meminfo10:57:062
137299392cyclictest29828-21meminfo10:57:062
137299392cyclictest29828-21meminfo10:57:062
137299392cyclictest16958-21if_eth311:32:012
137299392cyclictest16958-21if_eth311:32:012
137299391cyclictest7464-1grep10:17:082
137299391cyclictest7464-1grep10:17:082
137299391cyclictest7464-1grep10:17:082
137299391cyclictest4265-21apt-get07:21:562
137299391cyclictest4265-21apt-get07:21:562
137299391cyclictest4265-21apt-get07:21:562
137299391cyclictest19857-21/usr/sbin/munin11:37:032
137299391cyclictest19857-21/usr/sbin/munin11:37:032
137299391cyclictest19857-21/usr/sbin/munin11:37:032
137299391cyclictest0-21swapper/211:16:572
137299391cyclictest0-21swapper/211:16:572
71380rcu_preempt0-21swapper/009:59:460
71380rcu_preempt0-21swapper/009:59:460
71380rcu_preempt0-21swapper/009:59:460
46050380irq/122-QManpo4496-2110:48:550
46050380irq/122-QManpo4496-2110:48:550
46050380irq/122-QManpo4496-2110:48:550
46050380irq/122-QManpo10284-10
46050380irq/122-QManpo10284-10
137399383cyclictest0-21swapper/311:59:033
137399383cyclictest0-21swapper/311:59:033
137399383cyclictest0-21swapper/308:42:243
137399383cyclictest0-21swapper/308:42:243
137399381cyclictest25070-21apt-get09:51:553
137399381cyclictest25070-21apt-get09:51:553
137399381cyclictest0-21swapper/312:30:143
137399381cyclictest0-21swapper/312:30:143
137399381cyclictest0-21swapper/312:30:143
1373993813cyclictest11031-21aten_r4power_en09:26:593
1373993813cyclictest11031-21aten_r4power_en09:26:593
137299382cyclictest3468-21sh09:12:182
137299382cyclictest3468-21sh09:12:182
137299382cyclictest25077-21ssh10:48:322
137299382cyclictest25077-21ssh10:48:322
137299382cyclictest20864-21cut08:21:462
137299382cyclictest20864-21cut08:21:462
137299382cyclictest20864-21cut08:21:462
137299381cyclictest1959-21runrttasks07:17:092
137299381cyclictest1959-21runrttasks07:17:092
137299381cyclictest0-21swapper/207:12:132
137299381cyclictest0-21swapper/207:12:132
71370rcu_preempt31256-21memory11:57:080
71370rcu_preempt31256-21memory11:57:080
71370rcu_preempt1773-21rs:main1
71370rcu_preempt1773-21rs:main1
71370rcu_preempt1773-21rs:main1
71370rcu_preempt0-21swapper/012:19:030
71370rcu_preempt0-21swapper/012:19:030
71370rcu_preempt0-21swapper/012:19:030
71370rcu_preempt0-21swapper/009:47:570
71370rcu_preempt0-21swapper/009:47:570
46050370irq/122-QManpo21460-210
46050370irq/122-QManpo21460-210
46050370irq/122-QManpo18227-2110:48:550
46050370irq/122-QManpo18227-2110:48:550
46050370irq/122-QManpo18227-2110:48:550
46050370irq/122-QManpo1807-2110:48:550
46050370irq/122-QManpo1807-2110:48:550
46050370irq/122-QManpo1807-2110:48:550
46050370irq/122-QManpo12203-2110:48:550
46050370irq/122-QManpo12203-2110:48:550
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
46050370irq/122-QManpo0-210
137399372cyclictest4436-21/usr/sbin/munin07:21:593
137399372cyclictest4436-21/usr/sbin/munin07:21:593
137399372cyclictest4436-21/usr/sbin/munin07:21:593
137399372cyclictest32581-21sh10:04:383
137399372cyclictest32581-21sh10:04:383
137399372cyclictest0-21swapper/310:17:093
137399372cyclictest0-21swapper/310:17:093
137399372cyclictest0-21swapper/310:17:093
137399371cyclictest24483-1kworker/3:0H08:41:503
137399371cyclictest24483-1kworker/3:0H08:41:503
137399371cyclictest1958-21snmpd12:17:043
137399371cyclictest1958-21snmpd12:17:043
137399371cyclictest1958-21snmpd12:17:043
137399371cyclictest0-21swapper/307:31:593
137399371cyclictest0-21swapper/307:31:593
137399371cyclictest0-21swapper/307:31:593
137299373cyclictest30826-21apt-get10:01:552
137299373cyclictest30826-21apt-get10:01:552
137299372cyclictest0-21swapper/210:07:082
137299372cyclictest0-21swapper/210:07:082
137299371cyclictest0-21swapper/209:06:572
137299371cyclictest0-21swapper/209:06:572
71360rcu_preempt30654-21copy11:56:520
71360rcu_preempt30654-21copy11:56:520
71360rcu_preempt0-21swapper/307:59:293
71360rcu_preempt0-21swapper/307:59:293
71360rcu_preempt0-21swapper/009:36:540
71360rcu_preempt0-21swapper/009:36:540
46050360irq/122-QManpo31898-2110:48:550
46050360irq/122-QManpo31898-2110:48:550
46050360irq/122-QManpo2782-2110:48:550
46050360irq/122-QManpo2782-2110:48:550
46050360irq/122-QManpo2782-2110:48:550
46050360irq/122-QManpo15698-2110:48:550
46050360irq/122-QManpo15698-2110:48:550
46050360irq/122-QManpo12996-210
46050360irq/122-QManpo12996-210
46050360irq/122-QManpo10109-2110:48:550
46050360irq/122-QManpo10109-2110:48:550
46050360irq/122-QManpo10109-2110:48:550
46050360irq/122-QManpo0-210
46050360irq/122-QManpo0-210
1599360migration/08789-21ntp_kernel_err11:17:060
1599360migration/08789-21ntp_kernel_err11:17:060
137399362cyclictest8407-21/usr/sbin/munin07:36:593
137399362cyclictest8407-21/usr/sbin/munin07:36:593
137399362cyclictest8407-21/usr/sbin/munin07:36:593
137399362cyclictest24185-21ntpq08:32:073
137399362cyclictest24185-21ntpq08:32:073
137399362cyclictest22327-21/usr/sbin/munin08:27:103
137399362cyclictest22327-21/usr/sbin/munin08:27:103
137399361cyclictest5647-21/usr/sbin/munin07:27:083
137399361cyclictest5647-21/usr/sbin/munin07:27:083
137399361cyclictest5647-21/usr/sbin/munin07:27:083
1373993611cyclictest19378-21latency_hist08:16:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional