You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 07:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Fri Dec 05, 2025 00:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1911346993913,6cyclictest171rcu_preempt23:43:121
191134599383,17cyclictest1966758-21latency_hist21:31:110
1911347993714,7cyclictest171rcu_preempt21:51:102
191134799361,10cyclictest11050irq/107-eth%d21:52:312
191134599363,24cyclictest1981251-21sendmail-msp21:51:490
1911345993521,7cyclictest2090293-21sendmail-msp23:53:510
1911347993410,5cyclictest171rcu_preempt21:38:102
1911347993410,4cyclictest1959018-21ntpq21:23:122
191134599348,21cyclictest2079071-21ntpq23:33:170
1911347993324,5cyclictest0-21swapper/222:48:132
191134599333,29cyclictest0-21swapper/023:38:130
191134699321,19cyclictest28-21ksoftirqd/100:31:161
191134599325,2cyclictest1967673-21ssh21:32:320
1911347993112,6cyclictest171rcu_preempt00:28:282
1911345993110,5cyclictest1981632-21ssh21:46:250
191134599310,9cyclictest1992268-21/usr/sbin/munin21:58:070
191134699305,18cyclictest1964177-21/usr/sbin/munin21:28:171
1911346993010,1cyclictest11050irq/107-eth%d22:48:131
191134599301,23cyclictest0-21swapper/021:26:100
191134699291,6cyclictest0-21swapper/122:58:231
191134799285,21cyclictest1008-21mta-sts-daemon23:48:142
1911347992817,9cyclictest1951558-21diskmemload23:35:592
191134599286,16cyclictest111788-21systemd-journal23:06:140
191134599282,22cyclictest2023168-21cat22:31:100
191134599282,18cyclictest1954232-21/usr/sbin/munin21:18:120
191134699271,6cyclictest28-21ksoftirqd/122:18:091
1911346992711,12cyclictest619-21mta-sts-daemon20:33:281
1911346992711,12cyclictest619-21mta-sts-daemon20:33:281
191134699270,3cyclictest2137216-21/usr/sbin/munin00:43:121
191134599274,6cyclictest2110631-21ntpq00:08:150
191134599272,7cyclictest1936394-21apt-get20:31:170
191134599272,7cyclictest1936394-21apt-get20:31:170
191134599272,24cyclictest0-21swapper/022:46:090
191134799262,5cyclictest171rcu_preempt23:06:312
191134699266,16cyclictest628-21systemd-logind23:50:231
191134699263,4cyclictest0-21swapper/123:15:461
191134599262,22cyclictest0-21swapper/023:43:080
1911345992616,2cyclictest1948177-21grep21:03:210
191134599261,18cyclictest58-21kcompactd022:38:120
191134599260,21cyclictest1914722-21latency_hist19:26:100
191134599259,9cyclictest0-21swapper/000:13:140
191134599259,9cyclictest0-21swapper/000:13:140
191134599251,2cyclictest111788-21systemd-journal21:41:090
191134599251,17cyclictest2133691-21/usr/sbin/munin00:38:080
191134599251,12cyclictest69-21kswapd000:31:160
191134799247,5cyclictest171rcu_preempt21:33:172
191134799247,10cyclictest171rcu_preempt23:03:072
191134799244,13cyclictest111788-21systemd-journal00:31:142
191134799241,19cyclictest0-21swapper/221:58:142
1911346992420,3cyclictest271ktimers/122:38:121
1911346992413,5cyclictest2074465-21ntpq23:28:141
191134599241,18cyclictest0-21swapper/000:03:130
191134599240,18cyclictest2123480-21/usr/sbin/munin00:23:180
191134799233,17cyclictest2088020-21ssh23:43:122
191134599236,6cyclictest1935923-21/usr/sbin/munin20:28:160
191134599236,6cyclictest1935923-21/usr/sbin/munin20:28:160
191134599234,15cyclictest111788-21systemd-journal23:11:380
191134599234,13cyclictest0-21swapper/023:48:170
191134599230,16cyclictest2121382-21latency_hist00:21:090
112699230,2rtkit-daemon1125-21rtkit-daemon19:55:071
191134799223,3cyclictest171rcu_preempt21:27:462
191134699224,12cyclictest1911303-21munin-run19:16:081
191134699222,4cyclictest1951558-21diskmemload21:35:151
1911346992215,4cyclictest261rcuc/120:06:571
1911346992213,2cyclictest171rcu_preempt22:33:131
191134599222,7cyclictest1930934-21ntpq20:13:160
191134599221,16cyclictest1924610-21gpgv19:56:090
191134799214,10cyclictest11050irq/107-eth%d00:08:152
191134799212,2cyclictest0-21swapper/200:18:112
191134799212,15cyclictest1005-21mta-sts-daemon20:53:142
191134799211,6cyclictest1934239-21awk20:23:132
191134799211,15cyclictest111788-21systemd-journal23:30:232
191134799210,5cyclictest2138176-21ntp_states00:43:122
191134699219,7cyclictest271ktimers/120:23:131
191134699210,8cyclictest2101611-21ntpq23:58:121
191134599212,15cyclictest1934650-21/usr/sbin/munin20:23:170
1911345992119,1cyclictest0-21swapper/019:43:030
191134599211,19cyclictest0-21swapper/023:18:090
191134599210,20cyclictest2024332-21ssh22:33:080
191134799201,5cyclictest0-21swapper/219:43:102
191134799201,4cyclictest171rcu_preempt23:16:182
191134699204,12cyclictest2018822-21ssh22:26:101
191134699204,11cyclictest1989554-21ssh21:54:181
191134699204,10cyclictest1983656-21ssh21:48:171
191134699203,14cyclictest111788-21systemd-journal22:12:571
191134699201,4cyclictest1935776-21ntpq20:28:131
191134699201,4cyclictest1935776-21ntpq20:28:131
191134599203,10cyclictest2126746-21ntpq00:28:280
191134599202,12cyclictest111788-21systemd-journal22:53:460
191134599202,12cyclictest111788-21systemd-journal22:53:460
191134599201,18cyclictest1976626-21apt-config21:41:090
191134799196,10cyclictest1951558-21diskmemload21:18:212
1911347991910,4cyclictest11050irq/107-eth%d23:53:112
191134699193,4cyclictest2134009-21grep00:38:111
191134699193,4cyclictest171rcu_preempt23:51:101
191134699193,12cyclictest11050irq/107-eth%d19:48:121
191134699190,14cyclictest2111410-21ssh00:08:471
191134599197,3cyclictest2073573-21/usr/sbin/munin23:28:120
1911345991916,2cyclictest1919565-21munin-plugin-st19:41:090
1911345991916,2cyclictest1006-21mta-sts-daemon20:53:140
1911345991914,5cyclictest2138110-21ntp_kernel_pll_00:43:110
1911345991912,1cyclictest0-21swapper/023:58:140
191134899183,8cyclictest0-21swapper/323:43:123
191134899182,9cyclictest0-21swapper/323:33:173
191134899182,9cyclictest0-21swapper/321:28:493
191134899182,10cyclictest0-21swapper/323:28:143
191134799188,5cyclictest1006-21mta-sts-daemon00:36:332
191134799181,4cyclictest1951558-21diskmemload22:12:572
1911347991812,5cyclictest0-21swapper/222:38:042
191134799180,1cyclictest69-21kswapd022:56:132
191134699186,12cyclictest2123271-21ntp_states00:23:141
191134699182,9cyclictest1951558-21diskmemload21:41:121
1911346991813,4cyclictest0-21swapper/121:23:041
1911346991810,6cyclictest1954231-21ssh21:18:121
191134599187,6cyclictest1005-21mta-sts-daemon19:16:090
1911345991818,0cyclictest0-21swapper/022:23:180
1911345991810,4cyclictest259-21jbd2/mmcblk0p2-822:06:170
191134599180,18cyclictest0-21swapper/022:18:100
112699180,1rtkit-daemon0-21swapper/220:44:192
112699180,1rtkit-daemon0-21swapper/220:44:192
191134799172,3cyclictest171rcu_preempt23:23:102
191134799172,10cyclictest1976730-21sh21:41:122
191134799171,7cyclictest0-21swapper/222:26:102
1911347991711,5cyclictest1915241-21fschecks_time19:28:062
191134699171,2cyclictest58-21kcompactd023:06:311
1911346991711,3cyclictest0-21swapper/123:18:111
191134699170,8cyclictest0-21swapper/121:13:141
191134699170,3cyclictest1946604-21cron21:01:091
191134599171,12cyclictest1911482-21grep19:16:090
191134899163,7cyclictest0-21swapper/319:23:083
191134899162,8cyclictest0-21swapper/321:33:173
191134799165,2cyclictest11050irq/107-eth%d23:13:192
191134799163,1cyclictest1948285-21sendmail-msp21:11:312
191134799163,12cyclictest1997923-21sh22:03:112
191134799162,10cyclictest2114822-21ssh00:13:142
191134799162,10cyclictest2114822-21ssh00:13:142
191134799161,8cyclictest171rcu_preempt20:31:182
191134799161,8cyclictest171rcu_preempt20:31:182
191134799161,2cyclictest0-21swapper/220:03:112
191134799160,1cyclictest171rcu_preempt19:48:132
191134799160,1cyclictest11050irq/107-eth%d00:03:092
191134699164,3cyclictest171rcu_preempt22:43:121
191134699163,7cyclictest2108386-21sendmail-msp00:13:171
191134699163,7cyclictest2108386-21sendmail-msp00:13:171
191134699163,2cyclictest0-21swapper/119:16:091
191134699163,1cyclictest171rcu_preempt22:53:151
191134699163,1cyclictest171rcu_preempt22:53:151
191134699163,11cyclictest11050irq/107-eth%d19:28:121
191134699162,3cyclictest171rcu_preempt22:03:091
191134699162,10cyclictest111788-21systemd-journal00:06:081
191134699161,3cyclictest28-21ksoftirqd/120:48:171
1911346991611,4cyclictest0-21swapper/123:33:051
191134699160,1cyclictest0-21swapper/119:56:111
191134599168,2cyclictest1921500-21/usr/sbin/munin19:48:050
191134599163,7cyclictest1927517-21ntpq20:03:110
191134599163,6cyclictest2045518-21apt-get22:56:140
1911345991613,1cyclictest0-21swapper/022:43:090
191134599160,9cyclictest1951530-21/usr/sbin/munin21:13:180
191134599160,8cyclictest0-21swapper/023:03:150
112699160,2rtkit-daemon1125-21rtkit-daemon19:20:452
112699160,2rtkit-daemon0-21swapper/220:56:502
191134899157,4cyclictest0-21swapper/323:13:183
191134899156,3cyclictest0-21swapper/320:13:163
191134899154,6cyclictest0-21swapper/319:56:093
191134899153,7cyclictest0-21swapper/322:38:123
191134899153,6cyclictest0-21swapper/322:43:133
191134899153,5cyclictest0-21swapper/321:58:143
191134899153,5cyclictest0-21swapper/321:13:443
191134899152,7cyclictest0-21swapper/321:48:163
191134899150,7cyclictest0-21swapper/322:46:093
191134799159,4cyclictest2005269-21latency_hist22:11:102
191134799159,3cyclictest1943235-21unixbench_multi20:48:202
191134799156,9cyclictest2072803-21kworker/u8:1+events_unbound23:37:032
191134799156,4cyclictest2101579-21/usr/sbin/munin23:58:122
191134799154,8cyclictest36-21ksoftirqd/220:13:142
191134799153,8cyclictest2036570-21sendmail-msp22:53:462
191134799153,8cyclictest2036570-21sendmail-msp22:53:462
191134699154,8cyclictest2083707-21/usr/sbin/munin23:38:161
191134699153,8cyclictest1992557-21fschecks_time21:58:091
191134699153,7cyclictest1941699-21sendmail-msp20:53:111
191134699153,1cyclictest1916900-21grep19:33:061
1911346991512,2cyclictest0-21swapper/122:26:091
1911346991511,2cyclictest2118178-21aten_r2power_cu00:18:041
191134699150,5cyclictest1918594-21sed19:38:061
191134599155,7cyclictest1941699-21sendmail-msp20:46:220
191134599155,7cyclictest1932185-21if_end020:18:060
191134599152,10cyclictest2069922-21fake-hwclock23:23:090
191134599151,9cyclictest1917410-21ntp_states19:33:110
191134599151,5cyclictest1928431-21aten_r2power_cu20:08:040
191134599150,2cyclictest0-21swapper/022:13:190
191134599150,14cyclictest1945249-21/usr/sbin/munin20:58:050
191134899144,5cyclictest0-21swapper/321:38:103
191134899144,5cyclictest0-21swapper/300:18:073
191134899143,6cyclictest0-21swapper/300:03:053
191134899142,8cyclictest0-21swapper/300:28:283
191134799145,7cyclictest1006-21mta-sts-daemon22:35:012
191134799142,9cyclictest2123197-21ssh00:23:132
191134799142,11cyclictest1006-21mta-sts-daemon19:41:092
1911347991412,1cyclictest1008-21mta-sts-daemon20:18:122
191134699148,1cyclictest171rcu_preempt20:38:071
191134699144,1cyclictest171rcu_preempt19:43:101
191134699142,6cyclictest1976113-21apt21:41:091
191134699142,2cyclictest0-21swapper/122:08:061
191134699141,4cyclictest28-21ksoftirqd/123:03:071
1911346991410,3cyclictest1947175-21cut21:03:111
191134599143,8cyclictest1939667-21/usr/sbin/munin20:38:170
191134599142,10cyclictest1941700-21awk20:46:090
191134599142,10cyclictest1941700-21awk20:46:090
191134599140,2cyclictest11050irq/107-eth%d22:03:090
191134899134,5cyclictest0-21swapper/300:08:153
191134899133,6cyclictest0-21swapper/322:33:183
191134899133,5cyclictest0-21swapper/300:23:123
191134899132,7cyclictest0-21swapper/323:58:093
191134899132,7cyclictest0-21swapper/321:18:113
191134899132,6cyclictest0-21swapper/300:33:473
191134899132,5cyclictest0-21swapper/320:31:173
191134899132,5cyclictest0-21swapper/320:31:173
191134899132,5cyclictest0-21swapper/319:18:103
191134899132,4cyclictest0-21swapper/300:13:143
191134899132,4cyclictest0-21swapper/300:13:143
191134899132,2cyclictest0-21swapper/323:06:133
191134899131,6cyclictest0-21swapper/321:44:583
191134899130,5cyclictest0-21swapper/321:03:213
191134799139,1cyclictest0-21swapper/220:28:142
191134799139,1cyclictest0-21swapper/220:28:142
191134799138,4cyclictest0-21swapper/219:53:162
191134799136,5cyclictest2033653-21/usr/sbin/munin22:43:072
191134799131,10cyclictest2011357-21fschecks_time22:18:052
191134699132,9cyclictest1930393-21grep20:13:081
191134699132,8cyclictest1932184-21if_end020:18:061
191134699132,6cyclictest1940256-21/usr/sbin/munin20:43:051
191134699132,6cyclictest1940256-21/usr/sbin/munin20:43:051
191134699131,7cyclictest2072276-21sendmail23:26:091
191134699130,4cyclictest2127097-21grep00:28:341
191134599133,8cyclictest1948514-21/usr/sbin/munin21:08:060
191134899124,5cyclictest0-21swapper/322:18:093
191134899124,4cyclictest0-21swapper/323:48:133
191134899123,4cyclictest0-21swapper/319:38:083
191134899122,6cyclictest0-21swapper/322:56:103
191134899122,6cyclictest0-21swapper/322:56:103
191134899122,5cyclictest0-21swapper/322:31:103
191134899122,5cyclictest0-21swapper/319:48:053
191134899122,4cyclictest0-21swapper/322:11:193
191134899122,4cyclictest0-21swapper/321:23:113
191134899121,7cyclictest0-21swapper/322:03:043
191134899121,7cyclictest0-21swapper/321:51:423
191134799122,8cyclictest1947206-21fschecks_time21:03:112
191134799121,9cyclictest1916692-21/usr/sbin/munin19:33:032
191134799121,8cyclictest2015701-21/usr/sbin/munin22:23:072
191134799121,10cyclictest1938752-21head20:38:052
191134799120,2cyclictest0-21swapper/220:08:132
191134699129,2cyclictest0-21swapper/119:23:151
191134699121,9cyclictest1948998-21/usr/sbin/munin21:08:131
191134699120,10cyclictest1927479-21needreboot20:03:101
191134599129,2cyclictest1915291-21gltestperf19:28:070
191134599126,1cyclictest0-21swapper/019:58:090
191134899116,2cyclictest0-21swapper/320:23:133
191134899115,3cyclictest0-21swapper/320:28:133
191134899115,3cyclictest0-21swapper/320:28:133
191134899114,3cyclictest0-21swapper/323:23:103
191134899112,5cyclictest0-21swapper/323:03:043
191134899112,5cyclictest0-21swapper/300:38:203
191134899112,4cyclictest0-21swapper/323:18:043
191134799114,6cyclictest341rcuc/219:56:112
191134799111,7cyclictest764-21rs:main2
191134799111,7cyclictest1913201-21/usr/sbin/munin19:23:102
191134899103,5cyclictest0-21swapper/300:43:093
191134899103,3cyclictest0-21swapper/320:40:183
191134899102,5cyclictest0-21swapper/323:53:143
191134899102,5cyclictest0-21swapper/322:08:053
191134899102,5cyclictest0-21swapper/320:18:063
191134899102,4cyclictest0-21swapper/320:53:133
191134899101,6cyclictest0-21swapper/323:38:163
191134899100,4cyclictest0-21swapper/320:03:113
19113489994,3cyclictest0-21swapper/319:56:113
19113489994,2cyclictest0-21swapper/322:23:123
19113489993,4cyclictest0-21swapper/320:08:143
19113489993,3cyclictest0-21swapper/320:43:063
19113489993,3cyclictest0-21swapper/320:43:063
19113489992,6cyclictest0-21swapper/322:56:133
19113489992,5cyclictest0-21swapper/319:26:223
19113489992,4cyclictest0-21swapper/320:46:223
19113489991,4cyclictest0-21swapper/320:58:063
19113489991,4cyclictest0-21swapper/319:33:073
19113489990,5cyclictest0-21swapper/321:08:063
19113479981,6cyclictest0-21swapper/219:16:082
19113489971,4cyclictest0-21swapper/319:43:043
19113489941,2cyclictest0-21swapper/319:16:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional