You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 21:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Tue May 26, 2026 12:42:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1724672995945,9cyclictest0-21swapper/211:15:582
1724672995442,8cyclictest1-21systemd11:55:012
1724670995340,10cyclictest1784774-21munin-run09:40:010
1724672995037,10cyclictest1877739-21sshd11:35:052
1724672994841,3cyclictest0-21swapper/210:20:592
1724671994840,5cyclictest1842792-21find10:51:071
1724671994840,5cyclictest1729173-21munin-plugin-st07:25:001
1724671994741,3cyclictest0-21swapper/111:15:531
1724671994741,2cyclictest0-21swapper/108:10:591
1724672994636,5cyclictest0-21swapper/209:11:002
1724670994638,5cyclictest421-21dbus-daemon11:25:010
1724671994537,5cyclictest926102-21cups-browsed10:31:081
1724671994535,6cyclictest926102-21cups-browsed11:25:161
1724670994538,4cyclictest1897626-21munin-run12:00:000
1724670994534,8cyclictest1764787-21ssh09:15:010
1724672994435,5cyclictest1917824-21ssh12:25:012
1724671994434,8cyclictest420-21avahi-daemon09:25:021
1724671994432,8cyclictest1784788-21basename09:40:011
1724672994335,5cyclictest1813015-21latency_hist10:15:012
1724672994335,5cyclictest1813015-21latency_hist10:15:012
1724671994335,5cyclictest1853241-21cron11:05:011
1724671994335,5cyclictest1853241-21cron11:05:011
1724671994335,5cyclictest1792814-21ssh09:50:011
1724671994335,5cyclictest1747183-21systemd-run08:25:011
1724672994233,7cyclictest421-21dbus-daemon07:40:012
1724671994234,5cyclictest1881467-21cron11:40:011
1724671994233,5cyclictest1742675-21systemd-run08:10:011
1724672994133,5cyclictest1776769-21systemd-run09:30:012
1724671994135,3cyclictest0-21swapper/110:20:011
1724671994131,7cyclictest926102-21cups-browsed09:43:251
1724670994129,9cyclictest1917798-21latency_hist12:25:030
1724672994032,5cyclictest1-21systemd11:45:022
1724672994031,4cyclictest0-21swapper/212:36:062
1724672994030,6cyclictest1055-21mta-sts-daemon09:51:232
1724671994033,4cyclictest1732079-21unixbench_singl07:31:111
1724671994032,5cyclictest1760722-21idleruntime-cro09:10:011
1724671994028,8cyclictest926102-21cups-browsed12:31:081
1724671994011,8cyclictest1896741-21ssh11:58:181
1724671994011,6cyclictest1760706-21diskmemload11:49:491
172467099403,30cyclictest1927315-21ssh12:36:070
1724670994031,7cyclictest1742657-21cut08:10:000
172467099401,13cyclictest0-21swapper/007:31:040
1724672993931,5cyclictest1873465-21systemd-run11:30:012
1724672993931,5cyclictest1778720-21unixbench_multi09:31:112
1724671993933,3cyclictest0-21swapper/109:35:011
1724671993931,5cyclictest1812978-21systemd-run10:15:011
1724671993931,5cyclictest1812978-21systemd-run10:15:011
1724671993926,9cyclictest926102-21cups-browsed10:20:531
1724672993831,4cyclictest1875430-21sed11:31:102
1724672993829,5cyclictest1745671-21basename08:20:012
1724671993830,5cyclictest1841349-21latency_hist10:50:031
1724671993829,6cyclictest420-21avahi-daemon10:05:041
1724671993829,6cyclictest420-21avahi-daemon10:05:041
1724671993828,7cyclictest695-21cron09:55:011
1724671993828,7cyclictest1929874-21sh12:40:011
1724671993824,10cyclictest926102-21cups-browsed10:56:041
1724671993811,9cyclictest1907157-21ntpq12:11:031
1724670993831,4cyclictest1921884-21latency_hist12:30:020
1724670993816,6cyclictest171rcu_preempt10:26:320
1724672993730,4cyclictest1800845-21munin-run10:00:012
1724672993729,5cyclictest1-21systemd10:50:012
1724672993728,6cyclictest926102-21cups-browsed08:40:022
1724672993728,5cyclictest1897626-21munin-run12:00:002
1724671993731,3cyclictest0-21swapper/110:05:011
1724671993731,3cyclictest0-21swapper/108:40:011
1724671993728,5cyclictest1734190-21fschecks_count07:40:501
1724671993723,9cyclictest1725518-21ntpq07:10:561
1724670993728,7cyclictest1056-21mta-sts-daemon10:45:490
1724670993728,6cyclictest1751686-21systemd-run08:40:010
172467299366,25cyclictest1846501-21ssh10:55:592
1724672993629,3cyclictest0-21swapper/210:36:002
172467199368,10cyclictest1899123-21ntpq12:01:031
1724671993629,3cyclictest0-21swapper/110:00:011
1724671993628,5cyclictest1893576-21cron11:55:001
1724671993613,5cyclictest428-21mta-sts-daemon10:40:251
1724670993611,13cyclictest171rcu_preempt10:19:200
172467099360,10cyclictest14-21ksoftirqd/011:01:060
172467099360,10cyclictest14-21ksoftirqd/011:01:060
1724672993529,4cyclictest1724669-21cyclictest09:15:572
1724672993529,3cyclictest0-21swapper/211:01:022
1724672993529,3cyclictest0-21swapper/211:01:022
1724672993528,4cyclictest1857308-21systemd11:10:012
1724672993528,3cyclictest0-21swapper/208:51:062
1724672993527,5cyclictest1901686-21munin-plugin-st12:05:012
1724672993527,5cyclictest1790694-21unixbench-2d09:46:102
172467199353,25cyclictest1911103-21ssh12:15:591
1724671993529,3cyclictest0-21swapper/112:25:011
1724671993529,3cyclictest0-21swapper/110:40:011
1724671993528,4cyclictest1762332-21kworker/u8:15-xprtiod09:20:011
1724671993527,5cyclictest0-21swapper/109:14:591
1724671993523,7cyclictest926102-21cups-browsed11:10:131
1724670993524,2cyclictest171rcu_preempt11:16:010
1724670993521,7cyclictest1051-21mta-sts-daemon12:17:340
1724670993520,3cyclictest171rcu_preempt07:15:490
1724672993428,3cyclictest0-21swapper/209:41:012
1724672993428,3cyclictest0-21swapper/209:40:012
1724672993427,3cyclictest0-21swapper/212:16:052
1724672993426,5cyclictest1867302-21unixbench-2d11:21:102
1724672993425,6cyclictest421-21dbus-daemon10:05:492
1724672993425,6cyclictest421-21dbus-daemon10:05:492
1724672993423,8cyclictest1919092-21sh12:25:552
1724671993427,4cyclictest1056-21mta-sts-daemon11:06:021
1724670993428,4cyclictest516-21in:imuxsock09:20:010
1724670993428,3cyclictest0-21swapper/011:30:010
1724670993427,4cyclictest1794437-21mailstats09:51:060
1724670993423,3cyclictest171rcu_preempt09:26:070
1724670993423,2cyclictest171rcu_preempt12:01:580
1724670993421,7cyclictest420-21avahi-daemon09:30:190
1724670993410,8cyclictest14-21ksoftirqd/011:31:010
1724672993327,3cyclictest0-21swapper/209:00:012
1724672993325,5cyclictest1814234-21sh10:15:542
1724672993325,5cyclictest1727661-21munin-plugin-st07:20:012
1724672993324,6cyclictest1859296-21unixbench_singl11:11:112
1724672993324,6cyclictest1747183-21systemd-run08:25:012
1724672993323,7cyclictest1802144-21needreboot10:00:562
1724672993321,2cyclictest1734550-21ntpq07:40:572
1724672993316,3cyclictest171rcu_preempt12:11:072
1724672993315,3cyclictest171rcu_preempt09:21:042
172467199334,22cyclictest1774135-21ssh09:25:581
1724671993326,3cyclictest0-21swapper/111:35:011
1724671993325,5cyclictest1756348-21latency_hist08:55:021
1724670993327,4cyclictest1881541-21latency_hist11:40:020
1724670993326,5cyclictest1733687-21systemd-run07:40:010
1724670993321,3cyclictest171rcu_preempt12:10:100
1724670993319,6cyclictest171rcu_preempt10:50:590
1724670993319,4cyclictest171rcu_preempt09:21:000
1724670993318,3cyclictest171rcu_preempt08:46:020
1724670993318,3cyclictest171rcu_preempt08:46:020
1724670993317,11cyclictest12350irq/32-eth010:11:000
1724670993317,11cyclictest12350irq/32-eth010:11:000
1724670993316,6cyclictest151ktimers/012:31:160
1724670993316,3cyclictest171rcu_preempt07:24:440
172467099331,29cyclictest0-21swapper/011:41:000
1724672993225,3cyclictest0-21swapper/210:45:012
1724672993224,3cyclictest0-21swapper/210:30:582
1724672993222,7cyclictest1750165-21systemd-run08:35:012
1724672993212,8cyclictest1743673-21ps08:11:082
1724671993226,3cyclictest0-21swapper/111:20:521
172467199322,18cyclictest1883006-21ssh11:41:051
1724671993220,8cyclictest1727133-21ntpq07:16:031
172467099322,25cyclictest1834558-21ssh10:41:010
1724670993219,6cyclictest171rcu_preempt12:06:010
1724670993218,6cyclictest171rcu_preempt09:41:410
1724670993217,3cyclictest171rcu_preempt11:05:550
1724670993215,3cyclictest171rcu_preempt09:56:010
1724670993214,4cyclictest1760706-21diskmemload10:31:000
1724672993125,3cyclictest0-21swapper/211:50:012
1724672993124,4cyclictest1738415-21aten_r2power_cu07:55:472
1724672993124,4cyclictest1738415-21aten_r2power_cu07:55:472
1724672993119,4cyclictest1758931-21find09:01:092
172467199319,4cyclictest1760706-21diskmemload12:09:511
1724671993125,2cyclictest0-21swapper/109:00:011
1724671993124,4cyclictest1739647-21munin-plugin-st08:00:001
1724671993124,4cyclictest1739647-21munin-plugin-st08:00:001
1724671993121,8cyclictest1749495-21ntp_kernel_err08:30:561
1724671993119,8cyclictest1748023-21ntpq08:25:571
1724671993117,10cyclictest1825016-21ssh10:29:561
1724671993110,16cyclictest1730188-21ps07:26:081
172467099318,9cyclictest14-21ksoftirqd/010:01:030
1724670993125,4cyclictest191rcuc/008:51:070
1724670993120,2cyclictest171rcu_preempt09:05:550
1724670993119,3cyclictest171rcu_preempt08:11:010
1724670993118,2cyclictest171rcu_preempt08:15:500
1724670993117,6cyclictest171rcu_preempt08:20:590
1724670993116,3cyclictest1812973-21kworker/u8:12-rpciod10:20:110
1724670993115,3cyclictest171rcu_preempt11:12:310
1724672993024,3cyclictest0-21swapper/209:10:012
1724672993022,4cyclictest0-21swapper/212:06:132
1724672993019,3cyclictest171rcu_preempt07:10:022
1724672993015,3cyclictest171rcu_preempt10:50:162
1724672993015,3cyclictest171rcu_preempt07:45:592
1724672993013,3cyclictest171rcu_preempt08:46:042
1724672993013,3cyclictest171rcu_preempt08:46:042
1724672993013,3cyclictest171rcu_preempt07:26:002
1724672993013,13cyclictest351ktimers/208:05:012
1724672993013,13cyclictest351ktimers/208:05:012
1724672993012,5cyclictest171rcu_preempt08:40:572
1724671993023,3cyclictest0-21swapper/112:25:571
1724671993020,8cyclictest1758613-21ntp_kernel_pll_09:01:001
172467099308,8cyclictest14-21ksoftirqd/011:45:580
1724670993024,3cyclictest1759326-21latency_hist09:05:010
1724670993023,4cyclictest191rcuc/010:05:490
1724670993023,4cyclictest191rcuc/010:05:490
1724670993021,6cyclictest191rcuc/009:45:300
1724670993018,3cyclictest171rcu_preempt07:45:590
1724670993017,2cyclictest171rcu_preempt08:56:000
1724670993011,3cyclictest171rcu_preempt08:26:020
1724672992923,3cyclictest0-21swapper/208:30:012
1724672992921,5cyclictest1056-21mta-sts-daemon07:15:022
1724671992917,9cyclictest1737495-21ntp_kernel_err07:50:561
1724671992917,9cyclictest1737495-21ntp_kernel_err07:50:561
1724671992914,12cyclictest1745020-21ntpq08:15:571
172467099297,10cyclictest151ktimers/010:56:050
1724670992920,5cyclictest151ktimers/007:51:020
1724670992920,5cyclictest151ktimers/007:51:020
1724670992919,3cyclictest171rcu_preempt11:51:080
1724670992917,2cyclictest171rcu_preempt07:40:590
1724670992916,3cyclictest171rcu_preempt08:00:580
1724670992916,3cyclictest171rcu_preempt08:00:580
1724670992915,2cyclictest171rcu_preempt08:30:580
1724670992914,3cyclictest171rcu_preempt07:26:000
1724670992913,6cyclictest421-21dbus-daemon08:40:120
172467299288,10cyclictest1051-21mta-sts-daemon10:28:352
1724672992820,5cyclictest1732085-21head07:31:112
1724672992819,6cyclictest439-21systemd-logind07:55:012
1724672992819,6cyclictest439-21systemd-logind07:55:012
1724672992818,3cyclictest1760706-21diskmemload12:32:502
1724671992820,5cyclictest1733650-21sh07:40:001
1724671992817,7cyclictest1740642-21ntpq08:01:031
1724671992817,7cyclictest1740642-21ntpq08:01:031
1724671992816,8cyclictest1754128-21ntpq08:46:021
1724671992816,8cyclictest1754128-21ntpq08:46:021
1724670992823,3cyclictest1739635-21cron08:00:000
1724670992823,3cyclictest1739635-21cron08:00:000
1724670992819,3cyclictest171rcu_preempt10:37:270
1724671992716,7cyclictest1752549-21ntpq08:40:581
1724670992715,5cyclictest171rcu_preempt07:10:590
1724672992617,7cyclictest1742575-21unixbench_singl08:06:132
1724672992610,14cyclictest341rcuc/207:22:202
1724671992615,7cyclictest1736016-21ntpq07:45:581
172467399244,11cyclictest0-21swapper/310:10:593
172467399244,11cyclictest0-21swapper/310:10:593
1724670992417,4cyclictest191rcuc/007:10:010
172467399234,10cyclictest0-21swapper/309:56:003
172467399232,12cyclictest0-21swapper/312:01:003
172467399224,10cyclictest0-21swapper/311:11:023
172467399223,12cyclictest0-21swapper/310:26:013
172467399223,11cyclictest0-21swapper/311:01:013
172467399223,11cyclictest0-21swapper/311:01:013
172467399223,11cyclictest0-21swapper/310:46:003
172467399222,12cyclictest0-21swapper/310:40:593
172467399214,11cyclictest0-21swapper/311:36:033
172467399214,10cyclictest0-21swapper/309:26:053
172467399213,12cyclictest0-21swapper/311:55:593
172467399213,12cyclictest0-21swapper/311:21:003
172467399213,11cyclictest0-21swapper/310:36:063
172467399212,12cyclictest0-21swapper/311:51:023
1724671992110,8cyclictest421-21dbus-daemon07:10:011
172467399205,10cyclictest0-21swapper/312:36:073
172467399203,11cyclictest0-21swapper/311:16:043
172467399203,11cyclictest0-21swapper/310:55:593
172467399203,11cyclictest0-21swapper/310:31:003
172467399203,10cyclictest0-21swapper/310:50:583
172467399202,12cyclictest0-21swapper/312:20:573
172467399202,12cyclictest0-21swapper/311:41:023
172467399202,12cyclictest0-21swapper/309:31:003
172467399196,8cyclictest0-21swapper/310:20:583
172467399194,8cyclictest0-21swapper/308:10:593
172467399193,9cyclictest0-21swapper/312:31:003
172467399193,11cyclictest0-21swapper/312:15:573
172467399193,11cyclictest0-21swapper/309:50:593
172467399192,12cyclictest0-21swapper/310:01:003
172467399192,12cyclictest0-21swapper/309:16:003
172467399192,11cyclictest0-21swapper/309:21:043
172467399191,13cyclictest0-21swapper/310:05:583
172467399191,13cyclictest0-21swapper/310:05:583
172467399191,13cyclictest0-21swapper/308:52:013
172467399184,9cyclictest0-21swapper/309:10:583
172467399183,9cyclictest0-21swapper/309:45:583
172467399182,8cyclictest0-21swapper/312:11:013
172467399182,7cyclictest0-21swapper/311:30:593
172467399182,12cyclictest0-21swapper/311:25:583
172467399182,12cyclictest0-21swapper/308:06:013
172467399182,11cyclictest0-21swapper/311:05:063
172467399182,11cyclictest0-21swapper/309:06:013
172467399182,11cyclictest0-21swapper/308:30:573
172467399182,11cyclictest0-21swapper/307:26:053
172467399181,13cyclictest0-21swapper/311:46:003
172467399181,13cyclictest0-21swapper/309:40:583
172467399181,12cyclictest0-21swapper/312:26:013
172467399181,12cyclictest0-21swapper/310:15:573
172467399181,12cyclictest0-21swapper/308:55:573
172467399181,12cyclictest0-21swapper/308:36:003
172467399181,12cyclictest0-21swapper/308:25:593
172467399181,12cyclictest0-21swapper/308:15:573
172467399181,12cyclictest0-21swapper/307:50:573
172467399181,12cyclictest0-21swapper/307:50:573
172467399171,2cyclictest0-21swapper/307:10:013
172467399171,12cyclictest0-21swapper/312:05:553
172467399171,12cyclictest0-21swapper/309:35:573
172467399171,12cyclictest0-21swapper/309:01:003
172467399171,12cyclictest0-21swapper/308:40:583
172467399171,12cyclictest0-21swapper/308:00:563
172467399171,12cyclictest0-21swapper/308:00:563
172467399171,12cyclictest0-21swapper/307:56:013
172467399171,12cyclictest0-21swapper/307:56:013
172467399171,12cyclictest0-21swapper/307:30:583
172467399171,12cyclictest0-21swapper/307:20:593
172467399171,12cyclictest0-21swapper/307:10:563
172467399171,11cyclictest0-21swapper/307:45:593
172467399171,11cyclictest0-21swapper/307:15:573
172467399162,11cyclictest0-21swapper/308:45:593
172467399162,11cyclictest0-21swapper/308:45:593
172467399161,11cyclictest0-21swapper/308:20:543
172467399161,11cyclictest0-21swapper/307:40:563
172467399151,11cyclictest0-21swapper/307:35:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional