You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 14:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Aug 22, 2026 12:42:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1915831998368,10cyclictest1954643-21diskmemload09:14:062
1915831998368,10cyclictest1954643-21diskmemload09:14:062
1915829995947,9cyclictest0-21swapper/011:40:010
1915830995548,4cyclictest1001-21mta-sts-daemon07:36:031
1915830995446,3cyclictest0-21swapper/109:14:071
1915830995446,3cyclictest0-21swapper/109:14:071
1915831995025,21cyclictest0-21swapper/209:35:012
1915831995020,5cyclictest0-21swapper/212:20:012
1915831994920,6cyclictest0-21swapper/207:20:592
1915831994838,7cyclictest420-21avahi-daemon12:05:522
1915830994837,7cyclictest1-21systemd09:35:011
1915829994840,5cyclictest2059433-21grep12:05:540
1915831994725,19cyclictest0-21swapper/211:00:502
191583099476,30cyclictest1986853-21ssh10:06:051
1915829994718,10cyclictest1927327-21ntpq07:46:020
1915829994718,10cyclictest1927327-21ntpq07:46:020
1915831994638,5cyclictest1945890-21systemd-run08:50:012
1915831994636,7cyclictest421-21dbus-daemon07:55:012
1915831994626,17cyclictest0-21swapper/211:00:012
1915830994633,8cyclictest1977690-21ssh09:51:051
1915829994638,6cyclictest2056188-21aten_r2power_po12:00:510
1915831994523,5cyclictest1003-21mta-sts-daemon10:44:142
1915831994522,5cyclictest1002-21mta-sts-daemon10:01:142
191583099452,28cyclictest1959182-21ssh09:20:581
1915829994538,5cyclictest1933896-21systemd-run08:10:020
1915829994532,7cyclictest1951896-21systemd-run09:10:010
1915829994532,7cyclictest1951896-21systemd-run09:10:010
191582999452,33cyclictest2068890-21ssh12:20:590
1915831994334,5cyclictest0-21swapper/209:16:002
1915831994333,6cyclictest2026335-21ntp_offset11:11:012
1915830994332,7cyclictest1958019-21awk09:20:001
1915830994331,9cyclictest1933887-21sh08:10:021
1915830994329,11cyclictest2001846-21needreboot10:30:581
1915829994336,4cyclictest1939901-21systemd-run08:30:010
1915829994335,6cyclictest2025108-21/usr/sbin/munin11:10:020
191583199424,13cyclictest428-21mta-sts-daemon07:16:052
1915831994235,4cyclictest1002-21mta-sts-daemon10:29:572
1915831994234,5cyclictest1951877-21diskmemload09:36:152
1915831994221,4cyclictest1932571-21latency_hist08:05:022
1915830994230,8cyclictest420-21avahi-daemon09:57:201
191583099422,32cyclictest2008085-21ssh10:41:031
1915829994234,4cyclictest0-21swapper/011:15:560
1915829994233,5cyclictest2001546-21fschecks_time10:30:540
1915831994133,4cyclictest2031240-21kworker/u8:7-xprtiod11:41:122
1915830994131,6cyclictest420-21avahi-daemon11:08:261
191583099412,30cyclictest2005065-21ssh10:36:051
1915829994135,4cyclictest12650irq/32-eth009:14:050
1915829994135,4cyclictest12650irq/32-eth009:14:050
1915829994130,8cyclictest151ktimers/010:10:580
1915831994031,6cyclictest2029576-21sh11:16:102
1915831994031,6cyclictest2004384-21aten_r2power_po10:35:512
1915829994030,8cyclictest2010672-21sh10:45:550
1915829994026,8cyclictest1951877-21diskmemload09:46:050
1915829994026,10cyclictest12650irq/32-eth009:50:590
191582999401,28cyclictest1968424-21sh09:36:040
1915829994012,18cyclictest2008039-21ssh10:41:010
1915831993933,2cyclictest0-21swapper/209:56:072
191583099393,31cyclictest2017174-21ssh10:56:021
1915830993931,5cyclictest2019632-21aten_r2power_po11:00:501
191583099392,31cyclictest2074974-21ssh12:31:021
191583099392,29cyclictest1968406-21sshd09:36:021
1915830993830,5cyclictest421-21dbus-daemon10:25:021
1915830993826,6cyclictest0-21swapper/110:01:011
191583099382,31cyclictest2044646-21ssh11:41:031
1915829993828,7cyclictest2064687-21cron12:15:010
191582999382,28cyclictest2014199-21ssh10:51:060
191582999381,29cyclictest1980575-21ssh09:55:590
1915831993727,5cyclictest0-21swapper/211:06:132
1915830993726,7cyclictest1121621-21cups-browsed11:12:161
191583099372,28cyclictest627-21lldpd08:31:051
1915830993712,17cyclictest421-21dbus-daemon12:16:001
1915830993710,6cyclictest171rcu_preempt09:06:011
1915830993710,6cyclictest171rcu_preempt09:06:011
1915829993731,3cyclictest0-21swapper/011:26:040
1915829993728,6cyclictest2055579-21systemd-run12:00:010
1915829993728,6cyclictest1121621-21cups-browsed11:24:030
1915829993723,11cyclictest1916350-21fschecks_time07:10:520
1915829993719,8cyclictest1948260-21ntpq08:56:010
191583199364,26cyclictest2056963-21ssh12:01:072
1915831993631,2cyclictest0-21swapper/207:40:012
1915831993628,5cyclictest2047923-21switchtime11:46:102
1915831993628,5cyclictest1915852-21latency_hist07:10:022
1915831993627,5cyclictest1003-21mta-sts-daemon11:56:042
1915830993629,3cyclictest0-21swapper/108:36:051
1915830993627,5cyclictest2061645-21cron12:10:001
1915830993625,7cyclictest1989935-21proc_pri10:11:061
191583099362,29cyclictest2056783-21ssh12:01:021
1915830993618,13cyclictest2032789-21grep11:21:111
1915829993631,3cyclictest1950362-21kworker/u8:9-xprtiod11:00:010
1915829993625,8cyclictest1923323-21munin-plugin-st07:35:020
1915829993610,8cyclictest1986551-21memory10:05:560
1915829993610,18cyclictest0-21swapper/007:56:040
1915831993527,5cyclictest1003-21mta-sts-daemon10:24:572
1915831993527,5cyclictest1001-21mta-sts-daemon10:19:362
1915831993522,10cyclictest2034963-21cpu11:25:532
1915830993527,5cyclictest2051183-21unixbench_multi11:51:121
1915830993527,5cyclictest2051183-21unixbench_multi11:51:121
1915830993526,6cyclictest2014352-21systemctl10:51:101
1915830993526,6cyclictest0-21swapper/109:00:001
1915829993514,17cyclictest2026401-21ld11:11:040
1915831993426,5cyclictest1977706-21ssh09:51:062
1915831993426,4cyclictest0-21swapper/211:50:562
1915831993426,4cyclictest0-21swapper/211:50:562
191583199341,25cyclictest1959204-21ssh09:20:592
191583099343,24cyclictest2071948-21ssh12:26:001
1915830993429,2cyclictest0-21swapper/110:20:011
1915830993427,3cyclictest0-21swapper/108:20:021
1915830993425,6cyclictest1947312-21unixbench_singl08:51:121
1915830993425,4cyclictest0-21swapper/109:46:011
191582999349,13cyclictest1940176-21aten_r2power_en08:30:500
1915829993428,4cyclictest2079894-21munin-plugin-st12:40:010
1915829993427,4cyclictest1962272-21ntp_kernel_err09:26:000
1915829993425,6cyclictest151ktimers/012:16:020
191582999342,27cyclictest566-21gmain10:36:060
1915829993422,7cyclictest1925861-21ntpq07:41:060
1915829993420,8cyclictest1945349-21ntpq08:46:060
1915831993325,5cyclictest0-21swapper/210:50:002
191583199332,21cyclictest1986764-21ssh10:06:022
1915830993325,4cyclictest0-21swapper/108:00:021
1915830993324,6cyclictest420-21avahi-daemon09:25:561
1915830993323,7cyclictest1999164-21mailstats10:26:091
191582999333,20cyclictest1983894-21ssh10:01:080
1915829993328,3cyclictest2037315-21kworker/u8:15-rpciod11:55:010
1915829993328,3cyclictest2037315-21kworker/u8:15-rpciod11:55:010
1915829993328,2cyclictest0-21swapper/008:45:010
1915829993327,4cyclictest1973353-21systemd-run09:45:010
1915829993327,4cyclictest1924857-21cron07:40:010
1915829993326,5cyclictest1002-21mta-sts-daemon12:28:290
1915831993226,3cyclictest0-21swapper/208:40:012
1915831993225,3cyclictest0-21swapper/211:30:512
1915831993224,5cyclictest1002-21mta-sts-daemon12:32:072
1915831993224,4cyclictest0-21swapper/210:31:132
1915831993223,6cyclictest1121621-21cups-browsed12:37:502
1915831993222,4cyclictest0-21swapper/210:51:002
191583199322,22cyclictest2041619-21ssh11:36:072
1915831993220,8cyclictest1990260-21timerwakeupswit10:11:112
1915831993219,9cyclictest2072321-21switchtime12:26:122
1915831993212,15cyclictest351ktimers/207:41:032
1915830993227,3cyclictest0-21swapper/112:40:011
1915830993215,11cyclictest421-21dbus-daemon11:46:581
1915830993214,12cyclictest2035092-21/usr/sbin/munin11:25:551
191582999329,8cyclictest1999034-21/usr/sbin/munin10:26:070
191582999324,23cyclictest1965374-21sshd09:31:010
1915829993225,4cyclictest420-21avahi-daemon09:16:000
1915829993224,5cyclictest1920877-21gltestperf07:25:530
1915829993221,7cyclictest1931744-21ntpq08:00:590
1915829993221,5cyclictest1959179-21ntpq09:20:580
1915829993220,8cyclictest2074981-21ntpq12:31:020
1915830993125,3cyclictest0-21swapper/109:45:011
1915830993124,5cyclictest2029946-21unixbench_singl11:16:141
1915830993124,4cyclictest1003-21mta-sts-daemon11:34:211
191583099312,21cyclictest2041514-21ssh11:36:041
1915830993120,5cyclictest1001-21mta-sts-daemon11:56:001
1915830993118,9cyclictest1929364-21munin-plugin-st07:55:011
1915829993126,3cyclictest0-21swapper/010:25:010
1915829993123,6cyclictest2037986-21cpu11:30:520
1915829993122,5cyclictest1002-21mta-sts-daemon09:00:520
1915829993122,5cyclictest1002-21mta-sts-daemon09:00:520
1915829993122,4cyclictest1936214-21ntpq08:15:580
1915829993120,7cyclictest1942293-21ntpq08:36:030
1915829993120,7cyclictest1918215-21ntpq07:16:000
1915829993119,7cyclictest1919720-21ntpq07:21:000
1915829993118,8cyclictest1934765-21ntpq08:11:000
1915831993023,4cyclictest1975075-21grep09:46:122
1915830993024,3cyclictest1003-21mta-sts-daemon12:11:061
1915830993024,3cyclictest0-21swapper/107:45:011
1915830993022,5cyclictest2069528-21unixbench_singl12:21:121
191583099302,21cyclictest1121621-21cups-browsed10:46:011
1915829993024,4cyclictest1994885-21latency_hist10:20:030
1915829993017,9cyclictest1937835-21ntpq08:21:020
1915829993013,14cyclictest2019853-21/usr/sbin/munin11:00:540
1915831992922,3cyclictest0-21swapper/209:45:012
1915831992921,5cyclictest1927802-21unixbench_singl07:46:102
1915831992921,5cyclictest1927802-21unixbench_singl07:46:102
1915831992919,7cyclictest2032286-21missed_timers11:20:572
1915831992912,14cyclictest1962388-21diskmemload09:26:052
1915830992922,4cyclictest1935370-21munin-run08:15:011
1915829992919,7cyclictest1928761-21ntpq07:51:000
1915829992916,8cyclictest1946775-21ntpq08:51:020
191583199284,15cyclictest428-21mta-sts-daemon09:00:582
191583199284,15cyclictest428-21mta-sts-daemon09:00:582
1915831992822,3cyclictest0-21swapper/212:20:592
191583199282,22cyclictest421-21dbus-daemon07:55:592
1915831992821,4cyclictest2063293-21timerwakeupswit12:11:122
1915831992821,4cyclictest1935257-21unixbench_multi08:11:102
1915831992820,5cyclictest487-21rs:main2
1915831992820,5cyclictest487-21rs:main2
1915831992820,5cyclictest1948799-21unixbench_singl08:56:122
1915831992820,5cyclictest1938380-21idleruntime-cro08:25:012
1915830992820,5cyclictest1944375-21cron08:45:011
1915830992817,8cyclictest1918616-21timerwakeupswit07:16:101
1915829992823,2cyclictest0-21swapper/011:45:030
1915829992818,7cyclictest2046924-21aten_r2power_cu11:45:490
1915831992719,5cyclictest1939877-21munin-plugin-st08:30:012
1915831992719,5cyclictest1921959-21latency_hist07:30:022
1915830992721,3cyclictest0-21swapper/108:05:001
1915830992719,5cyclictest1945601-21timerandwakeup08:46:141
191583099271,19cyclictest1121621-21cups-browsed09:00:581
191583099271,19cyclictest1121621-21cups-browsed09:00:581
1915831992620,3cyclictest0-21swapper/208:40:532
1915831992615,8cyclictest1941519-21latency_hist08:35:022
1915830992619,4cyclictest1923320-21sh07:35:011
1915831992520,2cyclictest0-21swapper/207:30:552
1915831992519,3cyclictest0-21swapper/208:55:002
1915830992519,3cyclictest0-21swapper/108:25:011
191583199243,13cyclictest428-21mta-sts-daemon08:16:022
1915831992417,4cyclictest1916469-21kernelversion07:10:542
1915830992412,8cyclictest421-21dbus-daemon07:25:011
1915830992316,4cyclictest0-21swapper/107:46:011
1915830992316,4cyclictest0-21swapper/107:46:011
1915830992316,3cyclictest0-21swapper/107:15:011
1915830992315,5cyclictest1915845-21systemd07:10:021
1915830992315,5cyclictest1121621-21cups-browsed08:27:231
1915831992216,3cyclictest0-21swapper/208:10:012
191583099222,15cyclictest1921200-21ntpq07:25:581
191583299203,7cyclictest0-21swapper/309:55:593
191582999208,9cyclictest0-21swapper/007:10:010
191583299183,7cyclictest0-21swapper/312:11:023
191583299174,5cyclictest0-21swapper/311:15:593
191583299173,7cyclictest0-21swapper/310:41:013
191583299173,6cyclictest0-21swapper/312:21:023
191583299172,9cyclictest0-21swapper/309:14:073
191583299172,9cyclictest0-21swapper/309:14:073
191583299165,6cyclictest0-21swapper/311:01:063
191583299163,7cyclictest0-21swapper/311:30:593
191583299163,7cyclictest0-21swapper/311:21:003
191583299162,7cyclictest0-21swapper/311:26:023
191583299162,7cyclictest0-21swapper/310:01:023
191583299162,7cyclictest0-21swapper/309:31:013
191583299161,9cyclictest0-21swapper/309:26:013
191583299161,8cyclictest0-21swapper/307:31:043
191583299161,7cyclictest0-21swapper/309:06:023
191583299161,7cyclictest0-21swapper/309:06:023
191583299156,5cyclictest0-21swapper/312:15:593
191583299156,5cyclictest0-21swapper/309:49:483
191583299154,6cyclictest0-21swapper/310:21:003
191583299154,6cyclictest0-21swapper/310:06:023
191583299154,6cyclictest0-21swapper/308:20:013
191583299153,8cyclictest0-21swapper/309:16:003
191583299153,7cyclictest0-21swapper/310:46:003
191583299153,7cyclictest0-21swapper/309:21:043
191583299152,8cyclictest0-21swapper/312:26:033
191583299152,8cyclictest0-21swapper/312:00:593
191583299152,8cyclictest0-21swapper/311:45:593
191583299152,8cyclictest0-21swapper/310:36:073
191583299152,7cyclictest0-21swapper/312:05:593
191583299152,7cyclictest0-21swapper/310:15:593
191583299152,7cyclictest0-21swapper/310:10:593
191583299152,6cyclictest0-21swapper/308:55:593
191583299152,6cyclictest0-21swapper/307:36:013
191583299151,8cyclictest0-21swapper/312:31:073
191583299151,8cyclictest0-21swapper/309:41:093
191583299151,7cyclictest0-21swapper/310:56:063
191583299151,7cyclictest0-21swapper/307:41:043
191583299151,7cyclictest0-21swapper/307:11:003
191583299151,6cyclictest0-21swapper/307:21:033
191583299145,5cyclictest0-21swapper/308:41:043
191583299142,6cyclictest0-21swapper/308:21:063
191583299141,8cyclictest0-21swapper/311:56:073
191583299141,6cyclictest0-21swapper/308:36:023
191583299141,6cyclictest0-21swapper/307:46:033
191583299141,6cyclictest0-21swapper/307:46:033
191583299141,6cyclictest0-21swapper/307:26:043
191583299137,4cyclictest0-21swapper/311:51:033
191583299137,4cyclictest0-21swapper/311:51:033
191583299137,4cyclictest0-21swapper/311:06:013
191583299137,4cyclictest0-21swapper/308:30:303
191583299136,4cyclictest0-21swapper/311:10:493
191583299136,4cyclictest0-21swapper/310:26:033
191583299136,4cyclictest0-21swapper/309:50:313
191583299132,6cyclictest0-21swapper/310:51:003
191583299132,6cyclictest0-21swapper/308:55:003
191583299131,7cyclictest0-21swapper/308:10:573
191583299131,6cyclictest0-21swapper/308:46:013
191583299131,6cyclictest0-21swapper/307:55:593
191583299127,3cyclictest0-21swapper/311:35:193
191583299127,3cyclictest0-21swapper/307:50:393
191583299126,4cyclictest0-21swapper/308:06:053
191583299125,4cyclictest0-21swapper/309:04:153
191583299125,4cyclictest0-21swapper/309:04:153
191583299122,6cyclictest0-21swapper/310:31:003
191583299121,7cyclictest0-21swapper/312:35:193
191583299116,3cyclictest0-21swapper/311:40:593
191583299116,3cyclictest0-21swapper/308:00:533
191583299116,3cyclictest0-21swapper/307:10:023
191583299115,4cyclictest0-21swapper/308:25:533
191583299112,6cyclictest0-21swapper/307:15:593
191583299112,5cyclictest0-21swapper/309:35:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional