You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 02:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Tue Aug 18, 2026 00:43:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
174378699633,49cyclictest1903199-21ssh00:30:560
1743787995750,3cyclictest0-21swapper/123:40:001
1743788994932,11cyclictest14482-21cups-browsed20:51:052
1743788994932,11cyclictest14482-21cups-browsed20:51:052
1743787994940,6cyclictest421-21dbus-daemon21:30:011
174378699482,36cyclictest1805523-21ssh21:50:570
174378899471,35cyclictest0-21swapper/222:11:012
1743788994635,5cyclictest0-21swapper/222:50:592
1743788994622,21cyclictest0-21swapper/222:00:592
174378899453,37cyclictest1854415-21ntpq23:11:002
1743788994527,14cyclictest1822713-21sh22:20:012
1743788994527,14cyclictest1822713-21sh22:20:012
174378899451,39cyclictest1885832-21ssh00:01:492
1743787994534,7cyclictest421-21dbus-daemon22:35:011
1743787994534,7cyclictest421-21dbus-daemon22:35:011
174378699452,35cyclictest151ktimers/022:31:030
174378699452,35cyclictest151ktimers/022:31:030
1743787994433,4cyclictest0-21swapper/121:16:071
1743786994436,5cyclictest1878826-21sh23:50:580
1743786994435,4cyclictest0-21swapper/021:46:040
1743788994333,6cyclictest0-21swapper/200:40:012
1743788994320,20cyclictest1748278-21cron19:25:012
174378899431,35cyclictest1753637-21ntpq19:40:562
174378899431,35cyclictest1753637-21ntpq19:40:562
174378899431,34cyclictest1762628-21ntpq20:11:002
1743787994334,3cyclictest0-21swapper/120:20:581
174378899423,34cyclictest1851386-21ssh23:05:572
1743788994230,9cyclictest1891002-21needreboot00:10:562
1743788994230,7cyclictest14482-21cups-browsed23:15:422
1743788994225,14cyclictest1783615-21sh21:15:522
1743788994222,17cyclictest0-21swapper/222:21:092
1743788994222,17cyclictest0-21swapper/222:21:092
174378899421,37cyclictest0-21swapper/222:45:592
174378899421,35cyclictest1773152-21ntpq20:45:582
1743787994234,5cyclictest1764827-21latency_hist20:20:021
1743787994234,5cyclictest1746825-21latency_hist19:20:021
1743787994233,6cyclictest1799432-21ntp_kernel_pll_21:40:591
174378899413,34cyclictest1836123-21ntpq22:40:592
1743788994132,5cyclictest1780574-21ssh21:10:482
1743788994131,6cyclictest14482-21cups-browsed22:39:432
174378899412,34cyclictest1764143-21ntpq20:16:022
1743788994122,16cyclictest1894456-21ssh00:16:112
1743788994118,20cyclictest420-21avahi-daemon00:20:432
174378899411,36cyclictest1787214-21ntpq21:21:022
174378899411,35cyclictest1902889-21/usr/sbin/munin00:30:512
174378899411,35cyclictest1869806-21ntpq23:36:042
174378899411,34cyclictest1756653-21ntpq19:50:592
1743786994132,6cyclictest0-21swapper/000:16:070
1743788994031,6cyclictest1861153-21unixbench_singl23:21:152
1743788994031,6cyclictest1861153-21unixbench_singl23:21:152
174378899401,35cyclictest1744617-21ntpq19:10:562
174378899401,34cyclictest1768753-21ntpq20:31:032
174378899401,34cyclictest1759728-21ntpq20:01:012
174378899401,33cyclictest1881143-21ssh23:55:392
174378899401,33cyclictest1749170-21ntpq19:25:592
1743787994032,5cyclictest1848377-21ntp_kernel_pll_23:01:001
1743787994031,6cyclictest421-21dbus-daemon00:35:011
1743787994031,6cyclictest1888084-21ntp_kernel_pll_00:06:021
1743787994031,6cyclictest1851561-21ssh23:06:041
1743787994031,6cyclictest1775299-21systemd-run20:55:011
1743787994031,6cyclictest1775299-21systemd-run20:55:011
1743787994031,5cyclictest1802084-21fschecks_count21:45:521
1743787994028,8cyclictest1805794-21mailstats21:51:051
1743786994034,4cyclictest1814998-21mailstats22:06:060
1743786994032,5cyclictest1900793-21unixbench_multi00:26:130
1743786994030,7cyclictest1784326-21mailstats21:16:100
174378899398,26cyclictest1765288-21diskstats20:20:522
174378899392,33cyclictest1776155-21ntpq20:55:592
174378899392,33cyclictest1776155-21ntpq20:55:592
174378899392,33cyclictest1746120-21ntpq19:15:562
174378899391,35cyclictest1802520-21ntpq21:46:002
174378899391,34cyclictest1790327-21ntpq21:26:052
174378899391,33cyclictest1900316-21ntpq00:26:052
174378899391,33cyclictest1827060-21ntpq22:26:032
174378899391,33cyclictest1827060-21ntpq22:26:032
174378899391,33cyclictest1758222-21ntpq19:56:032
174378899391,32cyclictest1752157-21ntpq19:35:582
174378899391,32cyclictest1752157-21ntpq19:35:582
174378799393,26cyclictest1814739-21ssh22:05:581
1743787993930,6cyclictest1760303-21systemd-run20:05:011
1743787993930,4cyclictest0-21swapper/123:26:041
1743787993930,4cyclictest0-21swapper/123:26:041
1743786993927,9cyclictest1776759-21cron21:00:000
1743786993927,9cyclictest1776759-21cron21:00:000
1743788993830,5cyclictest1801326-21systemd-run21:45:012
1743788993822,14cyclictest0-21swapper/223:00:012
1743788993818,17cyclictest1003-21mta-sts-daemon23:54:092
1743788993817,18cyclictest0-21swapper/221:35:562
174378899381,34cyclictest1777928-21/usr/sbin/munin21:01:102
174378899381,34cyclictest1777928-21/usr/sbin/munin21:01:102
174378899381,34cyclictest1761126-21ntpq20:05:552
174378899381,34cyclictest1751047-21timerwakeupswit19:31:082
174378899381,33cyclictest1767259-21ntpq20:26:042
174378899381,33cyclictest1754506-21/usr/sbin/munin19:46:102
174378899381,31cyclictest14478-21cupsd21:05:342
174378899381,31cyclictest14478-21cupsd21:05:342
174378899380,34cyclictest1815396-21ssh22:06:112
1743787993831,3cyclictest0-21swapper/121:40:011
1743786993832,3cyclictest0-21swapper/022:55:010
1743786993830,6cyclictest1837997-21ssh22:45:010
1743786993826,8cyclictest151ktimers/021:26:020
1743786993825,10cyclictest1859359-21grep23:20:010
174378899371,32cyclictest1770221-21ntpq20:36:002
174378899371,31cyclictest1829960-21ntpq22:30:572
174378899371,31cyclictest1829960-21ntpq22:30:572
174378899371,29cyclictest1872745-21ssh23:40:572
174378899371,25cyclictest1848438-21ntpq23:01:022
174378799373,26cyclictest1833172-21ssh22:36:031
1743787993729,5cyclictest1828825-21munin-plugin-st22:30:001
1743787993729,5cyclictest1828825-21munin-plugin-st22:30:001
1743787993729,5cyclictest1821333-21timerwakeupswit22:16:131
1743787993729,5cyclictest1821333-21timerwakeupswit22:16:131
1743787993729,5cyclictest1782860-21ssh21:15:001
1743787993723,8cyclictest0-21swapper/121:30:581
1743787993717,16cyclictest271ktimers/123:31:011
1743787993717,16cyclictest271ktimers/123:31:011
1743786993730,4cyclictest1876273-21timerwakeupswit23:46:090
1743786993730,4cyclictest1755797-21systemd-run19:50:010
174378699372,29cyclictest1827052-21ssh22:26:030
174378699372,29cyclictest1827052-21ssh22:26:030
1743786993720,14cyclictest151ktimers/021:20:590
174378899363,28cyclictest1808603-21ntpq21:56:012
174378899363,27cyclictest1805530-21ntpq21:50:572
174378899361,31cyclictest1771649-21ntpq20:40:582
174378899361,30cyclictest1875509-21interrupts23:45:522
174378899361,30cyclictest1793276-21ntpq21:30:572
1743786993629,5cyclictest1001-21mta-sts-daemon20:25:580
1743786993628,5cyclictest420-21avahi-daemon19:10:020
174378899351,30cyclictest1862777-21ssh23:25:282
174378899351,30cyclictest1862777-21ssh23:25:282
174378899351,29cyclictest1866730-21ntpq23:31:032
174378899351,29cyclictest1866730-21ntpq23:31:032
1743787993528,4cyclictest1876405-21unixbench_singl23:46:091
1743787993527,5cyclictest1778161-21unixbench_multi21:01:111
1743787993527,5cyclictest1778161-21unixbench_multi21:01:111
1743787993524,7cyclictest1879079-21mailstats23:51:051
174378799352,24cyclictest1811644-21ssh22:00:591
1743786993527,3cyclictest0-21swapper/019:30:570
174378899344,22cyclictest428-21mta-sts-daemon00:05:062
1743787993427,3cyclictest0-21swapper/121:55:551
1743787993427,3cyclictest0-21swapper/100:30:011
1743787993426,5cyclictest1891318-21mailstats00:11:061
1743786993427,4cyclictest0-21swapper/021:35:590
1743786993426,5cyclictest420-21avahi-daemon20:01:050
1743786993424,8cyclictest1771598-21needreboot20:40:560
174378699341,18cyclictest1866618-21sh23:30:580
174378699341,18cyclictest1866618-21sh23:30:580
174378899331,29cyclictest1743799-21munin-run19:10:012
174378799333,23cyclictest1906306-21ssh00:36:011
1743787993326,4cyclictest1825812-21latency_hist22:25:011
1743787993326,4cyclictest1825812-21latency_hist22:25:011
1743787993325,5cyclictest1874615-21cron23:45:011
1743787993325,5cyclictest1001-21mta-sts-daemon22:10:111
174378699337,16cyclictest1003-21mta-sts-daemon23:35:570
174378699332,25cyclictest665-21snmpd21:11:000
174378699332,25cyclictest1863699-21ssh23:26:050
174378699332,25cyclictest1863699-21ssh23:26:050
1743786993316,11cyclictest1808652-21ssh21:56:040
174378699331,4cyclictest0-21swapper/023:40:560
174378699330,31cyclictest0-21swapper/019:35:580
174378699330,31cyclictest0-21swapper/019:35:580
174378799324,17cyclictest428-21mta-sts-daemon19:35:581
174378799324,17cyclictest428-21mta-sts-daemon19:35:581
1743787993225,4cyclictest1893908-21cat00:15:561
1743787993225,4cyclictest1773782-21munin-plugin-st20:50:011
1743787993225,3cyclictest0-21swapper/119:10:581
1743787993224,5cyclictest1856296-21cron23:15:011
1743787993223,6cyclictest1884871-21missed_timers00:00:531
1743787993222,7cyclictest1768926-21switchtime20:31:081
174378799322,25cyclictest1787222-21ssh21:21:021
174378699326,22cyclictest665-21snmpd21:05:590
174378699326,22cyclictest665-21snmpd21:05:590
1743786993226,4cyclictest1888220-21sh00:06:070
1743786993226,4cyclictest1834921-21latency_hist22:40:000
1743786993218,11cyclictest1766164-21tail20:21:110
1743787993124,4cyclictest1896683-21aten_r2power_vo00:20:511
1743787993123,5cyclictest750-21ntpd19:20:481
1743787993123,5cyclictest1779788-21cut21:10:001
1743787993123,5cyclictest1779788-21cut21:10:001
1743787993123,5cyclictest1726569-21kworker/u8:16+xprtiod20:00:011
1743787993121,7cyclictest1845059-21latency22:55:531
1743786993126,3cyclictest1884580-21grep00:00:500
1743786993123,6cyclictest485-21in:imuxsock23:15:010
1743786993123,4cyclictest0-21swapper/022:04:460
174378699312,24cyclictest1860695-21ssh23:21:090
174378699312,24cyclictest1860695-21ssh23:21:090
1743786993121,7cyclictest1845044-21latency22:55:530
1743786993120,4cyclictest1745160-21unixbench_multi19:11:100
174378799304,21cyclictest1002-21mta-sts-daemon20:40:581
1743787993023,3cyclictest0-21swapper/123:55:581
1743786993024,3cyclictest1000-21mta-sts-daemon22:20:100
1743786993024,3cyclictest1000-21mta-sts-daemon22:20:100
1743786993023,5cyclictest1761092-21needreboot20:05:540
1743786993022,5cyclictest12650irq/32-eth000:36:030
174378699302,23cyclictest665-21snmpd21:31:040
174378699302,22cyclictest1891050-21ssh00:10:570
1743787992923,3cyclictest0-21swapper/123:16:011
1743787992923,3cyclictest0-21swapper/122:51:051
1743787992921,5cyclictest1769914-21kernelversion20:35:531
1743787992920,6cyclictest420-21avahi-daemon23:23:491
1743787992920,6cyclictest420-21avahi-daemon23:23:491
1743787992918,6cyclictest14482-21cups-browsed19:40:581
1743787992918,6cyclictest14482-21cups-browsed19:40:581
1743786992925,2cyclictest0-21swapper/022:15:020
1743786992923,4cyclictest1847191-21kworker/u8:0-xprtiod23:55:590
1743786992923,4cyclictest1821347-21ssh22:16:130
1743786992923,4cyclictest1821347-21ssh22:16:130
1743787992822,3cyclictest0-21swapper/122:45:481
1743786992823,3cyclictest1848040-21if_wlan023:00:530
1743786992823,3cyclictest1743785-21cyclictest22:46:290
1743786992823,3cyclictest0-21swapper/020:36:090
1743786992822,3cyclictest0-21swapper/000:21:050
1743786992818,7cyclictest12650irq/32-eth019:20:560
1743787992720,5cyclictest1749795-21systemd-run19:30:011
1743787992720,4cyclictest1-21systemd20:15:021
1743786992714,11cyclictest0-21swapper/020:50:500
1743786992714,11cyclictest0-21swapper/020:50:500
1743786992714,10cyclictest265-21systemd-journal23:08:580
174378699271,21cyclictest1799475-21ntpq21:41:010
1743786992711,12cyclictest151ktimers/020:46:010
1743787992620,3cyclictest0-21swapper/120:55:521
1743787992620,3cyclictest0-21swapper/120:55:521
1743787992619,4cyclictest1751266-21cron19:35:001
1743787992619,4cyclictest1001-21mta-sts-daemon20:05:491
1743787992616,7cyclictest1836082-21ssh22:40:571
174378699264,13cyclictest1002-21mta-sts-daemon19:15:560
1743786992620,4cyclictest1764051-21missed_timers20:15:590
1743786992519,4cyclictest0-21swapper/020:35:010
174378799241,18cyclictest265-21systemd-journal19:50:591
1743786992414,4cyclictest1776912-21kworker/u8:17-xprtiod21:01:110
1743786992414,4cyclictest1776912-21kworker/u8:17-xprtiod21:01:110
1743786992413,8cyclictest1757295-21systemd19:55:020
1743786992311,9cyclictest1753277-21df_inode19:40:500
1743786992311,9cyclictest1753277-21df_inode19:40:500
174378699231,14cyclictest151ktimers/019:25:590
174378699231,11cyclictest1758139-21ntpq19:55:590
174378799222,15cyclictest1755234-21ntp_states19:46:011
1743787992115,3cyclictest0-21swapper/120:27:471
1743786992113,5cyclictest1762619-21ntpq20:11:000
1743787992013,4cyclictest0-21swapper/119:10:011
174378999173,8cyclictest0-21swapper/323:11:063
174378999173,7cyclictest0-21swapper/321:26:053
174378999172,8cyclictest0-21swapper/323:25:593
174378999172,8cyclictest0-21swapper/323:25:593
174378999172,7cyclictest0-21swapper/300:00:593
174378999172,6cyclictest0-21swapper/319:45:583
174378999171,8cyclictest0-21swapper/323:50:573
174378999163,7cyclictest0-21swapper/323:35:573
174378999162,8cyclictest0-21swapper/322:36:003
174378999162,8cyclictest0-21swapper/322:31:053
174378999162,8cyclictest0-21swapper/322:31:053
174378999162,7cyclictest0-21swapper/323:46:043
174378999162,7cyclictest0-21swapper/322:21:053
174378999162,7cyclictest0-21swapper/322:21:053
174378999162,6cyclictest0-21swapper/321:35:583
174378999161,9cyclictest0-21swapper/300:30:563
174378999161,8cyclictest0-21swapper/323:00:593
174378999161,6cyclictest0-21swapper/320:25:593
174378999161,6cyclictest0-21swapper/319:15:563
174378999152,8cyclictest0-21swapper/300:36:033
174378999152,7cyclictest0-21swapper/323:31:013
174378999152,7cyclictest0-21swapper/323:31:013
174378999152,7cyclictest0-21swapper/322:16:053
174378999152,7cyclictest0-21swapper/322:16:053
174378999152,7cyclictest0-21swapper/322:11:033
174378999152,7cyclictest0-21swapper/322:01:023
174378999152,6cyclictest0-21swapper/321:30:553
174378999151,8cyclictest0-21swapper/322:45:573
174378999151,7cyclictest0-21swapper/320:40:583
174378999151,7cyclictest0-21swapper/320:20:573
174378999151,6cyclictest0-21swapper/321:05:593
174378999151,6cyclictest0-21swapper/321:05:593
174378999143,6cyclictest0-21swapper/322:40:583
174378999143,6cyclictest0-21swapper/322:26:023
174378999143,6cyclictest0-21swapper/322:26:023
174378999142,8cyclictest0-21swapper/321:56:013
174378999142,7cyclictest0-21swapper/321:45:583
174378999142,7cyclictest0-21swapper/300:21:033
174378999142,7cyclictest0-21swapper/300:06:023
174378999142,5cyclictest0-21swapper/319:10:563
174378999141,7cyclictest0-21swapper/322:55:583
174378999141,6cyclictest0-21swapper/322:05:583
174378999134,6cyclictest0-21swapper/323:21:023
174378999134,6cyclictest0-21swapper/323:21:023
174378999132,7cyclictest0-21swapper/321:16:023
174378999132,6cyclictest0-21swapper/322:51:053
174378999132,6cyclictest0-21swapper/319:41:003
174378999132,6cyclictest0-21swapper/319:41:003
174378999132,6cyclictest0-21swapper/319:35:583
174378999132,6cyclictest0-21swapper/319:35:583
174378999132,5cyclictest0-21swapper/320:55:583
174378999132,5cyclictest0-21swapper/320:55:583
174378999131,8cyclictest0-21swapper/321:10:553
174378999131,8cyclictest0-21swapper/321:01:003
174378999131,8cyclictest0-21swapper/321:01:003
174378999123,5cyclictest0-21swapper/300:26:013
174378999122,6cyclictest0-21swapper/321:20:583
174378999122,6cyclictest0-21swapper/320:50:593
174378999122,6cyclictest0-21swapper/320:50:593
174378999122,5cyclictest0-21swapper/323:55:223
174378999122,5cyclictest0-21swapper/300:11:053
174378999121,7cyclictest0-21swapper/321:40:493
174378999121,6cyclictest0-21swapper/323:40:563
174378999121,6cyclictest0-21swapper/321:50:473
174378999121,5cyclictest0-21swapper/320:05:553
174378999113,6cyclictest0-21swapper/300:15:463
174378999113,5cyclictest0-21swapper/323:06:093
174378999112,5cyclictest0-21swapper/323:15:463
174378999112,5cyclictest0-21swapper/320:00:573
174378999111,6cyclictest0-21swapper/320:45:573
174378999111,6cyclictest0-21swapper/320:36:003
174378999111,6cyclictest0-21swapper/320:16:083
174378999111,6cyclictest0-21swapper/319:51:003
174378999111,5cyclictest0-21swapper/319:56:003
174378999111,5cyclictest0-21swapper/319:30:493
174378999101,6cyclictest0-21swapper/320:15:013
17437899991,5cyclictest0-21swapper/320:30:523
17437899991,5cyclictest0-21swapper/319:25:533
17437899991,5cyclictest0-21swapper/319:20:543
17437899981,4cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional