You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 03:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Mon Sep 07, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1681151994742,3cyclictest1890050-21apt-get22:30:133
1681143994238,2cyclictest1723141-21kworker/u8:4+flush-259:019:55:261
1681143994032,5cyclictest1728473-21cp19:55:001
1681143993834,3cyclictest2009485-21kworker/u8:3+flush-259:000:30:151
1681143993834,3cyclictest2009485-21kworker/u8:3+flush-259:000:25:171
1681143993834,3cyclictest1733949-21kworker/u8:0+flush-259:020:15:221
1681143993734,2cyclictest1978380-21kworker/u8:4+events_unbound00:10:231
1681143993734,2cyclictest1680661-21kworker/u8:0+flush-259:019:15:151
1681143993733,3cyclictest1967814-21kworker/u8:1+flush-259:023:50:001
1681139993730,5cyclictest1716423-21ntpq19:40:240
1681143993531,3cyclictest1780545-21kworker/u8:1+events_unbound21:40:201
1681143993330,2cyclictest1853199-21kworker/u8:2+flush-259:023:00:251
1681143993329,3cyclictest1780545-21kworker/u8:1+events_unbound21:45:261
1681143993327,4cyclictest1707220-21/usr/sbin/munin19:35:141
1681139993228,3cyclictest1743726-21kworker/u8:1+flush-259:020:25:010
1681139993226,4cyclictest1723141-21kworker/u8:4+flush-259:020:05:130
1681151993125,4cyclictest1837669-21latency_hist21:40:013
1681146993127,3cyclictest335557-21systemd-journal00:18:082
1681143993127,3cyclictest1780545-21kworker/u8:1+flush-259:020:55:211
1681143993127,3cyclictest1780545-21kworker/u8:1+events_unbound21:15:201
1681143993126,3cyclictest1648168-21kworker/u8:3+events_unbound19:30:191
1681139993125,4cyclictest1690606-21ntpq19:15:230
1681143993027,2cyclictest1648168-21kworker/u8:3+flush-259:019:40:161
1681143993026,3cyclictest1853199-21kworker/u8:2+events_unbound22:45:131
1681143993024,4cyclictest1836761-21ntpq21:35:211
1681151992923,4cyclictest1722999-21cat19:50:013
1681143992926,2cyclictest1926104-21kworker/u8:3+events_unbound23:50:171
1681143992926,2cyclictest1926104-21kworker/u8:3+events_unbound23:50:161
1681139992921,5cyclictest2008362-21ntpq00:20:220
1681146992825,2cyclictest335557-21systemd-journal20:51:242
1681143992825,2cyclictest1978380-21kworker/u8:4+events_unbound00:15:271
1681143992825,2cyclictest1853199-21kworker/u8:2+events_unbound22:25:211
1681143992825,2cyclictest1780545-21kworker/u8:1+flush-259:022:35:251
1681143992824,3cyclictest1998724-21kworker/u8:0+events_unbound00:20:071
1681143992824,3cyclictest1780545-21kworker/u8:1+flush-259:021:14:591
1681143992822,4cyclictest1848269-21apt-get21:50:141
1681139992825,2cyclictest1936977-21apt-get23:15:130
1681151992722,4cyclictest1791383-21apt-get20:55:123
1681151992721,4cyclictest1884636-21latency_hist22:25:003
1681143992722,3cyclictest1681331-21/usr/sbin/munin19:10:151
1681139992723,3cyclictest1978380-21kworker/u8:4+flush-259:000:10:180
1681139992722,3cyclictest1952495-21/usr/sbin/munin23:30:150
1681139992721,4cyclictest1978581-21diskstats23:55:150
1681139992721,4cyclictest1733949-21kworker/u8:0+flush-259:020:15:110
1681151992620,4cyclictest1868688-21latency_hist22:10:013
1681146992621,3cyclictest335557-21systemd-journal23:46:482
1681146992621,3cyclictest1910760-21apt-get22:50:152
1681143992623,2cyclictest1926104-21kworker/u8:3+flush-259:023:30:151
1681143992623,2cyclictest1780545-21kworker/u8:1+flush-259:023:15:211
1681143992622,4cyclictest1780545-21kworker/u8:1+flush-259:022:40:271
1681143992622,3cyclictest1853199-21kworker/u8:2+flush-259:022:00:001
1681143992622,3cyclictest1780545-21kworker/u8:1+events_unbound23:05:201
1681143992621,3cyclictest1853199-21kworker/u8:2+events_unbound22:50:211
1681143992611,7cyclictest1967799-21munin-run23:44:591
1681146992519,4cyclictest1847094-21ntpq21:45:222
1681143992522,2cyclictest1733949-21kworker/u8:0+events_unbound21:00:211
1681143992521,3cyclictest1936750-21kworker/u8:2+flush-259:023:35:181
1681143992520,3cyclictest335557-21systemd-journal20:46:071
1681139992519,4cyclictest1795431-21ntpq20:55:220
1681146992419,4cyclictest1744084-21kworker/u8:5+flush-259:021:10:142
1681146992417,5cyclictest1947056-21latency_hist23:25:012
1681143992421,2cyclictest1853199-21kworker/u8:2+events_unbound22:20:231
1681143992421,2cyclictest1743726-21kworker/u8:1+flush-259:020:10:271
1681143992421,2cyclictest1723141-21kworker/u8:4+events_unbound20:00:231
1681143992419,4cyclictest1733949-21kworker/u8:0+events_unbound20:28:081
1681139992419,3cyclictest1926104-21kworker/u8:3+flush-259:023:45:000
1681139992417,5cyclictest1805792-21ntpq21:05:210
1681151992316,5cyclictest335557-21systemd-journal00:35:003
1681146992319,3cyclictest1780545-21kworker/u8:1+flush-259:021:44:592
1681146992317,4cyclictest1832478-21latency_hist21:35:012
1681143992320,2cyclictest1946744-21kworker/u8:0+events_unbound23:25:181
1681143992318,3cyclictest1926104-21kworker/u8:3+flush-259:023:10:211
1681143992317,4cyclictest335557-21systemd-journal00:00:071
1681139992318,3cyclictest1723178-21apt-get19:50:110
1681143992219,2cyclictest1926104-21kworker/u8:3+events_unbound23:55:181
1681143992219,2cyclictest1743726-21kworker/u8:1+flush-259:020:20:221
1681143992216,4cyclictest2024992-21cp00:40:011
1681143992216,4cyclictest1743137-21ntpq20:05:211
1681146992115,4cyclictest1853443-21apt-get21:55:122
1681143992117,3cyclictest1873889-21gpgv22:15:011
1681143992117,3cyclictest1780545-21kworker/u8:1+events_unbound22:31:431
1681143992116,3cyclictest1790724-21gpgv20:55:001
1681139992115,4cyclictest335557-21systemd-journal19:50:000
1681151992014,4cyclictest1785492-21latency_hist20:50:013
168115199200,11cyclictest1863290-21taskset22:02:293
1681146992016,3cyclictest1744084-21kworker/u8:5+flush-259:020:45:012
1681146992016,3cyclictest1648168-21kworker/u8:3+flush-259:020:00:002
1681143992017,2cyclictest1926104-21kworker/u8:3+flush-259:000:05:211
1681143992017,2cyclictest1853199-21kworker/u8:2+flush-259:022:55:161
1681143992016,3cyclictest1796285-21kworker/u8:2+events_unbound21:25:171
1681143992016,3cyclictest1780545-21kworker/u8:1+events_unbound22:16:421
1681139992014,4cyclictest1888903-21ntpq22:25:210
1681151991916,2cyclictest1723141-21kworker/u8:4+flush-259:020:05:013
1681151991915,3cyclictest1780545-21kworker/u8:1+flush-259:022:35:173
1681146991913,4cyclictest1899223-21ntpq22:35:212
1681146991913,4cyclictest1858593-21/usr/sbin/munin22:00:132
1681143991916,2cyclictest490-21dbus-daemon21:30:271
1681143991916,2cyclictest1847706-21kworker/u8:0+events_unbound22:05:221
1681143991914,3cyclictest509-21rs:main1
1681139991915,3cyclictest1796285-21kworker/u8:2+flush-259:021:25:280
1681139991915,3cyclictest1632452-21kworker/u8:2+flush-259:019:25:000
1681139991915,3cyclictest1632452-21kworker/u8:2+flush-259:019:25:000
1681139991914,4cyclictest1847706-21kworker/u8:0+flush-259:022:05:170
168115199189,8cyclictest1806231-21unixbench_singl21:05:263
1681151991813,4cyclictest1790683-21apt-get20:55:013
1681146991813,3cyclictest1946744-21kworker/u8:0+flush-259:023:40:002
1681146991812,4cyclictest1827287-21latency_hist21:30:002
1681143991816,2cyclictest1632452-21kworker/u8:2+flush-259:019:20:181
1681143991816,2cyclictest1632452-21kworker/u8:2+flush-259:019:20:171
1681143991815,2cyclictest1680661-21kworker/u8:0+events_unbound19:25:131
1681143991815,2cyclictest1648168-21kworker/u8:3+events_unbound19:48:071
1681143991814,3cyclictest1847706-21kworker/u8:0+events_unbound22:00:081
1681139991814,3cyclictest1978380-21kworker/u8:4+events_unbound00:00:190
1681139991813,3cyclictest1847706-21kworker/u8:0+flush-259:021:55:250
1681139991813,3cyclictest1780545-21kworker/u8:1+flush-259:021:49:590
1681139991811,5cyclictest335557-21systemd-journal22:02:060
168115199174,11cyclictest2020369-21sed00:35:183
168115199170,9cyclictest2014395-21taskset00:29:383
168115199170,9cyclictest1811671-21taskset21:13:313
168115199170,15cyclictest1915674-21cat22:55:003
1681146991714,2cyclictest0-21swapper/222:20:012
1681146991710,5cyclictest335557-21systemd-journal19:54:062
1681143991714,2cyclictest1764837-21kworker/u8:2+flush-259:020:40:161
1681143991713,3cyclictest1733949-21kworker/u8:0+events_unbound20:35:091
1681139991714,2cyclictest60350irq/132-enp0s29f1:rx-019:36:480
1681139991713,3cyclictest1764838-21kworker/u8:3+flush-259:020:35:270
1681139991712,4cyclictest1868956-21apt-get22:10:150
1681151991614,1cyclictest0-21swapper/319:50:013
1681151991613,2cyclictest1770661-21irqcore20:35:163
168115199161,2cyclictest1941042-21ntpq23:15:243
168115199160,8cyclictest1712007-21taskset19:38:393
168115199160,14cyclictest1800975-21grep21:00:263
168115199160,13cyclictest1853575-21tr21:55:123
168114699169,5cyclictest335557-21systemd-journal23:00:012
1681146991613,2cyclictest1952235-21cron23:30:002
1681143991611,4cyclictest1796285-21kworker/u8:2+events_unbound21:05:391
168113999169,5cyclictest1759904-21/usr/sbin/munin20:25:140
1681139991614,1cyclictest60350irq/132-enp0s29f1:rx-023:35:240
1681139991614,1cyclictest60350irq/132-enp0s29f1:rx-022:45:280
1681139991614,1cyclictest60350irq/132-enp0s29f1:rx-021:15:240
1681139991614,1cyclictest60350irq/132-enp0s29f1:rx-021:00:270
1681139991613,2cyclictest60350irq/132-enp0s29f1:rx-022:30:160
1681139991613,2cyclictest60350irq/132-enp0s29f1:rx-022:20:250
1681139991613,2cyclictest60350irq/132-enp0s29f1:rx-021:30:210
1681139991613,2cyclictest60350irq/132-enp0s29f1:rx-019:30:240
1681139991613,2cyclictest60350irq/132-enp0s29f1:rx-019:10:240
1681139991613,2cyclictest60350irq/132-enp0s29f1:rx-000:25:200
1681139991613,2cyclictest1723141-21kworker/u8:4+flush-259:020:15:000
1681139991611,4cyclictest1817247-21apt-get21:20:100
1681139991610,4cyclictest1926620-21/usr/sbin/munin23:05:210
168115199151,12cyclictest335557-21systemd-journal00:25:003
168115199151,12cyclictest1978769-21/usr/sbin/munin23:55:173
168115199151,12cyclictest1962156-21unixbench_multi23:35:253
168115199151,12cyclictest1759656-21awk20:25:003
168115199151,11cyclictest1822392-21apt-get21:25:123
168115199151,10cyclictest1759929-21apt-get20:25:123
168115199150,14cyclictest1936260-21sed23:10:273
168115199150,13cyclictest1978136-21cron23:55:003
168115199150,13cyclictest1978136-21cron23:55:003
168115199150,13cyclictest1972998-21turbostat.cron23:49:593
168115199150,13cyclictest1947730-21irqcore23:25:173
168115199150,13cyclictest1873934-21awk22:15:003
168115199150,13cyclictest1852709-21grep21:50:283
168115199150,13cyclictest1769974-21apt20:35:003
168115199150,13cyclictest1749420-21grep20:15:013
168115199150,12cyclictest1999379-21fschecks_time00:15:143
168115199150,12cyclictest1994121-21cut00:10:153
168115199150,12cyclictest1988906-21cpuspeed_turbos00:05:153
168115199150,12cyclictest1962908-21/usr/sbin/munin23:40:133
168115199150,12cyclictest1952891-21/usr/sbin/munin23:30:163
168115199150,12cyclictest1920997-21latency_hist23:00:013
168115199150,12cyclictest1827671-21cut21:30:163
168115199150,12cyclictest1739446-21fschecks_time20:05:153
168115199150,12cyclictest1696984-21tr19:25:133
168115199150,12cyclictest1686509-21acpi19:15:113
168115199150,11cyclictest1707151-21sed19:35:003
1681146991512,2cyclictest1793676-21kthreadcore20:55:182
1681146991511,3cyclictest1926104-21kworker/u8:3+flush-259:023:30:212
1681146991511,3cyclictest1853199-21kworker/u8:2+flush-259:022:21:062
1681146991510,4cyclictest1648168-21kworker/u8:3+flush-259:019:15:162
1681146991510,3cyclictest17550irq/130-nvme0q319:20:132
1681146991510,3cyclictest17550irq/130-nvme0q319:20:122
1681143991511,3cyclictest1926104-21kworker/u8:3+events_unbound23:21:401
168113999158,5cyclictest1878590-21ntpq22:15:210
1681139991513,1cyclictest60350irq/132-enp0s29f1:rx-023:45:180
1681139991513,1cyclictest60350irq/132-enp0s29f1:rx-023:25:140
1681139991513,1cyclictest60350irq/132-enp0s29f1:rx-022:55:050
1681139991513,1cyclictest60350irq/132-enp0s29f1:rx-022:51:590
1681139991513,1cyclictest60350irq/132-enp0s29f1:rx-021:10:130
1681139991513,1cyclictest60350irq/132-enp0s29f1:rx-019:55:170
1681139991513,1cyclictest1680661-21kworker/u8:0+flush-259:019:25:250
1681139991512,2cyclictest60350irq/132-enp0s29f1:rx-023:50:140
1681139991512,2cyclictest60350irq/132-enp0s29f1:rx-023:50:140
1681139991511,3cyclictest60350irq/132-enp0s29f1:rx-020:45:190
168115199143,10cyclictest1887242-21tr22:25:183
168115199142,11cyclictest1812588-21sed21:15:173
1681151991411,2cyclictest0-21swapper/323:05:003
168115199141,11cyclictest1947055-21apt23:25:003
168115199141,11cyclictest0-21swapper/319:20:153
168115199141,11cyclictest0-21swapper/319:20:143
1681151991410,3cyclictest1905581-21apt-get22:45:123
168115199140,5cyclictest1753663-21ntpq20:15:223
168115199140,2cyclictest1818970-21kthreadcore21:20:173
168115199140,2cyclictest1733875-21sort20:00:003
168115199140,1cyclictest1716280-21needreboot19:40:213
168115199140,12cyclictest1984027-21grep00:00:183
168115199140,12cyclictest1900812-21ps22:40:193
168115199140,12cyclictest1847568-21head21:45:263
168115199140,12cyclictest1838073-21cpuspeed_turbos21:40:143
168115199140,12cyclictest1775518-21tr20:40:143
168115199140,12cyclictest1681766-21sed19:10:183
168115199140,11cyclictest1926839-21fschecks_count23:05:163
168115199140,11cyclictest1681250-21latency_hist19:10:003
168114699149,4cyclictest1743726-21kworker/u8:1+flush-259:020:20:262
1681146991410,3cyclictest1648168-21kworker/u8:3+flush-259:019:46:142
1681143991411,2cyclictest1764838-21kworker/u8:3+events_unbound20:31:281
1681139991412,2cyclictest60350irq/132-enp0s29f1:rx-022:44:420
1681139991412,2cyclictest60350irq/132-enp0s29f1:rx-000:35:020
1681139991412,1cyclictest60350irq/132-enp0s29f1:rx-023:00:180
1681139991412,1cyclictest60350irq/132-enp0s29f1:rx-022:40:000
1681139991412,1cyclictest60350irq/132-enp0s29f1:rx-020:00:240
1681139991411,2cyclictest1780545-21kworker/u8:1+flush-259:021:35:170
1681139991410,3cyclictest1926104-21kworker/u8:3+flush-259:000:05:280
1681139991410,3cyclictest1776437-21tr20:40:170
168115199130,4cyclictest1875711-21kthreadcore22:15:173
168114699131,6cyclictest1998899-21munin-plugin-st00:15:002
1681146991310,2cyclictest1931043-21unixbench_multi23:05:262
1681146991310,2cyclictest1894086-21ntp_kernel_pll_22:30:222
1681146991310,2cyclictest1749641-21cpuspeed_turbos20:15:132
1681146991310,2cyclictest1734057-21cpuspeed_turbos20:00:152
1681146991310,2cyclictest0-21swapper/222:40:192
1681139991311,2cyclictest60350irq/132-enp0s29f1:rx-023:14:300
1681139991311,1cyclictest60350irq/132-enp0s29f1:rx-023:23:050
1681139991311,1cyclictest60350irq/132-enp0s29f1:rx-021:50:210
1681139991310,2cyclictest60350irq/132-enp0s29f1:rx-020:50:060
1681139991310,2cyclictest60350irq/132-enp0s29f1:rx-000:33:340
168114699129,2cyclictest0-21swapper/222:15:012
168114699127,3cyclictest1967780-21cron23:45:002
168114699126,4cyclictest1853159-21cron21:54:592
168114699124,6cyclictest2019612-21munin-run00:35:002
1681146991210,1cyclictest1712533-21tr19:40:152
168114699119,1cyclictest1889768-21cron22:30:012
168114699118,2cyclictest1921559-21cpuspeed_turbos23:00:142
168114699117,2cyclictest1785505-21basename20:50:002
168114699117,2cyclictest0-21swapper/221:20:222
168114699106,3cyclictest0-21swapper/221:00:202
168114699100,2cyclictest1769963-21awk20:35:002
16811469997,1cyclictest0-21swapper/223:15:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional