You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 10:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu May 21, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1575425994534,8cyclictest1674781-21latency_hist20:45:011
1575433993937,1cyclictest1757865-21fwupd22:00:473
1575421993730,5cyclictest335557-21systemd-journal23:05:000
1575430993530,3cyclictest335557-21systemd-journal20:01:082
157543099351,33cyclictest1643406-21true20:15:002
157543099351,33cyclictest1643406-21true20:15:002
1575425993428,4cyclictest335557-21systemd-journal22:00:461
1575430993329,3cyclictest1515413-21kworker/u8:1+flush-259:019:15:162
1575421993329,2cyclictest1626885-21kworker/u8:3+flush-259:020:05:240
1575430993228,3cyclictest1841014-21kworker/u8:0+flush-259:023:35:152
1575425993228,3cyclictest1536687-21kworker/u8:4+flush-259:019:20:171
1575425993225,5cyclictest335557-21systemd-journal20:52:091
1575421993228,3cyclictest335557-21systemd-journal23:46:090
1575421993228,3cyclictest1840955-21apt-get23:25:000
1575433993025,4cyclictest335557-21systemd-journal19:52:103
1575430993026,3cyclictest1542690-21kworker/u8:2+flush-259:019:40:252
1575430993025,4cyclictest335557-21systemd-journal20:26:092
1575425993025,4cyclictest1825425-21kworker/u8:0+flush-259:023:15:181
1575425993025,3cyclictest1654354-21/usr/sbin/munin20:25:141
1575430992921,6cyclictest335557-21systemd-journal22:05:002
1575430992921,6cyclictest1626885-21kworker/u8:3+flush-259:020:40:312
1575421992923,4cyclictest509-21rs:main0
1575430992822,4cyclictest1753070-21latency_hist22:00:012
1575425992821,5cyclictest335557-21systemd-journal19:30:011
1575421992824,3cyclictest1841014-21kworker/u8:0+events_unbound23:33:110
157542199281,25cyclictest1-21systemd19:44:080
1575433992721,5cyclictest335557-21systemd-journal22:50:003
1575430992722,3cyclictest335557-21systemd-journal21:10:102
1575425992722,3cyclictest1836066-21apt-get23:20:111
1575421992723,3cyclictest1542690-21kworker/u8:2+events_unbound19:30:090
1575421992721,4cyclictest335557-21systemd-journal19:17:080
1575433992621,3cyclictest1815585-21diskstats23:00:143
1575433992618,6cyclictest1768575-21latency_hist22:15:003
1575425992620,4cyclictest1877509-21cp00:00:001
1575421992622,3cyclictest1882359-21kworker/u8:4+events_unbound00:37:080
1575421992622,3cyclictest1669851-21kworker/u8:0+events_unbound21:19:100
1575430992518,5cyclictest1846544-21latency_hist23:30:012
1575425992519,4cyclictest509-21rs:main1
1575421992520,4cyclictest1542690-21kworker/u8:2+events_unbound19:35:110
1575421992520,3cyclictest1696005-21kworker/u8:1+flush-259:021:55:230
1575421992518,5cyclictest1784110-21latency_hist22:30:000
157542199251,22cyclictest335557-21systemd-journal00:00:490
1575433992418,4cyclictest1784349-21/usr/sbin/munin22:30:143
1575430992419,3cyclictest1617170-21base6419:50:012
1575430992418,4cyclictest335557-21systemd-journal21:15:382
1575425992420,3cyclictest1888143-21/usr/sbin/munin00:10:121
1575425992418,4cyclictest335557-21systemd-journal21:42:091
1575425992415,8cyclictest1784112-21latency_hist22:30:001
1575421992421,2cyclictest1542690-21kworker/u8:2+flush-259:020:05:000
1575421992420,3cyclictest1626885-21kworker/u8:3+events_unbound20:40:280
1575421992419,4cyclictest1841014-21kworker/u8:0+events_unbound00:20:120
1575421992419,4cyclictest1542690-21kworker/u8:2+events_unbound19:45:180
1575421992419,3cyclictest1835551-21kworker/u8:1+events_unbound00:00:010
1575421992418,5cyclictest335557-21systemd-journal23:14:090
1575433992319,3cyclictest1841014-21kworker/u8:0+flush-259:000:15:153
1575433992319,3cyclictest1626885-21kworker/u8:3+events_unbound20:05:153
1575433992318,4cyclictest1626885-21kworker/u8:3+events_unbound20:00:183
1575430992317,5cyclictest1877968-21diskstats00:00:142
1575425992317,5cyclictest1918022-21ntpq00:35:211
1575421992320,2cyclictest1696005-21kworker/u8:1+flush-259:022:05:190
1575421992319,3cyclictest1712244-21kworker/u8:5+events_unbound21:32:100
1575421992319,3cyclictest1696005-21kworker/u8:1+flush-259:021:05:210
1575421992319,3cyclictest1626886-21kworker/u8:4+events_unbound19:55:260
1575421992319,3cyclictest1536687-21kworker/u8:4+events_unbound19:10:170
1575421992317,4cyclictest335557-21systemd-journal23:30:000
1575433992218,3cyclictest1773750-21kworker/u8:1+events_unbound22:20:153
1575433992218,3cyclictest1680155-21kworker/u8:4+flush-259:021:10:183
1575433992215,5cyclictest1747916-21latency_hist21:55:013
1575430992218,3cyclictest1732685-21kworker/u8:2+flush-259:021:40:142
1575430992218,2cyclictest1669851-21kworker/u8:0-ext4-rsv-conversion21:05:002
1575425992216,4cyclictest1898497-21/usr/sbin/munin00:20:181
1575421992219,2cyclictest1659529-21kworker/u8:1+events_unbound20:30:220
1575421992218,3cyclictest1669851-21kworker/u8:0+flush-259:021:01:390
1575421992218,3cyclictest1669851-21kworker/u8:0+events_unbound20:59:110
1575421992217,4cyclictest1841014-21kworker/u8:0+events_unbound23:36:090
1575421992217,4cyclictest1732685-21kworker/u8:2+flush-259:021:55:010
1575421992216,3cyclictest335557-21systemd-journal20:30:000
1575433992117,3cyclictest1815384-21kworker/u8:2+events_unbound23:10:243
1575433992117,3cyclictest1752270-21kworker/u8:3+flush-259:022:35:163
1575433992117,3cyclictest1626885-21kworker/u8:3+flush-259:020:20:163
1575433992115,4cyclictest509-21rs:main3
157542599218,11cyclictest1664804-21cpuspeed_turbos20:35:131
1575421992118,2cyclictest1778921-21kworker/u8:4+flush-259:022:50:000
1575421992118,2cyclictest1752270-21kworker/u8:3+flush-259:023:05:220
1575421992117,3cyclictest1835551-21kworker/u8:1+events_unbound00:10:130
1575421992117,3cyclictest1752270-21kworker/u8:3+events_unbound22:36:110
1575421992117,3cyclictest1696005-21kworker/u8:1+events_unbound22:00:220
1575421992115,4cyclictest1685126-21latency_hist20:55:010
1575433992017,2cyclictest1542690-21kworker/u8:2+events_unbound19:40:153
1575433992016,3cyclictest1542690-21kworker/u8:2+events_unbound20:15:183
1575433992016,3cyclictest1536687-21kworker/u8:4+flush-259:019:30:163
1575433992014,4cyclictest1717194-21/usr/sbin/munin21:25:143
1575433992013,5cyclictest1856821-21latency_hist23:40:013
1575430992018,2cyclictest1882359-21kworker/u8:4+flush-259:000:35:202
1575430992016,3cyclictest1752270-21kworker/u8:3+flush-259:022:35:142
1575430992016,3cyclictest1626885-21kworker/u8:3+flush-259:020:05:212
1575430992016,2cyclictest1722141-21turbostat.cron21:30:002
1575430992015,4cyclictest1542690-21kworker/u8:2+events_unbound19:55:192
1575430992013,5cyclictest1867114-21latency_hist23:50:012
1575430992013,5cyclictest1668716-21ntpq20:35:202
1575425992016,3cyclictest1542690-21kworker/u8:2+flush-259:019:40:271
1575425992015,4cyclictest1633227-21kworker/u8:0+flush-259:020:05:191
1575425992015,3cyclictest1862219-21apt-get23:45:101
1575425992015,3cyclictest1799638-21kworker/u8:1+events_unbound22:50:171
1575425992014,4cyclictest335557-21systemd-journal21:37:091
1575421992017,2cyclictest1835551-21kworker/u8:1+events_unbound00:07:320
1575421992016,3cyclictest1727322-21kworker/u8:0+events_unbound21:44:100
1575421992016,3cyclictest1680155-21kworker/u8:4+events_unbound21:25:230
1575421992016,3cyclictest1542690-21kworker/u8:2+events_unbound19:28:270
1575421992016,3cyclictest1536687-21kworker/u8:4+events_unbound19:22:270
1575433991915,3cyclictest1841014-21kworker/u8:0+events_unbound23:50:223
1575433991915,3cyclictest1815384-21kworker/u8:2+events_unbound23:20:143
1575433991915,3cyclictest1626885-21kworker/u8:3+flush-259:020:50:003
1575433991915,3cyclictest1536687-21kworker/u8:4+events_unbound19:15:203
1575433991914,4cyclictest335557-21systemd-journal23:20:003
1575433991913,4cyclictest509-21rs:main3
1575430991915,3cyclictest1752270-21kworker/u8:3+flush-259:023:05:142
1575430991915,3cyclictest1752270-21kworker/u8:3+flush-259:022:25:252
1575430991915,2cyclictest1908555-21true00:29:592
1575425991915,3cyclictest1778921-21kworker/u8:4+flush-259:022:40:141
1575425991914,4cyclictest1737848-21/usr/sbin/munin21:45:191
1575425991914,4cyclictest1616670-21https19:49:591
1575425991914,3cyclictest1596332-21apt-get19:30:091
1575421991917,1cyclictest1893068-21kworker/u8:3+events_unbound00:33:080
1575421991915,3cyclictest1893068-21kworker/u8:3+flush-259:000:25:250
1575421991915,3cyclictest1867133-21kworker/u8:3+flush-259:023:55:000
1575421991915,3cyclictest1835551-21kworker/u8:1+events_unbound23:19:560
1575421991915,3cyclictest1712244-21kworker/u8:5+events_unbound21:35:260
1575421991915,3cyclictest1680155-21kworker/u8:4+events_unbound21:11:100
1575421991915,3cyclictest1542690-21kworker/u8:2+events_unbound19:50:240
1575421991915,2cyclictest0-21swapper/021:50:000
1575421991914,3cyclictest60350irq/132-enp0s29f1:rx-022:10:200
1575421991913,4cyclictest1643380-21apt-get20:15:000
1575421991913,4cyclictest1643380-21apt-get20:15:000
1575421991912,5cyclictest1897415-21ntpq00:15:210
1575433991815,2cyclictest1669851-21kworker/u8:0+flush-259:020:59:403
1575433991813,4cyclictest1882359-21kworker/u8:4+flush-259:000:34:593
1575433991811,5cyclictest1643385-21latency_hist20:15:013
1575433991811,5cyclictest1643385-21latency_hist20:15:003
1575430991814,3cyclictest1680155-21kworker/u8:4+flush-259:020:55:252
157542599189,8cyclictest1789790-21fschecks_time22:35:141
157542599185,4cyclictest513-21gdbus20:35:011
157542599184,3cyclictest513-21gdbus23:40:001
1575425991815,2cyclictest1804762-21idleruntime-cro22:50:001
1575425991814,3cyclictest1680155-21kworker/u8:4+flush-259:020:55:141
1575421991814,3cyclictest1727322-21kworker/u8:0+flush-259:022:23:250
1575433991714,2cyclictest1835551-21kworker/u8:1+flush-259:023:50:003
1575433991714,2cyclictest1685106-21cron20:55:003
157543399171,14cyclictest1716959-21apt21:24:593
1575433991711,4cyclictest1669610-21latency_hist20:40:013
1575430991712,3cyclictest1727571-21apt-get21:35:112
1575421991714,2cyclictest60350irq/132-enp0s29f1:rx-020:45:190
1575421991713,3cyclictest1752270-21kworker/u8:3+flush-259:022:56:090
1575421991713,3cyclictest1542690-21kworker/u8:2+events_unbound20:35:220
1575433991612,3cyclictest1752270-21kworker/u8:3+flush-259:022:40:203
1575433991612,3cyclictest1536687-21kworker/u8:4+flush-259:019:25:003
1575433991611,3cyclictest509-21rs:main3
157543099168,5cyclictest335557-21systemd-journal20:50:002
1575430991613,2cyclictest1835551-21kworker/u8:1+events_unbound00:10:152
1575430991611,3cyclictest1867350-21/usr/sbin/munin23:50:152
1575430991610,4cyclictest335557-21systemd-journal21:35:002
1575430991610,4cyclictest1712243-21diskstats21:20:142
157542599163,3cyclictest1648276-21cat20:15:241
157542599161,4cyclictest1913731-21munin-plugin-st00:35:001
157542599161,4cyclictest1576024-21irqcore19:10:121
1575425991613,2cyclictest1691527-21kthreadcore21:00:181
1575425991613,2cyclictest1653198-21ntp_kernel_err20:20:201
1575425991611,4cyclictest1701108-21cat21:10:011
1575425991611,3cyclictest1542690-21kworker/u8:2+flush-259:019:35:171
1575425991610,5cyclictest1727322-21kworker/u8:0+flush-259:022:17:401
157542599160,7cyclictest1825493-21latency_hist23:10:011
157542599160,6cyclictest1845659-21ntpq23:25:201
157542599160,4cyclictest1883422-21sort00:05:161
157542599160,4cyclictest1632732-21latency_hist20:05:001
1575421991613,2cyclictest60350irq/132-enp0s29f1:rx-020:21:130
1575421991613,2cyclictest60350irq/132-enp0s29f1:rx-020:17:290
1575421991612,3cyclictest1799638-21kworker/u8:1+events_unbound22:51:070
157543399159,4cyclictest1841014-21kworker/u8:0+flush-259:023:33:403
1575433991512,2cyclictest1727322-21kworker/u8:0+events_unbound21:50:013
1575433991511,3cyclictest1752270-21kworker/u8:3+flush-259:022:55:253
1575433991511,3cyclictest1536687-21kworker/u8:4+events_unbound19:10:133
157543099158,5cyclictest335557-21systemd-journal21:06:082
1575430991512,2cyclictest1898936-21irqcore00:20:152
1575430991510,4cyclictest335557-21systemd-journal19:32:082
157542599155,1cyclictest0-21swapper/119:55:161
157542599151,2cyclictest1820505-21latency_hist23:05:001
157542599150,4cyclictest1743427-21sort21:50:151
157542599150,4cyclictest1679471-21tail20:45:241
1575421991513,1cyclictest60350irq/132-enp0s29f1:rx-023:40:140
1575421991512,2cyclictest1752270-21kworker/u8:3+events_unbound22:16:070
157543399149,4cyclictest1627381-21latency_hist20:00:013
1575433991411,1cyclictest0-21swapper/300:29:593
1575433991410,3cyclictest1680155-21kworker/u8:4+flush-259:021:00:193
1575433991410,3cyclictest1611524-21kworker/u8:0+flush-259:019:45:263
157543099149,4cyclictest1696005-21kworker/u8:1+flush-259:022:05:252
157543099147,4cyclictest335557-21systemd-journal19:25:002
1575430991410,3cyclictest1799638-21kworker/u8:1+flush-259:022:55:152
157542599141,2cyclictest1810331-21tr22:55:131
157542599140,5cyclictest1881810-21/usr/sbin/munin00:00:211
157542599140,4cyclictest1897537-21/usr/sbin/munin00:15:231
1575421991413,1cyclictest60350irq/132-enp0s29f1:rx-022:33:210
157543399139,3cyclictest1712244-21kworker/u8:5+events_unbound21:35:243
1575433991310,2cyclictest0-21swapper/300:05:003
1575433991310,1cyclictest0-21swapper/322:25:143
1575430991310,2cyclictest0-21swapper/220:24:592
157542599134,3cyclictest1784666-21fw_packets22:30:141
157542599130,4cyclictest1830817-21latency_hist23:15:001
157543399128,3cyclictest1908556-21kworker/u8:1+flush-259:000:35:203
157543399128,3cyclictest1835551-21kworker/u8:1+events_unbound00:10:113
157543399127,4cyclictest1696005-21kworker/u8:1+flush-259:021:30:213
157543099129,2cyclictest1815490-21cpuspeed_turbos23:00:132
157543099129,2cyclictest1680278-21cpuspeed_turbos20:50:102
157543099121,9cyclictest1851640-21awk23:35:002
157542599120,4cyclictest1905940-21tail00:25:171
1575421991210,1cyclictest60350irq/132-enp0s29f1:rx-021:20:170
157543399118,2cyclictest1769009-21fschecks_count22:15:133
157543399118,2cyclictest1601520-21cpuspeed_turbos19:35:133
157543399118,2cyclictest1595597-21unixbench_multi19:25:243
157543399117,3cyclictest1696005-21kworker/u8:1+flush-259:021:55:163
157543399117,3cyclictest0-21swapper/300:05:233
157543099116,4cyclictest1752270-21kworker/u8:3+flush-259:022:30:252
157543099116,4cyclictest1601407-21kworker/u8:1+flush-259:019:35:262
157543099111,2cyclictest1887909-21latency_hist00:10:012
15754309997,1cyclictest0-21swapper/221:45:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional