You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-30 - 14:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Thu Apr 30, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1542274994442,1cyclictest1713350-21fwupd21:53:212
1542279994237,3cyclictest1620067-21kworker/u8:0+flush-259:020:24:593
1542270994236,4cyclictest1677273-21latency_hist21:20:010
1542270994035,3cyclictest509-21rs:main0
1542279993933,4cyclictest1784687-21latency_hist00:00:013
1542270993329,3cyclictest1755212-21kworker/u8:4+flush-259:023:53:100
1542279993228,3cyclictest1588875-21apt-get19:55:113
1542270993228,3cyclictest1498953-21kworker/u8:1+flush-259:019:45:190
1542270993226,4cyclictest1656770-21/usr/sbin/munin21:00:150
1542279993128,2cyclictest1631023-21kworker/u8:3+flush-259:021:15:013
1542279993125,4cyclictest509-21rs:main3
1542274993128,2cyclictest1537138-21kworker/u8:0+flush-259:019:39:592
1542274993127,3cyclictest1697981-21kworker/u8:2+flush-259:023:05:002
1542270993123,6cyclictest252-21systemd-journal21:35:000
1542279993025,3cyclictest1760827-21latency_hist23:15:013
1542279993023,4cyclictest1641544-21diskstats20:45:143
1542270993026,3cyclictest1593792-21kworker/u8:0+flush-259:020:10:060
1542270993025,4cyclictest1697981-21kworker/u8:2+events_unbound22:35:000
1542270993024,4cyclictest1698204-21/usr/sbin/munin21:40:130
1542274992925,3cyclictest1537138-21kworker/u8:0+flush-259:019:15:172
1542273992925,3cyclictest1599065-21gpgv20:05:001
1542270992926,2cyclictest1773072-21kworker/u8:2+events_unbound00:39:150
1542270992925,3cyclictest1573146-21kworker/u8:3+flush-259:020:00:000
1542270992922,5cyclictest1719755-21latency_hist22:05:000
1542274992822,4cyclictest1767224-21latency_hist23:30:022
1542273992821,5cyclictest252-21systemd-journal22:10:001
1542270992821,5cyclictest252-21systemd-journal19:55:000
1542279992723,3cyclictest1498953-21kworker/u8:1+flush-259:019:50:143
1542274992721,4cyclictest252-21systemd-journal21:50:002
1542273992723,3cyclictest1773072-21kworker/u8:2+flush-259:023:50:161
1542273992722,4cyclictest1630369-21apt-get20:35:011
1542270992724,2cyclictest1573146-21kworker/u8:3+events_unbound20:00:220
154227099270,25cyclictest1614900-21true20:20:000
1542274992519,4cyclictest1547454-21latency_hist19:15:002
1542273992521,2cyclictest509-21rs:main1
1542270992520,4cyclictest1615157-21apt-get20:20:120
1542270992520,3cyclictest1604069-21kworker/u8:1+flush-259:021:30:010
1542274992419,3cyclictest252-21systemd-journal21:44:592
1542270992421,2cyclictest1542477-21kworker/u8:2+events_unbound19:20:190
1542270992417,5cyclictest1713510-21latency_hist21:55:000
1542279992320,2cyclictest1542477-21kworker/u8:2+flush-259:019:14:593
1542279992319,3cyclictest1641137-21kworker/u8:0+flush-259:021:10:013
1542279992319,3cyclictest1620067-21kworker/u8:0+flush-259:020:30:013
1542273992319,3cyclictest1697981-21kworker/u8:2+flush-259:023:00:171
1542270992315,5cyclictest1726211-21latency_hist22:20:000
1542274992218,3cyclictest1542477-21kworker/u8:2+events_unbound19:30:012
1542273992218,3cyclictest252-21systemd-journal22:00:301
1542273992217,4cyclictest1672510-21diskstats21:15:121
1542270992218,3cyclictest1604069-21kworker/u8:1+events_unbound20:45:240
1542270992218,3cyclictest1604069-21kworker/u8:1+events_unbound20:40:230
1542270992218,3cyclictest1593792-21kworker/u8:0+events_unbound20:05:230
1542270992217,4cyclictest1755022-21kworker/u8:1+events_unbound23:15:420
1542270992216,4cyclictest252-21systemd-journal23:05:390
1542270992215,5cyclictest1714170-21https22:00:000
1542270992215,5cyclictest1567116-21ntpq19:30:210
1542270992214,6cyclictest1624291-21ntpq20:25:220
1542279992116,3cyclictest1732400-21latency_hist22:30:003
1542279992116,3cyclictest1732400-21latency_hist22:30:003
1542274992119,1cyclictest1575706-21kthreadcore19:40:192
1542274992117,3cyclictest1767493-21apt-get23:30:122
1542273992117,3cyclictest1604069-21kworker/u8:1+flush-259:020:45:181
1542273992115,4cyclictest1609743-21latency_hist20:15:011
1542270992117,3cyclictest1631023-21kworker/u8:3+flush-259:020:35:160
1542279992015,4cyclictest1599807-21diskstats20:05:143
1542274992015,4cyclictest1759975-21ntpq23:10:212
1542274992014,4cyclictest1749158-21latency_hist22:55:012
1542273992017,2cyclictest252-21systemd-journal20:00:001
1542273992015,3cyclictest1802361-21gpgv00:30:001
1542270992017,2cyclictest1542477-21kworker/u8:2+flush-259:019:19:590
1542270992016,3cyclictest1726471-21apt-get22:20:130
1542270992016,3cyclictest1542477-21kworker/u8:2+flush-259:019:10:070
1542270992015,4cyclictest1697981-21kworker/u8:2+events_unbound22:50:220
1542270992015,4cyclictest1667168-21apt-get21:10:120
1542274991916,2cyclictest1687673-21munin-plugin-st21:30:012
1542274991914,3cyclictest1542219-21latency_hist19:10:012
1542273991916,2cyclictest1604069-21kworker/u8:1+flush-259:021:35:251
1542273991916,2cyclictest1604069-21kworker/u8:1+events_unbound20:19:591
1542270991915,3cyclictest1651387-21kworker/u8:2+events_unbound20:55:010
1542270991915,3cyclictest1604069-21kworker/u8:1+events_unbound20:30:230
1542270991915,2cyclictest1755212-21kworker/u8:4+flush-259:023:40:160
1542270991913,4cyclictest252-21systemd-journal23:35:450
1542279991815,2cyclictest1773072-21kworker/u8:2+flush-259:000:30:203
1542279991812,4cyclictest1725555-21latency_hist22:14:593
1542274991816,1cyclictest1593760-21cron20:00:002
1542274991815,2cyclictest1630369-21apt-get20:34:592
1542274991812,5cyclictest1691970-21ntpq21:30:202
1542273991816,1cyclictest0-21swapper/122:25:001
1542273991816,1cyclictest0-21swapper/120:35:001
1542273991814,3cyclictest1755212-21kworker/u8:4+flush-259:000:00:221
1542273991813,4cyclictest1796625-21apt-get00:20:111
154227399180,14cyclictest1557735-21awk19:24:591
1542270991815,1cyclictest0-21swapper/023:50:000
1542270991814,3cyclictest1755212-21kworker/u8:4+events_unbound00:23:320
1542270991813,3cyclictest1761739-21apt-get23:20:120
1542279991713,2cyclictest252-21systemd-journal22:17:053
1542279991710,5cyclictest1551688-21ntpq19:15:213
1542274991711,5cyclictest1736686-21ntpq22:30:212
1542273991714,2cyclictest1790572-21kworker/u8:1+flush-259:000:19:591
1542273991714,2cyclictest1755212-21kworker/u8:4+flush-259:000:10:241
1542273991711,4cyclictest252-21systemd-journal23:20:001
154227099179,5cyclictest1803247-21sshd00:30:160
154227099171,15cyclictest1744032-21turbostat22:50:000
1542279991613,2cyclictest1744018-21latency_hist22:50:013
1542279991612,3cyclictest0-21swapper/319:35:003
1542279991610,5cyclictest1778223-21latency_hist23:45:023
1542274991613,2cyclictest252-21systemd-journal19:24:592
1542274991613,2cyclictest0-21swapper/220:05:002
1542273991614,1cyclictest1738230-21sh22:40:001
1542273991614,1cyclictest0-21swapper/123:15:001
1542273991612,3cyclictest1646491-21/usr/sbin/munin20:50:151
1542273991610,5cyclictest1807727-21latency_hist00:35:011
1542270991613,2cyclictest60350irq/132-enp0s29f1:rx-019:27:080
1542270991613,2cyclictest1604069-21kworker/u8:1+events_unbound21:20:210
1542270991612,3cyclictest1755212-21kworker/u8:4+flush-259:023:31:410
1542270991612,2cyclictest0-21swapper/000:00:190
1542279991513,1cyclictest0-21swapper/319:50:003
1542279991512,2cyclictest1693113-21apt-get21:35:123
1542279991511,3cyclictest1630929-21gpgv20:35:003
1542274991513,1cyclictest1668188-21kthreadcore21:10:182
1542274991512,2cyclictest1773072-21kworker/u8:2+flush-259:023:50:262
1542274991512,2cyclictest1697981-21kworker/u8:2+events_unbound22:00:182
1542274991511,3cyclictest509-21rs:main2
1542274991511,3cyclictest1766579-21latency_hist23:25:012
1542274991511,3cyclictest1498953-21kworker/u8:1+flush-259:019:50:002
154227399159,4cyclictest252-21systemd-journal19:31:061
1542273991512,2cyclictest1744699-21irqcore22:50:151
1542273991512,2cyclictest1698295-21cpuspeed_turbos21:40:121
1542273991510,4cyclictest1604516-21latency_hist20:10:011
1542270991513,1cyclictest60350irq/132-enp0s29f1:rx-022:10:190
1542270991512,2cyclictest60350irq/132-enp0s29f1:rx-023:10:230
1542270991512,2cyclictest60350irq/132-enp0s29f1:rx-022:27:330
1542270991512,2cyclictest60350irq/132-enp0s29f1:rx-022:27:330
1542270991511,3cyclictest60350irq/132-enp0s29f1:rx-021:35:230
1542270991511,3cyclictest1773072-21kworker/u8:2+flush-259:000:09:170
1542270991511,3cyclictest1604069-21kworker/u8:1+events_unbound21:45:170
1542270991511,3cyclictest1537138-21kworker/u8:0+events_unbound19:40:230
1542270991511,2cyclictest0-21swapper/000:00:000
1542279991411,2cyclictest1661723-21cron21:05:003
1542279991411,2cyclictest1630392-21gpgv20:35:003
1542279991411,2cyclictest0-21swapper/322:25:003
1542274991412,1cyclictest1697957-21sh21:40:002
1542273991411,2cyclictest1721087-21irqcore22:10:161
1542273991411,2cyclictest1666886-21idleruntime-cro21:10:011
1542273991410,3cyclictest252-21systemd-journal21:05:001
1542273991410,3cyclictest1703391-21/usr/sbin/munin21:45:151
1542270991412,1cyclictest60350irq/132-enp0s29f1:rx-019:35:040
1542270991410,3cyclictest1662004-21apt-get21:05:140
154227999137,4cyclictest0-21swapper/319:25:003
1542279991311,1cyclictest1755212-21kworker/u8:4+flush-259:023:20:263
1542279991310,2cyclictest1749150-21sh22:55:003
1542279991310,2cyclictest0-21swapper/321:20:163
1542274991310,2cyclictest1784694-21/usr/sbin/munin00:00:002
1542274991310,2cyclictest1778861-21idleruntime-cro23:50:002
1542274991310,2cyclictest1650965-21unixbench_singl20:50:262
1542274991310,2cyclictest1593792-21kworker/u8:0+flush-259:020:05:222
154227399139,2cyclictest0-21swapper/122:00:001
154227399138,3cyclictest1636221-21/usr/sbin/munin20:40:151
1542273991311,1cyclictest1772391-21idleruntime-cro23:35:001
1542273991311,1cyclictest0-21swapper/121:30:151
1542273991310,2cyclictest1558066-21cpuspeed_turbos19:25:141
154227099139,3cyclictest60350irq/132-enp0s29f1:rx-022:40:210
1542270991311,1cyclictest60350irq/132-enp0s29f1:rx-023:25:120
1542270991311,1cyclictest60350irq/132-enp0s29f1:rx-022:39:240
1542270991310,2cyclictest60350irq/132-enp0s29f1:rx-022:56:280
1542270991310,2cyclictest60350irq/132-enp0s29f1:rx-020:55:160
1542270991310,2cyclictest60350irq/132-enp0s29f1:rx-000:15:570
154227999129,2cyclictest1790857-21cpuspeed_turbos00:10:123
154227999129,2cyclictest1785027-21cpuspeed_turbos00:00:123
154227999129,2cyclictest1767560-21cpuspeed_turbos23:30:133
154227999129,2cyclictest0-21swapper/320:40:243
154227999129,2cyclictest0-21swapper/320:15:243
154227999125,5cyclictest273-21systemd-udevd21:50:203
1542279991210,1cyclictest1672758-21irqcore21:15:143
1542279991210,1cyclictest0-21swapper/320:05:013
1542279991210,1cyclictest0-21swapper/319:35:173
154227499129,2cyclictest1631023-21kworker/u8:3+flush-259:020:55:212
154227499129,2cyclictest1583970-21fschecks_time19:50:122
154227499129,2cyclictest1567243-21proc_pri19:30:242
154227499128,3cyclictest509-21rs:main2
154227499128,3cyclictest1755212-21kworker/u8:4+events_unbound00:20:152
154227499121,4cyclictest252-21systemd-journal20:30:002
1542274991210,1cyclictest1789881-21cron00:04:592
1542274991210,1cyclictest0-21swapper/223:45:002
1542274991210,1cyclictest0-21swapper/221:15:232
1542274991210,1cyclictest0-21swapper/200:30:002
154227399129,2cyclictest1620577-21fschecks_time20:25:161
154227399127,3cyclictest1588618-21idleruntime-cro19:55:001
1542273991210,1cyclictest1726197-21idleruntime-cro22:20:001
1542270991211,1cyclictest60350irq/132-enp0s29f1:rx-022:09:180
154227999117,3cyclictest1702766-21sshd21:40:263
154227999117,2cyclictest252-21systemd-journal21:32:053
154227999117,2cyclictest0-21swapper/322:35:003
154227499119,1cyclictest0-21swapper/223:20:002
154227499118,2cyclictest1738751-21fschecks_time22:40:132
154227499118,2cyclictest1604754-21kworker/u8:4+flush-259:020:20:262
154227499118,1cyclictest0-21swapper/221:25:012
154227499117,3cyclictest1802833-21apt-get00:30:102
154227499117,3cyclictest1697981-21kworker/u8:2+flush-259:021:55:252
154227499116,3cyclictest1609491-21sshd20:12:052
154227499111,9cyclictest1795944-21journal-offline00:15:152
154227499110,4cyclictest1755684-21cat23:10:012
154227499110,10cyclictest1726202-21awk22:20:002
154227399119,1cyclictest0-21swapper/123:30:001
154227399119,1cyclictest0-21swapper/119:15:151
154227399117,3cyclictest1604069-21kworker/u8:1+flush-259:022:40:241
154227399117,2cyclictest1790533-21awk00:10:001
154227399117,2cyclictest1737575-21sh22:35:001
154227399116,3cyclictest507-21in:imuxsock23:40:051
154227399115,5cyclictest1686758-21ntpq21:25:201
154227399110,9cyclictest1656519-21awk21:00:001
154227099119,1cyclictest60350irq/132-enp0s29f1:rx-023:00:160
154227999107,2cyclictest1760847-21kworker/u8:0+events_unbound23:30:003
154227999107,2cyclictest0-21swapper/322:00:003
154227999105,4cyclictest252-21systemd-journal23:10:003
154227999105,4cyclictest1796773-21df00:20:133
154227999101,1cyclictest17963721systemd-run00:20:003
154227499108,1cyclictest0-21swapper/222:10:002
154227499107,1cyclictest0-21swapper/223:00:012
154227499105,3cyclictest1630890-21base6420:35:012
154227499104,4cyclictest1731162-21sshd22:23:052
154227499101,6cyclictest1697981-21kworker/u8:2+ext4-rsv-conversion22:40:002
154227399108,1cyclictest1708676-21cpuspeed_turbos21:50:141
154227399108,1cyclictest0-21swapper/121:10:191
154227399108,1cyclictest0-21swapper/100:00:001
154227399107,2cyclictest17450irq/129-nvme0q222:30:011
154227399107,2cyclictest17450irq/129-nvme0q222:30:011
154227399105,3cyclictest1573392-21apt-get19:40:121
15422799997,1cyclictest0-21swapper/323:20:003
15422799996,2cyclictest17650irq/131-nvme0q422:10:003
15422799995,3cyclictest1778211-21cron23:45:013
15422799994,3cyclictest1790389-21sshd00:08:303
15422799993,4cyclictest1808376-21apt00:40:013
15422749997,1cyclictest0-21swapper/200:10:012
15422749995,3cyclictest401ktimers/221:00:112
15422749995,2cyclictest832-21runrttasks22:45:262
15422749991,6cyclictest252-21systemd-journal22:30:002
15422749991,6cyclictest252-21systemd-journal22:30:002
15422739996,1cyclictest1743418-21kworker/u8:3-writeback23:00:011
15422739990,7cyclictest1778876-21latency_hist23:50:011
15422709995,3cyclictest1773072-21kworker/u8:2+events_unbound00:28:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional