You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 05:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Aug 17, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1613345995438,10cyclictest1774286-21/usr/sbin/munin21:45:220
1613345995138,10cyclictest1946052-21latency_hist00:30:010
1613351994640,4cyclictest1904201-21latency_hist23:50:012
1613345994540,3cyclictest1758874-21apt-get21:30:130
1613355994440,3cyclictest1768937-21kworker/u8:0+flush-259:022:40:003
1613345994439,3cyclictest1707169-21apt-get20:40:130
1613345994438,4cyclictest1774048-21latency_hist21:45:010
1613351994236,4cyclictest335557-21systemd-journal20:10:002
1613349993925,5cyclictest1815824-21latency_hist22:25:001
1613355993835,2cyclictest1904894-21apt-get23:50:133
1613351993833,4cyclictest1768937-21kworker/u8:0+events_unbound23:39:192
1613349993731,4cyclictest1784592-21/usr/sbin/munin21:55:141
1613349993722,4cyclictest335557-21systemd-journal00:05:001
1613355993529,4cyclictest1757773-21ntpq21:25:253
1613345993530,3cyclictest1691609-21apt-get20:25:130
1613345993529,4cyclictest1665059-21latency_hist20:00:010
1613349993431,2cyclictest1836508-21kworker/u8:1+events_unbound22:50:191
1613349993427,5cyclictest1945156-21ntpq00:25:231
1613355993326,5cyclictest335557-21systemd-journal23:00:003
1613351993228,3cyclictest1369598-21kworker/u8:3+flush-259:019:10:372
1613349993227,3cyclictest1743304-21/usr/sbin/munin21:15:191
1613351993127,3cyclictest1857879-21kworker/u8:4+events_unbound23:30:242
1613351993126,4cyclictest1857879-21kworker/u8:4+events_unbound00:35:242
1613351993126,4cyclictest1712060-21kworker/u8:2+flush-259:021:50:152
1613349993128,2cyclictest1768937-21kworker/u8:0+flush-259:023:35:001
1613345993126,4cyclictest335557-21systemd-journal21:30:010
1613345993023,5cyclictest1955611-21ntpq00:35:230
1613355992923,4cyclictest1686616-21diskstats20:20:153
1613351992925,3cyclictest1888714-21kworker/u8:1+flush-259:023:57:302
1613351992924,4cyclictest1670390-21store20:05:012
1613355992825,2cyclictest1738095-21kworker/u8:4+flush-259:021:35:163
1613355992824,3cyclictest1768937-21kworker/u8:0+flush-259:022:05:013
1613355992824,3cyclictest1717475-21/usr/sbin/munin20:50:143
1613351992824,3cyclictest1826186-21kworker/u8:3+events_unbound23:02:282
1613345992825,2cyclictest1369598-21kworker/u8:3+flush-259:019:45:260
1613345992822,4cyclictest335557-21systemd-journal23:41:290
1613355992720,5cyclictest1873631-21diskstats23:20:123
1613351992723,3cyclictest1857879-21kworker/u8:4+events_unbound00:25:302
1613351992723,3cyclictest1768937-21kworker/u8:0+events_unbound22:35:302
1613351992723,3cyclictest1738095-21kworker/u8:4+flush-259:022:05:172
1613351992723,3cyclictest1670840-21kworker/u8:4+events_unbound20:16:302
1613351992723,3cyclictest1670839-21kworker/u8:1+events_unbound20:25:272
1613351992722,4cyclictest1909640-21kworker/u8:2+events_unbound00:04:302
1613351992722,3cyclictest1649772-21kworker/u8:2+events_unbound20:20:182
1613345992721,4cyclictest1737866-21latency_hist21:10:010
1613355992621,4cyclictest1643458-21ntpq19:35:193
1613351992622,3cyclictest1712060-21kworker/u8:2+events_unbound21:32:302
1613351992620,4cyclictest335557-21systemd-journal21:05:012
1613349992620,4cyclictest1670383-21gpgv20:05:021
1613355992521,3cyclictest1909640-21kworker/u8:2+flush-259:023:55:273
1613351992522,2cyclictest1738095-21kworker/u8:4+flush-259:021:45:162
1613351992521,3cyclictest1820574-21kworker/u8:2+events_unbound22:31:292
1613351992520,3cyclictest1369598-21kworker/u8:3+events_unbound19:25:402
1613349992520,3cyclictest1852716-21apt-get23:00:141
1613349992519,4cyclictest1956499-21latency_hist00:40:011
1613349992518,5cyclictest1633130-21ntpq19:25:221
1613349992516,8cyclictest1920206-21kworker/u8:3+flush-259:000:10:001
1613345992519,4cyclictest1951088-21apt-get00:33:200
1613355992421,2cyclictest1909640-21kworker/u8:2+flush-259:000:00:293
1613355992420,3cyclictest335557-21systemd-journal22:10:293
1613355992420,3cyclictest1836508-21kworker/u8:1+flush-259:022:50:213
1613355992420,3cyclictest1717467-21kworker/u8:0+flush-259:021:09:593
1613351992420,3cyclictest1580019-21kworker/u8:2+events_unbound19:15:162
1613349992420,3cyclictest1670840-21kworker/u8:4+flush-259:020:30:181
1613345992420,3cyclictest1768937-21kworker/u8:0+flush-259:021:55:010
1613351992320,3cyclictest1836508-21kworker/u8:1+events_unbound23:05:102
1613351992319,3cyclictest1857879-21kworker/u8:4+events_unbound00:20:152
1613351992319,3cyclictest1800496-21kworker/u8:3+events_unbound22:19:282
1613351992319,3cyclictest1696729-21kworker/u8:3+events_unbound20:35:242
1613349992318,4cyclictest1930784-21/usr/sbin/munin00:15:141
1613349992317,4cyclictest1878389-21latency_hist23:25:011
1613345992320,2cyclictest1670180-21apt-get20:05:010
1613355992219,2cyclictest1768937-21kworker/u8:0+flush-259:022:35:003
1613355992218,3cyclictest335557-21systemd-journal23:33:283
1613355992218,3cyclictest1857879-21kworker/u8:4+flush-259:023:35:183
1613355992218,3cyclictest1369598-21kworker/u8:3+flush-259:019:55:013
1613351992219,2cyclictest1369598-21kworker/u8:3+flush-259:019:30:382
1613351992218,3cyclictest1857879-21kworker/u8:4+events_unbound00:30:302
1613351992218,3cyclictest1836508-21kworker/u8:1+events_unbound23:15:312
1613351992218,3cyclictest1820574-21kworker/u8:2+events_unbound22:46:282
1613351992218,3cyclictest1768937-21kworker/u8:0+events_unbound22:02:302
1613351992218,3cyclictest1717467-21kworker/u8:0+events_unbound20:55:182
1613351992218,3cyclictest1670840-21kworker/u8:4+events_unbound20:10:282
1613351992217,3cyclictest1842356-21/usr/sbin/munin22:50:152
1613351992215,5cyclictest335557-21systemd-journal19:40:012
1613349992219,2cyclictest1676074-21apt-get20:10:121
1613345992218,3cyclictest509-21rs:main0
1613355992117,3cyclictest1857879-21kworker/u8:4+flush-259:000:25:003
1613355992117,3cyclictest1580019-21kworker/u8:2+flush-259:019:15:233
1613351992118,2cyclictest1670840-21kworker/u8:4+flush-259:020:30:162
1613351992117,3cyclictest1909640-21kworker/u8:2+events_unbound23:53:292
1613351992117,3cyclictest1670839-21kworker/u8:1+events_unbound20:44:282
1613351992117,3cyclictest1623349-21kworker/u8:0+events_unbound19:50:272
1613351992116,4cyclictest1915036-21kworker/u8:0+events_unbound00:10:122
1613351992116,3cyclictest1654698-21latency_hist19:50:012
1613351992114,5cyclictest335557-21systemd-journal22:55:292
1613351992114,5cyclictest335557-21systemd-journal21:20:012
1613349992116,4cyclictest1878650-21apt-get23:25:161
1613345992116,4cyclictest1847538-21apt-get22:55:140
1613345992115,4cyclictest335557-21systemd-journal19:35:010
1613345992115,4cyclictest1768895-21latency_hist21:40:010
1613355992017,2cyclictest1675330-21unixbench_multi20:05:253
1613355992017,2cyclictest1670840-21kworker/u8:4+flush-259:020:10:213
1613355992016,3cyclictest1712060-21kworker/u8:2+flush-259:021:30:183
1613355992014,4cyclictest335557-21systemd-journal00:15:003
1613351992018,1cyclictest1738095-21kworker/u8:4+events_unbound21:35:222
1613351992016,2cyclictest1820574-21kworker/u8:2+flush-259:023:25:262
1613349992017,2cyclictest1712060-21kworker/u8:2+flush-259:021:50:171
1613349992016,3cyclictest1738131-21apt-get21:10:131
1613345992017,2cyclictest1738095-21kworker/u8:4+flush-259:021:20:180
1613345992016,3cyclictest1768937-21kworker/u8:0+flush-259:022:29:590
1613345992015,4cyclictest335557-21systemd-journal23:39:200
1613355991916,2cyclictest1826186-21kworker/u8:3+flush-259:023:00:183
1613355991915,3cyclictest335557-21systemd-journal23:06:193
1613355991915,3cyclictest335557-21systemd-journal21:56:283
1613355991915,3cyclictest1920455-21apt-get00:05:123
1613351991916,2cyclictest1722391-21sh20:54:592
1613351991915,3cyclictest1800496-21kworker/u8:3+events_unbound22:10:222
1613351991915,3cyclictest1738095-21kworker/u8:4+events_unbound21:21:192
1613349991916,2cyclictest1857879-21kworker/u8:4+flush-259:023:45:001
1613349991916,2cyclictest1644607-21apt-get19:40:121
1613345991915,3cyclictest1888714-21kworker/u8:1+flush-259:000:20:000
1613345991913,4cyclictest1618480-21latency_hist19:15:000
1613345991912,5cyclictest1706910-21latency_hist20:40:000
1613355991815,2cyclictest1623349-21kworker/u8:0+flush-259:019:45:193
1613351991814,3cyclictest1836508-21kworker/u8:1+events_unbound23:11:212
1613351991814,3cyclictest1836508-21kworker/u8:1+events_unbound23:11:212
1613351991814,3cyclictest1670839-21kworker/u8:1+events_unbound20:45:272
1613349991816,1cyclictest0-21swapper/121:35:001
1613349991815,2cyclictest1670839-21kworker/u8:1+flush-259:020:05:221
1613349991814,3cyclictest1935990-21apt-get00:20:131
1613349991811,5cyclictest1706058-21ntpq20:35:221
1613345991811,5cyclictest1622744-21ntpq19:15:190
1613355991713,3cyclictest1696729-21kworker/u8:3+flush-259:021:10:103
1613355991713,3cyclictest1369598-21kworker/u8:3+flush-259:020:00:313
161335599170,16cyclictest1835560-21ntpq22:40:203
1613351991713,3cyclictest1768937-21kworker/u8:0+events_unbound21:55:172
1613351991713,3cyclictest1712060-21kworker/u8:2+events_unbound21:25:122
1613351991713,3cyclictest1369598-21kworker/u8:3+events_unbound19:55:292
1613349991713,3cyclictest509-21rs:main1
1613349991713,3cyclictest1748507-21/usr/sbin/munin21:20:151
1613349991713,2cyclictest1638314-21ntp_kernel_pll_19:30:211
1613345991715,1cyclictest0-21swapper/019:55:000
1613345991713,3cyclictest1836466-21latency_hist22:44:590
1613345991713,3cyclictest1717467-21kworker/u8:0+flush-259:021:00:000
1613351991612,3cyclictest1800496-21kworker/u8:3+events_unbound22:20:202
1613351991612,3cyclictest1369598-21kworker/u8:3+flush-259:019:40:202
1613349991613,2cyclictest1670840-21kworker/u8:4+flush-259:020:15:171
1613349991613,2cyclictest1665052-21idleruntime-cro20:00:001
1613349991612,3cyclictest1649772-21kworker/u8:2+flush-259:020:20:181
1613349991612,2cyclictest1692022-21sort20:25:171
1613345991614,2cyclictest60350irq/132-enp0s29f1:rx-021:18:500
1613345991614,1cyclictest60350irq/132-enp0s29f1:rx-021:00:250
1613345991614,1cyclictest60350irq/132-enp0s29f1:rx-000:10:110
1613345991614,1cyclictest60350irq/132-enp0s29f1:rx-000:05:200
1613345991613,2cyclictest61150irq/133-enp0s29f1:tx-022:30:250
1613345991613,2cyclictest60350irq/132-enp0s29f1:rx-022:50:200
1613345991613,2cyclictest60350irq/132-enp0s29f1:rx-020:15:190
1613345991613,2cyclictest60350irq/132-enp0s29f1:rx-019:40:220
1613345991612,3cyclictest1768937-21kworker/u8:0+flush-259:023:45:150
1613345991610,4cyclictest1904203-21apt-get23:50:010
1613355991512,2cyclictest1904297-21apt-key23:50:003
1613355991512,2cyclictest1369598-21kworker/u8:3+flush-259:019:35:003
1613355991510,3cyclictest1613538-21/usr/sbin/munin19:10:163
161334999159,5cyclictest1799891-21kworker/u8:1+flush-259:022:20:001
161334999158,5cyclictest335557-21systemd-journal21:45:011
1613349991512,1cyclictest1624340-21irqcore19:20:191
1613349991512,1cyclictest0-21swapper/123:40:001
1613349991512,1cyclictest0-21swapper/122:10:011
1613349991510,4cyclictest1904203-21apt-get23:50:001
1613345991513,2cyclictest1670839-21kworker/u8:1+flush-259:020:20:250
1613345991513,1cyclictest60350irq/132-enp0s29f1:rx-023:20:190
1613345991513,1cyclictest60350irq/132-enp0s29f1:rx-023:10:170
1613345991513,1cyclictest60350irq/132-enp0s29f1:rx-023:10:170
1613345991513,1cyclictest60350irq/132-enp0s29f1:rx-022:10:210
1613345991513,1cyclictest60350irq/132-enp0s29f1:rx-021:10:170
1613345991513,1cyclictest60350irq/132-enp0s29f1:rx-020:50:170
1613345991512,2cyclictest60350irq/132-enp0s29f1:rx-023:18:590
1613345991512,2cyclictest60350irq/132-enp0s29f1:rx-022:35:210
1613345991512,2cyclictest60350irq/132-enp0s29f1:rx-022:00:010
1613345991512,1cyclictest0-21swapper/020:49:590
1613345991511,3cyclictest1857879-21kworker/u8:4+flush-259:023:05:230
161335599142,10cyclictest1727528-21awk20:59:593
1613355991412,1cyclictest0-21swapper/321:20:013
161335199149,4cyclictest1799891-21kworker/u8:1+events_unbound22:29:192
1613351991411,2cyclictest1696729-21kworker/u8:3+events_unbound21:10:172
1613351991410,3cyclictest1712060-21kworker/u8:2+flush-259:021:40:322
161334999149,4cyclictest1768937-21kworker/u8:0+events_unbound22:40:181
1613349991412,1cyclictest1618483-21idleruntime-cro19:15:001
1613349991411,2cyclictest1623349-21kworker/u8:0+flush-259:019:55:011
1613349991411,2cyclictest1619147-21irqcore19:15:151
1613345991412,1cyclictest60350irq/132-enp0s29f1:rx-019:20:180
1613345991412,1cyclictest0-21swapper/022:20:010
161335599139,3cyclictest1369598-21kworker/u8:3+flush-259:019:57:343
161335199139,3cyclictest1768937-21kworker/u8:0+events_unbound23:42:522
161335199139,3cyclictest1696729-21kworker/u8:3+events_unbound21:05:262
1613351991310,2cyclictest1920206-21kworker/u8:3+events_unbound00:05:122
161334999139,3cyclictest335557-21systemd-journal23:12:281
161334999139,3cyclictest335557-21systemd-journal23:12:281
161334999138,3cyclictest1670839-21kworker/u8:1+flush-259:020:45:001
1613349991310,2cyclictest1768937-21kworker/u8:0+flush-259:023:50:061
1613349991310,2cyclictest1712060-21kworker/u8:2+flush-259:021:50:001
1613349991310,2cyclictest0-21swapper/121:09:591
1613349991310,1cyclictest0-21swapper/123:10:001
1613345991311,1cyclictest60350irq/132-enp0s29f1:rx-023:30:130
1613345991311,1cyclictest60350irq/132-enp0s29f1:rx-019:35:050
161335599129,2cyclictest1951673-21cpuspeed_turbos00:35:153
161335599129,2cyclictest1748599-21cpuspeed_turbos21:20:123
161335199128,3cyclictest1623349-21kworker/u8:0+events_unbound19:23:312
161334999129,2cyclictest1910184-21cpuspeed_turbos23:55:151
161334999129,2cyclictest1768467-21unixbench_singl21:35:261
161334999129,2cyclictest1754733-21kthreadcore21:25:211
161334999127,4cyclictest1696729-21kworker/u8:3+flush-259:021:00:261
1613349991210,1cyclictest0-21swapper/122:25:191
1613345991210,1cyclictest60350irq/132-enp0s29f1:rx-022:45:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional