You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 15:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Jun 11, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1739917993835,2cyclictest2061730-21kworker/u8:1+flush-259:000:25:183
1739907993833,4cyclictest1775512-21ntpq19:40:200
1739907993832,4cyclictest335557-21systemd-journal23:49:590
1739907993631,3cyclictest509-21rs:main0
1739912993428,4cyclictest2025550-21/usr/sbin/munin23:45:152
1739912993427,5cyclictest335557-21systemd-journal22:00:012
1739917993329,3cyclictest1921487-21kworker/u8:4+flush-259:022:55:013
1739912993327,4cyclictest1802585-21latency_hist20:10:012
1739912993326,5cyclictest1750605-21latency_hist19:20:002
1739907993329,3cyclictest335557-21systemd-journal19:47:370
1739917993226,4cyclictest2025311-21latency_hist23:45:003
1739912993126,3cyclictest1921487-21kworker/u8:4+flush-259:023:25:162
1739909993126,3cyclictest1921705-21apt-get22:05:111
1739907993125,4cyclictest2046027-21latency_hist00:05:000
1739917993026,3cyclictest1797162-21kworker/u8:3+flush-259:020:20:243
1739912993026,3cyclictest335557-21systemd-journal22:36:292
1739909993026,3cyclictest1978854-21kworker/u8:0+events_unbound23:30:231
1739909993025,4cyclictest335557-21systemd-journal22:11:241
1739909992922,5cyclictest1812025-21ntpq20:15:211
1739912992824,3cyclictest1921487-21kworker/u8:4+flush-259:000:20:152
1739912992822,4cyclictest1999626-21latency_hist23:20:012
1739912992821,5cyclictest1921446-21latency_hist22:05:002
1739907992824,3cyclictest2010112-21/usr/sbin/munin23:30:130
1739907992824,3cyclictest1895591-21apt-get21:40:110
1739917992723,3cyclictest1838974-21apt-get20:45:123
1739917992723,3cyclictest1782288-21apt-get19:50:123
1739912992721,4cyclictest335557-21systemd-journal22:45:002
1739909992723,3cyclictest1740121-21apt-get19:10:101
1739907992723,3cyclictest1859530-21apt-get21:05:130
1739917992621,4cyclictest335557-21systemd-journal23:00:373
1739912992621,3cyclictest1859279-21kworker/u8:1+events_unbound22:50:162
1739912992520,3cyclictest2051160-21sh00:09:592
1739907992522,2cyclictest1797162-21kworker/u8:3+flush-259:020:30:100
1739907992519,4cyclictest1943375-21cut22:25:150
1739912992420,3cyclictest1921487-21kworker/u8:4+events_unbound23:10:202
1739912992419,4cyclictest1905631-21kworker/u8:2+events_unbound21:50:182
1739909992419,4cyclictest2060641-21ntpq00:15:211
1739909992417,5cyclictest1968770-21latency_hist22:50:011
173990999240,17cyclictest1890192-21apt21:34:591
1739907992420,3cyclictest1797162-21kworker/u8:3+flush-259:020:40:130
1739909992318,4cyclictest1802625-21kworker/u8:0+flush-259:021:15:121
1739909992318,3cyclictest1787451-21apt-get19:55:121
1739909992317,5cyclictest1817168-21ntpq20:20:191
1739909992317,4cyclictest1905601-21http21:50:001
1739909992310,11cyclictest335557-21systemd-journal21:09:541
1739907992318,4cyclictest335557-21systemd-journal21:35:000
1739907992317,4cyclictest1978111-21ntpq22:55:210
1739907992317,4cyclictest1807741-21latency_hist20:15:020
1739917992218,3cyclictest2025330-21kworker/u8:2+flush-259:000:10:153
1739912992218,3cyclictest2031477-21kworker/u8:0+flush-259:023:55:162
1739912992218,3cyclictest1802625-21kworker/u8:0+flush-259:021:25:232
1739912992218,3cyclictest1771091-21kworker/u8:2+events_unbound19:45:212
1739912992217,4cyclictest1978854-21kworker/u8:0+flush-259:023:40:212
1739912992216,4cyclictest335557-21systemd-journal22:57:362
1739912992216,4cyclictest1937590-21/usr/sbin/munin22:20:132
1739912992216,4cyclictest1859279-21kworker/u8:1+events_unbound21:40:172
1739912992214,5cyclictest1905759-21cat21:50:002
1739909992217,4cyclictest1859279-21kworker/u8:1+flush-259:023:24:591
1739907992216,5cyclictest335557-21systemd-journal21:55:010
1739907992216,4cyclictest335557-21systemd-journal23:56:500
1739917992118,2cyclictest1895328-21latency_hist21:39:593
1739917992117,3cyclictest1921487-21kworker/u8:4+flush-259:023:25:253
1739917992116,3cyclictest1754926-21ntpq19:20:203
173991299215,9cyclictest2046031-21awk00:05:002
1739912992117,3cyclictest1859279-21kworker/u8:1+events_unbound22:10:142
1739912992116,4cyclictest2025330-21kworker/u8:2+flush-259:023:50:202
1739912992116,3cyclictest1797162-21kworker/u8:3+flush-259:020:30:002
1739912992115,4cyclictest1739867-21kworker/u8:3+flush-259:019:40:162
1739909992116,4cyclictest1947700-21kworker/u8:2+flush-259:022:35:211
1739917992014,4cyclictest1838715-21turbostat20:44:593
1739912992016,3cyclictest1916367-21kworker/u8:0+events_unbound22:10:012
1739912992016,3cyclictest1859279-21kworker/u8:1+flush-259:021:20:222
1739912992015,3cyclictest1777094-21kworker/u8:0+events_unbound19:55:162
1739912992015,3cyclictest1734957-21kworker/u8:2+events_unbound19:10:172
1739909992017,2cyclictest1921487-21kworker/u8:4+flush-259:022:25:151
1739909992015,3cyclictest1676225-21kworker/u8:0+flush-259:019:30:101
1739909992014,4cyclictest1833546-21latency_hist20:40:011
1739907992017,2cyclictest1859279-21kworker/u8:1+flush-259:022:50:210
1739907992016,3cyclictest1890179-21kworker/u8:3+flush-259:021:50:000
1739917991916,2cyclictest1797162-21kworker/u8:3+flush-259:020:30:203
1739917991915,2cyclictest0-21swapper/320:54:593
1739912991916,2cyclictest1978854-21kworker/u8:0+flush-259:023:05:212
1739912991915,3cyclictest2050982-21kworker/u8:1+flush-259:000:10:212
1739912991915,3cyclictest1859279-21kworker/u8:1+events_unbound23:20:222
1739912991914,4cyclictest2061730-21kworker/u8:1+flush-259:000:25:162
1739912991914,4cyclictest1797162-21kworker/u8:3+events_unbound20:20:202
1739912991913,4cyclictest1963180-21apt-get22:45:032
1739912991913,4cyclictest1734957-21kworker/u8:2+flush-259:019:20:152
1739912991912,5cyclictest335557-21systemd-journal23:05:002
173991299191,15cyclictest1-21systemd23:39:592
173990999199,9cyclictest1792988-21irqcore20:00:181
1739909991914,3cyclictest1818351-21apt-get20:25:101
1739907991916,2cyclictest490-21dbus-daemon22:45:010
1739907991914,4cyclictest1745532-21cat19:15:000
1739917991814,3cyclictest335557-21systemd-journal22:34:553
1739917991813,3cyclictest509-21rs:main3
173991299182,8cyclictest1874783-21munin-run21:19:592
1739912991814,3cyclictest2025330-21kworker/u8:2+events_unbound00:33:412
1739912991814,3cyclictest1916367-21kworker/u8:0+events_unbound22:15:222
173990999181,4cyclictest1916313-21cron22:00:001
1739909991814,3cyclictest1932453-21apt-get22:15:121
1739909991814,3cyclictest1859279-21kworker/u8:1+flush-259:021:20:121
1739917991713,3cyclictest1859279-21kworker/u8:1+flush-259:021:55:113
1739917991712,4cyclictest1760106-21ntpq19:25:223
1739912991714,2cyclictest1797162-21kworker/u8:3+flush-259:020:40:162
1739912991713,3cyclictest1797162-21kworker/u8:3+flush-259:020:10:252
1739912991712,3cyclictest1802625-21kworker/u8:0+events_unbound20:35:152
1739912991711,5cyclictest1797446-21latency_hist20:05:012
173990999175,1cyclictest507-21in:imuxsock20:54:591
173990999174,3cyclictest490-21dbus-daemon19:45:001
173990999170,1cyclictest1859271-21munin-run21:04:591
1739907991713,3cyclictest2031477-21kworker/u8:0+flush-259:000:05:160
1739907991713,3cyclictest1978854-21kworker/u8:0+flush-259:023:30:000
1739907991712,4cyclictest1978854-21kworker/u8:0+flush-259:023:35:220
1739917991611,4cyclictest1947700-21kworker/u8:2+flush-259:022:35:163
173991299169,5cyclictest335557-21systemd-journal20:35:012
1739912991612,3cyclictest1859279-21kworker/u8:1+flush-259:021:35:202
1739912991612,3cyclictest1755790-21kworker/u8:1+flush-259:019:35:212
173990999169,6cyclictest0-21swapper/120:45:141
173990999164,2cyclictest1999623-21turbostat.cron23:20:001
1739909991612,3cyclictest500-21systemd-logind00:30:011
1739909991611,4cyclictest335557-21systemd-journal00:00:001
1739909991611,4cyclictest1859279-21kworker/u8:1+flush-259:023:00:271
173990999160,4cyclictest1952870-21grep22:35:011
1739907991614,1cyclictest60350irq/132-enp0s29f1:rx-021:00:240
1739907991614,1cyclictest60350irq/132-enp0s29f1:rx-000:30:140
1739907991614,1cyclictest60350irq/132-enp0s29f1:rx-000:21:050
1739907991613,2cyclictest1983905-21journal-offline23:01:330
1739907991612,3cyclictest2061730-21kworker/u8:1+flush-259:000:28:440
1739907991612,3cyclictest1802625-21kworker/u8:0+flush-259:020:35:230
1739907991612,2cyclictest1802577-21turbostat20:10:000
1739907991610,4cyclictest1864876-21diskstats21:10:130
1739917991513,1cyclictest0-21swapper/319:45:003
1739917991511,3cyclictest335557-21systemd-journal20:06:053
1739912991512,2cyclictest2060594-21ntp_kernel_pll_00:15:212
1739912991512,2cyclictest1921487-21kworker/u8:4+events_unbound22:25:172
1739912991511,3cyclictest1802625-21kworker/u8:0+events_unbound21:00:182
1739912991511,3cyclictest1739867-21kworker/u8:3+events_unbound19:30:202
1739912991510,4cyclictest1797162-21kworker/u8:3+events_unbound20:50:142
1739912991510,3cyclictest1952846-21cron22:35:012
1739912991510,3cyclictest1859279-21kworker/u8:1+flush-259:021:33:412
173990999156,1cyclictest0-21swapper/120:10:181
173990999155,1cyclictest0-21swapper/123:40:241
173990999155,1cyclictest0-21swapper/119:45:241
173990999154,2cyclictest2029604-21ntpq23:45:221
173990999154,1cyclictest0-21swapper/122:20:121
1739909991512,2cyclictest507-21in:imuxsock22:05:001
1739909991512,2cyclictest1771275-21cron19:40:011
1739909991511,3cyclictest2061730-21kworker/u8:1+flush-259:000:30:141
1739909991511,3cyclictest1739867-21kworker/u8:3+flush-259:019:15:061
1739909991511,3cyclictest0-21swapper/120:35:001
173990999150,7cyclictest2066692-21cat00:25:011
173990999150,2cyclictest1760915-21cron19:30:001
1739907991514,1cyclictest60350irq/132-enp0s29f1:rx-022:18:090
1739907991513,1cyclictest60350irq/132-enp0s29f1:rx-023:20:230
1739907991513,1cyclictest60350irq/132-enp0s29f1:rx-023:15:140
1739907991513,1cyclictest60350irq/132-enp0s29f1:rx-023:09:510
1739907991513,1cyclictest60350irq/132-enp0s29f1:rx-022:20:180
1739907991513,1cyclictest60350irq/132-enp0s29f1:rx-022:08:580
1739907991513,1cyclictest60350irq/132-enp0s29f1:rx-021:35:220
1739907991513,1cyclictest60350irq/132-enp0s29f1:rx-020:27:050
1739907991513,1cyclictest60350irq/132-enp0s29f1:rx-000:37:130
1739907991513,1cyclictest60350irq/132-enp0s29f1:rx-000:10:150
1739907991512,2cyclictest60350irq/132-enp0s29f1:rx-020:15:210
1739907991511,3cyclictest1739867-21kworker/u8:3+flush-259:019:30:150
1739907991511,3cyclictest1676225-21kworker/u8:0+flush-259:019:15:000
1739907991510,3cyclictest2061470-21latency_hist00:19:590
173991799148,4cyclictest1968762-21awk22:50:003
1739917991412,1cyclictest1927910-21kthreadcore22:10:183
1739917991411,2cyclictest1746174-21irqcore19:15:163
1739917991410,3cyclictest1802625-21kworker/u8:0+flush-259:020:35:113
173991299149,4cyclictest1978854-21kworker/u8:0+events_unbound23:30:172
173991299147,5cyclictest1854104-21latency_hist21:00:012
1739912991411,2cyclictest1859951-21sed21:05:172
1739912991410,3cyclictest1777094-21kworker/u8:0+events_unbound19:51:032
173990999145,1cyclictest0-21swapper/121:50:031
173990999144,1cyclictest0-21swapper/119:20:121
173990999142,4cyclictest1975791-21cat22:55:181
1739909991411,2cyclictest2030823-21cpuspeed_turbos23:50:111
173990999140,5cyclictest1894437-21ntpq21:35:201
1739907991413,1cyclictest60350irq/132-enp0s29f1:rx-019:20:120
1739907991412,1cyclictest60350irq/132-enp0s29f1:rx-023:40:130
1739907991412,1cyclictest60350irq/132-enp0s29f1:rx-022:45:060
1739907991411,2cyclictest60350irq/132-enp0s29f1:rx-023:10:200
1739907991411,2cyclictest60350irq/132-enp0s29f1:rx-022:35:480
1739907991411,2cyclictest60350irq/132-enp0s29f1:rx-022:30:230
1739907991411,2cyclictest1786259-21ntp_kernel_err19:50:190
173991799139,3cyclictest503-21tpm2-abrmd21:50:013
173991799139,3cyclictest335557-21systemd-journal21:51:213
173991799139,3cyclictest2072114-21cpuspeed_turbos00:30:123
173991799139,3cyclictest1921487-21kworker/u8:4+flush-259:023:20:113
173991799139,3cyclictest1787187-21turbostat19:59:553
173991799139,2cyclictest1895788-21fschecks_count21:40:143
173991799138,4cyclictest1879007-21ntpq21:20:193
173991799138,4cyclictest1802625-21kworker/u8:0+flush-259:021:00:073
173991799138,3cyclictest335557-21systemd-journal20:19:553
173991799138,3cyclictest1885067-21sleep21:30:003
1739917991311,1cyclictest2078273-21kthreadcore00:35:173
1739917991311,1cyclictest1887604-21kthreadcore21:30:183
1739917991310,2cyclictest1777385-21fschecks_time19:45:143
1739917991310,2cyclictest0-21swapper/321:09:593
173990999134,1cyclictest0-21swapper/120:40:261
173990999133,3cyclictest1787170-21cron19:55:001
1739909991310,2cyclictest1895665-21cpuspeed_turbos21:40:131
1739909991310,2cyclictest1884621-21unixbench_singl21:25:241
173990799139,3cyclictest60350irq/132-enp0s29f1:rx-020:45:120
173990799138,4cyclictest60350irq/132-enp0s29f1:rx-022:00:140
1739907991311,1cyclictest60350irq/132-enp0s29f1:rx-022:11:520
1739907991311,1cyclictest60350irq/132-enp0s29f1:rx-021:28:010
1739907991311,1cyclictest60350irq/132-enp0s29f1:rx-021:15:140
1739907991311,1cyclictest60350irq/132-enp0s29f1:rx-020:20:250
1739907991311,1cyclictest60350irq/132-enp0s29f1:rx-020:00:260
1739907991311,1cyclictest60350irq/132-enp0s29f1:rx-019:58:320
1739907991311,1cyclictest60350irq/132-enp0s29f1:rx-019:35:210
1739907991310,2cyclictest60350irq/132-enp0s29f1:rx-023:50:180
173990799130,12cyclictest1760940-21turbostat19:30:000
173991799128,3cyclictest1921487-21kworker/u8:4+flush-259:000:17:173
173991799128,3cyclictest1802625-21kworker/u8:0+flush-259:021:15:263
173991799126,4cyclictest335557-21systemd-journal19:15:013
173991299128,2cyclictest0-21swapper/221:10:252
173990999123,2cyclictest2019721-21unixbench_singl23:35:241
173990999121,4cyclictest2081297-21ntpq00:35:211
173990999121,2cyclictest2051427-21apt-get00:10:111
173990999120,5cyclictest1962272-21ntpq22:40:191
173990999120,5cyclictest1868753-21ntpq21:10:221
173990999120,4cyclictest2005193-21df23:25:141
173990799129,2cyclictest60350irq/132-enp0s29f1:rx-021:55:150
173991799118,2cyclictest0-21swapper/323:05:193
173991799118,1cyclictest0-21swapper/320:55:243
173991799117,2cyclictest2050312-21ntpq00:05:213
173991799111,2cyclictest1963180-21apt22:45:013
173991299118,2cyclictest0-21swapper/220:15:162
173991299117,2cyclictest0-21swapper/219:25:232
173990799118,2cyclictest1879423-21unixbench_multi21:20:240
173991799108,1cyclictest0-21swapper/323:50:123
173991799108,1cyclictest0-21swapper/322:25:153
173991799108,1cyclictest0-21swapper/321:10:173
173991799107,1cyclictest1935209-21kthreadcore22:15:183
173991799106,3cyclictest2025330-21kworker/u8:2+flush-259:023:45:223
173991799106,2cyclictest0-21swapper/320:25:173
173991799100,8cyclictest2015164-21cat23:35:013
17399179986,1cyclictest0-21swapper/319:30:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional