You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 11:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Wed Jun 24, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1494573994136,4cyclictest335557-21systemd-journal00:20:200
1494573994034,5cyclictest1713032-21latency_hist22:40:000
1494580993934,4cyclictest1645425-21base6421:35:012
1494573993731,4cyclictest509-21rs:main0
1494577993632,3cyclictest1800860-21/usr/sbin/munin00:05:181
1494582993531,3cyclictest1510144-21gpgv19:25:003
1494577993431,2cyclictest1656013-21kworker/u8:2+flush-259:022:10:001
1494577993328,3cyclictest1593913-21apt-get20:45:121
1494582993226,4cyclictest1743877-21latency_hist23:10:023
1494582993225,4cyclictest1630072-21/usr/sbin/munin21:20:153
1494577993227,3cyclictest1609152-21kworker/u8:0+flush-259:021:15:181
1494573993227,4cyclictest1671720-21apt-get22:00:120
1494573993226,5cyclictest1753222-21sshd23:15:200
1494582993024,5cyclictest335557-21systemd-journal19:20:013
1494577993026,3cyclictest1656013-21kworker/u8:2+flush-259:022:50:171
1494577993024,5cyclictest335557-21systemd-journal21:33:471
1494573993026,3cyclictest1505102-21kworker/u8:3+flush-259:020:50:180
1494577992925,3cyclictest1656013-21kworker/u8:2+flush-259:022:20:001
1494577992923,4cyclictest1764721-21apt-get23:30:101
1494577992923,4cyclictest1530178-21ntpq19:40:201
1494577992922,5cyclictest1583024-21cat20:35:011
1494573992926,2cyclictest1759528-21kworker/u8:2+flush-259:023:30:010
1494573992926,2cyclictest1526170-21kworker/u8:4+flush-259:020:30:170
1494573992925,3cyclictest1494747-21kworker/u8:0+events_unbound19:30:220
1494573992922,5cyclictest1702552-21/usr/sbin/munin22:30:170
1494573992922,5cyclictest1702552-21/usr/sbin/munin22:30:170
1494580992824,3cyclictest2570132-21kworker/u8:2+flush-259:019:20:012
1494580992824,3cyclictest1733630-21kworker/u8:3+events_unbound00:40:002
1494577992822,4cyclictest1614349-21latency_hist21:05:011
1494577992821,4cyclictest1634969-21latency_hist21:25:011
1494573992823,4cyclictest1795085-21kworker/u8:1+events_unbound00:06:220
1494573992823,4cyclictest1489394-21kworker/u8:3+events_unbound19:10:010
1494573992822,5cyclictest1650039-21ntpq21:35:270
1494580992724,2cyclictest1505102-21kworker/u8:3+flush-259:020:25:132
1494580992723,3cyclictest509-21rs:main2
149458099271,24cyclictest1-21systemd22:26:522
1494577992723,3cyclictest1526170-21kworker/u8:4+flush-259:021:30:011
1494577992722,3cyclictest1759562-21apt-get23:25:111
1494577992721,4cyclictest335557-21systemd-journal20:10:001
1494582992623,2cyclictest1541735-21apt-get19:55:113
1494573992622,3cyclictest1733630-21kworker/u8:3+events_unbound00:25:230
1494573992622,3cyclictest1505102-21kworker/u8:3+flush-259:021:45:250
1494573992621,3cyclictest1656013-21kworker/u8:2+flush-259:023:11:200
1494580992522,2cyclictest1655994-21kworker/u8:0+flush-259:021:45:012
1494580992520,3cyclictest1785365-21/usr/sbin/munin23:50:142
1494577992520,3cyclictest335557-21systemd-journal20:40:331
1494577992519,5cyclictest335557-21systemd-journal23:55:001
1494573992521,2cyclictest0-21swapper/023:45:010
1494573992520,3cyclictest1655994-21kworker/u8:0+events_unbound22:10:130
1494580992420,3cyclictest1733630-21kworker/u8:3+flush-259:000:20:262
1494580992418,5cyclictest1739007-21apt-get23:05:112
1494573992420,3cyclictest2570132-21kworker/u8:2+flush-259:019:10:240
1494573992420,3cyclictest1759528-21kworker/u8:2+events_unbound23:37:200
1494573992420,3cyclictest1526170-21kworker/u8:4+events_unbound19:50:230
1494582992316,5cyclictest1696321-21ntpq22:20:223
1494580992318,4cyclictest1821262-21kworker/u8:0+flush-259:000:30:252
1494580992318,3cyclictest1484055-21kworker/u8:1+events_unbound19:20:172
1494577992319,3cyclictest1744147-21apt-get23:10:121
1494577992317,4cyclictest335557-21systemd-journal20:55:421
1494573992317,4cyclictest1504874-21latency_hist19:20:000
1494582992218,3cyclictest1526170-21kworker/u8:4+flush-259:020:00:343
1494582992216,4cyclictest1774805-21latency_hist23:40:013
1494580992218,3cyclictest1655994-21kworker/u8:0+flush-259:022:05:002
1494580992217,4cyclictest1505102-21kworker/u8:3+flush-259:021:20:212
1494580992216,4cyclictest335557-21systemd-journal00:17:002
1494577992215,5cyclictest1550931-21ntpq20:00:291
1494573992219,2cyclictest1723346-21kworker/u8:0+flush-259:023:00:220
1494573992218,3cyclictest1733630-21kworker/u8:3+flush-259:023:20:160
1494573992218,3cyclictest1656013-21kworker/u8:2+events_unbound22:45:150
1494573992218,3cyclictest1656013-21kworker/u8:2+events_unbound22:45:150
1494573992217,4cyclictest1733630-21kworker/u8:3+flush-259:023:35:000
1494573992216,4cyclictest1588714-21apt-get20:40:110
1494573992215,5cyclictest335557-21systemd-journal23:07:200
1494580992118,2cyclictest1733630-21kworker/u8:3+flush-259:000:10:212
1494580992117,3cyclictest1718429-21/usr/sbin/munin22:45:222
1494580992117,3cyclictest1718429-21/usr/sbin/munin22:45:222
1494580992117,3cyclictest1551830-21kworker/u8:0+flush-259:020:10:172
1494573992118,2cyclictest1494747-21kworker/u8:0+events_unbound19:35:170
1494573992115,4cyclictest1556103-21ntpq20:05:200
1494573992114,5cyclictest1799754-21ntpq00:00:230
1494582992017,2cyclictest1733630-21kworker/u8:3+flush-259:023:25:003
1494582992016,3cyclictest1795085-21kworker/u8:1+flush-259:000:15:223
1494582992015,4cyclictest1645961-21apt-get21:35:133
1494582992015,4cyclictest1505102-21kworker/u8:3+flush-259:021:04:593
1494582992015,3cyclictest1656398-21diskstats21:45:153
1494580992016,3cyclictest1541188-21sshd19:51:382
1494580992016,3cyclictest1505102-21kworker/u8:3+flush-259:019:25:262
1494580992014,4cyclictest1618663-21ntpq21:05:222
1494577992016,2cyclictest1526170-21kworker/u8:4+flush-259:021:10:201
1494577992013,5cyclictest335557-21systemd-journal20:20:301
1494573992017,2cyclictest1526170-21kworker/u8:4+events_unbound20:55:170
1494573992016,3cyclictest1821262-21kworker/u8:0+events_unbound00:37:240
1494573992016,3cyclictest1733630-21kworker/u8:3+events_unbound00:11:220
1494573992016,3cyclictest1723346-21kworker/u8:0+events_unbound22:59:180
1494573992016,3cyclictest1505102-21kworker/u8:3+events_unbound20:25:240
1494573992014,4cyclictest335557-21systemd-journal21:24:420
149457399200,19cyclictest1666299-21turbostat21:55:000
1494582991916,2cyclictest509-21rs:main3
1494582991916,2cyclictest1837208-21gpgconf00:40:003
1494582991915,3cyclictest1826669-21apt-get00:30:123
1494582991915,3cyclictest1723346-21kworker/u8:0+flush-259:023:00:003
1494582991915,3cyclictest1640137-21kworker/u8:1+flush-259:021:40:253
1494580991916,2cyclictest1526170-21kworker/u8:4+events_unbound21:10:152
1494580991915,3cyclictest1582049-21ntp_offset20:30:232
1494577991916,2cyclictest1656013-21kworker/u8:2+flush-259:022:45:161
1494577991916,2cyclictest1656013-21kworker/u8:2+flush-259:022:45:161
1494577991915,3cyclictest1723346-21kworker/u8:0+events_unbound22:55:201
1494577991915,3cyclictest1505102-21kworker/u8:3+flush-259:021:45:161
1494577991914,3cyclictest1526170-21kworker/u8:4+events_unbound20:20:001
1494577991913,4cyclictest335557-21systemd-journal00:05:001
1494573991915,3cyclictest1484055-21kworker/u8:1+flush-259:019:20:240
1494573991914,4cyclictest1526170-21kworker/u8:4+events_unbound21:13:440
1494573991913,4cyclictest1718196-21latency_hist22:45:000
1494580991814,3cyclictest1759528-21kworker/u8:2+flush-259:023:30:242
1494580991814,3cyclictest1505102-21kworker/u8:3+events_unbound20:15:112
1494580991813,3cyclictest509-21rs:main2
1494577991812,4cyclictest1583399-21cat20:35:011
1494573991812,4cyclictest1551816-21latency_hist20:05:010
1494573991812,4cyclictest1510590-21gpgv19:25:020
1494582991715,1cyclictest0-21swapper/323:50:013
1494582991713,3cyclictest1764724-21kworker/u8:4+flush-259:023:55:263
1494582991712,3cyclictest335557-21systemd-journal19:12:393
1494582991712,3cyclictest335557-21systemd-journal00:30:003
1494580991713,3cyclictest1505102-21kworker/u8:3+flush-259:020:04:592
149457799173,6cyclictest1779972-21cron23:45:001
1494577991712,3cyclictest1603977-21latency_hist20:55:011
1494577991711,4cyclictest1666293-21latency_hist21:54:591
149457399179,6cyclictest1764724-21kworker/u8:4+flush-259:023:50:000
1494573991714,2cyclictest60350irq/132-enp0s29f1:rx-021:25:120
1494573991712,4cyclictest1645472-21gpgv21:35:010
1494582991613,2cyclictest1588436-21cron20:40:003
1494582991612,2cyclictest0-21swapper/300:15:003
1494580991613,2cyclictest1759528-21kworker/u8:2+flush-259:023:25:262
1494580991613,2cyclictest1494747-21kworker/u8:0+flush-259:019:35:002
1494580991611,4cyclictest1536504-21kworker/u8:2+flush-259:020:05:212
1494580991610,4cyclictest1749046-21latency_hist23:15:012
1494577991612,2cyclictest1536537-21apt-get19:50:111
1494573991613,2cyclictest60350irq/132-enp0s29f1:rx-022:25:230
1494573991613,2cyclictest60350irq/132-enp0s29f1:rx-020:45:180
1494573991612,3cyclictest1795085-21kworker/u8:1+events_unbound00:30:130
1494573991612,3cyclictest1795085-21kworker/u8:1+events_unbound00:15:140
1494573991612,3cyclictest1780016-21kworker/u8:0+flush-259:023:52:510
1494573991612,2cyclictest1692035-21turbostat22:19:590
1494573991611,3cyclictest1557251-21/usr/sbin/munin20:10:140
1494573991610,4cyclictest1583562-21apt-get20:35:120
1494582991512,2cyclictest1526170-21kworker/u8:4+flush-259:020:20:453
1494582991512,2cyclictest1526170-21kworker/u8:4+events_unbound19:45:183
1494582991510,4cyclictest1640109-21latency_hist21:30:013
1494580991512,2cyclictest1764724-21kworker/u8:4+flush-259:000:00:262
1494580991512,2cyclictest1583982-21irqcore20:35:172
1494580991511,3cyclictest1764724-21kworker/u8:4+flush-259:023:45:262
1494580991511,3cyclictest1723346-21kworker/u8:0+flush-259:022:50:222
1494577991512,2cyclictest0-21swapper/100:30:001
1494577991511,3cyclictest1795085-21kworker/u8:1+flush-259:000:20:261
1494577991510,3cyclictest335557-21systemd-journal20:00:001
149457799150,3cyclictest1785135-21idleruntime-cro23:50:001
1494573991513,2cyclictest60350irq/132-enp0s29f1:rx-023:57:260
1494573991513,1cyclictest60350irq/132-enp0s29f1:rx-021:55:520
1494573991512,2cyclictest60350irq/132-enp0s29f1:rx-022:51:160
1494573991512,2cyclictest60350irq/132-enp0s29f1:rx-022:20:120
1494573991512,2cyclictest60350irq/132-enp0s29f1:rx-019:42:030
1494573991511,3cyclictest1526170-21kworker/u8:4+flush-259:020:20:280
1494573991511,3cyclictest1526170-21kworker/u8:4+events_unbound21:05:150
1494573991510,3cyclictest1609152-21kworker/u8:0+events_unbound21:15:170
1494573991510,3cyclictest1526170-21kworker/u8:4+events_unbound19:45:190
149458299149,4cyclictest1552044-21kworker/u8:1+flush-259:020:08:433
1494582991412,1cyclictest0-21swapper/300:10:003
1494582991411,2cyclictest1764724-21kworker/u8:4+flush-259:023:40:213
1494582991411,2cyclictest1759528-21kworker/u8:2+flush-259:023:25:163
1494580991411,2cyclictest1821642-21cpuspeed_turbos00:25:132
1494580991411,2cyclictest1692472-21fschecks_count22:20:152
1494580991411,2cyclictest1635645-21irqcore21:25:162
1494580991411,2cyclictest1505102-21kworker/u8:3+flush-259:021:45:222
1494580991411,2cyclictest0-21swapper/219:39:592
1494580991411,1cyclictest0-21swapper/222:40:002
1494580991410,3cyclictest1780016-21kworker/u8:0+events_unbound23:55:232
1494580991410,3cyclictest1764724-21kworker/u8:4+events_unbound23:40:202
1494580991410,3cyclictest1505102-21kworker/u8:3+events_unbound20:50:232
1494577991412,1cyclictest0-21swapper/100:34:591
1494577991411,2cyclictest1774799-21cron23:40:001
1494577991411,2cyclictest1686480-21unixbench_singl22:10:241
1494577991411,2cyclictest1516292-21irqcore19:30:151
149457399149,4cyclictest1609399-21apt-get21:00:120
149458299139,3cyclictest0-21swapper/320:30:003
149458299138,3cyclictest509-21rs:main3
1494582991310,2cyclictest1733996-21cpuspeed_turbos23:00:123
1494582991310,2cyclictest1599177-21cpuspeed_turbos20:50:143
1494582991310,2cyclictest1587982-21kworker/u8:0+flush-259:020:45:163
1494582991310,2cyclictest1582455-21unixbench_singl20:30:273
1494582991310,2cyclictest1526170-21kworker/u8:4+flush-259:020:40:163
1494582991310,2cyclictest1505102-21kworker/u8:3+flush-259:020:15:143
149458099139,2cyclictest335557-21systemd-journal19:40:232
149458099137,3cyclictest1707469-21apt-get22:35:012
149458099137,3cyclictest1707469-21apt-get22:35:012
149458099131,2cyclictest1593657-21awk20:45:002
1494580991310,2cyclictest1505102-21kworker/u8:3+flush-259:021:00:252
1494577991311,1cyclictest1734881-21kthreadcore23:00:171
1494577991311,1cyclictest0-21swapper/120:25:231
1494573991311,1cyclictest60350irq/132-enp0s29f1:rx-022:09:170
149458299129,2cyclictest1748246-21cut23:10:243
149458299129,2cyclictest0-21swapper/321:35:013
149458299128,3cyclictest1505102-21kworker/u8:3+flush-259:021:15:013
149458299127,3cyclictest1-21systemd21:55:003
1494582991210,1cyclictest1671941-21fschecks_time22:00:143
149458099129,2cyclictest1723346-21kworker/u8:0+events_unbound22:55:162
149458099129,2cyclictest1526170-21kworker/u8:4+flush-259:019:45:242
149458099129,2cyclictest1526170-21kworker/u8:4+events_unbound19:55:232
149458099128,3cyclictest1505102-21kworker/u8:3+flush-259:021:55:002
149457799129,2cyclictest1833008-21kthreadcore00:35:161
149457799129,2cyclictest1557497-21fschecks_time20:10:151
149457799128,3cyclictest1640137-21kworker/u8:1+flush-259:021:41:531
149457799127,4cyclictest1656013-21kworker/u8:2+flush-259:021:55:281
1494577991210,1cyclictest0-21swapper/121:10:011
149458099119,1cyclictest0-21swapper/222:15:232
149458099117,3cyclictest1656013-21kworker/u8:2+events_unbound22:40:212
149457799118,2cyclictest1646980-21kthreadcore21:35:221
149457799117,3cyclictest1494747-21kworker/u8:0+flush-259:019:26:441
1494573991110,1cyclictest60350irq/132-enp0s29f1:rx-021:41:310
149458299107,2cyclictest1749371-21cpuspeed_turbos23:15:133
149458299107,2cyclictest1619121-21unixbench_singl21:05:263
149458299106,3cyclictest1505102-21kworker/u8:3+flush-259:021:15:253
149458299106,3cyclictest1505102-21kworker/u8:3+flush-259:019:36:443
149458099107,2cyclictest1682083-21cpuspeed_turbos22:10:122
149457799108,1cyclictest0-21swapper/122:25:201
149457799107,1cyclictest0-21swapper/119:25:001
14945829996,2cyclictest491ktimers/322:40:213
14945829995,2cyclictest1718828-21if_enp0s30f422:45:163
14945829995,2cyclictest1718828-21if_enp0s30f422:45:163
14945809984,2cyclictest1800891-21grep00:05:172
14945779980,1cyclictest16932042irqcore22:20:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional