You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 23:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Jul 27, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1670096996356,4cyclictest335557-21systemd-journal07:35:001
1670096996154,5cyclictest1873705-21cat10:25:011
1670093994842,4cyclictest335557-21systemd-journal09:14:490
1670103994639,5cyclictest1957358-21latency_hist11:45:013
1670096994641,3cyclictest3792832-21kworker/u8:1+flush-259:007:25:001
1670096993935,3cyclictest1930824-21kworker/u8:2+events_unbound11:40:011
1670093993935,3cyclictest1701101-21kworker/u8:0+flush-259:007:50:000
1670099993733,3cyclictest1842148-21kworker/u8:0+flush-259:011:00:212
1670096993732,3cyclictest335557-21systemd-journal08:50:481
1670093993630,4cyclictest1920530-21cp11:10:000
1670096993531,3cyclictest1920559-21kworker/u8:3+events_unbound11:22:481
1670096993530,4cyclictest1852853-21latency_hist10:05:011
1670096993431,2cyclictest1972620-21kworker/u8:1+events_unbound12:21:481
1670096993431,2cyclictest1842148-21kworker/u8:0+events_unbound10:19:491
1670096993431,2cyclictest1842148-21kworker/u8:0+events_unbound10:19:491
1670093993429,4cyclictest335557-21systemd-journal09:29:480
1670096993330,2cyclictest1701101-21kworker/u8:0+events_unbound08:00:241
1670103993225,5cyclictest1741955-21ntpq08:15:193
1670096993228,3cyclictest1972620-21kworker/u8:1+events_unbound12:30:181
1670096993227,3cyclictest1962785-21kworker/u8:4+flush-259:012:15:211
1670096993225,5cyclictest2003920-21latency_hist12:30:011
1670099993126,4cyclictest1701313-21/usr/sbin/munin07:40:152
1670096993127,3cyclictest1800546-21kworker/u8:4+events_unbound09:55:491
1670103993023,5cyclictest1805003-21ntpq09:15:213
1670099993025,4cyclictest335557-21systemd-journal09:10:482
1670096993026,3cyclictest1930824-21kworker/u8:2+events_unbound11:56:491
1670103992923,4cyclictest1998701-21latency_hist12:25:003
1670099992925,3cyclictest1784653-21latency_hist09:00:012
1670096992926,2cyclictest1930824-21kworker/u8:2+events_unbound11:46:491
1670096992926,2cyclictest1800546-21kworker/u8:4+flush-259:009:20:211
1670096992925,3cyclictest1910060-21kworker/u8:1+events_unbound11:15:141
1670096992924,4cyclictest1706906-21kworker/u8:4+flush-259:008:30:001
1670093992924,4cyclictest1946592-21apt-get11:35:010
1670093992924,3cyclictest335557-21systemd-journal12:00:130
1670093992922,5cyclictest335557-21systemd-journal11:15:000
1670103992824,3cyclictest1920370-21gpgv11:10:003
1670103992821,5cyclictest1878257-21ntpq10:25:253
1670103992821,4cyclictest335557-21systemd-journal11:35:023
1670096992825,2cyclictest1853089-21kworker/u8:2+events_unbound10:45:131
1670096992824,3cyclictest1853089-21kworker/u8:2+events_unbound10:10:141
1670096992824,3cyclictest1758045-21kworker/u8:2+flush-259:009:10:001
1670096992824,3cyclictest1632663-21kworker/u8:0+events_unbound07:14:271
1670093992822,4cyclictest1847307-21gpgv10:00:000
1670103992720,5cyclictest1983210-21latency_hist12:10:013
1670099992723,3cyclictest1832040-21apt-get09:45:132
1670099992721,4cyclictest1690767-21latency_hist07:30:002
1670096992724,2cyclictest1732474-21kworker/u8:1+events_unbound08:15:131
1670096992724,2cyclictest1701101-21kworker/u8:0+flush-259:009:00:491
1670096992723,3cyclictest1930824-21kworker/u8:2+events_unbound11:40:491
1670096992723,3cyclictest1805910-21kworker/u8:2+events_unbound09:47:501
1670096992723,3cyclictest1701101-21kworker/u8:0+events_unbound09:11:481
1670096992721,4cyclictest335557-21systemd-journal09:30:481
1670093992723,3cyclictest1988655-21apt-get12:15:130
1670103992621,3cyclictest1706906-21kworker/u8:4+flush-259:008:05:003
1670096992623,2cyclictest1962785-21kworker/u8:4+events_unbound12:03:511
1670096992623,2cyclictest1701101-21kworker/u8:0+events_unbound08:57:501
1670096992621,4cyclictest1701101-21kworker/u8:0+events_unbound09:26:491
1670093992620,4cyclictest1931082-21latency_hist11:20:020
1670093992618,6cyclictest335557-21systemd-journal09:55:000
1670096992522,2cyclictest1670055-21kworker/u8:2+events_unbound07:19:271
1670096992521,3cyclictest1842148-21kworker/u8:0+events_unbound11:00:121
1670093992520,3cyclictest335557-21systemd-journal08:54:540
1670103992421,2cyclictest1920559-21kworker/u8:3+flush-259:011:15:223
1670103992420,3cyclictest335557-21systemd-journal10:46:483
1670103992416,6cyclictest1695942-21latency_hist07:35:003
1670103992319,3cyclictest1774563-21/usr/sbin/munin08:50:143
1670103992317,4cyclictest1711881-21latency_hist07:50:013
1670099992318,4cyclictest1795421-21latency_hist09:10:022
1670096992320,2cyclictest1837189-21apt-get09:50:091
1670096992319,3cyclictest1910060-21kworker/u8:1+events_unbound11:14:491
1670093992318,3cyclictest1889709-21apt-get10:40:120
1670099992216,4cyclictest335557-21systemd-journal10:05:482
1670099992216,4cyclictest1826600-21latency_hist09:40:002
1670099992215,5cyclictest1909177-21ntpq10:55:232
1670096992219,2cyclictest1930824-21kworker/u8:2+events_unbound11:30:151
1670096992218,3cyclictest1853089-21kworker/u8:2+flush-259:011:05:251
1670096992218,2cyclictest0-21swapper/108:45:001
1670103992117,3cyclictest1722226-21kworker/u8:2+events_unbound08:05:153
1670103992114,5cyclictest1670023-21latency_hist07:10:003
1670099992115,4cyclictest335557-21systemd-journal11:23:482
1670103992017,2cyclictest1758045-21kworker/u8:2+flush-259:008:55:263
1670099992014,5cyclictest335557-21systemd-journal08:29:412
167009399207,2cyclictest1695123-21ntpq07:30:220
167009399205,4cyclictest1747192-21ntpq08:20:220
1670093992016,3cyclictest507-21in:imuxsock11:55:000
1670093992016,3cyclictest1998970-21apt-get12:25:120
1670093992014,4cyclictest1858311-21apt-get10:10:140
1670103991916,2cyclictest1763764-21latency_hist08:40:013
1670103991916,2cyclictest0-21swapper/307:45:003
1670103991915,3cyclictest1617188-21kworker/u8:5+events_unbound07:13:393
167009999198,2cyclictest1816592-21cpuspeed_turbos09:30:152
1670099991916,2cyclictest1701101-21kworker/u8:0+flush-259:008:45:262
1670099991915,3cyclictest1930824-21kworker/u8:2+flush-259:011:30:152
1670099991915,2cyclictest1897164-21kthreadcore10:45:182
1670099991915,2cyclictest1863906-21irqcore10:15:172
1670099991915,2cyclictest1863906-21irqcore10:15:162
1670099991914,4cyclictest1847845-21gpgv10:00:012
167009399195,4cyclictest1898890-21ntpq10:45:210
1670093991912,5cyclictest1872639-21ntpq10:20:200
1670099991813,4cyclictest1972620-21kworker/u8:1+flush-259:012:05:172
1670099991813,4cyclictest1800546-21kworker/u8:4+flush-259:009:30:012
1670099991813,4cyclictest1701101-21kworker/u8:0+flush-259:007:50:152
1670099991812,4cyclictest335557-21systemd-journal07:55:382
1670099991812,4cyclictest335557-21systemd-journal07:55:382
1670096991815,2cyclictest1831818-21kworker/u8:1+events_unbound10:10:001
1670096991814,3cyclictest1962785-21kworker/u8:4+flush-259:012:05:251
1670096991814,3cyclictest1706906-21kworker/u8:4+events_unbound07:59:301
1670096991814,3cyclictest1706906-21kworker/u8:4+events_unbound07:59:301
1670096991814,3cyclictest1701101-21kworker/u8:0+events_unbound09:35:151
1670096991811,5cyclictest335557-21systemd-journal07:30:001
167009399186,2cyclictest1867453-21ntpq10:15:210
167009399186,2cyclictest1867453-21ntpq10:15:210
1670093991815,2cyclictest1706906-21kworker/u8:4+flush-259:008:20:000
1670093991813,4cyclictest1820537-21ntpq09:30:230
1670093991812,4cyclictest1790254-21latency_hist09:05:010
167009399180,16cyclictest1753240-21true08:30:000
1670103991714,2cyclictest1873527-21cron10:25:003
1670103991714,2cyclictest1701075-21latency_hist07:40:003
1670103991714,1cyclictest0-21swapper/311:15:013
1670103991710,5cyclictest335557-21systemd-journal09:25:003
1670099991710,5cyclictest335557-21systemd-journal09:44:592
1670096991714,2cyclictest3792832-21kworker/u8:1+flush-259:007:35:261
1670096991714,2cyclictest1701101-21kworker/u8:0+events_unbound07:50:121
1670096991713,3cyclictest1853089-21kworker/u8:2+events_unbound10:50:081
1670096991713,3cyclictest1701101-21kworker/u8:0+events_unbound08:45:301
1670096991712,3cyclictest1842148-21kworker/u8:0+flush-259:010:35:161
167009399172,5cyclictest1829665-21grep09:40:180
167009399171,6cyclictest1680504-21cat07:19:590
1670093991711,4cyclictest1910032-21latency_hist11:00:000
167009999169,5cyclictest335557-21systemd-journal08:41:482
167009999169,5cyclictest1789399-21ntpq09:00:242
167009999167,1cyclictest0-21swapper/212:25:002
1670099991613,2cyclictest1758406-21idleruntime-cro08:35:002
1670099991612,2cyclictest1993534-21idleruntime-cro12:20:002
1670099991610,4cyclictest335557-21systemd-journal10:35:002
1670096991614,1cyclictest0-21swapper/108:10:001
1670096991612,3cyclictest3792832-21kworker/u8:1+flush-259:007:40:211
1670096991612,3cyclictest1957377-21kworker/u8:0+events_unbound11:50:171
1670096991612,3cyclictest1853089-21kworker/u8:2+events_unbound10:25:171
1670096991612,3cyclictest1706906-21kworker/u8:4+events_unbound08:20:181
167009399164,2cyclictest1853122-21apt-get10:05:120
167009399164,2cyclictest1794531-21ntpq09:05:230
167009399161,5cyclictest1911729-21grep11:00:180
1670093991614,1cyclictest60350irq/132-enp0s29f1:rx-007:20:060
1670093991613,2cyclictest60350irq/132-enp0s29f1:rx-012:05:240
1670093991613,2cyclictest60350irq/132-enp0s29f1:rx-009:35:120
1670093991612,3cyclictest335557-21systemd-journal11:20:470
167009399160,2cyclictest0-21swapper/008:45:000
1670103991512,2cyclictest1958049-21sed11:45:163
1670103991512,2cyclictest1858725-21irqcore10:10:183
1670103991512,2cyclictest1790942-21irqcore09:05:183
1670103991511,3cyclictest1930824-21kworker/u8:2+flush-259:012:10:523
1670103991511,3cyclictest1706906-21kworker/u8:4+flush-259:008:25:253
1670103991511,2cyclictest0-21swapper/309:15:003
1670103991511,2cyclictest0-21swapper/308:00:003
1670103991511,2cyclictest0-21swapper/308:00:003
1670099991512,1cyclictest0-21swapper/208:20:162
1670096991512,2cyclictest1853089-21kworker/u8:2+events_unbound10:55:131
1670096991511,3cyclictest1930824-21kworker/u8:2+events_unbound11:25:241
1670096991511,3cyclictest1801146-21fschecks_time09:15:141
1670096991511,3cyclictest1732474-21kworker/u8:1+events_unbound08:10:051
1670093991513,1cyclictest60350irq/132-enp0s29f1:rx-012:38:320
1670093991513,1cyclictest60350irq/132-enp0s29f1:rx-012:20:260
1670093991513,1cyclictest60350irq/132-enp0s29f1:rx-011:40:240
1670093991513,1cyclictest60350irq/132-enp0s29f1:rx-010:35:580
1670093991513,1cyclictest60350irq/132-enp0s29f1:rx-009:45:260
1670093991513,1cyclictest60350irq/132-enp0s29f1:rx-009:15:090
1670093991513,1cyclictest60350irq/132-enp0s29f1:rx-008:45:160
1670093991513,1cyclictest60350irq/132-enp0s29f1:rx-007:35:170
1670093991512,1cyclictest191rcu_preempt08:10:290
1670093991510,4cyclictest1806151-21apt-get09:20:120
167010399149,3cyclictest1800546-21kworker/u8:4+flush-259:009:55:163
1670103991411,2cyclictest2006484-21kthreadcore12:30:183
167009999149,3cyclictest1853089-21kworker/u8:2+flush-259:010:50:192
1670099991412,1cyclictest0-21swapper/210:00:002
1670099991411,2cyclictest1936497-21sshd11:25:102
1670099991411,1cyclictest0-21swapper/209:25:012
167009699147,5cyclictest1831774-21latency_hist09:45:001
167009399143,2cyclictest1987482-21ntpq12:10:220
167009399143,2cyclictest1847861-21apt-config10:00:000
167009399142,7cyclictest1936695-21diskstats11:25:150
167009399142,3cyclictest2008243-21ntpq12:30:210
167009399142,2cyclictest1971990-21collect211:55:240
167009399142,2cyclictest1878348-21ps10:25:250
1670093991413,1cyclictest60350irq/132-enp0s29f1:rx-010:34:040
1670093991412,1cyclictest60350irq/132-enp0s29f1:rx-011:47:260
1670093991412,1cyclictest60350irq/132-enp0s29f1:rx-008:32:340
1670093991412,1cyclictest60350irq/132-enp0s29f1:rx-008:05:240
1670093991412,1cyclictest60350irq/132-enp0s29f1:rx-007:55:190
1670093991412,1cyclictest60350irq/132-enp0s29f1:rx-007:55:190
1670093991412,1cyclictest60350irq/132-enp0s29f1:rx-007:25:250
1670093991411,2cyclictest61150irq/133-enp0s29f1:tx-011:35:150
1670093991410,3cyclictest60350irq/132-enp0s29f1:rx-008:35:220
167010399139,3cyclictest1853089-21kworker/u8:2+flush-259:010:05:253
167010399138,4cyclictest335557-21systemd-journal07:20:003
167010399136,5cyclictest1773413-21ntpq08:45:233
1670103991311,1cyclictest0-21swapper/311:25:013
1670103991311,1cyclictest0-21swapper/309:05:003
167010399130,12cyclictest1-21systemd09:51:483
167009999139,3cyclictest3792832-21kworker/u8:1+flush-259:007:39:592
1670099991310,2cyclictest1926474-21fschecks_time11:15:162
167009699139,3cyclictest1930824-21kworker/u8:2+events_unbound12:10:501
167009699137,3cyclictest1732474-21kworker/u8:1+events_unbound08:30:191
1670096991310,2cyclictest1758727-21cpuspeed_turbos08:35:131
1670096991310,2cyclictest1707009-21cpuspeed_turbos07:45:151
167009399132,2cyclictest0-21swapper/008:55:200
1670093991312,1cyclictest60350irq/132-enp0s29f1:rx-010:50:090
1670093991312,1cyclictest60350irq/132-enp0s29f1:rx-007:50:420
1670093991311,1cyclictest60350irq/132-enp0s29f1:rx-007:10:220
167010399129,2cyclictest1822702-21kthreadcore09:35:183
167010399129,2cyclictest1712357-21fschecks_time07:50:113
167010399128,3cyclictest1930824-21kworker/u8:2+events_unbound11:30:023
167010399127,3cyclictest335557-21systemd-journal09:34:553
167010399122,8cyclictest2014255-21awk12:39:593
1670103991210,1cyclictest0-21swapper/308:35:003
167009999129,2cyclictest2004600-21irqcore12:30:172
167009999129,2cyclictest1758727-21cpuspeed_turbos08:35:132
167009999129,2cyclictest1707070-21cut07:45:162
167009999129,2cyclictest1670490-21fschecks_count07:10:142
167009999129,2cyclictest0-21swapper/211:10:012
167009999128,3cyclictest1675771-21fschecks_time07:15:162
167009999127,3cyclictest335557-21systemd-journal10:40:022
167009999126,4cyclictest509-21rs:main2
167009999120,6cyclictest1695931-21cron07:35:002
167009699129,2cyclictest1930824-21kworker/u8:2+flush-259:012:35:201
167009699129,1cyclictest301rcuc/110:40:181
167010399118,2cyclictest1939717-21kthreadcore11:25:203
167010399117,2cyclictest1853089-21kworker/u8:2+flush-259:010:30:253
167010399111,8cyclictest1967727-21latency_hist11:55:023
167009999118,2cyclictest500-21systemd-logind11:55:002
167009999116,4cyclictest1972620-21kworker/u8:1+flush-259:012:25:232
167009999111,8cyclictest1727399-21awk08:05:002
167009699117,3cyclictest1879602-21fschecks_time10:30:141
167010399106,3cyclictest1685967-21cpuspeed_turbos07:25:133
167009999107,2cyclictest1738075-21cpuspeed_turbos08:15:122
167009999107,2cyclictest0-21swapper/209:20:002
167009999105,3cyclictest1972870-21cron11:59:592
16700999981,5cyclictest1638054-21munin-node07:20:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional