You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 19:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Jul 10, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1707943995038,9cyclictest1899505-21latency_hist10:15:013
1707937993935,3cyclictest1894383-21kworker/u8:0+events_unbound10:35:011
1707937993834,3cyclictest1930683-21kworker/u8:4+events_unbound12:25:261
1707937993532,2cyclictest1790895-21kworker/u8:2+flush-259:009:00:251
1707943993428,4cyclictest1785760-21latency_hist08:25:013
1707943993226,4cyclictest1707858-21latency_hist07:10:003
1707940993228,3cyclictest1946774-21kworker/u8:2+flush-259:011:29:592
1707937993026,3cyclictest1848259-21kworker/u8:4+events_unbound09:55:181
1707937993026,3cyclictest1744640-21/usr/sbin/munin07:45:251
1707933993024,4cyclictest1713058-21latency_hist07:15:000
1707937992926,2cyclictest1873836-21kworker/u8:2+events_unbound09:50:231
1707933992922,5cyclictest1930791-21latency_hist10:45:010
1707943992824,3cyclictest1930682-21kworker/u8:3+flush-259:010:55:003
1707943992823,3cyclictest1822481-21/usr/sbin/munin09:00:153
1707940992824,3cyclictest335557-21systemd-journal09:47:242
1707940992824,3cyclictest1734075-21kworker/u8:1+flush-259:008:00:002
1707940992823,4cyclictest1914014-21ntpq10:25:202
1707933992824,3cyclictest1848259-21kworker/u8:4+flush-259:009:40:250
1707933992824,3cyclictest1848259-21kworker/u8:4+flush-259:009:40:240
1707937992723,3cyclictest1734075-21kworker/u8:1+events_unbound08:35:141
1707933992723,3cyclictest1717939-21kworker/u8:0+flush-259:007:45:230
1707943992621,3cyclictest1904644-21kworker/u8:1+flush-259:010:35:173
1707940992622,3cyclictest1759648-21kworker/u8:4+flush-259:008:25:262
1707937992622,3cyclictest1978221-21kworker/u8:1+events_unbound11:34:021
1707937992622,3cyclictest1930683-21kworker/u8:4+events_unbound11:35:071
1707937992622,3cyclictest1702600-21kworker/u8:2+flush-259:007:10:191
1707937992619,6cyclictest1951853-21apt-get11:05:011
1707937992619,5cyclictest2044913-21ntpq12:30:191
1707933992619,5cyclictest1909760-21latency_hist10:25:010
1707937992522,2cyclictest1930683-21kworker/u8:4+flush-259:012:20:251
1707937992521,3cyclictest1718307-21gpgv07:20:001
1707943992420,3cyclictest1734075-21kworker/u8:1+flush-259:009:00:003
1707943992419,3cyclictest2020282-21/usr/sbin/munin12:10:133
1707940992420,3cyclictest1951970-21gpgv11:05:002
1707940992420,3cyclictest1930683-21kworker/u8:4+flush-259:011:35:252
1707937992421,2cyclictest1827424-21kworker/u8:0+events_unbound09:30:241
1707937992421,2cyclictest1734075-21kworker/u8:1+flush-259:009:15:241
1707937992421,2cyclictest1734075-21kworker/u8:1+flush-259:008:10:261
1707937992420,3cyclictest1930683-21kworker/u8:4+flush-259:011:05:111
1707937992420,3cyclictest1790895-21kworker/u8:2+events_unbound09:13:381
1707937992420,3cyclictest1734075-21kworker/u8:1+events_unbound09:20:181
1707943992317,4cyclictest2009235-21cat12:00:003
1707943992317,4cyclictest1904621-21latency_hist10:20:003
1707940992319,3cyclictest1904857-21/usr/sbin/munin10:20:142
1707940992318,4cyclictest335557-21systemd-journal11:50:002
1707937992320,2cyclictest2025443-21kworker/u8:0+flush-259:012:35:161
1707937992320,2cyclictest1827424-21kworker/u8:0+flush-259:009:25:211
1707937992320,2cyclictest1717939-21kworker/u8:0+flush-259:007:40:161
1707937992319,3cyclictest1930683-21kworker/u8:4+flush-259:012:04:251
1707937992319,3cyclictest1858396-21kworker/u8:1+events_unbound09:35:151
1707937992319,3cyclictest1858396-21kworker/u8:1+events_unbound09:35:141
1707937992319,3cyclictest1734075-21kworker/u8:1+events_unbound07:51:011
1707933992320,2cyclictest1993454-21kworker/u8:3+flush-259:011:45:250
1707933992319,3cyclictest1848259-21kworker/u8:4+flush-259:010:00:230
1707933992319,3cyclictest1734075-21kworker/u8:1+flush-259:008:30:160
1707940992218,3cyclictest1790895-21kworker/u8:2+flush-259:008:40:012
1707940992218,3cyclictest1734075-21kworker/u8:1+flush-259:009:20:252
1707940992218,3cyclictest1723983-21kworker/u8:2+flush-259:007:45:002
1707940992217,4cyclictest1972854-21latency_hist11:25:012
1707937992219,2cyclictest1894383-21kworker/u8:0+events_unbound10:18:251
1707933992216,4cyclictest2009546-21base6412:00:000
1707937992118,2cyclictest1993451-21kworker/u8:2+flush-259:011:50:201
1707937992118,2cyclictest1790895-21kworker/u8:2+events_unbound08:50:211
1707937992117,3cyclictest1930683-21kworker/u8:4+events_unbound12:10:031
1707933992116,3cyclictest1988554-21apt-get11:40:120
1707933992116,3cyclictest1930682-21kworker/u8:3+flush-259:010:55:270
1707933992114,5cyclictest1935086-21ntpq10:45:220
1707943992014,4cyclictest1884326-21/usr/sbin/munin10:00:133
1707937992017,2cyclictest1790895-21kworker/u8:2+flush-259:008:55:271
1707937992016,3cyclictest490-21dbus-daemon10:30:001
1707937992016,3cyclictest1790895-21kworker/u8:2+flush-259:009:05:241
1707937992016,2cyclictest0-21swapper/110:50:021
1707933992017,2cyclictest1873836-21kworker/u8:2+flush-259:010:10:160
1707933992015,4cyclictest2008933-21apt-get12:00:000
1707943991913,4cyclictest2019622-21latency_hist12:10:013
1707943991912,5cyclictest1971956-21ntpq11:20:213
1707943991912,5cyclictest1811908-21base6408:50:013
1707943991912,4cyclictest1978229-21/usr/sbin/munin11:30:183
1707940991915,3cyclictest1978221-21kworker/u8:1+flush-259:011:40:242
1707940991915,3cyclictest1930682-21kworker/u8:3+flush-259:010:55:252
1707937991916,2cyclictest1644285-21kworker/u8:1+flush-259:007:20:141
1707937991915,3cyclictest1848259-21kworker/u8:4+events_unbound10:10:491
1707937991915,3cyclictest1734075-21kworker/u8:1+events_unbound08:00:131
1707933991915,3cyclictest1692248-21kworker/u8:3+flush-259:007:20:000
1707943991815,2cyclictest1723983-21kworker/u8:2+flush-259:007:35:203
1707943991814,3cyclictest1978221-21kworker/u8:1+flush-259:011:44:593
1707943991812,4cyclictest335557-21systemd-journal08:10:243
1707943991812,4cyclictest1765142-21latency_hist08:05:013
1707940991815,2cyclictest1729614-21irqcore07:30:182
1707940991811,5cyclictest1837732-21latency_hist09:15:002
1707937991815,2cyclictest1848259-21kworker/u8:4+flush-259:009:45:181
1707937991815,2cyclictest1765183-21kworker/u8:0+events_unbound08:20:271
1707937991814,3cyclictest1946774-21kworker/u8:2+events_unbound11:23:251
1707937991814,3cyclictest1790895-21kworker/u8:2+events_unbound08:47:151
1707937991813,3cyclictest1978221-21kworker/u8:1+events_unbound11:40:111
1707937991812,4cyclictest1973091-21/usr/sbin/munin11:25:131
1707933991812,4cyclictest1806409-21latency_hist08:45:010
1707943991713,3cyclictest1873836-21kworker/u8:2+flush-259:009:50:263
1707943991712,4cyclictest1734075-21kworker/u8:1+events_unbound08:35:183
1707940991714,2cyclictest0-21swapper/211:35:002
1707940991713,3cyclictest1946774-21kworker/u8:2+flush-259:011:10:252
1707940991713,2cyclictest2010640-21kthreadcore12:00:172
1707940991712,4cyclictest1734075-21kworker/u8:1+flush-259:008:05:002
1707940991712,3cyclictest1993454-21kworker/u8:3+flush-259:012:05:272
1707940991711,4cyclictest1723983-21kworker/u8:2+flush-259:007:35:262
1707937991714,2cyclictest1993454-21kworker/u8:3+flush-259:012:05:151
1707937991714,2cyclictest1930682-21kworker/u8:3+flush-259:010:50:251
1707937991714,2cyclictest1827424-21kworker/u8:0+events_unbound09:44:251
1707937991714,2cyclictest1827424-21kworker/u8:0+events_unbound09:44:251
1707937991713,3cyclictest1904644-21kworker/u8:1+events_unbound10:40:071
1707937991713,3cyclictest1790895-21kworker/u8:2+events_unbound08:40:131
1707937991713,3cyclictest1723983-21kworker/u8:2+events_unbound07:35:441
1707937991712,4cyclictest2004016-21apt-get11:55:121
1707933991714,2cyclictest60350irq/132-enp0s29f1:rx-012:33:550
1707933991714,2cyclictest2025443-21kworker/u8:0+flush-259:012:35:250
1707933991714,2cyclictest1930683-21kworker/u8:4+flush-259:012:25:270
1707933991713,3cyclictest1717939-21kworker/u8:0+flush-259:007:30:260
1707933991711,4cyclictest1759960-21latency_hist08:00:010
1707943991613,2cyclictest1724443-21irqcore07:25:193
1707943991613,2cyclictest1724443-21irqcore07:25:183
1707943991611,4cyclictest1936084-21gpgv10:50:003
1707943991611,4cyclictest1795214-21ntpq08:30:243
1707940991613,2cyclictest1859039-21irqcore09:35:162
1707940991613,2cyclictest1859039-21irqcore09:35:162
1707940991612,3cyclictest1790895-21kworker/u8:2+events_unbound08:50:012
1707940991610,4cyclictest1770303-21latency_hist08:10:012
1707937991613,2cyclictest1930683-21kworker/u8:4+events_unbound11:45:131
1707937991613,2cyclictest1734075-21kworker/u8:1+flush-259:007:55:211
1707937991613,2cyclictest1734075-21kworker/u8:1+events_unbound08:25:171
1707933991614,1cyclictest60350irq/132-enp0s29f1:rx-008:50:260
1707933991613,2cyclictest60350irq/132-enp0s29f1:rx-009:54:160
1707933991613,2cyclictest60350irq/132-enp0s29f1:rx-008:45:200
1707933991613,2cyclictest60350irq/132-enp0s29f1:rx-008:25:270
1707933991613,2cyclictest60350irq/132-enp0s29f1:rx-008:10:170
1707933991613,2cyclictest1827415-21idleruntime-cro09:04:590
1707933991612,3cyclictest1790895-21kworker/u8:2+flush-259:008:55:220
1707933991611,4cyclictest1858617-21apt-get09:35:120
1707933991611,4cyclictest1858617-21apt-get09:35:120
170794399159,4cyclictest1983413-21/usr/sbin/munin11:35:143
170794399158,5cyclictest1919616-21ntpq10:30:203
1707943991512,2cyclictest2025880-21irqcore12:15:173
170794099158,5cyclictest1936484-21base6410:50:022
1707940991511,3cyclictest1765183-21kworker/u8:0+flush-259:008:15:422
1707937991512,2cyclictest2029879-21unixbench_multi12:15:261
1707937991512,2cyclictest1946774-21kworker/u8:2+events_unbound11:15:171
1707937991512,2cyclictest1904644-21kworker/u8:1+events_unbound10:35:161
1707937991512,2cyclictest1734075-21kworker/u8:1+events_unbound08:05:261
1707937991512,2cyclictest1692248-21kworker/u8:3+events_unbound07:25:271
1707937991512,2cyclictest1692248-21kworker/u8:3+events_unbound07:25:271
1707937991511,3cyclictest1734075-21kworker/u8:1+events_unbound08:17:011
170793399159,4cyclictest1784841-21ntpq08:20:220
1707933991513,2cyclictest60350irq/132-enp0s29f1:rx-012:10:190
1707933991513,1cyclictest60350irq/132-enp0s29f1:rx-011:54:220
1707933991513,1cyclictest60350irq/132-enp0s29f1:rx-011:24:380
1707933991513,1cyclictest60350irq/132-enp0s29f1:rx-011:15:130
1707933991513,1cyclictest60350irq/132-enp0s29f1:rx-010:25:230
1707933991512,2cyclictest61150irq/133-enp0s29f1:tx-007:35:250
1707933991512,2cyclictest60350irq/132-enp0s29f1:rx-011:05:570
1707933991512,2cyclictest60350irq/132-enp0s29f1:rx-011:01:170
1707933991512,2cyclictest60350irq/132-enp0s29f1:rx-010:05:170
1707933991512,2cyclictest60350irq/132-enp0s29f1:rx-009:55:200
1707933991512,2cyclictest60350irq/132-enp0s29f1:rx-009:06:250
1707933991510,4cyclictest1936654-21apt-get10:50:110
170794399145,2cyclictest0-21swapper/311:10:003
1707943991412,1cyclictest0-21swapper/307:20:003
1707943991410,3cyclictest1848259-21kworker/u8:4+flush-259:010:20:213
1707943991410,3cyclictest1734075-21kworker/u8:1+flush-259:009:20:103
170794099141,3cyclictest1827402-21awk09:04:592
1707940991410,3cyclictest1930683-21kworker/u8:4+flush-259:011:05:162
1707940991410,3cyclictest1827424-21kworker/u8:0+flush-259:009:30:152
1707937991411,2cyclictest1904644-21kworker/u8:1+events_unbound10:58:561
1707937991410,3cyclictest1873836-21kworker/u8:2+events_unbound10:05:031
1707937991410,3cyclictest1717939-21kworker/u8:0+events_unbound07:31:251
1707933991413,1cyclictest60350irq/132-enp0s29f1:rx-008:35:150
1707933991412,1cyclictest61150irq/133-enp0s29f1:tx-010:15:160
1707933991412,1cyclictest60350irq/132-enp0s29f1:rx-012:20:240
1707933991412,1cyclictest60350irq/132-enp0s29f1:rx-011:25:220
1707933991412,1cyclictest60350irq/132-enp0s29f1:rx-009:45:260
1707933991412,1cyclictest60350irq/132-enp0s29f1:rx-009:28:490
1707933991412,1cyclictest60350irq/132-enp0s29f1:rx-008:17:570
1707933991412,1cyclictest60350irq/132-enp0s29f1:rx-008:05:270
1707933991412,1cyclictest60350irq/132-enp0s29f1:rx-008:00:140
1707933991411,2cyclictest60350irq/132-enp0s29f1:rx-011:35:230
1707933991411,2cyclictest60350irq/132-enp0s29f1:rx-007:41:170
1707933991411,2cyclictest1853892-21irqcore09:30:150
1707933991410,3cyclictest1724020-21apt-get07:25:140
1707933991410,3cyclictest1724020-21apt-get07:25:140
170794399139,3cyclictest1790895-21kworker/u8:2+flush-259:009:05:253
1707943991310,2cyclictest50-21ksoftirqd/308:00:003
1707943991310,2cyclictest1973196-21cpuspeed_turbos11:25:123
1707943991310,2cyclictest1879387-21fschecks_count09:55:153
170794099139,3cyclictest1717939-21kworker/u8:0+events_unbound07:20:002
170794099136,5cyclictest335557-21systemd-journal10:40:012
1707940991311,1cyclictest0-21swapper/207:10:162
1707937991310,2cyclictest1894383-21kworker/u8:0+events_unbound10:20:251
1707937991310,2cyclictest1848259-21kworker/u8:4+events_unbound10:00:181
170793399139,3cyclictest61150irq/133-enp0s29f1:tx-009:10:240
170793399137,4cyclictest2025631-21diskstats12:15:130
1707933991311,1cyclictest60350irq/132-enp0s29f1:rx-011:10:140
170794399129,2cyclictest1994100-21sed11:45:153
170794399129,2cyclictest1952181-21apt-key11:05:013
170794399129,2cyclictest1942181-21sed10:55:183
170794399128,3cyclictest1827424-21kworker/u8:0+flush-259:009:45:243
170794399128,2cyclictest0-21swapper/309:10:253
1707943991210,1cyclictest1857882-21unixbench_multi09:30:243
170794099129,2cyclictest500-21systemd-logind12:25:002
170794099129,2cyclictest1894694-21cpuspeed_turbos10:10:122
170794099129,2cyclictest1848259-21kworker/u8:4+flush-259:010:00:142
170794099129,2cyclictest0-21swapper/212:00:002
170794099129,2cyclictest0-21swapper/211:15:232
170794099128,3cyclictest1894383-21kworker/u8:0+flush-259:010:30:562
170794099121,3cyclictest1868675-21latency_hist09:45:012
170794099121,3cyclictest1868675-21latency_hist09:45:002
170794099120,3cyclictest1775460-21awk08:15:002
170793399129,2cyclictest60350irq/132-enp0s29f1:rx-012:05:160
170793399129,2cyclictest60350irq/132-enp0s29f1:rx-010:35:090
170793399129,2cyclictest60350irq/132-enp0s29f1:rx-009:15:160
1707933991210,1cyclictest60350irq/132-enp0s29f1:rx-010:30:170
170794399118,2cyclictest1946774-21kworker/u8:2+flush-259:011:10:213
170794399117,2cyclictest1743973-21unixbench_singl07:40:263
170794399116,3cyclictest1801644-21diskstats08:40:143
170794099119,1cyclictest0-21swapper/212:10:192
170794099119,1cyclictest0-21swapper/210:05:242
170794099117,3cyclictest1734075-21kworker/u8:1+flush-259:009:15:162
170794099117,2cyclictest0-21swapper/208:40:262
170794099116,4cyclictest1874335-21perl09:50:152
170794099111,2cyclictest1998580-21awk11:50:002
170793399119,1cyclictest60350irq/132-enp0s29f1:rx-009:20:200
170793399118,2cyclictest500-21systemd-logind11:35:000
170793399117,3cyclictest1718879-21apt-get07:20:120
170794399107,2cyclictest1848430-21cpuspeed_turbos09:25:153
170794099107,2cyclictest1931133-21cpuspeed_turbos10:45:122
170794099107,2cyclictest0-21swapper/208:30:212
170794099107,2cyclictest0-21swapper/208:20:192
17079439997,1cyclictest0-21swapper/311:50:223
17079439996,2cyclictest1858755-21tr09:35:143
17079439996,2cyclictest1858755-21tr09:35:133
17079439996,2cyclictest0-21swapper/311:15:193
17079439995,3cyclictest2046136-21cut12:35:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional