You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 12:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sun Jun 28, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1658209995349,3cyclictest1788770-21kworker/u8:0+flush-259:023:00:003
1658209995149,1cyclictest1683816-21fwupd19:33:213
1658199994842,4cyclictest1987016-21latency_hist00:25:000
1658199994842,4cyclictest1987016-21latency_hist00:25:000
1658205994539,4cyclictest1940104-21latency_hist23:40:002
1658205994440,3cyclictest1678826-21kworker/u8:1+events_unbound19:33:212
1658209994340,2cyclictest1736865-21kworker/u8:3+events_unbound21:10:013
1658203994329,12cyclictest1768297-21/usr/sbin/munin20:55:141
1658209994138,2cyclictest1788770-21kworker/u8:0+flush-259:022:24:593
1658209994138,2cyclictest1689152-21kworker/u8:4+events_unbound20:10:003
1658209993832,4cyclictest1929859-21latency_hist23:30:013
1658205993832,4cyclictest1981582-21cat00:20:002
1658203993830,5cyclictest1882307-21latency_hist22:45:011
1658205993731,4cyclictest1704728-21latency_hist19:55:002
1658203993733,3cyclictest1903004-21kworker/u8:2+flush-259:023:18:141
1658209993431,2cyclictest1955798-21kworker/u8:2+flush-259:000:10:003
1658209993431,2cyclictest1788770-21kworker/u8:0+flush-259:022:35:003
1658203993428,4cyclictest1892660-21gpgv22:55:011
1658203993426,5cyclictest1840751-21latency_hist22:05:011
1658205993329,3cyclictest1773275-21kworker/u8:0+flush-259:021:05:012
1658205993328,3cyclictest1668718-21/usr/sbin/munin19:20:142
1658199993329,3cyclictest1856191-21kworker/u8:1+flush-259:022:30:140
1658205993229,2cyclictest1689152-21kworker/u8:4+flush-259:020:35:162
1658203993227,3cyclictest335557-21systemd-journal22:30:011
1658209993128,2cyclictest1924718-21kworker/u8:4+flush-259:023:35:003
1658205993127,3cyclictest1903224-21gpgv23:05:002
1658205993126,3cyclictest1898083-21latency_hist23:00:012
1658203993125,4cyclictest1752862-21apt-get20:40:121
1658199993128,2cyclictest1876971-21kworker/u8:3+flush-259:023:05:000
1658205993026,3cyclictest1861331-21gpgv22:25:002
1658199993027,2cyclictest1736865-21kworker/u8:3+flush-259:021:05:010
1658199993024,4cyclictest335557-21systemd-journal19:55:000
1658209992926,2cyclictest1689152-21kworker/u8:4+events_unbound20:40:193
1658205992926,2cyclictest1778618-21kworker/u8:1+flush-259:021:48:352
1658199992923,4cyclictest335557-21systemd-journal00:35:000
1658209992825,2cyclictest1689152-21kworker/u8:4+flush-259:020:15:213
1658205992825,2cyclictest1856191-21kworker/u8:1+flush-259:022:40:242
1658205992822,5cyclictest1747091-21cp20:35:002
1658203992823,3cyclictest1778618-21kworker/u8:1+flush-259:021:25:181
1658203992822,4cyclictest1998068-21apt-get00:35:121
1658203992822,4cyclictest1939915-21kworker/u8:0+flush-259:000:05:171
1658209992724,2cyclictest1903004-21kworker/u8:2+flush-259:023:10:203
1658209992724,2cyclictest1856191-21kworker/u8:1+flush-259:022:40:213
1658209992724,2cyclictest1788770-21kworker/u8:0+flush-259:022:30:003
1658199992724,2cyclictest1815257-21apt-get21:40:120
1658199992723,3cyclictest1876971-21kworker/u8:3+flush-259:023:05:150
1658209992622,3cyclictest1919740-21kworker/u8:1+flush-259:023:35:203
1658209992621,4cyclictest335557-21systemd-journal20:50:003
1658205992623,2cyclictest1950636-21kworker/u8:1+flush-259:000:00:362
1658205992622,3cyclictest1924718-21kworker/u8:4+flush-259:023:25:242
1658205992621,3cyclictest1997378-21latency_hist00:35:002
1658199992622,3cyclictest1939915-21kworker/u8:0+flush-259:023:55:170
1658209992522,2cyclictest1788770-21kworker/u8:0+flush-259:022:10:203
1658209992520,4cyclictest335557-21systemd-journal20:15:013
1658205992522,2cyclictest1919740-21kworker/u8:1+events_unbound23:24:352
1658199992522,2cyclictest1987245-21kworker/u8:4+flush-259:000:35:180
1658199992522,2cyclictest1939915-21kworker/u8:0+flush-259:000:15:260
1658199992521,3cyclictest1710141-21apt-get20:00:080
1658209992422,2cyclictest1987245-21kworker/u8:4+events_unbound00:25:213
1658209992420,3cyclictest1678826-21kworker/u8:1+flush-259:019:45:213
1658205992421,2cyclictest1736865-21kworker/u8:3+events_unbound20:45:232
1658199992421,2cyclictest1778618-21kworker/u8:1+events_unbound21:32:440
1658199992420,3cyclictest335557-21systemd-journal21:00:010
1658199992419,3cyclictest1825511-21apt-get21:50:120
1658209992320,2cyclictest1663363-21kworker/u8:2+events_unbound19:50:213
1658209992319,3cyclictest1845753-21kworker/u8:3+flush-259:022:15:103
1658209992319,3cyclictest1830695-21apt-get21:55:113
1658205992319,3cyclictest1689152-21kworker/u8:4+events_unbound19:40:172
1658203992317,4cyclictest1856191-21kworker/u8:1+flush-259:023:00:171
1658199992320,2cyclictest1778618-21kworker/u8:1+events_unbound21:24:330
1658199992319,3cyclictest1736865-21kworker/u8:3+events_unbound21:10:130
1658199992319,3cyclictest1736865-21kworker/u8:3+events_unbound20:53:350
1658199992317,4cyclictest1683980-21latency_hist19:35:000
1658209992219,2cyclictest1950636-21kworker/u8:1+flush-259:023:55:003
1658209992219,2cyclictest1876971-21kworker/u8:3+flush-259:023:40:213
1658209992218,3cyclictest1976528-21/usr/sbin/munin00:15:163
1658209992217,4cyclictest1955832-21apt-get23:55:123
1658209992216,4cyclictest1736634-21latency_hist20:25:003
1658205992219,2cyclictest1987245-21kworker/u8:4+flush-259:000:25:152
1658205992219,2cyclictest1788770-21kworker/u8:0+flush-259:021:27:382
1658205992218,3cyclictest1788770-21kworker/u8:0+events_unbound21:42:472
1658203992216,4cyclictest335557-21systemd-journal00:01:341
1658203992215,4cyclictest1699744-21/usr/sbin/munin19:50:131
1658199992218,3cyclictest1788770-21kworker/u8:0+flush-259:021:39:590
1658199992217,4cyclictest335557-21systemd-journal20:06:350
1658199992217,4cyclictest335557-21systemd-journal19:30:000
1658199992216,4cyclictest1924696-21latency_hist23:25:010
1658199992216,4cyclictest1877144-21latency_hist22:40:010
1658199992215,5cyclictest1762053-21ntpq20:45:220
1658209992118,2cyclictest1788770-21kworker/u8:0+flush-259:022:00:183
1658209992118,2cyclictest1788770-21kworker/u8:0+flush-259:021:50:233
1658209992118,2cyclictest1788770-21kworker/u8:0+events_unbound23:08:353
1658209992117,3cyclictest1788770-21kworker/u8:0+events_unbound23:15:153
1658205992118,2cyclictest1845753-21kworker/u8:3+events_unbound22:15:222
1658205992117,3cyclictest1955798-21kworker/u8:2+flush-259:000:10:152
1658199992118,2cyclictest1940370-21apt-get23:40:110
1658199992118,2cyclictest1924718-21kworker/u8:4+flush-259:023:50:000
1658199992118,2cyclictest1689152-21kworker/u8:4+events_unbound20:15:220
1658199992117,3cyclictest1939915-21kworker/u8:0+events_unbound00:00:140
1658199992117,3cyclictest1861420-21gpgv22:25:000
1658199992117,3cyclictest1678826-21kworker/u8:1+flush-259:019:45:230
1658209992017,2cyclictest1987031-21kworker/u8:1+events_unbound00:36:153
1658209992017,2cyclictest1950636-21kworker/u8:1+events_unbound00:10:233
1658209992017,2cyclictest1778618-21kworker/u8:1+events_unbound21:49:083
1658209992017,2cyclictest1689152-21kworker/u8:4+events_unbound20:35:213
1658209992016,3cyclictest1976083-21kworker/u8:3+flush-259:000:20:173
1658209992016,3cyclictest1976083-21kworker/u8:3+flush-259:000:20:173
1658209992016,3cyclictest1945533-21apt-get23:45:133
1658209992016,3cyclictest1788770-21kworker/u8:0+events_unbound22:38:353
1658209992016,3cyclictest1736865-21kworker/u8:3+flush-259:021:10:113
1658209992015,3cyclictest1788770-21kworker/u8:0+flush-259:021:30:233
1658209992014,4cyclictest1793873-21latency_hist21:19:593
1658205992017,2cyclictest1955798-21kworker/u8:2+events_unbound00:35:132
1658205992017,2cyclictest1924718-21kworker/u8:4+flush-259:023:30:152
1658205992017,2cyclictest1788770-21kworker/u8:0+flush-259:022:05:252
1658205992017,2cyclictest1788770-21kworker/u8:0+flush-259:022:05:252
1658205992017,2cyclictest1788770-21kworker/u8:0+flush-259:022:00:192
1658205992017,2cyclictest1788770-21kworker/u8:0+flush-259:021:30:232
1658205992017,2cyclictest1689152-21kworker/u8:4+events_unbound19:55:142
1658205992017,2cyclictest1663363-21kworker/u8:2+events_unbound19:37:342
1658205992016,3cyclictest1924718-21kworker/u8:4+flush-259:023:50:202
1658205992016,3cyclictest1903004-21kworker/u8:2+events_unbound23:10:342
1658205992016,3cyclictest1736865-21kworker/u8:3+events_unbound21:23:362
1658203992016,2cyclictest1699503-21sh19:50:001
1658203992015,4cyclictest1788770-21kworker/u8:0+flush-259:022:13:391
1658199992017,2cyclictest1919740-21kworker/u8:1+events_unbound23:35:180
1658199992017,2cyclictest1689152-21kworker/u8:4+events_unbound19:56:360
1658199992017,2cyclictest1615586-21kworker/u8:4+events_unbound19:15:130
1658199992016,3cyclictest1736865-21kworker/u8:3+events_unbound20:37:360
1658199992015,3cyclictest335557-21systemd-journal22:54:340
1658209991916,2cyclictest1856191-21kworker/u8:1+flush-259:022:45:153
1658209991916,2cyclictest1856191-21kworker/u8:1+events_unbound23:00:203
1658209991916,2cyclictest1736865-21kworker/u8:3+flush-259:021:00:153
1658209991915,3cyclictest1892573-21gpgv22:55:003
1658209991915,3cyclictest1788770-21kworker/u8:0+flush-259:021:35:263
1658209991915,3cyclictest1747195-21gpgv20:35:013
1658209991915,3cyclictest1689152-21kworker/u8:4+events_unbound19:40:123
1658209991914,4cyclictest1684214-21/usr/sbin/munin19:35:243
1658205991916,2cyclictest1778618-21kworker/u8:1+flush-259:021:15:162
1658205991915,3cyclictest1856191-21kworker/u8:1+flush-259:022:45:202
1658205991914,4cyclictest335557-21systemd-journal00:10:002
1658203991914,4cyclictest1893231-21apt-get22:55:131
1658203991914,3cyclictest1736865-21kworker/u8:3+flush-259:021:10:151
1658203991913,4cyclictest335557-21systemd-journal20:04:591
1658203991913,4cyclictest1742050-21/usr/sbin/munin20:30:141
1658199991916,2cyclictest1924718-21kworker/u8:4+flush-259:023:50:350
1658199991916,2cyclictest1856191-21kworker/u8:1+flush-259:022:55:200
1658199991916,2cyclictest1788770-21kworker/u8:0+flush-259:021:45:150
1658199991916,2cyclictest1720889-21kworker/u8:2+events_unbound20:25:210
1658199991916,2cyclictest1663363-21kworker/u8:2+events_unbound19:35:200
1658199991915,3cyclictest1778618-21kworker/u8:1+events_unbound21:25:250
1658199991915,3cyclictest1736865-21kworker/u8:3+events_unbound21:18:350
1658199991915,3cyclictest1715103-21kworker/u8:0+flush-259:020:24:400
1658199991914,4cyclictest335557-21systemd-journal22:45:000
1658209991816,2cyclictest1955798-21kworker/u8:2+events_unbound00:30:343
1658209991815,2cyclictest1599701-21kworker/u8:1+events_unbound19:10:013
1658209991814,3cyclictest1788770-21kworker/u8:0+events_unbound22:05:253
1658209991814,3cyclictest1788770-21kworker/u8:0+events_unbound22:05:243
1658209991814,3cyclictest1778618-21kworker/u8:1+events_unbound21:26:353
1658209991814,3cyclictest1663363-21kworker/u8:2+events_unbound19:20:233
1658209991813,3cyclictest1720889-21kworker/u8:2+flush-259:020:30:013
1658205991815,2cyclictest1720889-21kworker/u8:2+events_unbound20:22:352
1658205991814,3cyclictest1788770-21kworker/u8:0+events_unbound22:39:222
1658205991814,3cyclictest1678826-21kworker/u8:1+events_unbound19:45:212
1658203991815,2cyclictest1749991-21kthreadcore20:35:171
1658203991812,4cyclictest335557-21systemd-journal19:17:211
1658199991815,2cyclictest1856191-21kworker/u8:1+events_unbound22:45:240
1658199991815,2cyclictest1788770-21kworker/u8:0+events_unbound22:05:190
1658199991815,2cyclictest1788770-21kworker/u8:0+events_unbound22:05:190
1658199991814,3cyclictest1846127-21apt-get22:10:110
1658209991714,2cyclictest1657897-21kworker/u8:0+events_unbound19:27:403
1658205991714,2cyclictest1924718-21kworker/u8:4+flush-259:023:45:252
1658205991714,2cyclictest1876971-21kworker/u8:3+events_unbound23:05:122
1658205991714,2cyclictest1720889-21kworker/u8:2+flush-259:020:25:212
1658205991714,2cyclictest1689152-21kworker/u8:4+events_unbound20:55:162
1658205991714,2cyclictest1663363-21kworker/u8:2+events_unbound19:28:342
1658205991714,1cyclictest1892530-21cron22:55:002
1658205991713,3cyclictest1689152-21kworker/u8:4+flush-259:020:50:182
1658203991714,2cyclictest1981877-21latency_hist00:20:001
1658203991714,2cyclictest1960761-21grep00:00:011
1658203991714,2cyclictest1726183-21apt-key20:15:011
1658203991714,2cyclictest1720725-21apt-config20:10:011
1658203991714,1cyclictest0-21swapper/123:30:001
1658203991713,3cyclictest1657897-21kworker/u8:0+flush-259:019:25:261
1658203991712,4cyclictest1809879-21base6421:35:011
1658203991712,4cyclictest1720889-21kworker/u8:2+events_unbound20:25:181
1658203991712,3cyclictest1773498-21apt-get21:00:111
1658199991714,3cyclictest1955798-21kworker/u8:2+events_unbound00:11:350
1658199991714,2cyclictest1615586-21kworker/u8:4+events_unbound19:24:340
1658199991713,3cyclictest1903004-21kworker/u8:2+events_unbound23:10:030
1658199991711,4cyclictest1783540-21latency_hist21:10:010
1658209991612,3cyclictest1689152-21kworker/u8:4+events_unbound19:55:313
1658205991613,2cyclictest1815036-21kworker/u8:2+events_unbound21:55:152
1658205991613,2cyclictest1689152-21kworker/u8:4+flush-259:020:15:242
1658205991612,3cyclictest1689151-21kworker/u8:3+events_unbound20:07:312
1658205991612,3cyclictest1599701-21kworker/u8:1+events_unbound19:10:342
1658205991612,2cyclictest1725885-21gpgv20:15:012
165820399168,5cyclictest1945272-21latency_hist23:45:001
1658203991612,3cyclictest1820393-21apt-get21:45:111
1658203991612,3cyclictest1689152-21kworker/u8:4+flush-259:020:15:241
1658203991611,3cyclictest1845852-21sh22:10:001
1658203991611,3cyclictest1845852-21sh22:09:591
1658199991614,1cyclictest60350irq/132-enp0s29f1:rx-023:27:150
1658199991613,2cyclictest60350irq/132-enp0s29f1:rx-021:56:260
1658209991511,3cyclictest1689152-21kworker/u8:4+events_unbound20:02:153
1658205991511,3cyclictest1856191-21kworker/u8:1+events_unbound22:25:132
1658205991511,3cyclictest1663363-21kworker/u8:2+flush-259:019:17:212
1658203991511,3cyclictest1955798-21kworker/u8:2+flush-259:000:10:191
1658203991511,3cyclictest1689152-21kworker/u8:4+flush-259:019:55:261
1658199991513,2cyclictest1788770-21kworker/u8:0+events_unbound22:25:230
1658199991513,1cyclictest60350irq/132-enp0s29f1:rx-022:15:140
1658199991512,2cyclictest1689152-21kworker/u8:4+flush-259:020:43:390
165819999150,13cyclictest1694340-21idleruntime-cro19:45:000
1658205991411,2cyclictest1976083-21kworker/u8:3+events_unbound00:20:272
1658205991411,2cyclictest1976083-21kworker/u8:3+events_unbound00:20:272
1658205991411,2cyclictest1903004-21kworker/u8:2+events_unbound23:15:572
1658205991411,2cyclictest1787854-21ntp_kernel_pll_21:10:202
1658205991411,2cyclictest1689152-21kworker/u8:4+flush-259:020:00:242
165820399149,4cyclictest1684239-21apt-get19:35:111
165820399148,4cyclictest1924718-21kworker/u8:4+flush-259:023:46:041
165820399148,4cyclictest1689395-21apt-get19:40:131
165819999148,4cyclictest1663336-21latency_hist19:15:010
1658199991412,1cyclictest60350irq/132-enp0s29f1:rx-000:25:260
1658199991412,1cyclictest60350irq/132-enp0s29f1:rx-000:05:280
1658199991411,2cyclictest1924718-21kworker/u8:4+flush-259:023:30:230
165820999139,3cyclictest1950636-21kworker/u8:1+events_unbound00:04:353
165820999139,3cyclictest1615586-21kworker/u8:4+events_unbound19:15:233
165820599139,3cyclictest1876971-21kworker/u8:3+flush-259:023:40:152
165820599139,3cyclictest1689152-21kworker/u8:4+events_unbound21:07:362
1658205991310,2cyclictest1939915-21kworker/u8:0+events_unbound23:55:282
165820399136,5cyclictest1762910-21latency_hist20:50:011
1658203991310,2cyclictest1798552-21unixbench_multi21:20:261
165819999139,3cyclictest60350irq/132-enp0s29f1:rx-023:15:110
165820599128,3cyclictest0-21swapper/222:35:002
165820599127,4cyclictest1788770-21kworker/u8:0+events_unbound22:13:352
1658205991210,1cyclictest1778618-21kworker/u8:1+events_unbound21:35:152
165820399128,3cyclictest1923850-21ntp_offset23:20:221
165820399121,9cyclictest1683972-21awk19:35:001
165819999119,1cyclictest60350irq/132-enp0s29f1:rx-020:10:220
165819999117,3cyclictest1839940-21ntp_states22:00:230
165820399108,1cyclictest0-21swapper/119:20:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional