You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 18:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Tue Apr 21, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1584600995855,2cyclictest75-21kswapd011:02:442
1584592995451,2cyclictest75-21kswapd011:02:450
1584603995247,3cyclictest1708566-21kworker/u8:2+events_unbound10:35:243
1584592994839,6cyclictest509-21rs:main0
1584603994642,3cyclictest1895221-21kworker/u8:0+flush-259:012:30:163
1584603994642,3cyclictest1895221-21kworker/u8:0+flush-259:012:30:163
1584600994642,3cyclictest1635540-21kworker/u8:2+events_unbound08:15:242
1584596994643,2cyclictest75-21kswapd011:02:471
1584596994543,1cyclictest1785834-21fwupd10:21:161
1584596994538,4cyclictest1682876-21latency_hist08:45:011
1584603994438,2cyclictest1610517-21kworker/u8:1+events_unbound07:45:233
1584600994438,2cyclictest1781046-21kworker/u8:0+events_unbound10:55:242
1584603994340,2cyclictest75-21kswapd011:02:443
1584603994339,2cyclictest1672100-21kworker/u8:1+flush-259:009:30:233
1584600994340,2cyclictest1698287-21kworker/u8:0+events_unbound09:15:162
1584600994339,3cyclictest1844660-21kworker/u8:3+flush-259:011:30:062
1584600994339,3cyclictest1672100-21kworker/u8:1+events_unbound09:15:002
1584603994239,2cyclictest1734292-21kworker/u8:3+flush-259:009:40:243
1584603994239,2cyclictest1698287-21kworker/u8:0+flush-259:009:05:223
1584603994239,2cyclictest1672100-21kworker/u8:1+events_unbound09:25:123
1584603994238,3cyclictest1708566-21kworker/u8:2+events_unbound10:25:153
1584603994138,2cyclictest1744318-21kworker/u8:0+events_unbound09:50:223
1584603994138,2cyclictest1546910-21kworker/u8:3+events_unbound07:25:153
1584600994138,2cyclictest1672100-21kworker/u8:1+events_unbound09:00:252
1584600994137,3cyclictest1708566-21kworker/u8:2+events_unbound10:21:202
1584600994136,3cyclictest1610517-21kworker/u8:1+events_unbound07:50:212
1584600994037,2cyclictest1859365-21kworker/u8:4+events_unbound11:55:282
1584600994036,3cyclictest1579410-21kworker/u8:0+events_unbound07:35:222
1584603993936,2cyclictest1672100-21kworker/u8:1+events_unbound10:05:203
1584603993936,2cyclictest1635540-21kworker/u8:2+events_unbound08:25:243
1584603993936,2cyclictest1579410-21kworker/u8:0+flush-259:007:40:253
1584603993936,2cyclictest1579410-21kworker/u8:0+events_unbound08:10:123
1584600993936,3cyclictest1827643-21kworker/u8:1+flush-259:011:05:212
1584600993936,2cyclictest1744318-21kworker/u8:0+events_unbound09:55:232
1584600993936,2cyclictest1546910-21kworker/u8:3+events_unbound07:25:212
1584600993935,3cyclictest1734292-21kworker/u8:3+events_unbound09:40:142
1584600993935,3cyclictest1610517-21kworker/u8:1+flush-259:008:20:212
1584592993934,4cyclictest1921372-21apt-get12:35:130
1584592993932,4cyclictest509-21rs:main0
1584603993835,2cyclictest1744318-21kworker/u8:0+flush-259:010:00:213
1584603993835,2cyclictest1744318-21kworker/u8:0+flush-259:010:00:203
1584603993835,2cyclictest1610517-21kworker/u8:1+events_unbound08:05:193
1584603993834,3cyclictest1708566-21kworker/u8:2+events_unbound10:45:153
1584592993832,4cyclictest1853642-21kworker/u8:1+flush-259:011:40:200
1584603993734,2cyclictest1844660-21kworker/u8:3+events_unbound11:35:223
1584603993734,2cyclictest1672100-21kworker/u8:1+flush-259:010:15:233
1584603993733,3cyclictest1652101-21kworker/u8:4+events_unbound08:55:203
1584600993734,2cyclictest1895221-21kworker/u8:0+events_unbound12:30:172
1584600993734,2cyclictest1895221-21kworker/u8:0+events_unbound12:30:172
1584592993732,3cyclictest1672100-21kworker/u8:1+flush-259:009:25:150
1584600993633,2cyclictest1817541-21kworker/u8:3+events_unbound11:10:232
1584592993630,4cyclictest1791730-21diskstats10:30:140
1584603993532,2cyclictest1844660-21kworker/u8:3+events_unbound11:50:243
1584603993532,2cyclictest1579410-21kworker/u8:0+flush-259:008:00:153
1584603993531,2cyclictest1781046-21kworker/u8:0+flush-259:010:50:163
1584600993532,2cyclictest1844660-21kworker/u8:3+events_unbound11:20:212
1584600993532,2cyclictest1672100-21kworker/u8:1+events_unbound09:35:232
1584596993531,3cyclictest1781046-21kworker/u8:0+flush-259:010:50:201
1584603993431,2cyclictest1844660-21kworker/u8:3+events_unbound11:25:243
1584603993431,2cyclictest1744318-21kworker/u8:0+flush-259:009:55:163
1584600993431,2cyclictest1635540-21kworker/u8:2+events_unbound08:30:192
1584600993430,3cyclictest1635540-21kworker/u8:2+events_unbound08:25:202
1584596993428,4cyclictest1713701-21latency_hist09:15:011
1584603993330,2cyclictest1781046-21kworker/u8:0+events_unbound11:05:133
1584600993330,2cyclictest1859365-21kworker/u8:4+flush-259:012:25:162
1584600993328,3cyclictest252-21systemd-journal10:13:142
1584603993227,3cyclictest1698287-21kworker/u8:0+events_unbound09:15:183
1584600993229,2cyclictest1895221-21kworker/u8:0+events_unbound12:35:172
1584600993229,2cyclictest1672100-21kworker/u8:1+events_unbound08:45:222
1584600993228,3cyclictest252-21systemd-journal07:45:152
1584592993227,4cyclictest1672100-21kworker/u8:1+flush-259:009:00:160
1584592993227,3cyclictest1662521-21apt-get08:25:130
1584592993225,5cyclictest1811970-21gpgv10:50:000
1584603993128,2cyclictest1672100-21kworker/u8:1+events_unbound09:35:133
1584603993128,2cyclictest1610517-21kworker/u8:1+flush-259:007:50:253
1584603993127,3cyclictest1791534-21kworker/u8:3+events_unbound10:30:243
1584600993128,2cyclictest1844660-21kworker/u8:3+events_unbound11:45:122
1584600993128,2cyclictest1672100-21kworker/u8:1+events_unbound08:50:262
1584600993128,2cyclictest1635540-21kworker/u8:2+events_unbound08:35:142
1584600993128,2cyclictest1610517-21kworker/u8:1+events_unbound08:05:142
1584600993127,3cyclictest1610517-21kworker/u8:1+events_unbound07:55:232
1584596993124,5cyclictest1843841-21/usr/sbin/munin11:20:231
1584603993027,2cyclictest1672100-21kworker/u8:1+flush-259:008:40:203
1584603993026,2cyclictest1844660-21kworker/u8:3+events_unbound12:10:173
1584603993025,4cyclictest1869476-21latency_hist11:45:003
1584600993026,3cyclictest1708566-21kworker/u8:2+events_unbound10:25:172
1584600993020,5cyclictest252-21systemd-journal10:43:152
1584596993026,3cyclictest1579410-21kworker/u8:0+flush-259:007:30:171
1584596993025,4cyclictest1621254-21apt-get07:45:131
1584596993022,6cyclictest1770724-21latency_hist10:10:001
1584603992926,2cyclictest1859365-21kworker/u8:4+events_unbound11:55:223
1584596992925,3cyclictest1781046-21kworker/u8:0+flush-259:011:05:161
1584603992825,2cyclictest1895221-21kworker/u8:0+events_unbound12:25:243
1584600992826,2cyclictest1708566-21kworker/u8:2+events_unbound10:48:162
1584592992824,3cyclictest1853642-21kworker/u8:1+flush-259:011:55:000
1584592992821,5cyclictest1667827-21diskstats08:30:150
1584592992820,6cyclictest1718003-21ntpq09:15:210
1584603992725,1cyclictest1781046-21kworker/u8:0+flush-259:010:55:253
1584603992724,2cyclictest1781046-21kworker/u8:0+events_unbound11:20:133
1584603992723,3cyclictest252-21systemd-journal08:19:303
1584603992723,3cyclictest1781046-21kworker/u8:0+events_unbound11:15:193
1584603992723,3cyclictest1652101-21kworker/u8:4+flush-259:008:50:183
1584600992724,2cyclictest1859365-21kworker/u8:4+flush-259:012:15:192
1584600992724,2cyclictest1859365-21kworker/u8:4+flush-259:012:05:212
1584600992724,2cyclictest1859365-21kworker/u8:4+events_unbound11:55:002
1584600992724,2cyclictest1744318-21kworker/u8:0+flush-259:009:50:142
1584600992723,3cyclictest1672100-21kworker/u8:1+events_unbound09:26:182
1584596992723,2cyclictest1600298-21apt-get07:25:111
1584592992723,3cyclictest1859365-21kworker/u8:4+flush-259:012:05:000
1584603992623,2cyclictest1859365-21kworker/u8:4+flush-259:012:05:153
1584600992624,1cyclictest1579410-21kworker/u8:0+events_unbound07:15:142
1584592992622,3cyclictest1652101-21kworker/u8:4+flush-259:009:00:010
1584592992619,5cyclictest1600459-21diskstats07:25:130
158459299260,24cyclictest1-21systemd10:55:010
1584603992522,2cyclictest1915966-21kworker/u8:2+events_unbound12:35:183
1584603992522,2cyclictest1708566-21kworker/u8:2+flush-259:010:40:203
1584603992522,2cyclictest1672100-21kworker/u8:1+events_unbound10:10:273
1584600992522,2cyclictest1895221-21kworker/u8:0+events_unbound12:20:142
1584600992522,2cyclictest1844660-21kworker/u8:3+flush-259:011:35:262
1584600992522,2cyclictest1652101-21kworker/u8:4+flush-259:008:40:272
1584600992521,3cyclictest1672100-21kworker/u8:1+events_unbound10:16:172
1584596992521,3cyclictest1610517-21kworker/u8:1+flush-259:008:10:241
1584592992521,3cyclictest1610517-21kworker/u8:1+events_unbound07:45:170
1584592992520,3cyclictest1-21systemd10:25:000
1584592992519,4cyclictest1677976-21apt-get08:40:130
1584603992421,2cyclictest1635540-21kworker/u8:2+events_unbound08:20:153
1584603992421,2cyclictest1579410-21kworker/u8:0+events_unbound07:36:153
1584600992421,2cyclictest1844660-21kworker/u8:3+events_unbound11:25:222
1584600992421,2cyclictest1579410-21kworker/u8:0+events_unbound08:10:102
1584600992420,3cyclictest1708566-21kworker/u8:2+events_unbound10:35:172
1584600992420,2cyclictest1781046-21kworker/u8:0+events_unbound11:15:132
1584596992420,3cyclictest1672100-21kworker/u8:1+flush-259:008:45:151
1584600992321,2cyclictest1672100-21kworker/u8:1+events_unbound08:59:172
1584600992320,2cyclictest1853642-21kworker/u8:1+events_unbound11:43:452
1584600992320,2cyclictest1708566-21kworker/u8:2+events_unbound09:45:032
1584600992320,2cyclictest1579410-21kworker/u8:0+events_unbound08:01:172
1584596992318,3cyclictest1744318-21kworker/u8:0+events_unbound09:50:191
1584592992320,2cyclictest1915966-21kworker/u8:2+flush-259:012:35:000
1584592992320,2cyclictest1915966-21kworker/u8:2+flush-259:012:35:000
1584592992319,3cyclictest1859365-21kworker/u8:4+events_unbound12:20:210
1584592992319,3cyclictest1579410-21kworker/u8:0+flush-259:007:10:210
1584603992219,2cyclictest1546910-21kworker/u8:3+events_unbound07:13:153
1584600992219,2cyclictest1844660-21kworker/u8:3+flush-259:012:10:062
1584600992219,2cyclictest1781046-21kworker/u8:0+events_unbound10:52:152
1584600992219,2cyclictest1579410-21kworker/u8:0+events_unbound07:40:182
1584596992216,4cyclictest1796723-21/usr/sbin/munin10:35:161
1584592992219,2cyclictest1652101-21kworker/u8:4+events_unbound08:35:220
1584592992218,3cyclictest1744318-21kworker/u8:0+events_unbound10:00:240
1584592992218,3cyclictest1744318-21kworker/u8:0+events_unbound10:00:230
1584592992218,3cyclictest1708566-21kworker/u8:2+flush-259:010:45:010
1584592992218,3cyclictest1610517-21kworker/u8:1+events_unbound07:55:220
1584603992119,1cyclictest1672100-21kworker/u8:1+events_unbound10:20:173
1584603992118,2cyclictest1652101-21kworker/u8:4+events_unbound08:35:203
1584603992117,3cyclictest1844660-21kworker/u8:3+events_unbound11:48:173
1584600992118,2cyclictest1859365-21kworker/u8:4+events_unbound12:00:142
1584600992118,2cyclictest1672100-21kworker/u8:1+events_unbound10:05:262
1584600992118,2cyclictest1579410-21kworker/u8:0+flush-259:007:20:262
1584600992118,2cyclictest1579410-21kworker/u8:0+events_unbound07:30:142
1584600992118,2cyclictest1579410-21kworker/u8:0+events_unbound07:10:202
1584596992118,2cyclictest1708566-21kworker/u8:2+flush-259:010:45:181
1584596992114,5cyclictest252-21systemd-journal12:05:001
1584596992114,5cyclictest1729176-21latency_hist09:30:011
1584592992117,3cyclictest1885000-21turbostat11:59:590
1584592992116,3cyclictest1589970-21apt-get07:15:130
1584592992115,4cyclictest1744554-21latency_hist09:45:000
1584603992018,2cyclictest1579410-21kworker/u8:0+flush-259:007:30:253
1584603992017,2cyclictest1672100-21kworker/u8:1+flush-259:009:00:203
1584603992017,2cyclictest1635540-21kworker/u8:2+events_unbound08:30:213
1584603992016,3cyclictest1579410-21kworker/u8:0+events_unbound07:19:243
1584600992018,2cyclictest1744318-21kworker/u8:0+events_unbound10:00:202
1584600992018,2cyclictest1744318-21kworker/u8:0+events_unbound10:00:192
1584596992016,3cyclictest1916210-21apt-get12:30:121
1584596992016,3cyclictest1916210-21apt-get12:30:111
1584596992015,4cyclictest1844660-21kworker/u8:3+flush-259:011:35:001
1584596992015,4cyclictest1708566-21kworker/u8:2+flush-259:010:27:471
1584596992015,3cyclictest1-21systemd09:45:001
1584592992016,3cyclictest1635540-21kworker/u8:2+events_unbound08:20:110
1584592992016,3cyclictest1546910-21kworker/u8:3+events_unbound07:10:000
1584592992015,3cyclictest1781046-21kworker/u8:0+flush-259:011:15:200
1584592992014,4cyclictest252-21systemd-journal09:49:140
1584592992012,6cyclictest1858267-21ntpq11:30:210
1584603991916,2cyclictest1672100-21kworker/u8:1+events_unbound08:45:263
1584592991915,3cyclictest500-21systemd-logind07:40:000
1584592991915,3cyclictest1610517-21kworker/u8:1+events_unbound08:05:000
1584592991915,2cyclictest1635540-21kworker/u8:2+events_unbound08:15:210
1584603991815,2cyclictest1579410-21kworker/u8:0+events_unbound07:20:083
1584603991814,3cyclictest1708566-21kworker/u8:2+flush-259:009:20:173
1584596991815,2cyclictest1708566-21kworker/u8:2+flush-259:010:40:221
1584596991813,3cyclictest1844660-21kworker/u8:3+flush-259:012:10:151
1584596991813,3cyclictest1672100-21kworker/u8:1+events_unbound09:00:181
1584592991814,3cyclictest1708566-21kworker/u8:2+events_unbound09:20:150
1584592991814,3cyclictest1698287-21kworker/u8:0+flush-259:009:05:210
1584592991814,3cyclictest1579410-21kworker/u8:0+events_unbound07:20:130
1584592991813,3cyclictest1776143-21apt-get10:15:110
1584592991812,4cyclictest1615947-21base6407:40:000
1584603991714,3cyclictest1859365-21kworker/u8:4+events_unbound12:00:183
1584603991714,2cyclictest1903037-21kthreadcore12:15:163
1584603991714,2cyclictest1838654-21kworker/u8:2+events_unbound11:30:203
1584603991714,2cyclictest1781046-21kworker/u8:0+flush-259:011:10:063
1584603991714,2cyclictest1708566-21kworker/u8:2+events_unbound09:45:213
1584600991714,2cyclictest1672100-21kworker/u8:1+flush-259:009:20:342
1584600991712,4cyclictest1791534-21kworker/u8:3+events_unbound10:34:102
1584596991713,3cyclictest252-21systemd-journal12:00:001
1584596991713,3cyclictest1827643-21kworker/u8:1+flush-259:011:15:011
1584596991713,3cyclictest1791534-21kworker/u8:3+flush-259:010:31:201
1584596991713,3cyclictest1635540-21kworker/u8:2+flush-259:008:30:011
1584596991713,3cyclictest1610517-21kworker/u8:1+flush-259:008:20:201
158459699170,3cyclictest1641601-21awk08:05:011
1584592991713,3cyclictest1844660-21kworker/u8:3+flush-259:012:05:130
1584592991713,3cyclictest1817541-21kworker/u8:3+flush-259:011:10:160
1584592991713,3cyclictest1688252-21apt-get08:50:110
1584592991712,4cyclictest1781046-21kworker/u8:0+flush-259:010:55:270
1584592991712,4cyclictest1672100-21kworker/u8:1+flush-259:009:35:160
1584592991712,4cyclictest1579410-21kworker/u8:0+events_unbound07:30:190
1584592991711,2cyclictest60350irq/132-enp0s29f1:rx-010:35:250
1584603991613,2cyclictest1672100-21kworker/u8:1+events_unbound09:10:273
1584592991613,2cyclictest1844660-21kworker/u8:3+events_unbound11:25:160
1584592991613,2cyclictest1672100-21kworker/u8:1+flush-259:009:10:250
1584592991611,4cyclictest1744318-21kworker/u8:0+flush-259:009:50:250
1584592991611,4cyclictest1610517-21kworker/u8:1+flush-259:008:10:230
1584600991512,2cyclictest1698287-21kworker/u8:0+flush-259:009:06:202
158459699159,4cyclictest1734534-21apt-get09:35:121
1584596991512,2cyclictest1631981-21irqcore07:55:161
1584596991511,3cyclictest1859365-21kworker/u8:4+flush-259:011:54:281
1584596991511,3cyclictest1610517-21kworker/u8:1+flush-259:007:50:251
1584596991510,4cyclictest509-21rs:main1
1584596991510,4cyclictest1844660-21kworker/u8:3+flush-259:011:40:271
1584596991510,3cyclictest1652101-21kworker/u8:4+flush-259:008:35:171
1584596991510,3cyclictest1615428-21apt-get07:40:021
1584592991513,1cyclictest60350irq/132-enp0s29f1:rx-012:25:190
1584592991513,1cyclictest60350irq/132-enp0s29f1:rx-012:10:200
1584592991513,1cyclictest60350irq/132-enp0s29f1:rx-011:20:230
1584592991512,2cyclictest60350irq/132-enp0s29f1:rx-011:46:360
1584592991512,2cyclictest60350irq/132-enp0s29f1:rx-010:10:170
1584592991512,2cyclictest60350irq/132-enp0s29f1:rx-008:06:020
1584592991511,3cyclictest1744318-21kworker/u8:0+flush-259:009:55:240
1584603991411,2cyclictest1859365-21kworker/u8:4+flush-259:012:21:213
1584596991411,2cyclictest509-21rs:main1
1584596991411,2cyclictest1610963-21grep07:35:161
1584596991411,2cyclictest0-21swapper/110:00:001
1584592991412,1cyclictest60350irq/132-enp0s29f1:rx-011:35:340
1584592991412,1cyclictest60350irq/132-enp0s29f1:rx-010:06:510
1584592991412,1cyclictest60350irq/132-enp0s29f1:rx-009:30:210
1584592991411,2cyclictest60350irq/132-enp0s29f1:rx-008:47:490
1584600991310,2cyclictest1672100-21kworker/u8:1+events_unbound09:32:582
158459699139,3cyclictest1744318-21kworker/u8:0+flush-259:010:03:211
158459699139,3cyclictest1744318-21kworker/u8:0+flush-259:010:03:201
1584592991311,1cyclictest0-21swapper/011:10:010
158460399129,2cyclictest1579410-21kworker/u8:0+events_unbound07:55:323
158459699129,2cyclictest1745307-21cpuspeed_turbos09:45:121
158459699129,2cyclictest0-21swapper/107:10:001
158459699127,4cyclictest252-21systemd-journal08:06:141
158459699121,9cyclictest252-21systemd-journal12:20:001
1584596991210,1cyclictest0-21swapper/107:20:191
1584592991211,1cyclictest60350irq/132-enp0s29f1:rx-010:25:120
158459699119,1cyclictest0-21swapper/110:15:131
158459699118,2cyclictest1905914-21apt-get12:20:121
158459699118,2cyclictest1653154-21kthreadcore08:15:171
158459699118,1cyclictest0-21swapper/110:55:161
158459699117,2cyclictest1698267-21munin-plugin-st09:00:011
158459699111,2cyclictest1718884-21latency_hist09:20:001
158459699107,2cyclictest1729438-21apt-get09:30:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional