You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 16:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Apr 04, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1471551994942,4cyclictest509-21rs:main2
1471548994441,2cyclictest1649076-21kworker/u8:0+flush-259:012:20:191
1471551994338,4cyclictest1638617-21gpgv09:49:592
1471548994237,3cyclictest1675672-21/usr/sbin/munin10:25:141
1471546994137,3cyclictest1476953-21apt-get07:15:130
1471548994034,4cyclictest1556022-21diskstats08:30:131
1471556993936,2cyclictest1789601-21fwupd12:12:183
1471551993933,4cyclictest1607539-21kworker/u8:0+flush-259:009:20:152
1471556993832,4cyclictest1555176-21latency_hist08:30:003
1471548993835,2cyclictest1649076-21kworker/u8:0+flush-259:011:00:001
1471548993835,2cyclictest1607539-21kworker/u8:0+flush-259:009:20:231
1471548993834,3cyclictest1695948-21kworker/u8:1+flush-259:012:25:171
1471551993732,3cyclictest1314905-21kworker/u8:0+flush-259:007:45:182
1471548993734,2cyclictest1550050-21kworker/u8:3+events_unbound10:05:251
1471546993734,2cyclictest1550050-21kworker/u8:3+flush-259:009:05:160
1471548993633,2cyclictest1664731-21kworker/u8:2+flush-259:010:40:211
1471548993632,3cyclictest1418507-21kworker/u8:4+events_unbound07:25:241
1471551993529,4cyclictest1716675-21latency_hist11:05:012
1471548993532,2cyclictest1502450-21kworker/u8:2+flush-259:007:54:591
1471548993531,3cyclictest1695948-21kworker/u8:1+flush-259:011:30:201
1471546993532,2cyclictest1544624-21kworker/u8:1+flush-259:008:20:170
1471546993529,4cyclictest1696017-21latency_hist10:45:010
1471551993431,2cyclictest1502450-21kworker/u8:2+flush-259:007:59:592
1471548993428,3cyclictest1502450-21kworker/u8:2+flush-259:008:10:141
1471546993430,3cyclictest1502450-21kworker/u8:2+events_unbound08:45:020
1471548993330,2cyclictest1649076-21kworker/u8:0+flush-259:011:45:011
1471548993328,3cyclictest1779697-21/usr/sbin/munin12:05:201
1471548993328,3cyclictest1757989-21kworker/u8:2+events_unbound12:10:111
1471546993330,2cyclictest1314905-21kworker/u8:0+flush-259:007:20:170
1471556993225,5cyclictest1533933-21cp08:10:003
1471548993226,4cyclictest1649076-21kworker/u8:0+flush-259:011:20:261
1471546993228,3cyclictest1757989-21kworker/u8:2+events_unbound11:55:010
1471556993126,4cyclictest1550050-21kworker/u8:3+events_unbound10:00:243
1471548993125,4cyclictest1737564-21/usr/sbin/munin11:25:161
1471548993125,4cyclictest1492355-21apt-get07:30:111
1471546993128,2cyclictest1418507-21kworker/u8:4+flush-259:007:25:170
1471548993026,3cyclictest1582033-21apt-get08:55:111
1471548993026,3cyclictest1550050-21kworker/u8:3+flush-259:010:20:201
1471548993026,3cyclictest1314905-21kworker/u8:0+flush-259:007:35:271
1471548993025,3cyclictest1696248-21/usr/sbin/munin10:45:151
1471548993024,4cyclictest1502450-21kworker/u8:2+events_unbound08:40:231
1471546993026,3cyclictest1471770-21apt-get07:10:110
1471556992926,2cyclictest1550050-21kworker/u8:3+flush-259:008:45:243
1471556992924,4cyclictest1518585-21apt-get07:55:113
1471548992926,2cyclictest1628242-21kworker/u8:2+flush-259:009:55:181
1471548992926,2cyclictest1550050-21kworker/u8:3+events_unbound09:00:191
1471548992926,2cyclictest1523500-21kworker/u8:3+events_unbound08:15:141
1471546992926,2cyclictest1314905-21kworker/u8:0+flush-259:007:30:160
1471556992823,4cyclictest1555712-21base6408:30:013
1471556992820,6cyclictest1804552-21ntpq12:25:233
1471551992824,3cyclictest1790077-21/usr/sbin/munin12:15:242
1471551992824,3cyclictest1701618-21diskstats10:50:132
1471551992822,4cyclictest1555768-21cat08:30:002
1471551992821,4cyclictest1664731-21kworker/u8:2+flush-259:010:15:242
1471548992824,3cyclictest1695948-21kworker/u8:1+events_unbound12:30:281
1471548992824,2cyclictest1622908-21kworker/u8:0+flush-259:009:40:211
1471546992825,2cyclictest1613023-21apt-get09:25:120
147154699281,26cyclictest1-21systemd10:05:290
1471556992723,3cyclictest1314905-21kworker/u8:0+events_unbound07:10:233
1471548992723,3cyclictest1314905-21kworker/u8:0+events_unbound07:45:171
1471548992722,3cyclictest1664731-21kworker/u8:2+flush-259:010:35:201
1471548992722,3cyclictest1649076-21kworker/u8:0+flush-259:011:10:211
1471556992623,2cyclictest1628242-21kworker/u8:2+flush-259:009:55:243
1471556992622,3cyclictest1670537-21apt-get10:20:123
1471556992622,3cyclictest1314905-21kworker/u8:0+events_unbound07:15:233
1471556992620,4cyclictest1732402-21apt-get11:20:093
1471548992623,3cyclictest1757989-21kworker/u8:2+events_unbound12:00:131
1471546992623,2cyclictest1680808-21kworker/u8:3+flush-259:010:35:220
1471556992521,3cyclictest1314905-21kworker/u8:0+events_unbound08:20:013
1471551992520,4cyclictest1314905-21kworker/u8:0+flush-259:007:20:212
1471551992520,3cyclictest1560930-21kworker/u8:0+flush-259:008:50:002
1471548992521,3cyclictest1721861-21kworker/u8:4+events_unbound11:55:181
1471548992521,2cyclictest1757989-21kworker/u8:2+events_unbound12:35:141
1471546992522,2cyclictest1550050-21kworker/u8:3+flush-259:008:25:220
1471546992518,5cyclictest1571465-21cp08:45:000
1471551992420,3cyclictest1314905-21kworker/u8:0+flush-259:007:10:182
1471551992417,5cyclictest1805395-21latency_hist12:30:002
1471548992422,1cyclictest1763392-21apt-get11:50:121
1471548992421,2cyclictest1481846-21kworker/u8:1+flush-259:007:24:591
1471548992420,3cyclictest1649076-21kworker/u8:0+events_unbound10:10:081
1471548992420,3cyclictest1550050-21kworker/u8:3+flush-259:009:30:161
1471548992419,3cyclictest1758205-21/usr/sbin/munin11:45:231
1471546992423,1cyclictest1550050-21kworker/u8:3+events_unbound09:50:230
1471546992421,2cyclictest1649076-21kworker/u8:0+flush-259:010:10:210
1471546992421,2cyclictest1649076-21kworker/u8:0+events_unbound11:15:230
1471546992421,2cyclictest1597527-21kworker/u8:1+events_unbound09:10:240
1471546992420,3cyclictest1550050-21kworker/u8:3+events_unbound08:35:020
1471546992419,4cyclictest1638686-21cat09:50:000
1471556992320,2cyclictest1550050-21kworker/u8:3+events_unbound09:05:133
1471551992316,4cyclictest1795278-21/usr/sbin/munin12:20:232
1471548992320,2cyclictest1680808-21kworker/u8:3+events_unbound11:05:211
1471548992319,3cyclictest1545146-21apt-get08:20:121
1471548992319,2cyclictest1550050-21kworker/u8:3+flush-259:009:05:241
1471548992317,4cyclictest1680808-21kworker/u8:3+flush-259:010:50:251
1471548992316,5cyclictest1653552-21ntpq10:00:221
1471546992320,2cyclictest1649076-21kworker/u8:0+events_unbound12:10:000
1471546992319,3cyclictest1622908-21kworker/u8:0+flush-259:009:35:180
1471556992220,1cyclictest1597527-21kworker/u8:1+events_unbound09:10:233
1471556992218,3cyclictest1597527-21kworker/u8:1+events_unbound09:35:233
1471556992218,3cyclictest1550050-21kworker/u8:3+events_unbound09:50:223
1471556992217,4cyclictest1757989-21kworker/u8:2+events_unbound11:55:133
1471551992218,3cyclictest1550050-21kworker/u8:3+flush-259:009:40:262
1471548992219,2cyclictest1560930-21kworker/u8:0+flush-259:008:35:181
1471548992219,2cyclictest1550050-21kworker/u8:3+flush-259:008:45:201
1471548992218,3cyclictest1502450-21kworker/u8:2+events_unbound07:40:111
1471548992218,3cyclictest1314905-21kworker/u8:0+flush-259:008:00:191
1471548992217,4cyclictest1680808-21kworker/u8:3+events_unbound11:15:271
1471546992216,5cyclictest1517434-21ntpq07:50:210
147154699221,20cyclictest509-21rs:main0
1471556992118,2cyclictest1664970-21apt-get10:15:113
1471556992117,3cyclictest1721861-21kworker/u8:4+flush-259:011:30:013
1471556992117,3cyclictest1649076-21kworker/u8:0+events_unbound10:55:193
1471551992118,2cyclictest1680808-21kworker/u8:3+flush-259:010:45:172
1471551992117,3cyclictest1649076-21kworker/u8:0+flush-259:011:10:002
1471551992115,4cyclictest1789834-21latency_hist12:15:002
1471548992118,2cyclictest1680808-21kworker/u8:3+events_unbound10:30:211
1471546992118,2cyclictest1680808-21kworker/u8:3+events_unbound11:00:200
1471546992118,2cyclictest1560930-21kworker/u8:0+flush-259:008:55:160
1471546992117,3cyclictest252-21systemd-journal10:03:160
1471556992017,3cyclictest1597527-21kworker/u8:1+events_unbound09:15:143
1471556992017,2cyclictest1695948-21kworker/u8:1+events_unbound11:35:123
1471556992017,2cyclictest1695948-21kworker/u8:1+events_unbound11:00:233
1471556992017,2cyclictest1550050-21kworker/u8:3+events_unbound10:05:233
1471556992016,3cyclictest1314905-21kworker/u8:0+flush-259:008:00:263
1471551992014,4cyclictest1565860-21latency_hist08:40:002
1471548992017,2cyclictest1513413-21kworker/u8:1+flush-259:007:55:251
1471548992016,3cyclictest1695948-21kworker/u8:1+events_unbound11:35:241
1471548992015,3cyclictest1502450-21kworker/u8:2+events_unbound08:08:161
1471546992017,2cyclictest1523500-21kworker/u8:3+events_unbound08:15:180
1471556991916,2cyclictest1695948-21kworker/u8:1+flush-259:011:15:163
147155199195,8cyclictest1607607-21awk09:20:002
1471551991916,2cyclictest1664731-21kworker/u8:2+flush-259:010:40:242
1471551991913,4cyclictest1507600-21latency_hist07:45:002
1471548991916,2cyclictest858-21sshd10:15:161
1471548991915,3cyclictest1592115-21kworker/u8:2+events_unbound09:16:181
1471548991915,3cyclictest1550050-21kworker/u8:3+events_unbound08:53:191
1471546991916,2cyclictest1757989-21kworker/u8:2+flush-259:012:30:250
1471546991916,2cyclictest1757989-21kworker/u8:2+flush-259:012:00:160
1471546991916,2cyclictest1550050-21kworker/u8:3+events_unbound09:00:180
1471546991915,3cyclictest1721861-21kworker/u8:4+flush-259:011:25:010
1471546991915,3cyclictest1649076-21kworker/u8:0+flush-259:010:55:260
1471546991914,4cyclictest1534416-21/usr/sbin/munin08:10:150
1471556991815,2cyclictest1695948-21kworker/u8:1+events_unbound11:30:193
1471556991815,2cyclictest1550050-21kworker/u8:3+events_unbound09:30:193
1471556991814,3cyclictest1560930-21kworker/u8:0+events_unbound08:40:153
1471556991814,3cyclictest1506747-21ntpq07:40:213
147155199182,7cyclictest1502414-21awk07:39:592
1471551991815,2cyclictest1649076-21kworker/u8:0+flush-259:012:05:222
1471551991814,3cyclictest1560930-21kworker/u8:0+flush-259:008:55:232
1471551991814,2cyclictest0-21swapper/210:29:592
1471551991812,5cyclictest1768973-21munin-node11:55:112
1471551991812,4cyclictest252-21systemd-journal08:05:012
1471548991815,2cyclictest1638525-21gpgv09:50:001
1471546991815,2cyclictest1721861-21kworker/u8:4+events_unbound11:25:250
1471546991815,2cyclictest1622908-21kworker/u8:0+events_unbound09:40:180
1471546991814,3cyclictest1680808-21kworker/u8:3+events_unbound10:50:180
1471556991713,3cyclictest1560930-21kworker/u8:0+flush-259:008:50:173
1471556991713,3cyclictest1560930-21kworker/u8:0+events_unbound08:55:183
1471556991713,2cyclictest1314905-21kworker/u8:0+events_unbound07:35:173
1471551991713,3cyclictest1314905-21kworker/u8:0+flush-259:008:05:162
1471551991713,2cyclictest1653436-21tail10:00:202
1471548991713,3cyclictest1314905-21kworker/u8:0+events_unbound07:13:571
1471546991711,4cyclictest1612753-21latency_hist09:25:000
1471546991711,4cyclictest1560703-21dump-pmu-power08:35:000
1471556991613,2cyclictest1418507-21kworker/u8:4+flush-259:007:34:593
1471556991613,2cyclictest1314905-21kworker/u8:0+events_unbound07:10:023
147155199169,5cyclictest252-21systemd-journal10:55:172
147155199164,6cyclictest1747652-21munin-run11:35:012
1471551991612,3cyclictest1732129-21idleruntime-cro11:20:002
1471548991612,3cyclictest1612988-21kworker/u8:2+flush-259:009:26:021
1471546991614,1cyclictest60350irq/132-enp0s29f1:rx-011:40:140
1471546991614,1cyclictest60350irq/132-enp0s29f1:rx-009:15:170
1471546991613,2cyclictest60350irq/132-enp0s29f1:rx-010:15:250
1471546991613,2cyclictest1649076-21kworker/u8:0+flush-259:011:10:240
1471556991513,2cyclictest1695948-21kworker/u8:1+events_unbound12:40:003
1471556991512,2cyclictest1695948-21kworker/u8:1+flush-259:011:45:213
1471556991512,2cyclictest1664731-21kworker/u8:2+flush-259:010:35:183
147155199151,7cyclictest1617951-21munin-run09:30:002
1471551991512,2cyclictest1488247-21kthreadcore07:25:172
1471551991510,4cyclictest509-21rs:main2
1471548991512,2cyclictest1502450-21kworker/u8:2+events_unbound08:29:171
1471548991511,3cyclictest1695948-21kworker/u8:1+events_unbound12:15:371
1471548991511,3cyclictest1418507-21kworker/u8:4+events_unbound07:19:581
147154699159,4cyclictest252-21systemd-journal12:00:000
1471546991513,1cyclictest60350irq/132-enp0s29f1:rx-008:05:130
1471546991513,1cyclictest60350irq/132-enp0s29f1:rx-007:40:250
1471546991512,2cyclictest60350irq/132-enp0s29f1:rx-008:54:250
1471546991512,2cyclictest1757989-21kworker/u8:2+events_unbound12:35:210
1471546991512,2cyclictest1508885-21sort07:45:170
147155699149,4cyclictest509-21rs:main3
147155699149,3cyclictest1502450-21kworker/u8:2+flush-259:008:25:003
1471556991412,1cyclictest0-21swapper/307:54:593
1471556991411,2cyclictest1486096-21ntp_kernel_pll_07:20:233
1471556991410,3cyclictest1716916-21/usr/sbin/munin11:05:143
147155199149,3cyclictest1757989-21kworker/u8:2+flush-259:012:00:212
1471551991411,2cyclictest1646647-21kthreadcore09:55:172
1471551991410,3cyclictest1695948-21kworker/u8:1+flush-259:011:20:302
1471551991410,3cyclictest1550050-21kworker/u8:3+events_unbound09:50:182
1471548991411,2cyclictest1622908-21kworker/u8:0+flush-259:009:35:341
1471548991410,3cyclictest1695948-21kworker/u8:1+events_unbound11:00:031
1471546991412,1cyclictest60350irq/132-enp0s29f1:rx-012:20:240
1471546991412,1cyclictest60350irq/132-enp0s29f1:rx-008:00:240
1471546991412,1cyclictest0-21swapper/010:24:590
1471546991411,2cyclictest60350irq/132-enp0s29f1:rx-012:14:090
1471546991411,2cyclictest60350irq/132-enp0s29f1:rx-011:31:370
1471546991411,2cyclictest60350irq/132-enp0s29f1:rx-007:35:110
1471546991411,2cyclictest211rcuc/011:10:010
1471546991411,2cyclictest1695948-21kworker/u8:1+events_unbound12:15:200
147155699139,3cyclictest1757989-21kworker/u8:2+flush-259:011:50:163
147155699139,3cyclictest1649076-21kworker/u8:0+flush-259:012:17:353
147155699139,3cyclictest1587215-21apt-get09:00:103
1471556991310,2cyclictest1550050-21kworker/u8:3+flush-259:009:45:233
1471556991310,2cyclictest1502450-21kworker/u8:2+flush-259:008:35:253
147155199139,3cyclictest1523500-21kworker/u8:3+flush-259:008:15:302
147155199137,4cyclictest252-21systemd-journal07:35:002
147155199137,4cyclictest1481799-21latency_hist07:20:012
147155199135,3cyclictest1664709-21apt10:14:592
147155199131,9cyclictest1550027-21awk08:25:002
1471551991311,1cyclictest1727006-21turbostat11:15:002
1471551991310,2cyclictest1757989-21kworker/u8:2+flush-259:011:50:252
1471546991312,1cyclictest60350irq/132-enp0s29f1:rx-010:45:140
1471546991312,1cyclictest60350irq/132-enp0s29f1:rx-010:29:420
1471546991311,1cyclictest60350irq/132-enp0s29f1:rx-011:37:480
1471546991310,2cyclictest60350irq/132-enp0s29f1:rx-011:45:110
147155699129,2cyclictest1649076-21kworker/u8:0+flush-259:012:20:143
147155699128,3cyclictest252-21systemd-journal10:35:003
1471556991210,1cyclictest0-21swapper/312:00:163
147155199129,2cyclictest1681855-21sort10:30:162
147155199128,3cyclictest252-21systemd-journal11:29:552
147155199125,1cyclictest0-21swapper/209:15:012
147155199120,9cyclictest1815698-21awk12:40:002
147154899129,2cyclictest1628242-21kworker/u8:2+events_unbound09:53:031
147154699129,2cyclictest1695948-21kworker/u8:1+events_unbound12:25:190
1471546991211,1cyclictest60350irq/132-enp0s29f1:rx-007:57:440
147155699118,2cyclictest1675459-21kworker/u8:1+flush-259:010:25:233
147155699118,2cyclictest1649076-21kworker/u8:0+events_unbound12:05:223
147155699116,3cyclictest1539654-21dpkg08:15:003
147155199119,1cyclictest0-21swapper/208:15:002
147155199116,4cyclictest1571031-21cron08:45:012
147155199110,2cyclictest1581761-21awk08:55:002
147155699107,2cyclictest1680808-21kworker/u8:3+events_unbound10:45:243
147155699107,2cyclictest1622908-21kworker/u8:0+events_unbound09:40:173
147155699107,2cyclictest0-21swapper/310:10:103
147155699106,3cyclictest252-21systemd-journal09:20:173
147155699106,3cyclictest1508274-21tr07:45:173
147155199107,1cyclictest0-21swapper/209:05:122
14715569995,3cyclictest1695948-21kworker/u8:1+events_unbound10:55:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional