You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 15:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Fri May 08, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1377922995144,5cyclictest1621264-21cat11:05:002
1377922994843,4cyclictest1345146-21kworker/u8:0+flush-259:007:35:002
1377926994642,3cyclictest1642369-21kworker/u8:3+flush-259:011:50:213
1377916994337,4cyclictest252-21systemd-journal10:25:000
1377916994138,2cyclictest1455685-21kworker/u8:1+flush-259:008:30:210
1377918994034,4cyclictest1600725-21/usr/sbin/munin10:45:121
1377918994034,4cyclictest1429870-21latency_hist08:00:011
1377926993936,2cyclictest252-21systemd-journal08:55:013
1377918993833,4cyclictest1662765-21latency_hist11:45:001
1377926993733,3cyclictest1632517-21kworker/u8:2+flush-259:011:15:203
1377926993732,3cyclictest1345146-21kworker/u8:0+flush-259:007:25:243
1377926993633,2cyclictest1532627-21kworker/u8:3+events_unbound10:10:123
1377926993632,3cyclictest1683359-21kworker/u8:1+flush-259:012:30:213
1377926993532,2cyclictest1481536-21kworker/u8:2+events_unbound09:25:153
1377926993528,5cyclictest1517632-21latency_hist09:25:013
1377918993531,3cyclictest1616234-21apt-get11:00:111
1377916993431,2cyclictest1324511-21kworker/u8:3+flush-259:007:15:150
1377916993429,4cyclictest1693661-21latency_hist12:15:010
1377926993330,2cyclictest1616207-21kworker/u8:4+events_unbound11:00:223
1377926993330,2cyclictest1445423-21kworker/u8:0+events_unbound09:43:143
1377926993228,3cyclictest1554380-21kworker/u8:4+events_unbound10:40:143
1377926993225,5cyclictest1642136-21latency_hist11:25:013
1377926993225,3cyclictest1657643-21kworker/u8:0+events_unbound12:00:143
1377916993228,3cyclictest1414413-21kworker/u8:0+flush-259:008:00:000
1377926993128,2cyclictest1683359-21kworker/u8:1+events_unbound12:15:213
1377926993127,3cyclictest1324511-21kworker/u8:3+events_unbound07:13:173
1377926993026,3cyclictest1445423-21kworker/u8:0+events_unbound08:26:163
1377926993026,3cyclictest1435263-21kworker/u8:4+flush-259:009:15:203
1377922993025,4cyclictest1455934-21apt-get08:25:122
1377918993026,3cyclictest1683359-21kworker/u8:1+flush-259:012:25:151
1377916993023,5cyclictest1563503-21ntpq10:05:200
1377926992926,2cyclictest1677796-21kworker/u8:4+flush-259:012:20:233
1377926992926,2cyclictest1554380-21kworker/u8:4+flush-259:010:39:593
1377926992925,3cyclictest1554380-21kworker/u8:4+events_unbound10:03:143
1377926992925,3cyclictest1435263-21kworker/u8:4+flush-259:008:45:203
1377926992925,3cyclictest1324511-21kworker/u8:3+events_unbound07:23:153
1377918992924,3cyclictest1517654-21gpgv09:25:001
1377916992925,3cyclictest1345146-21kworker/u8:0+flush-259:007:10:210
1377926992825,2cyclictest1324511-21kworker/u8:3+events_unbound07:15:163
1377926992824,3cyclictest1688725-21kworker/u8:2+events_unbound12:10:173
1377926992820,5cyclictest1625856-21ntpq11:05:213
1377922992821,5cyclictest1449653-21ntpq08:15:212
1377918992823,3cyclictest1574967-21apt-get10:20:111
1377926992723,3cyclictest1673267-21kworker/u8:1+flush-259:011:55:213
1377926992721,4cyclictest1497314-21apt-get09:05:123
1377918992724,2cyclictest1345146-21kworker/u8:0+flush-259:007:19:551
1377918992721,4cyclictest252-21systemd-journal09:09:141
1377916992723,3cyclictest1324511-21kworker/u8:3+flush-259:007:55:000
1377916992722,4cyclictest1512512-21latency_hist09:20:010
1377926992623,2cyclictest1600724-21kworker/u8:2+events_unbound10:55:253
1377926992622,3cyclictest1569587-21kworker/u8:0+events_unbound10:16:143
1377926992622,3cyclictest1408900-21gpgv07:40:013
1377926992622,3cyclictest1324511-21kworker/u8:3+flush-259:007:40:203
1377926992618,6cyclictest1496138-21ntpq09:00:183
1377916992623,2cyclictest1345146-21kworker/u8:0+flush-259:007:25:170
1377926992521,3cyclictest1600724-21kworker/u8:2+events_unbound10:45:183
1377922992517,5cyclictest252-21systemd-journal07:45:152
1377918992520,4cyclictest1652921-21sshd11:35:131
1377918992520,4cyclictest1435263-21kworker/u8:4+events_unbound08:50:201
1377918992520,3cyclictest1693893-21/usr/sbin/munin12:15:141
1377918992518,5cyclictest1615151-21ntpq10:55:221
1377926992420,3cyclictest1651589-21kworker/u8:2+flush-259:011:34:593
1377926992420,3cyclictest1345146-21kworker/u8:0+events_unbound07:30:223
1377926992417,5cyclictest1486927-21apt-get08:55:113
1377922992420,3cyclictest1435263-21kworker/u8:4+flush-259:009:10:012
1377918992420,3cyclictest1430474-21kworker/u8:2+events_unbound08:15:141
1377918992420,2cyclictest1435263-21kworker/u8:4+flush-259:008:15:001
1377918992418,4cyclictest252-21systemd-journal09:35:151
1377916992419,3cyclictest1615969-21latency_hist11:00:000
1377916992418,5cyclictest1652445-21latency_hist11:35:010
1377916992418,4cyclictest1419572-21latency_hist07:50:000
1377926992320,2cyclictest1430474-21kworker/u8:2+events_unbound08:10:293
1377926992319,3cyclictest1532627-21kworker/u8:3+events_unbound10:20:113
1377926992316,4cyclictest252-21systemd-journal09:45:133
1377922992319,3cyclictest252-21systemd-journal11:26:122
1377922992319,3cyclictest1324511-21kworker/u8:3+flush-259:007:59:452
1377918992320,2cyclictest1553867-21kworker/u8:2+events_unbound10:00:231
1377918992320,2cyclictest1481536-21kworker/u8:2+flush-259:008:50:001
1377918992318,4cyclictest1595563-21/usr/sbin/munin10:40:141
1377918992317,4cyclictest1518314-21apt-get09:25:111
1377916992320,2cyclictest1642369-21kworker/u8:3+events_unbound11:50:010
1377916992318,4cyclictest1435263-21kworker/u8:4+events_unbound09:00:200
1377926992219,2cyclictest1445423-21kworker/u8:0+flush-259:009:30:153
1377926992218,3cyclictest1445666-21apt-get08:15:113
1377926992218,3cyclictest1430474-21kworker/u8:2+events_unbound08:03:143
1377926992218,3cyclictest1377809-21kworker/u8:1+flush-259:007:45:203
1377926992216,4cyclictest1429024-21ntpq07:55:203
1377918992217,4cyclictest1435272-21/usr/sbin/munin08:05:201
1377916992217,4cyclictest1523214-21latency_hist09:30:010
1377926992119,2cyclictest1713497-21kworker/u8:0+events_unbound12:35:243
1377926992117,3cyclictest1642369-21kworker/u8:3+flush-259:011:30:003
1377926992117,3cyclictest1642369-21kworker/u8:3+events_unbound11:45:253
1377926992117,3cyclictest1574934-21kworker/u8:1+flush-259:010:55:003
1377926992117,3cyclictest1481536-21kworker/u8:2+events_unbound09:40:013
1377926992116,3cyclictest252-21systemd-journal08:43:153
1377922992115,4cyclictest1407878-21ntpq07:35:212
1377918992117,3cyclictest1626719-21kworker/u8:1+flush-259:011:30:211
1377916992118,2cyclictest1554380-21kworker/u8:4+flush-259:010:30:200
1377916992117,3cyclictest1435263-21kworker/u8:4+events_unbound08:45:230
1377916992116,4cyclictest252-21systemd-journal07:39:530
1377916992116,4cyclictest1719471-21latency_hist12:40:000
1377916992116,4cyclictest1554380-21kworker/u8:4+flush-259:010:19:590
1377926992016,2cyclictest1657643-21kworker/u8:0+events_unbound12:05:203
1377918992017,2cyclictest1677796-21kworker/u8:4+flush-259:012:05:201
1377918992016,3cyclictest509-21rs:main1
1377918992016,3cyclictest1677796-21kworker/u8:4+flush-259:012:20:201
1377916992017,2cyclictest1345146-21kworker/u8:0+flush-259:007:30:210
1377916992016,3cyclictest1693318-21kworker/u8:3+events_unbound12:30:220
1377916992016,3cyclictest1445423-21kworker/u8:0+flush-259:008:40:200
1377916992016,3cyclictest1445423-21kworker/u8:0+events_unbound09:05:120
1377916992014,4cyclictest252-21systemd-journal11:24:130
1377926991915,3cyclictest1554380-21kworker/u8:4+flush-259:010:30:263
1377926991915,3cyclictest1553867-21kworker/u8:2+events_unbound09:58:133
1377926991911,5cyclictest1470319-21ntpq08:35:193
1377922991916,2cyclictest1683359-21kworker/u8:1+flush-259:012:30:162
1377922991914,4cyclictest1481536-21kworker/u8:2+flush-259:009:05:002
1377918991915,3cyclictest1445423-21kworker/u8:0+events_unbound08:55:151
1377918991915,3cyclictest1430134-21apt-get08:00:091
1377918991915,3cyclictest1383007-21sh07:15:001
1377918991913,4cyclictest1714566-21/usr/sbin/munin12:35:131
1377916991916,2cyclictest1445423-21kworker/u8:0+flush-259:009:20:250
1377916991915,3cyclictest1574934-21kworker/u8:1+events_unbound10:25:230
1377916991915,3cyclictest1445423-21kworker/u8:0+flush-259:009:45:010
1377916991915,3cyclictest1377809-21kworker/u8:1+events_unbound07:45:000
1377916991913,4cyclictest1668139-21apt-get11:50:110
1377922991814,3cyclictest1626719-21kworker/u8:1+flush-259:011:20:162
1377918991814,3cyclictest1584628-21kworker/u8:0+flush-259:010:30:301
1377916991816,1cyclictest0-21swapper/011:35:120
1377916991814,3cyclictest1626719-21kworker/u8:1+flush-259:011:15:240
1377926991714,2cyclictest1554380-21kworker/u8:4+events_unbound10:25:153
1377926991713,3cyclictest1616207-21kworker/u8:4+flush-259:011:10:243
1377926991710,5cyclictest509-21rs:main3
1377926991710,4cyclictest1454784-21ntpq08:20:203
1377922991713,3cyclictest1574934-21kworker/u8:1+flush-259:010:45:252
1377922991713,3cyclictest0-21swapper/207:54:592
1377922991710,4cyclictest1528348-21latency_hist09:35:012
1377918991714,2cyclictest1445423-21kworker/u8:0+flush-259:008:40:161
1377918991713,3cyclictest1345146-21kworker/u8:0+flush-259:007:25:231
1377916991714,2cyclictest60350irq/132-enp0s29f1:rx-008:03:190
1377916991713,3cyclictest1445423-21kworker/u8:0+flush-259:009:15:000
1377916991712,4cyclictest1445423-21kworker/u8:0+events_unbound08:55:230
1377926991612,3cyclictest1626719-21kworker/u8:1+events_unbound11:40:223
1377922991613,2cyclictest1554168-21systemd-run10:00:002
1377922991613,1cyclictest0-21swapper/208:50:002
1377922991611,3cyclictest1553867-21kworker/u8:2+flush-259:010:05:162
1377918991613,2cyclictest1466016-21cron08:34:591
1377918991612,3cyclictest1445423-21kworker/u8:0+events_unbound09:50:131
1377918991612,3cyclictest1377809-21kworker/u8:1+flush-259:007:45:001
1377916991613,2cyclictest60350irq/132-enp0s29f1:rx-011:25:360
1377916991613,2cyclictest60350irq/132-enp0s29f1:rx-011:10:170
1377916991613,2cyclictest60350irq/132-enp0s29f1:rx-010:45:180
1377916991613,2cyclictest1657643-21kworker/u8:0+flush-259:012:00:210
1377916991613,2cyclictest1657643-21kworker/u8:0+events_unbound12:05:140
1377916991611,4cyclictest252-21systemd-journal12:00:010
1377926991511,3cyclictest1435263-21kworker/u8:4+events_unbound09:10:163
1377926991511,3cyclictest1377809-21kworker/u8:1+events_unbound07:50:123
1377922991513,1cyclictest1622813-21kthreadcore11:05:172
1377922991513,1cyclictest0-21swapper/210:40:002
1377922991512,2cyclictest1629253-21kthreadcore11:10:172
1377922991512,2cyclictest0-21swapper/211:45:202
137791899159,4cyclictest1636976-21latency_hist11:20:011
1377918991512,2cyclictest1610799-21idleruntime-cro10:55:001
1377918991512,2cyclictest1435263-21kworker/u8:4+flush-259:008:35:241
1377918991511,3cyclictest1663025-21apt-get11:45:131
137791699158,5cyclictest1709163-21latency_hist12:30:010
1377916991513,1cyclictest60350irq/132-enp0s29f1:rx-009:55:480
1377916991513,1cyclictest60350irq/132-enp0s29f1:rx-009:50:020
1377916991513,1cyclictest60350irq/132-enp0s29f1:rx-008:51:230
1377916991513,1cyclictest60350irq/132-enp0s29f1:rx-007:20:130
1377916991512,2cyclictest60350irq/132-enp0s29f1:rx-012:22:180
1377916991512,2cyclictest60350irq/132-enp0s29f1:rx-008:35:300
1377916991512,2cyclictest60350irq/132-enp0s29f1:rx-008:05:150
1377916991512,1cyclictest0-21swapper/011:05:010
1377916991512,1cyclictest0-21swapper/010:44:590
1377916991511,3cyclictest1430474-21kworker/u8:2+flush-259:008:15:180
1377916991511,2cyclictest60350irq/132-enp0s29f1:rx-010:50:110
1377916991511,2cyclictest0-21swapper/010:05:000
1377916991510,4cyclictest1430474-21kworker/u8:2+flush-259:008:20:200
1377916991510,3cyclictest1435263-21kworker/u8:4+events_unbound08:10:180
137792299149,3cyclictest509-21rs:main2
137792299148,5cyclictest1507356-21latency_hist09:15:002
1377922991411,1cyclictest0-21swapper/208:55:212
1377922991410,3cyclictest1345146-21kworker/u8:0+flush-259:007:20:202
1377918991410,3cyclictest1553867-21kworker/u8:2+events_unbound10:05:141
1377918991410,3cyclictest1345146-21kworker/u8:0+flush-259:007:25:001
1377916991412,2cyclictest60350irq/132-enp0s29f1:rx-011:44:200
1377916991412,1cyclictest60350irq/132-enp0s29f1:rx-009:35:200
1377916991411,2cyclictest60350irq/132-enp0s29f1:rx-009:47:200
1377926991310,3cyclictest1651589-21kworker/u8:2+flush-259:011:35:193
1377922991311,1cyclictest1383012-21sh07:15:002
1377922991311,1cyclictest0-21swapper/212:05:012
1377922991310,2cyclictest1553867-21kworker/u8:2+flush-259:010:00:232
1377922991310,2cyclictest1522396-21ntp_offset09:25:212
1377922991310,2cyclictest1384300-21kthreadcore07:15:162
1377918991310,2cyclictest1677749-21unixbench_singl11:55:241
1377918991310,1cyclictest1569587-21kworker/u8:0-ext4-rsv-conversion10:19:591
137791699139,3cyclictest1445423-21kworker/u8:0+events_unbound08:25:210
1377916991312,1cyclictest60350irq/132-enp0s29f1:rx-012:15:210
1377916991312,1cyclictest60350irq/132-enp0s29f1:rx-011:05:500
1377916991311,1cyclictest60350irq/132-enp0s29f1:rx-010:35:150
1377916991310,2cyclictest60350irq/132-enp0s29f1:rx-009:32:140
137792699129,3cyclictest1553867-21kworker/u8:2+events_unbound10:05:243
137792699128,3cyclictest1435263-21kworker/u8:4+events_unbound08:09:153
137792299129,2cyclictest1532627-21kworker/u8:3+flush-259:010:15:232
137792299128,3cyclictest1445423-21kworker/u8:0+flush-259:009:20:262
137791899129,2cyclictest1677796-21kworker/u8:4+flush-259:012:00:531
137791899129,2cyclictest1625798-21ntp_kernel_pll_11:05:201
137791899129,2cyclictest1590654-21fschecks_time10:35:141
137791899129,2cyclictest1565112-21irqcore10:10:161
137791899129,2cyclictest1430474-21kworker/u8:2+events_unbound08:20:011
137791899128,3cyclictest1435263-21kworker/u8:4+events_unbound09:10:121
137791899128,2cyclictest0-21swapper/107:40:001
137791699129,2cyclictest60350irq/132-enp0s29f1:rx-010:10:160
137792699117,3cyclictest1455685-21kworker/u8:1+events_unbound08:30:033
137792299119,1cyclictest1468620-21tr08:35:182
137792299119,1cyclictest0-21swapper/210:34:592
137792299118,2cyclictest1507711-21cpuspeed_turbos09:15:142
137792299118,2cyclictest1435263-21kworker/u8:4+flush-259:008:42:442
137792299118,2cyclictest0-21swapper/210:10:212
137792299117,3cyclictest1430474-21kworker/u8:2+flush-259:008:02:472
137792299116,4cyclictest1409442-21/usr/sbin/munin07:40:202
137792299115,4cyclictest1688598-21cat12:10:012
137792299111,8cyclictest1585011-21latency_hist10:30:012
137792299111,6cyclictest1445406-21munin-run08:15:002
137791899118,1cyclictest0-21swapper/110:30:001
137791899116,4cyclictest1398697-21apt-get07:30:111
137792299108,1cyclictest0-21swapper/210:20:182
137792299107,2cyclictest1688829-21cpuspeed_turbos12:10:102
137792299107,2cyclictest1445423-21kworker/u8:0+flush-259:009:50:142
137792299104,4cyclictest1600490-21awk10:45:002
137792299100,8cyclictest1715086-21irqcore12:35:152
137792299100,2cyclictest1466047-21basename08:35:002
137791899107,2cyclictest0-21swapper/111:10:141
137791899106,3cyclictest1642369-21kworker/u8:3+events_unbound11:25:141
13779229997,1cyclictest0-21swapper/210:55:242
13779229996,2cyclictest0-21swapper/208:50:172
13779229995,3cyclictest1-21systemd09:50:012
13779229994,3cyclictest1673211-21cat11:55:012
13779229990,4cyclictest1455686-21systemd-run08:25:002
13779229986,1cyclictest0-21swapper/212:15:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional