You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 23:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Sep 11, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1373607993936,2cyclictest1482455-21kworker/u8:0+flush-259:009:20:161
1373607993934,3cyclictest335557-21systemd-journal07:20:001
1373614993830,7cyclictest1705944-21apt-get12:30:172
1373607993833,3cyclictest1602010-21/usr/sbin/munin10:50:161
1373607993732,4cyclictest1632370-21ntpq11:15:201
1373602993632,3cyclictest1410188-21kworker/u8:2+flush-259:007:45:240
1373602993631,4cyclictest1471695-21kworker/u8:1+flush-259:009:55:240
1373607993531,3cyclictest1695606-21apt-get12:20:111
1373614993227,4cyclictest1628265-21cat11:15:012
1373607993228,3cyclictest1539918-21/usr/sbin/munin09:50:201
1373607993228,3cyclictest1539918-21/usr/sbin/munin09:50:191
1373607993227,4cyclictest1519245-21/usr/sbin/munin09:30:161
1373607993226,4cyclictest1388609-21ntpq07:20:191
1373614993125,4cyclictest1544834-21latency_hist09:55:012
1373614993125,4cyclictest1544834-21latency_hist09:55:012
1373607993127,3cyclictest1471695-21kworker/u8:1+flush-259:008:55:111
1373602993126,3cyclictest1571077-21apt-get10:20:120
1373617993023,5cyclictest1643629-21latency_hist11:30:013
1373607993026,3cyclictest1477237-21kworker/u8:2+flush-259:009:35:171
1373617992925,3cyclictest1529576-21/usr/sbin/munin09:40:203
1373602992923,4cyclictest335557-21systemd-journal09:03:500
1373614992823,4cyclictest1415582-21apt-get07:50:112
1373614992823,3cyclictest1431050-21apt-get08:05:122
137360299281,25cyclictest1-21systemd08:20:000
1373614992622,3cyclictest1477237-21kworker/u8:2+flush-259:009:15:162
1373607992620,4cyclictest1482433-21latency_hist08:55:011
1373602992622,3cyclictest1477237-21kworker/u8:2+events_unbound10:10:200
1373614992518,5cyclictest1440253-21ntpq08:10:212
1373607992520,4cyclictest1575970-21kworker/u8:0+flush-259:010:30:251
1373607992518,5cyclictest1456580-21latency_hist08:30:011
1373602992521,3cyclictest1690405-21apt-get12:15:100
1373617992319,3cyclictest1606995-21kworker/u8:0+flush-259:011:34:593
1373617992317,4cyclictest1596599-21latency_hist10:45:013
1373617992317,4cyclictest1384353-21cat07:20:003
1373617992310,11cyclictest335557-21systemd-journal11:05:013
1373614992319,3cyclictest1471695-21kworker/u8:1+flush-259:010:25:162
1373607992319,3cyclictest1357865-21kworker/u8:3+flush-259:007:55:171
1373607992317,4cyclictest1633510-21/usr/sbin/munin11:20:151
1373607992316,5cyclictest1684094-21ntpq12:05:201
1373602992319,3cyclictest507-21in:imuxsock11:35:000
1373602992316,5cyclictest1704809-21ntpq12:25:210
1373617992216,4cyclictest1705667-21latency_hist12:30:013
1373614992217,3cyclictest1674601-21latency_hist12:00:002
1373607992216,4cyclictest1586329-21kworker/u8:2+flush-259:011:10:151
1373602992218,3cyclictest1649072-21apt-get11:35:120
1373602992218,3cyclictest1363034-21kworker/u8:2+events_unbound07:10:230
1373602992216,5cyclictest1378923-21kworker/u8:1+events_unbound07:20:220
1373617992116,4cyclictest1586569-21apt-get10:35:123
1373617992110,9cyclictest0-21swapper/308:50:153
1373614992115,4cyclictest1653989-21latency_hist11:40:012
1373607992115,4cyclictest335557-21systemd-journal08:46:171
1373602992118,2cyclictest1695087-21kworker/u8:3+events_unbound12:20:230
1373602992117,3cyclictest1627675-21apt-get11:15:000
1373602992117,3cyclictest1606995-21kworker/u8:0+flush-259:010:55:190
1373602992116,4cyclictest1633232-21kworker/u8:2+events_unbound12:00:140
1373602992116,4cyclictest1586329-21kworker/u8:2+events_unbound10:50:250
137360299211,19cyclictest1591465-21turbostat10:40:010
1373617992017,1cyclictest0-21swapper/308:25:013
1373617992016,3cyclictest1441141-21kworker/u8:3+flush-259:008:45:243
1373617992014,4cyclictest1377838-21ntpq07:10:223
1373617992010,8cyclictest1426054-21diskstats08:00:123
1373614992017,2cyclictest1471695-21kworker/u8:1+flush-259:009:20:202
137361499200,2cyclictest1565681-21awk10:15:002
1373607992016,3cyclictest1405225-21/usr/sbin/munin07:40:231
1373607992014,4cyclictest1685206-21/usr/sbin/munin12:10:251
1373607992014,4cyclictest1685206-21/usr/sbin/munin12:10:251
1373602992016,3cyclictest1575970-21kworker/u8:0+events_unbound10:30:140
1373602992016,3cyclictest1471695-21kworker/u8:1+flush-259:008:55:220
1373602992015,3cyclictest1606995-21kworker/u8:0+flush-259:011:05:240
1373602992015,3cyclictest1384034-21gpgv07:20:010
1373602992014,4cyclictest509-21rs:main0
1373602992013,5cyclictest1632357-21ntpq11:15:200
1373602992012,5cyclictest1673700-21ntpq11:55:200
1373617991915,3cyclictest1420519-21kworker/u8:0+flush-259:008:15:223
1373617991914,3cyclictest1471695-21kworker/u8:1+flush-259:009:10:163
1373617991912,5cyclictest1622536-21latency_hist11:10:003
137361499197,2cyclictest1555943-21grep10:05:162
1373614991916,2cyclictest1685648-21irqcore12:10:212
1373614991916,2cyclictest1685648-21irqcore12:10:202
1373614991916,2cyclictest1550068-21idleruntime-cro09:59:592
1373614991915,3cyclictest1544854-21kworker/u8:5+flush-259:010:15:172
1373614991914,3cyclictest1513851-21apt-key09:25:012
1373607991915,3cyclictest1633232-21kworker/u8:2+events_unbound11:40:231
1373607991914,4cyclictest1456455-21kworker/u8:0+flush-259:008:30:191
1373602991915,3cyclictest1477237-21kworker/u8:2+flush-259:009:45:000
1373602991915,3cyclictest1420519-21kworker/u8:0+flush-259:008:05:150
1373602991914,4cyclictest1477237-21kworker/u8:2+events_unbound09:30:180
1373602991912,5cyclictest335557-21systemd-journal11:54:590
137361799189,7cyclictest0-21swapper/309:35:143
137361799187,9cyclictest0-21swapper/309:15:253
137361799186,2cyclictest1627691-21gpgv11:15:013
1373617991814,3cyclictest1471695-21kworker/u8:1+flush-259:009:20:223
1373614991815,2cyclictest1410188-21kworker/u8:2+flush-259:007:45:212
1373607991813,4cyclictest1394940-21apt-get07:30:121
1373602991814,3cyclictest1544854-21kworker/u8:5+events_unbound10:40:240
1373602991813,4cyclictest1633232-21kworker/u8:2+flush-259:011:45:210
1373602991813,4cyclictest1534758-21apt-get09:45:110
1373602991813,4cyclictest1482455-21kworker/u8:0+events_unbound09:15:130
1373602991813,3cyclictest335480-21sshd08:43:180
1373602991811,5cyclictest1420479-21latency_hist07:55:000
1373617991714,2cyclictest1493169-21cpuspeed_turbos09:05:133
1373614991714,2cyclictest1383037-21ntp_kernel_pll_07:15:202
137361499170,2cyclictest1705667-21latency_hist12:30:012
137361499170,16cyclictest1552104-21sshd10:00:182
1373607991714,2cyclictest1644928-21kthreadcore11:30:241
1373607991712,4cyclictest1430810-21kworker/u8:1+flush-259:008:10:241
1373602991714,2cyclictest60350irq/132-enp0s29f1:rx-010:00:160
1373602991714,2cyclictest60350irq/132-enp0s29f1:rx-007:32:370
1373602991714,2cyclictest0-21swapper/008:35:000
1373602991713,3cyclictest1633232-21kworker/u8:2+events_unbound11:25:220
1373602991713,3cyclictest1482455-21kworker/u8:0+events_unbound09:20:140
1373602991713,3cyclictest1451271-21kworker/u8:2+flush-259:008:25:000
1373602991712,3cyclictest1462025-21apt-get08:35:120
1373602991710,5cyclictest509-21rs:main0
137361799166,1cyclictest0-21swapper/311:45:123
1373617991613,2cyclictest1477237-21kworker/u8:2+flush-259:010:00:223
1373617991612,3cyclictest1378923-21kworker/u8:1+flush-259:007:30:163
137361799160,3cyclictest1575943-21sh10:25:003
1373614991614,1cyclictest1643630-21cron11:30:002
1373614991611,3cyclictest1606976-21latency_hist10:55:002
1373607991613,2cyclictest1357865-21kworker/u8:3+flush-259:007:48:481
1373607991612,2cyclictest0-21swapper/109:40:161
1373607991611,4cyclictest1633232-21kworker/u8:2+flush-259:011:45:241
1373607991611,3cyclictest1378702-21latency_hist07:15:001
1373602991614,1cyclictest60350irq/132-enp0s29f1:rx-009:50:210
1373602991614,1cyclictest60350irq/132-enp0s29f1:rx-009:50:200
1373602991614,1cyclictest60350irq/132-enp0s29f1:rx-009:25:420
1373602991614,1cyclictest60350irq/132-enp0s29f1:rx-009:10:200
1373602991614,1cyclictest60350irq/132-enp0s29f1:rx-009:05:240
1373602991613,2cyclictest60350irq/132-enp0s29f1:rx-010:45:170
1373602991613,2cyclictest1669451-21kworker/u8:1+events_unbound12:10:270
1373602991613,2cyclictest1669451-21kworker/u8:1+events_unbound12:10:270
1373602991612,3cyclictest1420519-21kworker/u8:0+flush-259:008:00:100
1373602991612,3cyclictest1378923-21kworker/u8:1+events_unbound07:25:180
1373602991612,2cyclictest1404992-21turbostat07:40:000
137361799157,1cyclictest0-21swapper/309:00:183
1373617991512,2cyclictest1456144-21unixbench_singl08:25:243
1373617991512,2cyclictest0-21swapper/310:30:003
1373617991511,3cyclictest507-21in:imuxsock12:00:003
1373617991511,3cyclictest1420740-21apt-get07:55:123
1373617991511,3cyclictest1383904-21apt-get07:20:003
1373614991512,2cyclictest1421161-21irqcore07:55:172
1373614991512,2cyclictest1390203-21irqcore07:25:172
1373602991513,1cyclictest60350irq/132-enp0s29f1:rx-012:05:220
1373602991512,2cyclictest60350irq/132-enp0s29f1:rx-008:29:080
1373602991511,3cyclictest1565942-21apt-get10:15:090
1373602991511,3cyclictest1471695-21kworker/u8:1+events_unbound10:25:190
137361799145,3cyclictest1441019-21seq08:13:593
1373617991411,2cyclictest1456910-21cpuspeed_turbos08:30:133
1373617991411,1cyclictest0-21swapper/309:35:003
137361799140,3cyclictest1601829-21cat10:50:013
137361799140,1cyclictest1686219-21irqstats12:10:223
137361799140,1cyclictest1686219-21irqstats12:10:213
137361499149,4cyclictest1622793-21apt-get11:10:112
1373614991412,1cyclictest0-21swapper/209:15:002
1373614991411,2cyclictest1693813-21kthreadcore12:15:182
1373614991411,2cyclictest1633232-21kworker/u8:2+flush-259:011:40:202
1373614991410,3cyclictest1710783-21kworker/u8:2+flush-259:012:35:162
1373614991410,3cyclictest1633232-21kworker/u8:2+flush-259:012:05:152
1373614991410,3cyclictest1606995-21kworker/u8:0+flush-259:010:55:172
1373614991410,3cyclictest0-21swapper/209:05:022
1373614991410,2cyclictest0-21swapper/208:05:002
137360799148,4cyclictest1482455-21kworker/u8:0+flush-259:009:00:051
137360799148,4cyclictest1466907-21cron08:40:001
137360799146,5cyclictest1653969-21cron11:40:001
1373607991411,1cyclictest1616944-21kworker/u8:1-ext4-rsv-conversion11:10:011
137360299149,4cyclictest1700510-21kworker/u8:0+events_unbound12:30:240
1373602991412,2cyclictest60350irq/132-enp0s29f1:rx-011:01:200
1373602991412,1cyclictest60350irq/132-enp0s29f1:rx-011:40:230
1373602991412,1cyclictest60350irq/132-enp0s29f1:rx-007:40:130
1373602991411,2cyclictest60350irq/132-enp0s29f1:rx-011:20:150
137361799139,2cyclictest1378923-21kworker/u8:1+flush-259:007:40:163
137361799133,3cyclictest1638575-21cat11:25:003
1373617991311,1cyclictest1435964-21sh08:10:013
1373617991310,2cyclictest1695087-21kworker/u8:3+flush-259:012:20:153
137361499139,2cyclictest1472427-21cpuspeed_turbos08:45:132
137361499138,4cyclictest1700489-21latency_hist12:25:002
1373614991310,2cyclictest1644130-21fschecks_time11:30:202
1373614991310,2cyclictest1467613-21irqcore08:40:182
1373614991310,2cyclictest1456568-21idleruntime-cro08:30:002
137360799137,4cyclictest1550089-21basename09:59:591
137360799135,5cyclictest335557-21systemd-journal10:40:171
1373607991310,2cyclictest1586984-21irqcore10:35:181
1373607991310,2cyclictest1575537-21unixbench_singl10:20:241
1373607991310,2cyclictest0-21swapper/107:25:171
1373602991312,1cyclictest60350irq/132-enp0s29f1:rx-009:37:390
1373602991312,1cyclictest60350irq/132-enp0s29f1:rx-008:46:360
137361799129,2cyclictest0-21swapper/312:20:013
137361799128,3cyclictest1586329-21kworker/u8:2+flush-259:010:50:253
137361799128,3cyclictest1549361-21/usr/sbin/munin09:55:233
137361799128,3cyclictest0-21swapper/312:10:003
137361799126,4cyclictest1706093-21df12:30:193
137361499129,2cyclictest1581801-21irqcore10:30:172
137361499129,2cyclictest1534932-21fschecks_count09:45:142
137361499129,2cyclictest1523720-21unixbench_singl09:30:272
137361499129,2cyclictest1481996-21unixbench_singl08:50:232
137360799129,2cyclictest1612665-21uniq11:00:141
137360799128,3cyclictest1357865-21kworker/u8:3+flush-259:007:50:201
137360799127,3cyclictest1357865-21kworker/u8:3+flush-259:007:35:181
137360799126,4cyclictest1710910-21awk12:34:591
1373607991210,1cyclictest0-21swapper/112:15:121
137361799119,1cyclictest0-21swapper/310:30:173
137361799118,2cyclictest1456455-21kworker/u8:0+flush-259:008:35:193
137361799118,2cyclictest1410510-21cpuspeed_turbos07:45:123
137361499118,2cyclictest1606995-21kworker/u8:0+flush-259:011:05:152
137361499118,2cyclictest1497488-21unixbench_singl09:05:252
137361499115,4cyclictest1663872-21users11:45:242
137361499110,2cyclictest1410162-21awk07:45:002
137360799119,1cyclictest0-21swapper/110:15:171
137360799119,1cyclictest0-21swapper/110:10:001
137360799119,1cyclictest0-21swapper/109:19:591
137360799117,2cyclictest0-21swapper/108:25:001
137360799114,5cyclictest335557-21systemd-journal12:38:171
137361799108,1cyclictest0-21swapper/311:40:183
137361799106,3cyclictest1649174-21grep11:35:143
137361799106,3cyclictest1513410-21cron09:25:023
137361799105,3cyclictest1416565-21irqstats07:50:173
137361499107,2cyclictest1597870-21kthreadcore10:45:162
137361499107,2cyclictest1586636-21cpuspeed_turbos10:35:142
137360799106,3cyclictest1596853-21apt-get10:45:101
13736179995,3cyclictest491ktimers/310:15:113
13736179995,3cyclictest1483135-21sed08:55:153
13736179995,2cyclictest1-21systemd10:55:183
13736079997,1cyclictest0-21swapper/109:05:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional