You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 16:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Sep 08, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
189089993932,5cyclictest450590-21latency_hist11:20:003
189083993731,4cyclictest440008-21base6411:10:001
189083993531,3cyclictest251914-21kworker/u8:2+flush-259:009:45:171
189079993528,5cyclictest220472-21latency_hist07:40:010
189083993328,4cyclictest278872-21apt-get08:35:121
189089993229,2cyclictest398302-21kworker/u8:3+flush-259:011:35:183
189089993228,3cyclictest251914-21kworker/u8:2+flush-259:008:40:003
189089993127,3cyclictest173887-21kworker/u8:1+flush-259:008:00:253
189083993126,3cyclictest513672-21/usr/sbin/munin12:20:141
189083993125,5cyclictest493014-21apt-get12:00:111
189089992923,4cyclictest335557-21systemd-journal10:05:003
189087992925,3cyclictest450862-21apt-get11:20:122
189083992823,3cyclictest367306-21/usr/sbin/munin10:00:131
189079992824,3cyclictest315474-21apt-get09:10:120
189079992822,4cyclictest273631-21cat08:30:010
189079992820,4cyclictest335557-21systemd-journal10:02:170
189089992723,3cyclictest482360-21latency_hist11:50:013
189089992723,3cyclictest315232-21kworker/u8:1+flush-259:009:15:123
189089992622,3cyclictest145896-21kworker/u8:4+flush-259:008:45:003
189089992622,3cyclictest145896-21kworker/u8:4+flush-259:008:45:003
189083992618,6cyclictest335557-21systemd-journal07:59:171
189087992521,3cyclictest145896-21kworker/u8:4+flush-259:007:15:212
189087992520,3cyclictest251914-21kworker/u8:2+flush-259:008:45:072
189083992521,3cyclictest335557-21systemd-journal10:54:541
189083992518,4cyclictest257258-21cp08:15:001
189079992522,2cyclictest508508-21kworker/u8:1+flush-259:012:15:150
189089992418,4cyclictest445507-21cat11:15:003
189079992419,4cyclictest315232-21kworker/u8:1+events_unbound09:35:170
189079992418,4cyclictest387751-21latency_hist10:20:000
189089992320,2cyclictest145896-21kworker/u8:4+flush-259:007:20:223
189087992319,3cyclictest294300-21kworker/u8:3+flush-259:008:55:162
189087992319,3cyclictest205243-21apt-get07:25:112
189087992317,4cyclictest273160-21base6408:30:002
189079992318,4cyclictest518619-21kworker/u8:3+events_unbound12:25:140
189087992217,4cyclictest325783-21/usr/sbin/munin09:20:152
189083992218,3cyclictest251914-21kworker/u8:2+flush-259:009:00:001
189083992217,4cyclictest335557-21systemd-journal08:35:001
189083992217,3cyclictest529006-21gpgv12:35:001
189083992216,4cyclictest439633-21store11:10:001
189083992215,5cyclictest503078-21latency_hist12:10:001
189079992218,3cyclictest518619-21kworker/u8:3+flush-259:012:30:210
189079992218,3cyclictest145896-21kworker/u8:4+flush-259:008:20:270
189079992217,3cyclictest508508-21kworker/u8:1+flush-259:012:20:190
189089992117,3cyclictest492977-21kworker/u8:4+flush-259:012:05:213
189089992117,3cyclictest251914-21kworker/u8:2+flush-259:008:20:003
189089992117,2cyclictest439865-21latency_hist11:10:013
189087992118,2cyclictest492977-21kworker/u8:4+flush-259:012:05:162
189079992117,3cyclictest382578-21kworker/u8:1+flush-259:010:25:140
189079992117,3cyclictest294300-21kworker/u8:3+flush-259:009:00:230
189079992117,3cyclictest189285-21apt-get07:10:100
189079992116,4cyclictest294333-21apt-get08:50:110
189079992115,4cyclictest503507-21diskstats12:10:140
189079992114,5cyclictest335557-21systemd-journal08:44:360
189079992114,5cyclictest335557-21systemd-journal08:44:360
189089992017,2cyclictest529095-21gpgv12:35:013
189089992017,2cyclictest194248-21apt-get07:15:013
189083992014,5cyclictest335557-21systemd-journal07:37:171
189079992016,3cyclictest356959-21kworker/u8:0+events_unbound10:20:130
189079992016,3cyclictest251914-21kworker/u8:2+flush-259:009:50:000
189079992016,3cyclictest145896-21kworker/u8:4+flush-259:007:45:250
189079992015,3cyclictest241328-21kworker/u8:0+flush-259:008:05:240
189089991916,2cyclictest335936-21idleruntime-cro09:30:003
189089991916,2cyclictest145896-21kworker/u8:4+flush-259:007:50:153
189089991915,3cyclictest398302-21kworker/u8:3+flush-259:010:30:273
189087991915,2cyclictest0-21swapper/211:30:002
189087991915,2cyclictest0-21swapper/208:15:002
189083991915,2cyclictest0-21swapper/108:55:001
18907999192,15cyclictest509-21rs:main0
189079991916,2cyclictest251914-21kworker/u8:2+flush-259:009:40:250
189079991916,2cyclictest145896-21kworker/u8:4+flush-259:008:15:220
189079991916,2cyclictest145896-21kworker/u8:4+flush-259:008:00:160
189079991915,3cyclictest440070-21kworker/u8:4+flush-259:011:20:220
189079991915,3cyclictest398302-21kworker/u8:3+events_unbound11:30:140
189079991913,4cyclictest231038-21kworker/u8:2+events_unbound07:55:000
189079991911,1cyclictest199815-21turbostat07:20:000
189089991814,3cyclictest465725-21kworker/u8:0+flush-259:012:10:243
189089991814,3cyclictest145896-21kworker/u8:4+flush-259:008:20:273
189089991814,3cyclictest145896-21kworker/u8:4+flush-259:008:10:003
189089991813,3cyclictest335557-21systemd-journal09:05:003
189089991813,3cyclictest299506-21/usr/sbin/munin08:55:183
189087991815,2cyclictest251914-21kworker/u8:2+flush-259:009:55:132
189087991814,3cyclictest529212-21store12:35:002
189087991814,3cyclictest465725-21kworker/u8:0+flush-259:012:25:252
189087991812,4cyclictest335557-21systemd-journal07:25:002
189079991814,3cyclictest398302-21kworker/u8:3+events_unbound10:55:210
189079991814,3cyclictest315232-21kworker/u8:1+flush-259:009:35:000
189079991814,2cyclictest529634-21kworker/u8:1+flush-259:012:35:210
189079991814,2cyclictest257053-21idleruntime-cro08:15:000
189089991715,1cyclictest0-21swapper/309:25:003
189089991714,2cyclictest531969-21kthreadcore12:35:173
189089991714,2cyclictest310731-21irqcore09:05:173
189089991714,2cyclictest212711-21kthreadcore07:30:213
189089991713,3cyclictest387990-21kworker/u8:2+flush-259:010:24:523
189089991713,3cyclictest372247-21kworker/u8:3+flush-259:010:10:273
189089991712,3cyclictest184127-21kworker/u8:2+flush-259:007:25:163
189089991711,4cyclictest335557-21systemd-journal11:41:163
189087991713,3cyclictest184127-21kworker/u8:2+flush-259:007:10:162
189083991714,2cyclictest267837-21idleruntime-cro08:25:001
189083991713,3cyclictest145896-21kworker/u8:4+flush-259:007:45:221
189079991715,2cyclictest398302-21kworker/u8:3+events_unbound11:25:180
189079991715,1cyclictest372247-21kworker/u8:3+events_unbound10:10:260
189079991714,2cyclictest60350irq/132-enp0s29f1:rx-011:15:150
189079991714,2cyclictest356959-21kworker/u8:0+flush-259:010:00:000
189079991713,3cyclictest440513-21irqcore11:10:150
189079991713,3cyclictest356959-21kworker/u8:0+flush-259:010:39:590
189079991713,3cyclictest251914-21kworker/u8:2+events_unbound10:05:160
189079991712,4cyclictest492977-21kworker/u8:4+events_unbound12:05:190
189079991712,3cyclictest251914-21kworker/u8:2+flush-259:009:50:170
189089991614,1cyclictest347001-21irqcore09:40:163
189089991614,1cyclictest0-21swapper/311:25:013
189089991612,3cyclictest518619-21kworker/u8:3+flush-259:012:25:263
189087991613,2cyclictest398302-21kworker/u8:3+flush-259:011:05:002
189087991613,2cyclictest346313-21cron09:40:002
189087991613,2cyclictest278592-21cron08:35:002
189087991612,3cyclictest472311-21kworker/u8:1+flush-259:011:45:172
189087991611,4cyclictest503100-21kworker/u8:2+flush-259:012:13:232
189087991611,4cyclictest335557-21systemd-journal11:10:012
18908399169,5cyclictest335557-21systemd-journal10:23:181
18908399163,3cyclictest460539-21ntpq11:25:201
189083991614,1cyclictest335951-21sh09:30:001
189083991613,2cyclictest523792-21idleruntime-cro12:30:011
189083991612,3cyclictest335557-21systemd-journal08:29:171
189083991610,4cyclictest492744-21latency_hist12:00:011
189083991610,1cyclictest191rcu_preempt11:20:011
189079991614,1cyclictest60350irq/132-enp0s29f1:rx-008:55:100
189079991613,2cyclictest60350irq/132-enp0s29f1:rx-007:21:290
189079991613,2cyclictest493432-21irqcore12:00:160
189079991613,2cyclictest173887-21kworker/u8:1+events_unbound07:55:220
189079991611,4cyclictest173887-21kworker/u8:1+events_unbound07:30:260
189089991512,2cyclictest352185-21irqcore09:45:183
189089991512,2cyclictest272990-21cron08:30:003
189089991511,3cyclictest408433-21kworker/u8:2+flush-259:010:45:153
189087991513,1cyclictest0-21swapper/211:55:002
189087991512,2cyclictest424590-21irqcore10:55:162
189087991512,2cyclictest383849-21kthreadcore10:15:192
189087991511,4cyclictest408433-21kworker/u8:2+flush-259:011:11:222
18908399152,4cyclictest507363-21ntpq12:10:201
18908399152,3cyclictest408649-21/usr/sbin/munin10:40:151
189083991510,4cyclictest335557-21systemd-journal09:01:171
189079991513,1cyclictest60350irq/132-enp0s29f1:rx-010:30:180
189079991513,1cyclictest60350irq/132-enp0s29f1:rx-009:22:590
189079991513,1cyclictest60350irq/132-enp0s29f1:rx-008:45:200
189079991513,1cyclictest60350irq/132-enp0s29f1:rx-008:29:290
189079991513,1cyclictest60350irq/132-enp0s29f1:rx-007:40:160
189079991512,2cyclictest60350irq/132-enp0s29f1:rx-011:45:180
189079991512,2cyclictest60350irq/132-enp0s29f1:rx-009:25:170
189079991511,3cyclictest398302-21kworker/u8:3+flush-259:011:40:250
189079991511,3cyclictest398302-21kworker/u8:3+flush-259:010:45:250
189079991511,3cyclictest184127-21kworker/u8:2+flush-259:007:25:230
189079991510,3cyclictest294300-21kworker/u8:3+flush-259:009:05:170
18908999149,4cyclictest408433-21kworker/u8:2+flush-259:010:40:263
18908999149,4cyclictest230768-21latency_hist07:50:013
189089991411,2cyclictest488250-21sed11:55:163
189089991411,2cyclictest440070-21kworker/u8:4+flush-259:011:30:003
189089991411,1cyclictest0-21swapper/309:55:003
189089991410,3cyclictest398302-21kworker/u8:3+flush-259:011:30:153
189089991410,2cyclictest256904-40mandb08:13:273
18908799149,4cyclictest335557-21systemd-journal08:17:002
18908799148,4cyclictest241115-21apt-get08:00:002
189087991411,2cyclictest408433-21kworker/u8:2+flush-259:010:40:172
189087991411,2cyclictest372247-21kworker/u8:3+flush-259:010:10:302
189087991411,2cyclictest0-21swapper/210:55:002
189087991410,3cyclictest465725-21kworker/u8:0+flush-259:012:24:472
189087991410,3cyclictest173887-21kworker/u8:1+flush-259:007:55:222
189087991410,3cyclictest145896-21kworker/u8:4+flush-259:008:20:312
18908399148,4cyclictest194427-21cp07:15:011
18908399143,2cyclictest251024-21ntpq08:05:221
18908399142,2cyclictest261765-21ntpq08:15:201
18908399141,9cyclictest482605-21/usr/sbin/munin11:50:221
189083991410,3cyclictest393177-21apt-get10:25:101
189083991410,3cyclictest346590-21apt-get09:40:131
18907999147,5cyclictest472075-21latency_hist11:40:000
189079991412,1cyclictest60350irq/132-enp0s29f1:rx-010:50:200
189079991411,2cyclictest60350irq/132-enp0s29f1:rx-011:55:240
18908999139,3cyclictest356959-21kworker/u8:0+flush-259:009:55:563
189089991310,2cyclictest189509-21fschecks_time07:10:143
18908799139,3cyclictest231038-21kworker/u8:2+flush-259:007:50:472
18908799139,3cyclictest145896-21kworker/u8:4+flush-259:008:37:482
18908799139,3cyclictest145896-21kworker/u8:4+flush-259:007:44:312
18908799138,3cyclictest251873-21latency_hist08:10:002
18908799137,4cyclictest397148-21ntpq10:25:192
189087991311,1cyclictest0-21swapper/211:35:012
189087991311,1cyclictest0-21swapper/209:00:162
189087991310,2cyclictest534544-21cron12:40:012
189087991310,2cyclictest0-21swapper/211:40:002
189087991310,2cyclictest0-21swapper/209:30:002
18908399139,3cyclictest356959-21kworker/u8:0+flush-259:010:15:231
18908399136,6cyclictest431535-21grep11:00:201
18908399132,2cyclictest284027-21/usr/sbin/munin08:40:231
18908399132,2cyclictest284027-21/usr/sbin/munin08:40:231
18908399132,1cyclictest377828-21sshd10:10:171
18908399131,8cyclictest32-21ksoftirqd/109:30:141
18908399131,2cyclictest242785-21irqstats08:00:171
189083991311,1cyclictest311ktimers/107:50:201
189083991310,2cyclictest325532-21idleruntime-cro09:20:001
189079991311,1cyclictest60350irq/132-enp0s29f1:rx-011:01:390
189079991311,1cyclictest60350irq/132-enp0s29f1:rx-008:35:210
189079991310,2cyclictest60350irq/132-enp0s29f1:rx-011:05:570
18908999129,1cyclictest0-21swapper/310:59:593
18908999127,4cyclictest320385-21latency_hist09:15:013
18908999126,4cyclictest403520-21apt-get10:35:143
18908999126,4cyclictest335557-21systemd-journal08:54:183
189089991210,1cyclictest0-21swapper/312:15:163
189089991210,1cyclictest0-21swapper/309:35:193
18908799129,2cyclictest465725-21kworker/u8:0+flush-259:012:00:252
18908799129,2cyclictest450582-21sh11:20:002
18908799129,2cyclictest173887-21kworker/u8:1+flush-259:007:35:002
18908799129,2cyclictest0-21swapper/212:00:012
18908799128,3cyclictest508508-21kworker/u8:1+flush-259:012:15:232
18908799128,3cyclictest398302-21kworker/u8:3+flush-259:010:34:472
18908799128,2cyclictest0-21swapper/210:10:002
18908799127,4cyclictest351770-21apt-get09:45:142
189087991210,1cyclictest0-21swapper/210:05:002
18908399129,2cyclictest2109693-21snmpd09:58:021
18908399128,3cyclictest509-21rs:main1
18908399128,3cyclictest508612-21cpuspeed_turbos12:15:111
18908399122,5cyclictest209789-21runrttasks07:25:411
18908399122,4cyclictest320080-21taskset09:11:261
18908399122,2cyclictest497-21gpm11:30:151
18908399122,2cyclictest361590-21pool-/usr/bin/f09:51:171
18908399122,2cyclictest32-21ksoftirqd/111:40:161
18908399121,2cyclictest204096-21ntpq07:20:221
18908399120,2cyclictest467357-21diskstats11:35:141
18908999119,1cyclictest0-21swapper/312:25:003
18908999119,1cyclictest0-21swapper/312:00:253
18908999118,2cyclictest294077-21sh08:50:003
18908999118,2cyclictest273773-21cpuspeed_turbos08:30:113
18908999118,1cyclictest0-21swapper/310:50:143
18908999116,4cyclictest241303-21cp08:00:003
18908799119,1cyclictest0-21swapper/209:55:002
18908799119,1cyclictest0-21swapper/207:45:172
18908799118,2cyclictest0-21swapper/209:05:152
18908799115,4cyclictest215712-21diskstats07:35:132
18908399114,5cyclictest453925-21cut11:20:171
18908399113,6cyclictest407540-21collect210:35:241
18908399112,6cyclictest0-21swapper/110:30:271
18908399111,2cyclictest428824-21runrttasks10:57:041
18908399111,2cyclictest0-21swapper/111:45:221
18908399110,2cyclictest214453-21ntpq07:30:251
18907999118,2cyclictest60350irq/132-enp0s29f1:rx-009:18:300
18908999107,1cyclictest341127-21sh09:35:013
18908799107,1cyclictest0-21swapper/208:45:002
18908799107,1cyclictest0-21swapper/208:45:002
18908399100,2cyclictest220729-21apt-get07:40:121
1890899995,3cyclictest145896-21kworker/u8:4+flush-259:007:45:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional