You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 19:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Aug 22, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
342842994843,3cyclictest384764-21apt-get07:50:113
342842994236,4cyclictest353152-21apt-get07:20:013
342835993936,2cyclictest520241-21kworker/u8:2+flush-259:010:10:242
342831993832,4cyclictest335557-21systemd-journal12:20:551
342830993732,3cyclictest2458665-21kworker/u8:4+flush-259:008:25:000
342830993530,3cyclictest327195-21kworker/u8:2+events_unbound07:40:250
342830993327,4cyclictest2458665-21kworker/u8:4+flush-259:008:30:250
342842993228,3cyclictest467712-21latency_hist09:10:003
342831993226,4cyclictest462780-21apt-get09:05:131
342830993228,3cyclictest640171-21kworker/u8:2+flush-259:012:30:250
342830993128,2cyclictest551928-21kworker/u8:3+events_unbound10:40:250
342830993126,4cyclictest335557-21systemd-journal12:16:550
342831992922,5cyclictest426116-21apt-get08:30:121
342842992824,3cyclictest451981-21apt-get08:55:133
342831992823,4cyclictest562318-21apt-get10:40:121
342830992825,2cyclictest327195-21kworker/u8:2+events_unbound08:05:140
342830992723,3cyclictest478493-21kworker/u8:1+events_unbound10:35:250
342842992622,3cyclictest335557-21systemd-journal09:24:543
342835992621,3cyclictest634640-21gpgv11:50:002
342831992614,10cyclictest507-21in:imuxsock07:25:001
342842992521,3cyclictest369306-21apt-get07:35:123
342842992519,4cyclictest430130-21ntpq08:30:203
342835992521,3cyclictest618472-21kworker/u8:0+flush-259:011:55:252
342831992520,3cyclictest655731-21munin-plugin-st12:10:001
342830992521,3cyclictest618472-21kworker/u8:0+flush-259:011:35:000
342830992521,3cyclictest577861-21apt-get10:55:120
342842992418,4cyclictest399970-21latency_hist08:05:003
342842992417,4cyclictest353578-21gpgv07:20:023
342835992420,3cyclictest509-21rs:main2
342831992419,3cyclictest598570-21apt-get11:15:131
342831992419,3cyclictest598570-21apt-get11:15:131
342831992318,4cyclictest635211-21apt-get11:50:121
342831992318,3cyclictest515261-21base6409:55:011
342831992317,4cyclictest335557-21systemd-journal09:42:551
342830992321,1cyclictest0-21swapper/010:30:150
342830992320,2cyclictest435788-21kworker/u8:0+flush-259:008:45:140
342830992317,4cyclictest456908-21latency_hist09:00:010
342830992317,4cyclictest335557-21systemd-journal12:14:560
342842992220,1cyclictest0-21swapper/310:15:013
342842992218,3cyclictest634522-21latency_hist11:50:013
342842992218,3cyclictest624407-21apt-get11:40:113
342835992215,5cyclictest467818-21cp09:10:002
342831992218,3cyclictest435788-21kworker/u8:0+flush-259:009:00:011
342830992218,3cyclictest327195-21kworker/u8:2+events_unbound09:10:150
342831992115,4cyclictest405450-21apt-get08:10:111
342831992115,4cyclictest342777-21latency_hist07:10:001
342830992118,2cyclictest526036-21kworker/u8:4+flush-259:010:05:240
342830992117,3cyclictest499337-21kworker/u8:0+flush-259:009:53:210
342830992117,3cyclictest327195-21kworker/u8:2+events_unbound08:45:010
342830992114,5cyclictest335557-21systemd-journal11:45:000
342835992016,3cyclictest587674-21kworker/u8:3+flush-259:011:10:152
342831992014,4cyclictest509-21rs:main1
342831992014,4cyclictest335557-21systemd-journal10:33:551
342830992017,2cyclictest327195-21kworker/u8:2+flush-259:009:20:150
342830992016,3cyclictest435788-21kworker/u8:0+events_unbound09:00:150
342830992014,4cyclictest421124-21diskstats08:25:150
342830992013,5cyclictest587004-21ntpq11:00:200
342842991912,5cyclictest624143-21latency_hist11:40:023
342842991912,5cyclictest445648-21ntpq08:45:203
342835991913,4cyclictest335557-21systemd-journal09:20:002
342831991910,7cyclictest0-21swapper/110:10:151
342830991916,2cyclictest608660-21kworker/u8:2+flush-259:011:35:270
342830991916,2cyclictest327195-21kworker/u8:2+events_unbound09:35:120
342830991915,3cyclictest587674-21kworker/u8:3+flush-259:011:05:200
342830991913,4cyclictest546768-21apt-get10:25:130
342830991912,5cyclictest393984-21ntpq07:55:210
342830991911,6cyclictest388727-21ntpq07:50:200
342842991815,2cyclictest0-21swapper/312:30:003
342842991814,3cyclictest666274-21/usr/sbin/munin12:20:153
342842991814,3cyclictest587674-21kworker/u8:3+flush-259:011:05:253
342835991815,2cyclictest2458665-21kworker/u8:4+flush-259:008:10:212
342835991813,4cyclictest562279-21kworker/u8:4+flush-259:011:15:182
342835991813,4cyclictest562279-21kworker/u8:4+flush-259:011:15:182
34283199186,9cyclictest682001-21diskstats12:35:141
342831991814,3cyclictest577836-21/usr/sbin/munin10:55:141
342831991813,4cyclictest526037-21/usr/sbin/munin10:05:141
342830991815,2cyclictest587674-21kworker/u8:3+flush-259:011:45:190
342830991815,2cyclictest384508-21turbostat.cron07:50:000
342830991811,5cyclictest352276-21ntpq07:15:200
342842991715,1cyclictest0-21swapper/310:40:003
342842991713,3cyclictest478493-21kworker/u8:1+flush-259:009:55:263
342842991713,3cyclictest327195-21kworker/u8:2+flush-259:008:05:243
342842991712,4cyclictest335557-21systemd-journal09:30:003
342835991714,2cyclictest441363-21cron08:45:002
342835991714,2cyclictest0-21swapper/210:35:002
342835991713,3cyclictest587674-21kworker/u8:3+flush-259:011:05:182
342835991713,3cyclictest515201-21gpgv09:55:012
342835991713,3cyclictest456940-21kworker/u8:3+flush-259:009:30:182
342835991713,2cyclictest0-21swapper/211:35:002
34283199175,1cyclictest0-21swapper/112:30:211
34283199173,8cyclictest394845-21awk07:59:591
34283199172,3cyclictest0-21swapper/109:55:011
34283199171,4cyclictest658909-21cut12:10:191
34283199171,4cyclictest562034-21cron10:40:001
34283199171,4cyclictest507-21in:imuxsock10:29:591
34283199171,4cyclictest363903-21idleruntime-cro07:30:011
34283199171,3cyclictest436172-21apt08:40:001
34283199171,3cyclictest436172-21apt08:39:591
34283199171,3cyclictest425833-21cron08:29:591
342831991712,3cyclictest494219-21apt-get09:35:111
342831991712,3cyclictest395098-21apt-get08:00:111
342831991711,5cyclictest0-21swapper/112:25:141
342831991711,4cyclictest335557-21systemd-journal08:18:551
34283199170,5cyclictest347997-21awk07:15:011
34283199170,4cyclictest493947-21awk09:34:591
34283199170,4cyclictest420687-21sh08:25:001
34283099179,5cyclictest335557-21systemd-journal10:15:010
342830991713,3cyclictest640171-21kworker/u8:2+events_unbound12:22:560
342830991713,3cyclictest478493-21kworker/u8:1+events_unbound10:20:220
342830991713,3cyclictest456940-21kworker/u8:3+events_unbound09:30:080
342830991712,4cyclictest546538-21kworker/u8:0+flush-259:010:45:230
342842991613,2cyclictest499337-21kworker/u8:0+flush-259:010:00:173
342842991613,2cyclictest493089-21ntp_kernel_pll_09:30:233
342842991611,3cyclictest509455-21latency_hist09:50:013
342835991613,2cyclictest504268-21cron09:45:002
342835991613,2cyclictest374163-21idleruntime-cro07:39:592
342835991612,3cyclictest650762-21/usr/sbin/munin12:05:152
342835991612,3cyclictest640171-21kworker/u8:2+flush-259:012:35:252
342835991612,3cyclictest2458665-21kworker/u8:4+flush-259:007:15:112
34283199164,2cyclictest0-21swapper/112:20:011
34283199163,2cyclictest335557-21systemd-journal09:10:011
34283199161,4cyclictest513-21gdbus09:30:011
34283199161,4cyclictest400654-21sed08:05:191
34283199161,3cyclictest614178-21tr11:30:141
34283199161,3cyclictest513-21gdbus12:05:011
34283199160,4cyclictest634736-21latency_hist11:50:011
34283199160,4cyclictest604161-21grep11:20:171
34283199160,4cyclictest520899-21cut10:00:171
34283199160,4cyclictest384506-21idleruntime-cro07:49:591
34283199160,4cyclictest335557-21systemd-journal11:30:001
342830991612,3cyclictest562279-21kworker/u8:4+flush-259:010:50:240
342830991612,3cyclictest456940-21kworker/u8:3+events_unbound09:25:080
34284299158,5cyclictest335557-21systemd-journal12:09:553
342842991512,2cyclictest594391-21kthreadcore11:10:163
342842991511,3cyclictest587674-21kworker/u8:3+flush-259:011:20:173
342842991510,4cyclictest598734-21diskstats11:15:153
342842991510,4cyclictest598734-21diskstats11:15:153
342835991511,3cyclictest640171-21kworker/u8:2+flush-259:012:20:222
34283199154,2cyclictest388793-21ntp_kernel_pll_07:50:221
34283199151,3cyclictest374171-21latency_hist07:40:001
342831991510,3cyclictest1-21systemd12:00:001
34283199150,4cyclictest577598-21turbostat.cron10:55:001
342830991513,1cyclictest60350irq/132-enp0s29f1:rx-012:07:460
342830991513,1cyclictest60350irq/132-enp0s29f1:rx-012:02:270
342830991513,1cyclictest60350irq/132-enp0s29f1:rx-009:55:550
342830991513,1cyclictest60350irq/132-enp0s29f1:rx-009:40:250
342830991512,2cyclictest0-21swapper/009:10:000
342830991511,3cyclictest587674-21kworker/u8:3+events_unbound11:20:240
342830991510,3cyclictest598302-21sh11:15:000
34284299149,3cyclictest593131-21kworker/u8:1+flush-259:012:05:003
342842991411,2cyclictest528380-21tr10:05:183
342842991410,3cyclictest441379-21latency_hist08:45:003
342842991410,2cyclictest0-21swapper/309:55:013
342835991412,1cyclictest436176-21sh08:40:002
342835991412,1cyclictest436176-21sh08:39:592
342835991411,2cyclictest478493-21kworker/u8:1+flush-259:010:20:252
342835991411,2cyclictest327195-21kworker/u8:2+flush-259:007:40:262
342835991411,2cyclictest0-21swapper/209:55:012
342835991410,3cyclictest415982-21fschecks_count08:20:142
342831991411,2cyclictest592641-21unixbench_multi11:05:261
34283199140,5cyclictest350554-21/usr/sbin/munin07:15:171
34283199140,3cyclictest335557-21systemd-journal11:45:001
34283099146,6cyclictest635121-21cat11:50:010
342830991412,1cyclictest60350irq/132-enp0s29f1:rx-012:25:260
342830991412,1cyclictest60350irq/132-enp0s29f1:rx-011:27:250
342830991412,1cyclictest60350irq/132-enp0s29f1:rx-009:18:050
342830991412,1cyclictest60350irq/132-enp0s29f1:rx-008:04:390
342830991412,1cyclictest60350irq/132-enp0s29f1:rx-007:10:260
342830991411,2cyclictest60350irq/132-enp0s29f1:rx-008:50:220
342830991411,2cyclictest60350irq/132-enp0s29f1:rx-008:18:210
342830991411,2cyclictest410323-21sh08:14:590
342830991410,3cyclictest593131-21kworker/u8:1+flush-259:011:58:260
342830991410,3cyclictest363484-21unixbench_singl07:25:250
34284299139,3cyclictest431268-21/usr/sbin/munin08:35:243
34284299139,3cyclictest431268-21/usr/sbin/munin08:35:243
34284299137,4cyclictest450845-21ntpq08:50:213
342842991310,2cyclictest567212-21sh10:45:003
342842991310,2cyclictest405866-21irqcore08:10:163
34283599139,3cyclictest645347-21kworker/u8:4+flush-259:012:10:172
34283599139,3cyclictest363912-21latency_hist07:30:022
342835991311,1cyclictest587664-40mandb11:01:562
342835991310,2cyclictest506857-21kthreadcore09:45:182
342835991310,2cyclictest458017-21irqcore09:00:162
342835991310,1cyclictest0-21swapper/210:05:002
342835991310,1cyclictest0-21swapper/208:50:162
34283199135,1cyclictest441621-21/usr/sbin/munin08:45:221
34283199131,3cyclictest536439-21apt-get10:15:131
34283199130,4cyclictest587079-21ntpq11:00:221
34283199130,4cyclictest462508-21idleruntime-cro09:04:591
34283099139,3cyclictest640171-21kworker/u8:2+flush-259:012:35:200
34283099139,3cyclictest327195-21kworker/u8:2+events_unbound08:35:040
34283099139,3cyclictest327195-21kworker/u8:2+events_unbound08:35:030
34283099138,3cyclictest520241-21kworker/u8:2+flush-259:010:01:270
34283099132,2cyclictest353849-21apt-get07:20:140
342830991311,1cyclictest60350irq/132-enp0s29f1:rx-010:15:160
34284299129,2cyclictest435788-21kworker/u8:0+events_unbound09:15:013
34284299128,3cyclictest327195-21kworker/u8:2+flush-259:008:15:153
34284299128,2cyclictest0-21swapper/312:10:203
34284299126,4cyclictest686761-21latency_hist12:40:013
34283599129,2cyclictest639705-21unixbench_singl11:50:252
34283599129,2cyclictest452203-21fschecks_time08:55:162
34283599129,2cyclictest0-21swapper/210:55:212
34283599128,3cyclictest593131-21kworker/u8:1+flush-259:011:25:002
34283599128,3cyclictest520241-21kworker/u8:2+flush-259:010:25:262
34283599128,2cyclictest0-21swapper/212:20:002
34283599128,2cyclictest0-21swapper/209:40:002
34283599126,4cyclictest613815-21latency_hist11:30:012
342835991210,1cyclictest389683-21systemd-run07:55:002
342835991210,1cyclictest0-21swapper/212:05:012
34283199126,4cyclictest451708-21latency_hist08:55:001
34283199122,3cyclictest619230-21apt-get11:35:131
34283199121,4cyclictest436755-21hddtemp_smartct08:40:161
34283199120,5cyclictest508576-21ntpq09:45:221
34283199120,5cyclictest378416-21ntpq07:40:221
34283099128,3cyclictest327195-21kworker/u8:2+events_unbound09:45:550
34284299119,1cyclictest0-21swapper/311:05:003
34284299119,1cyclictest0-21swapper/310:55:003
34284299118,2cyclictest421184-21fschecks_time08:25:163
34284299118,2cyclictest415850-21cpuspeed_turbos08:20:133
34284299118,1cyclictest0-21swapper/307:45:233
34284299117,2cyclictest538750-21kthreadcore10:15:183
34284299110,9cyclictest504291-21awk09:45:013
34284299110,3cyclictest394819-21cron08:00:003
34283599118,2cyclictest488361-21unixbench_singl09:25:272
34283199118,2cyclictest327195-21kworker/u8:2+flush-259:009:15:161
34283199117,3cyclictest478493-21kworker/u8:1+flush-259:010:20:181
34283199110,4cyclictest478714-21/usr/sbin/munin09:20:161
34283099118,2cyclictest60350irq/132-enp0s29f1:rx-011:15:200
34283099118,2cyclictest60350irq/132-enp0s29f1:rx-011:15:200
34283099110,2cyclictest369041-21latency_hist07:35:010
34284299108,1cyclictest0-21swapper/311:25:163
34284299107,2cyclictest499105-21latency_hist09:40:003
34284299107,1cyclictest0-21swapper/312:30:153
34283599108,1cyclictest0-21swapper/210:50:172
3428429997,1cyclictest0-21swapper/307:30:143
3428359995,3cyclictest384452-21journal-offline07:49:442
3428359991,2cyclictest681584-21basename12:35:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional