You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 00:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Sep 22, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2912672995247,3cyclictest2943946-21apt-get07:40:030
2912677995046,3cyclictest3225519-21kworker/u8:0+flush-259:012:20:002
2912677994942,5cyclictest3163176-21latency_hist11:10:002
2912674994945,2cyclictest3220671-21apt-get12:05:121
2912677994844,3cyclictest3126624-21kworker/u8:2+flush-259:012:05:002
2912682994534,9cyclictest2928599-21base6407:25:013
2912682994339,3cyclictest3058132-21apt-get09:30:023
2912674994338,3cyclictest2970527-21apt-get08:05:121
2912682994237,3cyclictest2996035-21kworker/u8:1+flush-259:008:30:003
2912674994134,5cyclictest335557-21systemd-journal11:23:381
2912682994034,4cyclictest3179374-21apt-get11:25:113
2912672994034,4cyclictest335557-21systemd-journal12:40:010
2912677993834,3cyclictest2954721-21kworker/u8:2+flush-259:008:15:012
2912674993832,4cyclictest3230975-21apt-get12:15:111
2912672993732,3cyclictest335557-21systemd-journal10:37:380
2912682993633,2cyclictest3163178-21apt-get11:10:033
2912677993630,4cyclictest3075162-21apt-get09:45:132
2912674993631,3cyclictest3126624-21kworker/u8:2+flush-259:011:55:001
2912682993530,3cyclictest3199942-21/usr/sbin/munin11:45:263
2912682993530,3cyclictest3037713-21apt-get09:10:123
2912677993528,5cyclictest3245710-21ntpq12:25:212
2912682993326,5cyclictest3069311-21latency_hist09:40:013
2912674993329,3cyclictest3063946-21kworker/u8:3+flush-259:010:30:311
2912672993330,2cyclictest2949787-21apt-get07:45:130
2912672993327,4cyclictest3142768-21apt-get10:50:160
2912682993222,8cyclictest2944115-21base6407:40:013
2912672993226,4cyclictest2958993-21ntpq07:50:210
2912682993124,5cyclictest3198812-21ntpq11:40:213
2912672993128,2cyclictest2996035-21kworker/u8:1+flush-259:009:00:170
2912672993127,3cyclictest3042845-21apt-get09:15:130
2912672993125,4cyclictest3189794-21diskstats11:35:130
2912682993024,4cyclictest3011758-21/usr/sbin/munin08:45:153
2912677993026,3cyclictest3163104-21kworker/u8:3+flush-259:011:15:232
2912677993024,4cyclictest3043006-21diskstats09:15:152
2912674993023,5cyclictest3214350-21ntpq11:55:221
2912672993026,3cyclictest3006581-21/usr/sbin/munin08:40:200
2912677992925,3cyclictest2917802-21kworker/u8:0+flush-259:008:20:152
2912677992922,4cyclictest2917802-21kworker/u8:0+events_unbound07:45:192
2912674992921,5cyclictest2989943-21ntpq08:20:181
2912672992925,3cyclictest3189331-21kworker/u8:1+flush-259:011:40:220
2912677992824,3cyclictest3174201-21apt-get11:20:122
2912677992822,4cyclictest2996035-21kworker/u8:1+flush-259:009:15:002
2912674992824,3cyclictest3001452-21apt-get08:35:121
2912674992824,3cyclictest2917802-21kworker/u8:0+flush-259:009:20:231
2912672992823,4cyclictest3073607-21ntpq09:40:210
2912682992722,4cyclictest335557-21systemd-journal08:02:373
2912682992722,3cyclictest335557-21systemd-journal12:02:383
2912677992723,3cyclictest3225519-21kworker/u8:0+flush-259:012:35:162
2912677992723,3cyclictest2870204-21kworker/u8:3+flush-259:007:15:252
2912677992721,4cyclictest2917802-21kworker/u8:0+events_unbound08:30:122
2912674992724,2cyclictest3126624-21kworker/u8:2+flush-259:010:40:141
2912672992724,2cyclictest2917802-21kworker/u8:0+events_unbound07:40:000
2912672992722,3cyclictest3000290-21ntpq08:30:210
2912677992621,4cyclictest3085240-21kworker/u8:0+events_unbound11:05:002
2912677992620,4cyclictest3064375-21/usr/sbin/munin09:35:152
2912674992622,3cyclictest3085240-21kworker/u8:0+flush-259:010:50:201
2912672992622,3cyclictest3063946-21kworker/u8:3+flush-259:009:55:200
2912672992620,4cyclictest3173946-21latency_hist11:20:000
2912682992519,4cyclictest2960284-21diskstats07:55:153
2912677992521,3cyclictest2996037-21kworker/u8:4+flush-259:008:45:252
2912677992521,3cyclictest2917802-21kworker/u8:0+events_unbound08:40:232
2912677992517,6cyclictest3224692-21ntpq12:05:222
2912672992519,4cyclictest2980573-21latency_hist08:15:010
2912682992420,3cyclictest2954721-21kworker/u8:2+flush-259:008:10:013
2912682992418,4cyclictest3101030-21/usr/sbin/munin10:10:233
2912677992421,2cyclictest2907526-21kworker/u8:1+flush-259:007:35:162
2912677992420,3cyclictest3063946-21kworker/u8:3+events_unbound09:50:262
2912674992420,3cyclictest2917802-21kworker/u8:0+flush-259:008:15:181
2912674992418,4cyclictest335557-21systemd-journal11:00:371
2912674992418,4cyclictest335557-21systemd-journal07:41:361
2912672992419,3cyclictest3225986-21diskstats12:10:140
2912677992320,2cyclictest2917802-21kworker/u8:0+flush-259:009:20:182
2912677992320,2cyclictest2917802-21kworker/u8:0+events_unbound07:50:222
2912677992319,3cyclictest3225519-21kworker/u8:0+flush-259:012:30:382
2912677992319,3cyclictest3137368-21kworker/u8:1+events_unbound10:55:192
2912677992319,3cyclictest3090655-21kworker/u8:2+events_unbound10:00:232
2912677992318,3cyclictest3189331-21kworker/u8:1+flush-259:011:55:172
2912677992318,3cyclictest3063946-21kworker/u8:3+events_unbound09:55:172
2912677992316,4cyclictest3026221-21ntpq08:55:232
2912672992319,3cyclictest3126624-21kworker/u8:2+flush-259:011:50:170
2912672992317,4cyclictest3120557-21ntpq10:25:210
2912682992216,4cyclictest2934064-21diskstats07:30:133
2912677992218,3cyclictest3163104-21kworker/u8:3+flush-259:011:10:202
2912674992218,3cyclictest3090655-21kworker/u8:2+flush-259:010:15:211
2912672992219,2cyclictest3163104-21kworker/u8:3+flush-259:011:11:060
2912672992217,3cyclictest2954721-21kworker/u8:2+flush-259:008:05:180
2912682992117,3cyclictest2996251-21/usr/sbin/munin08:30:243
2912682992117,3cyclictest2907526-21kworker/u8:1+flush-259:007:20:213
2912677992117,3cyclictest2870204-21kworker/u8:3+flush-259:007:40:222
2912677992115,4cyclictest3090655-21kworker/u8:2+flush-259:010:05:212
2912677992115,4cyclictest2996015-21latency_hist08:30:002
2912674992118,2cyclictest2996035-21kworker/u8:1+flush-259:009:10:191
2912674992116,4cyclictest335557-21systemd-journal09:48:371
2912672992119,1cyclictest3184228-21cron11:30:000
2912672992116,4cyclictest3064400-21apt-get09:35:120
2912682992015,3cyclictest2954721-21kworker/u8:2+flush-259:007:55:013
2912682992014,4cyclictest335557-21systemd-journal12:10:363
2912677992016,3cyclictest3090655-21kworker/u8:2+flush-259:010:15:002
2912677992016,2cyclictest2917802-21kworker/u8:0-flush-259:009:05:002
2912677992015,3cyclictest2923196-21/usr/sbin/munin07:20:152
2912672992014,4cyclictest335557-21systemd-journal09:10:370
291268299195,3cyclictest3051961-21grep09:20:213
2912682991913,5cyclictest3241680-21cp12:25:023
2912677991916,2cyclictest3189331-21kworker/u8:1+flush-259:012:10:232
2912677991915,3cyclictest3063946-21kworker/u8:3+events_unbound10:24:392
2912677991915,3cyclictest3042809-21kworker/u8:2+flush-259:009:40:212
2912674991917,1cyclictest0-21swapper/108:35:001
2912674991916,2cyclictest3225519-21kworker/u8:0+flush-259:012:40:011
2912674991915,3cyclictest335557-21systemd-journal07:55:381
2912674991915,3cyclictest3236110-21apt-get12:20:111
2912674991915,3cyclictest2928774-21apt-get07:25:111
2912674991915,3cyclictest2917802-21kworker/u8:0+flush-259:008:25:251
2912674991914,4cyclictest335557-21systemd-journal08:50:381
2912674991913,4cyclictest3241051-21apt-get12:25:011
291268299188,8cyclictest0-21swapper/310:25:013
291268299188,1cyclictest0-21swapper/309:50:203
291268299187,10cyclictest0-21swapper/311:10:003
2912682991812,4cyclictest3225519-21kworker/u8:0+flush-259:012:10:003
291268299180,4cyclictest3194510-21cron11:40:003
2912677991814,3cyclictest3063946-21kworker/u8:3+events_unbound10:30:232
2912677991814,3cyclictest3042809-21kworker/u8:2+flush-259:009:30:212
2912677991814,3cyclictest2870204-21kworker/u8:3+flush-259:007:30:002
2912677991813,4cyclictest2954721-21kworker/u8:2+events_unbound08:18:392
2912674991815,2cyclictest3063946-21kworker/u8:3+flush-259:009:55:201
2912674991815,2cyclictest3042809-21kworker/u8:2+flush-259:009:35:191
2912674991815,2cyclictest0-21swapper/110:15:011
2912672991814,3cyclictest3075036-21gpgv09:45:010
2912672991811,5cyclictest2984837-21ntpq08:15:220
291268299177,1cyclictest0-21swapper/312:20:133
291268299176,1cyclictest0-21swapper/310:30:003
291268299175,1cyclictest335557-21systemd-journal07:50:003
291268299175,1cyclictest0-21swapper/307:10:253
2912682991713,3cyclictest3063946-21kworker/u8:3+flush-259:010:20:003
2912682991712,3cyclictest335557-21systemd-journal10:59:383
2912682991712,3cyclictest3163104-21kworker/u8:3+flush-259:011:30:243
2912682991712,3cyclictest3163104-21kworker/u8:3+flush-259:011:30:233
2912677991714,2cyclictest3132183-21turbostat.cron10:40:002
2912677991712,3cyclictest2960124-21apt-get07:55:122
2912677991710,5cyclictest335557-21systemd-journal07:15:002
2912674991713,3cyclictest2870204-21kworker/u8:3+flush-259:007:30:161
2912674991712,4cyclictest3163364-21cp11:10:011
2912672991713,3cyclictest2917802-21kworker/u8:0+flush-259:008:35:250
2912672991711,4cyclictest3141647-21ntpq10:45:220
2912672991711,4cyclictest3052009-21ntpq09:20:220
291268299169,5cyclictest3037454-21latency_hist09:10:003
291268299165,1cyclictest0-21swapper/309:28:373
291268299162,3cyclictest490-21dbus-daemon10:35:003
2912682991612,2cyclictest0-21swapper/311:15:183
2912682991611,4cyclictest2918020-21/usr/sbin/munin07:15:203
291267799169,5cyclictest3184248-21latency_hist11:30:002
2912677991613,2cyclictest3236519-21irqcore12:20:152
2912677991612,3cyclictest3137368-21kworker/u8:1+events_unbound10:45:162
2912677991612,3cyclictest2870204-21kworker/u8:3+events_unbound07:30:222
2912677991611,3cyclictest335557-21systemd-journal11:35:012
2912677991611,3cyclictest335557-21systemd-journal11:35:002
2912677991611,3cyclictest3085240-21kworker/u8:0+events_unbound10:50:172
2912677991611,3cyclictest2996037-21kworker/u8:4+events_unbound08:53:382
2912674991614,1cyclictest0-21swapper/109:30:001
2912672991614,1cyclictest60350irq/132-enp0s29f1:rx-011:45:210
2912672991614,1cyclictest60350irq/132-enp0s29f1:rx-010:24:120
2912672991613,2cyclictest60350irq/132-enp0s29f1:rx-011:20:240
2912672991613,2cyclictest0-21swapper/012:25:010
2912672991612,3cyclictest3090655-21kworker/u8:2+events_unbound10:05:170
2912672991611,3cyclictest3027098-21unin-run09:00:000
2912672991610,5cyclictest335557-21systemd-journal09:35:000
291268299154,2cyclictest3133117-21sed10:40:143
291268299154,2cyclictest3021640-21chrt08:52:083
2912682991512,2cyclictest3158032-21idleruntime-cro11:04:593
2912682991512,2cyclictest2917802-21kworker/u8:0+flush-259:008:35:133
2912682991512,1cyclictest3132187-21sh10:40:003
2912682991510,4cyclictest2996037-21kworker/u8:4+flush-259:008:55:173
2912677991512,2cyclictest3110196-21ntp_kernel_pll_10:15:222
2912677991512,2cyclictest2912665-21cyclictest09:05:162
291267499159,4cyclictest335557-21systemd-journal09:54:061
2912674991513,1cyclictest0-21swapper/107:40:011
2912674991511,3cyclictest3199688-21kworker/u8:3+flush-259:011:45:301
2912672991513,1cyclictest60350irq/132-enp0s29f1:rx-012:15:180
2912672991513,1cyclictest60350irq/132-enp0s29f1:rx-012:05:210
2912672991513,1cyclictest60350irq/132-enp0s29f1:rx-012:00:170
2912672991513,1cyclictest60350irq/132-enp0s29f1:rx-011:00:190
2912672991513,1cyclictest60350irq/132-enp0s29f1:rx-010:55:130
2912672991513,1cyclictest60350irq/132-enp0s29f1:rx-009:25:140
2912672991513,1cyclictest60350irq/132-enp0s29f1:rx-007:20:380
2912672991512,2cyclictest60350irq/132-enp0s29f1:rx-011:30:210
2912672991512,2cyclictest60350irq/132-enp0s29f1:rx-011:30:200
2912672991512,2cyclictest60350irq/132-enp0s29f1:rx-011:05:240
2912672991512,2cyclictest60350irq/132-enp0s29f1:rx-009:05:110
2912672991512,2cyclictest60350irq/132-enp0s29f1:rx-007:25:210
2912672991512,2cyclictest0-21swapper/007:20:000
2912672991512,1cyclictest3137346-21turbostat10:44:590
291268299145,1cyclictest0-21swapper/310:05:183
2912682991410,3cyclictest2996035-21kworker/u8:1+flush-259:008:44:083
291268299140,2cyclictest3257040-21cat12:40:003
2912677991410,3cyclictest3126624-21kworker/u8:2+events_unbound10:43:392
2912674991412,1cyclictest0-21swapper/111:45:011
2912674991412,1cyclictest0-21swapper/109:00:171
2912674991411,2cyclictest3168268-21unixbench_multi11:10:231
2912674991411,2cyclictest3126624-21kworker/u8:2+flush-259:011:25:191
291267299146,6cyclictest2938821-21latency_hist07:35:010
2912672991413,1cyclictest60350irq/132-enp0s29f1:rx-011:55:110
2912672991412,1cyclictest60350irq/132-enp0s29f1:rx-010:17:570
2912672991412,1cyclictest60350irq/132-enp0s29f1:rx-008:22:400
2912672991412,1cyclictest60350irq/132-enp0s29f1:rx-008:01:480
2912672991411,2cyclictest60350irq/132-enp0s29f1:rx-010:30:250
2912672991411,2cyclictest60350irq/132-enp0s29f1:rx-010:04:580
2912672991411,2cyclictest60350irq/132-enp0s29f1:rx-007:55:210
2912672991410,3cyclictest3247040-21fschecks_count12:30:130
291268299139,3cyclictest3042809-21kworker/u8:2+flush-259:009:40:313
291268299138,4cyclictest3095605-21latency_hist10:05:023
291268299137,4cyclictest2979729-21ntpq08:10:233
291268299131,3cyclictest3085493-21apt-get09:55:153
291267799139,3cyclictest3063946-21kworker/u8:3+events_unbound10:25:242
291267799138,4cyclictest3189331-21kworker/u8:1+flush-259:011:35:242
291267799133,7cyclictest3204903-21munin-run11:50:012
291267499139,3cyclictest3090655-21kworker/u8:2+flush-259:010:05:251
291267499139,3cyclictest2917802-21kworker/u8:0+flush-259:009:15:261
291267499138,3cyclictest3059001-21cut09:30:171
2912674991310,2cyclictest3063946-21kworker/u8:3+flush-259:010:20:261
2912674991310,2cyclictest2913006-21cpuspeed_turbos07:10:121
291267299139,3cyclictest60350irq/132-enp0s29f1:rx-010:10:150
2912672991310,2cyclictest60350irq/132-enp0s29f1:rx-007:10:230
2912672991310,1cyclictest0-21swapper/008:45:180
291268299129,2cyclictest500-21systemd-logind07:45:013
291268299123,2cyclictest3205451-21/usr/sbin/munin11:50:173
2912682991210,1cyclictest0-21swapper/310:45:193
291267799128,3cyclictest2954721-21kworker/u8:2+flush-259:008:05:262
291267799126,4cyclictest3053172-21/usr/sbin/munin09:25:142
291267499129,2cyclictest335557-21systemd-journal10:35:361
291267499128,3cyclictest3006366-21kworker/u8:2+flush-259:008:45:001
291267499127,3cyclictest2928287-21gpgv07:25:011
291267799118,2cyclictest2965390-21cpuspeed_turbos08:00:142
291267799115,4cyclictest3189331-21kworker/u8:1+flush-259:011:50:272
291267499118,2cyclictest3163104-21kworker/u8:3+flush-259:011:30:231
291267499118,2cyclictest3163104-21kworker/u8:3+flush-259:011:30:231
291267499118,2cyclictest3069827-21fschecks_time09:40:131
291267499118,2cyclictest0-21swapper/110:55:131
291267499117,3cyclictest3189331-21kworker/u8:1+flush-259:012:10:081
291267499117,3cyclictest2996035-21kworker/u8:1+flush-259:009:05:311
291267499117,3cyclictest2954721-21kworker/u8:2+flush-259:008:01:081
291267299119,1cyclictest60350irq/132-enp0s29f1:rx-009:52:430
291267299118,2cyclictest60350irq/132-enp0s29f1:rx-012:25:110
291267299118,2cyclictest2995580-21unixbench_singl08:25:250
291268299104,4cyclictest335557-21systemd-journal12:17:373
29126749990,2cyclictest3194520-21latency_hist11:40:001
29126829986,1cyclictest2980830-21apt08:15:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional