You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 01:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon May 11, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2566257995042,5cyclictest2789774-21latency_hist10:45:011
2566255994842,4cyclictest2774009-21cp10:30:010
2566255994539,4cyclictest2862233-21latency_hist11:55:010
2566260994441,2cyclictest2623033-21fwupd08:03:212
2566260994441,2cyclictest2623033-21fwupd08:03:202
2566257994133,5cyclictest2872660-21cp12:05:001
2566255994138,2cyclictest2867012-21kworker/u8:4+flush-259:012:00:260
2566260993935,3cyclictest2587129-21kworker/u8:2+flush-259:007:35:012
2566260993934,4cyclictest2810489-21gpgv11:05:012
2566257993832,4cyclictest2696041-21diskstats09:15:141
2566255993835,2cyclictest1852587-21kworker/u8:4+events_unbound07:14:420
2566264993628,6cyclictest2831354-21latency_hist11:25:013
2566255993632,3cyclictest2867385-21latency_hist12:00:000
2566255993532,3cyclictest2706582-21kworker/u8:0+events_unbound09:42:370
2566255993532,2cyclictest2805418-21kworker/u8:0+events_unbound11:05:190
2566255993529,4cyclictest252-21systemd-journal07:34:360
2566257993429,3cyclictest2805418-21kworker/u8:0+flush-259:011:00:181
2566255993431,2cyclictest2571350-21kworker/u8:1+events_unbound07:20:230
2566264993329,3cyclictest2706582-21kworker/u8:0+flush-259:009:35:183
2566264993326,5cyclictest2909029-21latency_hist12:40:003
2566260993325,2cyclictest2789785-21kworker/u8:2+flush-259:010:55:152
2566255993330,3cyclictest2837176-21kworker/u8:3+events_unbound12:21:370
2566255993330,2cyclictest2706582-21kworker/u8:0+events_unbound09:55:150
2566260993228,3cyclictest2623042-21kworker/u8:2+flush-259:008:25:112
2566260993228,3cyclictest2587129-21kworker/u8:2+events_unbound07:37:372
2566260993228,3cyclictest2550968-21kworker/u8:0+events_unbound07:53:372
2566257993227,3cyclictest252-21systemd-journal09:00:191
2566255993229,2cyclictest2837176-21kworker/u8:3+flush-259:012:10:370
2566255993229,2cyclictest2805418-21kworker/u8:0+events_unbound11:15:240
2566255993229,2cyclictest2732845-21kworker/u8:3+events_unbound10:40:210
2566255993229,2cyclictest2628401-21kworker/u8:1+events_unbound09:15:160
2566255993229,2cyclictest2550968-21kworker/u8:0+flush-259:008:03:370
2566255993229,2cyclictest2550968-21kworker/u8:0+flush-259:008:03:370
2566255993229,2cyclictest2550968-21kworker/u8:0+events_unbound07:39:540
2566260993127,3cyclictest2846839-21kworker/u8:0+events_unbound11:41:382
2566260993125,4cyclictest509-21rs:main2
2566257993125,4cyclictest252-21systemd-journal09:49:361
2566255993128,2cyclictest2893791-21kworker/u8:2+events_unbound12:25:230
2566255993128,2cyclictest2706582-21kworker/u8:0+events_unbound09:35:140
2566255993127,3cyclictest2550968-21kworker/u8:0+events_unbound07:40:220
2566255993126,3cyclictest2903842-21latency_hist12:35:000
2566264993025,3cyclictest2805418-21kworker/u8:0+events_unbound11:15:233
2566260993027,2cyclictest2716889-21kworker/u8:2+events_unbound10:26:352
2566260993026,3cyclictest2846839-21kworker/u8:0+events_unbound11:54:372
2566260993025,3cyclictest2789785-21kworker/u8:2+flush-259:011:30:162
2566257993024,4cyclictest509-21rs:main1
2566255993027,2cyclictest2669955-21kworker/u8:4+events_unbound09:05:210
2566255993027,2cyclictest2669955-21kworker/u8:4+events_unbound08:55:000
2566255993027,2cyclictest2654399-21kworker/u8:3+events_unbound08:35:150
2566255993027,2cyclictest2628401-21kworker/u8:1+events_unbound09:20:220
2566255993027,2cyclictest2571350-21kworker/u8:1+flush-259:007:15:250
2566255993026,3cyclictest2805418-21kworker/u8:0+events_unbound11:02:370
2566255993025,2cyclictest2716889-21kworker/u8:2+events_unbound10:10:000
2566255993024,5cyclictest2820194-21ntpq11:10:220
2566260992925,3cyclictest2517905-21kworker/u8:3+events_unbound07:14:482
2566255992927,2cyclictest2837176-21kworker/u8:3+flush-259:012:05:250
2566255992927,2cyclictest2789785-21kworker/u8:2+events_unbound10:55:200
2566255992926,2cyclictest2789785-21kworker/u8:2+events_unbound11:30:180
2566264992824,3cyclictest2732845-21kworker/u8:3+flush-259:010:30:223
2566260992824,3cyclictest2789785-21kworker/u8:2+flush-259:011:35:252
2566260992824,3cyclictest2550968-21kworker/u8:0+events_unbound07:46:382
2566260992824,3cyclictest2517905-21kworker/u8:3+events_unbound07:29:352
2566260992823,3cyclictest2732845-21kworker/u8:3+flush-259:010:35:242
2566257992824,3cyclictest2669988-21apt-get08:50:101
2566257992822,4cyclictest2669721-21latency_hist08:50:011
2566255992826,2cyclictest2878159-21kworker/u8:1+events_unbound12:19:380
2566255992825,2cyclictest2669955-21kworker/u8:4+flush-259:009:25:030
2566255992825,2cyclictest2550968-21kworker/u8:0+flush-259:007:50:150
2566255992824,3cyclictest2716889-21kworker/u8:2+flush-259:010:15:190
2566260992723,3cyclictest2837176-21kworker/u8:3+events_unbound12:03:362
2566260992723,3cyclictest2789785-21kworker/u8:2+events_unbound11:20:152
2566260992723,3cyclictest2732845-21kworker/u8:3+flush-259:010:50:392
2566260992723,3cyclictest2732845-21kworker/u8:3+events_unbound10:21:382
2566260992723,3cyclictest2732845-21kworker/u8:3+events_unbound10:21:382
2566260992723,3cyclictest2607674-21kworker/u8:3+events_unbound08:06:372
2566260992720,5cyclictest2685258-21latency_hist09:05:012
2566255992720,5cyclictest2795146-21/usr/sbin/munin10:50:140
2566260992622,3cyclictest2867012-21kworker/u8:4+events_unbound12:11:382
2566260992622,3cyclictest2623042-21kworker/u8:2+flush-259:008:10:372
2566257992620,4cyclictest2893791-21kworker/u8:2+flush-259:012:35:191
2566255992623,3cyclictest2706582-21kworker/u8:0+events_unbound09:51:380
2566255992623,2cyclictest2846839-21kworker/u8:0+events_unbound11:45:570
2566260992522,2cyclictest2878159-21kworker/u8:1+flush-259:012:15:252
2566260992522,2cyclictest2654399-21kworker/u8:3+flush-259:008:35:192
2566260992522,2cyclictest2550968-21kworker/u8:0+events_unbound07:55:222
2566260992521,3cyclictest2706582-21kworker/u8:0+events_unbound10:02:372
2566260992521,3cyclictest2628401-21kworker/u8:1+flush-259:009:30:232
2566260992520,4cyclictest2898705-21latency_hist12:30:002
2566260992519,4cyclictest252-21systemd-journal09:39:592
2566257992520,4cyclictest2637696-21kworker/u8:0+flush-259:008:40:011
2566255992522,2cyclictest2716889-21kworker/u8:2+flush-259:010:20:250
2566255992522,2cyclictest2716889-21kworker/u8:2+flush-259:010:20:240
2566260992421,2cyclictest2628401-21kworker/u8:1+events_unbound08:40:152
2566260992420,3cyclictest2805418-21kworker/u8:0+events_unbound11:25:562
2566260992419,4cyclictest2774594-21apt-get10:30:132
2566260992419,4cyclictest2732845-21kworker/u8:3+events_unbound09:50:322
2566257992418,4cyclictest2690865-21diskstats09:10:151
2566257992418,4cyclictest2576679-21cp07:20:011
2566255992421,2cyclictest2628401-21kworker/u8:1+flush-259:008:40:200
2566255992421,2cyclictest2628401-21kworker/u8:1+flush-259:008:20:160
2566264992319,3cyclictest2654399-21kworker/u8:3+flush-259:008:35:133
2566264992318,3cyclictest2857087-21kworker/u8:1+events_unbound11:55:183
2566264992317,4cyclictest2805418-21kworker/u8:0+events_unbound11:00:223
2566260992320,2cyclictest2716889-21kworker/u8:2+events_unbound10:10:232
2566260992320,2cyclictest2654399-21kworker/u8:3+events_unbound08:45:212
2566260992319,3cyclictest2716889-21kworker/u8:2+events_unbound10:18:382
2566260992319,3cyclictest2628401-21kworker/u8:1+events_unbound09:16:372
2566257992318,3cyclictest2836760-21apt-get11:30:111
2566257992316,5cyclictest2835655-21ntpq11:25:221
2566264992218,3cyclictest2628401-21kworker/u8:1+flush-259:009:20:163
2566260992218,3cyclictest2576609-21gpgv07:20:002
2566257992219,2cyclictest2587129-21kworker/u8:2+flush-259:007:30:001
2566257992215,5cyclictest2773007-21ntpq10:25:211
2566255992217,4cyclictest2768788-21kworker/u8:0+flush-259:010:45:170
2566264992117,3cyclictest2732845-21kworker/u8:3+flush-259:010:50:193
2566260992118,2cyclictest2623042-21kworker/u8:2+flush-259:008:15:202
2566260992118,2cyclictest252-21systemd-journal11:05:432
2566260992117,3cyclictest2893791-21kworker/u8:2+events_unbound12:34:372
2566260992117,3cyclictest2517905-21kworker/u8:3+events_unbound07:24:372
2566260992116,4cyclictest2805418-21kworker/u8:0+events_unbound11:15:542
2566257992115,4cyclictest2779729-21/usr/sbin/munin10:35:201
2566257992115,4cyclictest2618046-21latency_hist08:00:011
2566255992118,2cyclictest2805418-21kworker/u8:0+events_unbound11:25:200
2566255992117,3cyclictest2716889-21kworker/u8:2+events_unbound09:45:100
2566255992117,3cyclictest2706582-21kworker/u8:0+events_unbound09:34:370
2566255992116,4cyclictest2675168-21apt-get08:55:130
2566264992016,3cyclictest2867012-21kworker/u8:4+events_unbound12:10:243
2566264992016,3cyclictest2732845-21kworker/u8:3+events_unbound10:05:133
2566264992016,3cyclictest2716889-21kworker/u8:2+flush-259:010:20:233
2566264992016,3cyclictest2716889-21kworker/u8:2+flush-259:010:20:223
2566264992014,4cyclictest2716655-21latency_hist09:35:013
2566260992017,2cyclictest2669955-21kworker/u8:4+events_unbound09:26:382
2566260992016,3cyclictest2768788-21kworker/u8:0+events_unbound10:42:372
2566257992014,4cyclictest2592354-21latency_hist07:35:011
2566255992017,3cyclictest2706582-21kworker/u8:0+events_unbound10:00:330
2566255992017,2cyclictest2623042-21kworker/u8:2+events_unbound08:15:220
2566264991916,2cyclictest2837176-21kworker/u8:3+events_unbound12:30:173
2566264991916,2cyclictest2628401-21kworker/u8:1+flush-259:009:15:283
2566264991916,2cyclictest2623042-21kworker/u8:2+events_unbound08:50:133
2566264991915,3cyclictest2837176-21kworker/u8:3+flush-259:011:40:253
2566264991914,4cyclictest2736929-21ntpq09:50:223
2566260991916,2cyclictest2837176-21kworker/u8:3+events_unbound12:35:152
2566260991915,3cyclictest2706582-21kworker/u8:0+events_unbound09:40:142
2566260991915,2cyclictest2768788-21kworker/u8:0+flush-259:010:45:212
2566260991914,4cyclictest2701034-21/usr/sbin/munin09:20:142
2566255991916,2cyclictest2732845-21kworker/u8:3+events_unbound10:30:280
2566255991916,2cyclictest2680106-21kworker/u8:0+flush-259:009:10:260
2566255991912,5cyclictest252-21systemd-journal08:10:010
2566264991814,2cyclictest2837176-21kworker/u8:3+events_unbound12:20:213
2566260991814,3cyclictest2867012-21kworker/u8:4+events_unbound12:09:372
2566260991814,3cyclictest2587129-21kworker/u8:2+events_unbound07:40:372
256626099180,16cyclictest1-21systemd09:10:002
256625799184,7cyclictest2826222-21munin-run11:20:011
2566257991815,2cyclictest0-21swapper/109:25:001
2566257991814,3cyclictest2706616-21apt-get09:25:131
2566264991714,2cyclictest2872774-21apt-key12:05:003
2566264991714,2cyclictest2664536-21sh08:45:013
2566264991712,3cyclictest2623042-21kworker/u8:2+flush-259:008:10:173
2566264991712,3cyclictest2602633-21latency_hist07:45:003
2566264991711,4cyclictest2873151-21base6412:05:003
2566257991714,2cyclictest2669955-21kworker/u8:4+flush-259:009:05:211
2566257991712,3cyclictest2883519-21/usr/sbin/munin12:15:141
2566257991712,3cyclictest2550968-21kworker/u8:0+flush-259:007:50:161
2566257991710,5cyclictest252-21systemd-journal09:35:211
2566255991714,2cyclictest2732845-21kworker/u8:3+events_unbound10:35:190
2566264991612,3cyclictest2789785-21kworker/u8:2+events_unbound11:30:213
2566264991612,3cyclictest2607674-21kworker/u8:3+events_unbound08:03:243
2566264991612,3cyclictest2607674-21kworker/u8:3+events_unbound08:03:233
2566264991612,2cyclictest2695611-21sh09:15:003
2566264991611,3cyclictest2837176-21kworker/u8:3+events_unbound11:40:013
2566260991613,2cyclictest2837176-21kworker/u8:3+events_unbound12:20:242
256625799169,4cyclictest252-21systemd-journal10:30:301
2566257991612,3cyclictest2618313-21apt-get08:00:111
2566257991612,3cyclictest2618313-21apt-get08:00:111
2566255991614,1cyclictest60350irq/132-enp0s29f1:rx-011:40:260
2566255991613,2cyclictest60350irq/132-enp0s29f1:rx-007:59:110
2566264991511,3cyclictest2878159-21kworker/u8:1+flush-259:012:20:003
2566264991511,3cyclictest2789785-21kworker/u8:2+events_unbound11:05:153
2566264991511,3cyclictest2768788-21kworker/u8:0+flush-259:010:40:233
2566264991511,3cyclictest2550968-21kworker/u8:0+flush-259:007:30:203
2566264991510,3cyclictest2654399-21kworker/u8:3+flush-259:008:45:273
2566260991512,2cyclictest2680106-21kworker/u8:0+events_unbound09:10:172
2566260991512,2cyclictest2669955-21kworker/u8:4+events_unbound08:55:362
2566260991511,3cyclictest2623042-21kworker/u8:2+flush-259:008:30:202
256625799150,2cyclictest2758465-21idleruntime-cro10:15:001
2566255991513,1cyclictest60350irq/132-enp0s29f1:rx-012:35:320
2566255991513,1cyclictest60350irq/132-enp0s29f1:rx-009:01:140
2566255991513,1cyclictest60350irq/132-enp0s29f1:rx-007:45:090
2566255991511,3cyclictest2587169-21turbostat07:30:000
256626499146,2cyclictest0-21swapper/307:14:413
2566264991411,2cyclictest2783658-21needreboot10:35:203
2566264991411,2cyclictest2706582-21kworker/u8:0+flush-259:009:40:153
2566264991411,2cyclictest2571848-21fschecks_time07:15:143
2566264991411,2cyclictest2550968-21kworker/u8:0+flush-259:007:45:253
2566264991411,1cyclictest0-21swapper/311:50:193
2566264991410,3cyclictest2623042-21kworker/u8:2+flush-259:008:25:163
2566264991410,3cyclictest2592683-21cpuspeed_turbos07:35:123
256625799149,3cyclictest2878383-21apt-get12:10:121
256625799145,2cyclictest2623975-21cut08:05:171
2566257991411,2cyclictest2634840-21kthreadcore08:15:151
2566257991410,3cyclictest2669955-21kworker/u8:4+events_unbound09:00:001
256625599149,3cyclictest2831359-21turbostat11:25:010
2566255991412,1cyclictest60350irq/132-enp0s29f1:rx-010:10:240
2566255991411,3cyclictest2837176-21kworker/u8:3+events_unbound11:37:360
256626499139,3cyclictest2732845-21kworker/u8:3+events_unbound10:15:153
256626499139,3cyclictest2550968-21kworker/u8:0+flush-259:007:55:193
2566264991310,3cyclictest2623042-21kworker/u8:2+events_unbound08:30:163
2566264991310,2cyclictest2755866-21kthreadcore10:10:193
2566260991310,2cyclictest2837176-21kworker/u8:3+flush-259:011:48:472
256625799139,2cyclictest0-21swapper/112:30:221
256625799136,5cyclictest252-21systemd-journal11:09:591
2566257991311,1cyclictest2799042-21needreboot10:50:201
2566255991311,1cyclictest60350irq/132-enp0s29f1:rx-008:45:050
2566255991311,1cyclictest60350irq/132-enp0s29f1:rx-008:25:450
256626499129,2cyclictest2837176-21kworker/u8:3+flush-259:012:25:593
256626499129,2cyclictest2669955-21kworker/u8:4+flush-259:009:05:243
256626499129,2cyclictest2639996-21kthreadcore08:20:163
256626499129,2cyclictest2607674-21kworker/u8:3+events_unbound08:05:243
256626499128,3cyclictest2846839-21kworker/u8:0+events_unbound11:45:163
256626499128,3cyclictest2550968-21kworker/u8:0+flush-259:007:50:243
256626499128,2cyclictest2669955-21kworker/u8:4+flush-259:009:25:173
256626499126,4cyclictest2773925-21https10:30:003
256626099129,2cyclictest2857087-21kworker/u8:1+flush-259:011:55:212
256626099129,2cyclictest2628401-21kworker/u8:1+flush-259:008:20:062
256626099129,2cyclictest0-21swapper/208:55:012
256625799129,2cyclictest2768337-21unixbench_singl10:20:251
256625799129,2cyclictest2768337-21unixbench_singl10:20:251
256625799129,1cyclictest0-21swapper/111:15:001
256625799128,3cyclictest2706582-21kworker/u8:0+flush-259:009:34:411
256625799128,2cyclictest0-21swapper/108:30:261
256626499119,1cyclictest0-21swapper/310:00:143
256626499118,2cyclictest2680410-21cpuspeed_turbos09:00:123
256626099118,2cyclictest2727767-21cpuspeed_turbos09:45:122
256626099117,3cyclictest2732845-21kworker/u8:3+events_unbound10:09:372
256625799115,4cyclictest252-21systemd-journal10:10:001
256626499106,3cyclictest2805418-21kworker/u8:0+events_unbound11:25:163
256626499100,3cyclictest2680081-21latency_hist09:00:003
256625799107,2cyclictest2726472-21cut09:40:191
256625799103,6cyclictest2854494-21sed11:45:171
25662579997,1cyclictest0-21swapper/112:25:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional