You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 22:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Apr 07, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2731728994538,5cyclictest3069156-21latency_hist12:35:000
2731728994235,5cyclictest2851028-21latency_hist09:05:010
2731739994036,3cyclictest2678309-21kworker/u8:2+flush-259:008:10:003
2731734994037,2cyclictest3027958-21kworker/u8:2+flush-259:012:25:182
2731734994036,3cyclictest2742038-21kworker/u8:3+flush-259:007:45:142
2731739993733,3cyclictest3027958-21kworker/u8:2+flush-259:012:30:153
2731739993633,2cyclictest2908448-21kworker/u8:0+flush-259:011:05:163
2731734993632,3cyclictest2840247-21kworker/u8:2+flush-259:009:35:172
2731734993531,3cyclictest3006621-21base6411:35:012
2731730993530,3cyclictest252-21systemd-journal11:14:061
2731728993529,4cyclictest2829560-21gpgv08:45:000
2731739993229,2cyclictest2678309-21kworker/u8:2+flush-259:007:35:153
2731730993226,4cyclictest2777981-21latency_hist07:55:001
2731728993229,2cyclictest2908448-21kworker/u8:0+events_unbound12:15:160
2731734993125,4cyclictest3006489-21https11:35:002
2731728993128,2cyclictest2840238-21gpgv08:55:000
2731728993126,4cyclictest2778239-21apt-get07:55:090
2731739993027,2cyclictest3017231-21kworker/u8:3+flush-259:011:55:253
2731739992925,3cyclictest2929505-21apt-get10:20:113
2731730992925,3cyclictest3027958-21kworker/u8:2+flush-259:012:00:131
2731728992925,3cyclictest2918546-21gpgv10:10:000
2731739992824,3cyclictest2840247-21kworker/u8:2+flush-259:009:20:173
2731730992823,3cyclictest2970657-21apt-get11:00:121
2731728992824,3cyclictest2908448-21kworker/u8:0+events_unbound11:10:110
2731728992823,4cyclictest2742254-21apt-get07:20:110
2731728992822,4cyclictest2798978-21diskstats08:15:150
2731739992723,3cyclictest2929257-21kworker/u8:3+flush-259:010:55:003
2731734992721,4cyclictest2773080-21apt-get07:50:102
2731730992720,5cyclictest2924123-21latency_hist10:15:011
2731728992721,4cyclictest2929666-21diskstats10:20:140
2731728992720,5cyclictest2771959-21ntpq07:45:220
2731728992718,6cyclictest2741077-21ntpq07:15:200
2731739992620,4cyclictest252-21systemd-journal09:26:373
2731730992622,3cyclictest2960308-21/usr/sbin/munin10:50:141
2731730992622,3cyclictest2830132-21apt-get08:45:131
2731730992620,4cyclictest2906863-21ntpq09:55:201
2731728992622,2cyclictest3017231-21kworker/u8:3+flush-259:011:55:210
2731728992621,3cyclictest2929257-21kworker/u8:3+events_unbound10:55:200
2731728992621,3cyclictest2929257-21kworker/u8:3+events_unbound10:55:190
2731739992521,3cyclictest2814006-21kworker/u8:3+flush-259:008:35:253
2731739992520,3cyclictest252-21systemd-journal08:14:123
2731730992521,3cyclictest3012093-21idleruntime-cro11:40:001
2731730992519,4cyclictest3074275-21latency_hist12:40:001
2731728992522,2cyclictest2908448-21kworker/u8:0+flush-259:010:35:260
2731728992521,3cyclictest3027958-21kworker/u8:2+events_unbound12:25:430
2731739992421,2cyclictest2829481-21kworker/u8:1+flush-259:009:05:153
273173099248,9cyclictest2747160-21munin-run07:25:001
2731730992418,5cyclictest2839371-21ntpq08:50:211
2731728992420,3cyclictest3012366-21apt-get11:40:120
2731728992419,3cyclictest3038262-21kworker/u8:1+flush-259:012:10:010
2731728992418,4cyclictest2751401-21ntpq07:25:210
2731728992418,4cyclictest252-21systemd-journal10:46:420
2731734992317,4cyclictest2950031-21/usr/sbin/munin10:40:142
2731728992319,3cyclictest2840247-21kworker/u8:2+events_unbound09:25:000
2731728992319,3cyclictest2829481-21kworker/u8:1+events_unbound09:05:190
2731728992317,4cyclictest2830098-21kworker/u8:4+events_unbound10:00:020
2731739992218,3cyclictest3017231-21kworker/u8:3+flush-259:011:45:173
2731730992217,3cyclictest676936-21kworker/u8:1+flush-259:007:15:131
2731728992219,2cyclictest2929257-21kworker/u8:3+events_unbound11:20:160
2731728992219,2cyclictest2908448-21kworker/u8:0+flush-259:012:20:250
2731728992218,3cyclictest2908448-21kworker/u8:0+events_unbound11:50:260
2731728992218,3cyclictest2908448-21kworker/u8:0+events_unbound11:15:160
2731728992218,3cyclictest2908448-21kworker/u8:0+events_unbound11:05:120
2731728992216,4cyclictest3007117-21store11:35:010
2731739992118,2cyclictest3027958-21kworker/u8:2+flush-259:012:35:163
2731739992115,4cyclictest2939514-21latency_hist10:30:013
2731734992117,3cyclictest2678309-21kworker/u8:2+flush-259:008:25:012
2731734992116,4cyclictest2980954-21/usr/sbin/munin11:10:232
2731734992116,3cyclictest2996166-21latency_hist11:25:002
2731734992114,5cyclictest2908413-21cat10:00:022
2731730992117,3cyclictest3027958-21kworker/u8:2+flush-259:012:25:231
2731730992116,3cyclictest252-21systemd-journal09:31:381
2731730992115,5cyclictest2969513-21ntpq10:55:231
2731730992115,5cyclictest2969513-21ntpq10:55:221
2731728992117,3cyclictest2814006-21kworker/u8:3+events_unbound08:45:220
2731728992117,3cyclictest2742038-21kworker/u8:3+events_unbound07:35:130
2731739992017,2cyclictest2772862-21kworker/u8:1+flush-259:008:00:253
2731739992014,5cyclictest3037413-21ntpq12:00:223
2731739992014,4cyclictest2944897-21apt-get10:35:123
2731734992015,3cyclictest2861396-21latency_hist09:15:002
2731730992017,2cyclictest3022363-21idleruntime-cro11:50:001
2731730992014,4cyclictest252-21systemd-journal08:04:381
2731728992017,2cyclictest2908448-21kworker/u8:0+events_unbound10:40:200
2731728992017,2cyclictest2840247-21kworker/u8:2+flush-259:010:15:250
2731728992017,2cyclictest2840247-21kworker/u8:2+flush-259:009:00:010
2731728992016,3cyclictest676936-21kworker/u8:1+flush-259:007:10:210
2731728992016,3cyclictest2929257-21kworker/u8:3+events_unbound10:30:240
2731728992016,3cyclictest2908448-21kworker/u8:0+flush-259:011:25:190
2731728992016,3cyclictest2908448-21kworker/u8:0+flush-259:010:10:170
2731728992016,3cyclictest2871789-21kworker/u8:0+events_unbound09:25:390
2731728992016,3cyclictest2829481-21kworker/u8:1+events_unbound09:10:220
2731728992016,3cyclictest2742038-21kworker/u8:3+events_unbound07:53:400
2731728992013,5cyclictest2797729-21ntpq08:10:210
2731739991916,2cyclictest3022374-21apt-get11:50:023
2731739991913,4cyclictest2991035-21latency_hist11:20:013
2731734991915,3cyclictest2840247-21kworker/u8:2+flush-259:009:30:162
2731734991914,3cyclictest2819430-21apt-get08:35:122
2731734991913,4cyclictest2840214-21apt-get08:55:002
2731730991915,3cyclictest3038262-21kworker/u8:1+flush-259:012:15:011
2731730991915,3cyclictest2678309-21kworker/u8:2+flush-259:008:35:011
2731728991916,2cyclictest2908448-21kworker/u8:0+flush-259:012:10:220
2731728991915,3cyclictest3027958-21kworker/u8:2+flush-259:012:35:150
2731728991915,2cyclictest2824312-21idleruntime-cro08:40:000
2731728991913,4cyclictest2814221-21/usr/sbin/munin08:30:240
2731739991813,3cyclictest3053681-21latency_hist12:20:003
273173999181,14cyclictest2907841-21munin-run10:00:003
2731734991812,4cyclictest2928359-21ntpq10:15:222
2731728991815,2cyclictest2783120-21kworker/u8:0+events_unbound08:25:220
2731728991814,3cyclictest2996193-21kworker/u8:1+flush-259:011:45:260
2731728991814,3cyclictest2929257-21kworker/u8:3+events_unbound11:04:410
2731739991712,3cyclictest2742038-21kworker/u8:3+flush-259:007:25:003
2731739991711,4cyclictest252-21systemd-journal11:30:003
2731734991713,2cyclictest0-21swapper/208:19:592
2731734991713,2cyclictest0-21swapper/208:00:002
2731734991712,4cyclictest2731661-21latency_hist07:10:012
2731730991715,1cyclictest3038923-21irqcore12:05:161
2731730991715,1cyclictest0-21swapper/111:25:001
2731730991714,2cyclictest2762555-21idleruntime-cro07:40:001
2731730991712,4cyclictest2908448-21kworker/u8:0+flush-259:010:40:001
2731730991712,3cyclictest2678309-21kworker/u8:2+flush-259:007:40:181
2731728991714,2cyclictest3027958-21kworker/u8:2+events_unbound12:00:210
273172899171,15cyclictest509-21rs:main0
2731739991614,1cyclictest2918545-21gpgv10:09:593
2731739991614,1cyclictest0-21swapper/308:45:003
2731739991613,2cyclictest2965918-21irqcore10:55:183
2731739991613,2cyclictest2965918-21irqcore10:55:173
2731739991613,2cyclictest2929257-21kworker/u8:3+flush-259:010:45:093
2731739991612,3cyclictest2996193-21kworker/u8:1+flush-259:011:40:173
2731739991612,3cyclictest2908448-21kworker/u8:0+flush-259:010:10:113
2731739991611,4cyclictest2901737-21ntpq09:50:193
273173499167,8cyclictest0-21swapper/211:09:592
2731734991612,3cyclictest2887423-21kworker/u8:1+flush-259:009:40:172
2731734991610,4cyclictest2793390-21latency_hist08:10:002
2731730991614,1cyclictest0-21swapper/111:30:011
2731730991613,2cyclictest2857534-21kthreadcore09:10:171
2731730991613,2cyclictest2840247-21kworker/u8:2+flush-259:009:00:241
273172899169,5cyclictest3005645-21ntpq11:30:210
2731728991613,2cyclictest60350irq/132-enp0s29f1:rx-008:05:220
273173999159,4cyclictest2830078-21cp08:45:003
2731739991512,2cyclictest2773491-21irqcore07:50:153
2731739991512,2cyclictest2751446-21ntp_offset07:25:223
2731739991512,2cyclictest0-21swapper/310:05:013
2731739991510,3cyclictest2778324-21cut07:55:123
2731734991513,1cyclictest0-21swapper/212:35:002
2731734991512,2cyclictest2908448-21kworker/u8:0+flush-259:011:00:252
2731730991510,4cyclictest2678309-21kworker/u8:2+flush-259:008:20:261
2731728991513,1cyclictest60350irq/132-enp0s29f1:rx-009:51:040
2731728991512,2cyclictest60350irq/132-enp0s29f1:rx-009:30:230
2731728991512,2cyclictest2678309-21kworker/u8:2+flush-259:007:30:230
2731728991511,3cyclictest2887423-21kworker/u8:1+flush-259:009:40:160
2731728991511,3cyclictest2830098-21kworker/u8:4+events_unbound09:48:390
2731728991511,3cyclictest2678309-21kworker/u8:2+events_unbound07:40:280
273173999148,5cyclictest513-21gdbus09:35:013
2731739991411,2cyclictest2772818-21idleruntime-cro07:49:593
2731739991411,1cyclictest0-21swapper/308:55:013
273173999140,5cyclictest2954924-21awk10:45:003
273173999140,12cyclictest1-21systemd09:50:013
273173499148,5cyclictest0-21swapper/208:34:592
2731734991412,1cyclictest0-21swapper/212:25:012
2731734991411,2cyclictest2825586-21sed08:40:162
2731734991410,3cyclictest509-21rs:main2
273173099148,1cyclictest2934394-21idleruntime-cro10:25:001
2731730991412,1cyclictest0-21swapper/111:40:171
2731728991412,2cyclictest60350irq/132-enp0s29f1:rx-010:50:550
2731728991412,1cyclictest60350irq/132-enp0s29f1:rx-008:20:160
2731728991411,2cyclictest2929257-21kworker/u8:3+events_unbound10:25:190
273173999139,3cyclictest2908448-21kworker/u8:0+flush-259:011:00:123
273173999139,2cyclictest3009484-21kthreadcore11:35:153
2731739991310,2cyclictest2981045-21cpuspeed_turbos11:10:113
2731739991310,2cyclictest2840247-21kworker/u8:2+flush-259:009:00:153
273173499139,2cyclictest2830098-21kworker/u8:4+flush-259:009:25:002
273173499137,4cyclictest252-21systemd-journal09:05:012
2731734991310,2cyclictest676936-21kworker/u8:1+flush-259:007:15:232
2731734991310,2cyclictest3012433-21cpuspeed_turbos11:40:132
2731734991310,2cyclictest0-21swapper/210:00:012
273173099134,7cyclictest252-21systemd-journal07:49:591
2731730991310,1cyclictest0-21swapper/112:35:001
2731728991310,2cyclictest61150irq/133-enp0s29f1:tx-009:35:150
2731728991310,2cyclictest60350irq/132-enp0s29f1:rx-009:15:120
273173999129,2cyclictest0-21swapper/307:15:153
273173999128,3cyclictest2940194-21irqcore10:30:163
273173999127,4cyclictest2908448-21kworker/u8:0+flush-259:012:20:063
2731739991210,1cyclictest3001994-21tr11:30:163
2731739991210,1cyclictest0-21swapper/308:19:593
273173499129,2cyclictest2986198-21cpuspeed_turbos11:15:142
273173499129,2cyclictest2892684-21cpuspeed_turbos09:45:142
273173499128,3cyclictest2908448-21kworker/u8:0+flush-259:012:35:052
273173499121,2cyclictest3048545-21munin-plugin-st12:15:012
2731734991210,1cyclictest2837934-21kthreadcore08:50:192
273173099129,2cyclictest2980287-21unixbench_singl11:05:231
273173099129,2cyclictest2908448-21kworker/u8:0+flush-259:010:30:121
273173099129,2cyclictest2851350-21cpuspeed_turbos09:05:101
273173099128,3cyclictest2908448-21kworker/u8:0+flush-259:012:19:431
273173099128,3cyclictest2908448-21kworker/u8:0+flush-259:011:57:131
273173099128,3cyclictest2840247-21kworker/u8:2+flush-259:009:25:291
273173999118,2cyclictest2767229-21unixbench_multi07:40:253
273173999118,2cyclictest2736862-21idleruntime-cro07:15:003
273173499119,1cyclictest0-21swapper/207:35:222
273173499118,2cyclictest2772862-21kworker/u8:1+flush-259:008:00:492
273173499118,2cyclictest0-21swapper/210:25:162
273173499118,1cyclictest0-21swapper/207:15:002
273173499117,3cyclictest3053658-21cat12:19:552
273173499117,3cyclictest2969466-21ntp_kernel_err10:55:222
273173499117,3cyclictest2969466-21ntp_kernel_err10:55:212
273173499115,4cyclictest490-21dbus-daemon07:30:002
273173099118,2cyclictest2870135-21kthreadcore09:20:181
273173999107,2cyclictest0-21swapper/308:20:133
273173999106,3cyclictest491ktimers/309:15:123
273173499107,2cyclictest3023126-21cpuspeed_turbos11:50:132
273173499107,2cyclictest0-21swapper/212:10:012
273173499106,3cyclictest3033406-21cpuspeed_turbos12:00:122
273173499104,5cyclictest2834173-21ntpq08:45:222
273173099108,1cyclictest0-21swapper/107:35:001
273173099107,2cyclictest2798893-21cpuspeed_turbos08:15:131
273173099107,2cyclictest0-21swapper/110:50:001
273173099106,3cyclictest3023060-21apt-get11:50:111
273173099106,3cyclictest2934615-21/usr/sbin/munin10:25:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional