You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 06:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Aug 20, 2026 00:44:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2818506995751,4cyclictest2886654-21cat20:15:010
2818509994943,4cyclictest2886144-21apt-get20:15:001
2818506994945,3cyclictest2985513-21latency_hist21:50:000
2818506994844,3cyclictest3137702-21apt-get00:15:110
2818509994741,4cyclictest335557-21systemd-journal19:35:221
2818512994541,3cyclictest3059540-21kworker/u8:1+flush-259:000:35:002
2818506994338,3cyclictest3049452-21apt-get22:50:120
2818506994228,12cyclictest2881227-21apt-get20:10:130
2818514994138,2cyclictest2891452-21kworker/u8:1+flush-259:020:55:253
2818514994136,4cyclictest3033305-21gpgv22:35:013
2818509994134,5cyclictest335557-21systemd-journal23:09:281
2818512994033,5cyclictest335557-21systemd-journal20:15:002
2818512993934,3cyclictest509-21rs:main2
2818512993833,4cyclictest2870631-21kworker/u8:3+flush-259:020:34:592
2818512993731,4cyclictest3070041-21/usr/sbin/munin23:10:132
2818512993632,3cyclictest2870631-21kworker/u8:3+flush-259:020:30:002
2818512993632,2cyclictest2938122-21kworker/u8:0+events_unbound21:05:182
2818509993631,3cyclictest335557-21systemd-journal19:16:281
2818514993529,4cyclictest2996287-21latency_hist22:00:003
2818512993528,5cyclictest2963947-21ntpq21:25:232
2818509993530,4cyclictest2812961-21kworker/u8:4+flush-259:019:40:151
2818514993430,3cyclictest3043727-21gpgv22:45:003
2818512993430,3cyclictest3106171-21/usr/sbin/munin23:45:142
2818506993430,3cyclictest3048176-21kworker/u8:2+flush-259:023:15:150
2818506993427,5cyclictest2849832-21latency_hist19:40:010
2818514993329,3cyclictest2839145-21kworker/u8:2+events_unbound20:00:013
2818514993326,5cyclictest2907180-21latency_hist20:35:013
2818509993327,4cyclictest335557-21systemd-journal23:05:001
2818506993327,4cyclictest3153249-21apt-get00:30:130
2818506993227,3cyclictest2975396-21apt-get21:40:110
2818514993127,3cyclictest2849859-21kworker/u8:1+flush-259:020:09:593
2818514993126,3cyclictest2849453-21kworker/u8:0+events_unbound20:15:183
2818512993126,4cyclictest2818447-21kworker/u8:1+flush-259:019:30:002
2818506993125,4cyclictest2958727-21ntpq21:20:220
2818514993027,2cyclictest2812961-21kworker/u8:4+events_unbound19:25:003
2818514993026,3cyclictest3142654-21kworker/u8:4+flush-259:000:25:313
2818514993025,4cyclictest3011790-21kworker/u8:1+events_unbound22:39:283
2818509993026,3cyclictest3038694-21apt-get22:40:091
2818506993026,3cyclictest3048176-21kworker/u8:2+flush-259:023:00:160
2818514992925,3cyclictest3059540-21kworker/u8:1+flush-259:023:20:233
2818512992923,4cyclictest3054788-21diskstats22:55:142
2818506992923,5cyclictest3142654-21kworker/u8:4+flush-259:000:30:000
2818506992923,4cyclictest3033544-21/usr/sbin/munin22:35:150
2818514992824,3cyclictest3059540-21kworker/u8:1+events_unbound00:13:323
2818514992824,3cyclictest2948876-21kworker/u8:2+flush-259:021:35:003
2818514992824,3cyclictest2907207-21kworker/u8:2+events_unbound20:36:283
2818514992822,5cyclictest2870878-21apt-get20:00:143
2818512992822,4cyclictest3048176-21kworker/u8:2+flush-259:023:15:162
2818512992822,4cyclictest3027944-21/usr/sbin/munin22:30:232
2818509992822,4cyclictest2907445-21apt-get20:35:111
2818506992824,3cyclictest3121524-21kworker/u8:3+flush-259:000:25:000
2818506992822,4cyclictest3090735-21apt-get23:30:080
2818514992724,2cyclictest3059540-21kworker/u8:1+flush-259:023:05:263
2818514992724,2cyclictest3048176-21kworker/u8:2+events_unbound23:15:183
2818514992723,3cyclictest3059540-21kworker/u8:1+events_unbound23:59:293
2818514992723,3cyclictest3048176-21kworker/u8:2+flush-259:023:40:003
2818514992723,3cyclictest2849453-21kworker/u8:0+events_unbound20:40:243
2818512992723,3cyclictest3048176-21kworker/u8:2+flush-259:023:30:202
2818512992721,5cyclictest3027701-21latency_hist22:30:002
2818512992721,4cyclictest3148111-21apt-get00:25:112
2818512992720,5cyclictest3059540-21kworker/u8:1+flush-259:023:05:172
2818509992720,5cyclictest2886325-21cp20:15:011
2818514992622,3cyclictest2990611-21kworker/u8:3+flush-259:022:05:483
2818514992622,3cyclictest2990611-21kworker/u8:3+events_unbound22:00:483
2818514992622,3cyclictest2927838-21kworker/u8:3+events_unbound21:00:253
2818514992622,3cyclictest2828825-21sh19:20:003
2818514992621,4cyclictest2948876-21kworker/u8:2+events_unbound21:15:393
2818514992621,4cyclictest2927838-21kworker/u8:3+flush-259:021:10:173
2818514992620,4cyclictest3044128-21cat22:45:013
2818512992621,3cyclictest3111360-21apt-get23:50:122
2818512992620,4cyclictest2880968-21latency_hist20:10:012
2818512992618,6cyclictest3043997-21cp22:45:012
2818509992621,3cyclictest2829087-21apt-get19:20:111
2818506992620,4cyclictest3043612-21latency_hist22:45:010
2818506992619,5cyclictest3105928-21latency_hist23:45:000
2818514992522,2cyclictest3048176-21kworker/u8:2+flush-259:023:45:233
2818514992522,2cyclictest2870631-21kworker/u8:3+flush-259:020:25:243
2818514992521,3cyclictest2970162-21kworker/u8:1+events_unbound21:39:283
2818514992521,3cyclictest2891452-21kworker/u8:1+events_unbound20:53:283
2818514992520,3cyclictest2996309-21kworker/u8:0+events_unbound22:15:173
2818512992521,3cyclictest2849453-21kworker/u8:0+flush-259:020:20:252
2818512992521,3cyclictest2812961-21kworker/u8:4+events_unbound19:30:232
2818512992519,4cyclictest335557-21systemd-journal23:37:282
2818509992522,2cyclictest2902061-21idleruntime-cro20:30:001
2818509992520,4cyclictest2985625-21gpgv21:50:001
2818509992520,3cyclictest3059540-21kworker/u8:1+flush-259:023:20:151
2818506992520,3cyclictest2991374-21apt-get21:55:130
2818514992420,3cyclictest2927838-21kworker/u8:3+events_unbound21:26:283
2818514992420,3cyclictest2927838-21kworker/u8:3+events_unbound21:05:263
2818514992419,3cyclictest2980354-21kworker/u8:0+events_unbound21:50:233
2818514992418,4cyclictest3059540-21kworker/u8:1+flush-259:000:15:203
2818512992418,4cyclictest2995378-21ntpq21:55:222
2818509992420,3cyclictest335557-21systemd-journal21:00:341
2818509992419,4cyclictest3017126-21gpgv22:20:001
2818506992417,4cyclictest335557-21systemd-journal23:05:270
2818514992320,2cyclictest3048176-21kworker/u8:2+events_unbound00:01:313
2818512992319,3cyclictest2948876-21kworker/u8:2+flush-259:021:45:002
2818509992316,5cyclictest2943701-21latency_hist21:10:011
2818506992319,3cyclictest2996309-21kworker/u8:0+flush-259:022:30:170
2818506992318,3cyclictest3126987-21apt-get00:05:130
2818506992311,7cyclictest2855037-21munin-run19:45:000
2818514992219,2cyclictest2948876-21kworker/u8:2+flush-259:021:45:153
2818514992218,3cyclictest3054338-21kworker/u8:0+events_unbound22:59:303
2818514992218,3cyclictest3048176-21kworker/u8:2+events_unbound23:42:283
2818514992218,3cyclictest2907207-21kworker/u8:2+events_unbound20:45:193
2818514992218,2cyclictest2849453-21kworker/u8:0+flush-259:020:20:213
2818512992219,2cyclictest3059540-21kworker/u8:1+flush-259:000:40:012
2818512992218,3cyclictest2990611-21kworker/u8:3+flush-259:022:05:262
2818509992217,3cyclictest2949097-21apt-get21:15:111
2818506992218,2cyclictest2912357-21latency_hist20:40:000
2818506992217,3cyclictest2870631-21kworker/u8:3+flush-259:020:25:180
2818506992215,4cyclictest2932972-21latency_hist21:00:010
2818514992118,2cyclictest2780886-21kworker/u8:3+events_unbound19:35:193
2818514992117,3cyclictest3059540-21kworker/u8:1+flush-259:000:05:233
2818514992117,3cyclictest3059540-21kworker/u8:1+events_unbound23:52:313
2818514992117,3cyclictest3059540-21kworker/u8:1+events_unbound23:10:153
2818514992117,3cyclictest3048176-21kworker/u8:2+events_unbound00:33:323
2818514992117,3cyclictest2948876-21kworker/u8:2+events_unbound21:20:393
2818512992117,3cyclictest3059540-21kworker/u8:1+flush-259:000:00:252
2818512992117,3cyclictest2780886-21kworker/u8:3+flush-259:019:20:252
2818512992116,3cyclictest3142898-21apt-get00:20:122
2818512992116,3cyclictest2865673-21apt-get19:55:102
2818509992118,2cyclictest2818500-21cyclictest23:00:001
2818509992115,4cyclictest509-21rs:main1
2818509992115,4cyclictest3105909-21cat23:44:561
2818509992115,4cyclictest2954636-21cat21:20:011
2818506992117,3cyclictest3054338-21kworker/u8:0+flush-259:022:55:220
2818506992117,3cyclictest2948876-21kworker/u8:2+flush-259:021:25:220
2818506992117,3cyclictest2780886-21kworker/u8:3+flush-259:019:34:590
2818506992116,4cyclictest2986199-21apt-get21:50:120
2818506992116,3cyclictest2891964-21apt-get20:20:110
2818506992115,4cyclictest2834399-21diskstats19:25:140
2818514992017,2cyclictest3142654-21kworker/u8:4+events_unbound00:39:343
2818514992017,2cyclictest2954689-21kworker/u8:4+events_unbound22:10:183
2818514992016,3cyclictest3011790-21kworker/u8:1+events_unbound22:25:263
2818514992014,4cyclictest3011790-21kworker/u8:1+flush-259:022:20:173
2818512992015,4cyclictest2907207-21kworker/u8:2+flush-259:020:35:212
2818512992013,5cyclictest2828827-21latency_hist19:20:012
2818509992017,2cyclictest2990611-21kworker/u8:3+flush-259:022:00:001
2818509992016,2cyclictest0-21swapper/121:55:001
2818509992015,4cyclictest335557-21systemd-journal22:06:271
2818506992017,2cyclictest3022508-21dump-pmu-power22:25:000
2818506992014,3cyclictest2876233-21diskstats20:05:130
2818506992013,5cyclictest335557-21systemd-journal20:04:280
2818514991915,3cyclictest2948876-21kworker/u8:2+flush-259:021:40:213
2818514991915,3cyclictest2812961-21kworker/u8:4+events_unbound19:40:233
2818514991913,5cyclictest335557-21systemd-journal19:33:273
2818514991912,5cyclictest2860234-21latency_hist19:50:013
2818512991916,2cyclictest3142629-21cron00:19:592
2818512991914,3cyclictest335557-21systemd-journal22:35:012
2818512991913,4cyclictest2954884-21diskstats21:20:152
2818512991913,4cyclictest2922900-21/usr/sbin/munin20:50:132
2818512991912,4cyclictest3022504-21latency_hist22:25:002
2818509991916,2cyclictest2971-21cron22:50:001
2818509991915,3cyclictest3032998-21gpgv22:35:011
2818509991914,3cyclictest2922925-21apt-get20:50:101
2818509991913,4cyclictest2839109-21apt-get19:30:011
2818509991910,1cyclictest2912620-21apt-get20:40:121
2818506991916,2cyclictest3163274-21cron00:40:000
2818506991915,3cyclictest2996309-21kworker/u8:0+flush-259:022:10:480
2818506991914,3cyclictest2823932-21apt-get19:15:120
2818514991814,3cyclictest3048176-21kworker/u8:2+events_unbound00:22:313
2818512991815,2cyclictest0-21swapper/222:05:002
2818512991814,3cyclictest2849859-21kworker/u8:1+flush-259:019:50:232
2818512991814,3cyclictest2849453-21kworker/u8:0+flush-259:020:00:182
2818512991812,5cyclictest2954035-21apt-get21:20:012
281850999185,4cyclictest2947942-21ntpq21:10:211
2818506991814,3cyclictest60350irq/132-enp0s29f1:rx-000:10:110
2818514991714,2cyclictest3048176-21kworker/u8:2+flush-259:023:30:003
2818514991711,4cyclictest2823666-21latency_hist19:14:593
2818512991713,3cyclictest3038458-21kworker/u8:3+flush-259:022:45:272
281850999173,4cyclictest3094700-21gcc23:30:171
2818509991714,2cyclictest2849859-21kworker/u8:1+flush-259:019:55:151
2818509991711,4cyclictest2980338-21latency_hist21:45:001
2818506991714,2cyclictest60350irq/132-enp0s29f1:rx-023:55:130
2818506991714,2cyclictest60350irq/132-enp0s29f1:rx-023:45:210
2818506991712,3cyclictest335557-21systemd-journal23:26:040
2818514991613,2cyclictest2812961-21kworker/u8:4+events_unbound19:25:213
2818514991612,3cyclictest2812961-21kworker/u8:4+events_unbound19:53:283
2818512991613,2cyclictest3134410-21kthreadcore00:10:172
2818512991613,1cyclictest0-21swapper/222:20:002
2818512991610,4cyclictest2933206-21/usr/sbin/munin21:00:152
281850999165,2cyclictest2969069-21ntpq21:30:231
2818509991613,2cyclictest0-21swapper/119:50:001
2818506991614,1cyclictest60350irq/132-enp0s29f1:rx-023:50:250
2818506991614,1cyclictest60350irq/132-enp0s29f1:rx-000:00:280
2818506991613,2cyclictest60350irq/132-enp0s29f1:rx-020:40:200
2818506991613,2cyclictest60350irq/132-enp0s29f1:rx-019:45:210
2818514991511,3cyclictest2839145-21kworker/u8:2+flush-259:020:11:383
2818512991511,3cyclictest2855401-21cut19:45:122
2818512991511,3cyclictest2818447-21kworker/u8:1+flush-259:019:10:232
281850999157,6cyclictest335557-21systemd-journal00:10:001
281850699159,4cyclictest3044299-21apt-get22:45:130
2818506991514,1cyclictest60350irq/132-enp0s29f1:rx-020:32:110
2818506991513,2cyclictest60350irq/132-enp0s29f1:rx-019:57:470
2818506991513,1cyclictest60350irq/132-enp0s29f1:rx-022:25:220
2818506991513,1cyclictest60350irq/132-enp0s29f1:rx-021:30:460
2818506991512,2cyclictest61150irq/133-enp0s29f1:tx-022:15:170
2818506991512,2cyclictest0-21swapper/021:05:000
2818514991410,3cyclictest3054338-21kworker/u8:0+events_unbound23:02:303
281851299141,11cyclictest490-21dbus-daemon23:05:012
281850999147,5cyclictest3054350-21cron22:55:001
281850999146,6cyclictest3132365-21cut00:10:141
281850999146,6cyclictest2996659-21cut22:00:121
281850999145,6cyclictest2907301-21cat20:35:011
281850999144,2cyclictest3021586-21ntpq22:20:201
281850999143,6cyclictest3010692-21memory22:10:201
281850999143,2cyclictest3146945-21ntpq00:20:211
281850999142,6cyclictest2932978-21munin-run21:00:001
281850699147,5cyclictest2922669-21latency_hist20:50:010
2818506991412,1cyclictest60350irq/132-enp0s29f1:rx-023:23:180
2818506991412,1cyclictest60350irq/132-enp0s29f1:rx-022:00:120
2818506991412,1cyclictest60350irq/132-enp0s29f1:rx-021:35:160
2818506991411,2cyclictest60350irq/132-enp0s29f1:rx-023:35:150
2818506991411,2cyclictest60350irq/132-enp0s29f1:rx-023:14:510
2818506991411,2cyclictest60350irq/132-enp0s29f1:rx-021:05:220
2818506991411,2cyclictest60350irq/132-enp0s29f1:rx-020:50:010
2818506991411,2cyclictest60350irq/132-enp0s29f1:rx-019:51:230
281851499139,3cyclictest3038458-21kworker/u8:3+flush-259:022:50:253
2818514991310,2cyclictest3048176-21kworker/u8:2+events_unbound23:30:523
281851299139,3cyclictest3048176-21kworker/u8:2+flush-259:023:40:252
281851299131,10cyclictest3011759-21awk22:15:002
281850999139,3cyclictest2860497-21apt-get19:50:111
281850999138,3cyclictest335557-21systemd-journal20:04:591
281850999138,3cyclictest3153660-21sort00:30:181
281850999138,3cyclictest3100783-21latency_hist23:40:001
281850999138,3cyclictest3074989-21sh23:15:011
281850999138,3cyclictest2921893-21ps20:45:221
281850999136,5cyclictest3116309-21turbostat23:55:001
281850999136,5cyclictest2964825-21cat21:30:001
281850999136,5cyclictest2839367-21latency_hist19:30:001
281850999136,4cyclictest509-21rs:main1
281850999134,5cyclictest3037361-21memory22:35:201
281850999133,2cyclictest2892115-21df20:20:131
281850999132,2cyclictest2974057-21memory21:35:211
2818509991310,2cyclictest2849859-21kworker/u8:1+flush-259:020:05:161
2818506991312,1cyclictest60350irq/132-enp0s29f1:rx-019:10:170
2818506991311,1cyclictest60350irq/132-enp0s29f1:rx-019:22:510
2818506991310,2cyclictest60350irq/132-enp0s29f1:rx-021:15:170
281851299128,3cyclictest2907207-21kworker/u8:2+events_unbound20:40:142
281850999126,5cyclictest3158676-21fschecks_time00:35:131
281850999126,5cyclictest2818513-21latency_hist19:09:591
281850999123,7cyclictest3138883-21kthreadcore00:15:161
281851299119,1cyclictest0-21swapper/200:00:002
281851299117,3cyclictest2948876-21kworker/u8:2+events_unbound21:30:152
281851299116,4cyclictest2988347-21cut21:50:192
281851299100,8cyclictest2974050-21cat21:35:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional