You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 18:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Aug 07, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2821700994943,4cyclictest3045455-21latency_hist10:45:011
2821706994842,4cyclictest2973075-21kworker/u8:1+flush-259:009:55:003
2821696994842,4cyclictest2962721-21latency_hist09:25:010
2821700994539,3cyclictest3103430-21kworker/u8:0+flush-259:011:50:001
2821702994439,4cyclictest3077530-21kworker/u8:4+flush-259:011:35:002
2821700994439,3cyclictest3154895-21kworker/u8:5+flush-259:012:35:001
2821706994135,4cyclictest2983384-21latency_hist09:45:013
2821700994035,4cyclictest3077530-21kworker/u8:4+flush-259:011:25:001
2821700993934,3cyclictest2868943-21apt-get07:55:131
2821696993935,3cyclictest2842705-21apt-get07:30:120
2821700993830,5cyclictest335557-21systemd-journal09:20:011
2821706993732,4cyclictest2899607-21kworker/u8:0+flush-259:008:40:003
2821702993725,7cyclictest3082793-21apt-get11:20:122
2821702993529,4cyclictest335557-21systemd-journal11:30:002
2821696993529,4cyclictest3098075-21latency_hist11:35:010
2821706993428,4cyclictest2899782-21latency_hist08:25:003
2821700993329,3cyclictest2853443-21kworker/u8:1+flush-259:007:55:001
2821706993227,3cyclictest3004120-21kworker/u8:3+flush-259:010:10:113
2821706993225,5cyclictest2832055-21latency_hist07:20:023
2821700993226,4cyclictest3060900-21latency_hist11:00:011
2821696993226,4cyclictest335557-21systemd-journal08:14:110
2821706993126,3cyclictest3045475-21kworker/u8:1+flush-259:011:00:003
2821702993125,4cyclictest2873032-21ntpq07:55:232
2821700993127,3cyclictest2910831-21apt-get08:35:121
2821706993027,2cyclictest2853443-21kworker/u8:1+flush-259:009:15:223
2821702993026,3cyclictest3019853-21apt-get10:20:112
2821700993024,4cyclictest335557-21systemd-journal09:26:121
2821706992924,3cyclictest3077055-21cp11:15:013
2821700992924,3cyclictest2889691-21kworker/u8:3+flush-259:008:45:001
2821706992822,4cyclictest3040282-21latency_hist10:40:013
2821706992822,4cyclictest2868669-21latency_hist07:55:003
2821702992824,3cyclictest2936898-21kworker/u8:0+flush-259:009:35:262
2821702992822,4cyclictest2967901-21latency_hist09:30:012
2821700992822,4cyclictest3019267-21kworker/u8:2+flush-259:010:50:001
2821700992822,4cyclictest3019267-21kworker/u8:2+flush-259:010:50:001
2821700992822,4cyclictest2900044-21apt-get08:25:131
2821700992822,4cyclictest2900044-21apt-get08:25:121
2821700992820,6cyclictest2884252-21awk08:10:001
2821696992824,3cyclictest3118983-21apt-get11:55:150
2821706992722,3cyclictest509-21rs:main3
2821700992722,3cyclictest3082527-21latency_hist11:20:011
2821700992721,4cyclictest2978209-21latency_hist09:40:011
2821696992722,3cyclictest509-21rs:main0
2821696992720,5cyclictest2837241-21latency_hist07:25:020
2821706992621,4cyclictest4003230-21kworker/u8:0+flush-259:007:25:173
2821706992620,4cyclictest2994018-21apt-get09:55:123
2821700992623,2cyclictest3103430-21kworker/u8:0+flush-259:011:50:241
2821700992521,3cyclictest3019267-21kworker/u8:2+flush-259:010:35:001
2821700992521,3cyclictest2936898-21kworker/u8:0+flush-259:009:10:161
2821700992520,4cyclictest2778135-21kworker/u8:1+flush-259:007:20:141
2821700992520,3cyclictest3124104-21/usr/sbin/munin12:00:211
2821700992518,5cyclictest2863515-21latency_hist07:50:001
2821696992520,3cyclictest2853353-21gpgv07:40:010
2821696992520,3cyclictest2852946-21base6407:40:000
2821706992417,5cyclictest2847586-21latency_hist07:35:013
2821700992420,3cyclictest3004120-21kworker/u8:3+flush-259:012:10:011
2821700992419,4cyclictest3055784-21kworker/u8:0+flush-259:011:15:001
282170099240,22cyclictest1-21systemd10:15:001
2821696992419,3cyclictest3165271-21latency_hist12:40:000
2821696992418,4cyclictest2983650-21apt-get09:45:120
2821706992318,3cyclictest3103430-21kworker/u8:0+flush-259:011:50:163
2821700992320,2cyclictest3087764-21kworker/u8:1+events_unbound11:25:231
2821700992319,3cyclictest3149718-21kworker/u8:1+flush-259:012:25:211
2821700992319,2cyclictest2837506-21apt-get07:25:131
2821700992318,3cyclictest3004120-21kworker/u8:3+events_unbound10:25:181
282169699238,10cyclictest2967077-21ntpq09:25:220
2821706992217,3cyclictest335557-21systemd-journal11:24:123
2821706992217,3cyclictest3004120-21kworker/u8:3+flush-259:010:25:243
2821702992218,3cyclictest2915956-21apt-get08:40:102
2821700992218,3cyclictest2837259-21kworker/u8:2+flush-259:007:35:161
2821700992216,4cyclictest2931989-21apt-get08:55:111
2821700992216,4cyclictest2889691-21kworker/u8:3+flush-259:008:25:001
2821696992217,4cyclictest335557-21systemd-journal10:35:110
2821706992118,2cyclictest2853443-21kworker/u8:1+flush-259:009:10:253
2821706992117,2cyclictest0-21swapper/307:45:003
2821702992117,3cyclictest3004120-21kworker/u8:3+flush-259:012:10:162
2821702992116,4cyclictest3123872-21latency_hist12:00:012
2821702992116,3cyclictest2827099-21/usr/sbin/munin07:15:152
2821702992115,4cyclictest2915693-21latency_hist08:40:012
2821702992112,7cyclictest0-21swapper/207:35:162
2821700992117,3cyclictest4003230-21kworker/u8:0+events_unbound08:00:001
2821700992117,3cyclictest3103430-21kworker/u8:0+flush-259:012:20:281
2821700992117,3cyclictest3004120-21kworker/u8:3+flush-259:010:50:181
2821700992117,2cyclictest2973075-21kworker/u8:1+events_unbound09:50:241
282169699215,11cyclictest2870200-21grep07:55:180
282169699214,6cyclictest2880668-21grep08:05:220
2821706992016,3cyclictest3061587-21apt-get11:00:113
2821706992016,3cyclictest2999194-21apt-get10:00:123
2821702992016,3cyclictest2936898-21kworker/u8:0+flush-259:009:55:152
2821702992014,4cyclictest3144514-21latency_hist12:20:002
2821700992014,4cyclictest4003230-21kworker/u8:0+flush-259:007:30:151
2821700992013,5cyclictest2826859-21latency_hist07:15:021
282169699204,5cyclictest2995035-21ps09:55:160
282170299199,8cyclictest0-21swapper/211:00:012
282170299191,5cyclictest335557-21systemd-journal10:35:002
2821702991915,3cyclictest2973075-21kworker/u8:1+flush-259:010:05:172
2821702991914,4cyclictest335557-21systemd-journal09:04:352
2821700991916,2cyclictest2926082-21latency_hist08:50:011
2821700991914,4cyclictest3103430-21kworker/u8:0+flush-259:011:55:211
2821700991914,4cyclictest2853443-21kworker/u8:1+flush-259:009:05:161
2821700991914,3cyclictest2853414-21cat07:40:011
2821700991913,4cyclictest335557-21systemd-journal12:10:131
282169699194,4cyclictest2935986-21ld08:55:200
282169699193,6cyclictest2894718-21sort08:20:010
2821696991916,2cyclictest2983384-21sh09:45:010
2821696991915,2cyclictest3024754-21sh10:25:000
2821706991814,3cyclictest3139352-21kworker/u8:4+flush-259:012:15:293
282170299187,9cyclictest0-21swapper/208:50:132
282170299184,4cyclictest335557-21systemd-journal09:31:112
282170299181,6cyclictest3014410-21awk10:15:002
2821702991813,3cyclictest3076867-21apt-get11:15:022
2821702991812,4cyclictest2910556-21cat08:35:012
2821700991814,3cyclictest3061555-21kworker/u8:4+flush-259:011:00:191
2821700991814,3cyclictest2853443-21kworker/u8:1+events_unbound08:15:121
2821700991814,3cyclictest2853443-21kworker/u8:1+events_unbound08:15:011
2821700991813,3cyclictest2853443-21kworker/u8:1+events_unbound09:20:221
2821700991812,4cyclictest335557-21systemd-journal11:10:001
2821700991812,4cyclictest335557-21systemd-journal10:21:111
282169699183,5cyclictest3103283-21latency_hist11:40:010
282169699183,5cyclictest2973054-21latency_hist09:35:010
282169699182,6cyclictest3125555-21cut12:00:170
2821696991813,3cyclictest2957525-21latency_hist09:20:000
2821706991715,1cyclictest3009268-21cron10:10:003
2821706991715,1cyclictest2910144-21sh08:35:003
2821706991712,3cyclictest3087764-21kworker/u8:1+flush-259:012:00:013
2821706991712,3cyclictest2973295-21/usr/sbin/munin09:35:153
2821706991712,3cyclictest2835818-21kthreadcore07:20:183
2821706991710,5cyclictest3091989-21ntpq11:25:213
282170299177,9cyclictest0-21swapper/209:15:122
282170299175,1cyclictest3014971-21gltestperf10:15:162
2821702991715,1cyclictest2945311-21kthreadcore09:05:162
2821702991712,4cyclictest3004120-21kworker/u8:3+flush-259:011:45:172
2821702991710,6cyclictest335557-21systemd-journal08:04:102
282170299170,4cyclictest3025448-21sed10:25:172
2821700991712,3cyclictest3004325-21/usr/sbin/munin10:05:211
2821700991712,3cyclictest2937121-21apt-get09:00:111
2821700991711,4cyclictest3139352-21kworker/u8:4+flush-259:012:17:401
2821700991711,4cyclictest2993993-21/usr/sbin/munin09:55:201
282169699174,8cyclictest2867822-21ntpq07:50:210
282169699174,4cyclictest3070096-21cut11:05:200
282169699173,4cyclictest2937517-21cat09:00:150
282169699172,6cyclictest3089956-21grep11:25:180
282169699172,5cyclictest2903671-21grep08:25:190
282169699172,5cyclictest2903671-21grep08:25:180
2821696991714,2cyclictest60350irq/132-enp0s29f1:rx-011:10:160
2821696991711,5cyclictest2858629-21apt-get07:45:100
2821706991612,3cyclictest3077537-21/usr/sbin/munin11:15:213
2821706991611,3cyclictest2941975-21journal-offline09:04:343
282170299169,5cyclictest3076869-21latency_hist11:15:012
282170299165,1cyclictest0-21swapper/208:15:002
282170299161,3cyclictest3149697-21munin-run12:24:592
2821702991610,5cyclictest335557-21systemd-journal07:35:002
2821700991612,3cyclictest3139352-21kworker/u8:4+flush-259:012:35:171
2821700991612,3cyclictest3004120-21kworker/u8:3+events_unbound11:35:221
282169699169,5cyclictest2821697-21latency_hist07:10:000
282169699167,4cyclictest2895063-21df_inode08:20:130
282169699164,2cyclictest3086828-21ntpq11:20:210
282169699164,2cyclictest2825999-21ntpq07:10:210
282169699163,4cyclictest2875063-21irqcore08:00:150
282169699162,5cyclictest3116569-21cut11:50:180
282169699162,5cyclictest3106879-21cut11:40:180
2821696991614,1cyclictest60350irq/132-enp0s29f1:rx-010:05:140
2821696991613,2cyclictest0-21swapper/012:35:000
2821696991612,3cyclictest2952371-21cron09:15:010
282169699160,6cyclictest2930444-21collect208:50:210
2821706991512,2cyclictest3035118-21turbostat.cron10:35:003
282170299155,1cyclictest0-21swapper/210:00:172
282170299155,1cyclictest0-21swapper/208:22:122
282170299151,5cyclictest2862596-21ntpq07:45:202
2821702991511,3cyclictest3061555-21kworker/u8:4+flush-259:011:00:102
2821702991511,3cyclictest2853443-21kworker/u8:1+flush-259:008:55:152
282170099153,10cyclictest2832069-21idleruntime-cro07:20:001
2821700991511,3cyclictest3004120-21kworker/u8:3+flush-259:010:40:001
2821700991511,3cyclictest3004120-21kworker/u8:3+events_unbound11:40:141
282169699154,7cyclictest3034263-21ntpq10:30:210
282169699154,3cyclictest3148822-21ntpq12:20:220
282169699153,2cyclictest2925157-21ntpq08:45:190
282169699152,2cyclictest3029014-21ntpq10:25:210
282169699151,9cyclictest3056308-21fw_conntrack10:55:140
282169699151,4cyclictest3000175-21irqstats10:00:170
2821696991513,1cyclictest60350irq/132-enp0s29f1:rx-012:10:130
2821696991513,1cyclictest60350irq/132-enp0s29f1:rx-010:50:180
2821696991513,1cyclictest60350irq/132-enp0s29f1:rx-010:45:140
2821696991513,1cyclictest60350irq/132-enp0s29f1:rx-010:45:140
2821696991513,1cyclictest60350irq/132-enp0s29f1:rx-010:15:280
2821696991513,1cyclictest60350irq/132-enp0s29f1:rx-009:35:160
2821696991513,1cyclictest60350irq/132-enp0s29f1:rx-007:25:180
2821696991513,1cyclictest60350irq/132-enp0s29f1:rx-007:17:000
2821696991512,2cyclictest60350irq/132-enp0s29f1:rx-012:20:000
2821696991512,2cyclictest60350irq/132-enp0s29f1:rx-012:05:130
2821696991512,2cyclictest1-21systemd08:44:110
282170699146,6cyclictest335557-21systemd-journal09:50:003
2821706991410,3cyclictest3103430-21kworker/u8:0+flush-259:012:10:283
2821706991410,3cyclictest2879375-21apt-get08:05:153
282170299146,1cyclictest0-21swapper/212:35:102
282170299141,5cyclictest3054873-21ntpq10:50:202
2821702991411,2cyclictest3129714-21irqcore12:05:172
2821702991410,3cyclictest500-21systemd-logind10:40:002
2821702991410,3cyclictest2853443-21kworker/u8:1+flush-259:008:25:312
2821702991410,3cyclictest2853443-21kworker/u8:1+flush-259:008:25:302
2821702991410,3cyclictest2853443-21kworker/u8:1+events_unbound09:10:172
282170299140,6cyclictest2992888-21ntpq09:50:242
282170099149,3cyclictest2973054-21latency_hist09:35:001
2821700991410,3cyclictest2927371-21tr08:50:161
282169699147,5cyclictest3109712-21tr11:45:180
282169699146,6cyclictest2947247-21turbostat.cron09:10:010
282169699144,2cyclictest3081570-21ntpq11:15:200
282169699143,2cyclictest3065640-21ntpq11:00:190
282169699142,7cyclictest3040831-21fw_forwarded_lo10:40:160
2821696991412,1cyclictest60350irq/132-enp0s29f1:rx-012:25:170
2821696991411,2cyclictest0-21swapper/010:14:590
282170699138,3cyclictest2936898-21kworker/u8:0+flush-259:009:25:173
2821706991311,1cyclictest0-21swapper/312:40:003
2821706991310,2cyclictest2900216-21fschecks_count08:25:153
2821706991310,2cyclictest2900216-21fschecks_count08:25:143
282170299135,2cyclictest401ktimers/207:20:202
282170299132,1cyclictest2881272-21grep08:05:212
282170099139,3cyclictest2936898-21kworker/u8:0+events_unbound09:40:131
282170099139,2cyclictest2999452-21fschecks_time10:00:141
2821700991311,1cyclictest0-21swapper/108:35:011
282169699138,4cyclictest2914800-21ntpq08:35:220
282170699129,2cyclictest2826381-21unixbench_multi07:10:243
282170699129,2cyclictest0-21swapper/310:45:003
282170699121,8cyclictest2894641-21latency_hist08:20:013
2821706991210,1cyclictest0-21swapper/311:50:003
282170299129,1cyclictest0-21swapper/207:25:222
282170299128,2cyclictest0-21swapper/211:50:242
282170699119,1cyclictest0-21swapper/311:05:183
282170699119,1cyclictest0-21swapper/308:40:153
282170699118,2cyclictest2942717-21irqcore09:05:153
282170699118,1cyclictest0-21swapper/310:15:203
282170699117,3cyclictest3019267-21kworker/u8:2+flush-259:010:45:103
282170699117,3cyclictest3019267-21kworker/u8:2+flush-259:010:45:103
282170699117,2cyclictest3150382-21irqcore12:25:163
282170699116,4cyclictest3103600-21tr11:40:123
282170699110,10cyclictest3024791-21munin-run10:25:003
282170299118,2cyclictest3124196-21cpuspeed_turbos12:00:122
282170699101,1cyclictest0-21swapper/308:15:003
282170299108,1cyclictest0-21swapper/212:35:002
282170299105,3cyclictest2983377-21basename09:45:012
282170099106,3cyclictest3055784-21kworker/u8:0+flush-259:011:30:061
28217069995,3cyclictest3099128-21cut11:35:163
28217029997,1cyclictest0-21swapper/210:45:132
28217029997,1cyclictest0-21swapper/210:45:132
28217029995,2cyclictest0-21swapper/208:50:002
28217029985,2cyclictest2822339-21irqcore07:10:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional