You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 05:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Fri Mar 20, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27037129919800,1976cyclictest29447592sleep322:04:563
27037129919800,1976cyclictest29447592sleep322:04:563
27037129915101,1503cyclictest2790112-21sleep20:15:003
2703712993480,344cyclictest3105912-21turbostat23:54:553
2703712991614,1cyclictest0-21swapper/322:20:123
2703712991613,1cyclictest0-21swapper/321:38:263
270371299161,12cyclictest3159692-21turbostat00:24:593
270371299161,12cyclictest3113820-21taskset23:55:013
270371299161,12cyclictest2952708-21taskset22:10:023
270371299161,11cyclictest3134875-21taskset00:05:253
270371299161,11cyclictest3098253-21turbostat23:45:003
270371299161,11cyclictest3066744-21taskset23:22:333
270371299161,11cyclictest3052202-21turbostat23:15:003
270371299161,11cyclictest2936234-21taskset21:57:383
270371299161,11cyclictest2936234-21taskset21:57:373
270371299161,11cyclictest2897549-21taskset21:31:313
270371299161,10cyclictest2812050-21taskset20:30:183
270371299154,8cyclictest2770435-21taskset19:59:033
270371299151,9cyclictest2983464-21taskset22:30:113
2703712991512,1cyclictest0-21swapper/321:20:323
2703712991512,1cyclictest0-21swapper/321:06:193
2703712991512,1cyclictest0-21swapper/300:36:143
2703712991512,1cyclictest0-21swapper/300:04:303
270371299151,11cyclictest3074555-21taskset23:28:113
270371299151,11cyclictest2803331-21taskset20:25:023
270371299151,11cyclictest2802758-21taskset20:21:093
270371299151,11cyclictest2718721-21taskset19:19:573
270371299151,11cyclictest2710121-21taskset19:15:003
270371299151,10cyclictest3011654-21taskset22:45:193
270371299151,10cyclictest2975844-21taskset22:25:143
270371299151,10cyclictest2911947-21taskset21:40:223
270371299151,10cyclictest2834112-21taskset20:45:223
270371299151,10cyclictest2790359-21taskset20:15:033
270371299150,11cyclictest2866892-21taskset21:11:253
31168862140,1sleep00-21swapper/023:55:190
270371299141,9cyclictest2960909-21taskset22:15:143
270371299141,9cyclictest2849714-21taskset21:00:153
270371299141,9cyclictest2841751-21taskset20:55:133
270371299141,9cyclictest2743782-21taskset19:35:213
2703712991412,1cyclictest0-21swapper/323:00:343
2703712991412,0cyclictest0-21swapper/322:35:053
2703712991412,0cyclictest0-21swapper/320:36:273
2703712991411,1cyclictest0-21swapper/323:35:113
270371299141,10cyclictest3167615-21taskset00:30:083
270371299141,10cyclictest3159941-21taskset00:25:023
270371299141,10cyclictest3136888-21taskset00:10:023
270371299141,10cyclictest3105027-21taskset23:47:283
270371299141,10cyclictest3075461-21taskset23:30:023
270371299141,10cyclictest3037085-21taskset23:05:083
270371299141,10cyclictest3028892-21taskset22:59:233
270371299141,10cyclictest3021132-21taskset22:54:103
270371299141,10cyclictest3005894-21taskset22:44:183
270371299141,10cyclictest2951842-21taskset22:08:093
270371299141,10cyclictest2927920-21taskset21:50:403
270371299141,10cyclictest2920529-21taskset21:46:393
270371299141,10cyclictest2889552-21taskset21:25:303
270371299141,10cyclictest2875013-21taskset21:17:473
270371299141,10cyclictest2783247-21taskset20:05:563
270371299141,10cyclictest2776204-21taskset20:00:243
270371299141,10cyclictest2776204-21taskset20:00:243
270371299141,10cyclictest2757262-21taskset19:45:593
270371299141,10cyclictest2724876-21taskset19:20:253
270371299140,11cyclictest2751124-21taskset19:44:563
270371299140,11cyclictest2737705-21taskset19:30:243
270371299140,10cyclictest2840963-21taskset20:50:403
270371299140,10cyclictest2828413-21taskset20:42:423
27033602140,3sleep30-21swapper/319:07:113
29681572131,8sleep12968196-21apt-get22:20:111
270371299131,9cyclictest2763671-21taskset19:50:333
270371299131,8cyclictest31446452sleep300:15:133
270371299130,10cyclictest3058371-21taskset23:15:313
30742322121,4sleep13074238-21ssh23:27:181
28966182121,8sleep22896661-21ntpq21:30:232
27244212120,4sleep02724545-21sensors_temp19:20:240
270371299120,9cyclictest2725496-21taskset19:25:073
31821322110,8sleep02860397-21diskmemload00:38:280
31216992111,6sleep00-21swapper/000:00:130
30895722110,4sleep03089578-21ssh23:37:060
30528612111,8sleep23053003-21irqcore23:15:152
29162442111,7sleep12918087-21kthreadcore21:45:181
27026432110,6sleep22702687-21ntpq19:05:222
31738542100,7sleep13173860-21ssh00:31:351
30824932101,6sleep12860397-21diskmemload23:33:471
30577282101,6sleep03057774-21ntpq23:15:210
30424112101,6sleep03042449-21gcc23:05:230
30279282100,7sleep13027934-21ssh22:56:321
29293122100,4sleep02929318-21ssh21:54:510
28676782101,5sleep12867684-21ssh21:13:531
28595162100,6sleep12859549-21ntpq21:05:231
28542962101,4sleep22854328-21apt-get21:05:122
28225622101,5sleep12822559-21apt-get20:40:131
27838942101,5sleep12783896-21apt-get20:10:131
27578702101,5sleep02757872-21apt-get19:50:100
27502292100,1sleep10-21swapper/119:40:221
27386252100,7sleep22738438-21/usr/sbin/munin19:35:132
3175281291,4sleep13175310-21apt-get00:35:111
3083604290,6sleep13084166-21irqcore23:35:161
3037127291,4sleep13037124-21apt-get23:05:121
3034685291,5sleep03034732-21ntpq23:00:210
3014179291,4sleep13014174-21apt-get22:50:121
3012508291,4sleep03012514-21ssh22:46:000
2967188290,6sleep12967192-21ssh22:18:071
2936203290,1sleep00-21swapper/021:57:280
2936203290,1sleep00-21swapper/021:57:280
2881293291,5sleep12881336-21ntpq21:20:231
2847938291,4sleep12847971-21apt-get21:00:091
2840363291,4sleep02840407-21ntpq20:50:220
2834297291,5sleep12834570-21grep20:45:251
2833982291,5sleep02834025-21ntpq20:45:210
2822238290,6sleep12822308-21systemctl20:40:011
2808544290,6sleep02808595-21ntp_states20:25:240
2795647291,4sleep22795696-21ntpq20:15:242
2777373291,5sleep22777526-21df_inode20:05:132
2739893291,6sleep12741050-21cut19:35:151
2721684290,7sleep22723612-21grep19:20:172
2712540291,4sleep12712573-21apt-get19:15:111
3173032281,3sleep03173151-21python300:30:260
3157614281,4sleep03157644-21ntpq00:20:230
3140757281,4sleep23142023-21/usr/sbin/munin00:10:172
3113923281,4sleep20-21swapper/223:55:142
3103791280,5sleep23103840-21ntpq23:45:232
3079538281,4sleep23080612-21memory23:30:192
3060206281,3sleep10-21swapper/123:20:111
3050982281,4sleep03050986-21ssh23:11:230
3004012281,4sleep23004056-21ntpq22:40:222
2991156281,3sleep22991151-21apt-get22:35:122
2991114280,5sleep12991155-21ssh22:35:111
2983425281,4sleep22983457-21apt-get22:30:102
2965774281,4sleep22965802-21ntpq22:15:222
2953767281,4sleep12954367-21cut22:10:171
2936095280,5sleep12860397-21diskmemload21:57:091
2936095280,5sleep12860397-21diskmemload21:57:091
2906721281,4sleep12906718-21apt-get21:40:131
2890642280,1sleep10-21swapper/121:28:481
2882914285,1sleep20-21swapper/221:23:372
2867055280,2sleep22867059-21ssh21:12:012
2846748281,4sleep02846795-21ntp_states20:55:240
2834078280,4sleep22834111-21ntpq20:45:222
2822563281,4sleep22822716-21df_inode20:40:142
2799656281,4sleep02801641-21cut20:20:190
2785132280,5sleep22786220-21grep20:10:182
2777336281,4sleep02777369-21apt-get20:05:110
2766503280,5sleep12768401-21tr19:55:171
2760117281,4sleep22762040-21cut19:50:172
2744965281,4sleep02745115-21df_inode19:40:130
3173764270,4sleep23173746-40updatedb.plocat00:31:162
3159993271,2sleep00-21swapper/000:25:110
3151771270,4sleep02860397-21diskmemload00:19:270
3149889270,4sleep23149931-21ntpq00:15:242
3138960270,5sleep13140755-21cut00:10:161
3129273271,3sleep03129279-21ssh00:05:070
3112402270,5sleep03112408-21ssh23:51:350
3106237274,2sleep20-21swapper/223:50:132
3098582270,4sleep03098585-21/usr/sbin/munin23:45:130
3096230271,3sleep03096348-21python323:40:240
3092395271,3sleep13094166-21kthreadcore23:40:171
3084168271,2sleep20-21swapper/223:35:172
3076751270,4sleep03077777-21kthreadcore23:30:170
3074803270,1sleep00-21swapper/023:29:010
3066704270,1sleep00-21swapper/023:22:270
3061517271,4sleep23062440-21ssh23:20:162
3057776270,4sleep13057822-21ntpq23:15:221
3051502270,3sleep23051508-21ssh23:12:592
3029435271,3sleep23029472-21apt-get23:00:112
3027065271,3sleep03027098-21ntpq22:55:230
3023228271,3sleep20-21swapper/222:55:172
3006619270,4sleep13006822-21hddtemp_smartct22:45:141
3006113270,4sleep03006319-21date22:45:010
2996403271,3sleep02996453-21ntpq22:35:230
2989944270,2sleep10-21swapper/122:32:261
2981108272,3sleep12981142-21ntpq22:25:251
2976235270,4sleep22976891-21cut22:25:182
2976004270,4sleep02860397-21diskmemload22:25:160
2968199271,2sleep20-21swapper/222:20:122
2950589270,4sleep02950842-21awk22:05:250
2945058270,4sleep22945080-21apt-get22:05:122
2943712270,5sleep0974-21snmpd22:01:530
2943712270,5sleep0974-21snmpd22:01:530
2938886272,2sleep12940512-21kthreadcore22:00:181
2938886272,2sleep12940512-21kthreadcore22:00:181
2921982270,4sleep22921986-21ssh21:50:122
2921946270,4sleep10-21swapper/121:50:101
2919504270,4sleep02919548-21ntpq21:45:210
2904249270,4sleep02904298-21ntpq21:35:220
2898957270,4sleep12898961-21sh21:35:071
2881944271,3sleep02860397-21diskmemload21:20:340
2828592270,5sleep02828700-21latency_hist20:45:010
2821346271,3sleep02821388-21ntpq20:35:220
2808414271,3sleep22808502-21ntpq20:25:222
2771246270,4sleep02771914-21cut20:00:180
2771246270,4sleep02771914-21cut20:00:180
2771013270,4sleep22771040-21grep20:00:162
2771013270,4sleep22771040-21grep20:00:152
2697477270,3sleep10-21swapper/119:05:131
3182455261,2sleep20-21swapper/200:39:292
3165909260,1sleep10-21swapper/100:25:451
3161483260,3sleep23162692-21cut00:25:182
3152309260,3sleep13152341-21apt-get00:20:121
3151705262,2sleep1331ktimers/100:19:161
3136977260,3sleep03137129-21/usr/sbin/munin00:10:120
3127856260,1sleep20-21swapper/200:01:322
3122673260,3sleep13123387-21grep00:00:191
3120413260,1sleep10-21swapper/123:57:341
3106230260,2sleep10-21swapper/123:50:121
3103749261,2sleep10-21swapper/123:45:221
3096916260,1sleep20-21swapper/223:41:062
3069376261,2sleep20-21swapper/223:25:182
3044836260,3sleep13044986-21sh23:10:131
3043906263,1sleep20-21swapper/223:08:172
3029203260,3sleep13029177-21appstreamcli23:00:021
3021265260,3sleep20-21swapper/222:54:342
3020185260,1sleep00-21swapper/022:51:190
2999573260,4sleep13000401-21kthreadcore22:40:171
2959806260,3sleep02959812-21ssh22:14:010
2952897260,1sleep20-21swapper/222:10:142
2945265260,4sleep12945467-21ssh22:05:141
2913055260,1sleep00-21swapper/021:42:080
2899015260,3sleep22899026-21ssh21:35:112
2891423261,2sleep10-21swapper/121:30:141
2889340260,3sleep02889530-21users21:25:270
2875258261,3sleep12875262-21ssh21:18:311
2869869261,2sleep02871293-21kthreadcore21:15:170
2860701260,3sleep02860738-21apt-get21:10:110
2853148260,3sleep02853185-21ntpq21:00:200
2848902261,3sleep22849711-21kthreadcore21:00:152
2841602261,2sleep12841599-21apt-get20:55:131
2835613260,4sleep22836102-21cut20:50:162
2809355260,1sleep10-21swapper/120:28:461
2796887260,3sleep10-21swapper/120:20:111
2790408261,2sleep00-21swapper/020:15:130
2790056260,1sleep00-21swapper/020:14:440
2771916260,3sleep12772861-21cut20:00:191
2771916260,3sleep12772861-21cut20:00:181
2738474261,2sleep00-21swapper/019:35:100
2731622260,1sleep00-21swapper/019:28:410
2717679260,3sleep22717773-21ntpq19:15:202
2710174261,2sleep00-21swapper/019:15:020
2710072260,1sleep20-21swapper/219:14:232
2704078261,3sleep12704171-21fschecks_time19:10:131
2697441260,2sleep00-21swapper/019:05:120
3158332251,2sleep23158338-21ssh00:21:012
3134454250,2sleep13134505-21ssh00:05:201
3130823251,2sleep20-21swapper/200:05:172
3006409250,2sleep23006443-21apt-get22:45:112
2969663251,2sleep00-21swapper/022:20:180
2961847250,3sleep02962054-21ssh22:15:170
2943653250,1sleep20-21swapper/222:01:432
2943653250,1sleep20-21swapper/222:01:432
2936560250,3sleep22936566-21ssh21:58:352
2936560250,3sleep22936566-21ssh21:58:342
2914273250,3sleep22914279-21ssh21:45:032
2911897250,2sleep20-21swapper/221:40:222
2891417250,2sleep00-21swapper/021:30:130
2889806250,3sleep20-21swapper/221:26:142
2868381250,2sleep22868414-21apt-get21:15:112
2860089250,1sleep00-21swapper/021:06:140
2846835251,2sleep20-21swapper/220:55:262
2838568250,2sleep10-21swapper/120:50:191
2814980250,3sleep12809723-21/usr/sbin/munin20:30:261
2811182251,2sleep20-21swapper/220:30:192
2809756250,2sleep00-21swapper/020:30:130
2777372250,2sleep10-21swapper/120:05:121
2770228250,1sleep00-21swapper/019:56:250
2764513250,3sleep22764284-21/usr/sbin/munin19:55:142
2758999250,2sleep12760116-21kthreadcore19:50:161
2757406250,1sleep00-21swapper/019:47:510
2755969250,3sleep12751395-21/usr/sbin/munin19:45:191
2751430250,2sleep20-21swapper/219:45:112
2737485250,3sleep20-21swapper/219:30:242
2732480250,2sleep10-21swapper/119:30:151
2731991250,2sleep00-21swapper/019:30:100
2727385250,2sleep20-21swapper/219:25:192
2726485250,2sleep12727384-21kthreadcore19:25:181
2720467251,2sleep10-21swapper/119:20:171
2705345250,2sleep00-21swapper/019:10:160
2984945240,2sleep02986554-21kthreadcore22:30:170
2816101240,1sleep20-21swapper/220:35:052
2791393240,2sleep12792382-21grep20:15:191
2797346230,1sleep20-21swapper/220:20:162
2744927230,1sleep20-21swapper/219:40:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional