You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 21:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Sat Mar 14, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26946779911511,1145cyclictest2926620-21sleep10:05:013
72699270,12ntpd3048504-21ssh11:25:221
72699240,6ntpd2934097-21apt-get10:10:101
72699240,2ntpd0-21swapper/012:30:210
72699230,6ntpd2926908-21apt-get10:05:101
72699230,6ntpd2809621-21apt-get08:40:121
72699230,11ntpd3106221-21grep12:05:172
72699220,7ntpd3077478-21awk11:45:202
72699220,7ntpd2715798-21cat07:25:022
72699220,6ntpd3113570-21ntpq12:10:202
72699220,6ntpd3028244-21munin-run11:15:000
72699220,6ntpd3028244-21munin-run11:15:000
72699220,6ntpd2910295-21ntpq09:50:171
72699220,6ntpd2833425-21ntpq08:55:212
72699220,6ntpd2745961-21ntpq07:45:191
72699220,5ntpd3094001-21apt-get12:00:131
72699220,5ntpd2999573-21apt-get10:55:130
72699220,5ntpd2985103-21apt-get10:45:121
72699220,5ntpd2975741-21ntpq10:35:222
72699220,5ntpd2876285-21apt-get09:30:110
72699220,5ntpd2747211-21apt-get07:50:130
72699220,5ntpd2688645-21apt-get07:05:131
72699220,4ntpd2917577-21ssh09:55:211
72699210,7ntpd2739977-21/usr/sbin/munin07:40:252
72699210,6ntpd3141849-21grep12:30:171
72699210,6ntpd3077370-21ntpq11:45:180
72699210,6ntpd2968165-21ntpq10:30:212
72699210,6ntpd2960900-21ntpq10:25:202
72699210,6ntpd2932074-21ntpq10:05:200
72699210,6ntpd2890153-21ssh09:38:522
72699210,5ntpd3135301-21ntpq12:25:210
72699210,5ntpd3065100-21apt-get11:40:111
72699210,5ntpd3055639-21ntpq11:30:180
72699210,5ntpd2955820-21apt-get10:25:110
72699210,5ntpd2948596-21apt-get10:20:101
72699210,5ntpd2910404-21ntpq09:50:192
72699210,5ntpd2910153-21memory09:50:170
72699210,5ntpd2903180-21ntpq09:45:201
72699210,5ntpd2866662-21ntpq09:20:200
72699210,5ntpd2822086-21apt-get08:50:100
72699210,5ntpd2822086-21apt-get08:50:100
72699210,5ntpd2803366-21apt-get08:35:121
72699210,5ntpd2801974-21memory08:30:180
72699210,5ntpd2797302-21df08:30:122
72699210,5ntpd2721014-21ntp_states07:25:220
72699210,5ntpd2699958-21ntpq07:10:212
72699210,4ntpd3036014-21apt-get11:20:120
72699210,2ntpd0-21swapper/111:00:221
72699210,11ntpd2814696-21kworker/0:0+kacpi_notify09:45:500
72699200,7ntpd2933783-21cron10:10:002
72699200,7ntpd2875462-21chrt09:29:082
72699200,6ntpd3007017-21df_inode11:00:140
72699200,6ntpd2846745-21diskmemload12:37:211
72699200,5ntpd3099073-21ntpq12:00:212
72699200,5ntpd3026489-21ntp_states11:10:201
72699200,5ntpd3026489-21ntp_states11:10:191
72699200,5ntpd3020999-21munin-run11:10:001
72699200,5ntpd3006860-21apt-get11:00:122
72699200,5ntpd2963352-21hddtemp_smartct10:30:150
72699200,5ntpd2954263-21users10:20:230
72699200,5ntpd2873926-21ntpq09:25:190
72699200,5ntpd2845781-21ntpq09:05:200
72699200,5ntpd2841101-21hddtemp_smartct09:05:151
72699200,5ntpd2769886-21tr08:05:190
72699200,5ntpd2756762-21grep07:55:192
72699200,5ntpd2752317-21ntp_states07:50:221
72699200,5ntpd2741116-21diskstats07:45:140
72699200,5ntpd2727226-21ntp_states07:30:201
72699200,5ntpd2700002-21ntpq07:10:220
72699200,4ntpd2985266-21df_inode10:45:130
72699200,4ntpd2778449-21apt-get08:15:120
72699200,4ntpd2708177-21ntpq07:15:211
72699200,10ntpd2963017-21runrttasks10:30:111
72699190,8ntpd2853352-21taskset09:12:252
72699190,6ntpd3123859-21sed12:20:152
72699190,6ntpd2939554-21ls10:10:220
72699190,6ntpd2929673-21cat10:05:152
72699190,5ntpd3127990-21ntpq12:20:200
72699190,5ntpd3115668-21apt-get12:15:100
72699190,5ntpd2893696-21grep09:40:161
72699190,5ntpd2846745-21diskmemload12:09:010
72699190,5ntpd2827069-21ntpq08:50:182
72699190,5ntpd2827069-21ntpq08:50:182
72699190,5ntpd2808700-21awk08:35:240
72699190,5ntpd2764797-21ntpq08:00:191
72699190,5ntpd2733751-21find07:35:250
72699190,4ntpd3042469-21ssh11:23:192
72699190,4ntpd3041767-21ssh11:20:401
72699190,4ntpd3033627-21ntpq11:15:191
72699190,4ntpd2977374-21ssh10:39:310
72699190,4ntpd2861759-21df_inode09:20:131
72699190,4ntpd2854367-21apt-get09:15:112
72699190,4ntpd2847066-21apt-get09:10:101
72699190,4ntpd2834577-21apt-get09:00:111
72699190,4ntpd2820930-21ntpq08:45:191
72699190,4ntpd2728633-21fschecks_time07:35:161
72699190,3ntpd3028536-21apt-get11:15:102
72699180,8ntpd789-21mta-sts-daemon11:28:222
72699180,7ntpd789-21mta-sts-daemon09:15:300
72699180,7ntpd2846051-21sshd09:05:242
72699180,6ntpd3027814-21ssh11:13:332
72699180,6ntpd3027814-21ssh11:13:322
72699180,6ntpd2818677-21kthreadcore08:45:150
72699180,6ntpd2702792-21cut07:15:040
72699180,5ntpd3147701-21kthreadcore12:35:180
72699180,5ntpd3093968-21/usr/sbin/munin12:00:120
72699180,5ntpd2859437-21ntpq09:15:191
72699180,5ntpd2795995-21ntpq08:25:221
72699180,4ntpd3128046-21ntpq12:20:211
72699180,4ntpd3115936-21grep12:15:121
72699180,4ntpd3109437-21sed12:10:151
72699180,4ntpd3107944-21ssh12:09:181
72699180,4ntpd3099880-21kworker/u16:0-rpciod12:27:191
72699180,4ntpd3063695-21ssh11:36:051
72699180,4ntpd2995165-21tr10:50:160
72699180,4ntpd2977986-21df_inode10:40:110
72699180,4ntpd2976532-21ssh10:36:241
72699180,4ntpd2948446-21latency_hist10:20:002
72699180,4ntpd2924866-21ntp_states10:00:210
72699180,4ntpd2874619-21sh09:25:561
72699180,4ntpd2834826-21grep09:00:130
72699180,4ntpd2829593-21sed08:55:140
72699180,4ntpd2803517-21df08:35:132
72699180,4ntpd2777475-21smartctl08:10:240
72699180,4ntpd2714223-21/usr/sbin/munin07:20:191
72699180,3ntpd3091920-21ssh11:55:202
72699180,3ntpd3033572-21ssh11:15:180
72699180,3ntpd2999171-21ssh10:54:381
72699180,3ntpd2895835-21ld09:40:192
72699180,3ntpd2861606-21ssh09:20:112
72699180,2ntpd0-21swapper/210:00:212
269467799181,13cyclictest2953646-21chrt10:20:193
72699170,5ntpd2814986-21/usr/sbin/munin08:40:240
72699170,5ntpd0-21swapper/211:42:562
72699170,4ntpd3086279-21ssh11:54:260
72699170,4ntpd3084556-21ssh11:50:191
72699170,4ntpd3019242-21ld11:05:210
72699170,4ntpd2990925-21ssh10:45:532
72699170,4ntpd2984561-21ssh10:44:132
72699170,4ntpd2961547-21ssh10:25:381
72699170,4ntpd2896755-21sh09:41:330
72699170,4ntpd2778500-21awk08:15:132
72699170,4ntpd2739853-21awk07:40:240
72699170,4ntpd2691008-21kthreadcore07:05:170
72699170,3ntpd3091888-21ntpq11:55:180
72699170,3ntpd3063006-21ssh11:35:212
72699170,3ntpd3048414-21ssh11:25:200
72699170,3ntpd2977010-21kworker/u16:3-xprtiod11:05:102
72699170,3ntpd2925463-21ssh10:00:491
72699170,3ntpd2875722-21apt-get09:30:011
72699170,2ntpd0-21swapper/212:31:132
72699170,2ntpd0-21swapper/208:45:142
72699170,2ntpd0-21swapper/110:40:101
269467799176,7cyclictest31430882sleep312:30:313
269467799171,12cyclictest2715920-21taskset07:25:133
72699160,6ntpd804-21runrttasks07:36:332
72699160,4ntpd3136836-21ssh12:29:172
72699160,4ntpd3077434-21ssh11:45:201
72699160,4ntpd3065066-21/usr/sbin/munin11:40:130
72699160,4ntpd2946436-21ssh10:15:201
72699160,4ntpd2888629-21awk09:35:220
72699160,3ntpd3086904-21ssh11:55:101
72699160,3ntpd3056452-21ssh11:31:081
72699160,3ntpd3005417-21ssh10:55:571
72699160,3ntpd2997376-21ssh10:50:192
72699160,3ntpd2915255-21cut09:55:172
72699160,3ntpd2710820-21kthreadcore07:20:170
72699160,2ntpd3004464-21ssh10:55:192
72699160,2ntpd0-21swapper/212:35:122
72699160,2ntpd0-21swapper/211:30:202
72699160,2ntpd0-21swapper/208:15:012
72699160,2ntpd0-21swapper/207:45:212
72699160,2ntpd0-21swapper/207:05:232
72699160,2ntpd0-21swapper/108:50:161
72699160,2ntpd0-21swapper/108:50:161
72699160,2ntpd0-21swapper/108:30:111
72699160,2ntpd0-21swapper/107:10:191
72699160,2ntpd0-21swapper/008:20:220
269467799166,7cyclictest3028229-21turbostat11:15:003
269467799166,7cyclictest3028229-21turbostat11:14:593
269467799165,8cyclictest30736392sleep311:45:153
269467799165,8cyclictest3048490-21taskset11:25:223
269467799165,8cyclictest2746945-21turbostat07:54:553
269467799161,12cyclictest3064971-21taskset11:40:013
269467799161,12cyclictest2789809-21taskset08:20:223
269467799161,11cyclictest3035420-21turbostat11:20:003
269467799161,11cyclictest2982953-21taskset10:40:183
269467799161,11cyclictest28966292sleep309:41:093
269467799161,11cyclictest2883560-21taskset09:35:143
269467799161,11cyclictest2753476-21taskset07:55:143
269467799160,12cyclictest3129863-21turbostat12:24:593
72699150,3ntpd3120764-21ssh12:15:192
72699150,3ntpd3084614-21ssh11:50:202
72699150,3ntpd2954422-21ssh10:20:542
72699150,3ntpd2942695-21irqrtprio10:15:150
72699150,3ntpd2889986-21ssh09:38:171
72699150,3ntpd2834545-21/usr/sbin/munin09:00:172
72699150,2ntpd0-21swapper/209:46:322
72699150,2ntpd0-21swapper/209:30:212
72699150,2ntpd0-21swapper/208:40:212
72699150,2ntpd0-21swapper/208:20:232
72699150,2ntpd0-21swapper/207:15:212
72699150,2ntpd0-21swapper/108:15:211
72699150,2ntpd0-21swapper/108:10:201
72699150,2ntpd0-21swapper/108:05:221
72699150,2ntpd0-21swapper/107:55:231
72699150,2ntpd0-21swapper/011:35:210
72699150,2ntpd0-21swapper/009:10:190
72699150,2ntpd0-21swapper/008:25:130
72699150,1ntpd0-21swapper/207:30:112
72699150,1ntpd0-21swapper/207:25:132
72699150,1ntpd0-21swapper/108:55:101
269467799155,7cyclictest2900780-21taskset09:45:163
269467799155,7cyclictest28753572sleep309:28:463
269467799155,7cyclictest2728038-21taskset07:34:213
269467799153,8cyclictest31186252sleep312:15:163
269467799151,6cyclictest0-21swapper/308:55:213
2694677991513,1cyclictest0-21swapper/310:49:593
2694677991513,0cyclictest0-21swapper/311:09:053
2694677991512,1cyclictest0-21swapper/311:20:263
2694677991512,1cyclictest0-21swapper/308:35:163
2694677991512,1cyclictest0-21swapper/307:22:393
269467799151,11cyclictest2934394-21chrt10:10:133
269467799151,11cyclictest2882488-21chrt09:32:183
269467799151,10cyclictest3052427-21taskset11:30:153
72699140,2ntpd0-21swapper/208:25:212
72699140,2ntpd0-21swapper/208:05:212
72699140,2ntpd0-21swapper/207:50:182
72699140,2ntpd0-21swapper/007:55:210
72699140,1ntpd0-21swapper/208:00:102
72699140,1ntpd0-21swapper/012:10:100
269467799144,8cyclictest2759484-21turbostat08:04:543
269467799144,7cyclictest30858622sleep311:52:553
269467799144,7cyclictest29689352sleep310:31:093
269467799144,7cyclictest2771634-21taskset08:06:323
269467799141,9cyclictest2834727-21taskset09:00:123
269467799141,8cyclictest28543332sleep309:15:123
2694677991412,1cyclictest0-21swapper/308:15:043
2694677991411,1cyclictest0-21swapper/310:36:253
2694677991411,1cyclictest0-21swapper/309:20:173
2694677991411,1cyclictest0-21swapper/307:35:243
269467799141,10cyclictest3136933-21taskset12:29:383
269467799141,10cyclictest3114214-21taskset12:10:473
269467799141,10cyclictest3100256-21taskset12:02:413
269467799141,10cyclictest3092610-21taskset11:56:083
269467799141,10cyclictest3006145-21taskset10:58:423
269467799141,10cyclictest2998501-21taskset10:52:123
269467799141,10cyclictest2961796-21taskset10:26:323
269467799141,10cyclictest2928638-21taskset10:05:163
269467799141,10cyclictest2917633-21chrt09:55:223
269467799141,10cyclictest2905536-21taskset09:50:123
269467799141,10cyclictest2740958-21taskset07:45:113
161998140,1rtkit-daemon0-21swapper/008:00:280
72699130,2ntpd0-21swapper/007:30:170
72699130,1ntpd0-21swapper/108:20:021
72699130,1ntpd0-21swapper/107:25:191
269467799131,9cyclictest2701549-21taskset07:15:023
2694677991312,0cyclictest0-21swapper/309:12:033
269467799131,10cyclictest2947144-21chrt10:15:503
269467799130,11cyclictest2821607-21chrt08:47:303
269467799130,10cyclictest3149253-21chrt12:35:183
269467799130,10cyclictest3107538-21taskset12:07:493
269467799130,10cyclictest3006793-21taskset11:00:053
269467799130,10cyclictest2827355-21taskset08:50:233
269467799130,10cyclictest2827355-21taskset08:50:223
269467799130,10cyclictest2815162-21taskset08:40:243
269467799130,10cyclictest2802858-21taskset08:32:123
72699120,1ntpd0-21swapper/107:40:161
72699120,1ntpd0-21swapper/009:55:480
269467799122,7cyclictest2739832-21taskset07:40:233
2694677991210,1cyclictest0-21swapper/311:40:123
269467799120,9cyclictest2840771-21taskset09:05:043
269467799120,9cyclictest2772154-21taskset08:10:083
269467799120,9cyclictest2694823-21taskset07:10:023
269467799120,10cyclictest2796594-21chrt08:26:313
2693636290,5sleep30-21swapper/307:05:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional