You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 23:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Wed Nov 26, 2025 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
285007021680,3sleep3471rcuc/308:21:183
2776616996457,4cyclictest2848261-21latency_hist08:20:011
2776612996455,6cyclictest2872829-21kworker/u8:1+flush-8:008:56:280
2776616996357,4cyclictest2426287-21kworker/u8:3+events_unbound07:31:221
2776616996256,4cyclictest2927779-21kworker/u8:1+events_unbound10:16:221
2776616996254,6cyclictest2858451-21kworker/u8:4+flush-8:010:11:281
2776616996155,4cyclictest2858451-21kworker/u8:4+events_unbound09:46:281
2776616996152,7cyclictest2843270-21kworker/u8:3+flush-8:009:56:271
2776612996150,8cyclictest2911799-21ntpq09:21:210
2776612996149,9cyclictest2991182-21ntpq10:41:240
2776616996054,4cyclictest2872829-21kworker/u8:1+events_unbound08:46:291
2776616995952,5cyclictest3046669-21kworker/u8:0+flush-8:012:00:001
2776616995952,5cyclictest3046669-21kworker/u8:0+flush-8:012:00:001
2776616995852,4cyclictest3061829-21kworker/u8:2+flush-8:012:16:271
2776616995752,3cyclictest2843270-21kworker/u8:3+flush-8:008:41:291
2776616995650,4cyclictest2927779-21kworker/u8:1+events_unbound10:01:251
2776616995650,4cyclictest2872829-21kworker/u8:1+events_unbound08:51:241
2776616995650,4cyclictest2858451-21kworker/u8:4+flush-8:010:26:271
2776616995551,3cyclictest2426287-21kworker/u8:3+events_unbound07:15:021
2776616995549,4cyclictest2843270-21kworker/u8:3+flush-8:009:41:241
2776616995549,4cyclictest2843270-21kworker/u8:3+flush-8:009:41:241
2776616995549,3cyclictest2982352-21kworker/u8:0+events_unbound11:20:011
2776616995548,5cyclictest2858451-21kworker/u8:4+events_unbound09:06:101
2776616995548,5cyclictest2771521-21kworker/u8:2+events_unbound07:11:131
2776616995544,8cyclictest2827626-21ntpq07:56:221
28672472540,2sleep30-21swapper/308:36:193
2776616995444,7cyclictest3090602-21ntpq12:21:211
2776612995443,8cyclictest2817520-21ntpq07:46:230
2776616995347,4cyclictest2843270-21kworker/u8:3+events_unbound09:36:231
2776616995346,5cyclictest2843270-21kworker/u8:3+events_unbound09:21:121
2776616995344,7cyclictest2858451-21kworker/u8:4+flush-8:009:01:221
2776612995335,15cyclictest2897013-21ntpq09:06:220
2776616995246,5cyclictest2818574-21kworker/u8:0+flush-8:008:31:221
2776612995241,9cyclictest2787482-21ntpq07:16:240
2776616995146,3cyclictest2858451-21kworker/u8:4+events_unbound09:31:281
2776616995145,4cyclictest2982352-21kworker/u8:0+flush-8:011:06:091
2776616995145,4cyclictest2858451-21kworker/u8:4+flush-8:010:56:201
2776612995127,21cyclictest3011859-21latency_hist11:05:010
29615952500,3sleep20-21swapper/210:11:242
2776616995043,6cyclictest3046669-21kworker/u8:0+flush-8:011:41:241
2776612995029,18cyclictest2937736-21cp09:50:010
2776616994843,4cyclictest2858451-21kworker/u8:4+events_unbound09:26:151
2776616994843,3cyclictest2858451-21kworker/u8:4+flush-8:011:21:321
2776616994842,4cyclictest2858451-21kworker/u8:4+events_unbound09:16:131
2776616994841,5cyclictest2771521-21kworker/u8:2+flush-8:007:41:221
2776616994840,6cyclictest2858451-21kworker/u8:4+flush-8:011:51:241
2776616994838,3cyclictest2927779-21kworker/u8:1+events_unbound10:31:271
2776612994839,7cyclictest2906828-21ntpq09:16:220
2776612994837,8cyclictest2926701-21ntpq09:36:210
2776612994816,2cyclictest831-21mta-sts-daemon08:07:300
28166262470,1sleep3586-21kworker/3:2-events07:46:193
2776616994742,3cyclictest2843270-21kworker/u8:3+events_unbound08:21:141
2776616994742,3cyclictest2771521-21kworker/u8:2+flush-8:008:11:211
2776616994742,3cyclictest2771521-21kworker/u8:2+flush-8:007:51:521
2776616994740,5cyclictest2843270-21kworker/u8:3+flush-8:008:26:231
2776616994738,7cyclictest2858451-21kworker/u8:4+events_unbound10:21:291
2776616994736,8cyclictest2804011-21diskstats07:36:121
2776616994736,8cyclictest2804011-21diskstats07:36:121
29027682460,2sleep3471rcuc/309:14:593
2776616994638,5cyclictest2982352-21kworker/u8:0+flush-8:011:11:241
2776616994538,5cyclictest2426287-21kworker/u8:3+events_unbound07:46:121
2776616994533,6cyclictest2982352-21kworker/u8:0+events_unbound11:01:271
2776612994534,8cyclictest3065866-21ntpq11:56:210
2776612994534,8cyclictest3065866-21ntpq11:56:200
2776612994528,14cyclictest2898862-21irqrtprio09:11:180
2776617994427,15cyclictest2883346-21aten2_r5power_c08:56:102
2776616994439,3cyclictest2858451-21kworker/u8:4+events_unbound10:36:111
2776612994420,21cyclictest3095604-21ntpq12:26:220
2776616994338,4cyclictest2996562-21kworker/u8:1+events_unbound10:50:011
2776616994336,5cyclictest1940096-21kworker/u8:0+events_unbound07:21:151
2776616994334,6cyclictest2956677-21ntpq10:06:251
2776612994333,7cyclictest2781465-21latency_hist07:15:020
2776612994326,15cyclictest3051003-21needreboot11:41:210
2776612994235,5cyclictest2858451-21kworker/u8:4+flush-8:011:21:150
2776612994218,8cyclictest2832598-21ntpq08:01:230
2776616994137,3cyclictest3061829-21kworker/u8:2+flush-8:012:31:221
2776616994135,4cyclictest2872829-21kworker/u8:1+events_unbound08:56:291
2776616994135,4cyclictest1940096-21kworker/u8:0+flush-8:007:26:201
2776616994132,6cyclictest3080737-21ntpq12:11:221
27717842414,11sleep10-21swapper/107:05:451
2776617994024,14cyclictest3082031-21aten2_r5power_v12:16:122
2776617994022,16cyclictest2966962-21unixbench_multi10:16:292
2776616994034,4cyclictest3041657-21kworker/u8:1+events_unbound11:36:241
2776616994033,5cyclictest2771521-21kworker/u8:2+flush-8:008:01:261
2776612994031,6cyclictest3106516-21latency_hist12:40:010
277661299402,36cyclictest0-21swapper/011:46:270
2776612994023,15cyclictest2873095-21munin-run08:45:000
2776612994018,20cyclictest2806097-21kthreadcore07:36:180
2776612994018,20cyclictest2806097-21kthreadcore07:36:180
2776617993920,17cyclictest2972244-21cron10:25:002
2776616993932,5cyclictest2858451-21kworker/u8:4+flush-8:011:26:141
2776612993923,14cyclictest2952511-21cron10:05:000
2776612993921,16cyclictest2933792-21kthreadcore09:46:190
2776612993920,17cyclictest18912-21cron07:30:010
2776616993832,4cyclictest2982352-21kworker/u8:0+flush-8:011:31:091
2776612993828,8cyclictest2877194-21ntpq08:46:210
2776612993827,8cyclictest2976334-21ntpq10:26:220
2776612993819,17cyclictest0-21swapper/007:31:230
2776612993818,2cyclictest0-21swapper/011:10:010
2776612993818,18cyclictest3082451-21sort12:16:170
2776612993817,2cyclictest0-21swapper/008:11:160
277533123827,6sleep02775486-21grep07:06:200
2776617993723,12cyclictest2987705-21cpuspeed_turbos10:41:142
2776616993733,3cyclictest2843270-21kworker/u8:3+flush-8:008:36:211
2776616993732,4cyclictest2858451-21kworker/u8:4+events_unbound09:11:181
2776616993731,4cyclictest2982352-21kworker/u8:0+events_unbound10:51:131
2776616993728,6cyclictest282-21systemd-journal09:52:441
277661299372,33cyclictest0-21swapper/010:16:270
2776612993720,2cyclictest0-21swapper/010:35:000
2776612993717,2cyclictest0-21swapper/007:55:010
2776617993622,12cyclictest3067311-21cpuspeed_turbos12:01:112
2776617993620,14cyclictest2892512-21unixbench_singl09:01:272
2776617993619,15cyclictest2933220-21fschecks_time09:46:162
2776616993629,5cyclictest2858451-21kworker/u8:4+flush-8:012:01:121
2776616993627,6cyclictest3105664-21ntpq12:36:211
2776612993630,4cyclictest2891677-21kthreadcore09:01:180
277661299362,32cyclictest0-21swapper/007:41:270
2776612993618,1cyclictest0-21swapper/010:11:090
2776612993616,3cyclictest2922193-21unixbench_multi09:31:340
2776617993520,13cyclictest3026286-21unixbench_multi11:16:282
2776617993520,13cyclictest2992618-21cpuspeed_turbos10:46:112
277661299353,8cyclictest584-21snmpd08:36:080
2776612993525,7cyclictest2931661-21ntpq09:41:280
2776612993525,7cyclictest2931661-21ntpq09:41:280
2776612993517,2cyclictest0-21swapper/010:55:010
2776612993517,2cyclictest0-21swapper/008:31:180
2776617993423,10cyclictest2776606-21cyclictest07:15:012
2776617993418,14cyclictest3056495-21unixbench_multi11:46:292
2776617993418,14cyclictest2982726-21fschecks_count10:36:132
2776616993429,3cyclictest2771521-21kworker/u8:2+events_unbound08:06:211
2776612993429,3cyclictest2946630-21needreboot09:56:200
2776612993417,2cyclictest0-21swapper/011:16:190
2776612993415,3cyclictest0-21swapper/008:16:220
2776617993319,12cyclictest2923125-21cpuspeed_turbos09:36:112
2776612993324,6cyclictest2793310-21latency_hist07:25:010
2776612993316,14cyclictest282-21systemd-journal12:02:440
2776612993316,13cyclictest0-21swapper/010:46:090
277661799323,21cyclictest2818682-21apt-get07:51:102
2776617993223,7cyclictest282-21systemd-journal07:45:002
2776617993218,12cyclictest2908141-21aten2_r5power_p09:21:102
2776617993216,14cyclictest2863800-21fschecks_count08:36:112
2776617993215,14cyclictest0-21swapper/208:00:012
277661299322,9cyclictest584-21snmpd12:21:100
2776612993226,5cyclictest2771521-21kworker/u8:2+flush-8:007:55:160
2776612993225,5cyclictest3076266-21grep12:06:300
2776612993210,4cyclictest3061992-21latency_hist11:55:010
2776617993116,13cyclictest2897442-21unixbench_multi09:06:272
2776617993115,14cyclictest0-21swapper/208:06:232
277661799311,11cyclictest3072051-21apt-get12:06:102
277661799310,20cyclictest2838719-21aten2_r5power_c08:11:092
2776616993126,3cyclictest2858451-21kworker/u8:4+events_unbound11:46:181
2776612993126,3cyclictest2882067-21needreboot08:51:190
2776612993113,3cyclictest0-21swapper/011:31:170
277661799302,23cyclictest2868492-21apt-get08:41:122
277661799300,10cyclictest30372272date11:30:012
2776612993020,7cyclictest3020909-21ntpq11:11:230
30372262290,4sleep00-21swapper/011:30:010
277661799292,23cyclictest3100461-21ntpq12:31:202
277661799292,20cyclictest2873427-21apt-get08:46:092
277661799292,10cyclictest3001122-21ntpq10:51:232
277661799291,8cyclictest2953226-21/usr/sbin/munin10:06:132
2776617992917,10cyclictest2878645-21fschecks_count08:51:112
2776617992915,12cyclictest2804077-21fschecks_time07:36:132
2776617992915,12cyclictest2804077-21fschecks_time07:36:122
2776617992915,12cyclictest0-21swapper/210:26:272
2776617992913,14cyclictest2977817-21fschecks_count10:31:142
277661799286,13cyclictest0-21swapper/208:21:192
2776617992824,2cyclictest2898203-21aten2_r5power_e09:11:122
2776617992821,6cyclictest18912-21cron11:05:002
2776617992819,7cyclictest3002574-21fschecks_count10:56:122
277661799281,8cyclictest3102289-21/usr/sbin/munin12:36:132
2776617992810,16cyclictest3047405-21aten2_r5power_v11:41:112
2776617992810,16cyclictest0-21swapper/208:31:262
2776616992820,6cyclictest2843270-21kworker/u8:3+events_unbound10:41:241
2776612992822,4cyclictest2857852-21unixbench_multi08:26:290
277661799278,17cyclictest2786512-21tr07:16:212
2776617992723,2cyclictest2942995-21aten2_r5power_c09:56:102
277661799272,21cyclictest2941856-21ntpq09:51:252
2776617992721,4cyclictest3062404-21fschecks_count11:56:132
2776617992721,4cyclictest3062404-21fschecks_count11:56:132
2776617992721,4cyclictest2903415-21fschecks_time09:16:142
277661799271,9cyclictest3046082-21ntpq11:36:222
277661799271,8cyclictest3090497-21/usr/sbin/munin12:21:202
2776617992718,7cyclictest3077298-21fschecks_time12:11:132
277661799271,5cyclictest3016411-21unixbench_multi11:06:282
2776617992711,13cyclictest0-21swapper/207:46:272
2776612992722,3cyclictest0-21swapper/012:35:010
2776617992623,2cyclictest2799107-21fschecks_count07:31:132
277661799261,9cyclictest2921699-21ntpq09:31:272
277661799261,8cyclictest2928304-21/usr/sbin/munin09:41:212
277661799261,8cyclictest2928304-21/usr/sbin/munin09:41:212
277661799260,8cyclictest3019618-21cut11:11:192
277661799260,8cyclictest2829236-21/usr/sbin/munin08:01:142
2776612992621,3cyclictest3080669-21needreboot12:11:200
2776612992614,8cyclictest2917636-21latency_hist09:30:010
277661799254,7cyclictest3030365-21tr11:21:232
277661799251,9cyclictest3057182-21/usr/sbin/munin11:51:082
277661799251,7cyclictest2797237-21/usr/sbin/munin07:26:182
277661799251,3cyclictest2913605-21ps09:26:192
2776617992512,11cyclictest0-21swapper/212:26:282
277661799250,9cyclictest2792430-21/usr/sbin/munin07:21:232
277661799250,8cyclictest2947895-21/usr/sbin/munin10:01:072
277661799250,8cyclictest2847626-21awk08:16:272
277661799241,8cyclictest3037353-21munin-node11:31:062
277661799241,7cyclictest2853708-21cut08:26:112
2776612992419,3cyclictest2957444-21systemd-run10:10:010
277661699223,11cyclictest0-21swapper/112:06:131
2776612992217,3cyclictest3002521-21sh10:56:110
27762392224,14sleep20-21swapper/207:07:472
2776612992016,2cyclictest2968608-21kthreadcore10:21:210
2776616991915,2cyclictest0-21swapper/112:30:011
2776612991914,2cyclictest0-21swapper/008:25:010
27722662193,9sleep30-21swapper/307:06:153
277661299180,16cyclictest3045094-21cut11:36:190
277661299179,6cyclictest2982846-21ls10:36:140
30711162155,6sleep30-21swapper/312:01:273
30720252142,8sleep30-21swapper/312:06:083
29139052143,7sleep30-21swapper/309:26:213
30807252132,7sleep30-21swapper/312:11:223
30469212132,7sleep30-21swapper/311:39:593
30370272132,7sleep30-21swapper/311:30:013
29275732132,6sleep30-21swapper/309:40:013
29275732132,6sleep30-21swapper/309:40:013
28878982130,8sleep30-21swapper/309:00:003
28126032132,7sleep30-21swapper/307:41:273
28034122131,7sleep30-21swapper/307:35:013
27932972131,7sleep30-21swapper/307:25:003
27768722132,7sleep30-21swapper/307:11:133
30978202122,6sleep30-21swapper/312:31:173
30922882122,6sleep30-21swapper/312:26:153
30911772122,6sleep30-21swapper/312:21:293
30822942122,6sleep30-21swapper/312:16:163
30618172122,5sleep30-21swapper/311:55:013
30618172122,5sleep30-21swapper/311:55:013
30535632122,6sleep30-21swapper/311:46:183
30478102122,6sleep30-21swapper/311:41:163
30267112122,5sleep30-21swapper/311:20:023
30225472122,6sleep30-21swapper/311:16:163
30208552122,6sleep30-21swapper/311:11:233
30121972122,6sleep30-21swapper/311:06:093
30072342122,6sleep30-21swapper/311:01:073
30019122122,6sleep30-21swapper/310:54:453
29772022122,6sleep30-21swapper/310:30:013
29730732122,6sleep30-21swapper/310:26:163
29713772122,6sleep30-21swapper/310:21:273
29663142123,6sleep30-21swapper/310:16:213
29478982126,4sleep30-21swapper/310:01:083
29368632122,6sleep30-21swapper/309:46:313
29274152122,6sleep30-21swapper/309:38:453
29119502122,6sleep30-21swapper/309:21:273
29027682122,5sleep30-21swapper/309:15:013
28959182122,6sleep30-21swapper/309:06:183
28919722122,6sleep30-21swapper/309:01:213
28734582121,7sleep30-21swapper/308:46:123
28724852123,5sleep30-21swapper/308:41:303
28585572122,6sleep30-21swapper/308:31:113
28389412122,6sleep30-21swapper/308:11:123
28380702122,6sleep30-21swapper/308:06:303
28278372122,6sleep30-21swapper/307:56:283
28074482122,6sleep30-21swapper/307:36:213
28074482122,6sleep30-21swapper/307:36:213
27877442122,6sleep30-21swapper/307:16:313
31019272112,5sleep30-21swapper/312:36:103
30572112112,5sleep30-21swapper/311:51:123
30373822112,6sleep30-21swapper/311:31:093
30019632112,5sleep30-21swapper/310:55:013
29927852112,5sleep30-21swapper/310:46:143
29874262112,6sleep30-21swapper/310:40:453
29828692112,5sleep30-21swapper/310:36:153
29576972112,6sleep30-21swapper/310:10:393
29532272112,5sleep30-21swapper/310:06:143
29429702112,5sleep30-21swapper/309:56:093
29379842112,6sleep30-21swapper/309:51:093
29179762112,5sleep30-21swapper/309:31:103
28787502112,6sleep30-21swapper/308:51:133
28535392112,5sleep30-21swapper/308:25:453
28446502112,5sleep30-21swapper/308:16:183
28295382112,5sleep30-21swapper/308:01:173
28190812112,5sleep30-21swapper/307:51:373
27968922112,5sleep30-21swapper/307:26:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional