You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 05:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat Dec 06, 2025 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29374432700,2sleep3586-21kworker/3:2-events22:46:113
2720837996356,5cyclictest2827007-21kworker/u8:1+flush-8:021:36:171
27735732620,2sleep3586-21kworker/3:2+events20:01:133
2720835996150,9cyclictest282-21systemd-journal21:45:000
2720837995950,6cyclictest3020064-21latency_hist00:10:011
271699725927,28sleep20-21swapper/219:06:112
2720835995854,3cyclictest2950166-21kworker/u8:1+events_unbound23:56:240
2720835995853,3cyclictest2900153-21kworker/u8:3+events_unbound22:40:000
2720835995753,3cyclictest2880364-21kworker/u8:0+events_unbound21:46:210
2720835995752,4cyclictest2737385-21kworker/u8:0+events_unbound20:46:130
2720835995750,5cyclictest2720679-21kworker/u8:2+events_unbound19:31:220
2720837995649,5cyclictest2720679-21kworker/u8:2+events_unbound19:15:031
2720835995652,3cyclictest2925245-21kworker/u8:1+flush-8:022:41:240
2720835995651,4cyclictest2737385-21kworker/u8:0+events_unbound19:56:180
2720835995650,4cyclictest2747285-21kworker/u8:3+events_unbound20:10:000
2720835995648,6cyclictest2975436-21latency_hist23:25:010
2720835995552,2cyclictest2880364-21kworker/u8:0+flush-8:021:56:210
2720835995551,3cyclictest2737385-21kworker/u8:0+flush-8:020:01:240
2720835995549,4cyclictest2950166-21kworker/u8:1+events_unbound23:16:070
2720835995544,3cyclictest2827007-21kworker/u8:1+events_unbound22:06:180
2720835995450,3cyclictest2806724-21kworker/u8:3+flush-8:021:11:210
2720835995450,3cyclictest2797112-21kworker/u8:1+flush-8:020:26:250
2720835995449,3cyclictest2910594-21kworker/u8:0+events_unbound23:01:190
2720835995348,4cyclictest3005103-21kworker/u8:0+flush-8:000:16:210
2720835995347,5cyclictest2950166-21kworker/u8:1+events_unbound00:36:200
272083599531,49cyclictest1-21systemd19:50:000
2720837995245,5cyclictest2827007-21kworker/u8:1+flush-8:021:26:201
2720837995145,4cyclictest2806724-21kworker/u8:3+flush-8:020:56:181
2720835995147,3cyclictest2720679-21kworker/u8:2+events_unbound19:26:220
2720835995146,3cyclictest2720679-21kworker/u8:2+events_unbound19:11:200
2720835995145,4cyclictest2827007-21kworker/u8:1+events_unbound22:16:080
2720835995145,4cyclictest2827007-21kworker/u8:1+events_unbound22:11:190
30284852500,1sleep13028488-21cut00:16:141
2720837995045,3cyclictest2900153-21kworker/u8:3+events_unbound23:46:061
2720835995046,3cyclictest2880364-21kworker/u8:0+flush-8:022:01:210
2720835995046,3cyclictest2806724-21kworker/u8:3+flush-8:021:21:220
2720835995045,4cyclictest2900153-21kworker/u8:3+events_unbound22:46:190
2720835995045,3cyclictest2777122-21kworker/u8:2+events_unbound20:41:180
2720835995044,4cyclictest2900153-21kworker/u8:3+events_unbound23:51:150
2720835995044,4cyclictest2737385-21kworker/u8:0+events_unbound19:36:170
2720837994941,6cyclictest2747285-21kworker/u8:3+flush-8:020:11:211
2720835994945,3cyclictest2910594-21kworker/u8:0+events_unbound23:06:060
2720835994945,3cyclictest2861416-21kworker/u8:2+events_unbound22:21:240
2720835994945,3cyclictest2747285-21kworker/u8:3+flush-8:020:16:220
2720835994945,3cyclictest2737385-21kworker/u8:0+events_unbound20:51:240
2720835994944,3cyclictest2950166-21kworker/u8:1+events_unbound23:40:010
2720835994939,3cyclictest2827007-21kworker/u8:1+events_unbound21:01:110
2720835994839,6cyclictest2980949-21diskstats23:31:070
2720837994743,3cyclictest2206942-21kworker/u8:1+flush-8:019:31:071
2720837994742,3cyclictest2900153-21kworker/u8:3+flush-8:023:51:161
2720837994740,5cyclictest3010119-21cat00:00:011
2720835994743,3cyclictest3005103-21kworker/u8:0+flush-8:000:06:270
2720835994743,3cyclictest3005103-21kworker/u8:0+events_unbound00:11:200
2720835994743,3cyclictest2950166-21kworker/u8:1+flush-8:023:11:260
2720835994742,4cyclictest2861416-21kworker/u8:2+flush-8:021:51:070
2720835994742,3cyclictest3029758-21kworker/u8:2+events_unbound00:26:220
2720835994742,3cyclictest2806724-21kworker/u8:3+events_unbound21:06:170
2720837994640,5cyclictest3010337-21kworker/u8:4+flush-8:000:01:161
2720837994640,5cyclictest2980391-21kworker/u8:2+events_unbound23:31:201
2720837994640,5cyclictest2950166-21kworker/u8:1+flush-8:023:26:211
2720837994639,5cyclictest3029758-21kworker/u8:2+flush-8:000:21:141
2720835994642,3cyclictest2950166-21kworker/u8:1+events_unbound23:41:170
2720835994642,3cyclictest2950166-21kworker/u8:1+events_unbound23:26:080
2720835994642,3cyclictest2806724-21kworker/u8:3+events_unbound21:16:060
2720835994642,3cyclictest2777122-21kworker/u8:2+events_unbound20:31:210
2720835994641,4cyclictest2806724-21kworker/u8:3+events_unbound20:56:140
2720835994638,3cyclictest2827007-21kworker/u8:1+events_unbound21:36:310
28178302450,2chrt586-21kworker/3:2+events20:46:083
2720837994539,4cyclictest2797112-21kworker/u8:1+flush-8:020:26:231
2720835994541,3cyclictest2737385-21kworker/u8:0+events_unbound20:36:190
2720835994541,3cyclictest2737385-21kworker/u8:0+events_unbound20:36:190
2720835994540,3cyclictest2827007-21kworker/u8:1+events_unbound21:26:180
2720835994539,4cyclictest2747285-21kworker/u8:3+events_unbound20:11:100
2720837994438,5cyclictest2747285-21kworker/u8:3+flush-8:020:16:181
2720835994440,3cyclictest2950166-21kworker/u8:1+events_unbound23:46:220
2720835994440,3cyclictest2940273-21kworker/u8:2+events_unbound22:51:200
2720835994439,4cyclictest2206942-21kworker/u8:1+flush-8:019:21:100
2720837994338,4cyclictest2806724-21kworker/u8:3+flush-8:021:21:081
2720835994340,2cyclictest3039297-21kworker/u8:0+events_unbound00:31:480
2720835994339,3cyclictest2900153-21kworker/u8:3+events_unbound00:00:030
2720835994339,3cyclictest2747285-21kworker/u8:3+flush-8:020:21:110
2720835994338,4cyclictest2861416-21kworker/u8:2+events_unbound21:31:060
2720841994233,6cyclictest2831752-21awk21:00:012
2720837994233,7cyclictest282-21systemd-journal22:26:291
2720841994130,8cyclictest3025006-21awk00:15:002
2720837994137,3cyclictest2737385-21kworker/u8:0+events_unbound19:41:221
2720837994134,5cyclictest2837017-21apt-get21:06:041
2720837994130,9cyclictest2761478-21ntpq19:46:161
2720835994137,3cyclictest2206942-21kworker/u8:1+flush-8:019:16:170
2720837994035,4cyclictest2900153-21kworker/u8:3+flush-8:022:56:191
2720837994035,3cyclictest2806724-21kworker/u8:3+events_unbound21:11:051
2720835994036,3cyclictest2910594-21kworker/u8:0+flush-8:022:26:210
2720835994036,3cyclictest2900153-21kworker/u8:3+events_unbound22:56:230
2720835994032,3cyclictest2737385-21kworker/u8:0+events_unbound19:51:040
2720837993933,4cyclictest2900153-21kworker/u8:3+flush-8:023:16:241
2720837993928,8cyclictest282-21systemd-journal22:19:301
2720841993831,5cyclictest282-21systemd-journal21:44:302
2720837993833,3cyclictest2737385-21kworker/u8:0+events_unbound20:01:061
2720837993833,3cyclictest2206942-21kworker/u8:1+events_unbound19:26:051
2720837993831,5cyclictest2950166-21kworker/u8:1+flush-8:023:36:181
2720837993829,6cyclictest2782062-21latency_hist20:10:011
2720837993828,4cyclictest2827007-21kworker/u8:1+flush-8:021:31:221
2720837993732,3cyclictest2737385-21kworker/u8:0+flush-8:020:36:171
2720837993732,3cyclictest2737385-21kworker/u8:0+flush-8:020:36:161
2720837993729,6cyclictest282-21systemd-journal21:54:591
2720837993728,7cyclictest2935946-21apt-get22:46:021
2720835993733,3cyclictest2910594-21kworker/u8:0+events_unbound22:31:100
2720835993733,3cyclictest2910594-21kworker/u8:0+events_unbound22:31:100
2720837993632,3cyclictest3010337-21kworker/u8:4+events_unbound00:11:101
2720837993631,4cyclictest2737385-21kworker/u8:0+events_unbound19:51:081
2720837993630,4cyclictest2737385-21kworker/u8:0+flush-8:019:56:121
2720835993632,3cyclictest3029758-21kworker/u8:2+events_unbound00:21:200
2720835993632,3cyclictest2206942-21kworker/u8:1+events_unbound19:41:060
2720841993527,6cyclictest282-21systemd-journal20:30:002
2720837993529,5cyclictest2827007-21kworker/u8:1+flush-8:021:01:171
2720837993527,6cyclictest282-21systemd-journal20:55:011
2720837993527,6cyclictest2777122-21kworker/u8:2+events_unbound20:31:101
2720837993523,9cyclictest2875359-21ntpq21:41:141
2720837993428,5cyclictest2950166-21kworker/u8:1+flush-8:023:11:201
2720837993426,6cyclictest2951026-21apt-get23:01:021
2720837993228,3cyclictest3029758-21kworker/u8:2+events_unbound00:26:261
2720837993227,4cyclictest2910594-21kworker/u8:0+flush-8:023:06:171
2720837993227,4cyclictest2827007-21kworker/u8:1+flush-8:022:06:171
2720841993120,8cyclictest2762879-21diskstats19:51:072
2720837993127,3cyclictest2940273-21kworker/u8:2+events_unbound22:51:071
2720837993125,4cyclictest2721048-21apt-get19:11:031
272084199300,28cyclictest2915496-21unixbench_singl22:21:262
2720837993025,4cyclictest2880364-21kworker/u8:0+events_unbound21:56:191
2720837993024,5cyclictest2925245-21kworker/u8:1+flush-8:022:41:191
2720837993024,4cyclictest2900153-21kworker/u8:3+events_unbound23:41:081
2720837993023,5cyclictest2950166-21kworker/u8:1+flush-8:023:21:201
2720837993023,5cyclictest2901295-21apt-get22:11:041
2720837992925,3cyclictest2925245-21kworker/u8:1+events_unbound22:36:071
2720837992925,3cyclictest2915854-21systemd-run22:25:001
2720837992923,5cyclictest2827007-21kworker/u8:1+flush-8:021:16:191
2720835992910,6cyclictest13-21ksoftirqd/019:10:010
2720841992822,4cyclictest282-21systemd-journal19:45:002
2720837992825,2cyclictest2817556-21irqcore20:46:061
2720837992823,3cyclictest2910594-21kworker/u8:0+events_unbound22:31:181
2720837992823,3cyclictest2910594-21kworker/u8:0+events_unbound22:31:181
2720837992822,4cyclictest2876561-21apt-get21:46:021
2720837992819,7cyclictest2891429-21apt-get22:01:031
30108522270,4sleep2371rcuc/200:01:102
2720841992723,2cyclictest2895656-21grep22:01:232
2720841992722,3cyclictest2747868-21aten2_r5power_e19:36:052
2720837992724,2cyclictest2748530-21irqrtprio19:36:101
2720837992721,5cyclictest2206942-21kworker/u8:1+events_unbound19:21:161
2720841992623,2cyclictest2951056-21aten2_r5power_c23:01:042
2720841992622,3cyclictest2986011-21fschecks_time23:36:112
2720841992618,6cyclictest282-21systemd-journal20:34:212
2720841992617,7cyclictest2826837-21cat20:55:012
2720841992522,2cyclictest3000698-21cpuspeed_turbos23:51:042
2720841992522,2cyclictest0-21swapper/223:16:232
2720837992521,2cyclictest0-21swapper/100:36:091
2720837992519,4cyclictest2777122-21kworker/u8:2+events_unbound20:41:081
2720841992420,3cyclictest2906448-21cpuspeed_turbos22:16:092
2720841992420,2cyclictest2887376-21kthreadcore21:56:102
2720841992419,4cyclictest2761972-21unixbench_singl19:46:232
2720841992416,6cyclictest282-21systemd-journal20:18:302
2720841992414,8cyclictest2935629-21/usr/sbin/munin22:45:002
272084199240,9cyclictest30284882cut00:16:142
272084199238,3cyclictest28969382irqcore22:06:112
2720841992320,2cyclictest2965215-21unixbench_singl23:11:262
2720841992320,2cyclictest2721313-21fschecks_count19:11:082
2720841992314,7cyclictest282-21systemd-journal20:10:002
2720841992312,8cyclictest2950902-21cp23:00:002
272084199231,20cyclictest2995860-21fschecks_time23:46:092
2720837992319,2cyclictest0-21swapper/100:31:181
272084199224,3cyclictest27371172sed19:21:222
272084199222,14cyclictest2792300-21apt-get20:21:042
2720841992218,2cyclictest3045447-21fschecks_count00:36:102
2720841992210,4cyclictest0-21swapper/219:56:232
272083799220,20cyclictest2792524-21cpuspeed_turbos20:21:061
272084199219,4cyclictest0-21swapper/221:16:052
272084199219,4cyclictest0-21swapper/220:11:082
2720841992118,2cyclictest2881759-21fschecks_count21:51:072
2720841992115,4cyclictest0-21swapper/220:36:222
2720841992115,4cyclictest0-21swapper/220:36:222
272036622113,3sleep10-21swapper/119:06:301
27161322212,11sleep30-21swapper/319:06:043
272084199202,12cyclictest2851821-21apt-get21:21:042
2720841992017,2cyclictest2981014-21fschecks_time23:31:072
2720841992017,2cyclictest2861943-21cpuspeed_turbos21:31:062
2720841992013,5cyclictest282-21systemd-journal21:25:302
272084199197,8cyclictest2817024-21apt-get20:46:012
2720841991916,2cyclictest0-21swapper/222:26:292
2720841991914,3cyclictest2971147-21fschecks_time23:21:102
28714522180,2sleep3451irq_work/321:40:013
272084199188,3cyclictest0-21swapper/221:47:112
2720841991815,2cyclictest2742538-21cron19:30:002
2720841991813,3cyclictest0-21swapper/221:11:232
2720841991813,3cyclictest0-21swapper/200:30:002
2720841991811,5cyclictest2871490-21grep21:40:012
2720841991810,6cyclictest2838526-21tr21:06:122
272084199179,6cyclictest3016656-21tr00:06:122
272084199177,3cyclictest0-21swapper/222:45:182
272084199172,11cyclictest2994371-21ntpq23:41:172
2720841991714,2cyclictest2926121-21aten2_r5power_p22:36:052
2720841991713,2cyclictest3030516-21tr00:21:032
2720841991713,2cyclictest0-21swapper/222:51:112
2720841991713,2cyclictest0-21swapper/221:03:322
272084199171,12cyclictest2975767-21apt-get23:26:062
272084199166,8cyclictest2921101-21apt-get22:31:032
272084199166,8cyclictest2921101-21apt-get22:31:032
272084199162,2cyclictest0-21swapper/223:55:132
272084199162,13cyclictest0-21swapper/219:34:312
2720841991612,3cyclictest0-21swapper/219:19:592
2720841991612,2cyclictest0-21swapper/220:01:162
2720841991611,4cyclictest2910594-21kworker/u8:0+flush-8:023:06:162
2720841991611,3cyclictest0-21swapper/200:31:262
272084199161,11cyclictest2815377-21kthreadcore20:41:142
28518242152,8sleep30-21swapper/321:21:043
27923032152,8sleep30-21swapper/320:21:043
28875082144,6sleep30-21swapper/321:56:113
27288732143,7sleep30-21swapper/319:16:113
272084199146,6cyclictest2903140-21cut22:11:132
30399322132,6sleep30-21swapper/300:30:013
29811722132,6sleep30-21swapper/323:31:103
29150802132,7sleep30-21swapper/322:21:243
28811832132,6sleep30-21swapper/321:50:013
28653922132,7sleep30-21swapper/321:31:153
27813412132,6sleep30-21swapper/320:06:203
30454922122,6sleep30-21swapper/300:36:113
30355402122,6sleep30-21swapper/300:26:123
30291632122,6sleep30-21swapper/300:16:213
30150952122,6sleep30-21swapper/300:05:013
30109302122,6sleep30-21swapper/300:01:123
30091462123,6sleep30-21swapper/323:56:183
29959592122,6sleep30-21swapper/323:46:113
29906432122,6sleep30-21swapper/323:41:063
29875992123,5sleep30-21swapper/323:36:163
29758532122,6sleep30-21swapper/323:26:093
29462702122,6sleep30-21swapper/322:56:113
29446642122,6sleep30-21swapper/322:51:173
29318992122,6sleep30-21swapper/322:41:143
29102592122,6sleep30-21swapper/322:16:263
28964192123,6sleep30-21swapper/322:06:073
28804082122,6sleep30-21swapper/321:46:203
28754672123,6sleep30-21swapper/321:41:173
28567332122,6sleep30-21swapper/321:26:063
28363852122,6sleep30-21swapper/321:01:253
28125672122,6sleep30-21swapper/320:41:113
28014092122,6sleep30-21swapper/320:26:263
27872292122,6sleep30-21swapper/320:15:313
27847962123,5sleep30-21swapper/320:11:173
27593582122,6sleep30-21swapper/319:46:133
27535382122,6sleep30-21swapper/319:41:113
27474892122,5sleep30-21swapper/319:35:013
27329752122,6sleep30-21swapper/319:21:053
27210522122,6sleep30-21swapper/319:11:063
30341932111,6sleep30-21swapper/300:21:193
30240792112,5sleep30-21swapper/300:11:153
30004122112,6sleep30-21swapper/323:50:323
29707612113,5sleep30-21swapper/323:20:313
29697212112,5sleep30-21swapper/323:16:213
29646962112,5sleep30-21swapper/323:11:203
29559782112,5sleep30-21swapper/323:06:023
29530202112,5sleep30-21swapper/323:01:123
29263212112,5sleep30-21swapper/322:36:083
29239312112,5sleep30-21swapper/322:31:153
29239312112,5sleep30-21swapper/322:31:143
29161112112,6sleep30-21swapper/322:25:413
29017672112,5sleep30-21swapper/322:11:123
28914002112,5sleep30-21swapper/322:01:013
28468702112,5sleep30-21swapper/321:16:063
28419572112,5sleep30-21swapper/321:11:053
28369472112,5sleep30-21swapper/321:05:313
28307222112,5sleep30-21swapper/320:56:163
28223292112,5sleep30-21swapper/320:51:093
28067832112,5sleep30-21swapper/320:35:013
28067832112,5sleep30-21swapper/320:35:003
28021772112,5sleep30-21swapper/320:31:083
27719332112,5sleep30-21swapper/319:57:253
27669982112,5sleep30-21swapper/319:52:063
27440242112,5sleep30-21swapper/319:31:123
27381872112,5sleep30-21swapper/319:26:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional