You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 05:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Jul 01, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316405021870,3sleep375-21kworker/3:1-events00:00:183
29363242710,2chrt39-21ksoftirqd/220:10:202
2871877996559,4cyclictest3113075-21kworker/u8:0+events_unbound23:45:281
2871877996355,6cyclictest2933842-21kworker/u8:0+flush-8:022:15:261
2871877996355,6cyclictest2933842-21kworker/u8:0+flush-8:022:15:261
2871877996256,5cyclictest2911071-21kworker/u8:1+events_unbound20:05:301
2871877996256,5cyclictest2911071-21kworker/u8:1+events_unbound20:05:301
2871877996055,3cyclictest2933842-21kworker/u8:0+events_unbound21:35:291
2871877995852,5cyclictest3137829-21kworker/u8:2+events_unbound00:35:281
2871877995752,4cyclictest3012449-21kworker/u8:1+events_unbound21:45:131
2871877995751,4cyclictest3032895-21kworker/u8:3+events_unbound21:50:271
2871877995751,4cyclictest3032895-21kworker/u8:3+events_unbound21:50:261
2871877995751,4cyclictest2911071-21kworker/u8:1+flush-8:020:20:301
2871877995750,5cyclictest2933842-21kworker/u8:0+events_unbound21:05:301
29663772560,1sleep02966384-21tr20:40:200
2871877995652,3cyclictest3077814-21kworker/u8:3+events_unbound23:05:301
2871877995651,4cyclictest3068013-21kworker/u8:1+flush-8:022:35:261
2871877995649,6cyclictest3113075-21kworker/u8:0+flush-8:023:20:291
2871877995648,6cyclictest2898400-21kworker/u8:2+events_unbound20:15:281
2871873995647,7cyclictest2948701-21/usr/sbin/munin20:25:230
2871877995549,4cyclictest3113075-21kworker/u8:0+events_unbound23:15:281
2871877995448,4cyclictest2898400-21kworker/u8:2+events_unbound19:35:281
2871877995447,5cyclictest2898400-21kworker/u8:2+events_unbound20:45:241
2871877995346,5cyclictest3068013-21kworker/u8:1+events_unbound22:55:261
2871877995342,9cyclictest3091786-21ntpq22:45:241
2871877995246,5cyclictest2933842-21kworker/u8:0+flush-8:021:40:261
2871877995246,5cyclictest2911071-21kworker/u8:1+flush-8:020:00:251
2871877995246,5cyclictest2026296-21kworker/u8:0+events_unbound19:15:291
2871877995245,5cyclictest3123163-21kworker/u8:1+events_unbound00:25:291
287187399520,50cyclictest1-21systemd00:00:000
2871878995146,4cyclictest2884284-21kworker/u8:3+flush-8:019:25:302
2871877995046,3cyclictest2933842-21kworker/u8:0+events_unbound21:55:301
2871877995045,4cyclictest2026296-21kworker/u8:0+events_unbound19:10:281
2871877995045,3cyclictest2898400-21kworker/u8:2+events_unbound20:25:251
2871877995044,5cyclictest3068013-21kworker/u8:1+events_unbound22:50:301
2871878994837,8cyclictest1704890-21systemd-journal00:09:592
2871877994844,3cyclictest3003364-21kworker/u8:2+flush-8:021:30:281
2871877994742,3cyclictest2962780-21kworker/u8:3+flush-8:020:40:251
2871877994741,5cyclictest2911071-21kworker/u8:1+events_unbound19:55:271
2871877994642,3cyclictest2911071-21kworker/u8:1+flush-8:020:35:311
2871877994640,4cyclictest3137829-21kworker/u8:2+flush-8:023:50:261
2871877994640,4cyclictest2962780-21kworker/u8:3+flush-8:021:25:211
287187399461,43cyclictest1-21systemd23:35:010
2871873994611,18cyclictest589-21runrttasks22:45:130
2871877994541,3cyclictest3003364-21kworker/u8:2+flush-8:022:05:331
2871877994538,5cyclictest3123163-21kworker/u8:1+events_unbound00:30:151
2871877994438,4cyclictest2884284-21kworker/u8:3+flush-8:019:30:141
2871878994337,4cyclictest2962780-21kworker/u8:3+flush-8:021:00:302
2871877994339,2cyclictest3077814-21kworker/u8:3+events_unbound23:10:121
2871877994338,4cyclictest2884284-21kworker/u8:3+events_unbound19:40:221
2871877994337,5cyclictest3123163-21kworker/u8:1+flush-8:023:35:261
2871877994337,5cyclictest2993426-21kworker/u8:1+flush-8:021:10:261
2871877994337,5cyclictest2911071-21kworker/u8:1+events_unbound19:45:281
2871877994336,5cyclictest3077814-21kworker/u8:3+events_unbound22:40:181
2871873994335,6cyclictest3027021-21ntpq21:40:220
2871873994334,7cyclictest2912672-21ntpq19:45:250
2871873994333,8cyclictest2977295-21ntpq20:50:260
2871878994234,6cyclictest1704890-21systemd-journal22:00:002
2871877994136,4cyclictest3113075-21kworker/u8:0+flush-8:000:05:251
2871877994135,5cyclictest2933842-21kworker/u8:0+flush-8:020:30:261
2871877994134,5cyclictest2993426-21kworker/u8:1+flush-8:021:15:251
2871877994131,6cyclictest1704890-21systemd-journal19:50:471
2871877994035,4cyclictest2933842-21kworker/u8:0+flush-8:022:20:121
2871877994035,4cyclictest2933842-21kworker/u8:0+flush-8:022:20:121
2871877994035,3cyclictest3113075-21kworker/u8:0+flush-8:023:40:211
2871877994034,4cyclictest3123163-21kworker/u8:1+flush-8:023:55:271
2871877994034,4cyclictest3003364-21kworker/u8:2+events_unbound22:10:271
2871877993935,3cyclictest3032895-21kworker/u8:3+flush-8:022:00:291
2871877993934,4cyclictest2876927-21kworker/u8:1+events_unbound19:25:161
2871878993731,4cyclictest3003364-21kworker/u8:2+events_unbound22:40:292
2871877993732,3cyclictest2876927-21kworker/u8:1+events_unbound19:24:591
2871873993727,8cyclictest2933842-21kworker/u8:0+flush-8:021:35:310
2871878993631,4cyclictest3123163-21kworker/u8:1+flush-8:023:30:302
2871878993630,4cyclictest3113075-21kworker/u8:0+flush-8:023:10:262
2871878993626,8cyclictest2947632-21ntpq20:20:292
2871877993630,4cyclictest3123163-21kworker/u8:1+flush-8:000:15:161
2871877993629,5cyclictest3163069-21apt-get00:00:081
2871873993629,5cyclictest1704890-21systemd-journal21:16:000
2871873993628,5cyclictest3107449-21grep23:00:320
2871873993625,8cyclictest3101927-21ntpq22:55:250
28714752364,10sleep10-21swapper/119:07:071
2871878993530,4cyclictest2876927-21kworker/u8:1+events_unbound19:20:282
2871877993531,3cyclictest3077814-21kworker/u8:3+flush-8:023:30:201
2871877993531,3cyclictest2973082-21kworker/u8:1+flush-8:020:55:191
2871873993529,4cyclictest3122273-21grep23:15:310
2871873993528,5cyclictest2933842-21kworker/u8:0+events_unbound22:15:250
2871873993528,5cyclictest2933842-21kworker/u8:0+events_unbound22:15:240
2871873993528,5cyclictest1704890-21systemd-journal23:41:290
2871873993525,8cyclictest3072038-21ntpq22:25:250
2871873993523,8cyclictest1704890-21systemd-journal23:55:000
29353342340,3sleep10-21swapper/120:10:191
2871878993429,4cyclictest3003364-21kworker/u8:2+flush-8:022:25:302
2871878993429,4cyclictest2973082-21kworker/u8:1+events_unbound20:50:302
2871877993429,4cyclictest3113075-21kworker/u8:0+flush-8:023:25:341
287187399343,7cyclictest3173963-21grep00:15:100
2871877993329,3cyclictest3003364-21kworker/u8:2+flush-8:021:20:301
2871877993327,5cyclictest2933842-21kworker/u8:0+flush-8:022:25:261
2871873993328,3cyclictest2933609-21cron20:10:000
2871873993328,3cyclictest2933609-21cron20:09:590
2871873993324,7cyclictest2897805-21ntpq19:30:230
2871873993323,2cyclictest161rcu_preempt19:14:040
2871878993227,3cyclictest2933842-21kworker/u8:0+flush-8:022:30:312
2871878993226,4cyclictest3068013-21kworker/u8:1+flush-8:023:01:132
2871878993224,5cyclictest3082857-21awk22:40:012
2871878993223,7cyclictest1704890-21systemd-journal21:39:082
2871877993229,2cyclictest2973731-21cpuspeed_turbos20:50:151
2871877993227,4cyclictest3137829-21kworker/u8:2+flush-8:000:20:201
287187399325,14cyclictest589-21runrttasks22:05:280
2871873993227,3cyclictest3078436-21fschecks_count22:35:140
2871873993224,5cyclictest2982753-21grep20:55:300
2871873993211,11cyclictest3031759-21/usr/sbin/munin21:45:210
2871873993210,15cyclictest2957406-21ld20:30:250
30940352310,4sleep03093946-21irqrtprio22:50:200
2871878993126,3cyclictest3158574-21irqrtprio23:55:192
287187399318,11cyclictest589-21runrttasks20:45:140
287187399315,15cyclictest3116840-21ntpq23:10:230
2871873993126,3cyclictest2928418-21cron20:05:000
2871878993026,3cyclictest2876927-21kworker/u8:1+events_unbound19:30:272
2871877993026,3cyclictest3068013-21kworker/u8:1+events_unbound23:00:161
287187399309,6cyclictest3190061-21cut00:30:200
2871873993025,3cyclictest2887670-21needreboot19:20:220
287187399302,17cyclictest3016996-21memory21:30:200
2871873993021,7cyclictest2922544-21ntpq19:55:230
2871873993020,7cyclictest2883202-21grep19:15:320
287187399301,14cyclictest0-21swapper/022:40:260
28715432304,9sleep20-21swapper/219:08:022
2871878992924,4cyclictest2911071-21kworker/u8:1+flush-8:020:35:262
2871877992925,3cyclictest2933842-21kworker/u8:0+flush-8:021:00:151
287187399293,5cyclictest0-21swapper/000:20:290
287187399293,15cyclictest3152010-21python323:45:280
287187399293,14cyclictest2889532-21hddtemp_smartct19:25:170
2871873992924,4cyclictest2884284-21kworker/u8:3+events_unbound19:43:120
2871873992922,5cyclictest1704890-21systemd-journal22:01:080
287187399292,13cyclictest3063848-21sort22:20:160
287187399292,13cyclictest3063848-21sort22:20:150
2871873992919,8cyclictest3111859-21ntpq23:05:250
2871873992919,2cyclictest161rcu_preempt00:10:090
287187399291,15cyclictest3138803-21irqrtprio23:35:190
287187399290,18cyclictest2996031-21kthreadcore21:10:220
2871878992824,2cyclictest2913875-21aten2_r5power_c19:50:132
2871878992818,8cyclictest1704890-21systemd-journal20:07:092
2871878992818,8cyclictest1704890-21systemd-journal20:07:092
287187399286,10cyclictest3041957-21ntpq21:55:270
287187399284,13cyclictest3195520-21kthreadcore00:35:200
287187399284,13cyclictest3127068-21ntpq23:20:290
287187399284,13cyclictest2985113-21kthreadcore21:00:200
287187399283,17cyclictest3010118-21cut21:25:210
2871873992822,4cyclictest3167365-21unixbench_singl00:00:290
2871873992818,8cyclictest3073486-21diskstats22:30:170
287187399281,16cyclictest3057891-21munin-run22:15:010
287187399280,10cyclictest3007213-21runrttasks21:20:260
287187399280,10cyclictest2899398-21hddtemp_smartct19:35:150
2871878992724,2cyclictest3058418-21fschecks_count22:15:152
2871878992724,2cyclictest3058418-21fschecks_count22:15:142
2871877992723,3cyclictest3137829-21kworker/u8:2+events_unbound00:13:501
287187399279,8cyclictest2988519-21/usr/sbin/munin21:05:120
287187399277,10cyclictest2947553-21ntpq20:20:260
287187399274,12cyclictest2935989-21kthreadcore20:10:210
287187399274,10cyclictest3132160-21python323:25:290
287187399273,13cyclictest3170625-21kthreadcore00:05:220
287187399273,13cyclictest2962337-21ntpq20:35:250
2871873992721,4cyclictest3187798-21unixbench_singl00:25:340
287187399272,14cyclictest2939061-21diskstats20:15:160
287187399271,15cyclictest3036949-21ntpq21:50:260
287187399271,15cyclictest3036949-21ntpq21:50:260
2871878992622,2cyclictest3051971-21grep22:05:232
2871878992621,4cyclictest2898400-21kworker/u8:2-ext4-rsv-conversion19:40:002
28715932262,6sleep00-21swapper/019:08:390
2871878992521,2cyclictest2998638-21cpuspeed_turbos21:15:142
2871878992520,3cyclictest2953864-21cpuspeed_turbos20:30:132
287187899250,23cyclictest3123309-21aten2_r5power_v23:20:152
287187399254,10cyclictest2913915-21/usr/sbin/munin19:50:130
31976942240,3sleep23197698-21unixbench_singl00:35:332
2871878992421,2cyclictest3013687-21fschecks_time21:30:142
2871878992420,3cyclictest3137829-21kworker/u8:2+events_unbound23:50:142
2871878992420,2cyclictest2993686-21cpuspeed_turbos21:10:162
2871878992416,6cyclictest3003364-21kworker/u8:2+flush-8:022:10:212
287187899232,9cyclictest30917172uname22:45:222
2871878992319,2cyclictest3033198-21aten2_r5power_e21:50:132
2871878992319,2cyclictest3033198-21aten2_r5power_e21:50:132
2871878992318,3cyclictest2872259-21cpuspeed_turbos19:10:142
2871877992215,5cyclictest3073237-21apt-get22:30:131
2871878992116,4cyclictest3068013-21kworker/u8:1+flush-8:023:05:172
2871878992112,7cyclictest2965259-21tr20:40:202
28668152213,8sleep30-21swapper/319:05:023
2871878992017,2cyclictest3067549-21unixbench_multi22:20:292
2871878992017,2cyclictest3067549-21unixbench_multi22:20:292
2871878992016,3cyclictest0-21swapper/223:40:012
2871878992016,2cyclictest0-21swapper/200:15:092
2871878992014,4cyclictest0-21swapper/220:05:002
31193552190,2sleep3481ktimers/323:15:183
2871878991915,2cyclictest0-21swapper/222:50:152
2871878991915,2cyclictest0-21swapper/219:45:202
2871878991914,4cyclictest2939344-21cut20:15:182
2871878991910,7cyclictest3025099-21tr21:40:192
2871878991910,7cyclictest3003400-21apt-get21:20:112
30979062188,5sleep30-21swapper/322:55:023
287187899182,12cyclictest3128153-21apt-get23:25:132
2871878991814,2cyclictest3009108-21irqrtprio21:25:192
2871878991814,2cyclictest0-21swapper/220:55:312
2871878991813,3cyclictest0-21swapper/223:20:002
2871878991812,4cyclictest2904362-21fschecks_time19:40:152
287187899181,12cyclictest3143070-21apt-get23:40:132
2871878991810,6cyclictest3186927-21tr00:25:232
2871878991810,6cyclictest1704890-21systemd-journal19:20:012
287187899178,7cyclictest2919364-21sed19:55:192
2871878991714,2cyclictest3043362-21fschecks_count22:00:162
2871878991714,2cyclictest2949453-21tr20:25:202
2871878991713,2cyclictest0-21swapper/221:45:242
2871878991713,2cyclictest0-21swapper/220:45:192
2871878991713,2cyclictest0-21swapper/200:20:312
2871878991710,4cyclictest3151260-21kthreadcore23:45:212
287187899162,13cyclictest0-21swapper/200:13:332
287187899162,10cyclictest3162547-21apt-get00:00:032
2871878991612,3cyclictest3098402-21cpuspeed_turbos22:55:162
2871878991611,3cyclictest0-21swapper/221:05:202
287187899160,7cyclictest31886031cpu00:30:142
31687422153,8sleep30-21swapper/300:05:213
30317672142,8sleep30-21swapper/321:45:233
29437412142,8sleep30-21swapper/320:20:113
28767772142,7sleep30-21swapper/319:15:003
31938772132,8sleep30-21swapper/300:35:183
30878222132,6sleep30-21swapper/322:45:013
30563512132,7sleep30-21swapper/322:10:233
29972322132,7sleep30-21swapper/321:10:273
29881982132,6sleep30-21swapper/321:05:003
29782742132,6sleep30-21swapper/320:55:023
28756962132,7sleep30-21swapper/319:10:233
31894892122,6sleep30-21swapper/300:30:213
31783382122,5sleep30-21swapper/300:20:013
31729082122,6sleep30-21swapper/300:10:013
31477662122,6sleep30-21swapper/323:45:023
31334602122,6sleep30-21swapper/323:30:173
31275222122,6sleep30-21swapper/323:20:333
31129692122,5sleep30-21swapper/323:10:023
30714432123,5sleep30-21swapper/322:25:243
30670292122,6sleep30-21swapper/322:20:223
30670292122,6sleep30-21swapper/322:20:213
30618642122,6sleep30-21swapper/322:15:253
30618642122,6sleep30-21swapper/322:15:253
30528022122,6sleep30-21swapper/322:08:093
30477762122,6sleep30-21swapper/322:05:013
30265422122,6sleep30-21swapper/321:40:203
30127202123,6sleep30-21swapper/321:25:363
30034042122,6sleep30-21swapper/321:20:133
30026142122,6sleep30-21swapper/321:15:333
29734972122,6sleep30-21swapper/320:50:123
29684492122,6sleep30-21swapper/320:45:023
29626252123,5sleep30-21swapper/320:35:323
29533932122,6sleep30-21swapper/320:30:013
29492952122,6sleep30-21swapper/320:25:203
29430232122,6sleep30-21swapper/320:15:323
29135682122,6sleep30-21swapper/319:50:003
29037612122,5sleep30-21swapper/319:40:013
29034832122,6sleep30-21swapper/319:37:093
28981032122,6sleep30-21swapper/319:30:293
28933502122,6sleep30-21swapper/319:25:333
31838712112,5sleep30-21swapper/300:25:183
31773312112,6sleep30-21swapper/300:15:203
31581942112,6sleep30-21swapper/323:55:173
31534032112,5sleep30-21swapper/323:50:193
31430372112,6sleep30-21swapper/323:40:083
31380312112,5sleep30-21swapper/323:35:023
31288812112,5sleep30-21swapper/323:25:193
31080852112,5sleep30-21swapper/323:05:093
31034052112,5sleep30-21swapper/323:00:143
30984232112,5sleep30-21swapper/322:55:183
30869552112,6sleep30-21swapper/322:40:293
30826582112,6sleep30-21swapper/322:37:483
30732042112,5sleep30-21swapper/322:30:083
30380032112,5sleep30-21swapper/321:55:023
30367842111,6sleep30-21swapper/321:50:243
30367842111,6sleep30-21swapper/321:50:233
30183492112,5sleep30-21swapper/321:35:143
30131002112,5sleep30-21swapper/321:30:023
29872272112,5sleep30-21swapper/321:00:243
29635342112,5sleep30-21swapper/320:40:133
29378862112,5sleep30-21swapper/320:10:323
29328362112,5sleep30-21swapper/320:05:303
29328362112,5sleep30-21swapper/320:05:293
29278972112,6sleep30-21swapper/320:00:313
29187852112,6sleep30-21swapper/319:55:023
29183282112,5sleep30-21swapper/319:52:093
28844822112,5sleep30-21swapper/319:20:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional