You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 05:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat May 02, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
279156621060,3sleep0201rcuc/020:56:140
2680552996047,11cyclictest280-21systemd-journal22:25:001
28782692570,1sleep12878272-21cut22:26:081
2680554995449,4cyclictest2941285-21kworker/u8:0+flush-8:000:26:182
2680552995436,16cyclictest2891749-21/usr/sbin/munin22:41:121
2680547995343,7cyclictest280-21systemd-journal20:45:000
29632742510,4sleep30-21swapper/323:51:093
2680552994941,5cyclictest2817082-21latency_hist21:25:011
29930552480,3sleep375-21kworker/3:1-events00:21:113
2680552994828,7cyclictest280-21systemd-journal19:38:451
2680547994840,6cyclictest2762277-21apt-get20:29:590
2680552994730,8cyclictest2726545-21ntpq19:51:211
2680552994624,5cyclictest2985724-21cron00:15:001
2680554994541,3cyclictest2670644-21kworker/u8:1+flush-8:020:16:172
2680554994540,3cyclictest2670644-21kworker/u8:1+events_unbound23:21:192
2680554994538,5cyclictest2822053-21kworker/u8:3+events_unbound21:56:132
2680547994539,4cyclictest2901688-21apt-get22:50:580
2680547994538,5cyclictest2936262-21kworker/u8:2+flush-8:023:56:120
2680547994438,4cyclictest2738003-21kworker/u8:0+flush-8:020:20:000
2680547994437,5cyclictest2880409-21ntpq22:26:110
2680547994434,8cyclictest2994731-21ntpq00:21:140
2680547994434,7cyclictest280-21systemd-journal21:34:590
2680554994337,5cyclictest2738003-21kworker/u8:0+events_unbound20:42:472
2680547994337,4cyclictest2670644-21kworker/u8:1+flush-8:020:10:000
2680547994331,4cyclictest2738003-21kworker/u8:0+flush-8:021:11:190
2680552994236,4cyclictest2670644-21kworker/u8:1+flush-8:020:21:151
2680552994235,5cyclictest280-21systemd-journal00:31:041
2680552994232,7cyclictest280-21systemd-journal20:10:031
2680547994234,5cyclictest2702731-21kworker/u8:3+events_unbound20:01:120
2680554994137,3cyclictest2670644-21kworker/u8:1+flush-8:019:11:212
2680554994136,4cyclictest2670644-21kworker/u8:1+events_unbound19:15:042
268054799410,39cyclictest1-21systemd21:40:000
2680552994034,4cyclictest2832271-21apt-get21:40:591
2680552994033,5cyclictest2665288-21kworker/u8:2+flush-8:019:21:161
2680552994030,8cyclictest2741413-21ntpq20:06:141
2680552994029,8cyclictest280-21systemd-journal19:25:451
2680547994034,5cyclictest2941285-21kworker/u8:0+flush-8:023:31:130
2680547994033,5cyclictest2954975-21ntpq23:41:110
2680547994032,6cyclictest2665288-21kworker/u8:2+events_unbound19:26:110
2680552993930,6cyclictest2866479-21latency_hist22:15:011
2680552993930,6cyclictest2866479-21latency_hist22:15:011
2680547993933,4cyclictest2831364-21kworker/u8:0+events_unbound22:46:120
2680547993933,4cyclictest2665288-21kworker/u8:2+flush-8:019:46:140
2680547993832,4cyclictest2886280-21kworker/u8:2+flush-8:022:56:120
2680554993733,3cyclictest2802499-21kworker/u8:2+events_unbound21:21:202
2680554993732,4cyclictest2936262-21kworker/u8:2+events_unbound00:36:122
2680554993732,4cyclictest2936262-21kworker/u8:2+events_unbound00:36:122
2680552993725,9cyclictest2970895-40logrotate00:00:001
2680547993731,4cyclictest2996073-21kworker/u8:1+flush-8:000:26:060
2680547993730,5cyclictest2936262-21kworker/u8:2+flush-8:000:16:150
2680554993629,5cyclictest2772597-21cron20:40:002
2680547993632,3cyclictest2738003-21kworker/u8:0+flush-8:020:36:080
2680547993631,3cyclictest2802499-21kworker/u8:2+flush-8:021:26:120
2680547993630,4cyclictest2831364-21kworker/u8:0+flush-8:023:21:150
2680547993629,4cyclictest2913543-21kworker/u8:3+events_unbound23:36:030
2680552993528,5cyclictest280-21systemd-journal22:46:451
2680552993523,8cyclictest2762277-21apt-get20:30:011
2680547993527,6cyclictest2915317-21ntpq23:01:160
2680547993524,9cyclictest2890302-21ntpq22:36:110
2680554993430,3cyclictest2670644-21kworker/u8:1+events_unbound23:00:012
2680554993328,3cyclictest2941285-21kworker/u8:0+events_unbound00:20:002
2680552993329,3cyclictest2685639-21systemctl19:15:011
2680552993326,5cyclictest2901938-21diskstats22:51:021
2680552993325,6cyclictest2817400-21apt-get21:25:591
2680547993328,3cyclictest2941285-21kworker/u8:0+flush-8:023:51:100
2680547993327,4cyclictest2670644-21kworker/u8:1+flush-8:020:11:040
2680547993327,3cyclictest2670644-21kworker/u8:1+events_unbound20:33:200
2680547993326,5cyclictest2831364-21kworker/u8:0+flush-8:022:31:080
2680547993322,5cyclictest2936262-21kworker/u8:2+events_unbound23:26:130
2680552993227,4cyclictest2757551-21kworker/u8:2+flush-8:020:41:161
2680552993227,2cyclictest0-21swapper/122:40:011
2680552993221,9cyclictest2965089-21ntpq23:51:121
2680547993227,4cyclictest2665288-21kworker/u8:2+events_unbound19:16:020
2680547993226,4cyclictest2913543-21kworker/u8:3+flush-8:023:11:120
2680547993224,6cyclictest3005734-21latency_hist00:35:010
2680554993123,6cyclictest280-21systemd-journal21:40:452
2680554993123,6cyclictest2762277-21apt-get20:30:002
2680552993125,5cyclictest2670644-21kworker/u8:1+flush-8:023:08:171
2680552993121,8cyclictest2811242-21ntpq21:16:121
2680547993127,3cyclictest2665288-21kworker/u8:2+flush-8:019:44:050
2680547993126,3cyclictest2670644-21kworker/u8:1+events_unbound20:51:050
2680547993125,4cyclictest2916549-21aten2_r5power_e23:06:040
2680547993124,5cyclictest2831364-21kworker/u8:0+events_unbound21:51:150
2680547993120,8cyclictest2685514-21latency_hist19:15:010
2680552993025,4cyclictest2670644-21kworker/u8:1+flush-8:021:01:161
2680552993025,3cyclictest2998334-21kthreadcore00:26:101
2680552993023,5cyclictest2842161-21apt-get21:50:581
2680547993026,2cyclictest2727441-21systemd-run19:55:000
2680547993025,3cyclictest2980807-21cat00:10:000
2680547993024,4cyclictest2670644-21kworker/u8:1+flush-8:022:41:030
2680547993022,6cyclictest2757320-21latency_hist20:25:010
2680547993019,9cyclictest2696643-21ntpq19:21:110
2680547993018,5cyclictest2941285-21kworker/u8:0+flush-8:000:11:110
2680554992923,4cyclictest2985356-21unixbench_multi00:11:252
2680554992921,6cyclictest280-21systemd-journal21:55:002
2680552992926,2cyclictest2722506-21systemd-run19:50:001
2680552992925,3cyclictest2799783-21kthreadcore21:06:091
2680552992921,6cyclictest2926368-21/usr/sbin/munin23:16:111
2680552992919,8cyclictest280-21systemd-journal00:25:001
2680547992924,3cyclictest2861592-21systemd-run22:10:000
2680547992923,4cyclictest2822053-21kworker/u8:3+flush-8:022:11:190
2680547992923,4cyclictest2822053-21kworker/u8:3+flush-8:022:11:190
2680547992922,5cyclictest280-21systemd-journal19:57:300
2680547992922,5cyclictest280-21systemd-journal00:39:250
2680547992922,5cyclictest280-21systemd-journal00:39:250
2680547992919,7cyclictest2870569-21ntpq22:16:140
2680547992919,7cyclictest2870569-21ntpq22:16:130
2680554992824,2cyclictest2788338-21irqcore20:56:052
2680554992823,3cyclictest2996073-21kworker/u8:1+events_unbound00:30:082
2680552992825,2cyclictest2762587-21latency_hist20:30:011
2680552992824,3cyclictest2951952-21irqrtprio23:41:061
2680552992824,2cyclictest2692537-21latency_hist19:20:011
2680552992822,4cyclictest280-21systemd-journal19:33:441
2680547992824,3cyclictest2913543-21kworker/u8:3+flush-8:000:01:200
2680547992822,4cyclictest2822053-21kworker/u8:3+flush-8:021:46:120
2680547992822,4cyclictest2777379-21kworker/u8:3+flush-8:020:50:000
268054799281,3cyclictest2712664-21munin-run19:40:000
2680554992724,2cyclictest2955469-21unixbench_multi23:41:192
2680554992723,2cyclictest2891833-21aten2_r5power_e22:41:022
2680552992724,2cyclictest2946000-21systemd-run23:35:001
2680552992720,5cyclictest2827295-21apt-get21:36:001
2680552992718,7cyclictest280-21systemd-journal22:09:591
2680547992722,3cyclictest2793268-21irqcore21:01:070
2680547992721,4cyclictest2822053-21kworker/u8:3+flush-8:022:01:080
2680547992721,4cyclictest2670644-21kworker/u8:1+flush-8:021:21:140
2680554992622,3cyclictest2757551-21kworker/u8:2+events_unbound20:31:152
2680554992622,2cyclictest2926480-21aten2_r5power_p23:16:012
2680554992622,2cyclictest2862004-21aten2_r5power_v22:11:022
2680554992622,2cyclictest2862004-21aten2_r5power_v22:11:022
2680554992621,4cyclictest2936262-21kworker/u8:2-ext4-rsv-conversion00:25:002
2680552992621,3cyclictest2780052-21kthreadcore20:46:171
2680552992619,5cyclictest2782816-21apt-get20:51:001
2680547992621,4cyclictest2702731-21kworker/u8:3+flush-8:019:31:100
2680547992621,3cyclictest2807622-21aten2_r5power_v21:16:000
2680547992618,6cyclictest2822053-21kworker/u8:3+events_unbound21:40:590
2680554992522,2cyclictest2712611-21cron19:40:002
2680554992520,3cyclictest2961366-21aten2_r5power_c23:51:022
2680554992520,3cyclictest2801864-21unixbench_multi21:06:202
2680554992519,4cyclictest2821082-21tail21:26:112
2680552992522,2cyclictest2975854-21cron00:05:001
2680552992520,3cyclictest0-21swapper/119:59:591
2680552992519,4cyclictest2841497-21unixbench_singl21:46:191
2680552992518,5cyclictest2806328-21ntpq21:11:131
2680552992515,8cyclictest280-21systemd-journal00:20:001
268055299250,9cyclictest2883238-21tr22:31:091
2680547992520,3cyclictest2941285-21kworker/u8:0+events_unbound23:46:030
26756562255,13sleep10-21swapper/119:06:001
2680554992421,2cyclictest2925719-21unixbench_singl23:11:182
2680554992420,3cyclictest2670644-21kworker/u8:1+flush-8:022:23:512
2680554992420,2cyclictest2876748-21aten2_r5power_e22:26:022
2680554992419,4cyclictest2970888-21dpkg-db-backup00:00:002
2680554992418,4cyclictest2736917-21unixbench_multi20:01:192
2680552992420,3cyclictest2886280-21kworker/u8:2+events_unbound22:56:091
2680552992420,2cyclictest0-21swapper/123:26:181
2680552992420,2cyclictest0-21swapper/120:01:011
2680552992420,2cyclictest0-21swapper/119:41:011
2680552992419,3cyclictest2856300-21unixbench_singl22:01:201
2680552992418,4cyclictest280-21systemd-journal00:07:041
2680547992420,3cyclictest2822053-21kworker/u8:3+events_unbound21:56:020
2680547992417,5cyclictest2913543-21kworker/u8:3+events_unbound23:16:180
2680547992414,4cyclictest2777379-21kworker/u8:3+flush-8:021:06:090
26792142242,15sleep02679311-21ntpq19:06:120
293591222315,5sleep30-21swapper/323:23:383
2680554992320,2cyclictest2727965-21cpuspeed_turbos19:56:032
2680554992319,3cyclictest2670644-21kworker/u8:1+flush-8:021:36:392
2680554992319,2cyclictest2743039-21cpuspeed_turbos20:11:032
2680552992320,2cyclictest2931715-21cut23:21:051
2680552992318,3cyclictest0-21swapper/123:11:071
2680552992313,8cyclictest2751573-21ntp_states20:16:151
28231092220,5chrt0-21swapper/221:31:082
2680554992219,2cyclictest2703341-21fschecks_time19:31:042
2680554992218,2cyclictest2941672-21fschecks_time23:31:052
2680554992214,6cyclictest2861578-21awk22:10:002
2680552992219,2cyclictest2946589-21cut23:36:031
2680552992218,2cyclictest0-21swapper/123:01:121
2680552992218,2cyclictest0-21swapper/121:31:191
2680552992218,2cyclictest0-21swapper/120:36:151
2680552992217,3cyclictest3010350-21unixbench_singl00:36:201
2680552992217,3cyclictest3010350-21unixbench_singl00:36:191
2680554992117,3cyclictest2665288-21kworker/u8:2+flush-8:020:05:502
2680554992117,2cyclictest2802864-21cut21:11:042
2680554992112,7cyclictest2855263-21tr22:01:102
2680552992117,3cyclictest2850976-21proc_pri21:56:171
2680552992117,2cyclictest0-21swapper/122:16:201
2680552992117,2cyclictest0-21swapper/122:16:201
2680552992116,3cyclictest0-21swapper/120:56:151
2680552992116,2cyclictest0-21swapper/123:46:031
268055499202,12cyclictest2717874-21apt-get19:46:012
2680554992017,2cyclictest0-21swapper/219:10:012
2680554992016,3cyclictest2822053-21kworker/u8:3+events_unbound21:45:062
2680554992013,5cyclictest2727528-21grep19:55:012
2680547992016,3cyclictest2875983-21unixbench_multi22:21:190
2680554991916,2cyclictest0-21swapper/219:25:012
2680554991916,1cyclictest0-21swapper/222:40:012
268055499191,2cyclictest161rcu_preempt22:51:192
268055499190,5cyclictest2811446-21taskset21:16:172
268055499190,2cyclictest161rcu_preempt00:01:212
268055499185,4cyclictest421rcuog/220:46:192
268055499182,11cyclictest2698089-21apt-get19:25:582
2680554991815,2cyclictest2946590-21fschecks_count23:36:042
2680554991814,2cyclictest0-21swapper/220:51:192
2680554991814,2cyclictest0-21swapper/219:41:172
2680554991811,5cyclictest0-21swapper/222:31:142
26755532182,8sleep30-21swapper/319:05:023
2680554991713,3cyclictest2913543-21kworker/u8:3+events_unbound23:26:212
2680554991713,2cyclictest2896974-21cpuspeed_turbos22:46:022
2680554991713,2cyclictest0-21swapper/220:21:042
2680554991711,4cyclictest0-21swapper/223:01:222
268055499170,2cyclictest421rcuog/221:05:012
268055499168,6cyclictest2916722-21grep23:06:042
268055499162,5cyclictest0-21swapper/223:45:042
2680554991613,2cyclictest2976246-21aten2_r5power_e00:06:022
2680554991611,3cyclictest2867051-21df_inode22:16:042
2680554991611,3cyclictest2867051-21df_inode22:16:032
27326752152,8sleep30-21swapper/320:01:003
29564252142,8sleep30-21swapper/323:46:013
30016432133,6sleep30-21swapper/300:31:073
29485022132,6sleep30-21swapper/323:36:103
29361752132,6sleep30-21swapper/323:25:023
29211232132,6sleep30-21swapper/323:10:013
29118272133,7sleep30-21swapper/323:01:063
28862872132,6sleep30-21swapper/322:35:023
28470772132,7sleep30-21swapper/321:56:003
27874512132,6sleep30-21swapper/320:55:023
27304052132,6sleep30-21swapper/319:56:113
27239402132,7sleep30-21swapper/319:51:173
30099022122,6sleep30-21swapper/300:36:173
30099022122,6sleep30-21swapper/300:36:173
29998752122,6sleep30-21swapper/300:26:143
29766902122,6sleep30-21swapper/300:06:073
29709222122,5sleep30-21swapper/300:00:013
29672812122,6sleep30-21swapper/323:56:083
29308202122,6sleep30-21swapper/323:17:483
28986052120,8sleep30-21swapper/322:46:103
28954142122,6sleep30-21swapper/322:41:123
28825132123,6sleep30-21swapper/322:31:093
28740902122,6sleep30-21swapper/322:21:103
28711862122,6sleep30-21swapper/322:17:003
28711862122,6sleep30-21swapper/322:17:003
28623482122,6sleep30-21swapper/322:11:063
28623482122,6sleep30-21swapper/322:11:063
28522082122,6sleep30-21swapper/322:01:033
28463872122,6sleep30-21swapper/321:51:203
28406832122,6sleep30-21swapper/321:46:103
28360402122,7sleep30-21swapper/321:41:123
28294472122,6sleep30-21swapper/321:36:113
28216262122,6sleep30-21swapper/321:26:203
28121852122,6sleep30-21swapper/321:20:023
27962002122,6sleep30-21swapper/321:01:123
27818762122,6sleep30-21swapper/320:46:273
27474462122,5sleep30-21swapper/320:15:013
27391952122,6sleep30-21swapper/320:06:103
27181222123,6sleep30-21swapper/319:46:033
27134322122,6sleep30-21swapper/319:41:063
27082582122,6sleep30-21swapper/319:36:053
27070362122,6sleep30-21swapper/319:31:193
27025152122,6sleep30-21swapper/319:27:463
26856182122,5sleep30-21swapper/319:15:023
29860282112,5sleep30-21swapper/300:15:583
29811422112,5sleep30-21swapper/300:11:093
29548472112,5sleep30-21swapper/323:41:103
29414352112,5sleep30-21swapper/323:31:043
29066272112,5sleep30-21swapper/322:56:013
29025722112,5sleep30-21swapper/322:51:063
28802752112,5sleep30-21swapper/322:26:113
28226502112,5sleep30-21swapper/321:31:053
28074572112,5sleep30-21swapper/321:15:413
28025482112,5sleep30-21swapper/321:10:593
27979372112,5sleep30-21swapper/321:06:053
27827682113,5sleep30-21swapper/320:50:443
27729522112,5sleep30-21swapper/320:41:013
27722032112,5sleep30-21swapper/320:36:193
27628422112,6sleep30-21swapper/320:31:023
27620912112,6sleep30-21swapper/320:27:453
27528962112,5sleep30-21swapper/320:21:033
27429832112,5sleep30-21swapper/320:11:043
26928992112,5sleep30-21swapper/319:21:003
26807582112,6sleep30-21swapper/319:10:273
29252602101,5sleep30-21swapper/323:11:143
28568632102,5sleep30-21swapper/322:05:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional