You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 09:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sun May 24, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277014922020,6sleep30-21swapper/322:15:523
262699022010,3sleep375-21kworker/3:1+events19:50:543
262699022010,3sleep375-21kworker/3:1+events19:50:543
2582435997868,7cyclictest2713672-21latency_hist21:20:010
2582435997868,7cyclictest2713672-21latency_hist21:20:010
2582435996963,5cyclictest2787999-21kworker/u8:3+flush-8:000:01:030
2582435996661,4cyclictest2862521-21kworker/u8:2+flush-8:000:26:030
2582435996459,4cyclictest2638403-21kworker/u8:1+flush-8:021:26:010
2582435996458,4cyclictest2693654-21kworker/u8:0+flush-8:021:21:010
2582437996351,9cyclictest2851831-21ntpq23:36:021
2582435996358,4cyclictest2638403-21kworker/u8:1+flush-8:020:36:000
2582435996256,4cyclictest2589445-21kworker/u8:1+events_unbound19:15:460
2582435996157,3cyclictest2842889-21kworker/u8:0+flush-8:023:46:020
2582435996157,3cyclictest2787999-21kworker/u8:3+flush-8:022:36:020
2582435996056,3cyclictest2628451-21kworker/u8:3+flush-8:019:56:020
2582435996054,4cyclictest2638403-21kworker/u8:1+events_unbound22:20:000
2582435995955,3cyclictest2892537-21kworker/u8:1+events_unbound00:21:030
2582435995955,3cyclictest2638403-21kworker/u8:1+flush-8:021:01:010
2582435995854,3cyclictest2638403-21kworker/u8:1+flush-8:020:16:000
2582435995853,3cyclictest2638403-21kworker/u8:1+events_unbound21:30:510
2582435995752,4cyclictest2787999-21kworker/u8:3+events_unbound00:00:010
2582435995752,3cyclictest2638403-21kworker/u8:1+events_unbound21:10:470
2582435995751,4cyclictest2638403-21kworker/u8:1+events_unbound21:45:460
2582435995751,4cyclictest2618556-21kworker/u8:2+events_unbound19:51:000
2582435995751,4cyclictest2618556-21kworker/u8:2+events_unbound19:51:000
2582435995751,4cyclictest2589445-21kworker/u8:1+events_unbound19:25:460
2582437995648,6cyclictest2638403-21kworker/u8:1+flush-8:021:16:021
2582437995648,6cyclictest2638403-21kworker/u8:1+flush-8:021:16:021
2582435995652,3cyclictest2534903-21kworker/u8:3+events_unbound19:20:450
2582435995650,4cyclictest2693654-21kworker/u8:0+events_unbound21:40:590
2582435995649,5cyclictest2787999-21kworker/u8:3+events_unbound23:06:000
2582435995647,7cyclictest2744085-21diskstats21:50:500
2582437995545,7cyclictest2813004-21latency_hist23:00:011
2582435995551,3cyclictest2770957-21kworker/u8:2+flush-8:023:26:010
2582435995550,4cyclictest2693654-21kworker/u8:0+events_unbound22:06:030
2582435995549,4cyclictest2638403-21kworker/u8:1+flush-8:020:20:460
2582435995549,4cyclictest2628451-21kworker/u8:3+flush-8:020:30:020
2582437995444,8cyclictest2598205-21ntpq19:20:561
2582435995450,3cyclictest2770957-21kworker/u8:2+events_unbound22:41:010
2582435995448,4cyclictest2534903-21kworker/u8:3+events_unbound19:36:000
2582435995447,5cyclictest2649273-21kworker/u8:2+events_unbound20:26:010
2582435995444,7cyclictest2678560-21latency_hist20:45:010
2582437995347,5cyclictest2534903-21kworker/u8:3+flush-8:019:40:471
2582435995349,3cyclictest2628451-21kworker/u8:3+flush-8:020:06:030
2582435995348,4cyclictest2787999-21kworker/u8:3+flush-8:023:20:470
2582435995347,4cyclictest2872692-21kworker/u8:5+events_unbound00:06:000
2582437995242,8cyclictest2632819-21ntpq19:55:571
2582435995248,3cyclictest2770957-21kworker/u8:2+events_unbound22:51:040
2582435995246,4cyclictest2842889-21kworker/u8:0+events_unbound23:35:480
2582435995246,4cyclictest2628451-21kworker/u8:3+events_unbound20:00:460
2582437995147,3cyclictest2673614-21kworker/u8:2+events_unbound20:40:011
2582437995046,3cyclictest2693654-21kworker/u8:0+flush-8:022:45:551
2582435995046,3cyclictest2693654-21kworker/u8:0+flush-8:022:26:030
2582435995044,4cyclictest2628451-21kworker/u8:3+events_unbound20:50:010
2582435995044,3cyclictest2693654-21kworker/u8:0+events_unbound21:35:560
2582437994943,4cyclictest2708722-21kworker/u8:3+events_unbound21:55:011
2582437994942,5cyclictest2628451-21kworker/u8:3+flush-8:020:55:561
2582437994939,8cyclictest2911405-21ntpq00:35:571
2582435994945,3cyclictest2693654-21kworker/u8:0+flush-8:022:20:570
2582435994944,4cyclictest2534903-21kworker/u8:3+events_unbound19:30:450
2582435994943,5cyclictest2770957-21kworker/u8:2+events_unbound23:15:590
2582437994841,5cyclictest2638403-21kworker/u8:1+flush-8:020:50:481
2582435994843,3cyclictest2842889-21kworker/u8:0+events_unbound23:50:570
2582435994842,4cyclictest2589445-21kworker/u8:1+events_unbound19:45:580
2582437994741,5cyclictest2628451-21kworker/u8:3+flush-8:020:30:581
2582437994741,4cyclictest2693654-21kworker/u8:0+flush-8:022:20:491
2582437994738,7cyclictest2862521-21kworker/u8:2+flush-8:000:15:581
2582435994743,3cyclictest2842889-21kworker/u8:0+events_unbound23:31:000
2582435994743,3cyclictest2787999-21kworker/u8:3+flush-8:023:11:010
2582437994641,4cyclictest2708722-21kworker/u8:3+flush-8:021:55:461
2582437994637,6cyclictest1704890-21systemd-journal23:56:361
2582435994642,3cyclictest2892537-21kworker/u8:1+events_unbound00:36:000
2582435994641,3cyclictest2534903-21kworker/u8:3+events_unbound19:40:510
2582435994638,6cyclictest2906496-21ntpq00:30:570
2582437994535,5cyclictest2842889-21kworker/u8:0+flush-8:023:41:021
2582437994535,5cyclictest2842889-21kworker/u8:0+flush-8:023:41:021
2582435994541,3cyclictest2693654-21kworker/u8:0+events_unbound22:11:030
2582435994539,3cyclictest2693654-21kworker/u8:0+events_unbound22:30:430
2582435994535,7cyclictest2798504-21/usr/sbin/munin22:45:540
2582437994438,4cyclictest2649273-21kworker/u8:2+flush-8:020:21:021
2582435994440,3cyclictest2787999-21kworker/u8:3+events_unbound22:55:460
2582435994440,3cyclictest2638403-21kworker/u8:1+events_unbound20:50:590
2582435994440,3cyclictest2628451-21kworker/u8:3+flush-8:020:56:020
2582437994338,3cyclictest2787999-21kworker/u8:3+events_unbound23:20:491
2582437994237,3cyclictest2693654-21kworker/u8:0+events_unbound21:45:501
2582437994236,5cyclictest2770957-21kworker/u8:2+flush-8:023:00:511
2582435994238,3cyclictest2842889-21kworker/u8:0+events_unbound23:41:030
2582435994238,3cyclictest2842889-21kworker/u8:0+events_unbound23:41:020
27081382410,6sleep30-21swapper/321:11:033
2582437994136,4cyclictest2628451-21kworker/u8:3+flush-8:020:00:491
2582437994135,5cyclictest2770957-21kworker/u8:2+flush-8:022:40:581
2582437994135,4cyclictest1511211-21kworker/u8:2+events_unbound19:15:011
2582437994134,6cyclictest2693654-21kworker/u8:0+flush-8:022:00:471
2582435994137,3cyclictest2872692-21kworker/u8:5+flush-8:000:10:480
2582435994135,4cyclictest2693654-21kworker/u8:0+events_unbound22:00:570
2582437994035,3cyclictest2698603-21apt-get21:05:031
2582437994034,4cyclictest2638403-21kworker/u8:1+flush-8:021:30:491
2582437994030,8cyclictest2737504-21ntpq21:40:561
25820492404,11sleep10-21swapper/119:07:351
2582437993929,7cyclictest2828131-21/usr/sbin/munin23:16:011
2582437993833,4cyclictest2628451-21kworker/u8:3+flush-8:020:41:031
2582437993833,3cyclictest2787999-21kworker/u8:3+events_unbound22:35:461
2582437993832,4cyclictest2787999-21kworker/u8:3+events_unbound00:01:001
2582437993830,6cyclictest2618556-21kworker/u8:2+events_unbound20:06:001
2582435993834,3cyclictest2708722-21kworker/u8:3+events_unbound21:55:500
2582437993728,6cyclictest2902178-21apt-get00:30:001
2582437993631,4cyclictest2628451-21kworker/u8:3+flush-8:020:46:031
2582437993630,5cyclictest2787999-21kworker/u8:3+events_unbound23:11:011
2582437993627,7cyclictest2807195-21ntpq22:50:591
2582435993631,4cyclictest2628451-21kworker/u8:3+flush-8:020:10:510
2582437993530,4cyclictest2534903-21kworker/u8:3+flush-8:019:30:481
2582435993532,1cyclictest2817981-21latency_hist23:05:010
2582435993531,3cyclictest2872692-21kworker/u8:5+events_unbound00:18:380
2582441993425,7cyclictest2733431-21awk21:40:012
2582437993429,3cyclictest2663496-21apt-config20:30:011
2582437993429,3cyclictest2638403-21kworker/u8:1+flush-8:022:30:471
2582437993428,4cyclictest2693654-21kworker/u8:0+flush-8:022:11:011
2582435993430,3cyclictest1170318-21kworker/u8:0+flush-8:019:10:560
25819732344,9sleep20-21swapper/219:06:362
2582437993328,3cyclictest1511211-21kworker/u8:2+events_unbound19:15:031
2582437993326,5cyclictest2838028-21apt-get23:25:431
2582437993228,3cyclictest2886459-21kworker/u8:0+events_unbound00:25:011
2582437993228,3cyclictest2822919-21systemd-run23:10:011
2582437993227,4cyclictest2693654-21kworker/u8:0+flush-8:021:21:021
2582437993225,5cyclictest2534903-21kworker/u8:3+flush-8:019:36:011
2582435993223,7cyclictest2699105-21/usr/sbin/munin21:05:540
2582441993125,4cyclictest1704890-21systemd-journal20:12:592
2582437993126,3cyclictest2706244-21kthreadcore21:10:531
2582437993125,4cyclictest2628451-21kworker/u8:3+flush-8:020:11:001
2582441993025,3cyclictest2582653-21aten2_r5power_c19:10:442
2582437993025,4cyclictest2770957-21kworker/u8:2+events_unbound22:16:031
2582437993025,3cyclictest2622863-21needreboot19:45:561
2582437993020,8cyclictest2861625-21ntpq23:45:561
2582441992926,2cyclictest2613939-21sendmail19:40:002
2582441992925,2cyclictest2862895-21aten2_r5power_p23:50:472
2582437992923,5cyclictest2534903-21kworker/u8:3+flush-8:019:25:521
2582437992921,5cyclictest2723556-21latency_hist21:30:021
2582441992824,2cyclictest2868116-21fschecks_time23:55:492
258244199280,26cyclictest1-21systemd00:20:012
2582437992825,1cyclictest2638403-21kworker/u8:1+events_unbound20:16:001
2582437992824,3cyclictest2759296-21irqcore22:05:531
2582437992823,3cyclictest2618556-21kworker/u8:2+flush-8:019:51:021
2582437992823,3cyclictest2618556-21kworker/u8:2+flush-8:019:51:011
2582437992822,5cyclictest2892537-21kworker/u8:1+events_unbound00:30:561
2582441992724,2cyclictest2733813-21aten2_r5power_p21:40:442
2582441992723,3cyclictest2886459-21kworker/u8:0+flush-8:000:11:022
2582441992723,2cyclictest2872794-21aten2_r5power_e00:00:462
2582437992721,5cyclictest2842889-21kworker/u8:0+flush-8:023:31:021
2582437992721,5cyclictest2638403-21kworker/u8:1+flush-8:021:00:571
2582437992720,4cyclictest0-21swapper/123:50:581
2582437992620,5cyclictest2638403-21kworker/u8:1+flush-8:022:25:491
2582437992615,8cyclictest2882386-21latency_hist00:10:011
2582441992522,2cyclictest2589784-21fschecks_count19:15:462
2582441992520,3cyclictest2907874-21cpuspeed_turbos00:35:462
2582441992520,3cyclictest2892906-21fschecks_count00:20:502
2582441992517,5cyclictest2663870-21cat20:30:002
2582435992518,3cyclictest0-21swapper/019:10:000
28744072240,3sleep375-21kworker/3:1+events00:00:533
2582441992420,3cyclictest2818555-21fschecks_count23:05:472
2582441992419,4cyclictest2614522-21cut19:40:482
2582441992418,4cyclictest2902180-21munin-run00:30:002
2582437992422,1cyclictest2708722-21kworker/u8:3+events_unbound21:36:051
258244199237,3cyclictest28060572tr22:50:562
2582441992320,2cyclictest2772803-21unixbench_multi22:16:022
2582441992320,2cyclictest2694025-21aten2_r5power_p21:00:452
2582441992320,2cyclictest2689300-21fschecks_time20:55:482
2582441992320,2cyclictest2629182-21aten2_r5power_v19:55:472
2582441992320,2cyclictest2603658-21unixbench_multi19:26:022
2582441992319,2cyclictest2619526-21fschecks_time19:45:492
2582441992319,2cyclictest0-21swapper/223:39:592
2582441992219,2cyclictest2798844-21fschecks_time22:45:472
2582441992219,2cyclictest2674118-21cpuspeed_turbos20:40:442
258244199212,18cyclictest0-21swapper/220:31:012
2582441992117,3cyclictest2827445-21unixbench_multi23:11:032
2582441992117,2cyclictest2748514-21munin-run21:55:002
2582441992116,4cyclictest2728111-21unixbench_singl21:31:042
2582441992115,2cyclictest0-21swapper/222:20:462
2582437992117,2cyclictest0-21swapper/100:10:551
26420522200,3chrt451irq_work/320:05:553
258244199202,2cyclictest0-21swapper/223:21:032
258244199202,13cyclictest2877763-21apt-get00:05:442
2582441992017,2cyclictest2714305-21fschecks_time21:20:492
2582441992016,2cyclictest2679443-21fschecks_time20:45:472
2582441992016,2cyclictest0-21swapper/222:40:002
258244199192,16cyclictest0-21swapper/221:06:012
2582441991916,2cyclictest2813393-21aten2_r5power_e23:00:472
2582441991915,2cyclictest0-21swapper/222:55:452
2582441991915,2cyclictest0-21swapper/222:10:532
2582441991915,2cyclictest0-21swapper/222:05:582
2582441991913,4cyclictest2684108-21aten2_r5power_e20:50:452
25782072192,9sleep30-21swapper/319:05:533
258244199189,4cyclictest2778886-21/usr/sbin/munin22:25:472
2582441991815,2cyclictest2604592-21cpuspeed_turbos19:30:462
2582441991812,4cyclictest2753003-21unixbench_multi21:56:032
258244199179,6cyclictest2860011-21cat23:45:522
258244199178,7cyclictest2755118-21cut22:00:522
258244199178,7cyclictest2671950-21tr20:35:522
258244199175,4cyclictest0-21swapper/222:30:512
258244199172,11cyclictest2704819-21ps21:10:522
2582441991714,2cyclictest2719214-21fschecks_count21:25:462
2582441991713,2cyclictest0-21swapper/223:30:002
2582441991713,2cyclictest0-21swapper/223:15:472
2582441991713,2cyclictest0-21swapper/219:21:032
2582441991712,3cyclictest0-21swapper/220:20:012
258244199171,12cyclictest2905565-21kthreadcore00:30:542
258244199170,5cyclictest2853865-21kthreadcore23:40:512
258244199170,5cyclictest2853865-21kthreadcore23:40:512
27753102167,6sleep30-21swapper/322:20:543
258244199167,7cyclictest2639757-21sed20:05:522
2582441991613,2cyclictest0-21swapper/221:46:042
2582441991612,2cyclictest0-21swapper/223:35:002
2582441991611,4cyclictest2582429-21cyclictest22:41:032
2582441991611,3cyclictest2627945-21ntpq19:50:592
2582441991611,3cyclictest2627945-21ntpq19:50:592
2582441991610,4cyclictest0-21swapper/220:20:552
2582441991510,3cyclictest0-21swapper/221:15:522
2582441991510,3cyclictest0-21swapper/221:15:512
2582441991510,3cyclictest0-21swapper/220:00:552
28914032142,8sleep30-21swapper/300:15:583
28219782132,8sleep30-21swapper/323:05:553
27982432132,6sleep30-21swapper/322:45:023
27486522132,6sleep30-21swapper/321:55:023
27236042132,6sleep30-21swapper/321:30:023
26889582132,7sleep30-21swapper/320:55:433
26491472132,7sleep30-21swapper/320:15:473
29066832122,6sleep30-21swapper/300:31:033
28972312122,5sleep30-21swapper/300:25:013
28926202122,6sleep30-21swapper/300:20:473
28714192122,6sleep30-21swapper/323:55:563
28615982122,6sleep30-21swapper/323:45:573
28529092123,5sleep30-21swapper/323:40:433
28529092123,5sleep30-21swapper/323:40:433
28476762122,5sleep30-21swapper/323:35:023
28432082122,6sleep30-21swapper/323:30:483
28380002122,6sleep30-21swapper/323:25:433
28272192122,6sleep30-21swapper/323:11:023
28038192122,6sleep30-21swapper/322:50:513
27978952122,6sleep30-21swapper/322:41:053
27682532122,6sleep30-21swapper/322:15:003
27591832122,6sleep30-21swapper/322:05:543
27477442122,6sleep30-21swapper/321:51:053
27324602122,6sleep30-21swapper/321:35:563
27186062122,6sleep30-21swapper/321:25:013
27129652122,6sleep30-21swapper/321:16:023
27129652122,6sleep30-21swapper/321:16:013
26960962122,6sleep30-21swapper/321:00:523
26844712122,6sleep30-21swapper/320:50:503
26790142122,6sleep30-21swapper/320:45:033
26780342122,6sleep30-21swapper/320:41:033
26588032122,6sleep30-21swapper/320:25:383
26574322122,6sleep30-21swapper/320:20:573
26344392122,6sleep30-21swapper/320:00:503
26327462122,6sleep30-21swapper/319:55:563
26188952122,6sleep30-21swapper/319:45:003
26132932122,6sleep30-21swapper/319:36:023
25942112122,5sleep30-21swapper/319:20:013
25898922122,6sleep30-21swapper/319:15:483
25824912122,5sleep30-21swapper/319:10:023
29121572112,5sleep30-21swapper/300:38:373
28865192112,6sleep30-21swapper/300:11:013
28813242112,5sleep30-21swapper/300:05:543
28630952112,6sleep30-21swapper/323:50:503
28336672112,5sleep30-21swapper/323:20:523
28324862112,6sleep30-21swapper/323:16:363
28132512112,5sleep30-21swapper/323:00:033
28084022111,6sleep30-21swapper/322:55:453
27919082112,5sleep30-21swapper/322:35:543
27833932112,5sleep30-21swapper/322:30:013
27786422112,5sleep30-21swapper/322:25:043
27536802112,6sleep30-21swapper/322:00:153
27433082113,5sleep30-21swapper/321:47:233
27337322112,5sleep30-21swapper/321:40:463
27177712112,5sleep30-21swapper/321:20:593
26990512112,5sleep30-21swapper/321:05:023
26689492112,5sleep30-21swapper/320:35:453
26684442112,6sleep30-21swapper/320:32:403
26439442112,5sleep30-21swapper/320:10:443
26142122112,5sleep30-21swapper/319:40:443
26039342112,6sleep30-21swapper/319:28:283
26042932102,5sleep30-21swapper/319:30:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional