You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 05:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Aug 10, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28369302690,2sleep3575-21kworker/3:2-events19:55:003
2790443995939,17cyclictest275-21systemd-journal19:43:041
2790439995443,8cyclictest3025012-21latency_hist23:05:000
2790439995140,8cyclictest275-21systemd-journal22:25:010
2790443994938,8cyclictest2955717-21latency_hist21:55:021
2790439994331,10cyclictest2817837-21diskstats19:37:490
2790443994031,7cyclictest275-21systemd-journal19:15:011
2790443994031,6cyclictest2896175-21latency_hist20:55:011
2790443994026,12cyclictest3104602-21systemd-run00:25:001
2790439994031,6cyclictest2817356-21kworker/u8:1+flush-8:019:58:030
2790446993934,4cyclictest2955946-21kworker/u8:1+flush-8:022:33:002
2790439993929,8cyclictest2817356-21kworker/u8:1+flush-8:020:03:040
2790439993929,8cyclictest2817356-21kworker/u8:1+flush-8:020:03:040
2790439993928,8cyclictest275-21systemd-journal22:35:000
2790443993828,7cyclictest2960700-21latency_hist22:00:011
2790443993827,9cyclictest3006380-21irqrtprio22:47:521
2790439993828,7cyclictest3069486-21grep23:48:040
2790443993726,9cyclictest3077254-21kthreadcore23:57:541
2790443993716,18cyclictest3030181-21latency_hist23:10:011
2790443993711,13cyclictest0-21swapper/123:14:021
2790439993731,5cyclictest3064086-21kworker/u8:0+flush-8:000:05:010
279044399364,6cyclictest0-21swapper/119:22:471
2790443993620,15cyclictest3064086-21kworker/u8:0-ext4-rsv-conversion00:30:001
2790443993613,11cyclictest0-21swapper/122:08:221
2790446993529,4cyclictest2812195-21munin-plugin-st19:30:002
2790443993517,16cyclictest2906054-21systemd-run21:05:001
2790443993517,16cyclictest0-21swapper/120:10:001
2790443993510,12cyclictest0-21swapper/119:16:571
279044399348,14cyclictest0-21swapper/123:28:101
279044399343,5cyclictest0-21swapper/122:52:451
2790443993428,4cyclictest20823-21cron21:00:001
2790443993422,10cyclictest0-21swapper/121:20:001
2790443993419,13cyclictest2941321-21apt-get21:42:421
2790443993418,14cyclictest0-21swapper/119:40:001
2790443993417,15cyclictest2881326-21cron20:40:011
2790443993417,15cyclictest0-21swapper/123:35:001
2790443993417,15cyclictest0-21swapper/119:58:061
2790443993415,17cyclictest0-21swapper/122:03:001
2790443993415,17cyclictest0-21swapper/121:37:591
2790446993328,3cyclictest3000288-21kworker/u8:2+flush-8:023:30:002
2790446993327,4cyclictest2846542-21unixbench_singl20:03:072
2790446993327,4cyclictest2846542-21unixbench_singl20:03:072
2790446993323,7cyclictest2921064-21awk21:20:002
279044399334,4cyclictest0-21swapper/121:07:451
279044399334,4cyclictest0-21swapper/121:07:451
2790443993325,6cyclictest2980914-21apt-get22:22:431
2790443993323,7cyclictest2995296-21latency_hist22:35:011
2790443993317,14cyclictest0-21swapper/100:07:501
2790443993316,15cyclictest0-21swapper/122:58:011
2790443993316,15cyclictest0-21swapper/122:43:021
2790443993315,16cyclictest0-21swapper/122:12:511
2790443993315,16cyclictest0-21swapper/122:12:511
2790439993324,7cyclictest2865835-21ntpq20:22:580
2790439993324,7cyclictest2816464-21ntpq19:32:590
279044399323,6cyclictest0-21swapper/100:17:441
279044399322,12cyclictest2911412-21apt-get21:12:441
2790443993221,10cyclictest2927062-21sort21:27:521
2790443993218,12cyclictest2890941-21unixbench_multi20:48:051
2790443993218,12cyclictest0-21swapper/120:27:521
2790443993217,13cyclictest1-21systemd23:16:071
2790443993217,13cyclictest0-21swapper/119:50:001
2790443993216,14cyclictest0-21swapper/121:32:481
2790443993216,14cyclictest0-21swapper/121:22:571
2790443993216,14cyclictest0-21swapper/120:17:591
2790443993216,14cyclictest0-21swapper/120:03:011
2790443993216,14cyclictest0-21swapper/120:03:011
2790443993215,15cyclictest0-21swapper/120:43:031
2790439993227,3cyclictest2807304-21systemd-run19:25:010
279043999320,30cyclictest3079657-21munin-run00:00:010
2790446993127,3cyclictest2955946-21kworker/u8:1+flush-8:023:32:582
2790446993126,4cyclictest2980476-21kworker/u8:3+flush-8:022:42:522
279044399318,6cyclictest3118809-21ntpq00:38:011
2790443993118,11cyclictest0-21swapper/121:47:491
2790443993115,14cyclictest0-21swapper/120:23:031
2790443993114,15cyclictest0-21swapper/123:52:541
2790443993113,16cyclictest0-21swapper/123:42:581
2790443993113,15cyclictest2875645-21ntpq20:32:571
2790443993112,2cyclictest0-21swapper/100:32:551
2790443993112,2cyclictest0-21swapper/100:13:081
2790439993126,3cyclictest3060355-21aten2_r5power_p23:42:460
2790439993126,3cyclictest2988935-21kthreadcore22:27:550
2790439993126,3cyclictest2961526-21fschecks_time22:02:480
2790439993126,3cyclictest2882117-21fschecks_time20:42:490
2790439993125,4cyclictest2916057-21apt-key21:15:000
279044399303,6cyclictest0-21swapper/123:47:471
279044399303,5cyclictest0-21swapper/119:32:451
2790443993014,14cyclictest3044533-21switchtime23:23:041
2790443993014,14cyclictest2856444-21unixbench_singl20:13:061
2790443993011,17cyclictest2807853-21cpu19:27:471
2790439993024,4cyclictest3115704-21sed00:37:520
2790439993023,5cyclictest3074623-21cron23:55:000
2790439993023,5cyclictest2930929-21latency_hist21:30:010
2790439993022,5cyclictest3114271-21grep00:33:090
2790439993021,6cyclictest275-21systemd-journal23:05:010
2790439993020,8cyclictest2831251-21ntpq19:48:010
27855632304,9sleep20-21swapper/219:05:212
2790446992924,3cyclictest3015904-21fschecks_time22:57:482
2790446992924,3cyclictest2975992-21aten2_r5power_c22:17:462
279044399297,3cyclictest0-21swapper/122:15:441
2790443992915,12cyclictest0-21swapper/122:27:471
2790443992913,14cyclictest0-21swapper/122:35:061
2790443992912,2cyclictest0-21swapper/123:02:551
2790443992911,2cyclictest0-21swapper/123:38:031
2790443992911,2cyclictest0-21swapper/123:38:021
2790443992910,2cyclictest0-21swapper/119:52:531
2790439992922,5cyclictest2861576-21cron20:20:000
2790439992916,3cyclictest0-21swapper/019:42:520
29189922280,6sleep3471rcuc/321:17:583
2790446992824,3cyclictest3064086-21kworker/u8:0+flush-8:000:08:102
2790446992824,2cyclictest3014840-21unixbench_multi22:53:042
2790446992823,4cyclictest3075445-21fschecks_time23:57:492
279044399288,4cyclictest0-21swapper/100:02:491
2790439992822,4cyclictest2795283-21unixbench_singl19:13:050
2790439992821,5cyclictest2851692-21latency_hist20:10:000
2790446992723,3cyclictest3024860-21kworker/u8:3+events_unbound00:03:182
2790439992722,3cyclictest2867921-21kthreadcore20:27:530
2790439992721,4cyclictest3024860-21kworker/u8:3+events_unbound23:13:030
2790439992719,6cyclictest2832659-21diskstats19:52:480
2790446992623,2cyclictest3114311-21unixbench_singl00:33:082
2790446992622,3cyclictest3035865-21fschecks_count23:17:492
2790446992622,3cyclictest2955501-21unixbench_singl21:53:062
2790446992622,2cyclictest2946315-21aten2_r5power_c21:47:482
2790446992622,2cyclictest2936435-21aten2_r5power_p21:37:502
279044699260,10cyclictest28858802threads20:43:042
2790439992622,3cyclictest2808269-21sort19:27:520
2790439992622,2cyclictest2935643-21unixbench_multi21:33:040
2790439992622,2cyclictest0-21swapper/020:40:000
2790439992620,4cyclictest3064086-21kworker/u8:0+flush-8:000:28:030
2790439992619,5cyclictest2896627-21apt-get20:57:430
2790439992617,7cyclictest2999487-21ntpq22:37:550
2790439992616,7cyclictest2950784-21latency_hist21:50:010
2790446992522,2cyclictest2867223-21cpuspeed_turbos20:27:482
2790439992521,3cyclictest2891207-21kworker/u8:1+flush-8:021:18:060
2790439992520,4cyclictest2738211-21kworker/u8:2+events_unbound19:15:050
2790439992520,3cyclictest1-21systemd21:40:000
2790446992421,2cyclictest3070218-21aten2_r5power_e23:52:462
2790439992420,3cyclictest401-21dbus-daemon21:10:000
2790439992420,3cyclictest401-21dbus-daemon21:10:000
2790439992419,3cyclictest0-21swapper/020:52:560
2790439992418,4cyclictest3104338-21unixbench_multi00:23:050
2790439992416,6cyclictest3094692-21kworker/u8:3+flush-8:000:18:020
2790439992416,6cyclictest2956443-21fschecks_count21:57:490
2790439992416,5cyclictest2980435-21latency_hist22:20:000
2790439992413,9cyclictest2951490-21diskstats21:52:500
279044699238,3cyclictest28723132cat20:32:502
2790446992320,2cyclictest2892000-21fschecks_time20:52:492
2790446992320,2cyclictest2876877-21aten2_r5power_c20:37:462
2790446992319,2cyclictest2798112-21fschecks_count19:17:482
2790446992318,3cyclictest2827819-21tune2fs19:47:512
2790446992314,7cyclictest2837637-21fschecks_time19:57:502
279043999233,15cyclictest0-21swapper/023:22:450
2790439992318,3cyclictest0-21swapper/022:47:510
2790439992317,4cyclictest2924777-21kthreadcore21:22:560
2790439992315,5cyclictest3059527-21grep23:38:060
2790439992315,5cyclictest3059527-21grep23:38:060
2790439992314,7cyclictest2901539-21/usr/sbin/munin21:02:590
2790446992218,3cyclictest2965644-21cron22:05:002
2790446992218,2cyclictest2861574-21cron20:20:002
2790446992218,2cyclictest2791215-21cpuspeed_turbos19:12:482
279044399224,4cyclictest0-21swapper/119:10:011
2790439992210,10cyclictest275-21systemd-journal20:11:050
308172422112,5sleep30-21swapper/300:02:543
2790446992118,2cyclictest2996059-21fschecks_time22:37:492
2790446992117,2cyclictest0-21swapper/223:22:572
2790446992117,2cyclictest0-21swapper/222:30:002
2790446992117,2cyclictest0-21swapper/221:22:582
2790446992116,4cyclictest2955946-21kworker/u8:1+events_unbound22:05:062
2790446992115,4cyclictest2935623-21unixbench_multi21:33:042
2790446992115,4cyclictest2821329-21/usr/sbin/munin19:37:572
2790446992113,6cyclictest2910714-21unixbench_multi21:08:052
2790446992113,6cyclictest2910714-21unixbench_multi21:08:052
2790439992117,2cyclictest0-21swapper/023:32:480
2790439992117,2cyclictest0-21swapper/023:20:000
2790439992116,3cyclictest0-21swapper/000:08:120
2790446992016,3cyclictest3100353-21cpuspeed_turbos00:22:482
2790446992016,3cyclictest3065446-21cpuspeed_turbos23:47:472
2790446992015,3cyclictest0-21swapper/220:08:102
2790446992011,7cyclictest3117813-21tr00:37:562
279043999202,12cyclictest571-21snmpd21:42:590
279043999202,11cyclictest571-21snmpd22:57:450
2790439992016,2cyclictest0-21swapper/022:55:000
2790439992014,4cyclictest2890972-21grep20:48:060
279044699197,9cyclictest3060269-21apt-get23:42:452
2790446991916,2cyclictest3099398-21unixbench_multi00:18:042
2790446991916,2cyclictest3025733-21aten2_r5power_c23:07:462
2790446991915,2cyclictest2864331-21cut20:22:542
279043999199,2cyclictest0-21swapper/023:27:580
2790439991915,3cyclictest3093798-21missed_timers00:13:000
2790439991915,3cyclictest0-21swapper/022:12:060
2790439991915,3cyclictest0-21swapper/022:12:060
2790439991915,2cyclictest0-21swapper/020:35:010
2790439991912,5cyclictest275-21systemd-journal22:09:230
28129352180,6sleep20-21swapper/219:32:482
2790446991814,2cyclictest0-21swapper/223:37:542
2790446991814,2cyclictest0-21swapper/223:37:542
2790446991814,2cyclictest0-21swapper/222:47:572
2790446991814,2cyclictest0-21swapper/200:27:552
2790446991813,2cyclictest0-21swapper/219:42:012
279044699181,2cyclictest28889131kthreadcore20:47:552
2790446991812,4cyclictest2911630-21tr21:12:472
2790446991810,6cyclictest3022901-21tr23:02:552
2790439991812,4cyclictest0-21swapper/022:42:530
27856192182,9sleep30-21swapper/319:06:063
279044699179,6cyclictest2905591-21grep21:03:072
279044699179,6cyclictest2854538-21tr20:12:552
279044699178,7cyclictest2985505-21sed22:25:012
2790446991713,2cyclictest0-21swapper/223:13:032
2790446991711,4cyclictest0-21swapper/219:22:572
28657922166,6sleep30-21swapper/320:22:583
279044699167,7cyclictest2958799-21tr21:57:542
2790446991612,2cyclictest2900001-21kthreadcore20:57:542
2790446991612,2cyclictest0-21swapper/222:10:092
2790446991612,2cyclictest0-21swapper/222:10:092
27856932163,8sleep00-21swapper/019:07:030
279044699157,6cyclictest2832422-21cut19:52:462
279044699153,7cyclictest2945141-21ntpq21:42:572
2790446991511,2cyclictest0-21swapper/221:27:492
279044699151,11cyclictest3090194-21apt-get00:12:502
30412812142,8sleep30-21swapper/323:22:543
30257042147,5sleep30-21swapper/323:07:453
29358732142,8sleep30-21swapper/321:35:003
28558682142,8sleep30-21swapper/320:12:593
28220502142,6sleep30-21swapper/319:40:013
31145042132,7sleep30-21swapper/300:35:003
31070822130,2sleep3471rcuc/300:27:533
30947292132,6sleep30-21swapper/300:15:023
30173992133,6sleep30-21swapper/322:57:543
30094262132,7sleep30-21swapper/322:47:593
29500692130,9sleep30-21swapper/321:48:003
29409552132,6sleep30-21swapper/321:40:023
29402132132,7sleep30-21swapper/321:38:053
29003302132,7sleep30-21swapper/320:57:573
28122182132,6sleep30-21swapper/319:30:023
27954842130,8sleep30-21swapper/319:15:013
31045642121,5sleep30-21swapper/300:25:013
30907792122,6sleep30-21swapper/300:12:573
30861762122,6sleep30-21swapper/300:07:563
30706552122,6sleep30-21swapper/323:52:513
30560582120,8sleep30-21swapper/323:37:553
30560582120,8sleep30-21swapper/323:37:543
30391652122,6sleep30-21swapper/323:17:563
30302562122,6sleep30-21swapper/323:10:023
30223982122,6sleep30-21swapper/323:02:553
30105112122,6sleep30-21swapper/322:52:003
29994562122,6sleep30-21swapper/322:37:563
29903392122,5sleep30-21swapper/322:30:013
29762552122,6sleep30-21swapper/322:17:493
29709552122,6sleep30-21swapper/322:12:123
29709552122,6sleep30-21swapper/322:12:123
29517642122,6sleep30-21swapper/321:52:543
29153042122,6sleep30-21swapper/321:13:013
29102412122,6sleep30-21swapper/321:08:003
29102412122,6sleep30-21swapper/321:08:003
29014842122,6sleep30-21swapper/321:02:063
28961562122,7sleep30-21swapper/320:55:003
28907912122,6sleep30-21swapper/320:48:063
28818622122,6sleep30-21swapper/320:42:493
28764402122,6sleep30-21swapper/320:35:023
28695572122,6sleep30-21swapper/320:27:563
28508772122,6sleep30-21swapper/320:08:053
28461202122,7sleep30-21swapper/320:03:043
28461202122,7sleep30-21swapper/320:03:043
28264172123,6sleep30-21swapper/319:43:063
28066422122,6sleep30-21swapper/319:23:033
28021902122,6sleep30-21swapper/319:18:463
31155092112,6sleep30-21swapper/300:37:533
30749282112,6sleep30-21swapper/323:55:563
30654802112,5sleep30-21swapper/323:47:493
30602412112,5sleep30-21swapper/323:42:443
30502202113,5sleep30-21swapper/323:30:443
30452072112,5sleep30-21swapper/323:25:033
30022102112,5sleep30-21swapper/322:42:533
29857262112,6sleep30-21swapper/322:26:083
29806872112,6sleep30-21swapper/322:20:063
29658082112,5sleep30-21swapper/322:05:023
29629792112,5sleep30-21swapper/322:02:533
29589142112,5sleep30-21swapper/321:57:553
29263402113,5sleep30-21swapper/321:26:223
29213052113,5sleep30-21swapper/321:20:043
28721562112,5sleep30-21swapper/320:32:493
28570632112,5sleep30-21swapper/320:17:483
28369302112,5sleep30-21swapper/319:55:013
28272422112,5sleep30-21swapper/319:45:023
28077112112,5sleep30-21swapper/319:27:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional