You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 10:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sun May 03, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2483657996055,3cyclictest2483541-21kworker/u8:3+flush-8:020:21:171
2483657996054,5cyclictest2750798-21kworker/u8:0+flush-8:000:36:181
2483657996054,4cyclictest2629516-21kworker/u8:3+events_unbound23:06:011
2483657995951,6cyclictest2620167-21kworker/u8:2+flush-8:022:01:171
2483662995747,7cyclictest2526075-21cat19:50:012
2483662995747,7cyclictest2526075-21cat19:50:002
2483657995750,5cyclictest2684716-21kworker/u8:1+flush-8:023:01:031
2483657995746,8cyclictest2609127-21ntpq21:11:121
2483657995551,3cyclictest2629516-21kworker/u8:3+events_unbound23:56:171
2483657995549,4cyclictest2491285-21kworker/u8:0+events_unbound20:00:011
24992232540,4sleep375-21kworker/3:1-events19:21:103
2483657995448,5cyclictest2620167-21kworker/u8:2+flush-8:021:46:181
2483657995447,5cyclictest2629516-21kworker/u8:3+flush-8:023:51:131
2483656995448,4cyclictest2560479-21kworker/u8:2+flush-8:021:01:150
2483657995348,3cyclictest2560479-21kworker/u8:2+flush-8:020:36:171
2483657995246,4cyclictest2570082-21kworker/u8:0+events_unbound20:56:031
2483657995146,4cyclictest2560479-21kworker/u8:2+events_unbound20:51:041
2483657995146,3cyclictest2560479-21kworker/u8:2+events_unbound20:46:011
2483657995144,5cyclictest2684716-21kworker/u8:1+flush-8:022:41:141
2483656995144,5cyclictest2783798-21apt-get00:11:000
25482322500,6chrt0-21swapper/220:11:092
2483662995042,5cyclictest2649998-21cat21:55:012
2483657995045,4cyclictest2684716-21kworker/u8:1+events_unbound22:36:171
2483657995045,4cyclictest2483541-21kworker/u8:3+events_unbound19:26:151
2483657995044,4cyclictest2750798-21kworker/u8:0+flush-8:000:26:181
2483657994942,6cyclictest2629516-21kworker/u8:3+flush-8:023:21:121
2483656994944,3cyclictest2684716-21kworker/u8:1+flush-8:023:01:040
2483657994843,3cyclictest2483541-21kworker/u8:3+flush-8:019:11:021
27606732470,2sleep375-21kworker/3:1+mm_percpu_wq23:46:063
2483657994742,3cyclictest2750798-21kworker/u8:0+flush-8:023:41:121
2483657994742,3cyclictest2491285-21kworker/u8:0+flush-8:019:21:181
2483657994741,4cyclictest1808585-21kworker/u8:1+events_unbound19:36:141
2483657994741,4cyclictest1808585-21kworker/u8:1+events_unbound19:36:131
2483657994740,5cyclictest2620167-21kworker/u8:2+events_unbound21:51:041
2483657994738,6cyclictest2663790-21ntpq22:06:121
2483657994641,3cyclictest2483541-21kworker/u8:3+flush-8:019:41:121
2483657994641,3cyclictest2483541-21kworker/u8:3+flush-8:019:41:121
2483657994640,4cyclictest2620167-21kworker/u8:2+flush-8:021:56:191
2483657994639,5cyclictest2560479-21kworker/u8:2+flush-8:020:41:031
2483657994540,4cyclictest2620167-21kworker/u8:2+flush-8:022:31:171
2483657994540,4cyclictest2560479-21kworker/u8:2+flush-8:021:01:131
2483657994539,4cyclictest2550272-21kworker/u8:1+events_unbound20:16:131
2483657994538,6cyclictest2664666-21kworker/u8:0+flush-8:022:16:141
2483657994538,5cyclictest2729182-21apt-get23:16:001
2483657994533,9cyclictest280-21systemd-journal00:30:521
2483657994437,5cyclictest2684716-21kworker/u8:1+events_unbound23:11:021
2483657994437,5cyclictest2684716-21kworker/u8:1+events_unbound23:11:011
2483657994437,5cyclictest2483541-21kworker/u8:3+flush-8:020:26:171
2483657994436,6cyclictest2664666-21kworker/u8:0+flush-8:022:21:131
2483657994428,12cyclictest280-21systemd-journal19:51:531
2483656994437,5cyclictest2555512-21latency_hist20:20:010
2483657994339,3cyclictest2606162-21kworker/u8:1+events_unbound21:26:191
2483657994339,3cyclictest2606162-21kworker/u8:1+events_unbound21:26:191
2483657994338,4cyclictest2620167-21kworker/u8:2+flush-8:022:26:151
248365699430,41cyclictest1-21systemd20:35:000
2483657994237,4cyclictest2684716-21kworker/u8:1+flush-8:022:46:181
2483657994237,4cyclictest2560479-21kworker/u8:2+events_unbound21:06:041
2483657994237,3cyclictest2620167-21kworker/u8:2+flush-8:000:21:031
2483657994236,5cyclictest2773342-21kworker/u8:1+events_unbound00:06:121
2483657994236,5cyclictest1808585-21kworker/u8:1+flush-8:019:46:041
2483657994236,5cyclictest1808585-21kworker/u8:1+flush-8:019:46:041
2483657994136,3cyclictest2595319-21kworker/u8:3+flush-8:021:16:081
2483657994134,5cyclictest2491285-21kworker/u8:0+flush-8:020:06:141
2483656994135,5cyclictest2750798-21kworker/u8:0+flush-8:000:31:050
2483657994036,3cyclictest2629516-21kworker/u8:3+flush-8:021:41:061
2483657994035,4cyclictest2491285-21kworker/u8:0+flush-8:019:31:191
2483657994035,3cyclictest2606162-21kworker/u8:1+events_unbound21:21:121
2483657994033,5cyclictest2684716-21kworker/u8:1+flush-8:022:51:121
2483657994033,5cyclictest2620167-21kworker/u8:2+events_unbound22:11:151
2483656994032,6cyclictest280-21systemd-journal23:23:480
2483657993935,3cyclictest2750798-21kworker/u8:0+events_unbound23:46:131
2483657993932,5cyclictest2750798-21kworker/u8:0+flush-8:023:36:121
2483657993932,5cyclictest2620167-21kworker/u8:2+flush-8:000:11:131
2483657993931,6cyclictest2545956-21apt-get20:11:001
2483656993930,6cyclictest2709130-21latency_hist22:55:010
27012162380,5sleep20-21swapper/222:46:072
2483657993832,4cyclictest2491285-21kworker/u8:0+flush-8:020:01:141
2483657993831,5cyclictest2750798-21kworker/u8:0+flush-8:000:16:181
2483657993831,5cyclictest2620167-21kworker/u8:2+flush-8:000:01:151
2483656993834,3cyclictest2620167-21kworker/u8:2+events_unbound21:56:180
2483656993833,4cyclictest2491285-21kworker/u8:0+flush-8:019:46:170
2483656993833,4cyclictest2491285-21kworker/u8:0+flush-8:019:46:160
2483656993831,5cyclictest2510964-21grep19:36:020
2483656993831,5cyclictest2510964-21grep19:36:020
2483656993830,6cyclictest2813109-21apt-get00:40:000
2483662993724,11cyclictest2585817-21fschecks_count20:51:042
2483657993726,8cyclictest2713190-21ntpq22:56:111
2483656993732,3cyclictest2684716-21kworker/u8:1+flush-8:022:46:160
2483656993732,3cyclictest2606162-21kworker/u8:1+flush-8:021:26:060
2483656993732,3cyclictest2606162-21kworker/u8:1+flush-8:021:26:060
2483656993726,9cyclictest0-21swapper/022:20:000
2483662993619,15cyclictest2560895-21aten2_r5power_v20:26:012
2483657993632,3cyclictest2684716-21kworker/u8:1+events_unbound23:26:091
2483657993631,4cyclictest2629516-21kworker/u8:3+flush-8:023:31:061
2483657993626,7cyclictest280-21systemd-journal21:35:531
2483656993629,5cyclictest2782583-21ntpq00:06:120
2483656993531,3cyclictest2570082-21kworker/u8:0+flush-8:020:51:180
2483656993530,3cyclictest2684716-21kworker/u8:1+events_unbound22:41:180
2483656993529,4cyclictest2664666-21kworker/u8:0+flush-8:022:21:180
2483662993424,8cyclictest280-21systemd-journal19:15:032
2483662993419,13cyclictest2788974-21cpuspeed_turbos00:16:012
2483657993429,3cyclictest2550272-21kworker/u8:1+flush-8:020:31:051
2483656993430,3cyclictest2684716-21kworker/u8:1+flush-8:023:06:140
2483656993429,4cyclictest1808585-21kworker/u8:1+flush-8:019:15:050
2483656993429,3cyclictest2620167-21kworker/u8:2+flush-8:021:35:040
2483656993428,4cyclictest2483541-21kworker/u8:3+flush-8:020:26:070
2483656993428,4cyclictest1808585-21kworker/u8:1+events_unbound19:15:000
2483656993427,5cyclictest280-21systemd-journal21:20:000
2483656993427,5cyclictest2483541-21kworker/u8:3+flush-8:019:41:020
2483656993427,5cyclictest2483541-21kworker/u8:3+flush-8:019:41:020
2483662993323,8cyclictest2813222-21cp00:40:002
2483662993313,2cyclictest2545648-21systemd-run20:10:012
2483656993328,3cyclictest2595319-21kworker/u8:3+flush-8:021:11:070
2483656993326,5cyclictest280-21systemd-journal19:28:510
2483656993227,4cyclictest2750798-21kworker/u8:0+flush-8:023:41:180
2483656993223,6cyclictest2803237-21latency_hist00:30:000
248366299313,7cyclictest2793691-21apt-get00:21:012
248366299312,6cyclictest2655094-21apt-get22:01:002
2483662993114,16cyclictest0-21swapper/200:00:012
2483662993110,7cyclictest2606634-21cut21:11:082
2483657993127,2cyclictest2629835-21systemd-run21:35:001
2483656993127,3cyclictest2750798-21kworker/u8:0+flush-8:023:36:150
2483656993126,4cyclictest2629516-21kworker/u8:3+flush-8:023:51:030
2483656993126,3cyclictest2659704-21idleruntime-cro22:05:000
2483656993124,6cyclictest2639745-21kworker/u8:1+events_unbound22:06:160
2483656993123,6cyclictest2539832-21ntpq20:01:130
2483662993011,3cyclictest0-21swapper/219:51:112
248366299301,12cyclictest2499227-21kthreadcore19:21:102
2483657993025,4cyclictest2483541-21kworker/u8:3+flush-8:019:15:051
2483656993025,4cyclictest2629516-21kworker/u8:3+events_unbound23:31:100
2483656993024,4cyclictest2620167-21kworker/u8:2+events_unbound00:01:120
2483656993021,6cyclictest2763483-21latency_hist23:50:010
248366299299,6cyclictest2514089-21tr19:36:102
248366299299,6cyclictest2514089-21tr19:36:102
248366299291,8cyclictest2694664-21apt-get22:40:582
2483662992916,11cyclictest0-21swapper/223:11:192
2483662992916,11cyclictest0-21swapper/223:11:182
2483662992913,14cyclictest0-21swapper/223:41:012
2483662992912,2cyclictest0-21swapper/223:31:032
2483662992912,2cyclictest0-21swapper/223:06:112
2483662992912,2cyclictest0-21swapper/221:06:032
2483662992911,3cyclictest0-21swapper/223:01:102
2483662992911,3cyclictest0-21swapper/220:41:202
2483662992911,2cyclictest0-21swapper/222:40:012
2483662992910,2cyclictest0-21swapper/221:26:062
2483662992910,2cyclictest0-21swapper/221:26:062
2483656992925,3cyclictest2750798-21kworker/u8:0+flush-8:000:16:190
2483656992925,3cyclictest2606162-21kworker/u8:1+flush-8:021:21:030
2483656992924,4cyclictest1808585-21kworker/u8:1+flush-8:019:51:060
2483656992923,5cyclictest2560479-21kworker/u8:2+flush-8:020:46:100
2483656992923,4cyclictest2483541-21kworker/u8:3+events_unbound20:11:030
2483656992922,5cyclictest280-21systemd-journal23:13:460
2483656992922,5cyclictest280-21systemd-journal23:13:460
2483656992922,5cyclictest2483496-21latency_hist19:10:010
2483656992922,5cyclictest2483496-21latency_hist19:10:000
2483656992919,8cyclictest2635365-21diskstats21:41:050
248366299288,7cyclictest2592717-21tr20:56:092
248366299287,7cyclictest2682393-21tr22:26:092
248366299283,6cyclictest2783798-21apt-get00:11:002
2483662992822,4cyclictest2488551-21apt-get19:14:592
248366299281,8cyclictest2584473-21ps20:46:152
27997802270,2sleep3471rcuc/300:26:083
248366299279,3cyclictest0-21swapper/200:31:082
248366299276,6cyclictest2749636-21sed23:36:062
248366299274,5cyclictest2732927-21ntpq23:16:132
2483662992724,2cyclictest2595638-21cpuspeed_turbos21:01:012
2483662992722,3cyclictest2506298-21fschecks_time19:31:042
248366299271,10cyclictest2688687-21ps22:31:162
248366299271,10cyclictest2504763-21ntpq19:26:132
2483662992710,3cyclictest0-21swapper/200:26:042
248365699272,24cyclictest0-21swapper/021:31:160
2483656992720,5cyclictest2684716-21kworker/u8:1+flush-8:022:36:130
248366299269,3cyclictest0-21swapper/220:01:202
248366299266,6cyclictest2671277-21cut22:16:082
248366299262,6cyclictest2554895-21python320:16:172
248366299262,5cyclictest2638927-21ntpq21:41:162
248366299262,5cyclictest2569502-21ntpq20:31:112
2483656992622,3cyclictest2664666-21kworker/u8:0+flush-8:022:28:240
2483656992621,4cyclictest2483541-21kworker/u8:3+flush-8:019:31:180
2483656992621,3cyclictest2773322-21latency_hist00:00:010
2483656992621,3cyclictest2684716-21kworker/u8:1+events_unbound23:16:030
2483656992620,5cyclictest2491285-21kworker/u8:0+flush-8:020:06:230
2483656992619,5cyclictest2560479-21kworker/u8:2+events_unbound21:06:130
2483656992618,6cyclictest280-21systemd-journal20:25:010
248366299252,6cyclictest2782870-21python300:06:192
248366299252,5cyclictest2704534-21apt-get22:51:002
2483662992522,2cyclictest2660115-21aten2_r5power_p22:06:022
2483662992520,3cyclictest2531331-21cpuspeed_turbos19:56:022
248366299251,9cyclictest2634044-21ps21:36:162
248366299251,8cyclictest2713241-21ntpq22:56:132
2483662992512,2cyclictest0-21swapper/223:21:162
248366299251,10cyclictest2570660-21taskset20:36:002
248366299250,12cyclictest2516538-21sed19:41:072
248366299250,12cyclictest2516538-21sed19:41:072
2483656992521,3cyclictest2483541-21kworker/u8:3+events_unbound19:21:020
248365699251,22cyclictest401-21dbus-daemon23:30:010
248366299248,3cyclictest2615169-21grep21:20:012
2483662992420,2cyclictest2556111-21fschecks_count20:21:022
248366299241,6cyclictest2773325-21apt-get00:00:022
2483662992410,3cyclictest2669577-21cron22:15:002
2483662992410,3cyclictest0-21swapper/221:21:092
2483656992419,4cyclictest2797372-21needreboot00:21:120
2483656992419,4cyclictest2629516-21kworker/u8:3+flush-8:022:56:080
2483656992419,4cyclictest2570082-21kworker/u8:0+flush-8:020:56:040
2483656992416,6cyclictest2531083-21/usr/sbin/munin19:56:100
27670792230,3sleep375-21kworker/3:1+events23:51:093
248366299236,6cyclictest2654432-21unixbench_singl21:56:212
2483662992319,2cyclictest2763093-21unixbench_multi23:46:182
248365699232,20cyclictest0-21swapper/020:41:180
2483662992217,3cyclictest2629803-21cron21:35:002
248365699226,15cyclictest2629553-21kworker/0:0+events22:31:090
2483656992220,1cyclictest0-21swapper/021:46:170
2483656992217,4cyclictest2620167-21kworker/u8:2+flush-8:022:11:170
2483656992118,2cyclictest2570822-21cpuspeed20:36:030
2483656992117,3cyclictest0-21swapper/021:51:070
24831972214,11sleep10-21swapper/119:06:201
24831972214,11sleep10-21swapper/119:06:201
24832092193,9sleep30-21swapper/319:06:303
24832092193,9sleep30-21swapper/319:06:303
24793982194,9sleep20-21swapper/219:06:052
24793982194,9sleep20-21swapper/219:06:052
2483662991814,2cyclictest0-21swapper/222:21:122
248366299172,1cyclictest0-21swapper/223:26:122
2483662991612,2cyclictest0-21swapper/221:46:042
2483662991512,2cyclictest0-21swapper/223:50:522
27358882142,8sleep30-21swapper/323:21:083
25105672144,6sleep30-21swapper/319:34:593
27748252133,7sleep30-21swapper/300:01:083
27543862132,7sleep30-21swapper/323:41:073
26946382132,6sleep30-21swapper/322:40:593
25667902132,7sleep30-21swapper/320:31:063
25464452132,7sleep30-21swapper/320:11:073
25406842131,6sleep30-21swapper/320:05:013
24847832133,7sleep30-21swapper/319:11:083
27906752122,6sleep30-21swapper/300:16:103
27505172123,5sleep30-21swapper/323:36:093
27291862122,6sleep30-21swapper/323:16:033
27279882122,6sleep30-21swapper/323:11:133
27279882122,6sleep30-21swapper/323:11:133
27141012122,5sleep30-21swapper/323:00:003
27098162122,6sleep30-21swapper/322:56:043
27050292122,6sleep30-21swapper/322:51:073
27035642122,6sleep30-21swapper/322:46:173
26894362122,5sleep30-21swapper/322:35:013
26850992122,6sleep30-21swapper/322:31:043
26646542122,5sleep30-21swapper/322:10:003
26549112122,6sleep30-21swapper/322:00:023
26504062122,6sleep30-21swapper/321:56:043
26404722122,6sleep30-21swapper/321:46:063
26350442122,6sleep30-21swapper/321:40:283
26301522122,6sleep30-21swapper/321:36:033
26190622122,6sleep30-21swapper/321:21:143
26146442122,6sleep30-21swapper/321:16:203
26053882122,6sleep30-21swapper/321:11:023
25996702122,6sleep30-21swapper/321:01:193
25901612122,5sleep30-21swapper/320:55:013
25557622122,6sleep30-21swapper/320:20:133
25158652122,6sleep30-21swapper/319:41:023
25158652122,6sleep30-21swapper/319:41:013
25111462123,5sleep30-21swapper/319:36:043
25111462123,5sleep30-21swapper/319:36:043
25027012123,5sleep30-21swapper/319:26:093
24933062122,6sleep30-21swapper/319:16:103
28084312112,6sleep30-21swapper/300:35:323
28034582112,5sleep30-21swapper/300:30:023
27974692112,5sleep30-21swapper/300:21:153
27837442112,6sleep30-21swapper/300:10:403
27787432112,5sleep30-21swapper/300:05:023
27724842112,5sleep30-21swapper/323:56:153
27443312112,5sleep30-21swapper/323:31:033
27390172112,6sleep30-21swapper/323:25:383
27196882112,5sleep30-21swapper/323:06:033
26797752112,6sleep30-21swapper/322:25:503
26784752112,5sleep30-21swapper/322:21:133
26743652112,6sleep30-21swapper/322:18:003
26642012112,5sleep30-21swapper/322:06:203
26452272112,5sleep30-21swapper/321:51:033
26255772112,5sleep30-21swapper/321:31:053
26241082112,5sleep30-21swapper/321:26:153
26241082112,5sleep30-21swapper/321:26:153
26040532112,5sleep30-21swapper/321:06:133
25884832112,5sleep30-21swapper/320:51:123
25804682112,5sleep30-21swapper/320:45:023
25765662112,5sleep30-21swapper/320:41:093
25707542112,5sleep30-21swapper/320:36:033
25606852112,6sleep30-21swapper/320:25:043
25512722112,5sleep30-21swapper/320:16:053
25410262112,5sleep30-21swapper/320:06:013
25310582112,6sleep30-21swapper/319:55:423
25267392112,5sleep30-21swapper/319:51:093
25248492112,5sleep30-21swapper/319:46:153
25248492112,5sleep30-21swapper/319:46:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional