You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 06:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Jul 03, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27222332610,5sleep30-21swapper/323:45:213
2443007996054,4cyclictest2538738-21kworker/u8:3+events_unbound20:45:270
2443007995853,4cyclictest2538738-21kworker/u8:3+flush-8:021:05:290
2443007995851,6cyclictest2442878-21kworker/u8:2+flush-8:019:40:260
26103122560,4chrt0-21swapper/021:55:170
2443007995446,5cyclictest2708255-21kworker/u8:0+flush-8:000:30:150
2443007995443,9cyclictest2732247-21ntpq23:55:220
2443011995347,5cyclictest2708255-21kworker/u8:0+flush-8:023:50:321
2443011995338,10cyclictest1704890-21systemd-journal23:30:471
2443007995245,5cyclictest2688716-21kworker/u8:3+flush-8:023:30:300
2443007995143,6cyclictest1604667-21kworker/u8:0+flush-8:019:15:060
2443011995039,9cyclictest2573291-21ntpq21:15:231
2443007995039,8cyclictest2503433-21ntpq20:05:230
26630852490,3chrt0-21swapper/122:45:261
2443007994943,4cyclictest2654119-21kworker/u8:0+events_unbound22:45:250
2443007994943,4cyclictest2442878-21kworker/u8:2+flush-8:019:45:280
2443007994937,9cyclictest1704890-21systemd-journal19:32:280
2443011994843,4cyclictest2473842-21ntpq19:35:251
2443011994837,8cyclictest1704890-21systemd-journal00:11:481
2443007994840,5cyclictest2688716-21kworker/u8:3+flush-8:000:20:260
2443011994741,4cyclictest2442878-21kworker/u8:2+flush-8:019:15:311
2443011994740,5cyclictest2447768-21apt-get19:13:371
2443007994741,4cyclictest2643768-21kworker/u8:1+flush-8:023:15:220
2443007994741,4cyclictest2643768-21kworker/u8:1+flush-8:023:15:220
2443007994642,3cyclictest2504405-21kworker/u8:1+events_unbound21:10:300
2443007994640,4cyclictest2688716-21kworker/u8:3+events_unbound00:00:240
2443007994639,5cyclictest2688716-21kworker/u8:3+flush-8:023:25:240
2443007994639,4cyclictest1604667-21kworker/u8:0+events_unbound20:00:240
2443007994639,3cyclictest1604667-21kworker/u8:0+flush-8:021:40:210
2443007994638,5cyclictest2442878-21kworker/u8:2+events_unbound19:20:120
2443007994634,9cyclictest2697495-21ntpq23:20:240
2443007994634,9cyclictest2697495-21ntpq23:20:240
2443007994634,9cyclictest2493497-21ntpq19:55:230
2443015994528,3cyclictest1704890-21systemd-journal21:10:002
2443011994535,8cyclictest2468811-21ntpq19:30:221
2443007994541,3cyclictest2654119-21kworker/u8:0+flush-8:023:00:280
2443007994541,3cyclictest2538738-21kworker/u8:3+flush-8:022:05:300
2443007994539,4cyclictest2529409-21kworker/u8:2+events_unbound20:35:190
2443007994538,5cyclictest2504405-21kworker/u8:1+flush-8:020:15:230
2443007994537,6cyclictest2538738-21kworker/u8:3+flush-8:022:25:240
2443011994436,6cyclictest2667798-21ntpq22:50:231
2443007994439,3cyclictest2654119-21kworker/u8:0+flush-8:022:50:160
2443007994436,5cyclictest2708255-21kworker/u8:0+flush-8:000:25:250
2443011994336,5cyclictest2599170-21/usr/sbin/munin21:45:221
2443011994334,6cyclictest2489544-21latency_hist19:55:011
2443007994337,4cyclictest2733227-21kworker/u8:2+events_unbound00:15:250
2443007994337,4cyclictest1604667-21kworker/u8:0+flush-8:022:00:260
2443007994337,4cyclictest1096663-21kworker/u8:4+events_unbound19:35:220
2443007994335,5cyclictest1604667-21kworker/u8:0+events_unbound21:00:240
2443011994236,5cyclictest2504405-21kworker/u8:1+flush-8:021:25:251
2443007994237,3cyclictest2618947-21kworker/u8:2+flush-8:022:35:300
2443007994237,3cyclictest2529409-21kworker/u8:2+events_unbound20:40:290
2443007994235,5cyclictest2688716-21kworker/u8:3+flush-8:023:40:240
2443011994135,4cyclictest2708255-21kworker/u8:0+flush-8:000:30:191
2443007994135,3cyclictest2733227-21kworker/u8:2+events_unbound00:05:180
2443011994029,8cyclictest1704890-21systemd-journal20:10:421
2443007994036,3cyclictest2504405-21kworker/u8:1+flush-8:020:10:240
2443007994034,4cyclictest2688716-21kworker/u8:3+events_unbound23:50:150
2443007994034,4cyclictest2504405-21kworker/u8:1+flush-8:021:30:310
2443007994033,5cyclictest2504405-21kworker/u8:1+flush-8:021:25:250
2443007994033,4cyclictest2442878-21kworker/u8:2+events_unbound19:50:270
2443007994030,7cyclictest2504405-21kworker/u8:1+flush-8:021:20:250
2443011993933,4cyclictest1604667-21kworker/u8:0+flush-8:019:25:131
2443007993934,3cyclictest1604667-21kworker/u8:0+events_unbound20:50:250
2443007993932,5cyclictest2768168-21kworker/u8:1+flush-8:000:35:250
2443007993832,4cyclictest2733227-21kworker/u8:2+events_unbound00:10:200
2443007993832,4cyclictest2643768-21kworker/u8:1+events_unbound23:10:220
2443007993832,4cyclictest2514933-21kworker/u8:3+events_unbound20:35:010
2443007993832,4cyclictest2514933-21kworker/u8:3+events_unbound20:35:000
2443007993832,3cyclictest2618947-21kworker/u8:2+flush-8:022:15:170
2443011993731,4cyclictest1604667-21kworker/u8:0+flush-8:020:50:131
2443007993632,3cyclictest1604667-21kworker/u8:0+flush-8:021:15:220
2443007993631,3cyclictest2538738-21kworker/u8:3+flush-8:022:30:250
2443011993526,7cyclictest1704890-21systemd-journal00:28:481
2443011993525,7cyclictest1704890-21systemd-journal22:21:431
2443007993530,4cyclictest2442878-21kworker/u8:2+flush-8:019:25:250
2443007993530,3cyclictest2654119-21kworker/u8:0+events_unbound23:05:240
2443011993428,5cyclictest2538738-21kworker/u8:3+flush-8:022:25:311
2443007993430,3cyclictest2654119-21kworker/u8:0+events_unbound22:40:310
2443007993428,3cyclictest2688716-21kworker/u8:3+flush-8:023:45:210
24425052344,10sleep10-21swapper/119:06:081
2443011993326,5cyclictest2698043-21grep23:20:321
2443011993326,5cyclictest2698043-21grep23:20:321
2443007993327,4cyclictest2538738-21kworker/u8:3+events_unbound22:10:120
2443007993326,4cyclictest2504405-21kworker/u8:1+flush-8:020:25:160
2443007993325,7cyclictest2504405-21kworker/u8:1+flush-8:021:45:300
2443011993226,4cyclictest2534440-21apt-get20:40:091
2443011993222,7cyclictest2604338-21/usr/sbin/munin21:50:221
2443015993127,3cyclictest2544674-21aten2_r5power_p20:50:112
2443015993126,3cyclictest2712913-21unixbench_multi23:35:302
2443011993126,4cyclictest2504405-21kworker/u8:1+flush-8:021:30:271
2443011993125,5cyclictest2654119-21kworker/u8:0+flush-8:023:05:301
2443011993125,4cyclictest1096663-21kworker/u8:4+flush-8:020:05:271
2443011993121,8cyclictest2539375-21apt-get20:45:091
2443007993127,3cyclictest2618947-21kworker/u8:2+flush-8:022:55:210
2443007993126,3cyclictest2593988-21idleruntime-cro21:40:000
2443007993126,3cyclictest2538738-21kworker/u8:3+flush-8:022:20:250
2443007993125,4cyclictest2443368-21cpuspeed_turbos19:10:120
2443015993026,2cyclictest2738538-21aten2_r5power_p00:05:112
2443015993024,4cyclictest2767491-21unixbench_multi00:30:342
2443015993024,4cyclictest2628474-21unixbench_singl22:10:302
2443015993022,6cyclictest1704890-21systemd-journal22:10:012
2443011993025,3cyclictest2575200-21irqrtprio21:20:181
2443011993024,4cyclictest2688744-21apt-get23:15:081
2443011993024,4cyclictest2688744-21apt-get23:15:071
2443011993024,4cyclictest2688716-21kworker/u8:3+events_unbound23:35:281
2443007993026,3cyclictest1604667-21kworker/u8:0+events_unbound20:55:160
2443007993025,3cyclictest2688716-21kworker/u8:3+events_unbound23:35:240
2443015992925,2cyclictest2613582-21unixbench_singl21:55:302
2443011992926,2cyclictest2772940-21apt-key00:40:001
2443011992924,4cyclictest1604667-21kworker/u8:0+flush-8:019:55:151
2443011992920,7cyclictest2618012-21ntpq22:00:241
2443007992926,2cyclictest2609086-21systemd-run21:55:010
2443007992921,6cyclictest2514933-21kworker/u8:3+events_unbound20:20:230
2443015992824,2cyclictest2549610-21aten2_r5power_p20:55:122
2443015992823,3cyclictest2459449-21unixbench_singl19:20:302
2443015992823,3cyclictest2446883-21grep19:10:232
2443011992825,2cyclictest2758013-21cron00:25:001
2443011992824,3cyclictest2442878-21kworker/u8:2+flush-8:019:45:181
2443011992823,4cyclictest1604667-21kworker/u8:0+flush-8:020:00:251
2443011992822,4cyclictest2554477-21apt-get21:00:091
2443011992821,5cyclictest2688716-21kworker/u8:3+flush-8:000:00:251
2443011992820,6cyclictest2554205-21latency_hist21:00:021
2443015992722,3cyclictest2480282-21fschecks_time19:45:142
2443015992722,3cyclictest2479211-21unixbench_multi19:40:292
2443011992723,3cyclictest2618947-21kworker/u8:2+events_unbound22:15:231
2443011992721,4cyclictest2538738-21kworker/u8:3+flush-8:021:58:131
2443011992716,8cyclictest2722318-21ntpq23:45:221
2443015992622,3cyclictest2648226-21unixbench_multi22:30:302
2443015992622,2cyclictest2494074-21unixbench_singl19:55:312
2443011992622,3cyclictest2618947-21kworker/u8:2+flush-8:022:55:301
2443011992622,3cyclictest2514933-21kworker/u8:3+flush-8:020:20:271
2443011992620,4cyclictest2654119-21kworker/u8:0+events_unbound23:00:231
2443015992522,2cyclictest2733713-21cpuspeed_turbos00:00:132
2443015992522,2cyclictest2594554-21fschecks_count21:40:152
2443015992522,2cyclictest2533147-21tail20:35:212
2443015992518,5cyclictest2744333-21kthreadcore00:10:192
2443015992514,9cyclictest1704890-21systemd-journal21:25:422
2443011992521,2cyclictest2455428-21seq19:20:151
2443011992520,4cyclictest2708255-21kworker/u8:0+flush-8:023:55:261
2443011992520,4cyclictest1604667-21kworker/u8:0+flush-8:021:40:281
2443011992520,3cyclictest0-21swapper/100:17:471
2443011992519,5cyclictest2688716-21kworker/u8:3+events_unbound23:25:151
2443011992519,5cyclictest2538738-21kworker/u8:3+flush-8:022:10:231
2443011992519,5cyclictest2504405-21kworker/u8:1+flush-8:021:10:271
2443011992519,4cyclictest2511757-21kthreadcore20:15:191
2443015992420,3cyclictest0-21swapper/223:55:002
2443015992418,4cyclictest1704890-21systemd-journal22:02:472
2443011992420,2cyclictest2685979-21kthreadcore23:10:181
2443011992420,2cyclictest2648757-21apt-key22:35:001
2443011992420,2cyclictest0-21swapper/120:32:521
2443011992420,2cyclictest0-21swapper/120:32:511
2443011992419,4cyclictest2529409-21kworker/u8:2+events_unbound20:35:241
2443011992419,4cyclictest2504405-21kworker/u8:1+events_unbound21:35:141
2443011992418,5cyclictest2688716-21kworker/u8:3+flush-8:000:05:311
26709622230,6chrt0-21swapper/222:55:202
2443015992319,2cyclictest2503982-21unixbench_singl20:05:302
2443015992319,2cyclictest2470286-21fschecks_count19:35:132
2443011992319,3cyclictest2523801-21unixbench_singl20:25:311
2443011992319,2cyclictest0-21swapper/122:05:181
2443011992318,4cyclictest2708255-21kworker/u8:0+flush-8:023:43:531
2443011992318,3cyclictest2653469-21unixbench_singl22:35:301
2443015992219,2cyclictest2728857-21fschecks_time23:55:152
2443015992217,4cyclictest0-21swapper/220:29:592
2443011992218,2cyclictest2559657-21fschecks_count21:05:141
2443011992212,7cyclictest1704890-21systemd-journal22:41:431
2443015992117,2cyclictest2674051-21aten2_r5power_p23:00:112
2443015992117,2cyclictest2654260-21aten2_r5power_v22:40:112
2443015992110,2cyclictest421rcuog/221:50:202
2443011992113,6cyclictest2474946-21/usr/sbin/munin19:40:281
2443015992017,2cyclictest2684122-21fschecks_count23:10:132
2443015992017,2cyclictest2569455-21latency_hist21:15:012
2443015992016,2cyclictest0-21swapper/221:50:002
244301599198,4cyclictest0-21swapper/223:20:252
244301599198,4cyclictest0-21swapper/223:20:242
244301599192,12cyclictest2768199-21apt-get00:35:112
2443015991915,3cyclictest2538664-21unixbench_multi20:40:302
2443015991915,2cyclictest0-21swapper/223:50:002
2443015991915,2cyclictest0-21swapper/200:30:012
2443015991913,4cyclictest2454400-21unixbench_multi19:15:312
2443015991911,6cyclictest2755203-21tr00:20:182
2443015991911,6cyclictest2544399-21cut20:50:022
2443015991911,6cyclictest1704890-21systemd-journal19:30:002
2443015991910,7cyclictest2466566-21cut19:30:172
24427602194,11sleep20-21swapper/219:09:262
25951822188,6sleep30-21swapper/321:40:213
244301599189,7cyclictest2575533-21tr21:20:202
2443015991812,4cyclictest2659348-21cpuspeed_turbos22:45:122
2443015991812,4cyclictest0-21swapper/222:20:212
24426812182,10sleep00-21swapper/019:08:240
24425792183,9sleep30-21swapper/319:07:063
244301599177,8cyclictest2713831-21sort23:40:132
2443015991714,2cyclictest2748425-21aten2_r5power_e00:15:112
2443015991713,3cyclictest0-21swapper/222:39:592
2443015991713,2cyclictest0-21swapper/223:30:222
2443015991713,2cyclictest0-21swapper/223:15:112
2443015991713,2cyclictest0-21swapper/223:15:102
2443015991713,2cyclictest0-21swapper/222:50:242
2443015991713,2cyclictest0-21swapper/221:15:132
2443015991713,2cyclictest0-21swapper/221:00:172
2443015991713,2cyclictest0-21swapper/220:00:122
2443015991712,3cyclictest0-21swapper/223:25:202
2443015991712,3cyclictest0-21swapper/223:05:252
2443015991712,3cyclictest0-21swapper/221:30:202
2443015991711,4cyclictest0-21swapper/221:35:212
2443015991711,4cyclictest0-21swapper/220:20:172
244301599171,12cyclictest2504978-21fschecks_time20:10:142
244301599167,7cyclictest2641899-21tr22:25:222
244301599162,10cyclictest2632909-21ntpq22:15:212
244301599162,10cyclictest2488636-21ntpq19:50:232
2443015991611,3cyclictest2514291-21sendmail20:20:002
2443015991611,3cyclictest0-21swapper/220:30:112
2443015991611,3cyclictest0-21swapper/220:30:112
24659412152,7sleep30-21swapper/319:30:183
24431472142,8sleep30-21swapper/319:10:113
27431752132,6sleep30-21swapper/300:10:023
27085242132,6sleep30-21swapper/323:35:023
26338732132,6sleep30-21swapper/322:20:013
27684362122,6sleep30-21swapper/300:35:153
27538202122,6sleep30-21swapper/300:20:173
27509232122,6sleep30-21swapper/300:15:203
27407902122,6sleep30-21swapper/300:05:203
27239732122,6sleep30-21swapper/323:50:193
27140372122,6sleep30-21swapper/323:40:163
26995942122,6sleep30-21swapper/323:25:193
26937882122,6sleep30-21swapper/323:20:143
26937882122,6sleep30-21swapper/323:20:133
26925302122,6sleep30-21swapper/323:15:243
26925302122,6sleep30-21swapper/323:15:243
26884712122,6sleep30-21swapper/323:14:593
26739682122,6sleep30-21swapper/323:00:113
26687762122,6sleep30-21swapper/322:55:003
26648172122,6sleep30-21swapper/322:50:203
26600832122,6sleep30-21swapper/322:45:183
26543922122,6sleep30-21swapper/322:40:133
26393222122,6sleep30-21swapper/322:25:163
26327392122,6sleep30-21swapper/322:15:203
26245402122,6sleep30-21swapper/322:10:153
26146462122,6sleep30-21swapper/322:00:143
26090782122,5sleep30-21swapper/321:55:023
26043672122,6sleep30-21swapper/321:50:123
25990712122,6sleep30-21swapper/321:45:013
25832222122,6sleep30-21swapper/321:25:273
25742442122,6sleep30-21swapper/321:20:023
25700342122,6sleep30-21swapper/321:15:173
25492732122,6sleep30-21swapper/320:55:013
25485552122,6sleep30-21swapper/320:50:283
25392272122,6sleep30-21swapper/320:45:033
25242642122,6sleep30-21swapper/320:30:023
25242642122,6sleep30-21swapper/320:30:023
25198352122,6sleep30-21swapper/320:25:153
25131302122,6sleep30-21swapper/320:15:213
24986742122,6sleep30-21swapper/320:00:283
24897732122,6sleep30-21swapper/319:55:093
24874302122,6sleep30-21swapper/319:50:203
24604982122,6sleep30-21swapper/319:25:163
24553862122,6sleep30-21swapper/319:20:143
24501212122,6sleep30-21swapper/319:15:123
27677872112,6sleep30-21swapper/300:33:143
27585312112,5sleep30-21swapper/300:25:143
27337392112,5sleep30-21swapper/300:00:153
27285102112,5sleep30-21swapper/323:55:133
27041292112,5sleep30-21swapper/323:30:163
26803632112,5sleep30-21swapper/323:05:253
26537512112,6sleep30-21swapper/322:38:393
26442382113,5sleep30-21swapper/322:30:133
26215512110,7sleep30-21swapper/322:05:203
25933142112,5sleep30-21swapper/321:35:313
25842982112,5sleep30-21swapper/321:30:083
25645752112,5sleep30-21swapper/321:10:143
25598162112,5sleep30-21swapper/321:05:173
25544812112,5sleep30-21swapper/321:00:123
25341652112,5sleep30-21swapper/320:40:003
25296902112,5sleep30-21swapper/320:35:143
25145262112,6sleep30-21swapper/320:20:023
25049752112,5sleep30-21swapper/320:10:143
24994512112,5sleep30-21swapper/320:05:013
24798962112,5sleep30-21swapper/319:45:033
24749452112,5sleep30-21swapper/319:40:093
24699992113,5sleep30-21swapper/319:35:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional