You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 13:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue Jun 09, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36019002880,6chrt0-21swapper/222:50:402
34827772730,7sleep20-21swapper/220:50:412
3378487996457,5cyclictest3378395-21kworker/u8:0+flush-8:019:25:481
35421292620,6sleep20-21swapper/221:50:402
3378487996256,4cyclictest3492070-21kworker/u8:1+events_unbound22:00:001
3378487995947,8cyclictest1704890-21systemd-journal22:00:331
3378487995750,5cyclictest3646772-21kworker/u8:0+flush-8:023:55:481
3378487995650,4cyclictest3464522-21kworker/u8:2+events_unbound21:00:001
3378487995548,5cyclictest3558794-21kworker/u8:0+flush-8:023:20:421
3378486995445,6cyclictest3534145-21latency_hist21:45:010
3378491995342,8cyclictest1704890-21systemd-journal22:25:332
3378487995345,5cyclictest3646772-21kworker/u8:0+flush-8:000:20:501
3378486995347,4cyclictest3363694-21kworker/u8:2+events_unbound19:10:510
3378487995245,5cyclictest3524457-21kworker/u8:3+flush-8:022:45:471
3378487995147,3cyclictest3633208-21kworker/u8:1+flush-8:023:25:481
3378487995146,3cyclictest3404997-21kworker/u8:3+flush-8:020:10:531
3378487995145,4cyclictest3646772-21kworker/u8:0+events_unbound00:10:351
3378487995141,6cyclictest1704890-21systemd-journal20:20:331
3378486995042,6cyclictest3678677-21/usr/sbin/munin00:10:500
3378487994944,3cyclictest3464522-21kworker/u8:2+flush-8:020:45:381
3378487994941,6cyclictest3524457-21kworker/u8:3+flush-8:023:35:431
3378487994939,7cyclictest1704890-21systemd-journal23:45:011
3378487994843,4cyclictest3479495-21kworker/u8:3+events_unbound21:05:381
3378487994843,3cyclictest3363694-21kworker/u8:2+events_unbound19:45:341
3378487994840,6cyclictest3524457-21kworker/u8:3+flush-8:023:00:451
3378486994840,6cyclictest1704890-21systemd-journal23:15:000
3378487994742,4cyclictest3479495-21kworker/u8:3+events_unbound21:10:341
3378487994741,4cyclictest3524457-21kworker/u8:3+events_unbound22:40:001
3378487994740,5cyclictest3534371-21kworker/u8:2+flush-8:021:50:451
3378487994738,7cyclictest3534371-21kworker/u8:2+flush-8:022:05:441
3378486994736,8cyclictest3363694-21kworker/u8:2+flush-8:019:20:450
3378487994640,4cyclictest3558794-21kworker/u8:0+events_unbound23:15:431
3378487994640,4cyclictest3378395-21kworker/u8:0+flush-8:020:50:461
3378487994640,4cyclictest3238108-21kworker/u8:1+events_unbound19:30:461
3378487994540,3cyclictest3378395-21kworker/u8:0+events_unbound19:15:031
3378487994539,5cyclictest3464522-21kworker/u8:2+flush-8:020:40:491
3378487994539,4cyclictest3378395-21kworker/u8:0+flush-8:020:30:401
3378487994538,5cyclictest3524457-21kworker/u8:3+events_unbound22:40:451
3378487994439,4cyclictest3633208-21kworker/u8:1+events_unbound23:45:311
3378487994438,5cyclictest3569242-21kworker/u8:2+flush-8:023:05:491
3378487994437,5cyclictest3524457-21kworker/u8:3+flush-8:021:35:451
3378487994437,5cyclictest3524457-21kworker/u8:3+flush-8:021:35:451
3378486994437,5cyclictest3404997-21kworker/u8:3+flush-8:019:35:340
3378487994338,4cyclictest3492070-21kworker/u8:1+flush-8:021:20:441
3378487994337,4cyclictest3404997-21kworker/u8:3+flush-8:019:40:441
3378487994337,4cyclictest3404997-21kworker/u8:3+flush-8:019:40:441
3378486994335,5cyclictest3569002-21latency_hist22:20:010
3378487994237,3cyclictest3633208-21kworker/u8:1+flush-8:023:50:481
3378487994237,3cyclictest3534371-21kworker/u8:2+events_unbound21:50:011
3378487994236,4cyclictest3707719-21kworker/u8:3+events_unbound00:40:001
3378487994236,4cyclictest3558794-21kworker/u8:0+flush-8:022:25:431
3378487994236,4cyclictest3404997-21kworker/u8:3+events_unbound20:00:351
3378487994229,9cyclictest3603704-21latency_hist22:55:011
3378487994136,4cyclictest3404997-21kworker/u8:3+events_unbound19:55:421
3378487994135,4cyclictest3529491-21apt-get21:40:291
3378487994135,4cyclictest3363694-21kworker/u8:2+events_unbound19:10:351
3378486994134,5cyclictest3514200-21cp21:25:000
337848699410,38cyclictest3603756-21munin-run22:55:010
3378487994035,3cyclictest3569242-21kworker/u8:2+flush-8:022:55:421
3378487994035,3cyclictest3492070-21kworker/u8:1+events_unbound21:00:431
3378487994031,6cyclictest3677536-21kworker/u8:1+flush-8:000:25:451
34246012390,2sleep375-21kworker/3:1+mm_percpu_wq19:50:513
3378487993934,3cyclictest3524457-21kworker/u8:3+events_unbound23:15:011
3378487993933,4cyclictest3404997-21kworker/u8:3+events_unbound19:50:511
3378487993932,5cyclictest3646772-21kworker/u8:0+events_unbound00:30:431
3378486993932,5cyclictest3378395-21kworker/u8:0+flush-8:019:25:430
3378486993930,7cyclictest1704890-21systemd-journal20:10:010
3378487993831,6cyclictest3492070-21kworker/u8:1+flush-8:022:10:411
3378491993732,4cyclictest3646772-21kworker/u8:0+events_unbound00:05:422
3378487993733,3cyclictest3558794-21kworker/u8:0+flush-8:022:15:471
3378487993731,4cyclictest3668816-21kworker/u8:2+flush-8:000:00:461
3378487993731,4cyclictest3633208-21kworker/u8:1+flush-8:023:30:351
3378487993731,4cyclictest3633208-21kworker/u8:1+flush-8:023:30:341
3378487993731,4cyclictest3558794-21kworker/u8:0+events_unbound22:20:311
3378487993729,6cyclictest3404997-21kworker/u8:3+flush-8:019:35:421
3378486993730,5cyclictest3687469-21ntpq00:15:430
3378486993728,6cyclictest3549248-21latency_hist22:00:020
33781872373,9sleep10-21swapper/119:08:111
3378487993630,4cyclictest3558794-21kworker/u8:0+flush-8:022:30:361
3378487993627,7cyclictest3390841-21apt-get19:20:291
3378487993624,9cyclictest1704890-21systemd-journal20:05:321
3378486993627,6cyclictest1704890-21systemd-journal00:34:590
3378486993624,9cyclictest1704890-21systemd-journal23:30:000
337848699361,33cyclictest3579550-21sshd22:30:340
3378486993528,5cyclictest1704890-21systemd-journal21:27:490
3378491993427,5cyclictest3573962-21turbostat.cron22:25:002
3378486993427,5cyclictest3668816-21kworker/u8:2+flush-8:000:05:010
3378486993427,5cyclictest3534371-21kworker/u8:2+flush-8:022:00:310
3378491993328,3cyclictest3404997-21kworker/u8:3+flush-8:020:15:442
3378487993328,4cyclictest3683046-21kworker/u8:2+flush-8:000:15:511
3378487993328,3cyclictest3524253-21systemd-run21:35:001
3378487993327,4cyclictest3378395-21kworker/u8:0+flush-8:020:25:431
3378486993329,3cyclictest3558794-21kworker/u8:0+flush-8:022:20:320
3378491993228,3cyclictest3479495-21kworker/u8:3+flush-8:021:00:462
3378491993228,3cyclictest3464522-21kworker/u8:2+events_unbound21:30:372
3378491993228,3cyclictest3444899-21kworker/u8:1+flush-8:020:35:392
3378486993225,5cyclictest3589162-21apt-get22:40:280
3378486993222,8cyclictest3425604-21diskstats19:55:330
36821302310,6sleep3451irq_work/300:10:423
3378491993125,4cyclictest3404997-21kworker/u8:3+events_unbound19:50:372
3378486993126,3cyclictest3390368-21systemd-run19:19:590
35067652300,6sleep00-21swapper/021:15:430
3378491993025,3cyclictest3440262-21aten2_r5power_e20:10:352
3378487993022,6cyclictest3479495-21kworker/u8:3+flush-8:021:15:501
3378486993024,4cyclictest3569242-21kworker/u8:2+flush-8:023:05:450
3378486993023,5cyclictest1704890-21systemd-journal22:59:590
3378486993020,8cyclictest3627674-21ntpq23:15:430
3378491992926,2cyclictest3688953-21fschecks_time00:20:342
3378491992924,4cyclictest3391063-21cpuspeed_turbos19:20:332
3378491992924,3cyclictest3499676-21aten2_r5power_v21:10:322
3378491992924,3cyclictest3383064-21unixbench_singl19:10:522
3378491992920,7cyclictest3528801-21unixbench_singl21:35:502
3378491992920,7cyclictest3528801-21unixbench_singl21:35:502
3378487992924,4cyclictest3646772-21kworker/u8:0+events_unbound00:05:491
3378486992922,4cyclictest3677536-21kworker/u8:1+flush-8:000:25:340
3378486992921,5cyclictest3648622-21latency_hist23:40:010
3378486992920,7cyclictest3658811-21/usr/sbin/munin23:50:420
337757822915,7sleep30-21swapper/319:05:493
3378491992824,2cyclictest3683770-21aten2_r5power_v00:15:322
3378491992823,3cyclictest3643295-21unixbench_singl23:30:502
3378491992823,3cyclictest3643295-21unixbench_singl23:30:492
3378491992823,3cyclictest3534458-21aten2_r5power_c21:45:322
3378491992822,4cyclictest3534135-21idleruntime-cro21:44:592
3378491992822,4cyclictest3455358-21fschecks_time20:25:322
3378486992825,2cyclictest3707732-21unixbench_singl00:35:490
3378486992822,4cyclictest3404997-21kworker/u8:3+flush-8:020:00:480
3378486992822,3cyclictest0-21swapper/023:30:310
3378486992822,3cyclictest0-21swapper/023:30:300
3378486992821,2cyclictest421rcuog/219:45:450
3378486992818,7cyclictest1704890-21systemd-journal20:15:010
3378491992723,2cyclictest3644188-21cpuspeed_turbos23:35:322
3378491992722,4cyclictest3558794-21kworker/u8:0+flush-8:022:10:472
3378491992722,3cyclictest3518897-21unixbench_singl21:25:492
3378491992722,3cyclictest3454394-21unixbench_singl20:20:512
3378487992717,7cyclictest1704890-21systemd-journal20:35:331
3378486992723,2cyclictest3543093-21needreboot21:50:410
3378486992719,6cyclictest1704890-21systemd-journal19:44:330
3378486992719,6cyclictest1704890-21systemd-journal19:44:330
34392562260,5sleep3451irq_work/320:05:483
3378491992622,2cyclictest3668087-21unixbench_singl23:55:492
3378491992621,4cyclictest3550472-21kthreadcore22:00:372
3378491992620,4cyclictest3439526-21unixbench_singl20:05:482
3378491992618,6cyclictest3629098-21cpuspeed_turbos23:20:292
3378486992622,3cyclictest3693284-21sh00:25:000
3378486992622,2cyclictest3664027-21cpuspeed_turbos23:55:320
3378486992622,2cyclictest3405306-21cron19:35:000
3378486992621,3cyclictest3479494-21true20:50:000
3378486992620,4cyclictest3534371-21kworker/u8:2+events_unbound21:45:450
3378486992618,6cyclictest3404997-21kworker/u8:3+events_unbound20:15:510
3378486992617,7cyclictest1704890-21systemd-journal20:54:590
36885212250,5sleep3481ktimers/300:20:013
34983702250,3sleep3451irq_work/321:05:433
3378491992520,4cyclictest3434605-21unixbench_singl20:00:542
3378486992521,2cyclictest3673983-21cpuspeed_turbos00:05:320
3378486992520,4cyclictest3378395-21kworker/u8:0+events_unbound20:40:000
3378486992519,5cyclictest3404997-21kworker/u8:3+flush-8:020:25:330
3378486992518,5cyclictest3594376-21tr22:45:330
3378486992518,5cyclictest3503323-21ntpq21:10:440
3378491992421,2cyclictest3504581-21aten2_r5power_p21:15:312
3378491992419,3cyclictest3704386-21kthreadcore00:35:362
3378491992419,3cyclictest3697833-21unixbench_singl00:25:492
3378486992420,3cyclictest3613401-21unixbench_multi23:00:500
3378486992419,4cyclictest3653184-21unixbench_multi23:40:490
3378486992419,4cyclictest3378395-21kworker/u8:0+flush-8:020:20:460
3378486992417,5cyclictest3524457-21kworker/u8:3+flush-8:022:35:410
33781062242,3sleep00-21swapper/019:07:100
3378491992320,2cyclictest3582914-21needreboot22:30:392
3378491992320,2cyclictest3425466-21aten2_r5power_v19:55:322
3378491992320,2cyclictest3400743-21aten2_r5power_e19:30:332
3378491992320,2cyclictest3396040-21fschecks_count19:25:322
3378491992319,3cyclictest3509673-21cpuspeed_turbos21:20:322
3378491992319,3cyclictest0-21swapper/222:55:482
3378491992318,4cyclictest3475060-21cpuspeed_turbos20:45:342
3378491992318,3cyclictest3594366-21cpuspeed_turbos22:45:322
3378491992318,3cyclictest3410841-21fschecks_count19:40:352
3378491992318,3cyclictest3410841-21fschecks_count19:40:342
337849199231,20cyclictest3417658-21grep19:45:402
3378487992317,4cyclictest3479495-21kworker/u8:3+events_unbound21:25:411
3378486992318,3cyclictest3577897-21missed_timers22:25:420
3378486992318,3cyclictest3529180-21cron21:40:000
3378486992318,3cyclictest3529180-21cron21:39:590
3378486992316,5cyclictest3479495-21kworker/u8:3+flush-8:021:05:300
3378491992218,2cyclictest3614301-21cpuspeed_turbos23:05:322
3378491992217,3cyclictest0-21swapper/222:10:012
3378491992217,3cyclictest0-21swapper/219:20:012
3378491992215,6cyclictest3624853-21kthreadcore23:15:392
337849199220,10cyclictest3548456-21awk21:55:472
337848799227,3cyclictest0-21swapper/120:16:271
3378486992218,3cyclictest3633254-21sshd23:21:340
3378486992217,3cyclictest8550irq/124-ahci[0000:00:12.0]21:00:040
3378486992217,3cyclictest3424649-21unixbench_multi19:50:510
3378491992117,3cyclictest3593445-21unixbench_multi22:40:502
3378491992117,2cyclictest3568563-21unixbench_multi22:15:482
3378491992117,2cyclictest0-21swapper/220:59:592
3378491992115,4cyclictest3677536-21kworker/u8:1-ext4-rsv-conversion00:15:012
337849199210,8cyclictest36593802sed23:50:372
3378486992116,4cyclictest3654823-21kthreadcore23:45:390
3378486992116,4cyclictest3464522-21kworker/u8:2+flush-8:020:40:480
3378486992116,3cyclictest0-21swapper/020:30:410
337849199202,13cyclictest3648921-21apt-get23:40:312
3378491992017,2cyclictest3669052-21fschecks_count00:00:342
3378491992017,2cyclictest3588852-21cron22:40:002
3378491992015,3cyclictest0-21swapper/223:10:522
3378491992013,5cyclictest3405598-21apt-get19:35:302
337849199200,9cyclictest36545311irqcore23:45:362
337849199200,4cyclictest3474722-21latency_hist20:45:002
3378486992015,4cyclictest3487604-21kthreadcore20:55:400
3378486992014,4cyclictest3557919-21kthreadcore22:05:410
3378486992012,6cyclictest3563374-21systemctl22:10:460
3378491991915,2cyclictest0-21swapper/223:30:002
3378486991915,2cyclictest0-21swapper/021:30:300
33779932194,9sleep20-21swapper/219:05:512
337849199183,7cyclictest0-21swapper/223:00:422
3378491991813,4cyclictest0-21swapper/200:30:502
337849199179,6cyclictest3494592-21cut21:05:312
3378491991713,2cyclictest0-21swapper/220:30:502
35643632151,9sleep30-21swapper/322:15:293
36734682132,6sleep30-21swapper/300:05:013
36397222133,6sleep30-21swapper/323:30:383
36397222133,6sleep30-21swapper/323:30:383
36268642130,3sleep375-21kworker/3:1-events23:15:413
35995862134,6sleep30-21swapper/322:50:373
34843922132,7sleep30-21swapper/320:55:003
34646592132,6sleep30-21swapper/320:35:023
33943442132,7sleep30-21swapper/319:20:423
33834262132,7sleep30-21swapper/319:14:593
37052492123,5sleep30-21swapper/300:35:393
36982342122,5sleep30-21swapper/300:30:023
36939932122,6sleep30-21swapper/300:25:363
36635662122,6sleep30-21swapper/323:55:023
36633032122,6sleep30-21swapper/323:52:323
36491592122,6sleep30-21swapper/323:40:343
36471082122,6sleep30-21swapper/323:35:393
36294042122,6sleep30-21swapper/323:20:343
36192382122,6sleep30-21swapper/323:10:363
36135162122,6sleep30-21swapper/323:01:333
35945222122,6sleep30-21swapper/322:45:363
35890382122,6sleep30-21swapper/322:40:023
35869482122,6sleep30-21swapper/322:35:413
35791812123,5sleep30-21swapper/322:30:303
35742502122,6sleep30-21swapper/322:25:333
35700162122,7sleep30-21swapper/322:20:363
35497972122,6sleep30-21swapper/322:00:323
35391222122,6sleep30-21swapper/321:50:023
35344322122,6sleep30-21swapper/321:45:323
35341272122,6sleep30-21swapper/321:45:003
35242552123,5sleep30-21swapper/321:35:013
35242552123,5sleep30-21swapper/321:35:013
35195712122,6sleep30-21swapper/321:30:313
35188792122,6sleep30-21swapper/321:25:503
35099262122,6sleep30-21swapper/321:20:373
35057772123,6sleep30-21swapper/321:15:423
34895282122,6sleep30-21swapper/321:00:013
34871202122,6sleep30-21swapper/320:55:413
34772832122,6sleep30-21swapper/320:45:403
34745302120,6sleep30-21swapper/320:45:013
34599852122,6sleep30-21swapper/320:30:323
34545642122,6sleep30-21swapper/320:22:383
34491682122,6sleep30-21swapper/320:15:523
34399312122,6sleep30-21swapper/320:10:013
34155852123,5sleep30-21swapper/319:45:343
34151512122,6sleep30-21swapper/319:44:343
34151512122,6sleep30-21swapper/319:44:333
36885802112,6sleep30-21swapper/300:20:053
36737392112,5sleep30-21swapper/300:05:293
36576382112,5sleep30-21swapper/323:45:433
36384222112,6sleep30-21swapper/323:29:183
36140222112,5sleep30-21swapper/323:05:013
36042222112,5sleep30-21swapper/322:55:313
35596342112,6sleep30-21swapper/322:10:333
35547702112,5sleep30-21swapper/322:05:353
35487722112,5sleep30-21swapper/321:55:523
34992962112,5sleep30-21swapper/321:10:013
34549862112,5sleep30-21swapper/320:25:023
34302852112,5sleep30-21swapper/320:00:033
34298342112,6sleep30-21swapper/319:57:253
34102362112,6sleep30-21swapper/319:39:443
34003872112,5sleep30-21swapper/319:30:013
33961602112,5sleep30-21swapper/319:25:353
33871602111,6sleep30-21swapper/319:15:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional