You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 14:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sun Aug 16, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
338827721660,3sleep3575-21kworker/3:2-events09:52:523
322279799151146,3cyclictest0-21swapper/111:17:541
322279499149131,16cyclictest3472683-21ntpq11:17:540
322280299134129,3cyclictest3472681-21sshd11:17:542
32836752990,1chrt571-21snmpd08:07:560
32910712870,3sleep20-21swapper/208:17:492
32910712870,3sleep20-21swapper/208:17:492
3222794996144,8cyclictest275-21systemd-journal09:57:530
3222797995950,6cyclictest3443668-21latency_hist10:50:011
3222797995650,5cyclictest3364743-21kworker/u8:1+flush-8:010:17:541
34741542520,3chrt0-21swapper/211:22:432
3222794995247,4cyclictest3423879-21kworker/u8:1+events_unbound11:02:570
33520742480,2sleep3575-21kworker/3:2-events09:17:493
3222802994838,7cyclictest275-21systemd-journal08:05:532
3222797994642,3cyclictest3284162-21kworker/u8:0+flush-8:009:47:541
3222797994640,4cyclictest3212931-21kworker/u8:2+events_unbound09:10:001
3222797994634,9cyclictest275-21systemd-journal07:57:541
3222797994435,6cyclictest275-21systemd-journal09:03:541
3222794994433,9cyclictest275-21systemd-journal10:15:000
3222794994433,9cyclictest275-21systemd-journal10:15:000
33641422430,3sleep20-21swapper/209:27:592
3222794994338,4cyclictest3537727-21kworker/u8:0+flush-8:012:32:430
3222797994233,6cyclictest3254647-21latency_hist07:40:011
3222797994134,5cyclictest3284312-21latency_hist08:10:001
3222797994130,9cyclictest275-21systemd-journal09:37:531
3222794994135,4cyclictest3323728-21kworker/u8:1+flush-8:009:12:440
3222802994031,7cyclictest3314633-21cat08:40:012
3222797994035,4cyclictest3517958-21kworker/u8:3+events_unbound12:12:571
3222797994035,4cyclictest3212931-21kworker/u8:2+events_unbound08:58:001
3222797994031,7cyclictest3274870-21/usr/sbin/munin08:02:521
3222797993935,3cyclictest3349850-21kworker/u8:3+events_unbound09:22:471
3222794993934,3cyclictest3284162-21kworker/u8:0+events_unbound08:37:490
3222794993929,8cyclictest275-21systemd-journal07:55:000
3222794993929,7cyclictest275-21systemd-journal10:35:000
321850223928,6sleep30-21swapper/307:07:483
32178662393,9sleep10-21swapper/107:06:091
3222802993828,7cyclictest275-21systemd-journal08:15:002
3222802993827,8cyclictest275-21systemd-journal09:40:532
3222797993832,5cyclictest2421957-21kworker/u8:1+flush-8:008:12:441
3222797993832,4cyclictest3212931-21kworker/u8:2+events_unbound08:52:561
3222797993831,5cyclictest3314746-21kworker/u8:3+flush-8:008:45:011
3222794993832,4cyclictest3304592-21kworker/u8:1+flush-8:008:32:440
3222797993732,4cyclictest3537727-21kworker/u8:0+events_unbound12:27:581
3222797993730,5cyclictest3423879-21kworker/u8:1+flush-8:011:47:531
3222797993727,8cyclictest3423175-21ntpq10:27:561
3222797993727,8cyclictest3344867-21/usr/sbin/munin09:12:571
3222797993721,10cyclictest275-21systemd-journal11:10:001
3222797993632,3cyclictest3284162-21kworker/u8:0+events_unbound08:22:431
3222797993630,4cyclictest3403364-21kworker/u8:2+flush-8:010:32:551
3222797993629,5cyclictest3523459-21kworker/u8:1+events_unbound12:22:571
3222794993629,5cyclictest3403364-21kworker/u8:2+flush-8:010:22:590
3222794993628,5cyclictest275-21systemd-journal07:40:550
3222797993529,4cyclictest275-21systemd-journal11:22:531
3222797993526,6cyclictest3309348-21latency_hist08:35:011
3222794993523,9cyclictest3538033-21latency_hist12:25:010
3222797993426,6cyclictest3350040-21/usr/sbin/munin09:17:541
3222797993423,8cyclictest275-21systemd-journal08:27:531
3222802993326,5cyclictest275-21systemd-journal10:27:532
3222802993325,6cyclictest275-21systemd-journal09:14:532
3222797993325,6cyclictest2421957-21kworker/u8:1+flush-8:007:42:431
3222797993324,7cyclictest3508237-21cron11:55:001
3222794993325,7cyclictest3483328-21kworker/u8:2+flush-8:011:42:540
3222794993324,6cyclictest3269971-21aten2_r5power_c07:57:410
3222802993227,4cyclictest3175568-21kworker/u8:0+flush-8:007:20:002
3222802993223,6cyclictest275-21systemd-journal10:05:002
3222797993227,3cyclictest3310147-21fschecks_time08:37:451
3222797993227,3cyclictest3290186-21cpuspeed_turbos08:17:431
3222797993227,3cyclictest3290186-21cpuspeed_turbos08:17:431
3222797993226,4cyclictest20823-21cron10:40:001
3222797993224,6cyclictest275-21systemd-journal07:28:541
3222797993223,7cyclictest3349850-21kworker/u8:3+flush-8:009:32:431
3222794993227,3cyclictest3334518-21cron09:00:000
3222794993227,3cyclictest3248850-21needreboot07:32:530
3222794993227,3cyclictest3175568-21kworker/u8:0+events_unbound07:25:010
3222794993226,5cyclictest3349850-21kworker/u8:3+flush-8:009:17:520
3222794993226,4cyclictest3234825-21cron07:20:000
3222794993224,6cyclictest3329398-21unixbench_singl08:53:000
3222794993223,7cyclictest3227710-21latency_hist07:15:010
3222794993220,10cyclictest3289290-21apt-key08:15:000
3222797993125,5cyclictest2421957-21kworker/u8:1+flush-8:007:47:521
3222797993121,8cyclictest3393417-21ntpq09:57:551
3222794993126,4cyclictest3439268-21aten2_r5power_p10:47:430
3222794993126,3cyclictest3453542-21cron11:00:000
3222794993125,4cyclictest3423879-21kworker/u8:1+flush-8:010:54:240
3222794993124,6cyclictest3537727-21kworker/u8:0+flush-8:012:37:430
3222794993124,5cyclictest3335083-21aten2_r5power_p09:02:420
3222802993025,3cyclictest3483226-21unixbench_multi11:28:012
3222802993024,4cyclictest3548811-21cpuspeed_turbos12:37:412
3222802993023,5cyclictest3413728-21unixbench_singl10:17:592
3222802993022,6cyclictest3504077-21fschecks_count11:52:452
3222802993022,6cyclictest3251057-21kthreadcore07:37:472
3222797993022,6cyclictest3513700-21apt-get12:02:401
3222794993025,4cyclictest3284162-21kworker/u8:0+flush-8:008:27:470
3222794993023,5cyclictest3365249-21fschecks_time09:32:440
3222802992924,3cyclictest3523904-21fschecks_count12:12:442
3222802992924,3cyclictest3464123-21cpuspeed_turbos11:12:432
3222802992924,3cyclictest3404701-21cpuspeed_turbos10:12:442
3222802992924,3cyclictest3404701-21cpuspeed_turbos10:12:442
3222797992925,3cyclictest3212931-21kworker/u8:2+events_unbound08:47:541
3222797992924,3cyclictest3416592-21kthreadcore10:22:521
3222797992924,3cyclictest3388976-21unixbench_multi09:53:011
3222797992919,7cyclictest3513231-21latency_hist12:00:001
3222797992919,7cyclictest3513231-21latency_hist12:00:001
3222794992924,4cyclictest3488446-21kworker/u8:0+flush-8:011:37:590
3222794992924,4cyclictest3384081-21unixbench_singl09:48:000
3222794992924,4cyclictest3284162-21kworker/u8:0+events_unbound10:02:500
3222794992924,3cyclictest3499529-21irqrtprio11:47:440
3222794992922,5cyclictest3522415-21ntpq12:07:550
3222794992922,5cyclictest3518170-21cron12:05:000
3222794992922,5cyclictest3433765-21cron10:40:000
3222794992920,7cyclictest3403364-21kworker/u8:2+flush-8:011:12:540
322279499291,9cyclictest3323752-21ntpq08:47:560
3222802992824,3cyclictest3240464-21cpuspeed_turbos07:27:432
3222802992824,2cyclictest3532844-21unixbench_singl12:18:002
3222802992823,3cyclictest3429560-21fschecks_count10:37:432
3222802992818,2cyclictest35197662kthreadcore12:07:492
3222797992824,3cyclictest3175568-21kworker/u8:0+flush-8:007:12:461
3222797992823,4cyclictest3443541-21kworker/u8:3+flush-8:010:59:581
3222797992822,4cyclictest0-21swapper/111:40:001
3222794992824,2cyclictest3294504-21systemd-run08:20:000
3222794992824,2cyclictest3294504-21systemd-run08:20:000
3222794992824,2cyclictest0-21swapper/007:40:000
3222794992823,4cyclictest3364743-21kworker/u8:1+flush-8:009:52:540
3222794992822,5cyclictest3483473-21cron11:30:000
3222794992821,6cyclictest3344251-21unixbench_singl09:08:000
3222794992820,6cyclictest3523727-21aten2_r5power_v12:12:420
32360652270,5sleep30-21swapper/307:22:483
3222802992724,2cyclictest3320001-21aten2_r5power_e08:47:422
3222802992723,2cyclictest3380038-21cpuspeed_turbos09:47:432
3222802992719,6cyclictest275-21systemd-journal10:45:012
3222802992713,3cyclictest0-21swapper/212:23:422
3222797992722,4cyclictest3212931-21kworker/u8:2+events_unbound09:27:581
3222797992722,3cyclictest0-21swapper/111:02:581
3222797992721,5cyclictest3537727-21kworker/u8:0+events_unbound12:37:421
3222794992724,2cyclictest3513269-21systemd-run12:00:000
3222794992724,2cyclictest3513269-21systemd-run12:00:000
3222794992723,2cyclictest3540888-21kthreadcore12:27:480
3222794992722,3cyclictest3478286-21unixbench_multi11:23:020
3222794992722,3cyclictest3289736-21kworker/u8:3+events_unbound08:25:000
3222794992720,5cyclictest3378543-21needreboot09:42:510
3222794992720,5cyclictest3355784-21irqrtprio09:22:470
3222794992718,6cyclictest3423863-21latency_hist10:30:010
3222794992718,6cyclictest3319488-21latency_hist08:45:010
3222802992623,2cyclictest3389907-21cpuspeed_turbos09:57:442
3222802992620,4cyclictest3274442-21sendmail08:00:002
3222802992612,3cyclictest0-21swapper/208:40:322
3222797992621,4cyclictest3409221-21kworker/u8:0+flush-8:010:42:471
3222797992620,4cyclictest3245505-21cut07:32:461
3222797992619,5cyclictest3364743-21kworker/u8:1+events_unbound10:14:071
3222797992619,5cyclictest3364743-21kworker/u8:1+events_unbound10:14:071
3222797992617,7cyclictest3403329-21ntpq10:07:541
3222794992621,3cyclictest3244709-21cron07:30:000
3222794992619,5cyclictest3434335-21aten2_r5power_p10:42:440
3222802992520,4cyclictest3449296-21cpuspeed_turbos10:57:432
3222802992519,4cyclictest3484155-21cpuspeed_turbos11:32:432
3222802992518,6cyclictest3255402-21fschecks_count07:42:442
3222802992517,7cyclictest3514050-21fschecks_time12:02:452
3222802992514,9cyclictest3503333-21awk11:50:002
3222797992520,2cyclictest0-21swapper/111:12:561
3222797992519,3cyclictest3522911-21unixbench_singl12:08:011
3222797992514,8cyclictest3268796-21ntpq07:52:551
3222794992518,6cyclictest3212931-21kworker/u8:2+flush-8:009:27:530
3222794992518,4cyclictest0-21swapper/011:52:420
3222794992511,12cyclictest0-21swapper/010:17:560
3222802992421,2cyclictest3489183-21fschecks_count11:37:442
3222802992420,3cyclictest3249404-21unixbench_multi07:33:012
3222802992419,3cyclictest3459015-21aten2_r5power_c11:07:422
3222802992419,3cyclictest3269233-21unixbench_multi07:53:002
3222802992419,3cyclictest3227494-21unixbench_singl07:13:012
3222802992410,3cyclictest0-21swapper/207:24:082
3222797992420,2cyclictest0-21swapper/109:42:591
3222797992418,4cyclictest0-21swapper/110:02:431
3222797992418,3cyclictest3239786-21apt07:25:011
3222794992419,3cyclictest3279111-21unixbench_multi08:03:000
3222794992418,4cyclictest3374595-21latency_hist09:40:010
32216812244,12sleep03221720-21ntpq07:07:530
3222802992320,2cyclictest3424371-21aten2_r5power_e10:32:422
3222802992320,2cyclictest3275245-21fschecks_time08:02:452
3222802992318,4cyclictest3364743-21kworker/u8:1+flush-8:009:32:572
3222797992318,4cyclictest3462772-21kworker/u8:0+flush-8:011:27:451
3222797992317,3cyclictest0-21swapper/111:32:591
3222797992316,5cyclictest3532800-21grep12:18:001
3222797992316,5cyclictest3483328-21kworker/u8:2+events_unbound11:42:441
322279499238,11cyclictest3463459-21true11:10:000
3222802992219,2cyclictest3399885-21fschecks_time10:07:452
3222797992216,4cyclictest3227718-21apt-get07:15:031
3222797992213,7cyclictest3444093-21/usr/sbin/munin10:52:541
3222794992217,4cyclictest3532261-21needreboot12:17:510
3222794992217,3cyclictest0-21swapper/010:07:500
3222802992118,2cyclictest3444352-21cpuspeed_turbos10:52:452
3222802992118,2cyclictest3369964-21aten2_r5power_e09:37:432
3222802992117,2cyclictest0-21swapper/209:52:572
3222797992116,3cyclictest3537727-21kworker/u8:0+events_unbound12:32:491
3222794992115,4cyclictest2421957-21kworker/u8:1+flush-8:007:47:510
322280299202,8cyclictest0-21swapper/209:17:492
322280299202,17cyclictest0-21swapper/212:32:572
3222802992017,2cyclictest3300090-21cpuspeed_turbos08:27:452
3222802992016,2cyclictest0-21swapper/207:10:012
3222802992015,3cyclictest0-21swapper/209:25:002
3222802992015,3cyclictest0-21swapper/209:10:002
3222802992012,6cyclictest3329326-21tail08:53:002
322280299192,12cyclictest3493893-21apt-get11:42:402
3222802991911,6cyclictest3543272-21sed12:30:012
3222802991911,6cyclictest3264541-21grep07:50:002
3222802991911,6cyclictest0-21swapper/211:05:002
3222802991911,6cyclictest0-21swapper/210:22:512
3222802991910,7cyclictest3307920-21cut08:32:502
3222794991911,6cyclictest3484678-21sed11:32:470
322280299182,11cyclictest3508699-21apt-get11:57:412
322280299182,11cyclictest3508699-21apt-get11:57:412
3222802991810,6cyclictest0-21swapper/209:02:592
322280299179,6cyclictest3441708-21seq10:47:502
322280299179,6cyclictest3331229-21cut08:57:492
3222802991611,3cyclictest0-21swapper/208:22:492
34527892142,8sleep30-21swapper/310:57:533
35380192132,7sleep30-21swapper/312:25:013
34545262132,7sleep30-21swapper/311:02:473
34478842132,7sleep30-21swapper/310:52:563
34033952132,7sleep30-21swapper/310:07:573
32647032132,6sleep30-21swapper/307:50:023
32224792132,6sleep30-21swapper/307:10:013
35485922123,5sleep30-21swapper/312:37:413
35474912122,6sleep30-21swapper/312:32:553
35281662122,6sleep30-21swapper/312:15:023
35207862122,6sleep30-21swapper/312:07:513
35132712122,6sleep30-21swapper/312:00:023
35127572122,6sleep30-21swapper/311:58:003
35127572122,6sleep30-21swapper/311:58:003
35037912122,6sleep30-21swapper/311:52:433
34884822122,5sleep30-21swapper/311:35:013
34841862122,6sleep30-21swapper/311:32:443
34790172122,7sleep30-21swapper/311:27:433
34745462122,6sleep30-21swapper/311:22:493
34691372122,6sleep30-21swapper/311:17:443
34634562122,5sleep30-21swapper/311:10:013
34589572122,6sleep30-21swapper/311:07:403
34390162122,6sleep30-21swapper/310:45:533
34288812122,5sleep30-21swapper/310:35:023
33982302122,6sleep30-21swapper/310:02:523
33892552122,5sleep30-21swapper/309:55:013
33787542122,6sleep30-21swapper/309:42:583
33645072122,5sleep30-21swapper/309:30:023
33612122122,6sleep30-21swapper/309:27:493
33448572123,6sleep30-21swapper/309:12:323
33395022121,6sleep30-21swapper/309:05:013
33234702122,6sleep30-21swapper/308:47:523
33147982122,6sleep30-21swapper/308:40:543
33038862122,6sleep30-21swapper/308:28:033
32920972122,6sleep30-21swapper/308:17:513
32920972122,6sleep30-21swapper/308:17:513
32847662122,6sleep30-21swapper/308:12:413
32744572122,5sleep30-21swapper/308:00:013
32604212122,6sleep30-21swapper/307:47:453
32587032122,6sleep30-21swapper/307:42:513
32496532122,5sleep30-21swapper/307:35:013
32452592122,6sleep30-21swapper/307:32:443
32398662122,5sleep30-21swapper/307:25:023
32283402122,6sleep30-21swapper/307:15:033
35387232112,6sleep30-21swapper/312:27:423
35233602112,6sleep30-21swapper/312:10:203
34985962112,6sleep30-21swapper/311:45:163
34979502112,6sleep30-21swapper/311:43:003
34340652112,6sleep30-21swapper/310:40:403
34246702112,5sleep30-21swapper/310:32:453
34192612112,5sleep30-21swapper/310:26:313
34140872112,5sleep30-21swapper/310:20:013
34093092112,6sleep30-21swapper/310:16:203
34043172112,5sleep30-21swapper/310:10:543
34043172112,5sleep30-21swapper/310:10:543
33795862112,5sleep30-21swapper/309:45:023
33698382112,6sleep30-21swapper/309:37:083
33548512112,6sleep30-21swapper/309:20:143
33348652112,6sleep30-21swapper/309:01:163
33298142112,5sleep30-21swapper/308:55:023
33250572112,6sleep30-21swapper/308:52:383
33095752112,6sleep30-21swapper/308:35:083
33045932112,5sleep30-21swapper/308:30:063
32948162112,5sleep30-21swapper/308:21:283
32798022112,5sleep30-21swapper/308:07:393
32698952112,6sleep30-21swapper/307:57:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional