You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 21:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Aug 14, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39618752740,7sleep0201rcuc/010:42:470
3749995996349,11cyclictest3945942-21cat10:25:012
38506512620,1sleep03850652-21collect208:47:550
40390242580,3chrt575-21kworker/3:2-events11:57:503
3749985995747,7cyclictest3811498-21latency_hist08:10:010
3749985995344,6cyclictest275-21systemd-journal08:20:000
3749988995246,4cyclictest4060626-21kworker/u8:1+flush-8:012:28:001
3749988995041,6cyclictest4031064-21base6411:50:011
3749988994943,4cyclictest3771853-21kworker/u8:0+flush-8:008:02:471
3749985994940,6cyclictest3996193-21cat11:15:010
3749988994835,10cyclictest275-21systemd-journal10:24:021
3749988994741,4cyclictest3745149-21kworker/u8:3+events_unbound07:15:031
3749988994640,4cyclictest4041278-21kworker/u8:0+flush-8:012:07:581
3749988994540,4cyclictest3851595-21kworker/u8:2+events_unbound10:02:451
3749988994538,5cyclictest3991044-21kworker/u8:1+flush-8:011:57:431
3749995994435,6cyclictest3981121-21cp11:00:012
3749985994334,6cyclictest4070819-21latency_hist12:30:010
3749988994233,7cyclictest3915289-21ntpq09:52:571
3749988994137,3cyclictest3836362-21kworker/u8:1+events_unbound09:17:441
3749985994132,7cyclictest3762458-21diskstats07:22:450
3749988994035,4cyclictest3891366-21kworker/u8:0+flush-8:010:47:441
3749988994035,3cyclictest3970782-21kworker/u8:3+events_unbound11:43:001
374998599403,17cyclictest3920198-21collect209:57:530
3749985994029,9cyclictest275-21systemd-journal07:15:010
3749988993934,4cyclictest3786779-21kworker/u8:3+events_unbound08:17:491
3749988993934,4cyclictest3771853-21kworker/u8:0+events_unbound08:22:581
3749988993934,4cyclictest3771853-21kworker/u8:0+events_unbound08:22:581
3749988993932,5cyclictest3891366-21kworker/u8:0+flush-8:009:32:531
3749988993833,4cyclictest3851595-21kworker/u8:2+flush-8:009:27:561
3749988993833,3cyclictest3901604-21apt-get09:42:421
3749988993833,3cyclictest3901604-21apt-get09:42:411
3749988993832,4cyclictest3891366-21kworker/u8:0+flush-8:009:37:501
3749988993827,8cyclictest3910431-21ntpq09:47:571
374998599385,17cyclictest0-21swapper/008:37:410
3749985993829,7cyclictest3845773-21ntpq08:42:580
3749985993829,6cyclictest4016074-21latency_hist11:35:010
3749988993732,3cyclictest3713245-21kworker/u8:1+flush-8:007:37:521
3749985993732,4cyclictest3991044-21kworker/u8:1+events_unbound11:52:490
3749985993725,10cyclictest3941257-21/usr/sbin/munin10:22:580
3749985993710,15cyclictest4056540-21/usr/sbin/munin12:17:440
3749988993632,3cyclictest4041278-21kworker/u8:0+events_unbound12:37:581
3749988993626,8cyclictest3775863-21ntpq07:32:591
3749988993625,8cyclictest275-21systemd-journal12:31:031
374998599367,12cyclictest3852280-21/usr/sbin/munin08:52:470
3749988993530,4cyclictest3970782-21kworker/u8:3+events_unbound10:52:581
3749988993530,4cyclictest3891366-21kworker/u8:0+events_unbound11:07:541
3749988993530,4cyclictest3866026-21kworker/u8:3+flush-8:010:37:491
3749988993528,5cyclictest4065012-21ntpq12:22:541
3749988993526,7cyclictest3851355-21latency_hist08:50:011
3749988993523,9cyclictest275-21systemd-journal07:55:021
374998599356,11cyclictest39031751kthreadcore09:42:500
374998599356,11cyclictest39031751kthreadcore09:42:500
374998599354,19cyclictest3985150-21ntpq11:02:560
3749985993530,3cyclictest4080818-21apt-key12:40:000
3749995993426,6cyclictest4031320-21cp11:50:012
3749988993426,6cyclictest3782235-21apt-get07:42:411
3749988993425,7cyclictest3835817-21ntpq08:32:571
3749988993424,8cyclictest3795901-21ntpq07:52:541
3749985993423,8cyclictest3980683-21apt-get11:00:000
3749988993329,3cyclictest3851595-21kworker/u8:2+events_unbound11:27:421
3749988993328,3cyclictest3891366-21kworker/u8:0+flush-8:009:57:531
3749988993328,3cyclictest3786779-21kworker/u8:3+flush-8:008:45:011
3749988993326,5cyclictest3891366-21kworker/u8:0+flush-8:010:17:461
374998599335,16cyclictest3856976-21cpuspeed_turbos08:57:430
3749985993325,6cyclictest3956642-21diskstats10:37:450
3749985993324,6cyclictest3911066-21latency_hist09:50:000
3749985993321,9cyclictest275-21systemd-journal08:00:000
39225412320,2sleep0201rcuc/010:02:510
3749988993228,3cyclictest3851595-21kworker/u8:2+flush-8:011:23:031
3749988993228,3cyclictest3851595-21kworker/u8:2+flush-8:011:23:031
3749988993226,5cyclictest4041278-21kworker/u8:0+flush-8:012:13:001
3749988993226,4cyclictest3771411-21grep07:28:021
374998599328,13cyclictest3966676-21/usr/sbin/munin10:47:460
374998599326,9cyclictest3757944-21ps07:17:480
374998599325,15cyclictest4051979-21ps12:12:500
3749995993122,6cyclictest275-21systemd-journal09:15:012
3749988993127,3cyclictest3851595-21kworker/u8:2+flush-8:009:12:591
3749988993126,4cyclictest3851595-21kworker/u8:2+flush-8:011:02:551
3749988993126,4cyclictest3836362-21kworker/u8:1+flush-8:008:57:541
3749988993126,4cyclictest3713245-21kworker/u8:1+flush-8:007:12:591
3749988993126,3cyclictest3713245-21kworker/u8:1+events_unbound07:25:011
3749988993125,5cyclictest3851595-21kworker/u8:2+flush-8:010:07:551
374998599318,11cyclictest3865258-21/usr/sbin/munin09:02:560
374998599317,13cyclictest3870455-21ntpq09:07:560
374998599316,14cyclictest3975062-21ntpq10:52:550
374998599315,15cyclictest1-21systemd10:15:010
374998599314,16cyclictest4005978-21users11:23:000
374998599314,16cyclictest4005978-21users11:23:000
374998599313,14cyclictest3887220-21ps09:27:480
3749985993111,10cyclictest3895272-21ntpq09:32:580
3749995993026,2cyclictest3960874-21cron10:40:002
3749988993026,3cyclictest3786779-21kworker/u8:3+events_unbound08:26:501
3749988993024,5cyclictest3851595-21kworker/u8:2+flush-8:011:38:001
3749988993024,4cyclictest3866026-21kworker/u8:3+flush-8:010:35:011
3749988993021,7cyclictest275-21systemd-journal12:20:001
374998599309,10cyclictest3885342-21ntpq09:22:540
374998599308,12cyclictest3876520-21/usr/sbin/munin09:17:400
374998599308,11cyclictest4050464-21python312:08:000
374998599308,10cyclictest3950234-21ntpq10:27:540
374998599307,5cyclictest3872321-21ps09:12:470
374998599307,13cyclictest3930182-21ntpq10:07:540
374998599307,11cyclictest4040288-21ntpq11:57:530
374998599305,9cyclictest3796650-21latency_hist07:55:010
374998599305,15cyclictest4026598-21/usr/sbin/munin11:47:430
374998599305,15cyclictest3896875-21diskstats09:37:450
374998599305,15cyclictest3825905-21ntpq08:22:570
374998599305,15cyclictest3825905-21ntpq08:22:570
374998599305,15cyclictest3777906-21irqstats07:37:520
374998599305,14cyclictest3990346-21python311:08:000
374998599305,12cyclictest3995013-21ntpq11:12:530
374998599305,12cyclictest3787928-21ps07:47:470
3749985993025,3cyclictest3772142-21aten2_r5power_e07:32:460
374998599302,16cyclictest3805642-21wc08:02:530
3749985993013,4cyclictest3830762-21ntpq08:27:540
3749995992925,3cyclictest4060626-21kworker/u8:1+flush-8:012:25:002
3749995992925,2cyclictest3920698-21unixbench_multi09:58:002
3749988992925,3cyclictest3851595-21kworker/u8:2+events_unbound11:18:031
3749988992925,2cyclictest849-21mta-sts-daemon08:13:001
3749988992924,4cyclictest3836362-21kworker/u8:1+events_unbound09:06:591
3749988992922,5cyclictest3771853-21kworker/u8:0+flush-8:007:47:531
3749988992921,6cyclictest3995752-21latency_hist11:15:001
374998599297,12cyclictest3951808-21/usr/sbin/munin10:32:450
374998599297,12cyclictest3767606-21/usr/sbin/munin07:27:470
374998599296,13cyclictest4065081-21ntpq12:22:560
374998599295,14cyclictest4010351-21ntpq11:27:520
374998599295,11cyclictest3784031-21kthreadcore07:42:500
374998599294,14cyclictest4020337-21ntpq11:37:550
374998599294,14cyclictest3936556-21diskstats10:17:450
374998599294,12cyclictest3811959-21apt-get08:12:430
374998599292,16cyclictest4044366-21kthreadcore12:02:490
3749995992824,3cyclictest3841428-21cron08:40:002
3749995992820,6cyclictest4046432-21apt-get12:07:402
3749988992825,2cyclictest4046000-21systemd-run12:05:001
3749988992824,3cyclictest3851595-21kworker/u8:2+flush-8:009:03:051
3749988992822,5cyclictest3851595-21kworker/u8:2+events_unbound10:27:441
374998599289,9cyclictest3835985-21python308:32:590
374998599284,13cyclictest4075060-21ntpq12:32:560
374998599283,14cyclictest3912027-21if_err_enp4s0.309:52:490
374998599283,11cyclictest4022629-21kthreadcore11:42:490
3749995992723,2cyclictest3913676-21kthreadcore09:52:512
3749995992722,3cyclictest3762558-21cut07:22:462
3749995992719,6cyclictest275-21systemd-journal08:25:002
3749995992719,6cyclictest275-21systemd-journal08:25:002
3749995992623,2cyclictest3846906-21aten2_r5power_c08:47:432
3749995992622,2cyclictest3931578-21tr10:12:442
3749995992622,2cyclictest3776310-21unixbench_multi07:33:042
3749995992621,3cyclictest3995538-21unixbench_singl11:13:002
3749995992618,6cyclictest4006153-21turbostat.cron11:25:002
3749995992618,6cyclictest4006153-21turbostat.cron11:25:002
3749995992610,3cyclictest37897992cut07:47:492
3749988992622,3cyclictest3836362-21kworker/u8:1+events_unbound09:22:451
3749988992622,3cyclictest3786779-21kworker/u8:3+flush-8:008:07:591
3749988992621,4cyclictest3851595-21kworker/u8:2+flush-8:011:30:301
3749988992621,3cyclictest3836362-21kworker/u8:1+events_unbound08:37:441
38441742250,4sleep239-21ksoftirqd/208:42:522
3749995992523,1cyclictest3851595-21kworker/u8:2+flush-8:010:27:522
3749995992522,2cyclictest3961461-21aten2_r5power_v10:42:432
3749995992522,2cyclictest3856857-21aten2_r5power_v08:57:432
3749995992521,3cyclictest3905908-21unixbench_singl09:43:022
3749995992521,3cyclictest3905908-21unixbench_singl09:43:022
3749995992520,4cyclictest4045983-21idleruntime-cro12:05:002
3749995992514,9cyclictest4070811-21awk12:30:002
37496832252,6sleep00-21swapper/007:08:250
3749995992419,3cyclictest3971452-21tr10:52:432
3749995992319,2cyclictest0-21swapper/212:15:002
3749995992317,4cyclictest3781298-21unixbench_singl07:38:052
3749988992319,3cyclictest3841479-21kworker/u8:0+events_unbound08:52:591
3749988992316,5cyclictest3970782-21kworker/u8:3+flush-8:010:57:411
3749995992218,2cyclictest0-21swapper/211:20:002
3749995992217,4cyclictest3771853-21kworker/u8:0+flush-8:008:27:592
3749995992215,5cyclictest3895939-21apt-get09:35:022
3749988992218,3cyclictest3991044-21kworker/u8:1+flush-8:011:52:521
3749988992218,2cyclictest0-21swapper/110:42:481
3749995992118,2cyclictest3906780-21cpuspeed_turbos09:47:432
3749995992117,3cyclictest3836204-21unixbench_multi08:33:002
3749995992117,3cyclictest0-21swapper/209:30:002
374999599211,5cyclictest3810768-21ntpq08:07:552
3749995992115,4cyclictest3982292-21sed11:02:502
3749988992117,3cyclictest3851595-21kworker/u8:2+flush-8:010:12:031
37452132216,9sleep10-21swapper/107:05:571
3749995992017,2cyclictest3986439-21aten2_r5power_v11:07:442
3749995992017,2cyclictest3926583-21cpuspeed_turbos10:07:432
3749995992016,2cyclictest4060773-21cron12:20:002
3749995992016,2cyclictest3940617-21grep10:18:022
3749995992015,3cyclictest3757581-21fschecks_time07:17:452
3749995992014,4cyclictest4071330-21aten2_r5power_e12:32:432
3749995992014,4cyclictest0-21swapper/211:38:002
3749995992013,5cyclictest3851595-21kworker/u8:2+flush-8:010:33:002
374999599199,8cyclictest275-21systemd-journal07:54:022
3749995991915,3cyclictest4080876-21latency_hist12:40:002
3749995991915,2cyclictest4031808-21cpuspeed_turbos11:52:442
3749995991915,2cyclictest3895709-21unixbench_multi09:33:032
3749995991915,2cyclictest0-21swapper/208:15:002
3749995991915,2cyclictest0-21swapper/207:27:482
3749995991914,3cyclictest0-21swapper/207:15:012
3749995991913,4cyclictest0-21swapper/209:02:522
37449342194,9sleep20-21swapper/207:05:022
3749995991814,2cyclictest0-21swapper/210:47:592
3749995991813,3cyclictest3817237-21aten2_r5power_p08:17:432
3749995991812,4cyclictest3798069-21tr07:57:482
3749995991812,4cyclictest0-21swapper/208:02:522
37479502182,9sleep30-21swapper/307:07:523
3749995991714,2cyclictest0-21swapper/211:27:472
3749995991713,2cyclictest0-21swapper/211:32:432
3749995991711,4cyclictest0-21swapper/209:22:502
374999599169,5cyclictest4023111-21tr11:42:492
3749995991612,2cyclictest0-21swapper/210:02:472
374999599161,11cyclictest3870545-21ps09:07:592
38720752155,6sleep30-21swapper/309:12:473
374999599156,7cyclictest3872863-21tr09:12:482
3749995991511,2cyclictest0-21swapper/208:52:432
3749995991511,2cyclictest0-21swapper/207:42:462
374999599150,4cyclictest40390282kthreadcore11:57:512
40172392145,5sleep30-21swapper/311:37:493
39653482142,8sleep30-21swapper/310:42:593
40556142134,6sleep30-21swapper/312:13:043
40231922132,7sleep30-21swapper/311:42:503
39802762133,6sleep30-21swapper/310:58:003
39458692132,6sleep30-21swapper/310:25:023
39173362133,6sleep30-21swapper/309:57:493
39020742133,6sleep30-21swapper/309:42:493
39020742133,6sleep30-21swapper/309:42:483
38604852132,7sleep30-21swapper/308:57:543
40708302122,5sleep30-21swapper/312:30:023
40663002122,6sleep30-21swapper/312:27:443
40609982122,5sleep30-21swapper/312:20:023
40459632122,5sleep30-21swapper/312:05:013
40269242122,6sleep30-21swapper/311:47:483
40052522122,6sleep30-21swapper/311:22:523
40052522122,6sleep30-21swapper/311:22:523
39968422122,6sleep30-21swapper/311:17:463
39708292122,6sleep30-21swapper/310:50:023
39567652122,6sleep30-21swapper/310:37:463
39555572123,6sleep30-21swapper/310:33:003
39421662122,6sleep30-21swapper/310:22:493
39209992122,6sleep30-21swapper/310:00:023
39115222122,6sleep30-21swapper/309:52:433
39069322122,6sleep30-21swapper/309:47:463
38891782122,6sleep30-21swapper/309:27:523
38764532122,6sleep30-21swapper/309:17:003
38644922122,6sleep30-21swapper/309:02:563
38369482122,6sleep30-21swapper/308:37:443
38211462122,6sleep30-21swapper/308:18:023
38158542122,6sleep30-21swapper/308:13:003
38006862123,6sleep30-21swapper/307:57:513
37917082122,5sleep30-21swapper/307:50:013
37874632122,6sleep30-21swapper/307:47:443
37758652122,6sleep30-21swapper/307:33:003
37666492122,5sleep30-21swapper/307:25:013
40806002112,6sleep30-21swapper/312:38:443
40561282112,6sleep30-21swapper/312:15:483
40413512112,6sleep30-21swapper/312:01:083
40358582112,5sleep30-21swapper/311:53:013
40113582112,6sleep30-21swapper/311:30:183
40061392112,5sleep30-21swapper/311:25:013
39910462112,6sleep30-21swapper/311:10:083
39860912112,4sleep30-21swapper/311:05:023
39813572112,6sleep30-21swapper/311:02:373
39661152112,6sleep30-21swapper/310:45:523
39401992112,5sleep30-21swapper/310:17:593
39312602112,6sleep30-21swapper/310:11:583
39263282112,6sleep30-21swapper/310:07:323
38964292112,6sleep30-21swapper/309:35:303
38918572112,5sleep30-21swapper/309:32:493
38810842112,5sleep30-21swapper/309:20:013
38666092112,5sleep30-21swapper/309:07:413
38516202112,6sleep30-21swapper/308:50:363
38466422112,5sleep30-21swapper/308:45:023
38453382112,5sleep30-21swapper/308:42:543
38317852112,6sleep30-21swapper/308:30:343
38268222112,6sleep30-21swapper/308:25:123
38223772112,5sleep30-21swapper/308:22:473
38223772112,5sleep30-21swapper/308:22:473
38068692112,6sleep30-21swapper/308:05:463
38058942112,5sleep30-21swapper/308:02:573
37820902112,6sleep30-21swapper/307:41:103
37813852112,6sleep30-21swapper/307:38:333
37620702112,6sleep30-21swapper/307:21:163
37568762112,5sleep30-21swapper/307:15:063
37506032112,5sleep30-21swapper/307:12:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional