You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-07 - 17:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Mar 06, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3516910995447,5cyclictest3553435-21latency_hist07:45:001
3516907995142,6cyclictest3806866-21latency_hist12:00:020
3516907994738,6cyclictest3821662-21latency_hist12:15:010
3516907994738,6cyclictest3821662-21latency_hist12:15:000
3516910994538,5cyclictest3633332-21/usr/sbin/munin09:07:001
3516910994439,3cyclictest3577411-21apt-get08:06:531
35121872435,13sleep10-21swapper/107:06:391
3516910994231,8cyclictest280-21systemd-journal11:20:001
3516910994134,4cyclictest3682733-21latency_hist09:55:001
3516910993930,6cyclictest3801930-21latency_hist11:55:011
3516907993930,6cyclictest3667613-21latency_hist09:40:020
3516913993833,3cyclictest280-21systemd-journal08:35:002
3516910993833,4cyclictest3464971-21kworker/u8:0+flush-8:007:16:571
351690799382,30cyclictest3516766-21kworker/0:2+events09:11:420
3516910993729,6cyclictest3795321-21kworker/u8:0+events_unbound11:56:571
35948422360,3sleep375-21kworker/3:1-events08:26:503
3516910993631,3cyclictest3757151-21kworker/u8:2+flush-8:011:21:511
3516910993630,4cyclictest3511855-21kworker/u8:3+flush-8:007:32:001
3516910993628,6cyclictest3772616-21apt-get11:26:411
3516910993530,3cyclictest3632965-21cron09:05:001
351690799351,28cyclictest3801954-21kworker/0:0+events12:06:420
3516907993511,23cyclictest3516766-21kworker/0:2+events07:20:000
3516907993510,23cyclictest3516766-21kworker/0:2+events08:46:580
3516907993510,23cyclictest3516766-21kworker/0:2+events08:01:480
3516910993428,5cyclictest3511855-21kworker/u8:3+flush-8:007:22:001
3516910993428,5cyclictest3511855-21kworker/u8:3+events_unbound08:31:581
3516910993427,5cyclictest3781890-21kworker/u8:3+events_unbound11:41:551
3516907993426,6cyclictest3548483-21latency_hist07:40:010
3516907993410,22cyclictest3516766-21kworker/0:2+events07:21:570
3516907993410,19cyclictest3772258-21kworker/0:1+events11:26:370
35165352344,9sleep20-21swapper/207:07:372
3516910993326,5cyclictest280-21systemd-journal11:00:001
351690799339,22cyclictest3697831-21kworker/0:0+events11:11:550
351690799339,22cyclictest3516766-21kworker/0:2+events08:26:560
351690799337,21cyclictest3516766-21kworker/0:2+events08:15:280
3516907993325,6cyclictest3727443-21latency_hist10:40:010
351690799331,30cyclictest3516766-21kworker/0:2+events09:50:530
3516910993227,4cyclictest3757151-21kworker/u8:2+flush-8:012:16:541
3516910993227,3cyclictest3757380-21sh11:10:001
3516910993226,4cyclictest3816718-21cron12:10:001
3516910993225,5cyclictest3548735-21kworker/u8:1+flush-8:008:37:011
3516910993224,6cyclictest3597411-21ntpq08:26:551
3516910993221,8cyclictest280-21systemd-journal08:22:351
351690799327,23cyclictest3697831-21kworker/0:0+events10:31:540
351690799323,27cyclictest3801954-21kworker/0:0+events12:26:560
3516907993228,3cyclictest3628066-21systemd-run09:00:000
3516907993224,6cyclictest3593253-21latency_hist08:25:010
351690799322,29cyclictest3516766-21kworker/0:2+events07:56:500
351690799322,29cyclictest3516766-21kworker/0:2+events07:56:500
3516907993222,8cyclictest3840727-21ntpq12:31:560
3516907993210,21cyclictest3516766-21kworker/0:2+events08:41:520
38126072310,3chrt39-21ksoftirqd/212:06:472
3516913993126,3cyclictest3529055-21aten2_r5power_e07:21:422
3516910993126,3cyclictest880-21mta-sts-daemon11:11:571
3516910993126,3cyclictest3757151-21kworker/u8:2+flush-8:012:12:001
3516910993126,3cyclictest3757151-21kworker/u8:2+flush-8:012:12:001
3516910993125,4cyclictest3781890-21kworker/u8:3+events_unbound11:36:521
3516910993125,4cyclictest3742530-21cron10:55:001
3516910993125,4cyclictest3711735-21needreboot10:21:511
3516910993124,5cyclictest3548735-21kworker/u8:1+events_unbound08:41:541
351690799318,21cyclictest3516766-21kworker/0:2+events08:31:580
351690799313,26cyclictest3516766-21kworker/0:2+events07:31:540
3516907993123,6cyclictest3618512-21/usr/sbin/munin08:51:540
351690799311,28cyclictest3697831-21kworker/0:0+events11:06:540
351690799310,30cyclictest3516766-21kworker/0:2+events08:38:260
351691399308,3cyclictest36578522latency_hist09:30:022
3516913993026,3cyclictest3757151-21kworker/u8:2+flush-8:011:16:532
3516913993025,4cyclictest3787123-21kworker/u8:1+flush-8:011:47:002
3516913993022,6cyclictest3637636-21sed09:07:012
3516910993025,3cyclictest3834125-21kthreadcore12:26:491
3516910993024,5cyclictest3787123-21kworker/u8:1+events_unbound12:31:411
3516910993024,4cyclictest3534281-21fschecks_time07:26:531
351691099302,12cyclictest0-21swapper/109:36:551
3516910993020,8cyclictest3582585-21ntpq08:11:541
3516910993020,7cyclictest280-21systemd-journal11:49:411
351690799308,17cyclictest3801954-21kworker/0:0+events12:35:180
351690799307,22cyclictest3816750-21kworker/0:2+events12:15:580
351690799307,21cyclictest3772258-21kworker/0:1+events11:45:010
351690799307,21cyclictest3697831-21kworker/0:0+events10:46:420
351690799302,26cyclictest3801954-21kworker/0:0+events12:01:460
351690799302,26cyclictest3516766-21kworker/0:2+events09:56:580
3516907993022,5cyclictest3703179-21grep10:16:420
351690799301,27cyclictest3516766-21kworker/0:2+events09:45:000
351690799300,25cyclictest3516766-21kworker/0:2+events08:10:380
3516913992924,3cyclictest3517300-21aten2_r5power_v07:11:522
3516913992923,4cyclictest3662467-21kworker/u8:1+events_unbound09:47:002
3516910992924,4cyclictest3702412-21unixbench_multi10:12:001
3516910992924,3cyclictest3728432-21irqcore10:41:511
3516910992923,4cyclictest3682761-21kworker/u8:2+flush-8:010:02:001
3516910992923,4cyclictest3643446-21cpuspeed_turbos09:16:441
3516910992923,4cyclictest3638888-21irqcore09:11:491
351690799292,26cyclictest3516766-21kworker/0:2+events09:21:520
351690799292,25cyclictest3697831-21kworker/0:0+events10:21:440
351690799291,27cyclictest3697831-21kworker/0:0+events11:21:580
351690799291,27cyclictest3697831-21kworker/0:0+events10:11:560
351690799291,27cyclictest3516766-21kworker/0:2+events07:55:000
351690799291,26cyclictest3516766-21kworker/0:2+events08:06:500
3516907992910,17cyclictest3516766-21kworker/0:2+events10:01:540
351690799290,28cyclictest3516766-21kworker/0:2+events07:11:580
3516913992823,3cyclictest3693473-21cpuspeed_turbos10:06:432
3516913992821,5cyclictest280-21systemd-journal12:40:002
3516910992824,3cyclictest3662467-21kworker/u8:1+flush-8:009:40:311
3516910992823,4cyclictest3464971-21kworker/u8:0+flush-8:007:35:351
3516910992822,4cyclictest3697776-21cron10:10:001
3516910992822,4cyclictest3628010-21cron09:00:001
3516910992822,3cyclictest0-21swapper/111:35:001
3516910992819,7cyclictest3736528-21ntpq10:46:521
351690799289,18cyclictest3516766-21kworker/0:2+events10:07:260
351690799288,19cyclictest3801954-21kworker/0:0+events12:22:260
351690799288,19cyclictest3697831-21kworker/0:0+events11:16:380
351690799281,25cyclictest3697831-21kworker/0:0+events10:41:580
3516907992811,15cyclictest3516766-21kworker/0:2+events07:46:500
3516907992810,16cyclictest3772258-21kworker/0:1+events11:32:000
3516907992810,16cyclictest3516766-21kworker/0:2+events09:50:000
3516913992723,3cyclictest3662467-21kworker/u8:1+flush-8:011:06:592
3516913992723,2cyclictest0-21swapper/207:45:002
3516913992722,3cyclictest3578668-21kworker/u8:0+flush-8:008:46:482
3516910992723,2cyclictest0-21swapper/112:40:001
3516910992722,3cyclictest3652441-21unixbench_multi09:22:021
3516910992715,3cyclictest0-21swapper/109:56:481
351690799279,17cyclictest3697831-21kworker/0:0+events10:51:520
351690799279,16cyclictest3772258-21kworker/0:1+events11:51:560
351690799278,17cyclictest3516766-21kworker/0:2+events09:01:400
351690799277,19cyclictest3697831-21kworker/0:0+events11:03:220
3516907992719,6cyclictest3662625-21latency_hist09:35:010
3516907992718,8cyclictest3772258-21kworker/0:1+events11:49:300
351690799271,25cyclictest3516766-21kworker/0:2+events09:08:080
3516907992710,15cyclictest3772258-21kworker/0:1+events11:36:400
3516907992710,15cyclictest3516766-21kworker/0:2+events07:41:420
3516913992621,4cyclictest3787123-21kworker/u8:1+flush-8:012:31:512
3516913992621,3cyclictest3786750-21unixbench_multi11:36:592
3516913992621,3cyclictest3663272-21fschecks_count09:36:452
3516910992622,2cyclictest0-21swapper/108:01:471
3516910992621,3cyclictest3713223-21cpuspeed_turbos10:26:441
3516910992620,4cyclictest3831566-21cron12:25:001
3516910992620,4cyclictest3795321-21kworker/u8:0+events_unbound12:01:481
3516910992620,4cyclictest3718150-21cpuspeed_turbos10:31:441
3516910992620,4cyclictest3511855-21kworker/u8:3+events_unbound07:11:531
3516910992618,6cyclictest280-21systemd-journal09:30:011
3516907992620,4cyclictest3647441-21unixbench_multi09:17:000
3516907992617,6cyclictest3534216-21diskstats07:26:520
3516910992520,3cyclictest0-21swapper/110:36:481
351690799258,15cyclictest3697831-21kworker/0:0+events10:26:560
3516913992420,2cyclictest3737016-21unixbench_multi10:46:592
3516913992420,2cyclictest3569086-21tr08:01:432
3516913992418,5cyclictest3712315-21unixbench_singl10:21:592
3516910992419,3cyclictest3748106-21cpuspeed_turbos11:01:431
3516910992419,3cyclictest3578668-21kworker/u8:0+events_unbound10:16:481
3516910992418,4cyclictest3559201-21cpuspeed_turbos07:51:441
351690799248,15cyclictest3516766-21kworker/0:2+events09:27:380
3516913992319,3cyclictest3511855-21kworker/u8:3+events_unbound07:30:012
3516913992318,3cyclictest3772833-21cpuspeed_turbos11:26:442
3516910992319,2cyclictest0-21swapper/108:51:591
3516910992319,2cyclictest0-21swapper/108:46:431
3516910992318,4cyclictest3578668-21kworker/u8:0+flush-8:008:16:481
35121022233,3sleep00-21swapper/007:05:350
3516913992219,2cyclictest3743146-21cpuspeed_turbos10:56:462
3516913992217,4cyclictest882-21mta-sts-daemon08:11:502
3516913992217,4cyclictest3731550-21needreboot10:41:542
3516913992217,4cyclictest20977-21cron12:00:002
3516913992217,3cyclictest3554160-21aten2_r5power_v07:46:422
3516913992215,5cyclictest3612991-21apt-get08:45:002
3516913992211,8cyclictest3780721-21tr11:31:522
3516910992218,2cyclictest0-21swapper/107:46:461
3516910992217,2cyclictest0-21swapper/107:56:431
3516910992217,2cyclictest0-21swapper/107:56:431
3516910992216,5cyclictest3648018-21kworker/u8:2+flush-8:009:26:581
351690799225,15cyclictest3697831-21kworker/0:0+events10:56:580
351691399219,4cyclictest0-21swapper/212:21:522
3516913992111,2cyclictest0-21swapper/210:01:542
3516910992117,2cyclictest3673439-21cpuspeed_turbos09:46:441
351691399203,3cyclictest35958672cut08:26:502
351691399202,13cyclictest3588697-21apt-get08:21:422
351691399202,12cyclictest3757767-21apt-get11:11:412
3516913992017,2cyclictest3672321-21unixbench_singl09:42:012
3516913992016,2cyclictest3752102-21unixbench_multi11:02:002
3516913992013,5cyclictest3682739-21apt-get09:55:032
351691399193,2cyclictest161rcu_preempt12:16:462
351691399192,12cyclictest3563938-21apt-get07:56:422
351691399192,12cyclictest3563938-21apt-get07:56:422
351691399192,12cyclictest3562758-21ntpq07:51:542
351691399192,12cyclictest3543882-21apt-get07:36:432
351691399192,12cyclictest3524066-21apt-get07:16:422
3516913991916,2cyclictest371rcuc/210:26:432
3516913991916,2cyclictest0-21swapper/212:05:012
3516913991915,2cyclictest3642564-21unixbench_singl09:12:012
3516913991914,3cyclictest0-21swapper/212:27:002
3516913991913,4cyclictest3628015-21idleruntime-cro09:00:002
351691399182,12cyclictest3661811-21ntpq09:31:542
3516913991813,3cyclictest3722471-21cron10:35:002
3516913991813,3cyclictest0-21swapper/210:51:472
35125952183,8sleep30-21swapper/307:06:453
3516913991713,3cyclictest3662467-21kworker/u8:1+flush-8:010:11:452
3516913991713,3cyclictest3578668-21kworker/u8:0+events_unbound09:50:402
3516913991713,3cyclictest3511855-21kworker/u8:3+flush-8:008:07:012
3516913991713,2cyclictest0-21swapper/211:22:012
3516913991713,2cyclictest0-21swapper/208:51:492
3516913991712,3cyclictest0-21swapper/209:22:022
3516913991711,4cyclictest0-21swapper/207:31:492
351691399171,11cyclictest3643228-21apt-get09:16:422
351691399169,5cyclictest3787831-21grep11:41:432
351691399168,6cyclictest3818022-21cut12:11:482
351691399168,6cyclictest3818022-21cut12:11:482
351691399163,8cyclictest3703121-21apt-get10:16:412
351691399162,13cyclictest0-21swapper/208:16:312
3516913991613,2cyclictest0-21swapper/209:00:222
3516913991612,3cyclictest0-21swapper/210:37:012
3516913991612,2cyclictest0-21swapper/208:36:592
351691399152,12cyclictest0-21swapper/211:50:372
36727582132,6sleep30-21swapper/309:45:023
38400972123,6sleep30-21swapper/312:31:523
38317362122,5sleep30-21swapper/312:25:023
38315372122,6sleep30-21swapper/312:24:423
38019462122,5sleep30-21swapper/311:55:013
37862162122,6sleep30-21swapper/311:36:523
37814312122,6sleep30-21swapper/311:31:583
37670522122,6sleep30-21swapper/311:17:023
37613142122,6sleep30-21swapper/311:11:523
37471322122,6sleep30-21swapper/310:57:033
37327952122,6sleep30-21swapper/310:46:413
37126372122,6sleep30-21swapper/310:25:023
37093422120,3sleep375-21kworker/3:1-events10:21:483
37076662122,5sleep30-21swapper/310:20:003
36935002122,6sleep30-21swapper/310:06:443
36786602123,6sleep30-21swapper/309:51:483
36589532122,6sleep30-21swapper/309:31:503
36478282122,6sleep30-21swapper/309:20:023
36426092123,5sleep30-21swapper/309:12:043
36342392122,6sleep30-21swapper/309:06:503
36136022123,5sleep30-21swapper/308:46:403
36084192122,6sleep30-21swapper/308:41:353
36026132122,6sleep30-21swapper/308:31:593
35895802122,6sleep30-21swapper/308:21:483
35639122122,7sleep30-21swapper/307:56:413
35639122122,7sleep30-21swapper/307:56:413
35534912122,5sleep30-21swapper/307:45:013
35434372122,6sleep30-21swapper/307:34:343
35344662122,6sleep30-21swapper/307:26:563
35293702122,6sleep30-21swapper/307:21:463
35211622122,6sleep30-21swapper/307:12:073
38414612111,5sleep30-21swapper/312:35:013
38219772112,6sleep30-21swapper/312:16:113
38170092112,5sleep30-21swapper/312:10:463
38170092112,5sleep30-21swapper/312:10:463
38120972112,6sleep30-21swapper/312:05:443
38076472112,5sleep30-21swapper/312:01:473
37972892112,6sleep30-21swapper/311:51:123
37922632112,5sleep30-21swapper/311:45:023
37874852112,5sleep30-21swapper/311:41:413
37725862112,5sleep30-21swapper/311:26:403
37721572112,5sleep30-21swapper/311:24:123
37526532112,5sleep30-21swapper/311:05:023
37481182112,5sleep30-21swapper/311:01:453
37374172110,6sleep30-21swapper/310:50:013
37276822112,5sleep30-21swapper/310:40:023
37265392112,5sleep30-21swapper/310:36:533
37178002112,6sleep30-21swapper/310:30:283
36978112112,5sleep30-21swapper/310:10:013
36837172112,5sleep30-21swapper/309:56:453
36682542112,5sleep30-21swapper/309:41:453
36669712112,5sleep30-21swapper/309:36:593
36530082112,6sleep30-21swapper/309:25:283
36432022112,5sleep30-21swapper/309:16:413
36283062112,5sleep30-21swapper/309:00:323
36233352112,5sleep30-21swapper/308:55:033
36181422112,5sleep30-21swapper/308:50:013
36035352112,5sleep30-21swapper/308:36:453
35837452112,5sleep30-21swapper/308:16:433
35790432112,5sleep30-21swapper/308:11:463
35737542112,5sleep30-21swapper/308:06:243
35692762112,5sleep30-21swapper/308:01:463
35593902112,5sleep30-21swapper/307:51:473
35489252112,6sleep30-21swapper/307:41:443
35437102112,5sleep30-21swapper/307:35:023
35239712113,5sleep30-21swapper/307:15:483
36881432101,5sleep30-21swapper/310:00:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional