You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 01:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun May 10, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3030363996547,15cyclictest3100757-21ntpq08:16:081
3030358996352,8cyclictest280-21systemd-journal10:05:010
3030358996352,8cyclictest280-21systemd-journal10:05:000
3030363996049,8cyclictest3256104-21/usr/sbin/munin10:56:101
31962502590,6chrt0-21swapper/009:55:540
31962502590,6chrt0-21swapper/009:55:540
3030358995854,3cyclictest3334964-21kworker/u8:1+flush-8:012:21:120
3030358995850,6cyclictest280-21systemd-journal07:39:590
3030363995637,16cyclictest3096739-21latency_hist08:15:011
3030363995637,16cyclictest3096739-21latency_hist08:15:001
3030363995429,14cyclictest3261111-21apt-get11:00:561
3030358995450,3cyclictest2205339-21kworker/u8:2+events_unbound07:16:120
3030363995226,15cyclictest3030586-21apt-get07:10:541
3030358995247,4cyclictest3131364-21kworker/u8:2+events_unbound10:41:070
31300782510,4chrt0-21swapper/008:46:040
31110932510,4chrt0-21swapper/008:26:140
3030363995142,6cyclictest3339907-21latency_hist12:20:011
3030358995145,4cyclictest3121704-21kworker/u8:1+flush-8:008:51:110
3030358995144,5cyclictest3255501-21kworker/u8:0+flush-8:011:21:110
31031242500,5sleep30-21swapper/308:21:033
3030363995040,8cyclictest3145336-21ntpq09:01:101
3030358995044,4cyclictest3175600-21kworker/u8:0+flush-8:010:01:130
3030358995044,4cyclictest3175600-21kworker/u8:0+flush-8:010:01:130
3030358994943,4cyclictest2205339-21kworker/u8:2+events_unbound08:20:560
3030358994841,5cyclictest3131364-21kworker/u8:2+events_unbound09:31:130
3030358994841,5cyclictest2205339-21kworker/u8:2+flush-8:008:16:100
3030358994839,7cyclictest3115600-21kworker/u8:3+events_unbound09:36:080
3030365994741,4cyclictest2205339-21kworker/u8:2+flush-8:007:36:102
3030363994738,6cyclictest3345177-21/usr/sbin/munin12:26:111
3030358994741,5cyclictest2993940-21kworker/u8:3+flush-8:007:21:070
3030358994737,7cyclictest3295430-21latency_hist11:35:010
3030358994640,5cyclictest3273454-21kworker/u8:2+events_unbound11:36:100
3030358994639,5cyclictest3314869-21kworker/u8:2+flush-8:012:11:080
3030358994635,8cyclictest3122045-21diskstats08:40:590
3030358994625,5cyclictest2205339-21kworker/u8:2+events_unbound07:50:540
3030358994540,3cyclictest3220824-21kworker/u8:3+events_unbound10:21:110
3030358994539,4cyclictest3334964-21kworker/u8:1+flush-8:012:30:580
3030365994439,4cyclictest2993940-21kworker/u8:3+flush-8:007:20:002
3030363994437,5cyclictest280-21systemd-journal07:20:001
3030363994435,7cyclictest3041210-21ntpq07:16:061
3030358994439,3cyclictest3255501-21kworker/u8:0+events_unbound11:05:570
3030358994438,4cyclictest3175600-21kworker/u8:0+flush-8:010:25:580
3030358994437,5cyclictest3285229-21kworker/u8:4+flush-8:012:06:060
30990822430,3sleep20-21swapper/208:16:052
3030358994336,5cyclictest3115600-21kworker/u8:3+flush-8:008:56:060
3030358994335,5cyclictest3116767-21/usr/sbin/munin08:36:040
31635802420,3sleep00-21swapper/009:21:030
3030358994238,3cyclictest3300589-21kworker/u8:0+flush-8:012:01:060
3030358994238,3cyclictest3300589-21kworker/u8:0+flush-8:012:01:060
3030358994238,3cyclictest3240627-21kworker/u8:1+flush-8:010:51:130
3030358994235,5cyclictest3061348-21kworker/u8:0+flush-8:008:06:090
3030363994130,8cyclictest280-21systemd-journal08:46:071
3030363994126,13cyclictest3344023-21ntpq12:21:071
3030363994114,15cyclictest0-21swapper/111:26:041
3030358994137,3cyclictest3186208-21kworker/u8:1+flush-8:010:11:070
3030358994135,4cyclictest3186208-21kworker/u8:1+events_unbound09:46:100
3030358994134,5cyclictest3245821-21kworker/u8:3+events_unbound10:56:050
3030358994126,13cyclictest280-21systemd-journal09:26:070
3030365994034,4cyclictest3255501-21kworker/u8:0+flush-8:011:01:142
3030363994026,10cyclictest280-21systemd-journal07:37:071
3030358994034,4cyclictest3285222-21kworker/u8:1+flush-8:011:50:570
3030358994034,4cyclictest3061348-21kworker/u8:0+events_unbound08:11:030
3030358994034,4cyclictest3061348-21kworker/u8:0+events_unbound08:11:030
3030358994034,4cyclictest2993940-21kworker/u8:3+flush-8:007:11:140
3030363993928,9cyclictest280-21systemd-journal08:31:071
3030358993933,4cyclictest3314869-21kworker/u8:2+events_unbound12:00:000
3030358993933,4cyclictest3175600-21kworker/u8:0+flush-8:010:31:070
3030358993932,5cyclictest3255501-21kworker/u8:0+flush-8:011:16:130
3030363993831,5cyclictest3231291-21/usr/sbin/munin10:31:061
3030363993828,7cyclictest280-21systemd-journal12:34:081
303036399381,22cyclictest3359031-21taskset12:36:061
3030358993833,3cyclictest3175600-21kworker/u8:0+events_unbound10:15:560
3030358993832,4cyclictest2205339-21kworker/u8:2+flush-8:007:56:070
3030358993830,6cyclictest3146174-21latency_hist09:05:010
30301262384,10sleep10-21swapper/107:09:101
32742462370,8sleep239-21ksoftirqd/211:11:042
31876662370,2chrt75-21kworker/3:1+events09:46:023
3030363993728,6cyclictest280-21systemd-journal07:44:071
3030363993725,10cyclictest885-21mta-sts-daemon09:21:051
303036399371,23cyclictest3150970-21runrttasks09:08:261
3030358993731,4cyclictest3273454-21kworker/u8:2+flush-8:011:26:120
3030363993631,3cyclictest3073133-21irqrtprio07:51:011
3030363993627,6cyclictest3180999-21latency_hist09:40:011
3030363993619,15cyclictest3240529-21unixbench_multi10:36:141
303036399361,21cyclictest3195572-21runrttasks09:51:161
303036399361,19cyclictest3111236-21taskset08:26:171
303036399360,20cyclictest3280536-21runrttasks11:19:561
303036399360,20cyclictest3241683-21if_enp4s010:41:001
3030358993630,4cyclictest2205339-21kworker/u8:2+events_unbound08:30:570
3030358993630,4cyclictest2205339-21kworker/u8:2+events_unbound07:26:090
32707372350,6sleep3451irq_work/311:10:013
3030365993529,4cyclictest3121704-21kworker/u8:1+flush-8:008:50:582
3030363993525,8cyclictest3324220-21ntpq12:01:071
3030363993525,8cyclictest3324220-21ntpq12:01:071
3030363993524,9cyclictest3230971-21apt-key10:30:011
303036399352,16cyclictest0-21swapper/109:56:051
303036399352,16cyclictest0-21swapper/109:56:041
3030363993520,12cyclictest3304461-21ntpq11:41:071
3030358993531,3cyclictest3334964-21kworker/u8:1+events_unbound12:26:110
3030358993531,3cyclictest3115600-21kworker/u8:3+events_unbound09:11:130
3030358993529,4cyclictest3240627-21kworker/u8:1+events_unbound10:46:120
303036399348,16cyclictest0-21swapper/108:55:171
303036399340,20cyclictest3202521-21kthreadcore10:01:031
303036399340,20cyclictest3202521-21kthreadcore10:01:031
303036399340,20cyclictest3077304-21/usr/sbin/munin07:56:141
303036399340,18cyclictest3151347-21runrttasks09:10:101
3030358993430,3cyclictest3175600-21kworker/u8:0+events_unbound10:36:180
3030358993427,5cyclictest3273454-21kworker/u8:2+flush-8:011:11:130
3030365993325,6cyclictest3354762-21apt-get12:35:012
3030363993328,3cyclictest3330857-21irqcore12:10:591
3030363993323,8cyclictest3295750-21apt-get11:35:541
303036399332,20cyclictest0-21swapper/109:32:141
303036399332,19cyclictest421rcuog/211:24:051
3030363993311,9cyclictest0-21swapper/110:14:081
303036399331,17cyclictest3170942-21runrttasks09:28:041
303036399330,25cyclictest3210702-21taskset10:06:371
303036399330,25cyclictest3210702-21taskset10:06:371
303036399330,19cyclictest3290736-21runrttasks11:30:151
303036399330,18cyclictest3220595-21runrttasks10:16:561
303036399330,18cyclictest3106549-21runrttasks08:24:121
303036399330,17cyclictest3315444-21runrttasks11:55:261
3030358993329,3cyclictest3339919-21idleruntime-cro12:20:010
3030358993327,4cyclictest3051956-21kworker/u8:1+events_unbound07:41:080
3030358993326,5cyclictest3115600-21kworker/u8:3+flush-8:009:06:100
3030358993321,4cyclictest2993940-21kworker/u8:3+events_unbound07:35:010
3030365993226,4cyclictest3285229-21kworker/u8:4+flush-8:011:51:132
3030365993223,7cyclictest3231070-21cat10:30:012
303036399327,16cyclictest0-21swapper/111:10:211
3030363993222,8cyclictest3122384-21irqcore08:41:021
3030363993222,7cyclictest3090951-21ntpq08:06:071
303036399322,24cyclictest880-21mta-sts-daemon11:05:531
303036399321,25cyclictest3326111-21sed12:05:571
303036399321,24cyclictest3186299-21apt-get09:45:531
303036399321,17cyclictest3160800-21runrttasks09:17:491
3030358993225,5cyclictest3175600-21kworker/u8:0+events_unbound09:50:550
3030365993126,3cyclictest3290145-21grep11:26:112
3030365993125,4cyclictest3240627-21kworker/u8:1+flush-8:011:06:132
303036399313,13cyclictest0-21swapper/110:45:011
3030363993125,4cyclictest3300589-21kworker/u8:0+flush-8:011:45:311
3030363993117,11cyclictest3300589-21kworker/u8:0+flush-8:011:51:071
303036399310,19cyclictest3067397-21runrttasks07:45:081
3030358993127,3cyclictest3300589-21kworker/u8:0+events_unbound11:46:150
3030358993125,4cyclictest3334964-21kworker/u8:1+flush-8:012:35:570
3030365993025,4cyclictest2993940-21kworker/u8:3+events_unbound07:31:082
303036399303,22cyclictest0-21swapper/107:31:091
3030363993016,12cyclictest3185594-21unixbench_multi09:41:141
303036399301,24cyclictest882-21mta-sts-daemon08:01:061
3030363993012,16cyclictest3254921-21ntpq10:51:051
3030358993020,4cyclictest3115600-21kworker/u8:3+events_unbound09:40:560
30255862302,3sleep00-21swapper/007:05:450
3030363992910,17cyclictest3051867-21unixbench_multi07:26:131
3030358992925,3cyclictest3285222-21kworker/u8:1+flush-8:011:41:130
3030358992923,4cyclictest3115600-21kworker/u8:3+events_unbound09:16:060
3030365992823,4cyclictest3186208-21kworker/u8:1+events_unbound10:06:132
3030365992823,4cyclictest3186208-21kworker/u8:1+events_unbound10:06:122
3030365992823,3cyclictest3061348-21kworker/u8:0+flush-8:008:45:592
3030365992823,3cyclictest0-21swapper/211:50:002
303036399282,14cyclictest0-21swapper/110:21:001
3030363992819,6cyclictest3135426-21ntpq08:51:081
3030363992813,13cyclictest3121454-21cron08:40:011
3030358992823,3cyclictest2205339-21kworker/u8:2+flush-8:007:46:020
3030365992724,2cyclictest3241606-21fschecks_time10:40:592
303036599261,9cyclictest31548912cut09:11:052
3030358992623,2cyclictest3264737-21missed_timers11:01:070
303035899262,23cyclictest0-21swapper/008:01:110
3030365992521,2cyclictest3255464-21unixbench_singl10:51:142
3030365992521,2cyclictest3216440-21cpuspeed_turbos10:15:572
3030365992520,4cyclictest2993940-21kworker/u8:3+flush-8:007:21:122
32854322240,5sleep20-21swapper/211:24:082
3030365992421,2cyclictest3355423-21aten2_r5power_v12:35:562
3030365992421,2cyclictest3106279-21unixbench_singl08:21:152
3030365992420,2cyclictest3325423-21aten2_r5power_c12:05:532
3030365992420,2cyclictest3091416-21unixbench_multi08:06:132
3030365992416,7cyclictest280-21systemd-journal09:25:002
3030365992314,7cyclictest280-21systemd-journal10:40:012
303036599222,8cyclictest33209522cat12:00:592
303036599222,8cyclictest33209522cat12:00:592
3030365992219,2cyclictest3191312-21aten2_r5power_e09:50:552
3030365992219,2cyclictest3140813-21unixbench_multi08:56:122
3030365992218,2cyclictest3335480-21cpuspeed_turbos12:15:542
3030365992218,2cyclictest3156446-21aten2_r5power_p09:15:542
3030365992218,2cyclictest0-21swapper/210:50:002
3030365992117,2cyclictest3215881-21cron10:15:002
3030365992117,2cyclictest0-21swapper/209:56:082
3030365992117,2cyclictest0-21swapper/209:56:082
3030365992116,3cyclictest3190547-21unixbench_multi09:46:142
3030365992113,6cyclictest3170277-21sshd09:26:082
3030365992016,3cyclictest3290872-21aten2_r5power_e11:30:562
3030365992016,2cyclictest0-21swapper/209:40:582
3030365992016,2cyclictest0-21swapper/207:30:002
3030365992015,4cyclictest20977-21cron07:15:002
3030365992015,3cyclictest3175313-21grep09:31:092
3030365992012,6cyclictest3203516-21seq10:01:042
3030365992012,6cyclictest3203516-21seq10:01:042
3030365992012,6cyclictest3086043-21sshd08:01:072
31103712190,2sleep375-21kworker/3:1+events08:26:053
303036599196,9cyclictest3092125-21apt-get08:10:542
303036599196,9cyclictest3092125-21apt-get08:10:532
303036599194,3cyclictest31772052cut09:36:012
3030365991915,3cyclictest0-21swapper/208:40:012
3030365991915,2cyclictest3072472-21aten2_r5power_e07:50:562
30300342196,7sleep30-21swapper/307:08:013
30255532194,12sleep20-21swapper/207:05:192
303036599186,8cyclictest3068018-21irqcore07:46:002
3030365991815,2cyclictest3340469-21cpuspeed_turbos12:20:562
3030365991814,2cyclictest0-21swapper/212:11:062
3030365991810,6cyclictest3122824-21cut08:41:022
3030365991810,6cyclictest280-21systemd-journal12:00:002
303036599180,3cyclictest30802381kthreadcore07:56:072
303036599180,2cyclictest32237481kthreadcore10:21:022
3030365991713,2cyclictest3142812-21kthreadcore09:01:042
3030365991713,2cyclictest0-21swapper/211:16:002
3030365991713,2cyclictest0-21swapper/208:26:132
3030365991711,4cyclictest0-21swapper/210:31:052
3030365991711,4cyclictest0-21swapper/207:40:572
3030365991710,5cyclictest3116588-21grep08:35:012
303036599169,5cyclictest3256991-21sed10:55:592
3030365991613,2cyclictest3304755-21switchtime11:41:122
3030365991613,2cyclictest0-21swapper/209:05:352
3030365991612,2cyclictest0-21swapper/212:26:112
303036599160,14cyclictest3297864-21tr11:36:042
33114742133,6sleep30-21swapper/311:51:033
32532002132,7sleep30-21swapper/310:51:043
32208922132,6sleep30-21swapper/310:20:023
31560582132,6sleep30-21swapper/309:15:003
31289422132,7sleep30-21swapper/308:46:043
33505372122,6sleep30-21swapper/312:31:003
33449012122,5sleep30-21swapper/312:25:023
33312332123,6sleep30-21swapper/312:11:013
33256372121,7sleep30-21swapper/312:05:563
33010562122,6sleep30-21swapper/311:41:003
32956022122,5sleep30-21swapper/311:35:023
32908182122,6sleep30-21swapper/311:30:573
32707372122,6sleep30-21swapper/311:10:013
32459202122,5sleep30-21swapper/310:45:023
32412592122,6sleep30-21swapper/310:40:563
32398932122,6sleep30-21swapper/310:36:073
32158702122,6sleep30-21swapper/310:15:003
31853622122,6sleep30-21swapper/309:41:143
31625832122,6sleep30-21swapper/309:21:033
31557352122,6sleep30-21swapper/309:11:163
31469672122,7sleep30-21swapper/309:06:023
31366012122,6sleep30-21swapper/308:55:553
31360052123,5sleep30-21swapper/308:51:383
31215522122,5sleep30-21swapper/308:40:023
31010292122,6sleep30-21swapper/308:16:153
30819882122,5sleep30-21swapper/308:00:003
30801112122,6sleep30-21swapper/307:56:083
30582562122,6sleep30-21swapper/307:36:023
33557882112,5sleep30-21swapper/312:36:013
33403062112,5sleep30-21swapper/312:20:563
33351692112,5sleep30-21swapper/312:15:033
33207322111,6sleep30-21swapper/312:00:583
33207322111,6sleep30-21swapper/312:00:573
33154172112,5sleep30-21swapper/311:55:083
33053312112,5sleep30-21swapper/311:45:003
32903342112,5sleep30-21swapper/311:28:083
32808672112,5sleep30-21swapper/311:20:533
32758842112,6sleep30-21swapper/311:15:523
32615942112,5sleep30-21swapper/311:01:033
32564152112,5sleep30-21swapper/310:55:563
32313332112,5sleep30-21swapper/310:30:573
32288422112,5sleep30-21swapper/310:26:043
32188572112,5sleep30-21swapper/310:16:053
32068592112,5sleep30-21swapper/310:06:023
32068592112,5sleep30-21swapper/310:06:023
32010672112,6sleep30-21swapper/310:00:163
32010672112,6sleep30-21swapper/310:00:153
31961072112,6sleep30-21swapper/309:55:103
31961072112,6sleep30-21swapper/309:55:103
31948432112,5sleep30-21swapper/309:51:043
31762822112,6sleep30-21swapper/309:35:123
31713282112,5sleep30-21swapper/309:30:023
31689602112,5sleep30-21swapper/309:26:053
31418642112,5sleep30-21swapper/309:01:003
31201712112,5sleep30-21swapper/308:36:053
31157002112,5sleep30-21swapper/308:31:113
30954102112,5sleep30-21swapper/308:11:053
30954102112,5sleep30-21swapper/308:11:053
30909272112,5sleep30-21swapper/308:06:073
30723192112,5sleep30-21swapper/307:50:023
30677212112,5sleep30-21swapper/307:45:563
30624742112,5sleep30-21swapper/307:40:553
30529462112,5sleep30-21swapper/307:31:003
30475472112,5sleep30-21swapper/307:25:023
30462312112,5sleep30-21swapper/307:21:053
30355682112,5sleep30-21swapper/307:15:033
30311202112,5sleep30-21swapper/307:11:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional