You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 16:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri May 08, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
351771121080,3sleep03517715-21kthreadcore08:46:030
35592392930,6chrt0-21swapper/209:26:062
3420390998679,5cyclictest3630239-21kworker/u8:1+events_unbound11:06:132
3420388997861,14cyclictest280-21systemd-journal12:35:001
3420388997861,14cyclictest280-21systemd-journal12:35:001
3420388997263,7cyclictest3749970-21latency_hist12:40:001
3420388997263,7cyclictest3749970-21latency_hist12:40:001
34733262710,2sleep2371rcuc/208:01:032
3420390997166,3cyclictest3575467-21kworker/u8:0+events_unbound10:36:132
35479242630,4sleep375-21kworker/3:1-events09:16:043
3420390996258,3cyclictest3486565-21kworker/u8:2+flush-8:009:06:072
3420388996142,16cyclictest3491474-21latency_hist08:20:011
3420388996050,7cyclictest3526314-21latency_hist08:55:011
3420390995954,4cyclictest3659903-21kworker/u8:2+flush-8:011:41:142
3420390995951,5cyclictest3491909-21base6408:20:012
34345582580,7sleep3471rcuc/307:21:033
3420390995851,5cyclictest3610515-21apt-get10:20:002
37113752560,2sleep10-21swapper/112:01:031
3420390995642,11cyclictest280-21systemd-journal12:00:572
3420388995543,9cyclictest280-21systemd-journal08:35:571
3420383995546,6cyclictest3570800-21latency_hist09:40:010
3420388995447,5cyclictest3452281-21apt-get07:40:551
3420383995449,3cyclictest3500785-21kworker/u8:3+flush-8:008:56:130
3420390995348,3cyclictest3500785-21kworker/u8:3+events_unbound08:26:122
3420388995246,4cyclictest3442386-21apt-get07:30:551
3420388995246,4cyclictest3442386-21apt-get07:30:541
3420383995244,5cyclictest3740027-21latency_hist12:30:010
3420383995243,6cyclictest3432158-21latency_hist07:20:000
3420383995242,7cyclictest3511521-21latency_hist08:40:000
3420383995036,12cyclictest3659903-21kworker/u8:2+events_unbound11:25:570
3420388994942,5cyclictest3420574-21apt-get07:10:541
3420388994924,9cyclictest3733920-21ntpq12:21:061
3420383994936,9cyclictest280-21systemd-journal08:35:000
3420390994843,3cyclictest3643548-21kworker/u8:3+events_unbound12:36:102
3420390994843,3cyclictest3643548-21kworker/u8:3+events_unbound12:36:092
37376312470,6sleep20-21swapper/212:26:032
3420383994744,1cyclictest2044948-21kworker/u8:3+events_unbound07:15:000
3420383994741,3cyclictest3630239-21kworker/u8:1+flush-8:010:41:020
3420383994740,5cyclictest3659903-21kworker/u8:2+flush-8:011:36:070
3420388994639,5cyclictest2044948-21kworker/u8:3+flush-8:007:51:121
3420383994641,4cyclictest2044948-21kworker/u8:3+flush-8:007:21:140
3420383994639,5cyclictest3643548-21kworker/u8:3+flush-8:012:06:010
3420383994637,7cyclictest3400440-21kworker/u8:2+flush-8:007:26:080
3420383994635,8cyclictest3486565-21kworker/u8:2+flush-8:008:51:080
3420388994537,5cyclictest3515618-21ntpq08:41:081
3420388994535,7cyclictest3725503-21diskstats12:15:561
3420390994439,3cyclictest3643548-21kworker/u8:3+flush-8:011:31:032
3420388994435,7cyclictest3630868-21apt-get10:40:551
3420383994440,3cyclictest2044948-21kworker/u8:3+flush-8:007:55:590
3420383994438,4cyclictest3643548-21kworker/u8:3+events_unbound12:40:000
3420383994438,4cyclictest3643548-21kworker/u8:3+events_unbound12:40:000
3420383994437,4cyclictest3526342-21kworker/u8:1+flush-8:009:26:040
3420383994433,8cyclictest3526342-21kworker/u8:1+flush-8:010:16:070
3420383994432,10cyclictest3540353-21ntpq09:06:100
36862822430,3sleep10-21swapper/111:36:031
3420390994338,3cyclictest3461867-21kworker/u8:0+events_unbound08:35:012
3420383994324,12cyclictest280-21systemd-journal11:05:560
3420388994234,6cyclictest280-21systemd-journal10:12:571
3420383994238,3cyclictest3643548-21kworker/u8:3+events_unbound12:11:130
3420383994235,5cyclictest280-21systemd-journal09:46:030
3420383994235,4cyclictest3500785-21kworker/u8:3+events_unbound10:21:130
3420383994229,9cyclictest3575755-21apt-get09:45:010
3420390994136,3cyclictest3575467-21kworker/u8:0+flush-8:010:56:042
3420383994133,6cyclictest3625912-21/usr/sbin/munin10:36:070
3420383994133,6cyclictest3495768-21ntpq08:21:080
3420383994133,6cyclictest2044948-21kworker/u8:3+events_unbound07:51:110
3420383994132,7cyclictest3630239-21kworker/u8:1+flush-8:011:30:010
35328672400,6sleep3451irq_work/309:01:033
3420388994034,4cyclictest3708743-21ntpq11:56:081
3420388994031,6cyclictest3655291-21latency_hist11:05:011
3420383994036,3cyclictest3630239-21kworker/u8:1+flush-8:011:46:130
3420383994034,4cyclictest3526342-21kworker/u8:1+events_unbound10:01:130
3420383994033,5cyclictest3630239-21kworker/u8:1+flush-8:010:46:020
3420383994031,6cyclictest3575467-21kworker/u8:0+flush-8:010:56:070
3420383994030,8cyclictest3500785-21kworker/u8:3+events_unbound09:54:590
3420390993932,5cyclictest3614948-21journal-offline10:21:092
3420388993930,7cyclictest3625937-21apt-get10:35:551
3420388993930,6cyclictest280-21systemd-journal12:09:551
3420383993935,3cyclictest3486565-21kworker/u8:2+flush-8:009:01:130
3420383993933,4cyclictest3457211-21apt-get07:45:540
3420383993832,4cyclictest3630239-21kworker/u8:1+flush-8:011:01:090
3420383993832,4cyclictest3425460-21kworker/u8:1+flush-8:008:25:590
3420388993728,7cyclictest280-21systemd-journal11:00:001
3420388993728,6cyclictest3704726-21latency_hist11:55:001
3420383993732,4cyclictest3659903-21kworker/u8:2+flush-8:011:21:140
3420383993728,7cyclictest3575467-21kworker/u8:0+flush-8:010:51:130
3420383993728,6cyclictest3425460-21kworker/u8:1+flush-8:008:06:100
34200272364,9sleep10-21swapper/107:08:061
3420388993529,4cyclictest3611085-21apt-get10:20:541
3420388993528,4cyclictest3565858-21latency_hist09:35:011
3420388993527,6cyclictest3610515-21apt-get10:20:011
3420388993527,6cyclictest3472055-21apt-get08:00:541
3420388993526,7cyclictest280-21systemd-journal12:26:381
3420388993526,7cyclictest280-21systemd-journal09:30:011
3420388993525,8cyclictest280-21systemd-journal11:30:001
3420388993524,8cyclictest3481923-21apt-get08:10:551
3420383993531,3cyclictest3500785-21kworker/u8:3+flush-8:009:56:140
3420383993530,4cyclictest3425460-21kworker/u8:1+flush-8:007:31:150
3420383993530,4cyclictest3425460-21kworker/u8:1+flush-8:007:31:150
3420383993529,4cyclictest3630239-21kworker/u8:1+flush-8:012:00:590
3420383993528,5cyclictest280-21systemd-journal10:26:570
3420388993429,3cyclictest3471720-21sendmail08:00:001
3420388993428,5cyclictest2044948-21kworker/u8:3+events_unbound07:16:061
3420383993432,1cyclictest3486565-21kworker/u8:2+events_unbound09:11:120
3420383993432,1cyclictest3486565-21kworker/u8:2+events_unbound09:11:120
3420383993427,5cyclictest3526342-21kworker/u8:1+flush-8:009:16:150
3420383993427,5cyclictest3456895-21latency_hist07:45:010
3420383993427,5cyclictest3425460-21kworker/u8:1+events_unbound08:16:150
3420390993328,3cyclictest3671350-21kthreadcore11:21:022
3420390993324,7cyclictest280-21systemd-journal09:05:002
3420388993327,4cyclictest3665472-21apt-get11:15:531
3420388993325,6cyclictest280-21systemd-journal09:56:041
3420388993323,7cyclictest3595733-21latency_hist10:05:011
3420383993329,3cyclictest3630239-21kworker/u8:1+flush-8:011:56:140
3420383993329,3cyclictest3526342-21kworker/u8:1+flush-8:009:21:040
3420383993328,4cyclictest3526342-21kworker/u8:1+flush-8:010:11:080
3420383993327,4cyclictest2044948-21kworker/u8:3+events_unbound08:01:100
35568472320,2sleep3481ktimers/309:26:023
3420383993228,3cyclictest3732769-21kworker/u8:0+events_unbound12:21:070
3420383993228,3cyclictest3659903-21kworker/u8:2+events_unbound11:15:570
3420383993228,3cyclictest3526342-21kworker/u8:1+events_unbound09:31:130
342038399320,29cyclictest3486556-21true08:15:010
3420390993123,6cyclictest280-21systemd-journal12:20:002
3420390993122,7cyclictest280-21systemd-journal12:00:002
3420388993127,2cyclictest3541134-21sh09:10:001
3420388993122,6cyclictest3496666-21latency_hist08:25:001
3420383993127,3cyclictest3643548-21kworker/u8:3+events_unbound12:16:100
3420383993127,3cyclictest3575467-21kworker/u8:0+flush-8:010:32:280
3420383993124,5cyclictest3575467-21kworker/u8:0+events_unbound10:06:070
3420388993025,3cyclictest3684561-21unixbench_singl11:31:141
3420388993025,3cyclictest3566257-21aten2_r5power_p09:35:561
3420383993025,3cyclictest3694849-21cron11:45:000
3420390992925,3cyclictest3425460-21kworker/u8:1+events_unbound07:50:012
3420390992924,4cyclictest3643548-21kworker/u8:3+events_unbound12:21:152
3420390992918,9cyclictest3719870-21cp12:10:002
3420388992923,4cyclictest3526633-21apt-get08:55:541
3420388992922,6cyclictest3575467-21kworker/u8:0+events_unbound09:51:071
3420383992924,4cyclictest3486565-21kworker/u8:2+flush-8:008:42:020
3420383992920,7cyclictest3740314-21/usr/sbin/munin12:31:120
3420383992920,7cyclictest3740314-21/usr/sbin/munin12:31:110
3420383992913,12cyclictest2044948-21kworker/u8:3+flush-8:007:36:070
34200912292,6sleep00-21swapper/007:08:570
36319792280,3sleep375-21kworker/3:1+mm_percpu_wq10:41:033
3420390992825,2cyclictest3600306-21unixbench_singl10:06:152
3420390992824,2cyclictest3700167-21aten2_r5power_p11:50:582
3420390992822,4cyclictest3590429-21unixbench_singl09:56:132
3420390992821,5cyclictest280-21systemd-journal09:50:002
3420388992824,3cyclictest3694872-21systemd-run11:45:011
3420388992821,5cyclictest3659903-21kworker/u8:2+events_unbound11:21:071
3420388992819,7cyclictest3630239-21kworker/u8:1+flush-8:011:11:091
3420390992723,2cyclictest3516080-21unixbench_multi08:41:142
3420388992724,2cyclictest3640439-21cron10:50:001
3420388992722,3cyclictest3599641-21sshd10:06:061
3420388992721,4cyclictest3642903-21kthreadcore10:51:031
3420383992723,3cyclictest3659903-21kworker/u8:2+flush-8:011:51:110
3420390992622,2cyclictest3541729-21fschecks_count09:10:592
3420390992622,2cyclictest3541729-21fschecks_count09:10:592
3420390992620,4cyclictest280-21systemd-journal11:04:592
3420388992620,5cyclictest3425460-21kworker/u8:1+flush-8:008:06:071
3420383992620,4cyclictest3643548-21kworker/u8:3+flush-8:011:11:140
3420390992521,3cyclictest3456894-21idleruntime-cro07:45:012
3420390992521,2cyclictest3724593-21unixbench_singl12:11:152
3420388992521,3cyclictest401-21dbus-daemon09:24:591
3420388992521,2cyclictest3497295-21cut08:25:591
3420388992521,2cyclictest0-21swapper/108:45:571
3420388992520,3cyclictest3461464-21unixbench_multi07:46:151
3420390992420,2cyclictest3477214-21cpuspeed_turbos08:05:582
3420390992419,3cyclictest3595402-21unixbench_singl10:01:142
3420388992418,5cyclictest3575467-21kworker/u8:0+events_unbound11:05:581
3420388992418,4cyclictest3699442-21unixbench_singl11:46:151
3420390992320,2cyclictest3581521-21fschecks_count09:50:592
3420390992314,7cyclictest280-21systemd-journal10:49:592
342039099230,11cyclictest3546434-21aten2_r5power_c09:15:572
3420388992319,2cyclictest3546099-21munin-run09:15:001
3420388992319,2cyclictest3546099-21munin-run09:14:591
3420388992319,2cyclictest3436205-21needreboot07:21:041
3420388992316,5cyclictest280-21systemd-journal10:25:561
3420388992316,4cyclictest0-21swapper/110:30:551
35158142220,2sleep3481ktimers/308:41:133
342039099222,14cyclictest3665472-21apt-get11:15:562
342039099222,13cyclictest3427536-21apt-get07:15:552
3420390992219,2cyclictest3695256-21aten2_r5power_p11:45:572
3420390992219,2cyclictest3616357-21fschecks_count10:25:592
3420390992219,2cyclictest3437803-21fschecks_time07:25:592
3420390992218,3cyclictest3496651-21cron08:25:002
3420390992218,3cyclictest3461867-21kworker/u8:0+flush-8:008:35:022
3420390992218,3cyclictest3424324-21tail07:11:062
3420388992219,2cyclictest0-21swapper/107:35:591
3420388992218,2cyclictest0-21swapper/109:01:131
3420388992218,2cyclictest0-21swapper/107:26:141
3420388992215,6cyclictest3526342-21kworker/u8:1+flush-8:009:16:141
3420390992118,2cyclictest3462434-21fschecks_count07:50:582
3420390992117,2cyclictest0-21swapper/209:40:012
3420390992116,4cyclictest3575467-21kworker/u8:0+flush-8:010:50:312
3420390992116,3cyclictest0-21swapper/209:45:002
3420388992117,3cyclictest3721041-21irqrtprio12:11:021
3420388992117,2cyclictest0-21swapper/108:31:001
34200442217,8sleep30-21swapper/307:08:203
3420388992016,2cyclictest0-21swapper/109:45:541
3420388992014,4cyclictest0-21swapper/109:41:151
3420390991916,2cyclictest3520982-21unixbench_multi08:46:152
3420390991915,2cyclictest0-21swapper/211:30:002
3420390991914,3cyclictest3486193-21unixbench_singl08:11:152
3420390991913,4cyclictest3551592-21tr09:20:592
342039099190,2cyclictest34706751latency07:56:052
34155472194,12sleep20-21swapper/207:05:082
342039099182,6cyclictest0-21swapper/209:31:222
3420390991814,3cyclictest0-21swapper/211:39:592
3420390991810,6cyclictest3443530-21tr07:31:032
3420390991810,6cyclictest3443530-21tr07:31:032
37191682177,6sleep30-21swapper/312:06:153
3420390991714,2cyclictest3631184-21fschecks_time10:40:592
3420390991713,2cyclictest0-21swapper/208:59:592
3420390991712,4cyclictest3575467-21kworker/u8:0+events_unbound10:34:052
3420390991712,3cyclictest0-21swapper/212:31:142
3420390991712,3cyclictest0-21swapper/212:31:142
3420390991712,3cyclictest0-21swapper/211:11:022
3420390991712,3cyclictest0-21swapper/207:35:582
342039099164,7cyclictest3600963-21apt-get10:10:562
342039099162,13cyclictest0-21swapper/207:20:242
3420390991611,3cyclictest0-21swapper/208:51:052
35980552142,7sleep30-21swapper/310:06:053
36115942132,7sleep30-21swapper/310:21:023
35551362132,7sleep30-21swapper/309:21:103
35203592132,7sleep30-21swapper/308:46:073
34743102132,7sleep30-21swapper/308:01:053
37473462122,6sleep30-21swapper/312:36:053
37473462122,6sleep30-21swapper/312:36:053
37391552123,6sleep30-21swapper/312:26:103
37252582122,6sleep30-21swapper/312:15:543
37202322122,6sleep30-21swapper/312:10:043
37096652122,5sleep30-21swapper/312:00:013
37052862123,6sleep30-21swapper/311:55:593
37039902122,6sleep30-21swapper/311:51:143
36967662122,6sleep30-21swapper/311:46:053
36857082122,6sleep30-21swapper/311:36:023
36841592122,6sleep30-21swapper/311:31:123
36750842122,6sleep30-21swapper/311:25:023
36645422122,6sleep30-21swapper/311:11:143
36593272122,6sleep30-21swapper/311:06:073
36355342122,5sleep30-21swapper/310:45:013
36264202122,6sleep30-21swapper/310:36:023
36206472122,6sleep30-21swapper/310:30:003
36102122122,6sleep30-21swapper/310:16:153
36008072122,6sleep30-21swapper/310:10:023
35896412122,6sleep30-21swapper/309:56:063
35858352122,5sleep30-21swapper/309:55:013
35758892122,6sleep30-21swapper/309:45:023
35704172122,6sleep30-21swapper/309:36:153
35612462122,6sleep30-21swapper/309:30:583
35460812122,6sleep30-21swapper/309:15:003
35460812122,6sleep30-21swapper/309:14:593
35229282122,6sleep30-21swapper/308:51:053
35069282122,6sleep30-21swapper/308:35:563
35017872122,6sleep30-21swapper/308:30:023
34865242122,5sleep30-21swapper/308:15:013
34860962122,6sleep30-21swapper/308:11:153
34767452122,6sleep30-21swapper/308:05:023
34626412122,6sleep30-21swapper/307:51:023
34574982121,7sleep30-21swapper/307:46:003
34522292122,6sleep30-21swapper/307:40:383
34518832122,6sleep30-21swapper/307:39:383
34273652122,6sleep30-21swapper/307:15:063
34227792122,6sleep30-21swapper/307:11:053
37405962112,5sleep30-21swapper/312:30:593
37405962112,5sleep30-21swapper/312:30:593
37301422112,6sleep30-21swapper/312:20:203
36904622112,5sleep30-21swapper/311:40:583
36727692112,5sleep30-21swapper/311:21:043
36657212112,5sleep30-21swapper/311:15:593
36480102111,6sleep30-21swapper/310:56:053
36450372112,6sleep30-21swapper/310:51:153
36237662112,5sleep30-21swapper/310:31:043
35914882112,5sleep30-21swapper/310:00:593
35711342112,5sleep30-21swapper/309:40:573
35401132111,6sleep30-21swapper/309:06:063
35265392112,5sleep30-21swapper/308:55:023
34973602112,5sleep30-21swapper/308:26:003
34920202112,5sleep30-21swapper/308:20:553
34674252112,5sleep30-21swapper/307:55:593
34423602112,5sleep30-21swapper/307:30:553
34423602112,5sleep30-21swapper/307:30:553
34375662112,5sleep30-21swapper/307:25:573
36505792102,5sleep30-21swapper/311:00:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional