You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 00:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu Dec 18, 2025 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292195221790,3sleep3575-21kworker/3:2+events07:29:063
30627692750,3chrt575-21kworker/3:2-events09:50:013
29310412680,4sleep3575-21kworker/3:2-events07:39:053
32296322670,2sleep3481ktimers/312:39:043
2902620995543,9cyclictest278-21systemd-journal11:49:040
2902620995543,9cyclictest278-21systemd-journal11:49:040
2902622995242,8cyclictest278-21systemd-journal07:55:011
31605222510,4chrt0-21swapper/011:29:080
30842822480,3chrt3084285-21kthreadcore10:14:050
2902620994738,6cyclictest3171173-21latency_hist11:40:000
2902620994718,19cyclictest0-21swapper/008:39:040
2902620994714,22cyclictest0-21swapper/011:59:040
2902622994623,10cyclictest278-21systemd-journal08:29:041
2902620994515,20cyclictest0-21swapper/007:29:000
2902620994424,13cyclictest161rcu_preempt08:54:060
290262099431,31cyclictest3171417-21sshd11:40:050
290262099419,24cyclictest3146002-21ntpq11:14:130
2902620994113,19cyclictest0-21swapper/007:35:000
290262099411,27cyclictest3073056-21apt-get10:03:560
290262099399,22cyclictest2943889-21sed07:49:180
290262099399,19cyclictest0-21swapper/008:34:070
290262099396,24cyclictest576-21runrttasks09:17:110
2902620993923,14cyclictest2949052-21cron07:55:000
2902620993922,15cyclictest3141571-21unixbench_singl11:09:170
2902620993922,15cyclictest0-21swapper/007:15:050
2902622993831,5cyclictest2939666-21kworker/u8:3+flush-8:008:09:091
2902622993828,7cyclictest3097638-21/usr/sbin/munin10:29:081
290262099384,24cyclictest576-21runrttasks07:38:570
290262099382,23cyclictest0-21swapper/008:00:150
2902620993810,19cyclictest0-21swapper/012:38:550
290262099380,26cyclictest3043498-21apt-get09:33:570
31318122370,18sleep20-21swapper/211:00:012
2902622993729,6cyclictest3166244-21sh11:35:001
290262099376,23cyclictest0-21swapper/007:40:090
290262099374,23cyclictest0-21swapper/009:09:120
290262099371,25cyclictest2974682-21if_enp4s0.308:23:590
2902620993711,18cyclictest0-21swapper/009:03:340
2902620993710,19cyclictest0-21swapper/008:43:320
2902622993632,3cyclictest2897815-21kworker/u8:1+flush-8:007:30:361
290262099367,20cyclictest0-21swapper/010:45:300
290262099367,17cyclictest3126525-21unixbench_singl10:54:160
290262099360,22cyclictest3071875-21ntpq09:59:090
290262099354,18cyclictest3033647-21cpuspeed09:23:590
290262099352,22cyclictest0-21swapper/011:23:490
290262099352,22cyclictest0-21swapper/010:15:570
290262099352,21cyclictest0-21swapper/008:12:190
2902620993515,17cyclictest3062640-21latency_hist09:50:010
290262099351,31cyclictest3112573-21/usr/sbin/munin10:43:580
2902620993513,12cyclictest0-21swapper/010:25:000
2902620993513,12cyclictest0-21swapper/010:25:000
290262099350,25cyclictest576-21runrttasks12:10:160
290262099350,25cyclictest576-21runrttasks07:23:320
290262099350,23cyclictest576-21runrttasks08:05:290
2902622993429,3cyclictest3113194-21irqrtprio10:44:031
290262099347,20cyclictest576-21runrttasks12:30:060
290262099342,21cyclictest0-21swapper/011:33:440
2902620993421,11cyclictest3008126-21kworker/u8:3+flush-8:010:39:050
290262099341,23cyclictest576-21runrttasks07:58:230
2902620993410,21cyclictest3181909-21grep11:54:010
28978762344,9sleep20-21swapper/207:05:542
2902622993328,3cyclictest411-21dbus-daemon11:05:001
2902622993328,3cyclictest2973690-21systemd-run08:20:001
290262099332,21cyclictest0-21swapper/008:47:090
290262099332,20cyclictest0-21swapper/009:29:590
290262099332,20cyclictest0-21swapper/007:10:320
2902620993317,14cyclictest0-21swapper/011:19:160
2902620993316,15cyclictest3131618-21systemd-run11:00:000
2902620993314,17cyclictest411-21dbus-daemon09:15:010
290262099331,24cyclictest576-21runrttasks10:28:240
29559022320,5sleep20-21swapper/208:04:032
2902622993227,3cyclictest2914120-21unixbench_multi07:19:131
2902622993223,7cyclictest3150934-21ntpq11:19:141
2902620993227,3cyclictest3195810-21gpgv12:05:010
290262099322,20cyclictest0-21swapper/010:33:100
2902620993217,13cyclictest3221077-21latency_hist12:30:010
290262099321,25cyclictest3008739-21apt-get08:58:550
290262099321,25cyclictest3008739-21apt-get08:58:550
290262099321,21cyclictest0-21swapper/009:54:180
290262099320,20cyclictest3132154-21apt-get11:03:580
290262099320,19cyclictest3196404-21runrttasks12:07:030
290262099320,19cyclictest3080140-21sort10:09:040
2902622993126,3cyclictest3178797-21kthreadcore11:49:061
2902622993126,3cyclictest3178797-21kthreadcore11:49:061
290262099312,21cyclictest0-21swapper/012:21:550
2902620993114,15cyclictest0-21swapper/009:44:070
290262099311,19cyclictest576-21runrttasks09:35:080
290262099310,22cyclictest576-21runrttasks08:26:230
290262099310,17cyclictest3210384-21mailstats12:19:140
28980912314,9sleep10-21swapper/107:08:421
2902622993026,3cyclictest3008126-21kworker/u8:3+flush-8:010:20:201
2902622993026,3cyclictest3008126-21kworker/u8:3+flush-8:010:20:201
2902622993026,2cyclictest3053593-21cpuspeed_turbos09:43:581
2902622993024,4cyclictest3161573-21kworker/u8:1-ext4-rsv-conversion12:15:001
2902622993024,4cyclictest3019508-21sed09:09:031
2902622993024,4cyclictest3008126-21kworker/u8:3+flush-8:009:04:161
2902622993023,5cyclictest3062885-21kworker/u8:1+flush-8:010:05:051
2902622993020,7cyclictest3200950-21latency_hist12:10:011
2902622993018,9cyclictest3215742-21apt-get12:25:011
2902620993016,12cyclictest0-21swapper/008:18:590
2902626992924,3cyclictest3225680-21unixbench_multi12:34:142
2902622992924,3cyclictest3111896-21cron10:40:001
2902622992924,3cyclictest2924515-21latency_hist07:30:011
2902622992924,2cyclictest0-21swapper/109:20:001
2902622992923,4cyclictest3062885-21kworker/u8:1+events_unbound10:19:051
2902622992921,5cyclictest2998313-21latency_hist08:45:011
2902626992823,3cyclictest2988358-21unixbench_singl08:34:142
2902622992824,2cyclictest2968777-21systemd-run08:15:001
2902622992824,2cyclictest2907487-21idleruntime-cro07:15:001
2902622992823,3cyclictest3013015-21unixbench_singl08:59:141
2902622992823,3cyclictest3013015-21unixbench_singl08:59:141
2902622992821,5cyclictest3102583-21apt-get10:33:571
2902622992818,7cyclictest278-21systemd-journal11:29:041
29384742270,4sleep10-21swapper/107:44:081
29047952270,6sleep20-21swapper/207:14:002
2902626992722,4cyclictest3161573-21kworker/u8:1+flush-8:012:14:142
2902622992716,8cyclictest278-21systemd-journal09:55:001
2902626992622,2cyclictest2944789-21aten2_r5power_v07:53:592
2902626992620,5cyclictest3008126-21kworker/u8:3+flush-8:010:44:092
2902626992620,4cyclictest3166253-21taskset11:35:002
2902622992621,3cyclictest0-21swapper/109:49:141
2902622992620,3cyclictest0-21swapper/107:39:011
2902622992619,5cyclictest2939666-21kworker/u8:3+flush-8:008:23:581
2902622992618,6cyclictest3073056-21apt-get10:03:551
2902626992522,2cyclictest3018697-21aten2_r5power_v09:08:572
2902626992521,2cyclictest3063301-21aten2_r5power_v09:53:572
2902626992521,2cyclictest2949673-21aten2_r5power_e07:58:582
2902626992520,4cyclictest2845887-21kworker/u8:2-ext4-rsv-conversion07:44:592
2902626992517,6cyclictest3008054-21grep08:54:162
2902622992521,2cyclictest2919069-21unixbench_multi07:24:151
2902622992520,4cyclictest2943490-21ntp_kernel_pll_07:49:111
2902622992520,2cyclictest0-21swapper/111:09:121
2902622992520,2cyclictest0-21swapper/109:14:171
2902622992519,3cyclictest3167526-21irqrtprio11:39:031
2902626992421,2cyclictest3185762-21unixbench_multi11:54:162
2902626992420,2cyclictest3088063-21cpuspeed_turbos10:18:572
2902626992415,7cyclictest3038240-21cp09:25:022
290262299242,15cyclictest573-21snmpd11:43:581
2902622992419,3cyclictest3043788-21cut09:34:001
2902622992418,4cyclictest3195942-21apt-key12:05:011
2902622992414,7cyclictest2954000-21latency_hist08:00:011
2902622992413,7cyclictest0-21swapper/112:33:551
290262099247,14cyclictest2902467-21latency_hist07:10:010
32023532230,2sleep3481ktimers/312:14:053
2902626992320,2cyclictest3008770-21aten2_r5power_c08:58:562
2902626992320,2cyclictest3008770-21aten2_r5power_c08:58:562
2902626992319,3cyclictest2914279-21turbostat.cron07:20:002
2902626992319,2cyclictest3117498-21aten2_r5power_v10:48:582
2902626992319,2cyclictest3097006-21unixbench_singl10:24:142
2902626992319,2cyclictest3097006-21unixbench_singl10:24:142
2902626992319,2cyclictest2914963-21aten2_r5power_v07:23:582
2902622992319,2cyclictest3083495-21irqcore10:14:031
2902622992319,2cyclictest0-21swapper/112:39:051
2902622992318,3cyclictest3122339-21aten2_r5power_c10:53:581
2902622992318,2cyclictest0-21swapper/111:24:001
2902622992318,2cyclictest0-21swapper/111:13:561
2902622992318,2cyclictest0-21swapper/110:49:001
2902622992318,2cyclictest0-21swapper/108:54:021
2902622992317,4cyclictest3049353-21kthreadcore09:39:041
2902622992316,5cyclictest0-21swapper/108:49:151
2902622992315,5cyclictest2993391-21latency_hist08:40:021
2902622992314,7cyclictest2988483-21latency_hist08:35:011
31706522220,6chrt0-21swapper/211:39:132
2902626992219,2cyclictest2969337-21aten2_r5power_c08:18:572
2902626992218,2cyclictest3206671-21cpuspeed_turbos12:18:592
2902626992218,2cyclictest3053678-21fschecks_time09:43:592
2902626992218,2cyclictest2989257-21cpuspeed_turbos08:39:002
2902626992217,3cyclictest3047741-21unixbench_multi09:34:152
2902622992218,2cyclictest0-21swapper/109:29:001
2902622992217,4cyclictest3033574-21tr09:23:581
2902622992217,2cyclictest0-21swapper/112:28:541
2902622992216,4cyclictest3190698-21unixbench_multi11:59:151
2902622992216,4cyclictest3130267-21kthreadcore10:59:051
2902622992212,8cyclictest3071891-21ntpq09:59:101
2902626992117,3cyclictest3146545-21cron11:15:002
2902626992117,3cyclictest2939666-21kworker/u8:3+flush-8:007:49:172
2902626992116,4cyclictest3008126-21kworker/u8:3+flush-8:009:49:122
2902622992115,4cyclictest0-21swapper/108:04:131
2902622992114,4cyclictest0-21swapper/112:18:561
2902626992016,2cyclictest0-21swapper/210:14:142
2902626992016,2cyclictest0-21swapper/208:09:042
2902626992015,3cyclictest3104019-21kthreadcore10:34:062
2902626992015,3cyclictest2979375-21cpuspeed_turbos08:29:022
2902626992011,7cyclictest3216094-21find12:25:012
2902622992016,2cyclictest3185935-21systemd-run11:55:001
290262699198,3cyclictest29310442grep07:39:052
290262699192,12cyclictest3122307-21apt-get10:53:572
2902626991915,2cyclictest0-21swapper/209:14:042
2902626991915,2cyclictest0-21swapper/207:30:002
290262699189,7cyclictest3157988-21tr11:29:052
290262699189,7cyclictest2929283-21awk07:35:002
2902626991815,2cyclictest2999220-21fschecks_time08:48:592
2902626991814,2cyclictest0-21swapper/211:59:072
2902626991814,2cyclictest0-21swapper/210:29:042
290262699181,12cyclictest3141069-21ntpq11:09:112
28978262183,8sleep30-21swapper/307:05:163
290262699172,11cyclictest3215742-21apt-get12:25:042
290262699172,11cyclictest3200462-21ps12:09:132
2902626991714,2cyclictest3152262-21cpuspeed_turbos11:23:582
2902626991714,2cyclictest3107605-21aten2_r5power_p10:38:582
2902626991713,2cyclictest0-21swapper/209:29:032
290262699171,12cyclictest3073056-21apt-get10:03:562
290262699170,2cyclictest31489011kthreadcore11:19:062
290262699167,7cyclictest3171815-21cut11:43:592
290262699162,13cyclictest0-21swapper/211:45:332
290262699162,13cyclictest0-21swapper/211:45:332
290262699162,13cyclictest0-21swapper/209:15:122
290262699162,13cyclictest0-21swapper/209:00:272
290262699162,13cyclictest0-21swapper/208:21:572
2902626991613,2cyclictest0-21swapper/212:02:282
2902626991613,2cyclictest0-21swapper/211:02:042
2902626991613,2cyclictest0-21swapper/209:55:442
2902626991613,2cyclictest0-21swapper/208:42:142
2902626991612,2cyclictest0-21swapper/208:13:592
2902626991611,3cyclictest0-21swapper/212:39:032
2902626991512,2cyclictest0-21swapper/210:09:062
290262699151,10cyclictest3050696-21kthreadcore09:39:062
32115652132,7sleep30-21swapper/312:24:013
32102152132,7sleep30-21swapper/312:19:113
31422312132,7sleep30-21swapper/311:13:593
30667812132,7sleep30-21swapper/309:54:073
30521792134,5sleep30-21swapper/309:39:103
30082092132,6sleep30-21swapper/308:55:023
30082092132,6sleep30-21swapper/308:55:013
29879092132,7sleep30-21swapper/308:34:103
29165202133,6sleep30-21swapper/307:24:053
29142662132,7sleep30-21swapper/307:20:003
32157252122,5sleep30-21swapper/312:25:013
32002642122,6sleep30-21swapper/312:09:083
31914322122,6sleep30-21swapper/312:03:593
31743842122,6sleep30-21swapper/311:44:093
31694052122,6sleep30-21swapper/311:39:073
31515102122,6sleep30-21swapper/311:20:023
31477992122,6sleep30-21swapper/311:19:053
31259842122,7sleep30-21swapper/310:54:093
31124772122,6sleep30-21swapper/310:43:583
31084062122,6sleep30-21swapper/310:39:053
30948162123,5sleep30-21swapper/310:24:043
30948162123,5sleep30-21swapper/310:24:043
30916272122,6sleep30-21swapper/310:19:113
30478712122,5sleep30-21swapper/309:35:013
30338312122,6sleep30-21swapper/309:24:023
30278132124,5sleep30-21swapper/309:14:193
30204392122,6sleep30-21swapper/309:09:053
30024412122,6sleep30-21swapper/308:49:073
29927872122,6sleep30-21swapper/308:39:123
29794422122,6sleep30-21swapper/308:29:053
29781052122,7sleep30-21swapper/308:24:113
29693222122,6sleep30-21swapper/308:18:583
29687402122,6sleep30-21swapper/308:15:013
29631462122,6sleep30-21swapper/308:09:073
29446232126,4sleep30-21swapper/307:53:343
29352762122,6sleep30-21swapper/307:44:033
29292722122,5sleep30-21swapper/307:35:003
29027522122,6sleep30-21swapper/307:10:053
32211172112,5sleep30-21swapper/312:30:073
31863042112,5sleep30-21swapper/311:57:053
31812712112,5sleep30-21swapper/311:50:313
31763262112,6sleep30-21swapper/311:45:063
31763262112,6sleep30-21swapper/311:45:053
31615222112,5sleep30-21swapper/311:30:043
31566562112,6sleep30-21swapper/311:25:233
31369782114,5sleep30-21swapper/311:05:103
31356992112,5sleep30-21swapper/311:04:083
31274452112,5sleep30-21swapper/310:58:593
31172052112,6sleep30-21swapper/310:46:553
31025872112,5sleep30-21swapper/310:33:593
30973882112,6sleep30-21swapper/310:25:413
30828882111,6sleep30-21swapper/310:13:573
30782772112,5sleep30-21swapper/310:08:593
30727422112,6sleep30-21swapper/310:00:093
30684342112,5sleep30-21swapper/309:59:013
30571792112,5sleep30-21swapper/309:44:123
30417982112,5sleep30-21swapper/309:29:073
30281542112,6sleep30-21swapper/309:15:393
30134352112,6sleep30-21swapper/309:00:553
30036832114,5sleep30-21swapper/308:53:003
29937112112,5sleep30-21swapper/308:41:063
29544932113,5sleep30-21swapper/308:03:173
29396492112,5sleep30-21swapper/307:48:043
29492882102,5sleep30-21swapper/307:55:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional