You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 18:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Dec 15, 2025 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34220822820,2sleep3575-21kworker/3:2-events07:49:143
36647722710,2sleep0201rcuc/011:54:170
3380646995945,7cyclictest3590690-21latency_hist10:40:010
3380646995646,7cyclictest3535858-21latency_hist09:45:010
36241232490,4chrt371rcuc/211:14:072
3380653994839,6cyclictest3600900-21cat10:50:002
3380653994837,8cyclictest3660052-21latency_hist11:50:022
3380646994837,8cyclictest3500489-21ntpq09:09:110
3380648994535,7cyclictest3481487-21latency_hist08:50:011
36531922440,4chrt0-21swapper/111:44:071
3380648994434,7cyclictest3387671-21kworker/u8:2+flush-8:008:24:161
3380646994434,8cyclictest3556611-21diskstats10:09:010
3380648994337,5cyclictest3437183-21kworker/u8:0+flush-8:012:19:141
3380648994333,7cyclictest3392383-21latency_hist07:20:011
36609852420,2sleep2371rcuc/211:54:032
3380648994236,4cyclictest3343467-21kworker/u8:0+flush-8:007:14:061
3380646994231,8cyclictest3595634-21true10:45:000
3380648994135,5cyclictest3616291-21kworker/u8:3+flush-8:012:40:021
3380648994131,7cyclictest3496271-21latency_hist09:05:011
3380646994132,6cyclictest3575740-21latency_hist10:25:010
3380648994034,4cyclictest3380504-21kworker/u8:1+flush-8:008:09:171
3380648993933,4cyclictest3611069-21kworker/u8:2+flush-8:012:04:111
3380648993930,7cyclictest3387671-21kworker/u8:2+flush-8:009:19:101
3380648993832,5cyclictest3380504-21kworker/u8:1+flush-8:008:04:131
3380648993732,4cyclictest3437183-21kworker/u8:0+flush-8:010:09:161
3380648993732,3cyclictest3555215-21ntpq10:04:121
3380648993727,7cyclictest3486402-21latency_hist08:55:021
3380648993727,7cyclictest3380478-21latency_hist07:10:021
3380653993628,6cyclictest278-21systemd-journal12:20:002
3380648993627,7cyclictest3631384-21diskstats11:24:021
3380648993617,13cyclictest3387671-21kworker/u8:2+flush-8:009:13:581
338064699366,25cyclictest3427380-21kworker/0:0+events09:27:110
338064699366,25cyclictest3427380-21kworker/0:0+events09:27:110
35472272350,3chrt575-21kworker/3:2+events09:59:053
3380648993530,3cyclictest3690809-21irqrtprio12:24:051
3380648993530,3cyclictest3396702-21ntpq07:24:091
338064699353,30cyclictest3427380-21kworker/0:0+events08:09:000
3380648993427,5cyclictest3526681-21kworker/u8:1+flush-8:009:44:111
3380648993427,5cyclictest3437183-21kworker/u8:0+flush-8:011:29:091
3380646993428,4cyclictest3380504-21kworker/u8:1+flush-8:007:39:170
3380646993410,22cyclictest3515938-21kworker/0:1+events09:54:110
3380648993329,2cyclictest3562204-21irqrtprio10:14:051
3380648993328,3cyclictest3380504-21kworker/u8:1+flush-8:007:54:061
3380648993327,5cyclictest3561162-21kworker/u8:1+flush-8:010:29:111
3380648993327,4cyclictest3437183-21kworker/u8:0+flush-8:011:59:181
3380648993327,4cyclictest3437183-21kworker/u8:0+flush-8:011:04:021
3380648993327,4cyclictest3437183-21kworker/u8:0+flush-8:010:54:041
3380648993327,4cyclictest3437183-21kworker/u8:0+flush-8:010:54:041
3380648993326,5cyclictest3451130-21kworker/u8:3+flush-8:010:24:321
33760622334,9sleep20-21swapper/207:07:492
3380653993224,6cyclictest278-21systemd-journal12:00:532
3380648993227,3cyclictest3451130-21kworker/u8:3+flush-8:009:29:051
3380648993227,3cyclictest3451130-21kworker/u8:3+flush-8:009:29:051
3380648993226,5cyclictest3437183-21kworker/u8:0+flush-8:008:34:171
3380648993226,4cyclictest3581179-21/usr/sbin/munin10:34:101
3380648993225,5cyclictest3699745-21kworker/u8:2+flush-8:012:34:031
3380646993228,2cyclictest3669872-21cron12:00:010
3380646993223,7cyclictest278-21systemd-journal08:00:000
3380648993125,5cyclictest3611069-21kworker/u8:2+flush-8:011:19:181
338064699319,21cyclictest3575761-21kworker/0:0+events10:49:390
338064699312,28cyclictest3575761-21kworker/0:0+events10:59:150
338064699312,27cyclictest3427380-21kworker/0:0+events09:24:110
3380646993120,8cyclictest278-21systemd-journal09:20:000
338064699311,28cyclictest3365068-21kworker/0:2+events07:29:070
338064699311,25cyclictest3575761-21kworker/0:0+events11:35:470
3380648993025,3cyclictest3451130-21kworker/u8:3+events_unbound09:25:001
3380648993025,3cyclictest3428619-21irqrtprio07:59:051
3380648993025,3cyclictest0-21swapper/109:40:001
3380648993024,4cyclictest3561162-21kworker/u8:1+flush-8:010:39:191
3380648993023,5cyclictest3616291-21kworker/u8:3+flush-8:011:39:031
3380648993021,6cyclictest3595618-21latency_hist10:45:001
3380648993019,8cyclictest278-21systemd-journal08:37:521
338064699307,19cyclictest3408168-21kworker/0:3+events07:47:030
338064699305,23cyclictest3408168-21kworker/0:3+events07:44:150
338064699303,26cyclictest3575761-21kworker/0:0+events10:54:070
338064699303,26cyclictest3575761-21kworker/0:0+events10:54:070
3380646993025,3cyclictest3618510-21kthreadcore11:09:060
338064699302,27cyclictest3575761-21kworker/0:0+events12:02:070
338064699301,27cyclictest3575761-21kworker/0:0+events12:34:070
338064699301,27cyclictest3427380-21kworker/0:0+events08:23:590
338064699300,29cyclictest3427380-21kworker/0:0+events08:27:350
3380648992924,4cyclictest3611069-21kworker/u8:2+flush-8:011:09:011
338064699297,17cyclictest3515938-21kworker/0:1+events10:00:030
338064699296,21cyclictest3427380-21kworker/0:0+events08:34:110
3380646992925,2cyclictest3442881-21cpuspeed_turbos08:13:590
3380646992925,2cyclictest3442881-21cpuspeed_turbos08:13:590
3380646992922,5cyclictest3387671-21kworker/u8:2+flush-8:009:33:590
3380648992824,3cyclictest3611069-21kworker/u8:2+flush-8:011:49:031
3380648992824,2cyclictest0-21swapper/110:59:591
3380648992823,4cyclictest3616291-21kworker/u8:3+flush-8:012:14:161
3380648992823,4cyclictest3616291-21kworker/u8:3+flush-8:012:14:161
3380648992823,3cyclictest3699381-21cron12:30:001
3380648992823,3cyclictest3380504-21kworker/u8:1+flush-8:007:29:171
3380648992823,3cyclictest0-21swapper/110:00:001
3380648992822,5cyclictest3437183-21kworker/u8:0+events_unbound09:49:121
3380648992822,5cyclictest3380504-21kworker/u8:1+flush-8:007:44:151
3380648992822,4cyclictest3526681-21kworker/u8:1+events_unbound09:54:091
338064699281,26cyclictest3365068-21kworker/0:2+events07:19:110
338065399273,8cyclictest3610074-21sed10:59:112
3380653992724,2cyclictest3496902-21aten2_r5power_p09:09:012
3380648992723,3cyclictest3451130-21kworker/u8:3+flush-8:008:29:171
3380648992722,3cyclictest3443238-21irqcore08:14:031
3380648992722,3cyclictest3443238-21irqcore08:14:031
3380648992722,3cyclictest3387671-21kworker/u8:2+flush-8:009:34:051
3380648992720,5cyclictest3561162-21kworker/u8:1+events_unbound10:19:101
3380648992720,5cyclictest3451130-21kworker/u8:3+flush-8:008:19:121
338064699279,17cyclictest3575761-21kworker/0:0+events11:29:070
338064699276,20cyclictest3575761-21kworker/0:0+events11:19:270
338064699274,22cyclictest3575761-21kworker/0:0+events10:33:190
3380646992721,4cyclictest3427221-21unixbench_singl07:54:170
338065399263,5cyclictest3412122-21ps07:39:162
3380653992623,2cyclictest3620628-21unixbench_singl11:09:162
3380653992623,2cyclictest3556475-21aten2_r5power_v10:08:592
3380653992622,3cyclictest3482259-21cpuspeed_turbos08:54:002
3380653992621,3cyclictest3397210-21unixbench_singl07:24:162
3380648992620,4cyclictest3437183-21kworker/u8:0+flush-8:008:44:111
3380648992619,5cyclictest3451130-21kworker/u8:3+flush-8:009:09:181
3380648992616,7cyclictest3490757-21ntpq08:59:131
338064699269,15cyclictest3575761-21kworker/0:0+events11:03:590
338064699269,15cyclictest3515938-21kworker/0:1+events09:59:110
338064699268,16cyclictest3427380-21kworker/0:0+events08:39:110
3380646992620,4cyclictest411-21dbus-daemon08:05:000
3380646992620,4cyclictest3343467-21kworker/u8:0+events_unbound07:14:030
3380646992617,7cyclictest3451289-21ntpq08:19:100
338064699260,25cyclictest3575761-21kworker/0:0+events12:28:430
338065399256,3cyclictest0-21swapper/211:44:052
338065399252,5cyclictest3565245-21ntpq10:14:112
338065399252,5cyclictest3419018-21ps07:49:042
3380653992522,2cyclictest3492172-21fschecks_count09:04:032
3380653992522,2cyclictest3467394-21aten2_r5power_v08:38:592
3380648992520,3cyclictest3675668-21fschecks_count12:09:021
3380648992518,5cyclictest3640936-21apt-get11:33:561
3380648992518,5cyclictest3600531-21latency_hist10:50:001
3380648992517,6cyclictest3437183-21kworker/u8:0+flush-8:011:54:101
338064899251,10cyclictest34201792kthreadcore07:49:051
338064699258,16cyclictest3575761-21kworker/0:0+events11:14:110
338064699256,18cyclictest3575761-21kworker/0:0+events12:39:430
338064699252,18cyclictest3650252-21kworker/0:2+events11:45:030
3380646992520,3cyclictest0-21swapper/007:35:000
3380646992518,5cyclictest3387671-21kworker/u8:2+flush-8:009:11:240
3380646992510,13cyclictest3427380-21kworker/0:0+events08:48:590
3380653992420,2cyclictest3402087-21unixbench_multi07:29:192
3380653992420,2cyclictest3392259-21unixbench_singl07:19:182
3380653992419,3cyclictest3684515-21unixbench_singl12:14:172
3380653992419,3cyclictest3684515-21unixbench_singl12:14:172
3380653992413,9cyclictest3570804-21awk10:20:002
338065399240,7cyclictest3433204-21sh08:04:032
338065399240,13cyclictest3551991-21ps10:04:042
338065399240,12cyclictest3675360-21apt-get12:08:592
3380648992418,4cyclictest3616291-21kworker/u8:3+events_unbound11:14:061
338064699248,14cyclictest3427380-21kworker/0:0+events09:03:590
338064699247,16cyclictest3560739-21kworker/0:2+events10:18:590
3380646992421,2cyclictest3634798-21needreboot11:24:090
3380646992419,3cyclictest3562076-21irqcore10:14:050
3380646992419,3cyclictest0-21swapper/010:29:090
338065399237,6cyclictest0-21swapper/208:33:592
338065399235,5cyclictest3426707-21ntpq07:54:092
338065399235,3cyclictest3582225-21cut10:34:062
338064699239,12cyclictest3575761-21kworker/0:0+events12:24:110
338064699238,14cyclictest3515938-21kworker/0:1+events09:36:590
338064699238,14cyclictest3427380-21kworker/0:0+events08:53:390
338064699235,17cyclictest3575761-21kworker/0:0+events12:14:070
338064699235,17cyclictest3575761-21kworker/0:0+events12:14:070
338064699235,17cyclictest3427380-21kworker/0:0+events08:59:070
338064699234,18cyclictest3575761-21kworker/0:0+events11:31:070
3380646992318,3cyclictest3393264-21fschecks_time07:24:010
338065399224,9cyclictest0-21swapper/212:31:192
338065399224,4cyclictest0-21swapper/207:41:062
338065399223,9cyclictest0-21swapper/209:17:202
338065399222,5cyclictest3708639-21ntpq12:39:112
338065399222,4cyclictest0-21swapper/207:34:122
3380653992219,2cyclictest3605670-21cron10:55:002
3380653992219,2cyclictest3605670-21cron10:55:002
3380653992218,2cyclictest3442963-21fschecks_time08:14:022
3380653992218,2cyclictest3442963-21fschecks_time08:14:012
3380653992213,4cyclictest3626203-21apt-get11:18:592
338065399221,10cyclictest3520300-21ld09:29:132
338065399221,10cyclictest3520300-21ld09:29:122
338065399220,5cyclictest3477544-21awk08:49:042
338065399220,11cyclictest3441507-21ntpq08:09:132
3380648992216,4cyclictest0-21swapper/107:34:041
338064699224,16cyclictest3575761-21kworker/0:0+events12:09:110
338064699224,16cyclictest3427380-21kworker/0:0+events08:44:110
3380646992215,5cyclictest278-21systemd-journal11:44:420
338065399217,6cyclictest0-21swapper/209:14:042
338065399216,4cyclictest0-21swapper/211:34:092
338065399215,6cyclictest0-21swapper/209:44:522
338065399215,4cyclictest0-21swapper/211:59:032
338065399215,4cyclictest0-21swapper/210:40:282
338065399212,9cyclictest0-21swapper/210:38:402
338065399212,4cyclictest3540171-21ntpq09:49:112
338065399210,8cyclictest3541790-21awk09:54:022
3380648992116,3cyclictest3380504-21kworker/u8:1+events_unbound07:39:081
338064699215,14cyclictest3575761-21kworker/0:0+events12:19:070
338064699214,16cyclictest3515938-21kworker/0:1+events09:49:150
338065399205,4cyclictest0-21swapper/212:23:582
338065399205,4cyclictest0-21swapper/211:27:152
338065399205,3cyclictest35298292expr09:39:102
338065399205,2cyclictest161rcu_preempt07:59:162
338065399202,9cyclictest0-21swapper/210:25:332
338065399202,4cyclictest0-21swapper/210:00:002
338065399202,4cyclictest0-21swapper/208:19:072
3380653992016,2cyclictest3457675-21cpuspeed_turbos08:29:002
3380653992014,4cyclictest3631400-21fschecks_count11:24:022
338065399200,5cyclictest3456967-21sed08:25:022
338065399200,4cyclictest0-21swapper/211:39:022
33804222202,12sleep00-21swapper/007:09:280
338065399196,6cyclictest161rcu_preempt12:26:182
338065399195,4cyclictest0-21swapper/210:20:532
338065399194,4cyclictest0-21swapper/208:57:362
338065399192,9cyclictest0-21swapper/211:00:192
338065399192,9cyclictest0-21swapper/209:34:332
338065399192,4cyclictest0-21swapper/209:20:442
338065399192,12cyclictest3472191-21apt-get08:43:592
338065399190,3cyclictest3381329-21df07:13:572
33759042183,8sleep30-21swapper/307:05:453
36201252152,9sleep30-21swapper/311:09:113
36113892152,8sleep30-21swapper/311:03:583
34797952140,3sleep30-21swapper/308:49:083
33854942142,8sleep30-21swapper/307:15:003
36895562132,6sleep30-21swapper/312:20:013
36752382135,5sleep30-21swapper/312:07:453
35158982132,7sleep30-21swapper/309:25:003
34480422132,7sleep30-21swapper/308:19:043
34447222132,6sleep30-21swapper/308:14:063
34447222132,6sleep30-21swapper/308:14:063
37043342122,6sleep30-21swapper/312:35:013
37024522122,6sleep30-21swapper/312:34:093
36973742122,6sleep30-21swapper/312:29:083
36705062122,6sleep30-21swapper/312:04:003
36649892122,6sleep30-21swapper/311:55:013
36638972122,6sleep30-21swapper/311:54:093
36544452123,5sleep30-21swapper/311:44:103
36413192122,6sleep30-21swapper/311:34:033
36248552122,6sleep30-21swapper/311:14:093
36052962122,6sleep30-21swapper/310:54:203
36052962122,6sleep30-21swapper/310:54:193
35999492122,6sleep30-21swapper/310:49:133
35766622122,6sleep30-21swapper/310:29:043
35607842122,5sleep30-21swapper/310:10:023
35563352122,6sleep30-21swapper/310:08:573
35368562122,6sleep30-21swapper/309:49:033
35353332122,6sleep30-21swapper/309:44:143
35209772122,6sleep30-21swapper/309:30:013
35201342122,6sleep30-21swapper/309:29:093
35201342122,6sleep30-21swapper/309:29:093
35022012122,6sleep30-21swapper/309:14:043
35004582122,6sleep30-21swapper/309:09:113
34869532122,6sleep30-21swapper/308:59:003
34815002122,6sleep30-21swapper/308:50:013
34681682122,6sleep30-21swapper/308:39:063
34628642122,6sleep30-21swapper/308:34:043
34616822122,6sleep30-21swapper/308:29:193
34416402122,6sleep30-21swapper/308:09:173
34338072122,6sleep30-21swapper/308:04:073
34273292122,5sleep30-21swapper/307:55:003
34081022122,6sleep30-21swapper/307:37:513
34068892122,6sleep30-21swapper/307:34:143
34018312122,6sleep30-21swapper/307:29:173
33872342122,6sleep30-21swapper/307:15:043
36850052112,5sleep30-21swapper/312:17:003
36805572112,5sleep30-21swapper/312:14:033
36805572112,5sleep30-21swapper/312:14:033
36555242112,5sleep30-21swapper/311:47:073
36480532112,5sleep30-21swapper/311:39:083
36359722112,5sleep30-21swapper/311:28:213
36311382112,5sleep30-21swapper/311:24:003
36261772112,5sleep30-21swapper/311:18:583
36068332112,5sleep30-21swapper/310:59:043
35910362112,5sleep30-21swapper/310:41:273
35855892112,5sleep30-21swapper/310:35:013
35812082112,6sleep30-21swapper/310:34:013
35711492112,6sleep30-21swapper/310:21:213
35668442112,5sleep30-21swapper/310:19:043
35511992113,5sleep30-21swapper/310:01:393
35410042112,5sleep30-21swapper/309:50:073
35266992112,5sleep30-21swapper/309:39:043
35060762112,5sleep30-21swapper/309:15:013
34923192112,5sleep30-21swapper/309:04:053
34737812112,6sleep30-21swapper/308:44:073
34524522112,5sleep30-21swapper/308:23:253
34278692112,5sleep30-21swapper/307:58:583
34129182112,5sleep30-21swapper/307:40:523
33934062111,6sleep30-21swapper/307:24:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional