You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 15:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Dec 07, 2025 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40347922910,2sleep3586-21kworker/3:2+events08:45:013
35270421940,3sleep3586-21kworker/3:2-events07:51:193
61608221020,3chrt586-21kworker/3:2+events12:16:183
306768997565,7cyclictest418006-21kworker/u8:2+flush-8:009:31:221
306768996961,6cyclictest121399-21kworker/u8:4+flush-8:007:26:211
306771996560,4cyclictest348273-21kworker/u8:0+flush-8:008:01:212
306765996459,4cyclictest121399-21kworker/u8:4+flush-8:007:46:190
306771996154,5cyclictest282-21systemd-journal09:16:212
306765996055,4cyclictest378923-21kworker/u8:1+flush-8:008:21:240
306771995852,4cyclictest437834-21kworker/u8:1+flush-8:010:11:172
306771995852,4cyclictest378923-21kworker/u8:1+flush-8:008:26:182
306765995847,8cyclictest536908-21ntpq10:56:180
306771995750,5cyclictest557220-21kworker/u8:1+flush-8:011:26:192
306768995548,5cyclictest378923-21kworker/u8:1+flush-8:008:21:111
306771995449,3cyclictest418006-21kworker/u8:2+flush-8:010:06:202
306771995447,4cyclictest378923-21kworker/u8:1+events_unbound08:36:192
306765995450,3cyclictest121399-21kworker/u8:4+flush-8:007:16:210
306765995345,5cyclictest328498-21latency_hist07:30:010
306765995248,3cyclictest497673-21kworker/u8:0+events_unbound12:36:180
306765995248,3cyclictest3656641-21kworker/u8:3+flush-8:007:51:130
306765995247,4cyclictest388828-21kworker/u8:0+flush-8:008:51:210
306771995146,3cyclictest418006-21kworker/u8:2+flush-8:009:26:082
306771995039,8cyclictest586399-21kworker/u8:3+flush-8:011:51:192
306765994942,5cyclictest367665-21ntpq08:06:140
306768994840,6cyclictest557847-21apt-get11:21:021
306765994742,4cyclictest418006-21kworker/u8:2+events_unbound09:56:180
306765994741,4cyclictest463423-21kworker/u8:3+flush-8:009:46:080
306771994642,3cyclictest497673-21kworker/u8:0+events_unbound11:11:252
306771994639,6cyclictest418006-21kworker/u8:2+flush-8:010:21:202
306768994638,6cyclictest333434-21apt-get07:35:001
306771994540,4cyclictest297101-21kworker/u8:1+flush-8:007:46:152
306765994540,4cyclictest388828-21kworker/u8:0+flush-8:008:31:180
306765994540,3cyclictest297101-21kworker/u8:1+flush-8:007:21:170
306765994539,4cyclictest3656641-21kworker/u8:3+flush-8:009:07:060
306771994438,5cyclictest418006-21kworker/u8:2+flush-8:009:01:172
306768994437,5cyclictest616887-21latency_hist12:20:001
306768994437,5cyclictest282-21systemd-journal09:21:071
306765994440,3cyclictest418006-21kworker/u8:2+flush-8:011:11:160
306765994439,4cyclictest601799-21kworker/u8:3+flush-8:012:21:200
306765994439,3cyclictest121399-21kworker/u8:4+events_unbound07:41:080
306765994438,4cyclictest557220-21kworker/u8:1+flush-8:011:26:120
306771994339,3cyclictest388828-21kworker/u8:0+events_unbound09:21:182
306771994337,4cyclictest418006-21kworker/u8:2+events_unbound09:51:102
306768994337,4cyclictest388828-21kworker/u8:0+flush-8:008:41:081
306768994335,6cyclictest282-21systemd-journal07:45:001
306765994332,8cyclictest511941-21ntpq10:31:160
306771994238,3cyclictest508147-21kworker/u8:1+flush-8:010:31:182
306768994233,7cyclictest473564-21/usr/sbin/munin09:56:151
306765994236,5cyclictest418006-21kworker/u8:2+flush-8:009:31:170
306765994236,4cyclictest3656641-21kworker/u8:3+flush-8:007:31:260
306771994136,3cyclictest121399-21kworker/u8:4+flush-8:007:41:102
306768994137,3cyclictest418006-21kworker/u8:2+flush-8:011:16:131
306768994135,5cyclictest601799-21kworker/u8:3+events_unbound12:06:201
306765994135,4cyclictest3656641-21kworker/u8:3+flush-8:007:56:200
306768994034,5cyclictest497673-21kworker/u8:0+events_unbound11:41:131
306768994034,4cyclictest594694-21kworker/u8:2+flush-8:011:56:181
306768994034,4cyclictest388828-21kworker/u8:0+events_unbound08:51:221
306768994033,5cyclictest418006-21kworker/u8:2+events_unbound09:11:191
306768994033,5cyclictest418006-21kworker/u8:2+events_unbound09:11:191
306765994035,4cyclictest388828-21kworker/u8:0+flush-8:008:41:320
306765994035,3cyclictest418006-21kworker/u8:2+flush-8:009:11:120
306765994035,3cyclictest418006-21kworker/u8:2+flush-8:009:11:120
306765994034,4cyclictest3656641-21kworker/u8:3+flush-8:007:36:180
306765994032,5cyclictest626805-21latency_hist12:30:010
306765994029,8cyclictest591289-21ntpq11:51:170
306768993932,5cyclictest508210-21apt-get10:31:011
306768993932,5cyclictest373512-21apt-get08:15:001
306768993931,6cyclictest3656641-21kworker/u8:3+flush-8:009:07:001
306765993934,3cyclictest418006-21kworker/u8:2+events_unbound11:01:190
306768993832,4cyclictest373512-21apt-get08:15:031
306765993834,3cyclictest502656-21kworker/u8:3+events_unbound10:26:270
306765993832,4cyclictest418006-21kworker/u8:2+events_unbound09:51:160
306771993726,8cyclictest282-21systemd-journal08:09:032
306768993728,7cyclictest282-21systemd-journal09:43:031
306765993733,3cyclictest497673-21kworker/u8:0+events_unbound10:51:280
306765993731,5cyclictest418006-21kworker/u8:2+flush-8:009:01:150
306765993730,5cyclictest594694-21kworker/u8:2+flush-8:012:16:080
306765993730,5cyclictest557220-21kworker/u8:1+flush-8:011:46:150
306765993728,7cyclictest369131-21diskstats08:11:070
3450722360,2sleep3471rcuc/307:46:093
306771993630,5cyclictest121399-21kworker/u8:4+flush-8:007:11:112
306768993632,3cyclictest557220-21kworker/u8:1+events_unbound11:36:041
306768993632,3cyclictest557220-21kworker/u8:1+events_unbound11:36:041
306768993631,4cyclictest388828-21kworker/u8:0+events_unbound08:46:211
306768993630,5cyclictest388828-21kworker/u8:0+flush-8:008:31:181
306768993628,6cyclictest282-21systemd-journal11:35:001
306765993632,3cyclictest418006-21kworker/u8:2+events_unbound10:06:110
306765993628,6cyclictest437834-21kworker/u8:1+flush-8:010:01:170
306768993530,4cyclictest3656641-21kworker/u8:3+events_unbound07:36:141
306768993530,4cyclictest121399-21kworker/u8:4+flush-8:007:46:081
306768993529,5cyclictest388828-21kworker/u8:0+flush-8:008:56:151
306768993526,7cyclictest418006-21kworker/u8:2+flush-8:009:16:191
306765993530,4cyclictest601799-21kworker/u8:3+events_unbound12:31:230
306765993530,4cyclictest557220-21kworker/u8:1+events_unbound11:31:160
306765993530,4cyclictest388828-21kworker/u8:0+flush-8:009:16:190
306765993530,4cyclictest388828-21kworker/u8:0+flush-8:008:56:060
306765993528,5cyclictest418006-21kworker/u8:2+flush-8:010:36:220
306768993429,4cyclictest418006-21kworker/u8:2+flush-8:010:21:221
306768993428,5cyclictest121399-21kworker/u8:4+flush-8:007:56:181
306768993425,7cyclictest617234-21apt-get12:21:011
306768993424,7cyclictest636675-21latency_hist12:40:011
306765993430,3cyclictest594694-21kworker/u8:2+events_unbound11:56:200
306765993430,3cyclictest437834-21kworker/u8:1+events_unbound10:21:070
306765993425,6cyclictest378656-21latency_hist08:20:000
306765993423,8cyclictest282-21systemd-journal12:06:030
306771993326,5cyclictest282-21systemd-journal10:40:002
306771993323,8cyclictest282-21systemd-journal10:30:002
306768993328,4cyclictest601799-21kworker/u8:3+flush-8:012:31:211
306768993327,4cyclictest463577-21aten2_r5power_p09:46:061
306768993324,7cyclictest473263-21latency_hist09:55:001
306768993323,7cyclictest458210-21latency_hist09:40:011
306765993328,4cyclictest594694-21kworker/u8:2+events_unbound12:01:230
306765993328,4cyclictest497673-21kworker/u8:0+flush-8:010:41:210
306765993327,4cyclictest462768-21grep09:41:200
306765993327,4cyclictest388828-21kworker/u8:0+flush-8:008:46:180
306771993227,4cyclictest572072-21kworker/u8:2+flush-8:011:46:082
306771993226,4cyclictest497673-21kworker/u8:0+events_unbound10:55:012
306768993227,3cyclictest540271-21kthreadcore11:01:121
306768993227,3cyclictest316159-21kthreadcore07:16:131
306768993222,8cyclictest622143-21/usr/sbin/munin12:26:151
306765993228,3cyclictest497673-21kworker/u8:0+flush-8:012:11:190
306765993227,4cyclictest388828-21kworker/u8:0+events_unbound09:36:210
306765993227,4cyclictest3656641-21kworker/u8:3+flush-8:007:11:170
306768993127,3cyclictest497673-21kworker/u8:0+events_unbound10:41:161
306768993126,4cyclictest557220-21kworker/u8:1+flush-8:011:26:221
306768993126,4cyclictest502656-21kworker/u8:3+events_unbound10:26:251
306768993126,4cyclictest121399-21kworker/u8:4+flush-8:008:26:241
306768993124,5cyclictest513151-21apt-get10:36:031
306765993126,4cyclictest557220-21kworker/u8:1+events_unbound11:36:060
306765993126,4cyclictest557220-21kworker/u8:1+events_unbound11:36:060
306765993126,4cyclictest497673-21kworker/u8:0+events_unbound11:06:200
306765993122,6cyclictest282-21systemd-journal08:39:030
306771993026,2cyclictest478880-21fschecks_time10:01:072
306765993026,3cyclictest418006-21kworker/u8:2+flush-8:010:46:270
306765993026,3cyclictest418006-21kworker/u8:2+events_unbound09:26:150
306765993025,4cyclictest557220-21kworker/u8:1+flush-8:011:21:120
306771992923,4cyclictest378316-21unixbench_singl08:16:232
306768992925,3cyclictest497673-21kworker/u8:0+flush-8:012:11:161
306768992925,3cyclictest121399-21kworker/u8:4+events_unbound07:51:091
306768992919,8cyclictest282-21systemd-journal11:13:021
306765992924,4cyclictest437834-21kworker/u8:1+events_unbound10:11:160
306765992923,4cyclictest439376-21kthreadcore09:21:130
30676599292,26cyclictest437502-21kworker/0:3+events11:18:580
306771992822,5cyclictest418006-21kworker/u8:2+events_unbound09:56:252
306768992825,2cyclictest586298-21needreboot11:46:141
306768992822,5cyclictest297101-21kworker/u8:1+flush-8:007:21:191
306768992822,4cyclictest358752-21/usr/sbin/munin08:01:131
30676599282,25cyclictest577385-21kworker/0:2+events11:43:340
306765992822,4cyclictest378923-21kworker/u8:1+flush-8:008:26:130
306765992817,8cyclictest363475-21base6408:05:010
306771992720,5cyclictest282-21systemd-journal12:15:002
306768992721,4cyclictest527528-21unixbench_multi10:46:251
306771992623,1cyclictest282-21systemd-journal09:40:002
306771992621,4cyclictest338615-21idleruntime-cro07:40:002
306771992621,3cyclictest497563-21unixbench_multi10:16:212
306771992620,4cyclictest462817-21unixbench_singl09:41:212
306771992620,4cyclictest418006-21kworker/u8:2+events_unbound11:15:082
306771992619,5cyclictest282-21systemd-journal12:20:002
306768992622,2cyclictest306606-21latency_hist07:10:011
306768992621,3cyclictest394623-21irqrtprio08:36:101
306768992620,5cyclictest497673-21kworker/u8:0+events_unbound10:51:161
306768992619,6cyclictest587660-21aten2_r5power_v11:51:071
306768992619,5cyclictest547263-21grep11:06:241
306768992615,7cyclictest487285-21seq10:06:191
30676599266,19cyclictest437502-21kworker/0:3+events10:17:140
306771992522,2cyclictest602082-21idleruntime-cro12:05:002
306771992522,2cyclictest592814-21fschecks_time11:56:062
306771992521,3cyclictest557220-21kworker/u8:1+events_unbound11:36:282
306771992521,3cyclictest557220-21kworker/u8:1+events_unbound11:36:282
306771992520,4cyclictest378923-21kworker/u8:1+flush-8:008:30:062
306768992521,3cyclictest594694-21kworker/u8:2+flush-8:012:01:191
306768992519,5cyclictest437834-21kworker/u8:1+events_unbound10:16:151
306768992519,4cyclictest488406-21apt-get10:11:011
306771992416,6cyclictest373927-21cat08:15:012
306768992416,6cyclictest363919-21/usr/sbin/munin08:06:141
306771992320,2cyclictest621449-21unixbench_multi12:21:222
306771992319,3cyclictest497673-21kworker/u8:0+events_unbound10:55:052
306771992319,2cyclictest547311-21unixbench_singl11:06:242
306771992318,3cyclictest571958-21unixbench_multi11:31:242
306768992320,2cyclictest479284-21irqrtprio10:01:101
306768992318,4cyclictest3656641-21kworker/u8:3+flush-8:007:11:201
306768992313,8cyclictest443426-21/usr/sbin/munin09:26:221
3065232232,15sleep00-21swapper/007:09:070
306768992215,5cyclictest418609-21/usr/sbin/munin09:01:141
306771992118,2cyclictest408935-21cpuspeed_turbos08:51:072
306771992118,1cyclictest333878-21cat07:35:002
306771992117,2cyclictest518212-21aten2_r5power_p10:41:042
306771992115,4cyclictest606682-21unixbench_singl12:06:232
306771992114,5cyclictest282-21systemd-journal12:35:002
306771992112,7cyclictest408361-21cron08:50:002
30677199202,12cyclictest632039-21apt-get12:36:022
30677199202,12cyclictest538111-21apt-get11:01:042
306771992017,2cyclictest463840-21fschecks_time09:46:082
306771992016,3cyclictest448615-21cpuspeed_turbos09:31:082
306771992016,2cyclictest413915-21tr08:56:042
306771992015,3cyclictest577940-21fschecks_count11:41:062
306771992015,3cyclictest121399-21kworker/u8:4+events_unbound07:15:102
306771992011,7cyclictest353825-21apt-get07:56:032
306768992015,4cyclictest535989-21kthreadcore10:56:131
30677199192,12cyclictest398836-21apt-get08:41:052
306771991916,2cyclictest328483-21cron07:30:002
306771991916,2cyclictest319013-21aten2_r5power_c07:21:052
306771991915,3cyclictest622520-21fschecks_time12:26:062
306771991915,2cyclictest0-21swapper/209:10:012
306771991914,3cyclictest0-21swapper/211:21:072
306771991914,3cyclictest0-21swapper/209:11:132
306771991914,3cyclictest0-21swapper/209:11:132
3064362193,12sleep20-21swapper/207:08:012
3021002193,9sleep30-21swapper/307:06:053
30677199171,4cyclictest0-21swapper/207:54:532
30677199171,11cyclictest523291-21apt-get10:46:032
306771991613,2cyclictest0-21swapper/208:22:032
5713632143,7sleep30-21swapper/311:31:163
5152852145,5sleep30-21swapper/310:36:143
3753992143,7sleep30-21swapper/308:16:123
5929222132,7sleep30-21swapper/311:56:083
5628502132,7sleep30-21swapper/311:26:063
5468722132,7sleep30-21swapper/311:06:203
4880692132,6sleep30-21swapper/310:10:013
4825552130,8sleep30-21swapper/310:01:233
4073582132,7sleep30-21swapper/308:46:143
6275042122,6sleep30-21swapper/312:31:123
6218592122,6sleep30-21swapper/312:25:023
6024142122,6sleep30-21swapper/312:06:033
6013292122,6sleep30-21swapper/312:01:223
5723732122,6sleep30-21swapper/311:35:013
5723732122,6sleep30-21swapper/311:35:003
5578532122,6sleep30-21swapper/311:21:053
5476442122,6sleep30-21swapper/311:10:013
5336872122,6sleep30-21swapper/310:56:123
5284212122,6sleep30-21swapper/310:51:073
5234772122,6sleep30-21swapper/310:46:043
4950482122,6sleep30-21swapper/310:16:113
4746662122,6sleep30-21swapper/309:56:123
4722512123,5sleep30-21swapper/309:51:153
4524182122,6sleep30-21swapper/309:31:253
4474612122,6sleep30-21swapper/309:26:233
4333612122,6sleep30-21swapper/309:15:033
4236512122,6sleep30-21swapper/309:06:253
4224972122,6sleep30-21swapper/309:01:193
4133382123,5sleep30-21swapper/308:55:003
3843672122,6sleep30-21swapper/308:26:113
3786892122,6sleep30-21swapper/308:20:013
3591242122,6sleep30-21swapper/308:01:073
3535092122,5sleep30-21swapper/307:55:013
3411992122,6sleep30-21swapper/307:41:133
3339422122,6sleep30-21swapper/307:35:473
3292392122,6sleep30-21swapper/307:31:133
3242592122,6sleep30-21swapper/307:26:083
3072452122,6sleep30-21swapper/307:11:073
6325452112,5sleep30-21swapper/312:36:093
6194862112,5sleep30-21swapper/312:21:113
6075802112,5sleep30-21swapper/312:11:053
5879252112,5sleep30-21swapper/311:51:103
5869302112,5sleep30-21swapper/311:46:293
5776292112,6sleep30-21swapper/311:40:473
5528632112,6sleep30-21swapper/311:16:033
5380852112,5sleep30-21swapper/311:01:013
5181272112,6sleep30-21swapper/310:41:043
5084632112,5sleep30-21swapper/310:31:083
5034462112,5sleep30-21swapper/310:26:113
5020132112,5sleep30-21swapper/310:21:173
4634952112,6sleep30-21swapper/309:46:063
4590582112,5sleep30-21swapper/309:41:083
4580482112,5sleep30-21swapper/309:38:073
4381442112,5sleep30-21swapper/309:20:013
4284802112,5sleep30-21swapper/309:11:023
4284802112,5sleep30-21swapper/309:11:013
4086872112,5sleep30-21swapper/308:51:043
3938752112,5sleep30-21swapper/308:36:033
3888932112,6sleep30-21swapper/308:31:013
3690432112,5sleep30-21swapper/308:11:073
3638982112,5sleep30-21swapper/308:05:483
3189862112,5sleep30-21swapper/307:21:063
3124802112,5sleep30-21swapper/307:15:033
4883102102,5sleep30-21swapper/310:10:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional