You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 16:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Apr 04, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
207857523580,2sleep3481ktimers/308:16:313
219367321980,4sleep30-21swapper/310:11:323
20190822650,1sleep2371rcuc/207:16:342
2008160996243,16cyclictest2130049-21latency_hist09:10:011
2008160995638,7cyclictest2024823-21latency_hist07:25:011
2008157995449,3cyclictest2214848-21kworker/u8:3+flush-8:010:36:380
2008157995238,10cyclictest1950591-21kworker/u8:1+events_unbound07:51:210
2008162995042,6cyclictest280-21systemd-journal11:20:002
2008162994940,7cyclictest280-21systemd-journal12:20:002
2008160994840,5cyclictest280-21systemd-journal10:51:251
2008162994742,3cyclictest1955866-21kworker/u8:2+events_unbound07:56:292
2008162994641,4cyclictest1950591-21kworker/u8:1+events_unbound07:36:392
2008160994535,7cyclictest2164717-21apt-get09:45:011
2008157994539,4cyclictest2269267-21kworker/u8:3+flush-8:012:31:350
2008157994435,6cyclictest2318966-21latency_hist12:20:010
2008160994334,7cyclictest2314004-21latency_hist12:15:001
2008157994339,2cyclictest2100556-21kworker/u8:2+flush-8:011:51:360
20261452420,2sleep20-21swapper/207:26:292
2008160994233,7cyclictest280-21systemd-journal08:10:001
2008157994238,3cyclictest2130070-21kworker/u8:0+flush-8:010:41:250
2008157994237,4cyclictest2069212-21kworker/u8:3+flush-8:008:21:380
2008162994034,4cyclictest1950591-21kworker/u8:1+events_unbound08:11:332
2008162994034,4cyclictest1950591-21kworker/u8:1+events_unbound08:11:332
2008157994031,6cyclictest2269267-21kworker/u8:3+flush-8:011:46:330
2008160993931,6cyclictest2309069-21latency_hist12:10:011
2008160993930,6cyclictest2079995-21latency_hist08:20:001
2008162993833,3cyclictest2130070-21kworker/u8:0+events_unbound10:46:372
2008160993831,5cyclictest2164717-21apt-get09:45:001
2008160993827,8cyclictest280-21systemd-journal09:19:241
2008157993829,6cyclictest2179748-21apt-get09:59:590
2008162993732,4cyclictest2214848-21kworker/u8:3+flush-8:011:06:402
2008157993732,4cyclictest2269267-21kworker/u8:3+flush-8:011:41:250
2008157993732,3cyclictest2299428-21kworker/u8:1+flush-8:012:06:280
2008157993732,3cyclictest1955866-21kworker/u8:2+events_unbound07:16:370
2008162993632,3cyclictest1950591-21kworker/u8:1+events_unbound07:21:382
2008160993626,8cyclictest280-21systemd-journal11:11:241
2008157993633,2cyclictest2074802-21kworker/u8:2+flush-8:008:16:390
2008157993630,4cyclictest2249203-21kworker/u8:0+flush-8:012:26:290
2008157993528,5cyclictest2144663-21kworker/u8:3+flush-8:009:26:340
2008157993527,6cyclictest280-21systemd-journal10:06:250
2008157993527,6cyclictest2225090-21/usr/sbin/munin10:46:320
2008162993430,3cyclictest2328083-21kworker/u8:1+events_unbound12:26:372
2008160993425,7cyclictest2115548-21apt-get08:56:211
2008157993429,3cyclictest2130070-21kworker/u8:0+flush-8:009:21:290
2008157993427,5cyclictest280-21systemd-journal11:25:000
2008157993427,5cyclictest2249203-21kworker/u8:0+flush-8:012:21:350
2008157993427,5cyclictest2249203-21kworker/u8:0+flush-8:012:21:350
20037092341,30sleep30-21swapper/307:06:253
22040902330,5sleep1281rcuc/110:21:371
22040902330,5sleep1281rcuc/110:21:371
2008162993326,5cyclictest280-21systemd-journal08:01:182
2008162993326,5cyclictest280-21systemd-journal08:01:182
2008160993325,6cyclictest2274812-21apt-get11:36:191
2008157993328,3cyclictest2109887-21unixbench_multi08:46:410
2008157993328,3cyclictest1-21systemd07:35:000
2008157993327,4cyclictest2269267-21kworker/u8:3+events_unbound12:36:350
2008157993327,3cyclictest2269267-21kworker/u8:3+events_unbound11:30:010
2008157993326,5cyclictest2100556-21kworker/u8:2+events_unbound12:00:000
2008157993325,6cyclictest2279424-21sh11:40:000
2008160993224,6cyclictest2195175-21apt-get10:16:171
2008160993223,7cyclictest2050436-21/usr/sbin/munin07:51:331
2008160993222,7cyclictest2224772-21latency_hist10:45:011
2008157993227,3cyclictest2084243-21kworker/u8:1+events_unbound08:26:270
2008157993223,7cyclictest2313142-21ntpq12:11:330
20077562323,7sleep10-21swapper/107:07:071
2008162993127,2cyclictest2050520-21aten2_r5power_e07:51:232
2008160993127,3cyclictest401-21dbus-daemon07:30:001
2008160993122,7cyclictest2294595-21apt-get11:56:201
2008157993127,3cyclictest2229438-21kworker/u8:1+flush-8:010:51:300
2008157993127,3cyclictest2200012-21kworker/u8:1+events_unbound10:31:370
2008157993126,4cyclictest2144663-21kworker/u8:3+events_unbound09:46:330
2008157993126,3cyclictest1955866-21kworker/u8:2+events_unbound07:26:410
2008162993024,4cyclictest2069869-21apt-get08:10:002
2008160993022,6cyclictest2289309-21latency_hist11:50:011
2008160993021,7cyclictest2218960-21ntpq10:36:321
2008157993026,3cyclictest2100556-21kworker/u8:2+events_unbound09:01:270
2008157993025,4cyclictest2110501-21kworker/u8:1+events_unbound08:56:380
2008157993025,3cyclictest2259378-21latency_hist11:20:000
2008157993025,3cyclictest1955866-21kworker/u8:2+events_unbound08:01:220
2008157993025,3cyclictest1955866-21kworker/u8:2+events_unbound08:01:220
2008157993024,4cyclictest2200012-21kworker/u8:1+events_unbound10:26:300
2008157993024,4cyclictest2055037-21kworker/u8:0+flush-8:008:51:330
2008157993024,4cyclictest1950591-21kworker/u8:1+flush-8:008:11:340
2008157993024,4cyclictest1950591-21kworker/u8:1+flush-8:008:11:340
2008157993023,5cyclictest2180353-21apt-get10:01:210
2008157993020,7cyclictest2094824-21apt-get08:35:010
2008162992923,4cyclictest2190512-21cut10:11:262
2008160992926,2cyclictest2096136-21irqrtprio08:36:261
2008160992925,2cyclictest2229719-21systemd-run10:50:011
2008160992925,2cyclictest2015536-21cpuspeed_turbos07:16:231
2008160992922,5cyclictest2090259-21apt-get08:31:201
2008157992925,3cyclictest2130070-21kworker/u8:0+flush-8:009:31:400
2008157992924,4cyclictest2214848-21kworker/u8:3+events_unbound11:00:010
2008157992923,4cyclictest2130070-21kworker/u8:0+events_unbound09:41:430
2008157992923,4cyclictest1166025-21kworker/u8:4+events_unbound07:11:240
2008157992921,6cyclictest2024842-21kworker/u8:0+flush-8:007:36:340
2008157992920,6cyclictest280-21systemd-journal08:40:010
2008162992824,3cyclictest2299428-21kworker/u8:1+events_unbound12:01:302
2008160992824,2cyclictest0-21swapper/111:20:001
2008160992823,4cyclictest2214533-21unixbench_singl10:31:431
2008160992823,4cyclictest1950591-21kworker/u8:1-ext4-rsv-conversion07:35:001
2008160992823,3cyclictest2110501-21kworker/u8:1+flush-8:008:51:301
2008160992821,5cyclictest280-21systemd-journal08:47:251
2008157992824,2cyclictest2069916-21systemd-run08:10:000
2008157992823,4cyclictest2100556-21kworker/u8:2+flush-8:011:31:400
2008157992822,4cyclictest2055037-21kworker/u8:0+events_unbound08:41:330
2008157992821,5cyclictest2100556-21kworker/u8:2+events_unbound09:11:330
2008157992821,5cyclictest2100556-21kworker/u8:2+events_unbound09:06:280
2008157992819,6cyclictest1955866-21kworker/u8:2+flush-8:007:46:280
21712842270,2sleep1161rcu_preempt09:51:281
2008162992723,3cyclictest2130070-21kworker/u8:0+events_unbound09:16:262
2008162992723,3cyclictest2069212-21kworker/u8:3+events_unbound08:21:272
2008162992721,4cyclictest2119768-21unixbench_multi08:56:402
2008162992721,1cyclictest161rcu_preempt11:25:012
2008160992722,4cyclictest2318668-21unixbench_singl12:16:421
2008160992722,3cyclictest0-21swapper/107:15:001
2008160992719,5cyclictest2338788-21latency_hist12:40:011
2008157992721,4cyclictest2214848-21kworker/u8:3+events_unbound11:06:290
2008157992721,4cyclictest2130070-21kworker/u8:0+flush-8:009:36:280
2008162992622,3cyclictest2110501-21kworker/u8:1+events_unbound08:50:382
2008160992622,3cyclictest2146003-21irqrtprio09:26:271
2008160992622,3cyclictest2121096-21irqcore09:01:271
2008160992622,2cyclictest2328847-21cron12:30:001
2008160992621,4cyclictest2044931-21apt-config07:45:001
2008160992621,4cyclictest1955866-21kworker/u8:2+flush-8:007:56:351
2008160992621,3cyclictest0-21swapper/111:00:001
2008160992620,3cyclictest2155740-21irqcore09:36:271
2008157992622,3cyclictest2130070-21kworker/u8:0+events_unbound09:16:240
2008157992621,3cyclictest2144663-21kworker/u8:3+events_unbound10:11:380
200775222615,8sleep20-21swapper/207:07:042
2008162992522,2cyclictest2220210-21aten2_r5power_c10:41:222
2008162992520,3cyclictest2130070-21kworker/u8:0+events_unbound10:35:082
2008160992521,2cyclictest0-21swapper/109:56:251
2008160992519,3cyclictest0-21swapper/111:20:031
2008157992521,3cyclictest2200729-21sort10:21:270
2008157992521,3cyclictest2200729-21sort10:21:270
200816299249,5cyclictest2029798-21apt-get07:30:032
200816299247,2cyclictest161rcu_preempt09:56:282
2008162992421,2cyclictest2304775-21fschecks_count12:06:242
2008162992421,2cyclictest2159395-21unixbench_multi09:36:402
2008162992420,3cyclictest2084243-21kworker/u8:1+events_unbound08:31:562
2008162992419,3cyclictest2104913-21unixbench_multi08:41:402
2008162992418,4cyclictest2169511-21unixbench_multi09:46:402
2008162992418,1cyclictest161rcu_preempt09:41:392
2008160992421,2cyclictest2244546-21turbostat.cron11:05:001
2008160992419,4cyclictest401-21dbus-daemon12:25:001
2008160992419,4cyclictest401-21dbus-daemon12:25:001
2008160992413,9cyclictest280-21systemd-journal09:34:251
2008157992420,3cyclictest2299428-21kworker/u8:1+events_unbound12:01:240
2008157992420,3cyclictest2130070-21kworker/u8:0+events_unbound09:51:260
2008157992417,5cyclictest2130070-21kworker/u8:0+flush-8:010:16:310
200815799240,13cyclictest201rcuc/007:21:320
2008162992320,2cyclictest371rcuc/207:45:272
2008162992320,2cyclictest2234291-21unixbench_multi10:51:402
2008162992319,2cyclictest2288996-21unixbench_singl11:46:402
2008162992317,1cyclictest161rcu_preempt10:21:242
2008162992317,1cyclictest161rcu_preempt10:21:242
2008162992316,2cyclictest161rcu_preempt10:06:362
2008162992315,2cyclictest161rcu_preempt09:21:252
2008160992319,3cyclictest2333515-21unixbench_singl12:31:421
2008160992319,2cyclictest2062521-21kthreadcore08:01:301
2008160992319,2cyclictest2062521-21kthreadcore08:01:301
2008160992319,2cyclictest0-21swapper/110:29:591
2008160992318,3cyclictest2050101-21cron07:50:001
200815799239,4cyclictest2244122-21ls11:01:410
2008157992313,4cyclictest2024842-21kworker/u8:0+events_unbound07:41:320
200816299228,2cyclictest161rcu_preempt11:01:302
200816299223,8cyclictest0-21swapper/211:31:462
200816299222,8cyclictest0-21swapper/207:45:002
2008162992210,2cyclictest161rcu_preempt11:40:002
200816099228,5cyclictest0-21swapper/109:22:361
2008160992218,2cyclictest0-21swapper/108:26:321
2008160992218,2cyclictest0-21swapper/108:21:321
2008160992217,3cyclictest0-21swapper/112:05:011
2008160992217,3cyclictest0-21swapper/108:45:011
2008160992216,5cyclictest2134674-21unixbench_multi09:11:391
2008160992215,5cyclictest280-21systemd-journal11:05:241
20079192222,3sleep00-21swapper/007:09:150
200816299219,3cyclictest2128213-21cut09:06:292
200816299213,2cyclictest0-21swapper/208:16:342
200816299212,3cyclictest2309420-21apt-get12:11:222
2008162992118,2cyclictest2333505-21unixbench_singl12:31:422
2008162992118,2cyclictest2130458-21aten2_r5power_e09:11:212
2008162992117,3cyclictest2184974-21cron10:05:002
2008162992116,1cyclictest161rcu_preempt10:20:002
200816299210,3cyclictest2124767-21grep09:01:402
2008160992118,2cyclictest2268685-21ntp_kernel_pll_11:26:321
2008160992117,2cyclictest0-21swapper/111:51:251
2008160992117,2cyclictest0-21swapper/111:41:281
2008160992117,2cyclictest0-21swapper/107:36:341
2008160992115,4cyclictest0-21swapper/111:31:291
200816299203,6cyclictest0-21swapper/208:25:182
2008162992017,2cyclictest2170517-21fschecks_count09:51:242
2008162992014,4cyclictest280-21systemd-journal10:35:002
2008162992013,1cyclictest161rcu_preempt11:56:352
2008160992016,2cyclictest0-21swapper/108:11:281
2008160992016,2cyclictest0-21swapper/108:11:281
2008160992014,4cyclictest0-21swapper/110:06:311
2008160992014,4cyclictest0-21swapper/110:01:391
2008160992010,2cyclictest0-21swapper/110:13:011
200816299199,7cyclictest2251507-21tr11:11:292
200816299195,2cyclictest161rcu_preempt10:58:472
200816299193,6cyclictest0-21swapper/212:35:432
200816299193,3cyclictest2098637-21seq08:36:302
200816299193,2cyclictest0-21swapper/207:15:002
2008162991915,2cyclictest2150553-21fschecks_time09:31:262
2008162991913,2cyclictest0-21swapper/211:26:372
200816299190,3cyclictest2283827-21runrttasks11:41:382
200815799194,3cyclictest22527262cut11:11:310
2008157991915,2cyclictest0-21swapper/007:56:410
200816299187,2cyclictest161rcu_preempt10:30:002
200816299183,2cyclictest161rcu_preempt08:46:322
2008162991812,2cyclictest161rcu_preempt12:20:032
2008162991812,2cyclictest161rcu_preempt12:20:032
200816299180,3cyclictest161rcu_preempt09:26:322
2008162991713,2cyclictest0-21swapper/211:51:322
23338022168,5sleep30-21swapper/312:35:003
22544442144,6sleep30-21swapper/311:15:023
21300322142,7sleep30-21swapper/309:10:013
20803402142,8sleep30-21swapper/308:21:213
20297892142,8sleep30-21swapper/307:30:013
23239072132,6sleep30-21swapper/312:25:003
23239072132,6sleep30-21swapper/312:25:003
22468822132,7sleep30-21swapper/311:06:313
22435602132,7sleep30-21swapper/311:01:333
22200112132,6sleep30-21swapper/310:40:023
22168182133,7sleep30-21swapper/310:36:293
22109002133,7sleep30-21swapper/310:31:283
20409812132,6sleep30-21swapper/307:41:283
20340632132,7sleep30-21swapper/307:31:333
23375052122,6sleep30-21swapper/312:36:323
23147352122,6sleep30-21swapper/312:16:263
23095812122,6sleep30-21swapper/312:11:243
23045012122,6sleep30-21swapper/312:06:223
22893252122,5sleep30-21swapper/311:50:013
22883192122,6sleep30-21swapper/311:46:323
22796022122,5sleep30-21swapper/311:40:023
22711752122,6sleep30-21swapper/311:31:313
22395812120,8sleep30-21swapper/311:00:013
22297172122,5sleep30-21swapper/310:50:023
22054682122,6sleep30-21swapper/310:26:263
21841182122,6sleep30-21swapper/310:01:343
21660172122,6sleep30-21swapper/309:46:293
21605122122,6sleep30-21swapper/309:41:273
21452802122,6sleep30-21swapper/309:26:223
21399562122,6sleep30-21swapper/309:20:003
21343482122,6sleep30-21swapper/309:11:383
21201902122,6sleep30-21swapper/309:00:023
21100272122,6sleep30-21swapper/308:47:263
21005442121,6sleep30-21swapper/308:40:033
20948882122,5sleep30-21swapper/308:35:023
20679702122,6sleep30-21swapper/308:06:323
20550162122,6sleep30-21swapper/307:55:013
20504662122,6sleep30-21swapper/307:51:243
20458192122,6sleep30-21swapper/307:46:263
20375172122,6sleep30-21swapper/307:36:313
20199372122,5sleep30-21swapper/307:20:013
20158332122,6sleep30-21swapper/307:16:283
23245312112,5sleep30-21swapper/312:26:253
23040662112,5sleep30-21swapper/312:04:183
22950672112,5sleep30-21swapper/311:56:273
22747232112,6sleep30-21swapper/311:35:283
22598882112,6sleep30-21swapper/311:20:283
22503462112,5sleep30-21swapper/311:11:293
22288062112,6sleep30-21swapper/310:46:323
22000562112,5sleep30-21swapper/310:20:363
22000562112,5sleep30-21swapper/310:20:353
21960842112,5sleep30-21swapper/310:16:273
21882932112,5sleep30-21swapper/310:06:313
21751812112,5sleep30-21swapper/309:56:243
21707022112,5sleep30-21swapper/309:51:273
21548212112,5sleep30-21swapper/309:35:013
21502402110,7sleep30-21swapper/309:31:243
21402482113,5sleep30-21swapper/309:20:293
21154802113,5sleep30-21swapper/308:55:493
21133962112,5sleep30-21swapper/308:51:313
20911452112,5sleep30-21swapper/308:31:293
20853062112,5sleep30-21swapper/308:26:233
20703372112,5sleep30-21swapper/308:10:143
20703372112,5sleep30-21swapper/308:10:143
20603792112,5sleep30-21swapper/308:01:233
20603792112,5sleep30-21swapper/308:01:223
20082802112,5sleep30-21swapper/307:10:013
22649212102,5sleep30-21swapper/311:26:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional