You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 21:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Tue Jun 16, 2026 12:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
152352920,7sleep12979299cyclictest09:17:311
9432830,1sleep00-21swapper/012:12:350
9432830,1sleep00-21swapper/012:12:350
228102810,5sleep22979399cyclictest12:00:172
211152730,3sleep121072-21ssh09:25:041
211152730,3sleep121072-21ssh09:25:041
29791997226,26cyclictest13-21rcuc/009:50:140
29791997226,26cyclictest13-21rcuc/009:50:140
166182720,1sleep20-21swapper/212:30:522
2979199705,43cyclictest0-21swapper/007:10:060
237762700,2sleep00-21swapper/008:20:310
2979299697,12cyclictest20713-21ssh10:40:151
29791996933,3cyclictest0-21swapper/010:40:150
2979199682,15cyclictest1032-21dpkg08:50:040
50152670,8sleep27950irq/56-dwc_otg_12:17:242
250292630,1sleep20-21swapper/208:25:242
2979199622,34cyclictest6633-21latency_hist12:20:040
2979399613,40cyclictest0-21swapper/207:10:052
2979299615,11cyclictest8050irq/56-dwc_otg_08:50:041
2979499603,39cyclictest0-21swapper/307:10:053
198352600,3sleep318806-21/usr/sbin/munin10:00:293
2979399598,35cyclictest0-21swapper/211:00:162
29791995923,3cyclictest0-21swapper/011:45:140
2979299587,36cyclictest0-21swapper/107:10:051
2979299583,4cyclictest7950irq/56-dwc_otg_11:00:171
2979199585,34cyclictest0-21swapper/011:40:160
2979199585,34cyclictest0-21swapper/011:40:160
2979199575,28cyclictest0-21swapper/012:00:040
2979299561,34cyclictest0-21swapper/108:10:161
158662560,2sleep30-21swapper/312:30:253
29791995514,22cyclictest14599-21aten_rbpower_cu09:55:170
2979199545,44cyclictest0-21swapper/009:25:130
29791995433,8cyclictest0-21swapper/011:20:160
29791995427,11cyclictest7850irq/56-dwc_otg11:30:030
29791995417,4cyclictest0-21swapper/012:00:140
255202540,2sleep30-21swapper/312:03:243
2979299537,12cyclictest0-21swapper/108:25:171
2979199538,25cyclictest4052-21grep08:55:300
29791995331,4cyclictest0-21swapper/010:30:150
2979199531,28cyclictest0-21swapper/010:10:150
2979199531,28cyclictest0-21swapper/010:10:150
2979299523,31cyclictest7850irq/56-dwc_otg12:30:151
29791995241,4cyclictest7950irq/56-dwc_otg_09:20:300
29791995241,4cyclictest7950irq/56-dwc_otg_09:20:300
29791995228,6cyclictest125-21systemd-journal10:50:030
2979199522,5cyclictest29596-21kworker/0:009:00:170
2979199522,29cyclictest1983-21aten_rbpower_en11:35:170
29791995214,5cyclictest0-21swapper/012:25:170
2979199521,36cyclictest0-21swapper/010:05:160
29793995125,5cyclictest6945-21aten_rbpower_vo12:20:172
29791995130,4cyclictest9132-21grep10:25:320
29791995116,24cyclictest0-21swapper/010:22:350
29791995113,34cyclictest19269-21runrttasks12:35:150
29791995031,4cyclictest5650-21fschecks_time11:00:200
29791995029,13cyclictest0-21swapper/008:05:170
29791995027,8cyclictest13974-21unixbench_multi09:15:310
29791995027,5cyclictest17729-21grep10:35:320
29791995027,5cyclictest17729-21grep10:35:320
29791995025,5cyclictest19892-21cat08:10:290
2979199502,27cyclictest550-21sed10:15:300
2979199502,27cyclictest0-21swapper/009:45:150
29791995021,5cyclictest9726-21unixbench_multi09:10:320
2979199497,6cyclictest0-21swapper/011:10:140
2979199497,6cyclictest0-21swapper/011:10:140
2979199493,9cyclictest7850irq/56-dwc_otg11:00:030
2979199491,7cyclictest21568-21idleruntime-cro11:20:030
2979199491,30cyclictest15463-21grep12:30:200
2979199491,30cyclictest0-21swapper/011:10:040
2979199491,27cyclictest26896-21grep09:30:320
2979199491,26cyclictest19123-21fschecks_count10:00:200
2979199491,26cyclictest0-21swapper/009:40:250
2979499487,25cyclictest0-21swapper/309:05:173
2979299485,7cyclictest7850irq/56-dwc_otg10:00:141
2979299484,16cyclictest0-21swapper/108:55:161
2979299481,5cyclictest0-21swapper/109:30:141
29791994817,14cyclictest32691-21sh11:32:410
2979199481,25cyclictest15201-21basename08:00:030
2979499471,32cyclictest8050irq/56-dwc_otg_10:05:183
29791994723,4cyclictest3754-21wc07:25:300
2979199471,36cyclictest0-21swapper/008:27:290
29791994712,5cyclictest15591-21unixbench_multi11:50:320
2979199471,22cyclictest6922-21aten_rbpower_po12:20:170
2979199471,15cyclictest0-21swapper/007:45:280
299312460,2sleep00-21swapper/009:35:180
29791994627,6cyclictest8050irq/56-dwc_otg_07:40:220
2979299456,24cyclictest0-21swapper/109:05:171
29791994524,2cyclictest0-21swapper/008:50:090
29791994516,6cyclictest31007-21unixbench_multi08:40:320
294942452,14sleep00-21swapper/007:09:430
2979399448,4cyclictest7850irq/56-dwc_otg12:35:152
2979399441,31cyclictest0-21swapper/209:32:312
2979199444,18cyclictest0-21swapper/007:20:150
29793994318,12cyclictest14324-21ntp_offset11:10:242
29793994318,12cyclictest14324-21ntp_offset11:10:242
2979299437,23cyclictest0-21swapper/108:05:181
29791994323,3cyclictest0-21swapper/008:30:220
29791994322,3cyclictest0-21swapper/007:15:220
29791994321,5cyclictest0-21swapper/007:30:150
29791994321,5cyclictest0-21swapper/007:30:150
29791994316,17cyclictest0-21swapper/008:36:440
29791994314,17cyclictest0-21swapper/012:06:180
2979199431,21cyclictest12900-21grep07:50:310
2979199431,21cyclictest0-21swapper/010:50:190
203822430,1sleep20-21swapper/210:00:562
317932420,6sleep331797-21aten_rbpower_vo08:45:173
2979399427,24cyclictest0-21swapper/209:05:172
29793994220,19cyclictest1445450wget11:50:182
29792994217,13cyclictest30959-21timerandwakeup09:35:321
29792994213,20cyclictest0-21swapper/110:45:171
2979199421,20cyclictest125-21systemd-journal08:17:450
2979199421,20cyclictest125-21systemd-journal08:17:450
29794994116,4cyclictest11512-21kernelversion12:25:243
29793994115,5cyclictest31964-21cat12:10:302
29793994115,5cyclictest31964-21cat12:10:302
2979299412,4cyclictest8050irq/56-dwc_otg_12:35:231
29792994114,17cyclictest0-21swapper/111:31:041
36112400,1sleep30-21swapper/311:36:143
2979299401,25cyclictest0-21swapper/107:20:171
2979199402,22cyclictest0-21swapper/009:06:420
311132390,1sleep30-21swapper/310:51:303
29794993916,4cyclictest15776-21grep09:55:313
29794993914,4cyclictest727-21runrttasks08:25:193
2979399397,7cyclictest8050irq/56-dwc_otg_10:10:332
2979399397,7cyclictest8050irq/56-dwc_otg_10:10:332
2979399395,5cyclictest7950irq/56-dwc_otg_11:35:292
2979399395,22cyclictest7950irq/56-dwc_otg_11:15:212
2979399393,23cyclictest0-21swapper/208:05:182
29793993918,10cyclictest8050irq/56-dwc_otg_10:25:142
29793993911,5cyclictest14005-21latency_hist11:50:032
2979299393,28cyclictest0-21swapper/107:45:151
29792993915,14cyclictest13240-21latency_hist11:10:041
2979299391,28cyclictest0-21swapper/112:10:331
2979299391,28cyclictest0-21swapper/112:10:331
2979299391,18cyclictest3183-21runrttasks07:25:221
2979199397,6cyclictest7950irq/56-dwc_otg_07:35:170
283192390,5sleep231-21ksoftirqd/208:35:222
245292390,2sleep20-21swapper/211:22:572
29794993816,4cyclictest727-21runrttasks11:15:003
29794993816,4cyclictest727-21runrttasks11:15:003
29794993815,13cyclictest301842chrt10:13:053
29794993815,13cyclictest301842chrt10:13:053
29793993812,4cyclictest7950irq/56-dwc_otg_09:20:342
29793993812,4cyclictest7950irq/56-dwc_otg_09:20:342
2979299387,19cyclictest14699-21fschecks_time11:50:211
2979299387,19cyclictest0-21swapper/110:05:181
2979299384,21cyclictest0-21swapper/111:38:331
29792993822,8cyclictest8050irq/56-dwc_otg_09:50:231
29792993822,8cyclictest8050irq/56-dwc_otg_09:50:231
29792993817,4cyclictest796-21apt-key10:55:041
2979299381,15cyclictest13196-21timerandwakeup10:30:291
29792993810,19cyclictest0-21swapper/112:16:101
29791993816,15cyclictest0-21swapper/008:00:350
2979499374,5cyclictest4947-21cut11:00:033
29794993717,11cyclictest7099-21ntpq07:35:273
2979499371,6cyclictest20383-21idleruntime-cro10:40:033
2979499371,6cyclictest20383-21idleruntime-cro10:40:033
29794993716,6cyclictest727-21runrttasks10:16:213
2979399376,4cyclictest0-21swapper/210:22:412
2979399376,4cyclictest0-21swapper/209:59:522
2979399372,6cyclictest16593-21unixbench_singl08:00:322
29793993713,12cyclictest8134-21diskmemload10:34:362
2979299376,21cyclictest22641-21ssh12:00:151
2979299371,13cyclictest0-21swapper/109:45:061
2979499367,17cyclictest0-21swapper/308:05:183
2979499367,13cyclictest22776-21aten_rbpower_vo08:20:173
2979499361,8cyclictest1385-21apt09:40:033
29794993617,12cyclictest8050irq/56-dwc_otg_11:20:203
29794993614,6cyclictest31206-21ls11:30:293
29794993614,5cyclictest27048-21fschecks_count12:05:203
2979499361,28cyclictest0-21swapper/311:15:233
2979499361,23cyclictest10587-21ls11:45:203
2979399369,4cyclictest0-21swapper/209:51:232
2979399369,4cyclictest0-21swapper/209:51:232
2979399368,4cyclictest0-21swapper/210:42:322
2979399368,12cyclictest0-21swapper/211:25:312
29793993621,7cyclictest8050irq/56-dwc_otg_10:06:262
29793993618,8cyclictest301ktimersoftd/210:55:052
29793993615,4cyclictest21243-21if_eth008:15:222
29793993615,4cyclictest21243-21if_eth008:15:222
29793993613,8cyclictest10251-21ssh11:05:272
2979399361,18cyclictest8050irq/56-dwc_otg_09:10:172
29792993618,4cyclictest8313-21if_err_eth010:25:221
2979299361,25cyclictest0-21swapper/107:40:181
2979499359,3cyclictest0-21swapper/311:41:133
2979499359,3cyclictest0-21swapper/311:41:133
2979499351,7cyclictest8076-21head12:20:313
2979499351,7cyclictest2926-21seq12:15:203
29794993517,5cyclictest727-21runrttasks09:10:153
2979499351,5cyclictest20784-21ls08:15:043
2979399359,5cyclictest7950irq/56-dwc_otg_08:10:252
2979399359,13cyclictest0-21swapper/210:54:322
2979399359,12cyclictest8050irq/56-dwc_otg_07:15:192
2979399358,4cyclictest0-21swapper/210:46:382
2979399356,4cyclictest7950irq/56-dwc_otg_12:05:182
2979399356,4cyclictest7850irq/56-dwc_otg07:20:172
2979399356,4cyclictest0-21swapper/211:43:262
2979399356,4cyclictest0-21swapper/211:43:262
2979399355,5cyclictest7850irq/56-dwc_otg08:32:492
2979399354,15cyclictest61-21kswapd009:45:132
2979299353,16cyclictest0-21swapper/111:17:001
29792993516,12cyclictest0-21swapper/112:21:091
29792993513,11cyclictest8134-21diskmemload10:39:131
29792993513,11cyclictest8134-21diskmemload10:39:131
2979299351,27cyclictest0-21swapper/109:10:551
29792993512,12cyclictest0-21swapper/110:22:531
2979299351,14cyclictest5910-21grep09:00:311
163782351,4sleep30-21swapper/309:19:323
131872351,5sleep10-21swapper/107:52:391
2979499345,21cyclictest5292-21ssh11:00:163
2979499343,5cyclictest13087-21ssh11:09:473
2979499341,7cyclictest19538-21ssh12:35:213
2979499341,6cyclictest32050-21ssh12:10:313
2979499341,6cyclictest32050-21ssh12:10:313
29794993416,10cyclictest727-21runrttasks08:18:013
29794993416,10cyclictest727-21runrttasks08:18:013
29794993414,5cyclictest24716-21latency_hist10:45:033
29794993414,13cyclictest3326-21sh09:41:013
29794993412,10cyclictest8134-21diskmemload10:22:273
2979499341,17cyclictest8371-21ssh10:25:223
29794993411,4cyclictest0-21swapper/309:50:163
29794993411,4cyclictest0-21swapper/309:50:163
2979399349,5cyclictest7950irq/56-dwc_otg_09:15:262
2979399347,4cyclictest0-21swapper/209:36:552
2979399347,3cyclictest0-21swapper/210:37:202
2979399347,3cyclictest0-21swapper/210:37:202
2979399345,4cyclictest7850irq/56-dwc_otg07:50:312
2979399345,4cyclictest30156-21/usr/sbin/munin11:30:282
2979399345,4cyclictest0-21swapper/212:25:342
2979399345,13cyclictest8050irq/56-dwc_otg_08:45:042
2979399342,6cyclictest32509-21ntp_kernel_pll_10:15:242
29793993415,5cyclictest800-21sh08:50:032
2979299349,4cyclictest0-21swapper/111:20:281
2979299348,5cyclictest1861-21cpu09:40:181
2979299346,14cyclictest7850irq/56-dwc_otg07:30:301
2979299346,14cyclictest7850irq/56-dwc_otg07:30:301
29792993425,5cyclictest6191-21aten_rbpower_vo11:40:191
29792993425,5cyclictest6191-21aten_rbpower_vo11:40:191
2979299341,5cyclictest32390-21memory10:15:231
2979299341,16cyclictest0-21swapper/108:02:021
29792993411,5cyclictest23-21ksoftirqd/111:50:031
2979299341,15cyclictest0-21swapper/109:25:201
2979299341,12cyclictest0-21swapper/109:55:201
43682330,6sleep12979299cyclictest10:59:091
2979499337,4cyclictest0-21swapper/311:25:323
2979499332,5cyclictest0-21swapper/307:55:043
2979499332,5cyclictest0-21swapper/307:25:223
2979499331,7cyclictest21697-21cut09:25:203
2979499331,6cyclictest5911-21unixbench_singl09:00:313
29794993315,9cyclictest8050irq/56-dwc_otg_11:51:233
29794993315,4cyclictest21494-21sh11:58:373
2979499331,3cyclictest0-21swapper/309:30:153
2979399335,3cyclictest0-21swapper/209:25:462
2979299337,6cyclictest8050irq/56-dwc_otg_08:25:031
2979299336,13cyclictest7850irq/56-dwc_otg11:25:141
2979299332,15cyclictest8050irq/56-dwc_otg_08:51:071
2979299331,25cyclictest27077-21grep12:05:201
29792993310,5cyclictest0-21swapper/111:10:141
29792993310,5cyclictest0-21swapper/111:10:141
296082336,15sleep129735-21latency_hist07:10:051
2979499323,5cyclictest29133-21grep08:35:333
2979499322,5cyclictest0-21swapper/307:20:183
2979499321,8cyclictest25061-21wget10:45:173
2979399325,19cyclictest7950irq/56-dwc_otg_07:30:032
2979399323,14cyclictest0-21swapper/212:00:042
2979299329,11cyclictest8050irq/56-dwc_otg_07:15:191
2979299323,20cyclictest0-21swapper/107:35:551
2979299322,17cyclictest0-21swapper/110:10:251
2979299322,17cyclictest0-21swapper/110:10:251
2979299321,13cyclictest30380-21cat08:40:241
2979299321,11cyclictest0-21swapper/111:59:191
2979499313,14cyclictest37-21rcuc/308:30:303
2979499311,5cyclictest0-21swapper/308:50:213
29794993115,4cyclictest14277-21sh10:31:543
2979499311,3cyclictest8050irq/56-dwc_otg_08:40:183
29794993113,9cyclictest0-21swapper/309:45:303
2979499311,17cyclictest0-21swapper/307:30:213
2979499311,17cyclictest0-21swapper/307:30:213
2979399318,13cyclictest0-21swapper/209:40:042
2979399313,5cyclictest7850irq/56-dwc_otg08:55:272
2979299314,10cyclictest7850irq/56-dwc_otg12:25:221
2979299311,12cyclictest0-21swapper/108:19:141
2979299311,12cyclictest0-21swapper/108:19:141
2979299311,12cyclictest0-21swapper/107:55:201
2979499301,7cyclictest3518-21/usr/sbin/munin08:55:233
2979499301,7cyclictest16186-21wc08:00:283
2979499301,4cyclictest0-21swapper/307:50:043
29794993011,4cyclictest0-21swapper/309:20:063
29794993011,4cyclictest0-21swapper/309:20:063
2979399308,6cyclictest1074-21apt-config08:50:042
2979299302,15cyclictest28308-21fschecks_count08:35:221
2979499291,8cyclictest0-21swapper/307:40:463
29794992912,4cyclictest31656-21aten_rbpower_en07:15:153
2979399291,7cyclictest7850irq/56-dwc_otg07:45:302
2979399291,6cyclictest8283-21wget07:40:182
2979499281,6cyclictest0-21swapper/307:58:423
2979399282,15cyclictest0-21swapper/208:23:282
29793992811,4cyclictest13864-21fschecks_count07:55:202
2979299281,16cyclictest0-21swapper/108:35:031
29793992715,4cyclictest7950irq/56-dwc_otg_07:30:232
29793992715,4cyclictest7950irq/56-dwc_otg_07:30:232
291642273,14sleep30-21swapper/307:05:333
287702276,10sleep20-21swapper/207:05:282
2979399269,5cyclictest7950irq/56-dwc_otg_09:05:032
2979399262,16cyclictest0-21swapper/207:35:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional