You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 18:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Tue Dec 16, 2025 12:43:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
871299935,31cyclictest6863-21unixbench_multi10:03:190
871299882,52cyclictest1125-21runrttasks07:10:060
871299851,27cyclictest9106-21grep11:40:030
282792850,1sleep30-21swapper/308:03:183
871299801,41cyclictest0-21swapper/009:23:010
8712997826,27cyclictest0-21swapper/011:03:000
8712997821,47cyclictest1125-21runrttasks10:38:120
871499743,11cyclictest0-21swapper/207:10:062
75652720,2sleep10-21swapper/108:38:051
75652720,2sleep10-21swapper/108:38:051
871599686,20cyclictest0-21swapper/310:03:023
8712996829,5cyclictest14851-21aten_rbpower_en10:28:030
871299676,29cyclictest0-21swapper/009:53:030
8713996640,20cyclictest0-21swapper/107:10:061
871499652,12cyclictest23676-21/usr/sbin/munin09:23:192
8713996527,22cyclictest21871-21cat12:15:041
8713996523,20cyclictest26425-21ntpq12:28:111
871299658,34cyclictest0-21swapper/011:17:580
871299657,34cyclictest0-21swapper/007:40:100
871299657,34cyclictest0-21swapper/007:40:100
871499641,16cyclictest0-21swapper/208:43:002
8713996325,21cyclictest32181-21users11:13:181
8713996319,21cyclictest30786-21cut08:13:031
871399627,6cyclictest7750irq/56-dwc_otg10:03:001
871299626,32cyclictest23182-21latency_hist07:50:030
871299626,32cyclictest23182-21latency_hist07:50:030
871299621,9cyclictest14239-21wc08:55:040
8713996123,13cyclictest15726-21cron07:30:031
8713996118,21cyclictest7750irq/56-dwc_otg10:30:041
871299618,5cyclictest0-21swapper/011:47:590
8712996125,10cyclictest0-21swapper/012:08:010
871599605,10cyclictest0-21swapper/308:58:003
8714996015,35cyclictest7850irq/56-dwc_otg_10:03:172
871399608,23cyclictest0-21swapper/109:53:031
871299602,34cyclictest5579-21aten_rbpower_cu08:33:020
871499592,11cyclictest7950irq/56-dwc_otg_09:47:352
871499591,12cyclictest7950irq/56-dwc_otg_08:00:042
871499583,10cyclictest7950irq/56-dwc_otg_07:30:282
871499581,42cyclictest0-21swapper/212:34:032
8713995820,22cyclictest11313-21apt-get11:47:581
8713995818,15cyclictest0-21swapper/109:15:031
871299586,28cyclictest0-21swapper/010:58:020
871299581,33cyclictest22480-21ls09:18:100
871299581,33cyclictest22480-21ls09:18:100
871499572,47cyclictest0-21swapper/209:58:142
871499572,47cyclictest0-21swapper/209:58:142
8713995725,13cyclictest13618-21sed08:53:151
8713995725,12cyclictest26151-21ntpq09:28:101
8713995724,16cyclictest22106-21sshd12:17:441
8712995721,9cyclictest0-21swapper/010:13:020
871299572,10cyclictest7750irq/56-dwc_otg07:58:020
871299571,27cyclictest1455-21grep09:48:170
871499563,10cyclictest7950irq/56-dwc_otg_08:05:042
8713995621,11cyclictest7750irq/56-dwc_otg10:38:081
8713995619,10cyclictest28961-21apt-get08:08:011
871299569,25cyclictest0-21swapper/011:43:160
8712995615,25cyclictest1125-21runrttasks11:33:010
8712995615,25cyclictest1125-21runrttasks11:33:010
871299561,36cyclictest9025-21ls10:10:030
871599552,14cyclictest0-21swapper/311:58:013
871499551,4cyclictest0-21swapper/210:10:042
871499551,12cyclictest0-21swapper/208:18:332
871499551,11cyclictest7850irq/56-dwc_otg_08:13:092
8713995529,12cyclictest11996-21ls08:48:161
8713995522,20cyclictest23931-21/usr/sbin/munin12:23:131
8713995522,20cyclictest23931-21/usr/sbin/munin12:23:131
8713995521,19cyclictest4118-21/usr/sbin/munin09:58:031
8713995521,19cyclictest4118-21/usr/sbin/munin09:58:031
8713995521,11cyclictest18316-21fschecks_time07:38:061
8713995520,18cyclictest23688-21chrt10:51:481
8713995520,18cyclictest23688-21chrt10:51:481
8712995526,5cyclictest10279-21grep08:43:160
871299551,34cyclictest24624-21tail07:53:170
871499542,11cyclictest7950irq/56-dwc_otg_11:10:462
871499541,11cyclictest7950irq/56-dwc_otg_12:36:522
8713995423,12cyclictest23464-21taskset09:20:271
8713995422,16cyclictest1060-21cat08:18:161
8712995415,25cyclictest29464-21aten_rbpower_vo12:38:040
871299541,31cyclictest0-21swapper/007:28:020
871299541,29cyclictest24031-21aten_rbpower_po12:23:020
871299541,29cyclictest24031-21aten_rbpower_po12:23:020
8712995410,9cyclictest28471-21ls12:33:160
871499537,6cyclictest7850irq/56-dwc_otg_08:48:032
871499532,11cyclictest7950irq/56-dwc_otg_10:14:252
8714995318,31cyclictest25685-21seq09:28:032
8714995311,3cyclictest7850irq/56-dwc_otg_11:08:062
8713995323,12cyclictest16400-21df_inode07:33:041
8713995322,12cyclictest21302-21apt-get09:15:081
8713995322,12cyclictest21302-21apt-get09:15:081
871399532,14cyclictest0-21swapper/108:23:031
8713995321,13cyclictest13873-21chrt07:24:361
8712995335,4cyclictest20482-21cut10:43:060
871299532,34cyclictest0-21swapper/007:23:120
871299532,30cyclictest435-21cron10:50:040
871299531,47cyclictest11187-21grep08:48:060
871499523,9cyclictest7950irq/56-dwc_otg_09:36:242
871499521,9cyclictest3269-21tail11:23:172
871499521,8cyclictest0-21swapper/210:43:332
871499521,4cyclictest7950irq/56-dwc_otg_07:17:042
871499521,4cyclictest7950irq/56-dwc_otg_07:17:042
8713995218,23cyclictest27402-21taskset12:31:181
8713995218,20cyclictest29165-21chrt11:07:381
8712995230,5cyclictest32443-21latency_hist09:45:040
8712995229,7cyclictest7950irq/56-dwc_otg_10:35:030
871299521,32cyclictest24868-21unixbench-2d10:53:180
871299521,32cyclictest24868-21unixbench-2d10:53:180
8712995213,20cyclictest16587-21/usr/sbin/munin09:03:060
871299521,31cyclictest31501-21cat11:13:090
871599514,6cyclictest0-21swapper/308:08:023
871599513,10cyclictest7950irq/56-dwc_otg_08:28:013
871499512,8cyclictest7950irq/56-dwc_otg_07:24:452
871499512,3cyclictest0-21swapper/212:17:352
871499512,13cyclictest1125-21runrttasks07:35:302
871499511,6cyclictest7850irq/56-dwc_otg_11:48:052
871499511,5cyclictest18969-21missed_timers10:38:112
871499511,4cyclictest7950irq/56-dwc_otg_08:08:062
871499511,4cyclictest13094-21/usr/sbin/munin11:53:072
871499511,3cyclictest7950irq/56-dwc_otg_11:05:042
8713995122,12cyclictest1803-21grep09:50:041
8713995115,13cyclictest19460-21seq09:09:481
871299518,23cyclictest16050-21grep11:58:170
871299512,28cyclictest17053-21fschecks_time12:03:080
871299512,24cyclictest18135-21/usr/sbin/munin09:07:590
8712995121,14cyclictest3735-21/usr/sbin/munin08:28:130
871299511,29cyclictest13570-21missed_timers10:23:120
871499502,9cyclictest15490-21unixbench_multi07:28:172
871499502,5cyclictest0-21swapper/211:40:032
871499502,3cyclictest7950irq/56-dwc_otg_09:15:152
871499502,3cyclictest7950irq/56-dwc_otg_09:15:152
871499501,9cyclictest0-21swapper/208:24:112
8714995010,4cyclictest26610-21timerwakeupswit10:58:162
8713995017,13cyclictest13914-21/usr/sbin/munin11:53:141
8713995016,12cyclictest14542-21/usr/sbin/munin08:58:001
8713995012,14cyclictest24912-21latency_hist07:55:031
8712995024,6cyclictest17530-21sh07:35:030
871299502,26cyclictest0-21swapper/009:33:130
871299501,32cyclictest0-21swapper/007:38:010
871299501,28cyclictest0-21swapper/011:28:130
8712995011,21cyclictest0-21swapper/009:28:090
871599491,25cyclictest0-21swapper/308:18:033
871499494,7cyclictest7950irq/56-dwc_otg_10:19:232
871499493,7cyclictest0-21swapper/211:30:042
871499492,10cyclictest31974-21date09:43:162
871499492,10cyclictest0-21swapper/210:22:042
871499491,9cyclictest0-21swapper/211:56:072
871499491,8cyclictest0-21swapper/211:43:002
871499491,4cyclictest27396-21apt-get09:33:022
871499491,3cyclictest7950irq/56-dwc_otg_12:23:192
871499491,3cyclictest7950irq/56-dwc_otg_12:23:192
8714994911,4cyclictest17306-21missed_timers12:03:122
8713994922,11cyclictest1124-21snmpd07:46:311
8713994922,11cyclictest1124-21snmpd07:46:311
8713994918,18cyclictest128-21systemd-journal08:31:401
8713994916,21cyclictest0-21swapper/111:05:041
8713994916,20cyclictest2021-21chrt11:21:061
8712994927,5cyclictest7850irq/56-dwc_otg_08:40:040
8712994927,5cyclictest7850irq/56-dwc_otg_08:40:040
871499481,9cyclictest7850irq/56-dwc_otg_07:43:032
871499481,9cyclictest7850irq/56-dwc_otg_07:43:032
871499481,5cyclictest7950irq/56-dwc_otg_10:46:162
8714994814,31cyclictest2322-21cpuspeed09:53:042
8713994816,13cyclictest31371-21if_err_eth009:43:071
8713994813,21cyclictest29198-21taskset12:36:201
8713994813,13cyclictest0-21swapper/111:18:401
8713994812,21cyclictest0-21swapper/111:57:171
8712994821,14cyclictest0-21swapper/009:38:060
8712994818,18cyclictest27118-21grep12:30:030
871299481,29cyclictest15705-21unixbench_singl08:58:170
871299481,25cyclictest22809-21ntp_kernel_pll_12:18:110
871499474,7cyclictest7850irq/56-dwc_otg_08:40:042
871499474,7cyclictest7850irq/56-dwc_otg_08:40:042
871499471,9cyclictest0-21swapper/207:46:402
871499471,9cyclictest0-21swapper/207:46:402
871499471,7cyclictest0-21swapper/209:01:272
871499471,3cyclictest7950irq/56-dwc_otg_11:34:372
871499471,3cyclictest7950irq/56-dwc_otg_11:34:372
871399474,8cyclictest0-21swapper/107:18:011
871399474,8cyclictest0-21swapper/107:18:011
8713994717,12cyclictest16570-21taskset12:01:191
8713994714,12cyclictest16798-21awk10:33:051
8713994713,10cyclictest0-21swapper/111:39:491
8713994712,15cyclictest7850irq/56-dwc_otg_10:25:031
871299474,36cyclictest0-21swapper/008:18:010
871299472,5cyclictest30104-21grep08:08:180
871499469,4cyclictest4756-21/usr/sbin/munin08:28:162
871499463,7cyclictest0-21swapper/212:28:032
871499461,8cyclictest19506-21apt09:10:032
871499461,12cyclictest0-21swapper/210:54:182
871499461,12cyclictest0-21swapper/210:54:182
871399467,25cyclictest0-21swapper/109:30:081
8713994616,10cyclictest0-21swapper/111:34:331
8713994616,10cyclictest0-21swapper/111:34:331
8713994613,18cyclictest0-21swapper/109:01:271
871299464,6cyclictest0-21swapper/009:58:000
871299464,6cyclictest0-21swapper/009:58:000
871299462,22cyclictest0-21swapper/011:23:180
871599451,4cyclictest0-21swapper/309:13:033
871499454,25cyclictest7850irq/56-dwc_otg_08:33:022
871499453,5cyclictest0-21swapper/211:17:592
871499451,11cyclictest0-21swapper/210:33:082
8714994510,4cyclictest23941-21if_wlan007:53:082
871399452,7cyclictest0-21swapper/110:18:021
8713994524,11cyclictest18403-21sshd12:06:441
8713994515,14cyclictest9250-21taskset10:11:351
8713994512,12cyclictest20007-21taskset10:40:431
871299455,30cyclictest13-21rcuc/012:13:190
871499442,6cyclictest15901-21unixbench_multi10:28:172
871499442,13cyclictest0-21swapper/208:50:442
8713994416,15cyclictest0-21swapper/108:02:171
8713994415,11cyclictest7378-21chrt10:05:481
8713994414,11cyclictest0-21swapper/109:36:201
8712994433,4cyclictest11787-21missed_timers10:18:120
8712994422,3cyclictest0-21swapper/008:13:110
69072443,35sleep00-21swapper/007:05:340
8713994317,6cyclictest9611-21aten_rbpower_vo11:43:041
8713994315,13cyclictest19736-21chrt07:41:021
8713994315,13cyclictest19736-21chrt07:41:021
8712994320,14cyclictest0-21swapper/008:22:190
8712994317,13cyclictest0-21swapper/011:52:250
871599427,21cyclictest0-21swapper/311:25:093
871499421,12cyclictest0-21swapper/208:58:042
8713994215,18cyclictest0-21swapper/107:56:531
8713994213,10cyclictest9450irq/48-DMA09:42:411
8713994212,12cyclictest0-21swapper/108:26:281
871299421,18cyclictest29318-21aten_rbpower_vo11:08:030
871599417,25cyclictest0-21swapper/312:03:043
871599417,25cyclictest0-21swapper/308:48:023
871599417,24cyclictest0-21swapper/311:13:033
8715994121,5cyclictest37-21rcuc/312:28:033
8713994111,10cyclictest21990-21/usr/sbin/munin10:48:121
871299411,22cyclictest1125-21runrttasks08:00:160
193062410,3sleep319309-21processes12:08:143
871599407,24cyclictest0-21swapper/308:38:033
871599407,24cyclictest0-21swapper/308:38:033
871599401,3cyclictest7950irq/56-dwc_otg_07:33:023
8714994010,3cyclictest21118-21sed09:13:172
8713994014,10cyclictest0-21swapper/108:43:001
8713994010,14cyclictest0-21swapper/110:57:111
871599397,24cyclictest0-21swapper/309:30:083
871599397,21cyclictest0-21swapper/311:08:023
8715993913,6cyclictest7850irq/56-dwc_otg_07:18:063
8715993913,6cyclictest7850irq/56-dwc_otg_07:18:063
871499391,9cyclictest1125-21runrttasks12:12:132
871299391,20cyclictest10839-21cut07:18:020
871299391,20cyclictest10839-21cut07:18:020
871599385,7cyclictest7950irq/56-dwc_otg_07:28:173
8712993815,15cyclictest0-21swapper/009:10:080
871599373,12cyclictest0-21swapper/307:10:073
871599371,22cyclictest7345-21ls11:35:033
871599371,22cyclictest7345-21ls11:35:033
871599365,5cyclictest25111-21head12:23:163
871599365,5cyclictest25111-21head12:23:163
871599356,14cyclictest7950irq/56-dwc_otg_12:13:043
871599354,6cyclictest0-21swapper/308:23:043
871599354,12cyclictest7950irq/56-dwc_otg_10:25:043
871599352,6cyclictest7850irq/56-dwc_otg_10:33:083
871499351,13cyclictest0-21swapper/212:06:502
871599347,9cyclictest8711-21cyclictest10:13:013
871599347,14cyclictest7950irq/56-dwc_otg_11:18:153
871599346,13cyclictest7950irq/56-dwc_otg_09:28:063
871599345,14cyclictest7950irq/56-dwc_otg_10:28:173
871599341,9cyclictest7950irq/56-dwc_otg_07:38:003
871599341,7cyclictest23483-21idleruntime-cro12:20:043
871599341,23cyclictest695-21ls09:48:073
871599337,23cyclictest0-21swapper/311:23:023
871599336,13cyclictest7950irq/56-dwc_otg_10:18:043
871599331,7cyclictest22341-21fschecks_time10:48:083
8715993316,4cyclictest22049-21idleruntime07:48:073
8715993316,4cyclictest22049-21idleruntime07:48:073
871599331,5cyclictest7950irq/56-dwc_otg_11:53:013
871599328,22cyclictest0-21swapper/307:40:093
871599328,22cyclictest0-21swapper/307:40:093
871599326,13cyclictest7950irq/56-dwc_otg_09:23:163
871599322,4cyclictest7950irq/56-dwc_otg_11:43:023
871599321,6cyclictest7850irq/56-dwc_otg_09:20:043
871599321,6cyclictest7850irq/56-dwc_otg_09:20:043
871599321,5cyclictest0-21swapper/308:53:013
871599321,3cyclictest7950irq/56-dwc_otg_07:53:013
871599321,27cyclictest32407-21ls09:45:043
871599321,23cyclictest0-21swapper/311:01:563
871599321,13cyclictest7950irq/56-dwc_otg_07:25:033
871599318,6cyclictest7950irq/56-dwc_otg_12:38:183
871599317,15cyclictest0-21swapper/311:38:023
871599317,15cyclictest0-21swapper/310:58:023
8715993120,4cyclictest18136-21acpi09:07:593
69052313,21sleep30-21swapper/307:05:333
871599307,5cyclictest7950irq/56-dwc_otg_09:01:453
871599307,14cyclictest0-21swapper/308:13:033
871599302,3cyclictest7950irq/56-dwc_otg_09:36:413
8715993022,6cyclictest18387-21/usr/sbin/munin10:38:003
8715993015,10cyclictest39-21ksoftirqd/308:33:003
871599301,22cyclictest28556-21timerwakeupswit12:33:163
84082303,21sleep10-21swapper/107:09:401
871599297,4cyclictest7950irq/56-dwc_otg_09:53:163
871599296,6cyclictest7950irq/56-dwc_otg_10:50:183
871599296,6cyclictest7950irq/56-dwc_otg_10:50:183
871599292,5cyclictest3955-21acpi09:57:593
871599292,5cyclictest3955-21acpi09:57:593
871599292,15cyclictest0-21swapper/310:05:083
871599291,20cyclictest9474-21uniq08:43:063
85192294,13sleep28638-21cat07:10:052
871599286,14cyclictest0-21swapper/310:43:023
871599284,5cyclictest7950irq/56-dwc_otg_11:45:393
871599276,5cyclictest0-21swapper/307:57:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional