You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 14:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Mon Dec 29, 2025 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1804025010,5sleep00-21swapper/007:10:100
1804025010,5sleep00-21swapper/007:10:100
170662930,4sleep10-21swapper/107:05:341
170662930,4sleep10-21swapper/107:05:341
217872910,2sleep10-21swapper/111:45:351
99462870,5sleep01819699cyclictest08:15:350
1819699773,48cyclictest0-21swapper/007:10:120
1819799735,26cyclictest7750irq/56-dwc_otg10:25:381
1819799727,53cyclictest0-21swapper/109:30:251
1819899693,10cyclictest18200-21chrt07:10:122
18197996917,5cyclictest20315-21latency_hist10:15:101
1819699661,40cyclictest11518-21ls09:50:250
307772640,2sleep20-21swapper/212:10:362
1819899642,14cyclictest0-21swapper/212:20:102
1819699641,24cyclictest0-21swapper/007:40:240
1819899637,34cyclictest0-21swapper/211:15:222
18196996322,14cyclictest0-21swapper/011:05:200
274262620,2sleep00-21swapper/010:35:100
1819899626,13cyclictest488-21grep10:50:102
1819799627,17cyclictest7850irq/56-dwc_otg_10:50:091
1819699611,14cyclictest0-21swapper/010:15:360
1819899595,4cyclictest7850irq/56-dwc_otg_09:00:302
18198995913,39cyclictest28579-21users09:05:392
1819899591,11cyclictest0-21swapper/208:55:222
18198995910,5cyclictest26032-21taskset11:59:332
1819899585,5cyclictest9450irq/48-DMA10:44:552
1819899575,9cyclictest31684-21/usr/sbin/munin07:45:362
1819899575,9cyclictest31684-21/usr/sbin/munin07:45:362
1819899571,18cyclictest0-21swapper/210:55:322
1819899571,10cyclictest0-21swapper/208:50:332
1819699576,12cyclictest1103-21ls07:50:350
278952560,2sleep0101ktimersoftd/010:35:270
1819999561,14cyclictest7750irq/56-dwc_otg12:00:233
1819899561,5cyclictest7950irq/56-dwc_otg_08:04:522
1819899561,13cyclictest9835-21fschecks_time09:45:272
1819899561,12cyclictest0-21swapper/212:20:312
18196995634,12cyclictest25886-21kworker/0:012:00:310
1819699561,34cyclictest0-21swapper/010:50:100
1819899551,5cyclictest13428-21apt-config11:25:102
1819899551,18cyclictest0-21swapper/210:25:372
1819899551,13cyclictest0-21swapper/210:50:262
1819899551,13cyclictest0-21swapper/210:50:262
1819799553,26cyclictest0-21swapper/107:10:121
1819899544,4cyclictest7950irq/56-dwc_otg_11:25:142
1819899542,12cyclictest128-21systemd-journal09:58:242
1819899542,12cyclictest128-21systemd-journal09:58:242
1819899541,8cyclictest0-21swapper/208:15:112
1819899541,11cyclictest0-21swapper/207:57:112
1819899541,10cyclictest0-21swapper/208:12:222
1819899536,4cyclictest7950irq/56-dwc_otg_09:40:102
1819899535,10cyclictest7950irq/56-dwc_otg_11:38:312
1819899532,16cyclictest0-21swapper/209:50:242
1819899531,12cyclictest0-21swapper/210:45:002
18197995331,5cyclictest10242-21ls08:15:391
18196995331,4cyclictest21987-21taskset08:50:210
1819699531,29cyclictest11831-21wget11:20:240
18196995312,23cyclictest11314-21fschecks_count08:20:270
1819699531,13cyclictest0-21swapper/009:30:250
1819899524,8cyclictest18267-21sshd10:09:372
1819899521,16cyclictest0-21swapper/208:42:362
1819899521,13cyclictest0-21swapper/210:36:512
1819899521,13cyclictest0-21swapper/207:34:222
1819799524,19cyclictest7850irq/56-dwc_otg_09:15:241
18197995215,23cyclictest0-21swapper/108:50:231
1819699527,25cyclictest17212-21cat11:35:100
18196995229,6cyclictest18887-21modprobe11:40:090
1819699522,6cyclictest7850irq/56-dwc_otg_09:20:230
18196995222,7cyclictest7850irq/56-dwc_otg_07:50:100
18196995222,7cyclictest7850irq/56-dwc_otg_07:50:100
1819899511,17cyclictest0-21swapper/208:22:442
1819899511,14cyclictest0-21swapper/211:11:422
1819799517,26cyclictest0-21swapper/112:05:231
18196995125,6cyclictest7750irq/56-dwc_otg07:20:250
1819699511,27cyclictest7073-21sed09:35:400
1819999505,6cyclictest7950irq/56-dwc_otg_07:30:213
1819899501,4cyclictest0-21swapper/210:20:102
1819899501,13cyclictest5798-21sshd11:03:372
1819899501,13cyclictest0-21swapper/212:31:382
1819799508,6cyclictest0-21swapper/112:30:101
1819999491,5cyclictest7850irq/56-dwc_otg_10:20:213
1819899498,24cyclictest0-21swapper/209:15:242
1819899491,15cyclictest0-21swapper/208:30:152
1819899491,15cyclictest0-21swapper/208:30:152
1819899491,10cyclictest7850irq/56-dwc_otg_07:52:062
18196994931,12cyclictest1914-21kworker/0:010:55:260
18196994924,3cyclictest0-21swapper/008:10:290
1819699492,27cyclictest0-21swapper/007:35:260
18196994921,4cyclictest0-21swapper/009:25:370
18196994918,6cyclictest32022-21fschecks_time12:15:290
1819699491,28cyclictest20239-21grep11:40:410
1819699491,25cyclictest28197-21aten_rbpower_en12:05:230
1819899481,6cyclictest18235-21cat08:40:102
1819899481,14cyclictest0-21swapper/207:37:122
1819899481,12cyclictest0-21swapper/211:47:352
1819899481,10cyclictest19867-21chrt10:11:582
1819699481,5cyclictest9308-21sh09:45:100
1819699481,27cyclictest17440-21ntpq10:05:320
1819699481,25cyclictest20062-21aten_rbpower_cu07:15:240
18196994722,7cyclictest23713-21aten_rbpower_en07:25:240
18196994718,22cyclictest0-21swapper/011:53:090
18196994716,22cyclictest0-21swapper/010:51:490
18196994716,22cyclictest0-21swapper/010:51:490
1819699471,26cyclictest25521-21grep07:30:240
1819699471,20cyclictest0-21swapper/008:40:240
1819899461,6cyclictest23640-21/usr/sbin/munin07:25:212
1819899461,14cyclictest0-21swapper/207:42:582
1819799467,24cyclictest0-21swapper/110:30:261
1819799467,24cyclictest0-21swapper/108:35:241
18197994623,4cyclictest31658-21latency_hist12:15:111
1819799461,8cyclictest26100-21munin-run12:00:101
18197994613,6cyclictest14817-21aten_rbpower_en08:30:261
18197994613,6cyclictest14817-21aten_rbpower_en08:30:261
18196994624,6cyclictest26352-21proc_pri09:00:340
18196994621,6cyclictest7850irq/56-dwc_otg_08:30:330
18196994621,6cyclictest7850irq/56-dwc_otg_08:30:330
18196994616,5cyclictest0-21swapper/010:20:360
18196994615,14cyclictest0-21swapper/010:10:270
1819699461,25cyclictest31909-21ps09:15:350
18196994534,4cyclictest7750irq/56-dwc_otg09:45:370
18196994522,6cyclictest7750irq/56-dwc_otg08:40:090
18196994515,20cyclictest0-21swapper/012:12:300
18196994514,16cyclictest14793-21grep11:25:390
1819699451,29cyclictest5760-21grep08:05:250
1819699451,26cyclictest0-21swapper/009:10:240
1819699451,25cyclictest10737-21grep11:15:330
1819699451,23cyclictest0-21swapper/010:40:230
1819999448,22cyclictest0-21swapper/310:25:253
1819999447,25cyclictest0-21swapper/311:10:163
1819999447,23cyclictest0-21swapper/311:35:243
1819999443,6cyclictest0-21swapper/308:15:223
1819899447,23cyclictest0-21swapper/211:30:242
1819899445,8cyclictest0-21swapper/212:35:222
1819899442,39cyclictest0-21swapper/207:20:282
1819899441,9cyclictest0-21swapper/208:25:242
1819899441,9cyclictest0-21swapper/208:25:242
1819899441,4cyclictest2450-21aten_rbpower_vo09:25:242
1819699443,6cyclictest0-21swapper/010:00:380
18196994422,5cyclictest7850irq/56-dwc_otg_08:55:280
18196994418,4cyclictest13384-21grep08:25:300
18196994418,4cyclictest13384-21grep08:25:300
1819899431,9cyclictest0-21swapper/208:45:282
1819899431,16cyclictest0-21swapper/210:22:542
1819799437,22cyclictest0-21swapper/107:30:241
1819799437,20cyclictest7750irq/56-dwc_otg10:50:281
1819799437,20cyclictest7750irq/56-dwc_otg10:50:281
18197994320,13cyclictest13560-21if_eth009:55:281
18197994320,13cyclictest13560-21if_eth009:55:281
18196994317,11cyclictest0-21swapper/009:58:300
18196994317,11cyclictest0-21swapper/009:58:300
1819699431,5cyclictest21998-21grep11:45:380
18196994315,15cyclictest0-21swapper/007:56:150
18196994314,11cyclictest7950irq/56-dwc_otg_08:50:090
1819699431,2cyclictest0-21swapper/008:00:360
1819699431,24cyclictest24520-21/usr/sbin/munin11:55:320
1819999427,21cyclictest0-21swapper/307:25:243
1819899427,25cyclictest0-21swapper/210:30:262
1819899427,23cyclictest0-21swapper/209:20:232
1819899421,4cyclictest7850irq/56-dwc_otg_07:15:212
1819799422,25cyclictest892-21ntpq07:50:311
1819799422,24cyclictest0-21swapper/109:20:211
1819699427,18cyclictest7512-21cat12:35:380
1819699420,27cyclictest0-21swapper/010:25:260
1819999418,25cyclictest0-21swapper/309:10:163
1819799417,7cyclictest0-21swapper/107:40:231
18196994124,8cyclictest0-21swapper/012:24:090
1819699411,6cyclictest29169-21apt-config09:10:110
1819699411,23cyclictest0-21swapper/011:00:270
33062401,5sleep00-21swapper/012:25:280
18199994017,4cyclictest21741-21latency_hist08:50:093
1819999401,5cyclictest32735-21latency_hist09:20:103
1819899407,21cyclictest0-21swapper/208:05:242
1819799407,23cyclictest0-21swapper/111:25:241
1819799402,6cyclictest27877-21fschecks_time10:35:261
1819799402,21cyclictest0-21swapper/111:10:201
18196994020,3cyclictest0-21swapper/011:10:110
1819999397,8cyclictest7850irq/56-dwc_otg_07:35:223
1819999395,5cyclictest0-21swapper/309:50:213
1819999391,24cyclictest0-21swapper/310:50:153
1819999391,24cyclictest0-21swapper/310:50:153
1819899391,15cyclictest0-21swapper/209:42:472
1819799394,25cyclictest7950irq/56-dwc_otg_12:20:221
1819999382,6cyclictest0-21swapper/308:20:223
18199993817,5cyclictest2819550wget12:05:233
1819999381,24cyclictest30257-21ls10:40:383
1819999381,24cyclictest0-21swapper/309:55:233
1819999381,24cyclictest0-21swapper/309:55:233
18198993821,4cyclictest7966-21latency_hist11:10:112
18198993820,4cyclictest19826-21ntp_states11:40:362
1819899381,16cyclictest0-21swapper/212:25:422
1819799384,26cyclictest7750irq/56-dwc_otg11:40:391
1819799384,23cyclictest7750irq/56-dwc_otg08:25:101
18197993816,6cyclictest6650-21/usr/sbin/munin09:35:351
18196993810,14cyclictest7950irq/56-dwc_otg_12:30:380
1819999377,25cyclictest0-21swapper/311:05:163
1819999377,21cyclictest0-21swapper/308:10:253
1819999377,16cyclictest0-21swapper/311:40:263
1819999373,12cyclictest0-21swapper/307:10:123
1819999371,4cyclictest7850irq/56-dwc_otg_11:25:243
1819999371,20cyclictest20376-21ls07:15:283
18198993713,13cyclictest0-21swapper/209:30:252
1819799377,6cyclictest7950irq/56-dwc_otg_10:20:191
1819799375,20cyclictest7750irq/56-dwc_otg11:20:101
1819799373,23cyclictest7750irq/56-dwc_otg11:00:271
18197993718,4cyclictest26378-21basename12:00:261
18197993715,6cyclictest22704-21switchtime07:20:371
1819799371,3cyclictest0-21swapper/109:00:211
1819999367,24cyclictest0-21swapper/309:35:243
1819999362,4cyclictest0-21swapper/312:38:543
1819899361,17cyclictest0-21swapper/212:04:002
1819899361,15cyclictest0-21swapper/211:52:422
1819799362,3cyclictest0-21swapper/109:40:301
1819799361,9cyclictest6394-21latency_hist12:35:101
1819799361,7cyclictest7968-21latency_hist11:10:111
18197993615,4cyclictest0-21swapper/110:05:281
1819799361,4cyclictest7950irq/56-dwc_otg_08:05:231
1819799361,23cyclictest0-21swapper/108:02:381
1819799361,18cyclictest0-21swapper/111:50:231
18197993610,5cyclictest11215-21latency_hist09:50:111
1819999357,14cyclictest7950irq/56-dwc_otg_08:50:263
18198993514,4cyclictest29754-21latency_hist12:10:102
1819799358,19cyclictest7750irq/56-dwc_otg10:55:331
1819799351,8cyclictest17099-21wc11:35:101
243332340,1sleep10-21swapper/107:25:331
1819999347,22cyclictest0-21swapper/309:45:233
1819999347,22cyclictest0-21swapper/308:30:263
1819999347,22cyclictest0-21swapper/308:30:263
1819999341,22cyclictest20734-21ls10:15:283
1819799348,15cyclictest7850irq/56-dwc_otg_08:55:251
1819799346,21cyclictest7850irq/56-dwc_otg_10:00:381
1819999336,19cyclictest11-21rcu_preempt10:00:243
1819899331,15cyclictest0-21swapper/210:04:102
1819799336,5cyclictest7950irq/56-dwc_otg_08:25:281
1819799336,5cyclictest7950irq/56-dwc_otg_08:25:281
1819799335,13cyclictest28954-21modprobe09:10:101
1819799334,6cyclictest7950irq/56-dwc_otg_09:10:241
1819799332,4cyclictest0-21swapper/108:10:251
18197993312,5cyclictest221ktimersoftd/110:44:261
18197993311,12cyclictest0-21swapper/107:15:381
1819999324,5cyclictest7850irq/56-dwc_otg_09:05:383
18199993217,4cyclictest32665-21/usr/sbin/munin07:50:283
18197993212,8cyclictest19063-21grep11:40:101
1819799321,16cyclictest7750irq/56-dwc_otg07:57:441
1819999317,22cyclictest0-21swapper/310:55:263
1819999317,14cyclictest0-21swapper/307:45:243
1819999317,14cyclictest0-21swapper/307:45:243
1819999312,6cyclictest23035-21fschecks_time11:50:293
18199993113,5cyclictest278992cut10:35:273
1819799316,5cyclictest7750irq/56-dwc_otg09:50:241
1819799316,15cyclictest0-21swapper/110:15:241
1819799315,6cyclictest7950irq/56-dwc_otg_11:20:241
1819799315,6cyclictest32019-21fschecks_count12:15:291
18197993112,5cyclictest19963-21latency_hist08:45:101
1819999308,5cyclictest7850irq/56-dwc_otg_11:30:233
1819999306,14cyclictest7950irq/56-dwc_otg_11:45:323
1819999301,6cyclictest7850irq/56-dwc_otg_11:25:113
1819999301,3cyclictest0-21swapper/309:30:283
1819999301,22cyclictest30280-21ls12:10:283
1819799309,4cyclictest7850irq/56-dwc_otg_09:25:341
1819799303,17cyclictest7750irq/56-dwc_otg08:48:341
1819799302,9cyclictest30951-21wget07:45:241
1819799302,9cyclictest30951-21wget07:45:241
18197993011,12cyclictest8161-21sed12:40:101
177412300,23sleep30-21swapper/307:07:473
177412300,23sleep30-21swapper/307:07:473
143702301,4sleep30-21swapper/308:29:403
143702301,4sleep30-21swapper/308:29:403
1819999297,13cyclictest0-21swapper/311:00:163
1819999296,5cyclictest7850irq/56-dwc_otg_07:40:353
18199992920,6cyclictest6286-21latency_hist12:35:103
1819999291,5cyclictest0-21swapper/312:20:013
1819999291,4cyclictest7950irq/56-dwc_otg_09:25:103
1819999291,23cyclictest24885-21idleruntime11:55:273
1819799294,5cyclictest0-21swapper/107:35:221
1819999283,4cyclictest7850irq/56-dwc_otg_08:40:323
1819999283,16cyclictest0-21swapper/310:14:203
1819999283,10cyclictest7950irq/56-dwc_otg_09:40:333
1819999282,4cyclictest7850irq/56-dwc_otg_10:05:273
1819999282,17cyclictest0-21swapper/312:22:203
1819999281,7cyclictest4949-21grep08:00:373
1819999281,6cyclictest0-21swapper/307:20:323
1819999281,19cyclictest0-21swapper/307:59:113
1819999281,17cyclictest0-21swapper/309:26:123
1819999278,10cyclictest7950irq/56-dwc_otg_08:07:523
1819999275,10cyclictest7950irq/56-dwc_otg_10:33:313
1819999273,3cyclictest7850irq/56-dwc_otg_09:00:273
1819999271,5cyclictest10304-21fschecks_time11:15:263
1819999271,15cyclictest3919-21timerwakeupswit12:25:363
1819999265,9cyclictest7950irq/56-dwc_otg_08:55:323
1819999262,5cyclictest7950irq/56-dwc_otg_10:45:233
176312263,14sleep20-21swapper/207:06:212
176312263,14sleep20-21swapper/207:06:212
1819999254,18cyclictest16927-21idleruntime08:35:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional