You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 08:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Fri May 22, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1166621630,4sleep011668-21rt-features00:05:270
1166621630,4sleep011668-21rt-features00:05:270
1535921140,2sleep00-21swapper/019:15:180
1535921140,2sleep00-21swapper/019:15:180
245392790,2sleep00-21swapper/000:20:370
13161997524,22cyclictest0-21swapper/022:15:150
13161997524,22cyclictest0-21swapper/022:15:150
168512740,2sleep10-21swapper/122:55:151
13162997412,4cyclictest0-21swapper/121:40:011
54502730,4sleep31316499cyclictest21:25:233
211202710,3sleep21316399cyclictest21:44:272
1316199713,50cyclictest0-21swapper/023:40:140
1316499708,50cyclictest8050irq/56-dwc_otg_23:30:163
1316499701,54cyclictest26000-21/usr/sbin/munin19:45:153
1316499701,51cyclictest22059-21taskset21:02:593
1316499701,51cyclictest22059-21taskset21:02:593
1316499694,46cyclictest25387-21apt-get23:05:083
1316499692,43cyclictest0-21swapper/320:45:173
13161996915,27cyclictest8050irq/56-dwc_otg_00:25:160
1316499681,48cyclictest427-21/usr/sbin/munin21:20:123
1316499681,45cyclictest7950irq/56-dwc_otg_00:20:163
1316499671,56cyclictest20588-21unixbench_singl22:20:303
1316299678,44cyclictest8050irq/56-dwc_otg_23:24:421
1316499664,50cyclictest9730-21awk23:25:013
1316199664,44cyclictest0-21swapper/023:35:120
1316499653,49cyclictest28912-21ssh23:47:153
1316499651,46cyclictest8050irq/56-dwc_otg_20:25:013
1316199654,35cyclictest10971-21grep20:30:290
1316499643,49cyclictest5250-21chrt22:03:243
1316499643,46cyclictest11114-21ssh21:31:533
1316499641,52cyclictest6875-21ssh00:40:003
1316499641,52cyclictest6875-21ssh00:40:003
1316499641,51cyclictest907-21df20:05:153
1316499641,43cyclictest0-21swapper/319:27:503
1316299647,10cyclictest8050irq/56-dwc_otg_00:20:171
103732640,2sleep310375-21wc20:30:203
1316499634,47cyclictest9607-21taskset00:03:343
1316499633,49cyclictest9832-21ssh22:45:523
1316299638,6cyclictest0-21swapper/122:40:111
1316299638,43cyclictest8050irq/56-dwc_otg_23:35:021
13161996317,26cyclictest0-21swapper/020:10:110
1316499621,52cyclictest4069-21ssh22:40:143
1316499611,49cyclictest23679-21ssh23:02:423
1316499611,48cyclictest8295-21fschecks_count20:25:193
1316299614,5cyclictest7850irq/56-dwc_otg23:05:021
13162996111,4cyclictest0-21swapper/123:38:171
1316199615,25cyclictest0-21swapper/000:30:130
13161996137,10cyclictest7850irq/56-dwc_otg23:30:220
1316199611,6cyclictest21074-21/usr/sbin/munin23:00:150
1316199611,45cyclictest21778-21grep21:00:300
1316199611,45cyclictest21778-21grep21:00:300
1316499602,49cyclictest0-21swapper/323:26:043
1316499602,46cyclictest0-21swapper/300:16:243
1316499601,48cyclictest3551-21ssh22:39:473
1316499601,45cyclictest18748-21sort00:15:013
1316499601,41cyclictest2487-21diskmemload23:55:133
1316299605,7cyclictest141-21systemd-journal23:50:011
1316299605,4cyclictest8050irq/56-dwc_otg_23:55:151
1316299602,6cyclictest21639-21latency_hist21:45:021
1316299602,5cyclictest24042-21diskmemload22:45:221
13161996030,6cyclictest7950irq/56-dwc_otg_22:25:250
13161996023,7cyclictest8050irq/56-dwc_otg_23:50:160
13161996010,8cyclictest0-21swapper/019:20:130
1316499592,46cyclictest18490-21awk19:25:013
1316499591,50cyclictest15830-21ssh21:37:383
1316499591,45cyclictest23682-21ssh21:46:173
1316499591,45cyclictest23682-21ssh21:46:173
13164995914,36cyclictest18895-21sh22:56:483
1316299599,38cyclictest7850irq/56-dwc_otg21:55:161
1316299594,12cyclictest0-21swapper/122:09:071
1316299591,5cyclictest0-21swapper/122:15:271
1316299591,5cyclictest0-21swapper/122:15:271
1316199591,49cyclictest0-21swapper/023:45:120
127882590,13sleep20-21swapper/219:08:402
71732580,6sleep11316299cyclictest21:27:271
33422580,2sleep20-21swapper/200:35:172
33422580,2sleep20-21swapper/200:35:172
1316499582,42cyclictest217612chrt19:31:033
1316299584,4cyclictest0-21swapper/100:30:541
1316299583,5cyclictest14583-21ssh22:14:481
1316299583,4cyclictest20164-21ssh22:20:261
1316299581,3cyclictest0-21swapper/119:45:191
1316199582,40cyclictest0-21swapper/021:50:160
1316499571,47cyclictest20271-21ssh21:42:593
1316499571,46cyclictest16071-21sh22:54:193
1316499571,45cyclictest31088-21rm21:17:253
1316499571,44cyclictest26885-21ssh22:28:573
1316499571,44cyclictest14346-21ssh22:14:233
1316499571,39cyclictest26875-21rm21:12:323
1316499571,39cyclictest10856-21wget00:05:153
1316499571,39cyclictest10856-21wget00:05:153
1316299575,10cyclictest8050irq/56-dwc_otg_21:17:071
1316299573,6cyclictest18786-21wc00:15:021
1316299571,6cyclictest18584-21wc19:25:011
13161995729,7cyclictest7950irq/56-dwc_otg_23:25:240
1316199572,38cyclictest0-21swapper/000:35:310
1316199572,38cyclictest0-21swapper/000:35:310
1316199571,5cyclictest13-21rcuc/022:05:280
13161995711,9cyclictest0-21swapper/020:50:120
25922560,3sleep32594-21sh20:10:043
1316499562,43cyclictest0-21swapper/322:34:123
1316499561,45cyclictest18563-21chrt20:54:203
1316499561,45cyclictest0-21swapper/323:39:353
1316499561,44cyclictest28150-21ssh21:51:373
1316499561,43cyclictest471-21ssh23:13:503
1316499561,43cyclictest471-21ssh23:13:503
1316299567,10cyclictest0-21swapper/122:25:361
1316299565,9cyclictest7850irq/56-dwc_otg21:54:511
1316299561,6cyclictest15574-21cut20:45:181
1316199566,31cyclictest0-21swapper/019:10:150
1316199566,10cyclictest0-21swapper/021:05:130
1316199562,41cyclictest0-21swapper/019:40:170
118002560,2sleep20-21swapper/223:26:162
1316499555,35cyclictest0-21swapper/323:44:003
1316499551,45cyclictest25467-21seq19:42:233
1316499551,44cyclictest23463-21timerwakeupswit21:05:293
1316499551,43cyclictest0-21swapper/300:31:293
1316499551,42cyclictest5699-21taskset20:16:363
1316499551,42cyclictest5699-21taskset20:16:363
1316499551,40cyclictest0-21swapper/300:28:563
1316499551,37cyclictest0-21swapper/323:19:033
1316299553,3cyclictest7850irq/56-dwc_otg21:20:151
1316299551,5cyclictest8363-21fschecks_time20:25:191
1316299551,5cyclictest7850irq/56-dwc_otg22:04:051
13162995513,5cyclictest1133-21runrttasks23:10:241
13162995513,5cyclictest1133-21runrttasks23:10:241
1316199556,27cyclictest29283-21/usr/sbin/munin21:15:240
13161995514,23cyclictest1133-21runrttasks22:30:250
1316199551,38cyclictest30871-21ls21:55:220
1316199551,38cyclictest20403-21cat22:20:280
1316499541,38cyclictest0-21swapper/323:53:293
13162995417,34cyclictest13230-21idleruntime-cro20:40:011
1316299541,5cyclictest31903-21sh23:50:301
1316299541,4cyclictest0-21swapper/120:51:071
1316299541,17cyclictest0-21swapper/119:35:141
13161995429,5cyclictest16374-21grep20:45:280
1316199542,42cyclictest0-21swapper/020:00:260
1316199542,36cyclictest0-21swapper/020:25:010
1316199541,39cyclictest15177-21fschecks_count00:10:190
1316499531,39cyclictest566-21ssh21:57:413
1316499531,39cyclictest12952-21chrt20:36:573
1316499531,38cyclictest0-21swapper/319:36:443
1316299534,4cyclictest26568-21ls23:05:291
1316299533,8cyclictest9947-21chrt23:25:021
1316299533,36cyclictest0-21swapper/121:31:591
1316299532,4cyclictest5175-21rm00:36:531
1316299532,4cyclictest5175-21rm00:36:531
13162995324,5cyclictest19005-21fschecks_time19:25:191
1316299532,12cyclictest0-21swapper/122:31:491
13162995316,34cyclictest3642-21sh22:39:571
1316299531,5cyclictest7850irq/56-dwc_otg00:25:311
1316299531,4cyclictest0-21swapper/100:19:501
1316299531,3cyclictest0-21swapper/122:54:561
13162995313,4cyclictest22259-21latency_hist21:05:021
13162995313,4cyclictest22259-21latency_hist21:05:021
1316199534,46cyclictest25417-21kworker/0:219:50:140
13161995341,4cyclictest7950irq/56-dwc_otg_23:20:200
1316199533,4cyclictest0-21swapper/022:36:370
1316199532,6cyclictest0-21swapper/021:20:140
1316199532,39cyclictest0-21swapper/020:55:530
1316499521,42cyclictest9687-21ssh22:08:423
1316399527,10cyclictest7950irq/56-dwc_otg_21:05:132
1316399524,13cyclictest0-21swapper/223:50:162
1316299524,3cyclictest7950irq/56-dwc_otg_23:44:301
1316299523,9cyclictest0-21swapper/100:00:211
1316299521,3cyclictest0-21swapper/119:55:291
13162995211,5cyclictest21194-21ntp_kernel_pll_19:30:231
13162995210,4cyclictest23670-21sh21:46:171
13162995210,4cyclictest23670-21sh21:46:171
1316199522,40cyclictest0-21swapper/020:43:080
13161995222,8cyclictest16943-21aten_rbpower_po22:55:170
1316199521,40cyclictest0-21swapper/000:00:200
1316199521,31cyclictest5117-21fschecks_time21:25:190
13161995213,15cyclictest24042-21diskmemload22:50:300
1316199521,30cyclictest0-21swapper/023:18:120
1316499511,41cyclictest0-21swapper/320:59:443
1316499511,36cyclictest8050irq/56-dwc_otg_20:42:473
1316299517,7cyclictest3747-21tail20:10:281
1316299517,3cyclictest0-21swapper/121:11:101
1316299516,8cyclictest8050irq/56-dwc_otg_00:05:131
1316299516,8cyclictest8050irq/56-dwc_otg_00:05:131
1316299513,7cyclictest8050irq/56-dwc_otg_20:22:251
13161995135,9cyclictest20812-21fschecks_time19:30:180
13161995130,7cyclictest29415-21ssh23:10:020
1316199512,38cyclictest0-21swapper/021:44:220
13161995123,19cyclictest0-21swapper/022:00:230
1316199511,39cyclictest0-21swapper/019:35:240
1316199511,36cyclictest8140-21tr20:25:160
1316199511,33cyclictest0-21swapper/000:15:170
1316199511,32cyclictest0-21swapper/021:33:180
1316499501,44cyclictest15848-21proc_pri19:15:263
1316499501,44cyclictest15848-21proc_pri19:15:263
1316499501,39cyclictest17398-21ssh22:17:153
1316499501,39cyclictest17398-21ssh22:17:153
1316399507,28cyclictest0-21swapper/219:50:132
1316399504,7cyclictest7950irq/56-dwc_otg_20:25:142
1316299508,26cyclictest0-21swapper/121:05:151
1316299501,5cyclictest0-21swapper/120:59:461
1316299501,12cyclictest0-21swapper/120:05:161
1316299501,11cyclictest0-21swapper/123:19:081
1316199509,29cyclictest110082sh22:47:550
13161995028,5cyclictest3158-21cat23:55:240
13161995024,5cyclictest8050irq/56-dwc_otg_21:10:190
1316199502,38cyclictest26785-21switchtime19:45:270
13161995020,4cyclictest17202-21modprobe21:40:010
1316199501,13cyclictest0-21swapper/022:40:240
311022491,2sleep00-21swapper/023:10:370
311022491,2sleep00-21swapper/023:10:370
13163994916,5cyclictest8050irq/56-dwc_otg_22:25:152
13161994919,15cyclictest29536-21/usr/sbin/munin19:55:230
1316199491,37cyclictest0-21swapper/020:35:220
1316499481,37cyclictest0-21swapper/320:02:243
1316499481,37cyclictest0-21swapper/319:11:223
1316299482,4cyclictest0-21swapper/119:40:121
1316199481,39cyclictest0-21swapper/021:45:170
1316199481,39cyclictest0-21swapper/021:45:170
1316199481,37cyclictest0-21swapper/022:14:030
105172480,2sleep10-21swapper/120:30:231
1316499472,40cyclictest27816-21cut19:50:143
1316499471,41cyclictest29537-21/usr/sbin/munin19:55:133
1316299473,5cyclictest0-21swapper/120:40:121
1316299472,11cyclictest8050irq/56-dwc_otg_19:50:411
1316299471,12cyclictest0-21swapper/120:02:041
13161994710,19cyclictest0-21swapper/019:25:140
125902472,36sleep00-21swapper/019:06:070
13163994612,25cyclictest0-21swapper/220:55:142
1316299461,4cyclictest8050irq/56-dwc_otg_19:13:531
13161994624,10cyclictest7950irq/56-dwc_otg_20:15:170
13161994624,10cyclictest7950irq/56-dwc_otg_20:15:170
288982450,5sleep21316399cyclictest00:26:032
1316399457,25cyclictest0-21swapper/219:15:152
1316399457,25cyclictest0-21swapper/219:15:152
1316399456,25cyclictest0-21swapper/219:10:152
13163994529,12cyclictest8050irq/56-dwc_otg_22:05:132
13163994516,19cyclictest0-21swapper/222:40:122
1316399447,24cyclictest0-21swapper/222:30:072
1316399437,23cyclictest0-21swapper/222:55:162
1316399432,13cyclictest0-21swapper/220:50:122
1316399431,9cyclictest0-21swapper/219:20:132
1316199431,34cyclictest0-21swapper/020:05:250
1316399427,23cyclictest0-21swapper/220:45:142
1316299425,4cyclictest0-21swapper/120:15:161
1316299425,4cyclictest0-21swapper/120:15:161
1316299421,5cyclictest16376-21runrttasks19:16:391
1316299421,5cyclictest16376-21runrttasks19:16:391
13163994122,12cyclictest13254-21ssh21:35:122
108502391,3sleep20-21swapper/222:10:162
1316399385,5cyclictest7950irq/56-dwc_otg_21:20:142
1316399382,6cyclictest2489-21ssh23:55:132
1316399371,6cyclictest7850irq/56-dwc_otg20:30:122
1316399368,6cyclictest7950irq/56-dwc_otg_19:55:192
1316399368,4cyclictest23540-21sh23:40:302
1316399365,5cyclictest8050irq/56-dwc_otg_21:25:122
13163993614,4cyclictest19798-21sh00:15:252
13163993611,13cyclictest0-21swapper/220:10:082
115812366,17sleep311639-21fschecks_count19:05:263
1316399356,20cyclictest14238-21ssh23:30:152
13163993516,6cyclictest20553-1kworker/u9:223:40:032
1316399351,27cyclictest0-21swapper/223:23:542
1316399351,24cyclictest18677-21latency_hist00:15:012
1316399351,22cyclictest29053-21ls21:15:212
13163993511,7cyclictest13577-21aten_rbpower_vo20:40:152
13163993510,11cyclictest0-21swapper/200:30:232
13163993416,5cyclictest22313-21/usr/sbin/munin19:35:112
1316399341,16cyclictest27109-21/usr/sbin/munin21:50:272
1316399336,5cyclictest27538-21awk23:45:272
1316399335,8cyclictest29709-21ssh23:10:112
1316399335,8cyclictest29709-21ssh23:10:112
1316399332,5cyclictest7950irq/56-dwc_otg_23:05:232
1316399327,21cyclictest0-21swapper/219:40:132
1316399325,4cyclictest0-21swapper/221:12:212
1316399322,11cyclictest7950irq/56-dwc_otg_00:05:142
1316399322,11cyclictest7950irq/56-dwc_otg_00:05:142
13163993214,10cyclictest22222-21kworker/u8:122:04:582
13163993213,5cyclictest20852chrt22:37:132
13163993212,4cyclictest0-21swapper/200:00:232
1316399319,10cyclictest0-21swapper/200:24:592
1316399318,4cyclictest8050irq/56-dwc_otg_23:15:112
1316399317,4cyclictest7950irq/56-dwc_otg_20:00:142
1316399317,11cyclictest0-21swapper/223:00:182
1316399316,5cyclictest7950irq/56-dwc_otg_22:50:152
1316399313,5cyclictest7950irq/56-dwc_otg_19:25:152
1316399311,21cyclictest2368-21dpkg20:10:022
1316399302,3cyclictest7950irq/56-dwc_otg_22:50:012
13163993023,5cyclictest23936-21ssh21:46:442
13163993023,5cyclictest23936-21ssh21:46:442
13163993014,4cyclictest13209-21modprobe20:40:012
1316399299,3cyclictest0-21swapper/221:32:122
1316399295,9cyclictest7950irq/56-dwc_otg_19:45:472
1316399294,4cyclictest7950irq/56-dwc_otg_22:20:232
1316399291,5cyclictest7950irq/56-dwc_otg_20:15:212
1316399291,5cyclictest7950irq/56-dwc_otg_20:15:212
1316399291,4cyclictest0-21swapper/221:00:152
1316399291,4cyclictest0-21swapper/221:00:152
13163992910,4cyclictest0-21swapper/222:15:082
13163992910,4cyclictest0-21swapper/222:15:082
127202283,15sleep10-21swapper/119:07:461
1316399273,9cyclictest7950irq/56-dwc_otg_21:56:072
1316399269,4cyclictest6502-21cut20:20:172
1316399261,7cyclictest20812-21sort19:30:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional