You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 10:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sun Aug 09, 2026 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1182022450,3sleep30-21swapper/319:05:133
1182022450,3sleep30-21swapper/319:05:133
1511721720,5sleep31364999cyclictest23:34:533
136469914837,77cyclictest24842-21diskmemload22:10:280
13646991482,121cyclictest0-21swapper/021:20:290
13648991364,32cyclictest0-21swapper/200:25:102
13646991326,99cyclictest7591-21grep22:45:280
136469912876,20cyclictest0-21swapper/000:30:230
13646991233,94cyclictest0-21swapper/021:35:330
13646991143,104cyclictest19310-21ssh23:00:180
13646991122,17cyclictest7850irq/56-dwc_otg_00:00:250
13646991103,84cyclictest0-21swapper/021:25:270
136469911017,8cyclictest22232-21kworker/u8:300:15:120
13646991082,85cyclictest24124-21apt-get00:25:090
13646991074,80cyclictest0-21swapper/021:15:220
13646991064,79cyclictest0-21swapper/023:50:220
136469910456,18cyclictest25463-21/usr/sbin/munin21:10:190
13646991013,77cyclictest0-21swapper/021:45:060
156612990,4sleep115648-21apt-config20:45:021
156612990,4sleep115648-21apt-config20:45:021
1364699992,80cyclictest0-21swapper/022:40:240
13647999711,13cyclictest7750irq/56-dwc_otg22:45:281
64582960,5sleep36264-21latency_hist20:20:033
13647999624,14cyclictest29171-21fschecks_time00:30:211
5252930,1sleep30-21swapper/323:15:573
1364699933,50cyclictest14367-21kworker/0:122:55:300
1364799923,10cyclictest5931-21ntp_states21:25:281
1364799914,10cyclictest19331-21ssh23:00:211
1364699918,74cyclictest0-21swapper/020:45:090
13646999045,23cyclictest12535-21ssh00:10:220
1364799883,16cyclictest7950irq/56-dwc_otg_00:00:261
1364799876,13cyclictest0-21swapper/121:10:201
1364699871,63cyclictest0-21swapper/021:50:100
117052870,5sleep11364799cyclictest22:50:271
13646998624,12cyclictest0-21swapper/019:44:090
13649998512,48cyclictest24483-21ssh00:25:073
1364899833,40cyclictest9577-21kworker/u8:021:15:202
199312800,5sleep31364999cyclictest20:55:193
13646998016,54cyclictest0-21swapper/020:15:180
1364699801,32cyclictest0-21swapper/020:41:050
1364699801,32cyclictest0-21swapper/020:41:050
13646997918,15cyclictest0-21swapper/020:25:300
13647997620,36cyclictest7950irq/56-dwc_otg_00:25:101
13649997511,35cyclictest7850irq/56-dwc_otg_00:30:223
1364899759,32cyclictest7750irq/56-dwc_otg22:10:362
1364699751,33cyclictest2653-21latency_hist20:10:020
13648997413,30cyclictest7950irq/56-dwc_otg_21:25:372
1364799743,13cyclictest1191-21snmpd21:35:331
1364699741,4cyclictest18201-21latency_hist22:20:030
13646997413,13cyclictest29920-21sh22:33:580
1364699736,17cyclictest11282-21iwlist22:50:200
13646997322,11cyclictest23702-21cat22:25:310
13646997317,12cyclictest0-21swapper/023:07:070
1364699731,14cyclictest18272-21rm21:40:250
1364699722,22cyclictest0-21swapper/020:10:220
1364699721,19cyclictest0-21swapper/023:35:020
1364899714,44cyclictest0-21swapper/200:15:132
13646997129,4cyclictest7750irq/56-dwc_otg22:20:050
1364699712,19cyclictest0-21swapper/000:20:180
13646997117,10cyclictest0-21swapper/020:20:240
1364699704,20cyclictest0-21swapper/020:53:500
13646997017,9cyclictest0-21swapper/000:36:440
13646997017,9cyclictest0-21swapper/000:36:440
13646997016,3cyclictest0-21swapper/022:05:160
13646997015,3cyclictest0-21swapper/023:48:360
1364699701,21cyclictest1602-21taskset22:38:550
307952690,1sleep10-21swapper/121:15:501
1364999696,42cyclictest7850irq/56-dwc_otg_23:00:253
1364899693,35cyclictest29075-21fschecks_count00:30:202
13646996930,4cyclictest32668-21unixbench_singl23:15:300
1364699692,22cyclictest0-21swapper/019:57:220
1364699691,28cyclictest0-21swapper/021:58:440
1364699691,25cyclictest0-21swapper/019:34:060
13648996824,14cyclictest16202-21unixbench_singl22:55:312
13646996826,4cyclictest7750irq/56-dwc_otg23:20:160
1364699681,21cyclictest7583-21fschecks_time23:25:180
197612670,5sleep11364799cyclictest22:20:321
13649996725,23cyclictest381ktimersoftd/322:55:353
1364899678,32cyclictest28475-21kernelversion23:50:222
1364899673,30cyclictest19378-21fschecks_count23:00:222
1364799674,30cyclictest1180-21runrttasks00:10:201
13646996717,11cyclictest0-21swapper/019:36:220
1364699671,23cyclictest0-21swapper/020:30:190
1364999669,15cyclictest7750irq/56-dwc_otg21:35:333
1364899661,10cyclictest0-21swapper/219:50:152
13647996618,19cyclictest0-21swapper/122:55:341
1364699662,31cyclictest0-21swapper/023:43:440
255272650,14sleep31364999cyclictest21:10:203
1364999655,35cyclictest0-21swapper/321:20:293
13649996510,34cyclictest0-21swapper/322:10:293
1364899653,39cyclictest4450-21missed_timers00:00:242
13646996513,15cyclictest0-21swapper/019:46:430
10892650,2sleep30-21swapper/323:55:473
1364699648,38cyclictest16607-21grep19:15:310
1364699642,27cyclictest0-21swapper/019:26:210
1364899633,42cyclictest0-21swapper/221:20:322
13648996318,20cyclictest7750irq/56-dwc_otg21:45:052
13646996322,7cyclictest0-21swapper/023:10:150
1364699631,27cyclictest0-21swapper/000:08:160
233852620,2sleep20-21swapper/219:35:272
13649996231,11cyclictest5935-21ssh21:25:293
13649996118,34cyclictest28465-21ssh23:50:213
1364699612,41cyclictest0-21swapper/020:00:300
13646996117,10cyclictest0-21swapper/022:01:070
1364999605,30cyclictest0-21swapper/322:40:253
13648996034,18cyclictest25468-21fschecks_count21:10:202
13648996012,25cyclictest0-21swapper/221:35:332
13646996039,7cyclictest28400-21fschecks_count19:50:210
13646996033,19cyclictest0-21swapper/020:55:070
13649995934,20cyclictest16142-21ssh00:15:123
1364899595,27cyclictest0-21swapper/222:40:242
13647995918,12cyclictest0-21swapper/100:15:141
13647995913,9cyclictest7750irq/56-dwc_otg22:10:281
13647995910,22cyclictest0-21swapper/120:55:071
1364899584,38cyclictest0-21swapper/200:10:232
1364699572,43cyclictest0-21swapper/020:35:300
13647995612,24cyclictest28551-21latency23:50:221
13647995610,10cyclictest7850irq/56-dwc_otg_22:40:241
1364699562,34cyclictest0-21swapper/019:21:110
1364999556,29cyclictest6661-21/usr/sbin/munin22:45:293
13649995515,19cyclictest0-21swapper/300:00:243
1364799559,21cyclictest0-21swapper/121:45:091
13649995412,25cyclictest21614-21ssh21:45:053
1364899548,29cyclictest0-21swapper/219:30:142
13647995413,9cyclictest7750irq/56-dwc_otg21:20:261
1364699541,26cyclictest0-21swapper/019:10:030
1364999538,20cyclictest26728-21sh22:30:143
1364899538,28cyclictest0-21swapper/220:20:092
1364899538,28cyclictest0-21swapper/219:20:152
13646995337,5cyclictest0-21swapper/023:57:330
13646995312,9cyclictest7850irq/56-dwc_otg_21:00:150
1364899528,27cyclictest0-21swapper/220:25:082
1364999518,26cyclictest0-21swapper/320:45:173
1364999517,9cyclictest1191-21snmpd20:05:143
1364999513,27cyclictest7850irq/56-dwc_otg_00:10:213
1364699511,32cyclictest10399-21unixbench-2d21:30:300
1364999508,27cyclictest0-21swapper/321:05:153
1364999508,27cyclictest0-21swapper/321:05:153
1364899508,26cyclictest0-21swapper/220:45:172
1364899504,25cyclictest7950irq/56-dwc_otg_22:45:262
1364799508,29cyclictest0-21swapper/120:20:081
13646995040,3cyclictest0-21swapper/021:10:030
13646995040,3cyclictest0-21swapper/021:10:030
1364699501,47cyclictest19440-21latency_hist23:40:020
1364999498,29cyclictest0-21swapper/319:40:163
1364999498,25cyclictest0-21swapper/320:20:153
13649994917,25cyclictest29700-21grep21:15:203
1364799494,19cyclictest0-21swapper/119:45:141
133172482,38sleep00-21swapper/019:09:150
133172482,38sleep00-21swapper/019:09:150
1364999477,26cyclictest0-21swapper/323:25:143
1364999477,25cyclictest0-21swapper/319:10:173
13649994711,18cyclictest7950irq/56-dwc_otg_20:10:183
1364799472,22cyclictest6149-21ssh22:05:181
13649994516,10cyclictest7950irq/56-dwc_otg_23:35:183
1364899457,23cyclictest0-21swapper/220:55:072
1364799453,35cyclictest0-21swapper/121:44:391
1364999447,23cyclictest17508-21ssh21:40:163
1364999441,29cyclictest29113-21ls19:50:313
1364799448,30cyclictest0-21swapper/120:45:091
1364799436,16cyclictest0-21swapper/122:35:291
1364999427,15cyclictest381ktimersoftd/323:40:273
1364999425,18cyclictest7950irq/56-dwc_otg_22:20:023
1364999423,4cyclictest7850irq/56-dwc_otg_19:35:143
13649994222,4cyclictest7750irq/56-dwc_otg20:35:333
13649994214,8cyclictest7750irq/56-dwc_otg22:25:263
13649994211,15cyclictest10409-21/usr/sbin/munin20:30:293
1364899426,15cyclictest31-21ksoftirqd/220:15:012
13647994220,10cyclictest0-21swapper/120:15:201
63462410,2sleep30-21swapper/323:23:583
1364999418,18cyclictest0-21swapper/319:55:163
13649994118,6cyclictest7850irq/56-dwc_otg_20:25:243
13649994117,9cyclictest7950irq/56-dwc_otg_23:12:373
1364999407,20cyclictest0-21swapper/323:05:163
1364899408,27cyclictest0-21swapper/219:25:172
13648994016,15cyclictest31-21ksoftirqd/220:15:212
13648994011,10cyclictest31-21ksoftirqd/220:35:312
1364799403,9cyclictest0-21swapper/119:25:221
13647994022,5cyclictest18864-21latency_hist19:25:021
224872390,3sleep121-21rcuc/119:35:011
1364999396,17cyclictest7850irq/56-dwc_otg_19:25:213
13649993915,6cyclictest7950irq/56-dwc_otg_22:50:133
1364899396,4cyclictest7850irq/56-dwc_otg_00:00:012
1364899391,3cyclictest7950irq/56-dwc_otg_20:00:182
1364799399,4cyclictest0-21swapper/123:16:521
1364799397,18cyclictest0-21swapper/120:30:091
1364999388,15cyclictest0-21swapper/320:40:153
1364999388,15cyclictest0-21swapper/320:40:153
1364999386,15cyclictest7950irq/56-dwc_otg_00:20:133
1364999385,18cyclictest7950irq/56-dwc_otg_21:58:213
13649993816,8cyclictest7950irq/56-dwc_otg_22:20:193
13649993815,5cyclictest1223-21ntp_kernel_pll_00:35:253
13649993815,5cyclictest1223-21ntp_kernel_pll_00:35:253
13649993813,13cyclictest7850irq/56-dwc_otg_21:30:303
1364899387,27cyclictest30848-21ls19:55:302
1364899386,18cyclictest7950irq/56-dwc_otg_23:25:142
1364899385,24cyclictest7850irq/56-dwc_otg_20:40:222
1364899385,24cyclictest7850irq/56-dwc_otg_20:40:222
1364799389,26cyclictest23860-21ssh23:45:171
1364799388,18cyclictest0-21swapper/120:05:161
13647993821,13cyclictest0-21swapper/100:25:011
1364899372,14cyclictest7750irq/56-dwc_otg22:10:022
1364899371,5cyclictest7950irq/56-dwc_otg_00:35:142
1364899371,5cyclictest7950irq/56-dwc_otg_00:35:142
13648993715,13cyclictest301ktimersoftd/219:40:182
1364799374,6cyclictest0-21swapper/120:00:161
1364799373,13cyclictest0-21swapper/119:37:171
13647993723,8cyclictest221ktimersoftd/100:05:181
13647993715,6cyclictest25653-21unixbench_singl19:40:321
1364999365,24cyclictest37-21rcuc/319:33:373
13649993620,4cyclictest7850irq/56-dwc_otg_22:01:163
13649993619,8cyclictest7850irq/56-dwc_otg_22:06:203
13649993613,8cyclictest7850irq/56-dwc_otg_21:53:043
1364999361,26cyclictest24867-21timerandwakeup23:45:303
1364999361,24cyclictest826-21latency_hist20:05:023
1364899369,18cyclictest7950irq/56-dwc_otg_23:35:162
1364899368,6cyclictest31-21ksoftirqd/219:45:182
1364899367,5cyclictest31-21ksoftirqd/219:10:212
1364899366,15cyclictest7950irq/56-dwc_otg_20:30:292
1364899361,18cyclictest31-21ksoftirqd/200:05:332
13648993611,6cyclictest7850irq/56-dwc_otg_21:50:212
1364799365,8cyclictest8726-21diskstats20:25:191
1364799363,5cyclictest9450irq/48-DMA08:56:171
13647993617,4cyclictest23822-21grep22:25:321
1364999357,12cyclictest7950irq/56-dwc_otg_22:36:353
1364899357,24cyclictest0-21swapper/221:05:152
1364899357,24cyclictest0-21swapper/221:05:152
1364899357,23cyclictest0-21swapper/222:25:172
1364899354,23cyclictest29-21rcuc/222:50:222
1364899354,15cyclictest7850irq/56-dwc_otg_19:15:302
1364899351,6cyclictest27280-21rm23:10:132
1364799358,5cyclictest23-21ksoftirqd/122:05:021
1364799357,11cyclictest0-21swapper/123:35:031
1364799354,6cyclictest0-21swapper/121:00:141
13647993511,11cyclictest0-21swapper/123:35:301
126402357,15sleep10-21swapper/119:05:281
126402357,15sleep10-21swapper/119:05:281
1364999347,11cyclictest7950irq/56-dwc_otg_19:15:273
1364999341,6cyclictest18072-21sort20:50:203
1364899348,5cyclictest20377-21aten_rbpower_en00:20:162
1364899345,20cyclictest23204-21ssh23:05:162
1364899341,6cyclictest7950irq/56-dwc_otg_21:35:022
1364799349,4cyclictest7850irq/56-dwc_otg_20:50:301
1364799349,4cyclictest0-21swapper/121:32:121
1364799342,5cyclictest30947-21cat21:55:291
13647993415,5cyclictest28563-21sh22:31:291
13647993411,4cyclictest0-21swapper/123:20:291
1364999337,5cyclictest7950irq/56-dwc_otg_19:20:313
1364999337,14cyclictest7850irq/56-dwc_otg_21:00:303
1364899337,15cyclictest0-21swapper/221:40:162
1364899336,7cyclictest7850irq/56-dwc_otg_23:40:232
1364899334,19cyclictest0-21swapper/223:24:372
1364899333,13cyclictest7950irq/56-dwc_otg_22:30:302
1364799339,7cyclictest9550irq/80-mmc019:20:011
1364799336,9cyclictest0-21swapper/123:55:141
1364799333,14cyclictest7850irq/56-dwc_otg_23:10:191
1364799332,14cyclictest7750irq/56-dwc_otg20:35:161
1364799331,17cyclictest1180-21runrttasks00:39:561
1364799331,17cyclictest1180-21runrttasks00:39:561
1364999328,4cyclictest7950irq/56-dwc_otg_19:45:253
1364999321,18cyclictest0-21swapper/300:06:033
1364899328,5cyclictest31-21ksoftirqd/223:15:152
1364899327,6cyclictest0-21swapper/222:22:442
1364899322,20cyclictest0-21swapper/220:08:042
1364899321,5cyclictest24222-21/usr/sbin/munin23:45:212
13648993214,5cyclictest29-21rcuc/221:03:322
1364799322,6cyclictest7950irq/56-dwc_otg_23:05:171
13647993216,5cyclictest28588-21kernelversion19:50:231
13647993210,4cyclictest0-21swapper/123:43:541
1364899316,4cyclictest7950irq/56-dwc_otg_22:35:222
1364899315,22cyclictest7950irq/56-dwc_otg_22:15:132
1364899312,7cyclictest1675-21apt-get22:00:152
1364899312,5cyclictest0-21swapper/221:55:242
1364799316,4cyclictest7750irq/56-dwc_otg23:25:211
1364799314,6cyclictest2738850ssh21:50:551
1364799312,17cyclictest30449-21latency19:55:231
1364799311,16cyclictest0-21swapper/121:05:191
1364799311,16cyclictest0-21swapper/121:05:191
1364899309,4cyclictest0-21swapper/223:30:172
1364899305,4cyclictest7750irq/56-dwc_otg20:50:262
1364799302,17cyclictest15653-21ssh22:15:461
1364799275,3cyclictest0-21swapper/119:10:241
130392263,14sleep20-21swapper/219:05:452
130392263,14sleep20-21swapper/219:05:452
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional