You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 19:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Dec 25, 2025 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
440622850,1sleep00-21swapper/007:05:250
174022980,6sleep0586099cyclictest12:10:220
586099928,26cyclictest0-21swapper/011:45:220
136812900,2sleep00-21swapper/010:30:230
586099847,68cyclictest0-21swapper/010:55:220
5860998026,26cyclictest0-21swapper/010:10:200
279872790,2sleep20-21swapper/208:10:262
279872790,2sleep20-21swapper/208:10:262
228452760,4sleep122833-21latency09:25:281
228452760,4sleep122833-21latency09:25:281
5860997010,14cyclictest0-21swapper/007:18:180
5860997010,14cyclictest0-21swapper/007:18:180
586099686,25cyclictest0-21swapper/012:35:130
586099643,27cyclictest0-21swapper/010:25:170
5862996311,49cyclictest4679-21fschecks_count10:05:262
586099632,32cyclictest25076-21grep08:00:370
136202630,4sleep113619-21tune2fs09:00:241
586099627,36cyclictest0-21swapper/007:45:070
586099626,53cyclictest0-21swapper/012:20:220
586099626,24cyclictest0-21swapper/008:20:230
586299611,12cyclictest17558-21fschecks_time12:10:252
586299611,12cyclictest0-21swapper/207:20:232
586099618,34cyclictest0-21swapper/011:25:170
586099618,34cyclictest0-21swapper/011:25:170
5860996130,5cyclictest25563-21unixbench_singl11:00:370
5860996125,5cyclictest0-21swapper/008:40:190
5860996114,22cyclictest0-21swapper/012:00:190
586299593,15cyclictest11550-21munin-run10:25:082
5862995916,6cyclictest8839-21unixbench_singl07:15:352
5862995916,6cyclictest8839-21unixbench_singl07:15:352
586299591,5cyclictest26456-21/usr/sbin/munin12:35:262
29572590,1sleep20-21swapper/211:30:232
586099582,7cyclictest0-21swapper/008:35:170
586299575,12cyclictest0-21swapper/208:19:042
5862995717,4cyclictest20697-21fschecks_time07:50:252
586199573,17cyclictest15780-21ls12:05:251
586099572,35cyclictest0-21swapper/007:10:340
586299561,5cyclictest2747-21aten_rbpower_vo10:00:222
586299561,5cyclictest2747-21aten_rbpower_vo10:00:222
586099568,28cyclictest10740-21grep08:50:360
586099563,29cyclictest14858-21latency_hist07:35:080
586099561,33cyclictest27303-21grep11:05:360
586299557,10cyclictest7850irq/56-dwc_otg_09:10:322
586299555,5cyclictest7950irq/56-dwc_otg_11:00:232
586299553,10cyclictest0-21swapper/210:30:312
586299551,18cyclictest0-21swapper/211:47:312
586299544,9cyclictest0-21swapper/207:25:292
5862995413,7cyclictest11918-21aten_rbpower_vo11:55:212
586299541,16cyclictest0-21swapper/211:16:582
586299541,11cyclictest13726-21cat07:30:312
5860995435,3cyclictest0-21swapper/010:20:070
5860995433,5cyclictest7850irq/56-dwc_otg_11:50:370
586299532,8cyclictest0-21swapper/209:20:422
586099532,29cyclictest0-21swapper/011:40:250
586099531,6cyclictest29338-21munin-run09:45:070
5860995315,6cyclictest0-21swapper/012:05:190
586099531,31cyclictest0-21swapper/009:00:180
586099531,29cyclictest4725-21fschecks_time10:05:270
586299521,8cyclictest15393-21if_wlan007:35:262
5860995238,4cyclictest7850irq/56-dwc_otg_08:50:090
586099522,40cyclictest0-21swapper/010:40:290
586099521,31cyclictest3681-21ls10:00:360
586099521,31cyclictest3681-21ls10:00:360
47702526,31sleep20-21swapper/207:05:322
5860995124,5cyclictest20145-21unixbench_singl10:45:350
586099512,28cyclictest19110-21aten_rbpower_po12:15:220
5860995121,16cyclictest0-21swapper/009:45:090
586099511,13cyclictest0-21swapper/012:00:080
586299501,17cyclictest0-21swapper/210:57:342
5860995031,7cyclictest7750irq/56-dwc_otg07:35:360
5860995021,14cyclictest17379-21grep09:10:280
5860995017,17cyclictest23763-21grep08:00:080
586099501,27cyclictest0-21swapper/010:40:080
586099501,27cyclictest0-21swapper/010:40:080
586299491,6cyclictest29070-21runrttasks09:42:042
586099494,7cyclictest0-21swapper/007:20:210
586099494,42cyclictest0-21swapper/012:25:220
5860994919,9cyclictest0-21swapper/008:10:200
5860994919,9cyclictest0-21swapper/008:10:200
586099491,31cyclictest914-21seq09:55:220
586099491,29cyclictest18607-21aten_rbpower_cu07:45:220
586299489,3cyclictest7950irq/56-dwc_otg_12:05:252
586299483,9cyclictest15215-21cpu09:05:212
586299481,7cyclictest1124-21snmpd09:15:272
586099488,24cyclictest4865-21fschecks_count11:35:240
586099482,34cyclictest0-21swapper/011:10:210
5860994821,4cyclictest24671-21aten_rbpower_vo12:30:240
586099482,12cyclictest0-21swapper/007:25:180
5860994818,15cyclictest7950irq/56-dwc_otg_11:15:370
5860994818,15cyclictest20953-21if_eth009:20:260
586099481,30cyclictest0-21swapper/010:50:360
586099481,28cyclictest29507-21cpu08:15:220
586399477,25cyclictest0-21swapper/310:20:233
586299478,3cyclictest0-21swapper/209:35:272
586199475,7cyclictest7750irq/56-dwc_otg08:30:181
586099473,27cyclictest0-21swapper/009:28:200
586099473,27cyclictest0-21swapper/009:28:200
5860994719,13cyclictest31714-21fschecks_count09:50:240
586099471,4cyclictest1707-21grep08:25:350
586399467,24cyclictest0-21swapper/309:25:223
586399467,24cyclictest0-21swapper/309:25:223
586399466,21cyclictest1663-21awk11:25:293
586399466,21cyclictest1663-21awk11:25:293
5863994613,18cyclictest7950irq/56-dwc_otg_07:25:223
586299465,9cyclictest7950irq/56-dwc_otg_07:40:292
5860994616,21cyclictest0-21swapper/009:16:120
586399457,24cyclictest0-21swapper/308:25:203
586399457,24cyclictest0-21swapper/308:00:223
586399457,24cyclictest0-21swapper/307:15:213
586399457,24cyclictest0-21swapper/307:15:213
586399457,23cyclictest0-21swapper/310:25:203
586399456,24cyclictest0-21swapper/312:35:133
586399453,4cyclictest7750irq/56-dwc_otg08:30:193
586299451,6cyclictest31418-21df_inode08:20:262
586199455,16cyclictest0-21swapper/112:15:191
5861994522,4cyclictest21060-21fschecks_count10:50:241
586099452,25cyclictest0-21swapper/010:20:380
586099451,25cyclictest128-21systemd-journal08:33:090
586099451,24cyclictest20946-21missed_timers07:50:280
5860994512,30cyclictest24385-21fschecks_count09:30:260
40572457,27sleep34109-21wget07:05:213
586399447,24cyclictest0-21swapper/312:25:133
586399447,23cyclictest0-21swapper/312:05:203
586399447,23cyclictest0-21swapper/310:40:203
586399447,23cyclictest0-21swapper/310:30:233
586399447,23cyclictest0-21swapper/309:10:213
586399447,22cyclictest0-21swapper/311:30:223
586399447,22cyclictest0-21swapper/310:45:213
586399444,25cyclictest0-21swapper/310:35:203
586399444,25cyclictest0-21swapper/310:35:203
5861994411,9cyclictest0-21swapper/108:05:171
5860994424,3cyclictest0-21swapper/008:55:190
586399438,16cyclictest5197-21processes10:05:343
5863994313,11cyclictest7950irq/56-dwc_otg_07:45:343
5861994322,5cyclictest26130-21idleruntime-cro12:35:081
586099432,23cyclictest0-21swapper/009:09:240
5860994321,4cyclictest27387-21chrt09:38:350
5860994321,3cyclictest0-21swapper/011:20:320
5860994318,5cyclictest13-21rcuc/011:30:280
80602421,4sleep18057-21apt-get10:15:201
586399427,22cyclictest0-21swapper/307:40:203
586399427,22cyclictest0-21swapper/307:10:203
586299426,22cyclictest0-21swapper/212:25:132
586299423,24cyclictest0-21swapper/207:45:222
586299421,19cyclictest0-21swapper/212:24:212
586199427,23cyclictest0-21swapper/112:00:221
586399417,21cyclictest0-21swapper/307:20:223
5863994114,6cyclictest381ktimersoftd/307:30:243
5863994111,17cyclictest7950irq/56-dwc_otg_11:50:353
586299417,24cyclictest0-21swapper/212:00:222
586299413,7cyclictest0-21swapper/208:05:172
586199417,21cyclictest0-21swapper/108:45:211
586399409,16cyclictest0-21swapper/312:10:213
586399404,13cyclictest1124-21snmpd12:00:193
586399403,7cyclictest7750irq/56-dwc_otg09:45:193
5863994014,6cyclictest3251-21sed10:00:303
5863994014,6cyclictest3251-21sed10:00:303
586299407,7cyclictest0-21swapper/208:30:182
5861994019,5cyclictest5110-21latency11:35:271
5860994016,15cyclictest0-21swapper/008:06:440
586399397,23cyclictest0-21swapper/310:55:223
586399392,5cyclictest7850irq/56-dwc_otg_11:15:213
5863993919,8cyclictest7950irq/56-dwc_otg_09:18:183
586299397,4cyclictest19225-21cut10:45:242
586199394,8cyclictest7850irq/56-dwc_otg_11:45:201
5861993924,6cyclictest7950irq/56-dwc_otg_09:05:211
586399388,25cyclictest0-21swapper/309:55:213
586399381,24cyclictest0-21swapper/311:10:253
5863993811,11cyclictest19615-21/usr/sbin/munin12:15:293
586299389,17cyclictest7950irq/56-dwc_otg_08:40:342
586299381,24cyclictest24671-21latency09:30:292
586199387,22cyclictest0-21swapper/111:50:221
586199381,6cyclictest7750irq/56-dwc_otg09:55:211
586399379,14cyclictest7950irq/56-dwc_otg_11:00:363
586399377,21cyclictest0-21swapper/309:00:143
586299371,12cyclictest0-21swapper/210:38:572
586299371,12cyclictest0-21swapper/210:38:572
586199372,6cyclictest7950irq/56-dwc_otg_08:25:181
5861993716,4cyclictest6907-21timerandwakeup08:40:341
586199371,29cyclictest27939-21ls08:10:261
586199371,29cyclictest27939-21ls08:10:261
586399362,5cyclictest27577-21/usr/sbin/munin08:10:263
586399362,5cyclictest27577-21/usr/sbin/munin08:10:263
586399362,22cyclictest322-21chrt09:52:113
586399361,4cyclictest7750irq/56-dwc_otg12:30:203
5863993614,10cyclictest7950irq/56-dwc_otg_08:18:393
5863993613,9cyclictest21585-21ls09:20:353
586399361,25cyclictest8375-21cut10:15:253
586399361,20cyclictest13131-21apt-config09:00:093
586199367,14cyclictest7950irq/56-dwc_otg_07:20:371
586199362,18cyclictest0-21swapper/109:00:091
5861993615,6cyclictest8357-21/usr/sbin/munin07:15:291
5861993615,6cyclictest8357-21/usr/sbin/munin07:15:291
586199361,25cyclictest27147-21timerandwakeup11:05:341
586199361,24cyclictest28327-21missed_timers09:40:291
586399351,14cyclictest7850irq/56-dwc_otg_11:45:283
586299356,14cyclictest0-21swapper/211:50:222
586299351,24cyclictest0-21swapper/209:55:212
586299351,22cyclictest0-21swapper/211:35:202
586199357,24cyclictest0-21swapper/111:55:201
586199352,27cyclictest7950irq/56-dwc_otg_11:20:191
5861993513,5cyclictest19239-21latency09:15:271
586399343,11cyclictest0-21swapper/308:50:363
586399342,23cyclictest27022-21chrt08:06:123
586399342,12cyclictest21504-21sshd07:50:353
5863993410,11cyclictest14944-21taskset07:35:173
586299348,5cyclictest7950irq/56-dwc_otg_08:55:362
586299348,13cyclictest29719-21latency_hist11:15:092
586299341,15cyclictest0-21swapper/209:47:172
586199346,11cyclictest7950irq/56-dwc_otg_07:40:341
586199345,13cyclictest7950irq/56-dwc_otg_11:20:091
586199341,5cyclictest9582-21/usr/sbin/munin08:50:271
274572340,2sleep10-21swapper/112:35:351
216392340,2sleep10-21swapper/112:20:331
586399337,22cyclictest0-21swapper/309:40:213
586399337,14cyclictest0-21swapper/310:50:203
586399336,15cyclictest0-21swapper/312:20:223
586399335,11cyclictest0-21swapper/309:05:103
586399331,21cyclictest25149-21ls09:30:363
586299332,14cyclictest0-21swapper/210:16:022
586299332,13cyclictest0-21swapper/209:26:502
586299332,13cyclictest0-21swapper/209:26:502
586299331,25cyclictest26440-21cut11:05:242
586299331,15cyclictest0-21swapper/208:35:172
586199337,13cyclictest7950irq/56-dwc_otg_08:40:081
586199335,7cyclictest7950irq/56-dwc_otg_10:55:251
5861993317,5cyclictest21940-21idleruntime-cro07:55:081
189782330,5sleep1586199cyclictest10:45:181
586399327,15cyclictest0-21swapper/307:55:193
586399323,20cyclictest0-21swapper/308:49:013
586299324,16cyclictest0-21swapper/208:45:212
586299323,19cyclictest0-21swapper/211:40:342
586299322,15cyclictest7950irq/56-dwc_otg_09:00:212
586199325,8cyclictest30963-21latency_hist08:20:081
586199325,16cyclictest7950irq/56-dwc_otg_11:10:241
586199324,16cyclictest24275-21fschecks_time08:00:261
586199321,14cyclictest7950irq/56-dwc_otg_09:35:321
4952320,1sleep30-21swapper/308:25:083
586399318,3cyclictest0-21swapper/311:42:083
586399315,4cyclictest0-21swapper/308:35:343
586399315,10cyclictest1124-21snmpd11:25:073
586399311,15cyclictest27623-21taskset11:08:333
5862993112,6cyclictest6047-21cpu07:10:212
586299311,26cyclictest18932-21ls10:45:082
586199318,5cyclictest21-21rcuc/109:30:351
586199318,5cyclictest12398-21missed_timers10:25:281
586199313,8cyclictest7492-21sed11:40:331
586199313,13cyclictest7950irq/56-dwc_otg_10:35:081
586199312,20cyclictest0-21swapper/110:03:261
586199312,20cyclictest0-21swapper/110:03:261
586199312,11cyclictest0-21swapper/107:45:261
5861993115,5cyclictest3584-21processes11:30:331
586199311,4cyclictest0-21swapper/107:10:241
5861993114,11cyclictest144232chrt07:31:371
586199311,19cyclictest15549-21missed_timers07:35:281
586399307,3cyclictest0-21swapper/311:36:293
586299307,9cyclictest7950irq/56-dwc_otg_07:55:192
586299306,14cyclictest0-21swapper/211:25:202
586299306,14cyclictest0-21swapper/211:25:202
5862993019,4cyclictest32492-21switchtime11:20:332
586299301,4cyclictest0-21swapper/210:50:322
586299301,20cyclictest0-21swapper/208:02:242
586299301,14cyclictest1125-21runrttasks08:27:422
586199307,12cyclictest7750irq/56-dwc_otg10:20:271
586199305,16cyclictest0-21swapper/112:10:291
586199302,5cyclictest7750irq/56-dwc_otg11:25:171
586199302,5cyclictest7750irq/56-dwc_otg11:25:171
586199302,4cyclictest7750irq/56-dwc_otg09:45:351
586199301,5cyclictest7850irq/56-dwc_otg_10:05:371
586199301,19cyclictest0-21swapper/110:44:041
586199301,12cyclictest7950irq/56-dwc_otg_07:55:231
586399298,5cyclictest0-21swapper/310:14:043
586399298,10cyclictest27233-21seq09:36:423
586299294,6cyclictest7950irq/56-dwc_otg_08:50:252
586199299,13cyclictest32069-21missed_timers09:50:291
586199296,10cyclictest7750irq/56-dwc_otg07:25:321
586199295,7cyclictest15639-21fschecks_count10:35:241
586199295,7cyclictest15639-21fschecks_count10:35:241
586199295,4cyclictest7950irq/56-dwc_otg_08:20:381
586199293,17cyclictest0-21swapper/112:28:171
586199292,9cyclictest0-21swapper/110:10:221
5861992923,4cyclictest16945-21aten_rbpower_cu09:10:221
586199291,13cyclictest7750irq/56-dwc_otg11:00:261
586399288,5cyclictest13021-21taskset11:55:473
586299286,12cyclictest7950irq/56-dwc_otg_12:15:282
586299282,4cyclictest7750irq/56-dwc_otg12:35:082
586299281,5cyclictest7412-21sed10:10:362
586199282,6cyclictest7750irq/56-dwc_otg09:21:221
586399272,5cyclictest0-21swapper/308:40:293
586299277,10cyclictest12309-21chrt10:25:262
40332273,16sleep10-21swapper/107:05:141
586299261,4cyclictest32523-21ls09:50:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional