You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 10:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Mon Dec 08, 2025 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
41402870,2sleep00-21swapper/020:45:300
2009998630,13cyclictest3298-21ssh00:30:250
143102860,1sleep10-21swapper/123:17:161
143102860,1sleep10-21swapper/123:17:161
2009998472,5cyclictest0-21swapper/022:46:340
2009998227,8cyclictest0-21swapper/022:10:270
60232770,1sleep10-21swapper/121:42:151
200999772,43cyclictest0-21swapper/000:05:270
2009997723,12cyclictest0-21swapper/019:25:270
2009997628,12cyclictest0-21swapper/023:00:270
176152760,5sleep2201199cyclictest23:21:122
138032760,1sleep30-21swapper/321:52:273
200999753,41cyclictest0-21swapper/023:30:280
29002740,5sleep00-21swapper/000:30:140
200999723,66cyclictest101ktimersoftd/021:20:160
2009997219,11cyclictest0-21swapper/020:10:290
2009997026,12cyclictest0-21swapper/023:15:260
2009997026,12cyclictest0-21swapper/023:15:260
80112690,2sleep37952-21ssh23:50:443
2009996926,23cyclictest0-21swapper/000:35:260
200999681,39cyclictest0-21swapper/019:40:270
2009996811,9cyclictest7950irq/56-dwc_otg_22:20:290
2010996714,23cyclictest0-21swapper/120:10:291
2009996719,30cyclictest22257-21fschecks_count20:05:330
2009996719,30cyclictest22257-21fschecks_count20:05:330
51792650,1sleep30-21swapper/300:32:153
285612650,2sleep128566-21acpi00:20:251
2010996512,46cyclictest0-21swapper/119:10:281
2009996511,31cyclictest0-21swapper/022:05:270
200999646,25cyclictest0-21swapper/020:00:280
2010996217,26cyclictest0-21swapper/123:00:271
200999623,33cyclictest0-21swapper/019:10:170
200999618,32cyclictest19934-21/usr/sbin/munin23:25:270
200999617,39cyclictest7245-21fschecks_time23:50:340
200999612,29cyclictest13149-21wc21:10:160
184922610,6sleep1201099cyclictest21:15:461
201199591,24cyclictest21708-21ssh00:10:262
2009995935,11cyclictest0-21swapper/023:47:480
200999592,9cyclictest29005-21http20:25:140
201099585,33cyclictest0-21swapper/122:20:281
2009995826,19cyclictest0-21swapper/019:35:370
2009995821,25cyclictest0-21swapper/019:50:140
200999572,34cyclictest30892-21apt20:30:150
200999572,23cyclictest22824-21sort22:05:150
200999571,42cyclictest4983-21unixbench_singl19:15:440
200999566,31cyclictest18560-21ssh22:40:380
200999561,30cyclictest22861-21ssh00:10:430
200999561,29cyclictest11043-21fschecks_count23:55:330
200999557,29cyclictest0-21swapper/021:20:210
200999555,6cyclictest0-21swapper/022:25:280
200999554,41cyclictest15288-21ssh22:35:480
200999552,35cyclictest0-21swapper/020:15:280
200999552,27cyclictest16960-21ssh21:15:150
200999551,31cyclictest26461-21unixbench_multi00:15:460
201099547,18cyclictest0-21swapper/121:10:201
201099546,27cyclictest0-21swapper/100:30:271
2010995422,20cyclictest0-21swapper/122:10:271
200999546,4cyclictest0-21swapper/022:50:290
200999545,30cyclictest25104-21grep21:25:300
179802540,6sleep117982-21latency_hist00:05:151
222112530,2sleep10-21swapper/122:45:361
201099534,17cyclictest0-21swapper/100:05:271
2009995327,10cyclictest101ktimersoftd/022:18:480
2009995315,34cyclictest101ktimersoftd/023:14:360
200999531,34cyclictest31667-21wget23:40:310
200999531,33cyclictest0-21swapper/021:45:460
2009995312,12cyclictest0-21swapper/022:55:280
2011995220,20cyclictest29-21rcuc/221:20:212
2010995217,18cyclictest0-21swapper/119:40:281
200999528,27cyclictest0-21swapper/020:55:370
200999527,21cyclictest18099-21ssh23:22:130
2009995223,14cyclictest0-21swapper/019:55:420
200999522,25cyclictest0-21swapper/019:30:470
200999515,31cyclictest0-21swapper/021:54:080
200999513,38cyclictest9-21ksoftirqd/021:56:280
200999511,37cyclictest0-21swapper/000:21:280
200999511,31cyclictest0-21swapper/020:30:430
201099507,26cyclictest0-21swapper/122:50:291
200999505,42cyclictest101ktimersoftd/022:33:020
2009995030,10cyclictest0-21swapper/021:34:190
2009995029,10cyclictest0-21swapper/021:42:390
2009995024,5cyclictest0-21swapper/023:35:280
2011994929,11cyclictest28620-21ssh22:54:292
201099492,14cyclictest0-21swapper/123:35:281
200999498,38cyclictest101ktimersoftd/023:08:480
2009994933,8cyclictest0-21swapper/000:02:120
200999491,40cyclictest0-21swapper/019:50:340
2010994812,26cyclictest0-21swapper/100:35:271
17042483,12sleep00-21swapper/019:09:510
201199477,25cyclictest0-21swapper/219:55:302
201199477,25cyclictest0-21swapper/219:40:202
201099478,9cyclictest7750irq/56-dwc_otg22:05:281
201099473,5cyclictest19341-21ssh22:00:291
2009994722,12cyclictest0-21swapper/021:37:000
188662470,3sleep337-21rcuc/321:16:323
201099467,24cyclictest0-21swapper/120:25:201
201099467,14cyclictest12899-21diskmemload23:30:281
201099464,6cyclictest0-21swapper/120:15:281
200999468,21cyclictest0-21swapper/021:00:150
2009994630,4cyclictest101ktimersoftd/019:20:310
200999461,31cyclictest0-21swapper/020:36:170
201299457,25cyclictest0-21swapper/322:15:213
201199457,23cyclictest0-21swapper/219:35:292
201099456,24cyclictest451-21rs:main1
201099455,24cyclictest0-21swapper/120:30:281
201099452,8cyclictest0-21swapper/123:05:321
200999455,37cyclictest101ktimersoftd/020:52:300
201199447,25cyclictest0-21swapper/223:05:342
201199447,25cyclictest0-21swapper/222:15:292
201199447,23cyclictest0-21swapper/219:10:302
2010994411,18cyclictest0-21swapper/121:45:281
201299437,24cyclictest0-21swapper/320:25:193
201199439,24cyclictest0-21swapper/223:25:302
2011994320,4cyclictest7093-21if_wlan000:35:352
201199431,26cyclictest17403-21cpuspeed21:15:302
228612420,2sleep231-21ksoftirqd/222:05:152
201199427,25cyclictest0-21swapper/220:55:302
201099428,24cyclictest0-21swapper/122:25:201
201099427,7cyclictest17860-21aten_rbpower_cu22:40:291
201099427,23cyclictest0-21swapper/122:35:281
201099421,5cyclictest7750irq/56-dwc_otg20:05:291
201099421,5cyclictest7750irq/56-dwc_otg20:05:291
2009994218,15cyclictest0-21swapper/020:43:410
326032410,1sleep10-21swapper/121:35:221
201299417,24cyclictest0-21swapper/300:10:273
2012994123,7cyclictest31951-21ssh22:58:293
201199417,23cyclictest0-21swapper/219:25:292
2011994124,5cyclictest7950irq/56-dwc_otg_22:55:402
2011994115,7cyclictest13383-21/usr/sbin/munin21:10:302
201099413,23cyclictest0-21swapper/121:05:311
201299407,21cyclictest0-21swapper/320:15:303
2011994017,8cyclictest0-21swapper/222:40:382
2011994014,8cyclictest12899-21diskmemload23:40:302
201099407,18cyclictest7850irq/56-dwc_otg_21:05:141
201099403,14cyclictest23-21ksoftirqd/121:20:381
12952406,22sleep21360-21vmstat19:05:442
201199399,3cyclictest0-21swapper/222:24:262
2010993919,5cyclictest24871-21sh00:15:051
130002390,2sleep20-21swapper/221:50:492
201299386,21cyclictest4617-21ssh23:05:343
201299384,25cyclictest0-21swapper/323:35:293
201299381,26cyclictest4193-21ls19:15:343
201199381,23cyclictest28943-21wget21:30:312
201099387,11cyclictest0-21swapper/123:10:271
2010993823,6cyclictest23-21ksoftirqd/123:25:391
201099381,5cyclictest6890-21ssh23:50:291
201099381,25cyclictest7750irq/56-dwc_otg20:35:361
201299379,15cyclictest31813-21ntp_kernel_pll_20:30:373
201299377,22cyclictest0-21swapper/319:25:293
201299373,27cyclictest7950irq/56-dwc_otg_19:50:283
2012993715,8cyclictest0-21swapper/323:30:433
201199379,6cyclictest7750irq/56-dwc_otg23:50:152
201199378,5cyclictest0-21swapper/223:30:342
201199377,22cyclictest0-21swapper/220:15:302
2011993721,5cyclictest10755-21sh22:30:372
201199371,9cyclictest0-21swapper/219:50:282
2011993716,6cyclictest7850irq/56-dwc_otg_23:35:332
2011993710,5cyclictest0-21swapper/223:15:352
2011993710,5cyclictest0-21swapper/223:15:352
201099372,25cyclictest7750irq/56-dwc_otg23:20:431
201099371,26cyclictest0-21swapper/123:55:281
201299369,13cyclictest7950irq/56-dwc_otg_20:10:463
201299366,6cyclictest7950irq/56-dwc_otg_22:40:433
201299363,16cyclictest0-21swapper/319:30:343
2012993630,4cyclictest12779-21latency_hist19:40:153
201299362,11cyclictest12887-21kworker/u8:421:25:263
2012993618,4cyclictest16396-21latency_hist19:50:153
201299361,16cyclictest2275850ssh22:45:433
201199368,6cyclictest7950irq/56-dwc_otg_22:48:272
201199363,20cyclictest7750irq/56-dwc_otg00:25:342
201099362,5cyclictest0-21swapper/100:15:411
201099361,25cyclictest26007-21timerandwakeup21:25:431
201299357,12cyclictest7950irq/56-dwc_otg_21:40:393
201299356,14cyclictest7950irq/56-dwc_otg_00:25:393
201299353,20cyclictest0-21swapper/321:35:313
201299351,2cyclictest0-21swapper/300:05:263
201199357,21cyclictest0-21swapper/200:20:282
201199355,20cyclictest14561-21ssh00:00:312
201199352,4cyclictest7950irq/56-dwc_otg_21:40:282
201099357,13cyclictest0-21swapper/121:30:411
201099354,21cyclictest7950irq/56-dwc_otg_20:05:151
201099352,8cyclictest0-21swapper/119:50:291
201099351,7cyclictest752-21ssh00:25:461
18462358,15sleep10-21swapper/119:10:161
201299345,8cyclictest0-21swapper/300:35:453
201299344,13cyclictest7950irq/56-dwc_otg_23:30:153
201299343,8cyclictest0-21swapper/319:10:173
201299343,24cyclictest7950irq/56-dwc_otg_23:10:253
2012993416,4cyclictest1922-21unixbench_multi23:00:443
2012993415,5cyclictest26737-21grep22:50:433
2012993411,3cyclictest0-21swapper/323:40:423
2012993410,5cyclictest2558-21sort20:40:363
201199348,6cyclictest7750irq/56-dwc_otg21:25:342
201199347,4cyclictest0-21swapper/221:59:082
201199347,24cyclictest0-21swapper/223:55:302
201199344,6cyclictest7850irq/56-dwc_otg_23:10:432
201199344,4cyclictest8234-21basename21:45:352
2011993410,7cyclictest1120-21runrttasks20:30:312
201099344,5cyclictest7750irq/56-dwc_otg21:00:141
201099343,3cyclictest7950irq/56-dwc_otg_19:45:351
201099342,22cyclictest7850irq/56-dwc_otg_19:25:421
201099342,18cyclictest0-21swapper/122:17:001
2010993413,9cyclictest0-21swapper/121:55:321
201099341,23cyclictest13626-21latency_hist22:35:151
2010993410,4cyclictest0-21swapper/123:45:391
201099340,16cyclictest0-21swapper/121:50:281
265282330,4sleep326497-21kworker/3:322:10:073
201299331,6cyclictest13726-21cut21:10:343
2012993311,5cyclictest0-21swapper/322:20:453
2012993310,5cyclictest7950irq/56-dwc_otg_22:25:443
201199337,14cyclictest0-21swapper/219:45:282
2011993311,5cyclictest31-21ksoftirqd/200:30:282
201099334,6cyclictest7750irq/56-dwc_otg20:40:471
201099331,21cyclictest5681-21latency_hist20:50:151
287592320,2sleep10-21swapper/120:22:331
280432320,4sleep2201199cyclictest22:10:422
201299326,14cyclictest7950irq/56-dwc_otg_22:30:433
201299322,7cyclictest7750irq/56-dwc_otg00:00:473
201299321,9cyclictest25358-21grep00:15:313
2011993223,6cyclictest7950irq/56-dwc_otg_21:36:222
201199321,9cyclictest809-21fschecks_time20:35:342
201199321,7cyclictest7750irq/56-dwc_otg23:00:282
2011993215,5cyclictest2386850wget20:10:322
201199321,18cyclictest0-21swapper/200:06:442
201099324,9cyclictest0-21swapper/122:55:281
201099324,19cyclictest0-21swapper/119:35:281
201099322,16cyclictest7950irq/56-dwc_otg_19:30:431
201299319,5cyclictest13482-21unixbench_singl23:15:433
201299319,5cyclictest13482-21unixbench_singl23:15:433
201299319,12cyclictest0-21swapper/322:36:373
201299314,14cyclictest7950irq/56-dwc_otg_22:10:423
201299313,18cyclictest0-21swapper/321:05:363
2012993117,10cyclictest0-21swapper/319:20:303
201299311,10cyclictest0-21swapper/323:58:103
201199319,4cyclictest0-21swapper/222:35:222
201199318,4cyclictest7750irq/56-dwc_otg20:46:422
201199313,7cyclictest9766-21/usr/sbin/munin21:00:322
2011993122,6cyclictest20266-21aten_rbpower_po20:00:292
2011993111,4cyclictest0-21swapper/222:25:172
201199311,11cyclictest0-21swapper/200:15:292
2010993115,4cyclictest23-21ksoftirqd/123:42:261
201299306,5cyclictest7950irq/56-dwc_otg_21:20:373
201299306,4cyclictest20165-21proc_pri22:00:413
201299306,10cyclictest7950irq/56-dwc_otg_21:55:413
201299305,13cyclictest0-21swapper/323:46:323
201299305,11cyclictest7950irq/56-dwc_otg_20:50:383
201299305,11cyclictest7950irq/56-dwc_otg_00:20:363
201299303,7cyclictest8558-21grep21:45:393
201299301,8cyclictest10133-21grep21:00:373
2012993015,12cyclictest0-21swapper/319:55:343
2012993011,9cyclictest0-21swapper/323:21:283
201199307,5cyclictest31-21ksoftirqd/222:05:432
2011993022,5cyclictest7485-21sh20:55:142
201299296,6cyclictest30011-21unixbench-2d21:30:453
201299296,11cyclictest7950irq/56-dwc_otg_20:45:383
201299295,11cyclictest7950irq/56-dwc_otg_20:55:383
201299294,12cyclictest955-21kernelversion20:35:373
201299291,6cyclictest0-21swapper/320:20:283
201199296,14cyclictest0-21swapper/220:25:292
201099293,3cyclictest7850irq/56-dwc_otg_20:50:351
201099291,12cyclictest7750irq/56-dwc_otg19:55:371
201299282,5cyclictest7750irq/56-dwc_otg20:05:393
201299282,5cyclictest7750irq/56-dwc_otg20:05:393
201199284,5cyclictest31-21ksoftirqd/219:20:382
201199282,9cyclictest11364-21aten_rbpower_cu21:05:322
201199282,5cyclictest7063-21/usr/sbin/munin23:50:312
201199282,5cyclictest0-21swapper/220:42:082
201199281,16cyclictest28016-21missed_timers20:20:382
9782274,11sleep31067-21sed19:05:413
201299271,19cyclictest0-21swapper/319:40:213
201199271,16cyclictest0-21swapper/219:15:312
201199267,12cyclictest0-21swapper/219:30:322
201099261,4cyclictest7750irq/56-dwc_otg19:20:311
201199253,3cyclictest7750irq/56-dwc_otg20:05:382
201199253,3cyclictest7750irq/56-dwc_otg20:05:382
201299243,11cyclictest7950irq/56-dwc_otg_20:00:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional