You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-13 - 17:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sat Sep 13, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3925115999017,2cyclictest0-21swapper/010:10:010
392512099711,18cyclictest0-21swapper/211:10:012
3925120996931,32cyclictest0-21swapper/210:40:292
392511599681,3cyclictest0-21swapper/009:35:010
392511599681,3cyclictest0-21swapper/009:35:010
3925115996727,35cyclictest0-21swapper/010:00:300
3925115996726,4cyclictest0-21swapper/007:45:290
3925120996629,32cyclictest0-21swapper/207:10:282
3925115996618,7cyclictest0-21swapper/011:30:010
392512099654,35cyclictest0-21swapper/212:40:012
392511599652,4cyclictest3966648-21/usr/sbin/munin11:10:220
3925120996223,34cyclictest0-21swapper/207:45:232
3925120996220,7cyclictest0-21swapper/209:25:202
3925120996123,9cyclictest0-21swapper/208:30:192
3925120996120,4cyclictest168450irq/135-8000000.ethernet-tx209:20:192
3925117996127,29cyclictest3952571-21unixbench_multi09:45:331
3925115996124,11cyclictest3942333-21grep08:45:290
392512099601,33cyclictest0-21swapper/208:40:002
3925120995923,5cyclictest0-21swapper/211:30:292
3925117995945,8cyclictest3927841-21grep07:20:311
3925120995820,4cyclictest0-21swapper/207:55:222
3925117995817,17cyclictest3929789-21/usr/sbin/munin07:35:201
3925115995830,4cyclictest20950irq/209-8000000.ethernet07:15:020
3925115995714,18cyclictest3925110-21cyclictest11:30:140
3925120995520,5cyclictest0-21swapper/210:00:012
3925120995516,11cyclictest0-21swapper/212:30:012
3925115995528,4cyclictest20950irq/209-8000000.ethernet09:05:190
3925115995513,12cyclictest0-21swapper/007:12:310
3925120995424,5cyclictest0-21swapper/209:45:332
3925120995423,4cyclictest3941798-21/usr/sbin/munin08:45:182
3925117995445,5cyclictest3927117-21latency_hist07:20:001
392511599541,28cyclictest0-21swapper/011:00:080
3925120995325,6cyclictest0-21swapper/209:55:002
3925120995322,4cyclictest0-21swapper/212:05:212
3925120995316,13cyclictest0-21swapper/209:00:312
392511599531,25cyclictest0-21swapper/011:52:040
3925120995226,2cyclictest0-21swapper/208:00:302
3925120995223,9cyclictest3980601-21grep12:30:302
392512099521,4cyclictest3960774-21meminfo10:35:272
3925115995223,4cyclictest20950irq/209-8000000.ethernet10:30:330
3925120995122,4cyclictest3927792-21unixbench_multi07:20:302
3925120995117,7cyclictest0-21swapper/209:45:012
392511599517,23cyclictest3962062-21latency_hist10:45:010
3925115995127,4cyclictest3933724-21grep07:55:290
392511599511,4cyclictest0-21swapper/012:40:010
3925115995112,13cyclictest0-21swapper/008:39:120
3925117995027,16cyclictest231ktimers/109:05:121
3925115995028,4cyclictest20950irq/209-8000000.ethernet12:10:000
392511599501,43cyclictest0-21swapper/009:15:150
3925115995012,12cyclictest0-21swapper/011:07:470
3925120994919,8cyclictest0-21swapper/211:10:192
3925120994917,7cyclictest0-21swapper/210:49:592
392511599495,8cyclictest15-21rcuc/009:50:010
3925120994833,11cyclictest311ktimers/209:10:162
3925120994823,4cyclictest0-21swapper/209:30:192
3925120994823,4cyclictest0-21swapper/209:30:192
3925120994821,9cyclictest3957722-21sshd10:17:332
3925120994821,22cyclictest0-21swapper/210:30:322
3925120994817,8cyclictest0-21swapper/212:10:222
392512099481,29cyclictest0-21swapper/208:30:022
392512099481,29cyclictest0-21swapper/208:30:012
3925117994840,4cyclictest3935502-21munin-plugin-st08:09:591
3925117994828,13cyclictest3973787-21grep11:50:291
3925115994819,8cyclictest0-21swapper/012:30:300
392512099464,18cyclictest0-21swapper/208:10:012
3925120994617,4cyclictest0-21swapper/210:25:012
3925115994627,15cyclictest131ktimers/009:25:150
3925115994625,4cyclictest20950irq/209-8000000.ethernet11:20:130
3925115994625,4cyclictest20950irq/209-8000000.ethernet11:20:130
392512099451,29cyclictest0-21swapper/210:05:232
392512099451,27cyclictest0-21swapper/208:45:012
392512099451,24cyclictest0-21swapper/208:15:012
392511799456,8cyclictest24-21ksoftirqd/108:15:011
3925117994534,7cyclictest3970440-21grep11:30:301
3925117994434,6cyclictest3962751-21grep10:45:301
3925117994413,13cyclictest3925110-21cyclictest07:30:011
3925115994436,4cyclictest20750irq/251-8000000.ethernet07:20:150
3925117994328,10cyclictest0-21swapper/112:10:291
3925117994323,14cyclictest231ktimers/111:10:131
3925115994336,4cyclictest0-21swapper/008:55:150
3925115994318,6cyclictest27350irq/343-s-wl18xx09:40:290
392511599431,4cyclictest3948052-21tail09:20:280
392511599431,3cyclictest0-21swapper/008:30:130
392512099421,33cyclictest0-21swapper/210:55:002
3925117994230,8cyclictest0-21swapper/109:15:001
3925117994230,8cyclictest0-21swapper/108:55:331
3925117994229,8cyclictest3934606-21grep08:00:301
3925117994227,10cyclictest231ktimers/110:20:161
392511599424,5cyclictest0-21swapper/012:05:020
3925115994221,18cyclictest20750irq/251-8000000.ethernet10:10:150
3925120994133,5cyclictest3938025-21unixbench_multi08:20:292
392512099411,2cyclictest0-21swapper/207:50:012
3925117994128,6cyclictest0-21swapper/108:40:221
3925117994126,7cyclictest0-21swapper/111:25:311
3925117994125,10cyclictest0-21swapper/110:30:011
3925117994125,10cyclictest0-21swapper/110:30:011
3925115994132,5cyclictest0-21swapper/008:50:300
392511599411,8cyclictest3944929-21grep09:00:310
3925120994031,5cyclictest0-21swapper/208:55:332
3925120994030,7cyclictest3969622-21latency_hist11:30:002
3925120994017,3cyclictest27350irq/343-s-wl18xx11:45:162
3925120994017,3cyclictest27350irq/343-s-wl18xx11:45:162
3925117994033,4cyclictest3937273-21latency_hist08:20:011
3925117994029,6cyclictest0-21swapper/108:45:161
3925117994026,9cyclictest3972130-21grep11:40:311
3925117994026,7cyclictest0-21swapper/109:40:311
392511799401,7cyclictest0-21swapper/107:45:011
392511799401,4cyclictest0-21swapper/112:35:001
3925115994032,4cyclictest0-21swapper/011:55:240
392511599401,20cyclictest0-21swapper/007:30:220
3925120993931,5cyclictest168450irq/135-8000000.ethernet-tx210:15:012
3925117993930,5cyclictest3955217-21munin-plugin-st10:05:011
3925117993930,4cyclictest0-21swapper/112:20:281
3925117993926,8cyclictest0-21swapper/109:25:011
3925117993925,9cyclictest231ktimers/109:30:131
3925117993925,9cyclictest231ktimers/109:30:131
3925117993924,7cyclictest0-21swapper/107:55:261
3925115993918,19cyclictest0-21swapper/012:20:240
392511599391,4cyclictest0-21swapper/010:45:220
392511599391,3cyclictest3936427-21munin-plugin-st08:14:590
392512099381,6cyclictest0-21swapper/212:00:012
3925117993831,5cyclictest3955991-21grep10:05:301
3925117993830,5cyclictest3947436-21unixbench_singl09:15:321
3925117993829,6cyclictest3949213-21grep09:25:281
3925117993825,4cyclictest3943240-21unixbench_singl08:50:311
3925117993824,9cyclictest0-21swapper/111:45:231
3925117993824,9cyclictest0-21swapper/111:45:221
3925117993822,13cyclictest231ktimers/111:35:141
3925115993831,4cyclictest20750irq/251-8000000.ethernet08:15:160
392511599381,4cyclictest0-21swapper/010:55:010
392511599381,31cyclictest0-21swapper/010:55:160
392511599381,25cyclictest0-21swapper/011:35:390
392511599381,11cyclictest3946321-21memory09:10:280
392512099376,5cyclictest27250irq/343-wl18xx10:00:292
3925120993730,4cyclictest3937274-21run-parts08:20:012
3925120993725,8cyclictest0-21swapper/207:35:282
392511799377,2cyclictest0-21swapper/111:20:011
3925117993728,5cyclictest0-21swapper/110:30:291
3925117993726,6cyclictest3965290-21grep11:00:331
3925117993719,13cyclictest231ktimers/109:00:181
3925115993730,4cyclictest20950irq/209-8000000.ethernet08:05:260
3925115993727,7cyclictest0-21swapper/009:50:310
392511599371,4cyclictest0-21swapper/010:30:000
392511599371,4cyclictest0-21swapper/010:30:000
392511599371,34cyclictest0-21swapper/007:50:150
392511599371,25cyclictest0-21swapper/012:18:470
392511599371,25cyclictest0-21swapper/011:18:080
3925120993629,4cyclictest168450irq/135-8000000.ethernet-tx211:45:002
392511799364,28cyclictest0-21swapper/107:50:261
3925117993622,10cyclictest0-21swapper/110:40:281
3925117993620,7cyclictest3961051-21grep10:35:311
392511799361,5cyclictest3938864-21unixbench_multi08:25:311
392511799361,5cyclictest3938864-21unixbench_multi08:25:311
3925115993627,6cyclictest0-21swapper/009:55:290
3925115993621,11cyclictest131ktimers/011:45:150
3925115993621,11cyclictest131ktimers/011:45:150
392511599361,6cyclictest3958248-21kernelversion10:20:260
3925115993613,12cyclictest0-21swapper/007:28:210
392511599361,24cyclictest0-21swapper/011:41:060
392511599361,24cyclictest0-21swapper/007:37:530
3925120993525,5cyclictest0-21swapper/212:20:272
3925120993523,6cyclictest0-21swapper/211:55:002
3925117993525,6cyclictest3956847-21grep10:10:291
3925117993524,6cyclictest0-21swapper/110:55:331
3925117993522,7cyclictest3963582-21grep10:50:301
3925115993529,4cyclictest20950irq/209-8000000.ethernet07:40:180
392511599351,32cyclictest0-21swapper/008:25:150
392511599351,32cyclictest0-21swapper/008:25:150
3925115993512,12cyclictest0-21swapper/012:13:550
3925120993427,4cyclictest0-21swapper/212:15:342
3925120993423,4cyclictest0-21swapper/207:25:222
3925120993413,15cyclictest168450irq/135-8000000.ethernet-tx209:35:132
392512099341,25cyclictest0-21swapper/209:10:022
3925117993430,2cyclictest0-21swapper/108:20:231
3925117993429,3cyclictest0-21swapper/111:20:151
3925117993429,3cyclictest0-21swapper/111:20:151
3925117993424,6cyclictest0-21swapper/109:55:011
3925117993424,5cyclictest0-21swapper/112:35:301
3925117993418,11cyclictest0-21swapper/110:15:301
3925115993423,7cyclictest3941394-21grep08:40:320
3925115993423,5cyclictest0-21swapper/009:35:270
392511599341,3cyclictest0-21swapper/008:00:150
3925120993325,5cyclictest0-21swapper/211:15:312
3925120993324,5cyclictest3947468-21grep09:15:312
3925120993324,5cyclictest0-21swapper/210:55:332
3925120993323,5cyclictest0-21swapper/211:35:182
392512099331,5cyclictest0-21swapper/211:25:022
392512099331,5cyclictest0-21swapper/211:25:022
3925117993323,6cyclictest0-21swapper/111:55:311
392511799332,25cyclictest0-21swapper/111:05:281
3925117993320,9cyclictest0-21swapper/112:05:301
3925115993327,4cyclictest20950irq/209-8000000.ethernet10:35:150
3925115993326,4cyclictest20750irq/251-8000000.ethernet10:15:140
3925120993224,4cyclictest0-21swapper/212:05:012
3925120993219,9cyclictest0-21swapper/208:50:192
392512099321,5cyclictest27250irq/343-wl18xx07:40:282
392512099321,24cyclictest0-21swapper/211:05:012
392511799322,5cyclictest0-21swapper/112:30:011
3925117993223,5cyclictest0-21swapper/108:30:301
3925117993222,5cyclictest0-21swapper/112:00:201
3925117993221,5cyclictest0-21swapper/107:10:011
3925117993221,5cyclictest0-21swapper/107:10:011
3925117993211,4cyclictest27350irq/343-s-wl18xx08:38:471
3925117993122,6cyclictest3950956-21dropbear09:35:371
3925117993118,10cyclictest231ktimers/107:30:151
392511799311,2cyclictest0-21swapper/110:00:011
392511599312,5cyclictest3979160-21apt-get12:25:120
3925120993024,4cyclictest1666-21snmpd07:30:282
3925120993013,14cyclictest168450irq/135-8000000.ethernet-tx210:25:272
3925120993013,14cyclictest168450irq/135-8000000.ethernet-tx210:25:272
3925117993023,4cyclictest3925920-21latency_hist07:15:001
3925115993019,7cyclictest0-21swapper/007:10:020
3925115993019,7cyclictest0-21swapper/007:10:020
392511599301,4cyclictest3937553-21df_inode08:20:180
3925120992919,7cyclictest0-21swapper/207:20:002
392511799285,15cyclictest3931904-21ptp4l07:45:291
392511799271,13cyclictest0-21swapper/112:15:111
3925120992514,7cyclictest0-21swapper/207:10:002
3925120992514,7cyclictest0-21swapper/207:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional