You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 10:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Tue Dec 02, 2025 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
241671799822,71cyclictest0-21swapper/022:00:100
2416728997460,11cyclictest391ktimers/323:55:213
2416721997029,35cyclictest0-21swapper/123:00:311
241672499691,25cyclictest2464069-21/usr/sbin/munin23:45:192
2416721996827,32cyclictest0-21swapper/100:00:011
2416721996630,31cyclictest168350irq/126-8000000.ethernet-tx100:35:191
2416724996523,36cyclictest0-21swapper/222:55:302
2416721996523,33cyclictest0-21swapper/121:00:291
241671799653,26cyclictest15-21rcuc/020:55:020
241671799653,26cyclictest15-21rcuc/020:55:020
241671799651,50cyclictest0-21swapper/020:45:140
2416724996116,35cyclictest0-21swapper/223:05:222
241672199614,22cyclictest2417732-21forks19:15:011
2416721996131,22cyclictest0-21swapper/123:20:281
2416721996131,22cyclictest0-21swapper/123:20:281
2416721996121,34cyclictest0-21swapper/119:35:281
2416724996027,27cyclictest2441653-21unixbench_singl21:30:282
2416724996020,32cyclictest0-21swapper/222:50:292
2416724996020,32cyclictest0-21swapper/222:50:292
2416717996037,12cyclictest2452701-21munin-plugin-st22:40:010
2416717996037,12cyclictest2452701-21munin-plugin-st22:40:010
2416724995922,31cyclictest0-21swapper/200:40:012
2416724995920,32cyclictest0-21swapper/221:00:312
2416724995917,18cyclictest2422326-21/usr/sbin/munin19:40:212
2416721995919,29cyclictest0-21swapper/120:45:241
241671799592,54cyclictest0-21swapper/023:45:010
2416724995825,27cyclictest0-21swapper/221:35:192
2416724995820,32cyclictest0-21swapper/220:00:312
2416724995818,5cyclictest0-21swapper/219:20:302
2416724995818,35cyclictest0-21swapper/221:40:312
2416724995817,32cyclictest0-21swapper/220:20:232
2416724995817,32cyclictest0-21swapper/220:20:232
241672199589,41cyclictest0-21swapper/119:20:281
2416721995830,20cyclictest0-21swapper/121:35:291
2416724995723,29cyclictest0-21swapper/221:50:292
2416724995721,28cyclictest0-21swapper/222:00:012
2416721995729,23cyclictest0-21swapper/120:40:291
2416721995719,31cyclictest0-21swapper/122:05:001
2416721995716,33cyclictest0-21swapper/100:30:241
2416724995628,23cyclictest1668-21snmpd00:30:202
2416724995626,26cyclictest0-21swapper/221:15:282
2416724995615,7cyclictest0-21swapper/221:10:272
2416724995611,10cyclictest0-21swapper/200:20:192
2416721995633,17cyclictest0-21swapper/120:20:311
2416721995633,17cyclictest0-21swapper/120:20:311
2416721995621,29cyclictest0-21swapper/122:30:221
2416721995616,35cyclictest0-21swapper/122:20:011
241672199561,10cyclictest2467677-21ssh00:05:201
241672199561,10cyclictest2453926-21ssh22:45:221
2416724995529,22cyclictest2435597-21grep20:55:322
2416724995525,26cyclictest0-21swapper/220:05:332
2416724995519,29cyclictest0-21swapper/219:15:292
2416721995532,18cyclictest2455958-21grep22:55:291
2416721995519,30cyclictest0-21swapper/123:35:011
2416717995520,27cyclictest0-21swapper/020:30:220
241672499549,9cyclictest0-21swapper/222:25:202
2416724995435,15cyclictest2428885-21apt-get20:20:012
2416724995435,15cyclictest2428885-21apt-get20:20:012
2416724995418,29cyclictest0-21swapper/200:00:012
2416724995417,4cyclictest0-21swapper/200:05:272
2416724995413,4cyclictest0-21swapper/200:30:012
241672199545,39cyclictest0-21swapper/121:50:281
241672199543,6cyclictest2471314-21/usr/sbin/munin00:25:261
2416721995423,25cyclictest2458059-21/usr/sbin/munin23:10:281
2416721995420,26cyclictest0-21swapper/121:25:311
241672499532,13cyclictest2444143-21tail21:45:302
2416724995317,4cyclictest0-21swapper/223:35:232
241672499531,4cyclictest0-21swapper/220:15:012
241672199535,39cyclictest0-21swapper/121:05:291
2416721995330,19cyclictest0-21swapper/121:10:291
2416721995326,17cyclictest0-21swapper/121:00:011
2416721995317,29cyclictest2444265-21wc21:50:001
2416721995313,33cyclictest0-21swapper/123:35:191
241672499528,12cyclictest0-21swapper/221:25:232
2416724995216,7cyclictest0-21swapper/222:10:252
2416724995216,4cyclictest0-21swapper/219:30:312
2416724995210,8cyclictest0-21swapper/219:25:312
2416721995221,22cyclictest0-21swapper/100:15:281
2416721995218,27cyclictest0-21swapper/123:45:281
2416721995214,30cyclictest0-21swapper/120:00:241
2416724995144,5cyclictest0-21swapper/222:00:142
2416724995112,5cyclictest0-21swapper/220:35:012
241672199516,34cyclictest0-21swapper/120:35:291
241672199514,5cyclictest2453253-21cut22:40:271
241672199512,8cyclictest2426622-21/usr/sbin/munin20:05:231
241672199511,8cyclictest2423518-21/usr/sbin/munin19:45:271
2416721995110,33cyclictest0-21swapper/123:50:281
2416717995114,29cyclictest0-21swapper/022:45:190
2416717995111,21cyclictest2466389-21apt-get00:00:020
241672499508,10cyclictest0-21swapper/223:50:282
2416724995015,4cyclictest0-21swapper/200:00:282
2416724995014,7cyclictest0-21swapper/223:25:222
241672499501,42cyclictest0-21swapper/219:35:272
241672199508,34cyclictest0-21swapper/121:25:011
241672199504,36cyclictest0-21swapper/122:05:201
241672199502,8cyclictest2431225-21/usr/sbin/munin20:30:291
241672199502,8cyclictest2427897-21/usr/sbin/munin20:10:291
2416721995028,15cyclictest2445894-21grep21:55:301
241672199502,7cyclictest2419917-21/usr/sbin/munin19:25:221
2416721995015,27cyclictest0-21swapper/123:15:291
2416721995013,30cyclictest231ktimers/100:20:191
2416721995010,32cyclictest0-21swapper/120:20:001
2416721995010,32cyclictest0-21swapper/120:20:001
241672499498,12cyclictest0-21swapper/200:10:282
241672499493,16cyclictest2453441-21unixbench_multi22:40:302
2416724994918,26cyclictest0-21swapper/223:30:222
2416724994913,6cyclictest0-21swapper/223:40:222
241672199497,36cyclictest2452592-21grep22:35:301
241672199497,36cyclictest2452592-21grep22:35:301
2416721994942,4cyclictest2461246-21munin-plugin-st23:30:001
241672199492,7cyclictest2424847-21apt-get19:55:181
241672199492,5cyclictest2454931-21grep22:50:261
241672199492,5cyclictest2454931-21grep22:50:261
241672199491,8cyclictest2443582-21grep21:45:011
241672199491,6cyclictest2424325-21/usr/sbin/munin19:50:281
2416721994915,26cyclictest0-21swapper/120:25:311
2416721994912,29cyclictest0-21swapper/121:30:241
2416717994942,4cyclictest2467336-21munin-plugin-st00:05:000
241672499482,13cyclictest2449250-21unixbench_singl22:15:292
241672199483,5cyclictest2422444-21fschecks_count19:40:211
241672199483,4cyclictest2450612-21/usr/sbin/munin22:25:241
241672199482,7cyclictest2434678-21/usr/sbin/munin20:50:281
241672199482,7cyclictest2434678-21/usr/sbin/munin20:50:281
241672199481,8cyclictest2418070-21/usr/sbin/munin19:15:181
2416721994818,23cyclictest0-21swapper/119:30:291
2416721994817,24cyclictest0-21swapper/123:05:311
241672199481,2cyclictest0-21swapper/121:15:021
2416721994810,30cyclictest0-21swapper/122:10:281
241672499476,11cyclictest0-21swapper/219:15:012
241672499474,10cyclictest0-21swapper/222:10:012
2416724994739,5cyclictest2454396-21munin-plugin-st22:50:002
2416724994725,18cyclictest2456830-21grep23:00:312
2416724994716,4cyclictest0-21swapper/220:25:302
241672199472,7cyclictest2449872-21phc2sys22:20:271
241672199472,7cyclictest2449872-21phc2sys22:20:271
241672199471,8cyclictest2466948-21/usr/sbin/munin00:00:231
2416717994735,6cyclictest0-21swapper/022:30:300
2416717994729,12cyclictest0-21swapper/019:45:290
2416717994714,29cyclictest0-21swapper/020:35:290
241672499467,10cyclictest2432264-21sed20:35:282
2416724994622,21cyclictest0-21swapper/221:05:252
241672499461,2cyclictest0-21swapper/223:16:142
241672199461,8cyclictest2468732-21/usr/sbin/munin00:10:271
2416717994629,11cyclictest0-21swapper/023:35:310
2416724994515,4cyclictest0-21swapper/200:15:182
241672199452,5cyclictest2463232-21apt-get23:40:171
2416717994532,6cyclictest0-21swapper/021:30:290
2416717994528,10cyclictest0-21swapper/023:00:300
241671799452,37cyclictest2447184-21fschecks_time22:05:200
241672499445,14cyclictest2424579-21sed19:50:302
2416717994434,6cyclictest2444200-21grep21:45:300
2416717994430,9cyclictest2464653-21grep23:45:280
241672499432,10cyclictest2460527-21grep23:25:012
241672499432,10cyclictest2460527-21grep23:25:012
241671799431,2cyclictest0-21swapper/020:10:020
2416717994234,4cyclictest21050irq/252-8000000.ethernet20:20:250
2416717994234,4cyclictest21050irq/252-8000000.ethernet20:20:250
241671799421,5cyclictest2443237-21/usr/sbin/munin21:40:300
241671799421,2cyclictest0-21swapper/020:05:010
241671799414,30cyclictest2460531-21latency_hist23:25:010
241671799414,30cyclictest2460531-21latency_hist23:25:010
2416717994130,8cyclictest0-21swapper/022:40:220
241671799411,38cyclictest0-21swapper/021:35:120
241672499407,5cyclictest0-21swapper/220:00:002
241672499407,11cyclictest2416840-21latency_hist19:10:012
2416717994033,4cyclictest21050irq/252-8000000.ethernet00:25:240
241671799402,4cyclictest15-21rcuc/020:30:000
241671799401,4cyclictest0-21swapper/021:15:010
241671799401,37cyclictest0-21swapper/022:50:230
241671799401,37cyclictest0-21swapper/022:50:220
2416724993927,8cyclictest0-21swapper/222:35:312
2416724993927,8cyclictest0-21swapper/222:35:312
241672499391,31cyclictest0-21swapper/221:20:182
241672499391,2cyclictest0-21swapper/222:35:012
241672499391,2cyclictest0-21swapper/220:40:242
241671799394,5cyclictest0-21swapper/021:55:240
241671799393,2cyclictest0-21swapper/000:15:010
241671799392,19cyclictest15-21rcuc/019:45:000
2416717993918,19cyclictest0-21swapper/019:20:210
241671799391,4cyclictest0-21swapper/019:50:170
241671799391,3cyclictest2456931-21apt-get23:05:030
241671799391,36cyclictest131ktimers/000:20:210
241671799391,36cyclictest0-21swapper/020:10:240
241671799391,33cyclictest2435670-21grep20:55:320
2416717993913,21cyclictest131ktimers/021:15:100
241671799386,2cyclictest0-21swapper/019:10:020
2416717993834,2cyclictest0-21swapper/023:25:130
2416717993831,4cyclictest131ktimers/000:30:160
2416717993822,10cyclictest0-21swapper/019:15:210
241671799381,35cyclictest0-21swapper/019:25:310
2416717993729,6cyclictest131ktimers/021:50:280
2416717993728,5cyclictest0-21swapper/000:10:000
2416717993728,4cyclictest131ktimers/022:10:260
2416717993727,7cyclictest2465487-21grep23:50:280
241671799371,2cyclictest0-21swapper/022:20:010
241672199361,9cyclictest2416745-21latency_hist19:10:001
2416717993630,4cyclictest21250irq/208-8000000.ethernet20:20:010
2416717993630,4cyclictest21250irq/208-8000000.ethernet20:20:000
2416717993627,6cyclictest2425421-21grep19:55:310
2416717993627,5cyclictest0-21swapper/021:25:310
2416724993522,9cyclictest2458619-21grep23:10:272
2416717993530,3cyclictest0-21swapper/019:10:120
2416717993529,4cyclictest21250irq/208-8000000.ethernet19:30:170
2416717993516,13cyclictest131ktimers/023:10:130
2416724993426,4cyclictest2423736-21unixbench_singl19:45:282
2416717993429,3cyclictest0-21swapper/022:24:260
2416717993429,3cyclictest0-21swapper/022:24:260
2416717993424,6cyclictest0-21swapper/020:40:280
2416717993418,12cyclictest131ktimers/023:15:160
241671799341,6cyclictest2473055-21grep00:35:280
241671799341,5cyclictest0-21swapper/021:10:000
241671799341,27cyclictest0-21swapper/021:20:120
2416717993327,4cyclictest21250irq/208-8000000.ethernet22:25:180
2416717993326,5cyclictest131ktimers/000:15:270
241671799332,5cyclictest2456079-21cut23:00:000
2416717993227,3cyclictest21050irq/252-8000000.ethernet21:00:220
2416717993226,4cyclictest21250irq/208-8000000.ethernet23:30:150
2416717993223,5cyclictest21250irq/208-8000000.ethernet19:35:280
2416724992820,5cyclictest0-21swapper/220:50:242
2416724992820,5cyclictest0-21swapper/220:50:232
2416724992617,7cyclictest1668-21snmpd20:45:142
2416724992616,5cyclictest0-21swapper/222:20:272
2416724992616,5cyclictest0-21swapper/222:20:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional