You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 14:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Mon Dec 01, 2025 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
152880499651,48cyclictest32-21ksoftirqd/221:20:012
1528800996351,6cyclictest0-21swapper/021:00:290
152880099631,24cyclictest0-21swapper/019:30:000
1528801995910,11cyclictest1548755-21apt-key21:05:011
1528800995950,4cyclictest0-21swapper/021:20:110
152880099572,24cyclictest15-21rcuc/020:35:020
1528804995447,4cyclictest311ktimers/223:40:012
1528801995416,22cyclictest22-21rcuc/121:10:011
1528804995238,11cyclictest0-21swapper/223:44:592
152880499521,24cyclictest0-21swapper/223:50:002
152880499501,19cyclictest0-21swapper/221:30:022
1528804994932,12cyclictest311ktimers/222:40:162
152880499491,27cyclictest0-21swapper/200:40:012
1528801994934,7cyclictest0-21swapper/100:35:321
1528800994924,19cyclictest21050irq/252-8000000.ethernet00:35:160
1528804994837,5cyclictest0-21swapper/220:50:022
1528804994837,5cyclictest0-21swapper/220:50:022
152880199485,31cyclictest0-21swapper/120:35:011
1528800994840,5cyclictest0-21swapper/019:10:140
1528804994734,9cyclictest0-21swapper/222:10:002
1528800994740,4cyclictest21050irq/252-8000000.ethernet23:20:000
1528800994740,4cyclictest21050irq/252-8000000.ethernet22:40:310
1528801994635,5cyclictest1556327-21grep21:45:301
1528801994634,8cyclictest1540061-21grep20:10:321
1528801994633,9cyclictest0-21swapper/122:10:011
152880099462,9cyclictest0-21swapper/021:15:010
1528804994534,8cyclictest311ktimers/219:40:132
1528804994532,9cyclictest1578406-21sendmail00:00:002
152880499451,29cyclictest0-21swapper/223:25:022
152880499451,29cyclictest0-21swapper/221:45:022
1528801994527,10cyclictest0-21swapper/121:05:291
152880199451,2cyclictest0-21swapper/122:20:011
152880199451,2cyclictest0-21swapper/122:20:011
1528800994536,5cyclictest21250irq/208-8000000.ethernet21:50:260
152880099451,9cyclictest0-21swapper/023:55:020
1528804994435,5cyclictest0-21swapper/220:35:312
1528804994435,4cyclictest0-21swapper/219:20:012
1528804994433,6cyclictest1563950-21grep22:30:302
1528804994432,8cyclictest1539213-21grep20:05:292
1528804994432,8cyclictest1539213-21grep20:05:282
1528801994434,5cyclictest0-21swapper/121:50:281
1528801994428,8cyclictest1575801-21grep23:40:291
1528801994424,15cyclictest231ktimers/120:20:141
1528800994436,4cyclictest21050irq/252-8000000.ethernet21:25:170
1528800994436,4cyclictest21050irq/252-8000000.ethernet20:45:120
1528800994436,4cyclictest21050irq/252-8000000.ethernet20:45:120
1528800994434,4cyclictest21050irq/252-8000000.ethernet19:30:190
1528804994335,5cyclictest1537465-21unixbench_multi19:55:282
1528804994329,9cyclictest1573895-21grep23:30:282
152880499432,34cyclictest1549798-21/usr/sbin/munin21:10:182
1528801994334,6cyclictest1551286-21latency_hist21:20:001
1528801994334,5cyclictest168350irq/126-8000000.ethernet-tx100:24:391
1528800994336,4cyclictest21050irq/252-8000000.ethernet19:55:280
1528800994336,4cyclictest21050irq/252-8000000.ethernet19:15:040
1528800994335,4cyclictest21050irq/252-8000000.ethernet23:25:180
1528800994335,4cyclictest21050irq/252-8000000.ethernet23:20:290
1528800994332,4cyclictest21050irq/252-8000000.ethernet21:05:020
1528800994329,9cyclictest0-21swapper/020:40:300
152880099432,34cyclictest0-21swapper/020:30:010
1528804994235,5cyclictest311ktimers/222:25:152
1528804994232,5cyclictest1541743-21grep20:20:302
1528804994230,5cyclictest0-21swapper/221:30:292
1528804994222,10cyclictest0-21swapper/220:55:302
1528804994222,10cyclictest0-21swapper/220:55:302
1528801994230,8cyclictest0-21swapper/120:35:311
1528801994227,9cyclictest0-21swapper/119:40:221
1528801994222,11cyclictest0-21swapper/120:50:311
1528800994236,3cyclictest21050irq/252-8000000.ethernet20:10:140
1528800994235,4cyclictest21050irq/252-8000000.ethernet23:10:240
1528800994235,4cyclictest21050irq/252-8000000.ethernet22:25:180
1528800994235,4cyclictest21050irq/252-8000000.ethernet20:40:000
1528800994235,4cyclictest21050irq/252-8000000.ethernet00:00:250
1528800994234,4cyclictest21050irq/252-8000000.ethernet23:45:160
1528800994234,4cyclictest21050irq/252-8000000.ethernet19:45:170
1528800994234,4cyclictest21050irq/252-8000000.ethernet00:20:140
1528800994234,4cyclictest21050irq/252-8000000.ethernet00:10:250
1528800994231,4cyclictest21050irq/252-8000000.ethernet21:35:150
152880099422,32cyclictest0-21swapper/019:35:130
152880099422,32cyclictest0-21swapper/019:35:130
1528804994129,7cyclictest311ktimers/221:35:162
1528804994128,9cyclictest0-21swapper/200:10:252
1528801994134,4cyclictest0-21swapper/122:00:301
1528801994133,5cyclictest0-21swapper/120:50:011
1528801994133,5cyclictest0-21swapper/120:50:001
1528801994130,7cyclictest1530673-21grep19:15:301
1528801994129,9cyclictest0-21swapper/123:00:291
1528801994129,5cyclictest0-21swapper/121:35:291
1528801994127,10cyclictest0-21swapper/119:55:271
1528801994123,9cyclictest0-21swapper/123:30:281
1528800994135,4cyclictest0-21swapper/021:55:320
1528800994134,4cyclictest21050irq/252-8000000.ethernet23:05:190
1528800994134,4cyclictest21050irq/252-8000000.ethernet22:45:250
1528800994134,4cyclictest21050irq/252-8000000.ethernet21:35:000
1528800994134,4cyclictest21050irq/252-8000000.ethernet21:15:190
1528800994134,4cyclictest21050irq/252-8000000.ethernet20:20:270
1528800994134,4cyclictest21050irq/252-8000000.ethernet19:40:260
152880099412,36cyclictest0-21swapper/020:05:190
152880099412,36cyclictest0-21swapper/020:05:190
1528800994120,9cyclictest21250irq/208-8000000.ethernet00:30:140
1528804994030,4cyclictest0-21swapper/219:50:312
1528804994030,4cyclictest0-21swapper/219:50:312
1528804994027,9cyclictest0-21swapper/200:15:262
1528804994025,10cyclictest0-21swapper/220:30:262
1528804994015,4cyclictest0-21swapper/220:45:012
1528801994031,5cyclictest0-21swapper/122:45:301
1528801994031,5cyclictest0-21swapper/121:45:011
1528801994030,5cyclictest0-21swapper/123:20:291
1528801994029,7cyclictest1547695-21grep20:55:311
1528801994029,7cyclictest1547695-21grep20:55:311
1528801994028,8cyclictest1534144-21grep19:35:311
1528801994028,8cyclictest1534144-21grep19:35:301
152880099403,6cyclictest1546884-21grep20:50:300
1528800994033,4cyclictest21050irq/252-8000000.ethernet23:40:130
1528800994033,4cyclictest21050irq/252-8000000.ethernet22:30:220
1528800994029,7cyclictest0-21swapper/000:15:250
152880099402,7cyclictest1536643-21unixbench_multi19:50:310
152880099402,7cyclictest1536643-21unixbench_multi19:50:310
1528800994025,11cyclictest0-21swapper/023:30:290
1528800994018,13cyclictest1560031-21/usr/sbin/munin22:10:190
1528804993933,3cyclictest14-21rcu_preempt22:05:002
1528804993929,6cyclictest0-21swapper/219:10:312
1528804993928,7cyclictest1546912-21grep20:50:302
152880499391,6cyclictest0-21swapper/223:50:012
1528801993923,9cyclictest0-21swapper/123:05:211
1528800993932,5cyclictest21250irq/208-8000000.ethernet21:45:210
1528800993932,4cyclictest21050irq/252-8000000.ethernet22:20:100
1528800993932,4cyclictest21050irq/252-8000000.ethernet22:20:100
1528800993932,4cyclictest21050irq/252-8000000.ethernet22:15:200
1528800993931,4cyclictest275-21systemd-journal22:10:000
1528800993928,8cyclictest1575029-21munin-plugin-st23:40:010
1528800993928,6cyclictest21250irq/208-8000000.ethernet20:00:290
1528800993926,9cyclictest0-21swapper/023:00:270
1528804993830,5cyclictest0-21swapper/220:00:302
1528804993827,6cyclictest0-21swapper/220:15:292
1528804993823,6cyclictest1583695-21grep00:30:312
152880199388,5cyclictest0-21swapper/119:30:291
152880199383,30cyclictest1538409-21grep20:00:291
1528801993828,6cyclictest1565640-21unixbench_multi22:40:301
1528801993825,9cyclictest0-21swapper/121:35:001
1528801993822,9cyclictest0-21swapper/122:35:301
1528801993822,12cyclictest0-21swapper/100:25:261
1528800993833,2cyclictest0-21swapper/021:45:000
1528800993829,6cyclictest1578062-21meminfo23:55:250
1528804993728,4cyclictest0-21swapper/221:55:292
1528804993724,6cyclictest0-21swapper/200:00:282
1528804993721,9cyclictest0-21swapper/223:10:222
1528801993726,6cyclictest1558000-21grep21:55:321
1528801993726,5cyclictest0-21swapper/123:35:301
1528801993725,6cyclictest1563952-21unixbench_multi22:30:301
1528801993723,9cyclictest0-21swapper/122:15:221
1528801993722,7cyclictest0-21swapper/122:25:311
1528800993732,3cyclictest0-21swapper/022:00:210
1528800993728,6cyclictest1531180-21if_eth019:20:250
1528804993627,4cyclictest168450irq/134-8000000.ethernet-tx222:19:272
1528804993624,8cyclictest0-21swapper/222:45:262
1528804993623,10cyclictest0-21swapper/220:25:222
152880499361,21cyclictest0-21swapper/222:15:012
1528801993626,4cyclictest0-21swapper/122:55:221
1528801993624,8cyclictest0-21swapper/119:50:281
1528801993624,8cyclictest0-21swapper/119:50:281
1528801993623,9cyclictest0-21swapper/100:10:161
1528801993620,12cyclictest231ktimers/119:25:131
152880199361,29cyclictest0-21swapper/123:25:301
1528800993631,3cyclictest21050irq/252-8000000.ethernet22:57:240
1528800993630,3cyclictest0-21swapper/022:50:260
1528800993630,2cyclictest0-21swapper/020:15:180
1528800993629,4cyclictest1564951-21latency_hist22:40:000
152880099362,2cyclictest0-21swapper/000:10:010
1528804993525,6cyclictest1567426-21apt22:55:002
1528804993524,7cyclictest1535858-21grep19:45:272
1528804993523,6cyclictest1552085-21grep21:20:272
1528804993519,10cyclictest0-21swapper/200:25:012
1528804993516,14cyclictest311ktimers/221:05:162
152880499351,4cyclictest0-21swapper/219:35:012
152880499351,4cyclictest0-21swapper/219:35:012
1528801993528,3cyclictest0-21swapper/123:45:221
1528801993522,8cyclictest0-21swapper/119:50:011
152880199352,26cyclictest0-21swapper/120:05:191
152880199352,26cyclictest0-21swapper/120:05:191
1528801993518,13cyclictest231ktimers/123:15:121
1528801993512,14cyclictest231ktimers/122:50:161
152880499348,16cyclictest1548680-21apt-key21:05:002
1528804993425,6cyclictest1569128-21munin-plugin-st23:05:002
1528804993416,10cyclictest0-21swapper/223:15:192
1528801993426,5cyclictest1552867-21grep21:25:291
1528801993425,6cyclictest275-21systemd-journal23:50:171
1528801993418,11cyclictest231ktimers/100:00:121
1528801993414,14cyclictest231ktimers/120:40:131
152880199341,27cyclictest0-21swapper/119:10:211
1528801993410,15cyclictest1580615-21/usr/sbin/munin00:15:161
1528800993429,2cyclictest0-21swapper/020:55:230
1528800993429,2cyclictest0-21swapper/020:55:220
1528804993325,4cyclictest0-21swapper/222:55:292
1528804993325,4cyclictest0-21swapper/219:20:322
1528804993323,8cyclictest0-21swapper/220:10:302
1528804993323,7cyclictest311ktimers/223:05:142
1528804993314,16cyclictest168450irq/134-8000000.ethernet-tx219:26:212
152880499331,28cyclictest0-21swapper/200:30:012
1528801993325,4cyclictest0-21swapper/100:30:311
1528801993323,5cyclictest0-21swapper/123:10:291
1528801993321,8cyclictest0-21swapper/121:20:271
152880099334,3cyclictest0-21swapper/019:10:010
152880099334,3cyclictest0-21swapper/019:10:010
1528800993329,2cyclictest0-21swapper/000:25:250
1528804993222,7cyclictest311ktimers/222:20:112
1528804993222,7cyclictest311ktimers/222:20:112
1528804993222,6cyclictest0-21swapper/219:30:292
1528804993221,8cyclictest0-21swapper/222:35:242
1528804993220,7cyclictest311ktimers/223:25:132
1528801993221,6cyclictest0-21swapper/119:25:021
152880199321,4cyclictest0-21swapper/120:15:281
1528804993123,4cyclictest0-21swapper/221:55:012
152880199311,28cyclictest0-21swapper/122:10:241
152880199303,22cyclictest1577857-21cut23:55:191
1528801993021,4cyclictest0-21swapper/120:30:011
1528804992919,6cyclictest0-21swapper/221:45:302
152880499291,24cyclictest0-21swapper/219:10:022
152880499291,24cyclictest0-21swapper/219:10:012
152880199261,2cyclictest0-21swapper/119:10:011
152880199261,2cyclictest0-21swapper/119:10:011
1528801992417,4cyclictest14-21rcu_preempt00:10:011
1528804992315,4cyclictest0-21swapper/200:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional