You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 12:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Sat Jul 12, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2277970998214,22cyclictest15-21rcuc/000:20:010
227797099731,66cyclictest0-21swapper/000:00:200
227797099731,2cyclictest0-21swapper/022:30:010
2277970997030,33cyclictest0-21swapper/021:55:210
2277970996965,2cyclictest0-21swapper/019:25:020
2277970996931,34cyclictest0-21swapper/021:10:290
227797099682,2cyclictest0-21swapper/020:00:010
227797099651,56cyclictest0-21swapper/020:50:210
227797099641,3cyclictest0-21swapper/021:00:010
227797099641,3cyclictest0-21swapper/021:00:010
2277970996357,3cyclictest0-21swapper/020:40:130
227797099621,8cyclictest2300110-21ps21:15:280
2277970996217,37cyclictest2284095-21grep19:40:330
2277970996129,23cyclictest0-21swapper/020:30:300
2277970996126,32cyclictest0-21swapper/019:25:290
2277970996119,37cyclictest0-21swapper/022:10:000
227797099611,52cyclictest0-21swapper/020:20:140
227797399608,18cyclictest22-21rcuc/122:05:011
227797099604,45cyclictest2311523-21grep22:20:290
2277970996037,20cyclictest2320913-21sendmail23:20:000
2277970996023,31cyclictest0-21swapper/022:00:230
2277970996012,4cyclictest0-21swapper/020:00:220
227797099592,16cyclictest2323447-21sed23:30:290
2277970995921,32cyclictest2317683-21latency_hist23:00:010
227797399583,34cyclictest24-21ksoftirqd/123:45:061
227797099583,9cyclictest2298568-21grep21:05:290
2277970995826,22cyclictest0-21swapper/023:45:190
2277970995818,31cyclictest0-21swapper/022:30:250
2277970995818,31cyclictest0-21swapper/022:30:240
227797099581,52cyclictest2281858-21df19:30:170
227797099579,36cyclictest0-21swapper/021:30:150
2277970995729,26cyclictest20950irq/209-8000000.ethernet21:45:290
227797099571,8cyclictest2319721-21meminfo23:10:270
2277970995710,9cyclictest2309915-21sh22:15:000
2277970995628,24cyclictest20950irq/209-8000000.ethernet00:35:010
2277970995628,24cyclictest20950irq/209-8000000.ethernet00:35:010
2277970995619,28cyclictest0-21swapper/022:15:330
2277970995614,36cyclictest20950irq/209-8000000.ethernet21:35:260
2277970995614,34cyclictest20950irq/209-8000000.ethernet19:50:290
227797099556,11cyclictest2316625-21unixbench_singl22:50:310
2277970995529,20cyclictest2293330-21ps20:35:280
2277970995513,33cyclictest0-21swapper/020:10:290
227797099551,2cyclictest0-21swapper/021:30:010
2277970995511,33cyclictest0-21swapper/020:20:020
227797099543,8cyclictest2278659-21grep19:10:280
227797099543,12cyclictest2282839-21sh19:35:220
2277970995341,6cyclictest19950irq/27-20000000.i2c20:25:290
227797099533,6cyclictest2329796-21latency_hist00:10:020
2277970995330,18cyclictest20950irq/209-8000000.ethernet00:25:210
2277970995322,27cyclictest0-21swapper/022:40:190
2277973995238,11cyclictest2324380-21munin-plugin-st23:40:001
227797099524,8cyclictest2301151-21head21:20:330
227797099524,11cyclictest2334654-21sed00:35:290
227797099523,6cyclictest2297355-21cut21:00:230
227797099522,9cyclictest2332123-21grep00:20:280
227797099522,9cyclictest2327826-21tail23:55:290
227797099522,7cyclictest2321719-21grep23:20:300
227797099521,41cyclictest2324659-21latency_hist23:40:010
227797099521,11cyclictest2295286-21cron20:50:000
227797099513,7cyclictest2325253-21grep23:40:270
227797099511,8cyclictest2329921-21fschecks_count00:10:210
227797099506,7cyclictest0-21swapper/022:35:300
227797099504,6cyclictest2322222-21tune2fs23:25:210
227797099503,11cyclictest2304570-21unixbench_multi21:40:290
2277974994940,4cyclictest2321879-21apt-key23:25:002
227797099493,6cyclictest2327034-21grep23:50:300
227797099493,6cyclictest2327034-21grep23:50:300
2277973994824,14cyclictest231ktimers/119:10:011
2277973994824,14cyclictest231ktimers/119:10:011
227797099483,9cyclictest2318339-21sed23:00:280
2277970994827,17cyclictest0-21swapper/019:10:010
2277970994827,17cyclictest0-21swapper/019:10:010
2277970994816,3cyclictest0-21swapper/019:45:070
2277970994815,30cyclictest131ktimers/021:50:240
2277973994735,6cyclictest0-21swapper/123:25:001
227797099472,7cyclictest2287893-21lsblk20:05:230
227797099472,6cyclictest2315733-21grep22:45:300
2277974994626,11cyclictest2316039-21/usr/sbin/munin22:50:222
227797099463,8cyclictest2318991-21ptp4l23:05:260
227797099462,12cyclictest2279442-21fschecks_time19:15:230
2277974994529,12cyclictest0-21swapper/220:30:002
2277974994427,11cyclictest311ktimers/219:10:122
227797499441,39cyclictest0-21swapper/221:45:012
2277973994431,8cyclictest0-21swapper/122:50:001
2277973994429,8cyclictest0-21swapper/123:15:291
2277973994429,10cyclictest0-21swapper/119:45:331
2277974994330,9cyclictest0-21swapper/219:40:002
2277973994331,6cyclictest0-21swapper/120:00:311
2277974994226,12cyclictest311ktimers/219:45:192
2277974994222,10cyclictest30-21rcuc/223:20:022
2277973994230,8cyclictest0-21swapper/121:50:321
2277973994228,10cyclictest0-21swapper/120:35:211
2277974994131,7cyclictest0-21swapper/222:05:302
2277974994120,16cyclictest311ktimers/200:20:132
227797499411,10cyclictest0-21swapper/223:50:022
227797499411,10cyclictest0-21swapper/223:50:012
2277973994133,5cyclictest2277967-21cyclictest20:25:001
2277974994027,8cyclictest311ktimers/220:55:122
2277974994027,8cyclictest311ktimers/220:55:122
2277974994027,8cyclictest0-21swapper/223:55:292
2277974994023,12cyclictest311ktimers/222:00:142
2277974994022,10cyclictest0-21swapper/223:25:202
2277974994018,15cyclictest311ktimers/200:35:152
227797499401,6cyclictest0-21swapper/222:20:012
2277973994032,4cyclictest2292394-21uname20:30:251
227797399401,5cyclictest0-21swapper/100:25:011
2277974993930,5cyclictest2328682-21grep00:00:302
2277974993929,5cyclictest0-21swapper/219:30:282
2277974993920,15cyclictest311ktimers/200:30:152
2277974993920,15cyclictest311ktimers/200:30:142
2277973993928,5cyclictest22-21rcuc/122:05:011
2277973993923,12cyclictest231ktimers/119:35:151
2277973993922,13cyclictest231ktimers/119:50:171
227797399391,7cyclictest0-21swapper/121:10:011
2277973993910,16cyclictest2312659-21/usr/sbin/munin22:30:191
2277973993910,16cyclictest2312659-21/usr/sbin/munin22:30:191
2277974993825,9cyclictest0-21swapper/221:20:242
2277974993822,9cyclictest0-21swapper/222:10:282
2277974993822,12cyclictest311ktimers/220:45:162
227797499381,2cyclictest0-21swapper/200:10:012
2277973993830,4cyclictest0-21swapper/121:00:301
2277973993826,8cyclictest0-21swapper/121:15:001
2277973993826,6cyclictest0-21swapper/100:20:001
227797499373,19cyclictest2304882-21/usr/sbin/munin21:45:192
2277974993730,4cyclictest2320061-21munin-run23:15:002
2277974993727,5cyclictest0-21swapper/221:30:292
2277974993720,12cyclictest311ktimers/223:05:132
2277974993718,14cyclictest311ktimers/223:00:122
227797499371,7cyclictest0-21swapper/221:15:022
227797399378,15cyclictest2280120-21/usr/sbin/munin19:20:171
2277973993728,5cyclictest0-21swapper/120:55:281
2277973993728,5cyclictest0-21swapper/120:55:281
2277973993726,8cyclictest1666-21snmpd19:45:011
2277973993719,12cyclictest231ktimers/122:15:151
2277974993627,5cyclictest0-21swapper/222:35:302
2277974993627,5cyclictest0-21swapper/200:30:012
2277974993620,9cyclictest2330385-21grep00:10:302
2277974993620,5cyclictest0-21swapper/222:40:142
2277973993621,9cyclictest0-21swapper/123:00:281
2277973993621,10cyclictest231ktimers/100:10:131
2277974993526,5cyclictest0-21swapper/221:50:322
2277974993525,5cyclictest0-21swapper/220:05:322
2277974993524,8cyclictest0-21swapper/222:50:002
2277974993519,12cyclictest311ktimers/221:55:152
2277974993518,9cyclictest0-21swapper/220:40:022
2277973993526,6cyclictest2334630-21grep00:35:301
2277973993526,6cyclictest2303718-21grep21:35:311
2277973993526,5cyclictest0-21swapper/123:10:011
2277973993519,11cyclictest231ktimers/121:25:131
2277974993426,4cyclictest0-21swapper/221:25:222
2277974993424,6cyclictest0-21swapper/221:00:232
2277974993423,8cyclictest2298867-21/usr/sbin/munin21:10:252
2277974993417,12cyclictest311ktimers/222:30:142
2277974993417,12cyclictest311ktimers/222:30:142
227797399346,12cyclictest22-21rcuc/119:30:011
227797399345,27cyclictest2322893-21/usr/sbin/munin23:30:191
2277973993427,4cyclictest0-21swapper/122:20:221
2277973993426,4cyclictest0-21swapper/120:10:261
2277973993423,8cyclictest2295491-21/usr/sbin/munin20:50:131
2277973993422,8cyclictest0-21swapper/119:15:301
227797399342,19cyclictest24-21ksoftirqd/121:15:131
2277973993418,8cyclictest0-21swapper/120:05:211
227797499332,5cyclictest2290988-21munin-run20:25:002
2277974993325,5cyclictest0-21swapper/222:55:212
2277974993323,5cyclictest0-21swapper/220:40:312
2277974993319,8cyclictest311ktimers/220:30:052
2277973993326,3cyclictest0-21swapper/120:20:011
2277973993322,8cyclictest2286087-21sshd19:55:211
2277973993320,10cyclictest231ktimers/100:05:131
2277973993320,10cyclictest231ktimers/100:00:151
2277974993225,5cyclictest168450irq/135-8000000.ethernet-tx220:15:282
2277974993224,5cyclictest0-21swapper/220:10:292
227797499321,3cyclictest2286532-21find19:55:312
227797499321,26cyclictest0-21swapper/220:50:182
2277973993224,6cyclictest2319419-21/usr/sbin/munin23:10:331
2277973993223,6cyclictest0-21swapper/121:35:021
2277973993222,5cyclictest0-21swapper/121:55:331
2277973993220,8cyclictest2317533-21sendmail23:00:001
2277973993218,12cyclictest1666-21snmpd23:56:391
2277973993216,12cyclictest231ktimers/120:25:141
2277974993124,4cyclictest0-21swapper/219:15:022
2277974993123,4cyclictest0-21swapper/219:20:272
2277974993122,6cyclictest311ktimers/220:00:142
2277974993120,7cyclictest0-21swapper/219:40:252
2277974993118,10cyclictest311ktimers/221:35:152
2277974993112,5cyclictest27350irq/343-s-wl18xx23:30:162
2277973993125,3cyclictest0-21swapper/100:35:021
2277973993125,3cyclictest0-21swapper/100:35:011
2277973993121,6cyclictest0-21swapper/121:20:331
2277973993113,13cyclictest231ktimers/123:25:111
227797399311,28cyclictest0-21swapper/123:40:251
2277973993111,18cyclictest1666-21snmpd23:52:011
2277973993111,18cyclictest1666-21snmpd23:52:011
227797499301,27cyclictest2280960-21/usr/sbin/munin19:25:302
227797499301,24cyclictest0-21swapper/221:05:112
2277973993023,4cyclictest0-21swapper/119:30:211
2277973993019,7cyclictest0-21swapper/122:25:191
2277973993017,9cyclictest0-21swapper/121:45:201
2277974992918,8cyclictest0-21swapper/222:25:282
227797499291,4cyclictest2324985-21memory23:40:252
2277973992916,8cyclictest231ktimers/122:10:151
227797399291,2cyclictest0-21swapper/100:30:011
2277974992819,5cyclictest0-21swapper/223:45:292
227797499281,25cyclictest0-21swapper/219:50:282
2277973992822,4cyclictest2315817-21kworker/u8:1-writeback22:50:221
2277973992819,7cyclictest2294653-21/usr/sbin/munin20:45:311
2277973992819,4cyclictest0-21swapper/121:45:011
2277974992720,4cyclictest0-21swapper/222:25:002
2277973992715,9cyclictest231ktimers/120:40:161
227797399271,13cyclictest0-21swapper/122:38:211
2277974992619,4cyclictest0-21swapper/223:35:312
2277973992619,4cyclictest168350irq/127-8000000.ethernet-tx119:12:051
227797499251,19cyclictest0-21swapper/200:15:032
2277973992518,3cyclictest0-21swapper/122:40:251
2277974991812,3cyclictest2278019-21latency_hist19:10:012
2277974991812,3cyclictest2278019-21latency_hist19:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional