You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 03:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6s.osadl.org (updated Thu Apr 25, 2024 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
565359999995,2cyclictest0-21swapper/022:20:010
565359998617,54cyclictest131ktimers/019:40:100
565359998617,54cyclictest131ktimers/019:40:100
565359997659,4cyclictest1633-21snmpd19:15:070
565360996112,17cyclictest586117-21/usr/sbin/munin21:20:161
56535999581,31cyclictest15-21rcuc/000:00:010
565359995746,6cyclictest0-21swapper/020:55:100
56535999571,30cyclictest15-21rcuc/022:45:010
565362995644,8cyclictest576530-21munin-plugin-st20:25:002
56536099551,2cyclictest0-21swapper/123:50:191
56536099549,28cyclictest565521-21/usr/sbin/munin19:10:171
56536099541,29cyclictest0-21swapper/122:50:011
565360995339,9cyclictest580001-21munin-plugin-st20:45:011
56535999531,41cyclictest0-21swapper/022:55:090
56536099521,32cyclictest0-21swapper/123:10:011
56536099521,32cyclictest0-21swapper/123:10:011
565359995246,4cyclictest0-21swapper/021:15:020
565362995140,8cyclictest613118-21run-parts00:00:002
565362995130,10cyclictest32-21ksoftirqd/223:45:002
56535999516,11cyclictest14-21rcu_preempt20:10:010
56535999511,3cyclictest0-21swapper/019:40:000
56535999511,2cyclictest0-21swapper/020:30:110
56536099509,19cyclictest585255-21/usr/sbin/munin21:15:201
565359995039,6cyclictest0-21swapper/022:50:290
565359995039,6cyclictest0-21swapper/022:50:290
56535999501,25cyclictest572226-21grep19:55:320
565362994940,5cyclictest573149-21munin-plugin-st20:04:592
565362994935,10cyclictest0-21swapper/200:10:332
565359994930,15cyclictest131ktimers/022:20:090
565359994930,15cyclictest131ktimers/022:20:090
56535999492,9cyclictest0-21swapper/023:50:190
565360994840,4cyclictest577458-21munin-plugin-st20:30:001
565359994835,8cyclictest0-21swapper/023:35:300
565359994734,9cyclictest0-21swapper/020:25:010
56535999469,14cyclictest25050irq/422-mmc119:35:010
565359994630,9cyclictest0-21swapper/020:25:310
565359994629,14cyclictest131ktimers/023:15:140
565360994532,8cyclictest0-21swapper/119:30:251
565360994531,10cyclictest0-21swapper/123:55:271
565360994530,8cyclictest0-21swapper/120:50:281
565359994527,13cyclictest131ktimers/022:35:110
565359994527,13cyclictest131ktimers/022:35:110
56535999451,35cyclictest0-21swapper/023:25:090
565362994434,7cyclictest14-21rcu_preempt19:55:322
565362994434,6cyclictest14-21rcu_preempt21:50:192
565360994436,5cyclictest619987-21sendmail00:40:001
56536099442,9cyclictest0-21swapper/119:45:021
565360994428,8cyclictest0-21swapper/122:00:001
565360994425,13cyclictest231ktimers/120:00:151
565359994437,4cyclictest597743-21munin-plugin-st22:30:000
56535999441,40cyclictest613701-21ps00:00:300
565362994335,4cyclictest14-21rcu_preempt00:35:302
565360994329,9cyclictest0-21swapper/123:35:301
56536099431,2cyclictest0-21swapper/121:10:021
565359994331,8cyclictest0-21swapper/000:20:300
565359994316,25cyclictest131ktimers/021:35:010
565362994231,7cyclictest566397-21wc19:15:012
565362994230,8cyclictest0-21swapper/222:20:272
565362994230,8cyclictest0-21swapper/222:20:272
565362994227,10cyclictest311ktimers/222:50:122
565362994227,10cyclictest311ktimers/222:50:122
565362994226,8cyclictest0-21swapper/223:30:292
565360994230,8cyclictest588441-21munin-plugin-st21:35:001
565360994229,9cyclictest0-21swapper/120:19:591
56536099421,27cyclictest0-21swapper/121:45:011
565359994235,4cyclictest20950irq/251-8000000.ethernet22:30:240
565359994229,9cyclictest0-21swapper/020:35:290
565359994229,8cyclictest607021-21grep23:20:280
565359994229,8cyclictest0-21swapper/020:10:320
565359994213,17cyclictest566194-21munin-node19:15:010
565362994134,4cyclictest14-21rcu_preempt20:05:212
565362994129,9cyclictest311ktimers/220:25:142
565362994129,8cyclictest0-21swapper/222:15:282
565362994128,9cyclictest0-21swapper/223:00:302
565362994128,10cyclictest0-21swapper/219:50:342
565362994127,11cyclictest311ktimers/221:25:102
565362994125,8cyclictest0-21swapper/223:20:282
565362994124,8cyclictest0-21swapper/220:10:322
565360994133,4cyclictest0-21swapper/122:25:271
565360994129,8cyclictest231ktimers/100:10:161
565360994129,8cyclictest0-21swapper/120:20:321
565360994127,8cyclictest0-21swapper/120:10:321
565360994121,14cyclictest231ktimers/121:50:101
565359994128,9cyclictest0-21swapper/021:55:300
565359994128,8cyclictest0-21swapper/000:05:310
565362994024,9cyclictest0-21swapper/222:25:292
565360994024,10cyclictest0-21swapper/123:30:291
565360994022,13cyclictest231ktimers/119:20:071
565360994022,10cyclictest0-21swapper/122:10:281
565359994027,8cyclictest591820-21munin-plugin-st21:55:000
565359994019,4cyclictest0-21swapper/023:00:140
565359994012,4cyclictest293-21systemd-journal21:20:000
565362993929,6cyclictest0-21swapper/221:00:172
565362993927,6cyclictest311ktimers/223:10:112
565362993925,9cyclictest0-21swapper/221:35:252
565362993925,9cyclictest0-21swapper/221:35:252
565360993929,6cyclictest0-21swapper/122:20:001
565360993927,7cyclictest0-21swapper/122:05:211
565360993927,7cyclictest0-21swapper/122:05:211
565360993925,9cyclictest0-21swapper/121:05:321
565359993931,4cyclictest21150irq/209-8000000.ethernet00:30:020
565359993931,4cyclictest21150irq/209-8000000.ethernet00:30:010
565359993927,7cyclictest0-21swapper/021:20:280
565359993924,12cyclictest6150081/usr/sbin/munin00:10:320
565359993923,12cyclictest131ktimers/021:40:130
56535999391,8cyclictest618833-21phc2sys00:30:240
56535999391,3cyclictest0-21swapper/020:50:010
56535999391,2cyclictest0-21swapper/000:40:010
56535999391,27cyclictest0-21swapper/022:08:330
56535999391,27cyclictest0-21swapper/022:08:330
565362993832,4cyclictest566775-21sendmail19:19:592
565362993832,4cyclictest14-21rcu_preempt00:23:152
565362993830,6cyclictest14-21rcu_preempt21:10:312
565362993827,7cyclictest0-21swapper/222:00:282
565362993826,8cyclictest0-21swapper/223:15:302
565362993826,6cyclictest311ktimers/200:00:132
565360993828,7cyclictest231ktimers/100:25:121
565360993828,7cyclictest231ktimers/100:25:121
565359993831,4cyclictest20050irq/27-20000000.i2c21:25:160
565359993830,5cyclictest293-21systemd-journal23:35:000
565359993828,7cyclictest293-21systemd-journal22:15:000
565359993827,8cyclictest0-21swapper/023:10:280
565359993825,9cyclictest0-21swapper/023:05:260
565359993825,9cyclictest0-21swapper/023:05:260
56535999381,25cyclictest0-21swapper/021:37:240
56535999381,25cyclictest0-21swapper/021:37:240
565362993730,4cyclictest165150irq/135-8000000.ethernet-tx222:45:162
565362993729,5cyclictest598580-21grep22:30:302
565362993728,5cyclictest165150irq/135-8000000.ethernet-tx220:35:002
565362993727,6cyclictest0-21swapper/221:40:312
565362993726,8cyclictest0-21swapper/200:30:012
565362993726,8cyclictest0-21swapper/200:30:012
565362993725,9cyclictest0-21swapper/221:55:292
565362993725,8cyclictest0-21swapper/219:45:302
565362993725,7cyclictest0-21swapper/221:50:012
565362993722,7cyclictest0-21swapper/221:30:342
565360993728,5cyclictest0-21swapper/123:15:171
565360993728,5cyclictest0-21swapper/100:20:301
565360993726,7cyclictest0-21swapper/120:30:331
565360993725,8cyclictest231ktimers/121:35:151
565360993725,8cyclictest231ktimers/121:35:151
565360993720,11cyclictest0-21swapper/120:55:291
56536099371,3cyclictest0-21swapper/123:20:021
56535999371,5cyclictest0-21swapper/019:25:010
56535999371,25cyclictest0-21swapper/022:01:120
56535999371,25cyclictest0-21swapper/020:04:290
56535999370,3cyclictest610505-21apt-get23:45:010
565362993630,3cyclictest609648-21sh23:40:002
565362993629,4cyclictest165150irq/135-8000000.ethernet-tx220:45:142
565362993626,5cyclictest0-21swapper/223:25:282
565362993625,8cyclictest612170-21grep23:50:302
565362993625,7cyclictest0-21swapper/222:45:002
565362993624,8cyclictest0-21swapper/222:05:312
565362993624,8cyclictest0-21swapper/222:05:312
565362993622,10cyclictest30-21rcuc/219:30:122
565362993621,8cyclictest0-21swapper/221:15:312
56536299361,29cyclictest0-21swapper/223:45:012
56536099367,12cyclictest615848-21/usr/sbin/munin00:15:221
565360993628,4cyclictest0-21swapper/122:00:251
565360993623,8cyclictest0-21swapper/122:50:191
565360993623,8cyclictest0-21swapper/122:50:191
565359993626,7cyclictest0-21swapper/000:15:340
565359993625,8cyclictest0-21swapper/021:05:240
565359993617,8cyclictest15-21rcuc/019:50:150
56535999361,25cyclictest0-21swapper/020:50:430
565362993529,4cyclictest582524-21munin-plugin-st21:00:012
565362993526,5cyclictest0-21swapper/220:15:292
565362993522,9cyclictest0-21swapper/222:35:292
565362993522,9cyclictest0-21swapper/222:35:292
565362993521,8cyclictest30-21rcuc/219:20:172
565362993521,8cyclictest14-21rcu_preempt21:05:182
565360993528,4cyclictest566667-21grep19:15:061
565360993522,8cyclictest231ktimers/123:25:121
565360993522,8cyclictest231ktimers/100:30:111
565360993521,10cyclictest0-21swapper/120:35:291
565360993521,10cyclictest0-21swapper/120:05:311
56536099351,5cyclictest0-21swapper/100:05:021
56536099351,28cyclictest0-21swapper/123:45:011
565359993529,3cyclictest575118-21tune2fs20:15:200
565359993519,10cyclictest0-21swapper/022:45:190
565359993517,16cyclictest0-21swapper/020:40:230
565359993514,11cyclictest0-21swapper/019:49:110
565362993423,7cyclictest619028-21grep00:30:272
565360993424,7cyclictest0-21swapper/120:45:281
565360993422,9cyclictest0-21swapper/123:10:251
56535999343,27cyclictest0-21swapper/021:00:280
565359993428,4cyclictest21150irq/209-8000000.ethernet21:45:190
565362993327,4cyclictest569408-21kernelversion19:40:202
565362993327,4cyclictest569408-21kernelversion19:40:202
565362993321,8cyclictest0-21swapper/223:05:272
565362993321,8cyclictest0-21swapper/223:05:272
56536299331,25cyclictest614956-21sed00:10:012
565360993325,4cyclictest0-21swapper/121:45:281
565360993323,7cyclictest0-21swapper/121:00:311
565360993321,7cyclictest231ktimers/122:40:121
565359993328,2cyclictest0-21swapper/019:10:010
56535999331,17cyclictest0-21swapper/023:49:400
565362993223,6cyclictest30-21rcuc/222:55:202
565362993223,5cyclictest0-21swapper/219:30:012
565362993223,5cyclictest0-21swapper/219:30:012
565362993222,7cyclictest0-21swapper/220:35:292
565362993220,9cyclictest0-21swapper/220:40:252
565360993221,8cyclictest0-21swapper/122:20:271
565360993221,8cyclictest0-21swapper/122:20:271
565360993221,6cyclictest1633-21snmpd21:25:461
565360993220,8cyclictest571345-21grep19:50:341
565360993220,8cyclictest0-21swapper/119:55:291
565362993126,3cyclictest14-21rcu_preempt22:10:152
565362993123,6cyclictest30-21rcuc/200:15:272
565362993122,6cyclictest30-21rcuc/220:50:252
565360993120,7cyclictest0-21swapper/122:35:291
565360993120,7cyclictest0-21swapper/122:35:291
565362993021,6cyclictest30-21rcuc/221:20:172
56536299301,22cyclictest0-21swapper/219:38:002
565360993021,6cyclictest0-21swapper/123:00:301
565360993019,8cyclictest0-21swapper/100:00:321
565360993018,8cyclictest0-21swapper/122:30:301
565360992918,7cyclictest0-21swapper/122:55:181
565360992918,5cyclictest22-21rcuc/119:40:251
565360992918,5cyclictest22-21rcuc/119:40:251
565359992917,9cyclictest567833-21sshd19:28:000
565359992917,9cyclictest567833-21sshd19:28:000
565360992816,8cyclictest0-21swapper/123:45:281
56536099281,5cyclictest0-21swapper/119:25:001
56536099281,5cyclictest0-21swapper/119:25:001
565360992717,7cyclictest0-21swapper/119:10:011
56536099251,7cyclictest568911-21apt19:40:001
565362992317,3cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional