Taylor expansion of gaussian integral with respect to variance

In summary, the conversation was about finding a way to perform a Taylor series expansion of an integral with respect to variance \epsilon, which posed some difficulties due to a singularity at \epsilon=0. The speaker suggested using the Method of Steepest Descent by Taylor expanding the function close to the origin and keeping only the lowest order terms. Another solution was proposed by rescaling x_i with \sqrt \epsilon, making the integral analytically solvable. The Method of Steepest Descent was acknowledged as a smart approach for future applications.
  • #1
norman86
5
0
Hi everyone. The problem I have to face is to perform a taylor series expansion of the integral

[tex] \int_{-\infty}^{\infty}\frac{e^{-\sum_{i}\frac{x_{i}^{2}}{2\epsilon}}}{\sqrt{2\pi\epsilon}^{N}}\cdot e^{f(\{x\})}dx_{i}\ldots dx_{N} [/tex]

with respect to variance [tex]\epsilon[/tex]. I find some difficulties because the function in the integral has a singularity in [tex]\epsilon=0[/tex] and this makes calculation a bit strange, but it must be possible to calculate the taylor series coefficients (I need them only at second order). In fact, for zero variance the entire integral reduces to f(0) besause the gaussian function becomes a Dirac's delta distribution centered in 0.

The function f is a polynomial of degree 4 in all x variables and contains only even powers and terms like x_i x_j, so it is not possible to factor it into product of single terms dependending only from i index.

I have tried to expand f in series and use the moment generating function of the gaussian, but neither this trick seems to work. Nor I have had much luck expanding the gaussian. Anyone has some ideas? Thank you.
 
Physics news on Phys.org
  • #2
You're right that as [itex]\epsilon \rightarrow 0[/itex] you get a delta function that picks out f(0). So, what I might do is use the fact that as [itex]\epsilon[/itex] gets very small most of the contribution to the integral is going to come from the region just around the origin, so you can Taylor expand your function f close to the origin (easy to do since it's a polynomial), and just have to keep the lowest order terms. Since you only have even powers, you essentially get a Gaussian. That is, for [itex]\epsilon[/itex] small,

[tex]\int_{-\infty}^{\infty}\frac{e^{-\sum_{i}\frac{x_{i}^{2}}{2\epsilon}}}{\sqrt{2\pi \epsilon}^{N}}\cdot e^{f(\{x\})}dx_{i}\ldots dx_{N} \approx e^{f(0)}\int_{-\infty}^{\infty}e^{-\sum_{i}\frac{x_{i}^{2}}{2\epsilon}}\cdot e^{\frac{1}{2}x_iA_{ij}x_j}dx_{i}\ldots dx_{N} [/tex].
where
[tex]A_{ij} = \frac{\partial^2 f}{\partial x_i \partial x_j}[/tex]
and the denominator has been neglected for a reason I will explain below. Note also that I'm using the summation convention: repeated dummy indices are summed over.

One potential danger: I'm assuming that the integrand is most sharply peaked at the origin. To be really careful what I ought to do is look for the minima of the exponent,

[tex] -\frac{1}{\epsilon}\left(\frac{x_i x_i}{2} - \epsilon f(x) + \frac{N \epsilon}{2}\ln(2\pi \epsilon)\right)[/tex]

However, unless f(x) contains a 1/epsilon, then as epsilon gets small the minimum should be close to the origin, and as long as N doesn't tend to infinity the constant logarithmic term won't matter and can be neglected compared to the other terms as epsilon tends to zero, hence why I neglected it above. If you wanted to do higher order corrections, though, you would need to consider the minima of the above expression.

If N does get large in any point of the calculation, you'll need to constrain it such that [itex]N\epsilon[/itex] is fixed as N goes to infinity and epsilon goes to zero in order to have a well defined expression.

Finally, note that the result is an asymptotic expression, not from an exact series expansion.

This method is called the Method of Steepest Descent (look it up, but note that http://en.wikipedia.org/wiki/Method_of_steepest_descent isn't really useful). The complex-form is also useful, called the Method of stationary phase.
 
Last edited:
  • #3
Thank you very much. I have fixed this problem by simply rescale [tex]x_i[/tex] with [tex]\sqrt \epsilon[/tex]. this makes [tex]\epsilon[/tex] disappear from any fraction and the structure of even powers of the polynomial makes everything analytical and taylor expandeable.

The idea of the steepest descent method is a smart one. I'll think about it for some future applications.
 

Related to Taylor expansion of gaussian integral with respect to variance

1. What is a Taylor expansion?

A Taylor expansion is a mathematical tool used to approximate a function as a polynomial. It involves expressing a function as an infinite sum of terms, each term representing the contribution of a particular derivative of the function at a given point.

2. What is a Gaussian integral?

A Gaussian integral is a type of definite integral that involves the Gaussian function, also known as the bell curve. It is used to calculate the area under the curve of a normal distribution and is commonly used in statistics and probability.

3. What is the variance in a Gaussian integral?

The variance in a Gaussian integral represents the spread or variability of the data in a normal distribution. It is a measure of how far the data points are from the mean of the distribution.

4. How is the Taylor expansion of a Gaussian integral with respect to variance calculated?

The Taylor expansion of a Gaussian integral with respect to variance involves taking the derivative of the integral with respect to the variance and expressing it as an infinite sum of terms, similar to a regular Taylor expansion. The resulting terms can then be simplified to obtain a closed-form expression.

5. What is the significance of the Taylor expansion of a Gaussian integral with respect to variance?

The Taylor expansion of a Gaussian integral with respect to variance allows us to approximate the value of the integral for different values of the variance. This is useful in various fields, including statistics, physics, and engineering, where the Gaussian function and its integrals are commonly used.

Similar threads

Replies
2
Views
1K
Replies
2
Views
2K
Replies
5
Views
2K
  • Calculus
Replies
1
Views
1K
Replies
19
Views
3K
  • Calculus
Replies
15
Views
2K
Replies
3
Views
1K
Replies
7
Views
2K
Replies
3
Views
4K
Back
Top