Are the epsilons independent from each other?

In summary, the variables \varepsilon_t and \varepsilon_{t+1} are not independent from each other, as their relationship is dependent on \sigma_t and z_t through the function f(\sigma,z). Therefore, we cannot write their joint probability density as a product of their individual probabilities.
  • #1
St41n
32
0
[tex]\varepsilon _t = z_t \sigma _t [/tex]

[tex]
z_t \sim IID\,N\left( {0,1} \right)
[/tex]

[tex]
\sigma _t^2 = f\left( {\sigma _{t - 1} ,z_{t - 1} } \right)
[/tex]Are the epsilons independent from each other? Why?
 
Last edited:
Physics news on Phys.org
  • #2


St41n said:
[tex]\varepsilon _t = z_t \sigma _t [/tex]

[tex]
z_t \sim IID\,N\left( {0,1} \right)
[/tex]

[tex]
\sigma _t^2 = f\left( {\sigma _{t - 1} ,z_{t - 1} } \right)
[/tex]


Are the epsilons independent from each other? Why?


I can't see that they could be independent in the general case of [itex] f (\sigma ,z)[/itex] being any real-valued function, since [itex] p(\varepsilon_{t+1} | \sigma_t ,z_t)[/itex] is dependent on [itex]\sigma_t[/itex] and [itex]z_t[/itex], just like [itex] p(\varepsilon_{t} | \sigma_t ,z_t) = \delta(\varepsilon_{t} - \sigma_t z_t)[/itex] ([itex] p[/itex] representing probability densities and [itex] \delta[/itex] the Dirac delta distribution). This implies that

[tex]
p(\varepsilon _t,\varepsilon _{t+1}) = \int\int{
p(\varepsilon_{t} | \sigma_t ,z_t)
p(\varepsilon_{t+1} | \sigma_t ,z_t)
p(\sigma_t)p(z_t)
d\sigma_t dz_t}
[/tex]

cannot, in general, be written as a product [itex]p(\varepsilon _t,\varepsilon _{t+1}) = p(\varepsilon_{t})p(\varepsilon_{t+1})[/itex] as is the case for independent variables.

-Emanuel
 
  • #3


Ok, this makes sense
Thank you very much
 

Related to Are the epsilons independent from each other?

1. Are epsilons independent from each other?

Epsilons refer to the error terms in a statistical model. The independence of these error terms is a crucial assumption in many statistical analyses. In simpler terms, it means that the errors for one data point should not be related to the errors for another data point. So, to answer the question, yes, epsilons should be independent from each other.

2. What happens if the epsilons are not independent?

If the assumption of independence is violated, it can have a significant impact on the validity of the statistical results. Non-independent error terms can lead to biased estimates, inflated standard errors, and incorrect conclusions. Therefore, it is important to check for independence when conducting statistical analyses.

3. How can I test for the independence of epsilons?

There are several methods to test for the independence of epsilons, depending on the type of data and the statistical model being used. Some common methods include the Durbin-Watson test, the Breusch-Godfrey test, and the Ljung-Box test. These tests help to determine if there is any significant correlation between the error terms.

4. Can I still use a statistical model if the epsilons are not independent?

If the assumption of independence is violated, it is not recommended to use the statistical model. However, there are some techniques, such as regression with autocorrelated errors, that can be used to handle non-independent error terms. It is important to consult with a statistician or conduct further research before deciding on the best approach.

5. What can cause the epsilons to be dependent?

There are several reasons why the assumption of independence may be violated. One common cause is the presence of a hidden variable that affects both the dependent and independent variables. Other causes include measurement errors, omitted variables, and autocorrelation in time series data. It is important to carefully examine the data and the model to identify potential sources of dependency between the error terms.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
Replies
0
Views
457
Replies
3
Views
657
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
995
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
0
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
14
Views
2K
  • Advanced Physics Homework Help
Replies
4
Views
1K
Back
Top