# How do I calculate the t-statistic of a regression when I already have the coefficients?

137 ビュー (過去 30 日間)
Steven 2013 年 6 月 10 日
コメント済み: Iris Li 2018 年 6 月 3 日
Hi,
I found the coefficients of a simple regression Y = aX1+bX2 using a maximum likelihood optimization. Now I would like to find the t-statistics of coefficient a and b.
The normal regress functions don't allow me to give them as an input though.
Any suggestions how I can do this?
thanks

サインインしてコメントする。

### 採用された回答

Tom Lane 2013 年 6 月 11 日

If you use regstats to estimate the coefficient standard errors, here's what you get using the Hald data:
s = regstats(heat,ingredients,'linear');
sqrt(diag(s.covb * (8/13)))' % 8/13 converts unbiased variance to mle
If you have another estimator that is the mle for some probability model, you could compute the second derivative of the log likelihood function and use that to estimate the standard errors. Here's an example using the normal distribution so it gives roughly the same answer as above:
loglik = @(b) sum(log(normpdf(heat,b(1)+ingredients*b(2:end),sqrt(8/13)*sqrt(s.mse))));
H = zeros(5);
b = s.beta;
db = 0.001;
for j=1:5,
ej = j==(1:5)';
H(j,j) = (loglik(b+ej*db)-2*loglik(b)+loglik(b-ej*db))/db^2;
for k=j+1:5
ek = k==(1:5)';
H(j,k) = ( loglik(b+ej*db+ek*db) + loglik(b) ...
- loglik(b+ej*db) - loglik(b+ek*db))/db^2;
H(k,j) = H(j,k);
end
end
sqrt(diag(inv(-H)))'

サインインしてコメントする。

### その他の回答 (1 件)

Tom Lane 2013 年 6 月 11 日
The t statistic is the ratio of the estimate to its standard error. If you can determine the standard error, you can take this ratio yourself.
However, least squares is the maximum likelihood method for a regression if the residuals are normally distributed. In that case you can let regress (or regstats or LinearModel) compute the coefficients and t statistics for you. If you have some other estimation method that is not least squares, you would need to determine the standard errors of those estimators.
##### 2 件のコメント表示非表示 1 件の古いコメント
Iris Li 2018 年 6 月 3 日
Hey did you solve you problem? I need to test significance of those coefficients.

サインインしてコメントする。

### カテゴリ

Find more on Multiple Linear Regression in Help Center and File Exchange

### Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by