# Improved estimation for linear models under different loss functions

PhD Thesis

*Improved estimation for linear models under different loss functions.*PhD Thesis Doctor of Philosophy. University of Southern Queensland.

Title | Improved estimation for linear models under different loss functions |
---|---|

Type | PhD Thesis |

Authors | |

Author | Hoque, Zahirul |

Supervisor | Khan, Shahjahan |

Institution of Origin | University of Southern Queensland |

Qualification Name | Doctor of Philosophy |

Number of Pages | 187 |

Year | 2004 |

Abstract | This thesis investigates improved estimators of the parameters of the linear regression models with normal errors, under sample and non-sample prior information about the value of the parameters. The estimators considered are the unrestricted estimator (UE), restricted estimator (RE), shrinkage restricted estimator (SRE), preliminary test estimator (PTE), shrinkage preliminary test estimator (SPTE), and shrinkage estimator (SE). The performances of the estimators are investigated with respect to bias, squared error and linex loss. For the analyses of the risk functions of the estimators, analytical, graphical and numerical procedures are adopted. In Part I the SRE, SPTE and SE of the slope and intercept parameters of the simple linear regression model are considered. The performances of the estimators are investigated with respect to their biases and mean square errors. The efficiencies of the SRE, SPTE and SE relative to the UE are obtained. It is revealed that under certain conditions, SE outperforms the other estimators considered in this thesis. In Part II in addition to the likelihood ratio (LR) test, the Wald (W) and Lagrange multiplier (LM) tests are used to define the SPTE and SE of the parameter vector of the multiple linear regression model with normal errors. Moreover, the modified and size-corrected W, LR and LM tests are used in the definition of SPTE. It is revealed that a great deal of conflict exists among the quadratic biases (QB) and quadratic risks (QR) of the SPTEs under the three original tests. The use of the modified tests reduces the conflict among the QRs, but not among the QBs. However, the use of the size-corrected tests in the definition of the SPTE almost eliminates the conflict among both QBs and QRs. It is also revealed that there is a great deal of conflict among the performances of the SEs when the three original tests are used as the preliminary test statistics. With respect to quadratic bias, the W test statistic based SE outperforms that based on the LR and LM test statistics. However, with respect to the QR criterion, the LM test statistic based SE outperforms the W and LM test statistics based SEs, under certain conditions. In Part III the performance of the PTE of the slope parameter of the simple linear regression model is investigated under the linex loss function. This is motivated by increasing criticism of the squared error loss function for its inappropriateness in many real life situations where underestimation of a parameter is more serious than its overestimation or vice-versa. It is revealed that under the linex loss function the PTE outperforms the UE if the nonsample prior information about the value of the parameter is not too far from its true value. Like the linex loss function, the risk function of the PTE is also asymmetric. However, if the magnitude of the scale parameter of the linex loss is very small, the risk of the PTE is nearly symmetric. |

Keywords | linear model, unrestricted estimator (UE), restricted estimator (RE), shrinkage restricted estimator (SRE), preliminary test estimator (PTE), shrinkage preliminary test estimator (SPTE), and shrinkage estimator (SE) |

ANZSRC Field of Research 2020 | 490501. Applied statistics |

https://research.usq.edu.au/item/9xxwv/improved-estimation-for-linear-models-under-different-loss-functions

## Download files

##### 2261

total views##### 444

total downloads##### 2

views this month##### 2

downloads this month

## Export as

## Related outputs

##### Gastroesophageal reflux disease following laparoscopic vertical sleeve gastrectomy and laparoscopic roux-en-Y gastric bypass: meta-analysis and systematic review of 5-year data

Memon, Muhammed A, Osland, Emma, Yunus, Rossita M, Alam, Khorshed, Hoque, Zahirul and Khan, Shahjahan. 2024. "Gastroesophageal reflux disease following laparoscopic vertical sleeve gastrectomy and laparoscopic roux-en-Y gastric bypass: meta-analysis and systematic review of 5-year data."*Diseases of the Esophagus.*37 (3), pp. 593-617. https://doi.org/10.1093/dote/doad063

##### Modelling the Association between Vitamin D Deficiency and Incidence of Covid-19 Infection Adjusting for the Confounders and Unobserved Heterogeneity

Hoque, Zahirul, Hossain, Shahadut, Hasan, Masud, Hoque, Irfanul and Haque, Afrozul. 2023. "Modelling the Association between Vitamin D Deficiency and Incidence of Covid-19 Infection Adjusting for the Confounders and Unobserved Heterogeneity."*Journal of Applied Probability and Statistics.*18 (1), pp. 19-33.

##### Differences in levels of E. coli contamination of point of use drinking water in Bangladesh

Hasan, Md. Masud, Hoque, Zahirul, Kabir, Enamul and Hossain, Shahadut. 2022. "Differences in levels of E. coli contamination of point of use drinking water in Bangladesh."*PLoS One.*17 (5), pp. 1-12. https://doi.org/10.1371/journal.pone.0267386

##### Response-based multiple imputation method for minimizing the impact of covariate detection limit in logistic regression

Hossain, Shahadut, Hoque, Zahirul and Wesolowski, Jacek. 2021. "Response-based multiple imputation method for minimizing the impact of covariate detection limit in logistic regression."*Communications in Statistics: Theory and Methods.*50 (2), pp. 371-386. https://doi.org/10.1080/03610926.2019.1635699

##### Preliminary Test Methodology in View of Asymmetry with Elliptically Contoured Distribution

Arashi, M. and Hoque, Z.. 2020. "Preliminary Test Methodology in View of Asymmetry with Elliptically Contoured Distribution."*Journal of Applied Probability and Statistics.*15 (1), pp. 101-112.

##### Shrinkage Estimator of Regression Model Under Asymmetric Loss

Hoque, Zahirul, Wesolowski, Jacek and Hossain, Shahadut. 2018. "Shrinkage Estimator of Regression Model Under Asymmetric Loss."*Communications in Statistics: Theory and Methods.*47 (22), pp. 5547-5557. https://doi.org/10.1080/03610926.2017.1397169

##### Performance of preliminary test estimator under linex loss function

Hoque, Zahirul, Khan, Shahjahan and Wesolowski, Jacek. 2009. "Performance of preliminary test estimator under linex loss function."*Communications in Statistics: Theory and Methods.*38 (2), pp. 252-261. https://doi.org/10.1080/03610920802192471

##### James-Stein estimators for the mean vector of a multivariate normal population based on independent samples from two normal populations with common covariance structure

Khan, Shahjahan and Hoque, Zahirul. 2002. "James-Stein estimators for the mean vector of a multivariate normal population based on independent samples from two normal populations with common covariance structure."*Pakistan Journal of Statistics.*18 (3), pp. 359-381.

##### Estimation of the slope parameter for linear regression model with uncertain prior information

Khan, Shahjahan, Hoque, Zahirul and Saleh, A. K. Md. Ehsanes. 2002. "Estimation of the slope parameter for linear regression model with uncertain prior information."*Journal of Statistical Research.*36, pp. 55- 73.

##### A better alternative to non-parametric approaches for adjusting for covariate measurement errors in logistic regression.

Hossain, Shahadut, Hoque, Zahirul and Hasan, A. H. M. Saidul. 2016. "A better alternative to non-parametric approaches for adjusting for covariate measurement errors in logistic regression."*Communications in Statistics: Simulation and Computation.*45 (8), pp. 2659-2677. https://doi.org/10.1080/03610918.2014.917675

##### Education and Health for Human Security in MMCs: Achievements and the Third Sector Interventions

Hossain, Shahadut and Hoque, Zahirul. 2015. "Education and Health for Human Security in MMCs: Achievements and the Third Sector Interventions ." Hasan, Samiul (ed.)*Human Security and Philanthropy: Islamic Perspectives and Muslim Majority Country Practices*. United States. Springer. pp. 263-288

##### Improved Estimation in regression with Varying Penalty

Hoque, Zahirul and Hossain, Shahadut. 2012. "Improved Estimation in regression with Varying Penalty."*Journal of Statistical Theory and Practice.*6, pp. 260-273. https://doi.org/10.1080/15598608.2012.673878

##### Observed data based estimator and both observed data and prior information based estimator under asymmetric losses

Hoque, Zahirul, Wesolowski, Jacek and Khan, Shahjahan. 2007. "Observed data based estimator and both observed data and prior information based estimator under asymmetric losses."*American Journal of Mathematical and Management Sciences.*27 (1-2), pp. 93-110. https://doi.org/10.1080/01966324.2007.10737690

##### Edgeworth size corrected W, LR and LM test in the formation of the preliminary test estimator

Khan, Shahjahan, Hoque, Zahirul and Billah, Baki. 2006. "Edgeworth size corrected W, LR and LM test in the formation of the preliminary test estimator."*Journal of Statistical Research.*40 (2), pp. 55-64.

##### On the Size Corrected Tests in Improved Estimation

Hoque, Z., Billah, B. and Khan, S.. 2005. "On the Size Corrected Tests in Improved Estimation."*Calcutta Statistical Association Bulletin.*57 (3-4), pp. 143-160. https://doi.org/10.1177/0008068320050301

##### Estimation of the intercept parameter for linear regression model with uncertain non-sample prior information

Khan, Shahjahan, Hoque, Zahirul and Saleh, A. K. Md. E.. 2005. "Estimation of the intercept parameter for linear regression model with uncertain non-sample prior information."*Statistical Papers.*46 (3), pp. 379-395. https://doi.org/10.1007/bf02762840

##### Improved Estimation in Linear Dynamic Regression Model

Hoque, Zahirul and Gerlach, Richard. 2005. "Improved Estimation in Linear Dynamic Regression Model."*Journal of Applied Statistical Science.*17 (2), pp. 309-314.

##### Preliminary test estimators for the multivariate normal mean based on the modified W, LR and LM tests

Khan, S. and Hoque, Z.. 2003. "Preliminary test estimators for the multivariate normal mean based on the modified W, LR and LM tests."*Journal of Statistical Research.*37 (1), pp. 43-55.