Search ETDs:
A Monte Carlo Study of Parallel Analysis, Minimum Average Partial, Indicator Function, and Modified Average Roots for Determining the Number of Dimensions with Binary Variables in Test Data: Impact of Sample Size and Factor Structure
Ruengvirayudh, Pornchanok

2018, Doctor of Philosophy (PhD), Ohio University, Educational Research and Evaluation (Education).
Determining the number of dimensions underlying many variables in the data or many items in the test is a crucial process prior to performing exploratory factor analysis. Failure to do so leads to serious consequences concerning construct validity. Parallel analysis (PA) has been found to be useful to determine the number of dimensions (i.e., components or factors) in many conditions. As computational power of computers is much advanced, novel procedures have been developed to improve the accuracy of PA. Authors of a number of previous studies have investigated the use of parallel analysis with scale data (e.g., questionnaires).

However, little research has been conducted on the performance of PA when applied to existing real test data. This present study, therefore, compared the consistency of PA and other criteria (i.e., minimum average partial, broken stick, average root and modified average roots, imbedded error, and indicator function) in extracting the number of dimensions from large existing real test data at the population level (approximately 400,000 cases) based on these studied variables: sample size, factor structure, number of randomly generated data sets, threshold, and type of input correlation matrices. R scripts in the R program were written to repeatedly sample from a population’s data in a Monte Carlo simulation procedure and to run the analyses.

Consistent methods yielding precise results under most studied conditions were: MAP, IND, PACOR95 (i.e., PA using the original correlation matrices with 1s on the diagonal) with the 95th percentile as a threshold and 100 randomly generated data sets, and MAR1.4 (i.e., 1.4*Average Root), respectively. When practitioners have small sample sizes of at least 100, MAP is recommended for use. PA performed consistently with sample sizes of at least 200. However, MAP and PA are not incorporated in commercial statistical software (e.g., SPSS, SAS). Therefore, alternative methods are recommended for use in place of or in conjunction with recommended methods to compare the results. IND and MAR1.4 are recommended for use with sample sizes of at least 200 and 300, respectively. However, BS and IE are not recommended due to large errors and unvaried results of other than one dimension when n = 100, respectively.

In general, a sample size of 100 is not recommended for use because it is not sufficient to yield precise results. Sample sizes of 200, 300, and 400 are recommended to be minimum, acceptable, and desirable sample sizes to yield consistent results. In this study, an unbalanced factor structure (i.e., unequal numbers of items in each dimension) showed a negative impact on the precision of the factor extraction results. Tutorials on how to perform PA and the other five criteria with examples were presented.
Gordon Brooks (Committee Chair)
Krisanna Machtmes (Committee Member)
Anirudh Ruhil (Committee Member)
Michelle O'Malley (Committee Member)
367 p.

Recommended Citations

Hide/Show APA Citation

Ruengvirayudh, P. (2018). A Monte Carlo Study of Parallel Analysis, Minimum Average Partial, Indicator Function, and Modified Average Roots for Determining the Number of Dimensions with Binary Variables in Test Data: Impact of Sample Size and Factor Structure . (Electronic Thesis or Dissertation). Retrieved from https://etd.ohiolink.edu/

Hide/Show MLA Citation

Ruengvirayudh, Pornchanok. "A Monte Carlo Study of Parallel Analysis, Minimum Average Partial, Indicator Function, and Modified Average Roots for Determining the Number of Dimensions with Binary Variables in Test Data: Impact of Sample Size and Factor Structure ." Electronic Thesis or Dissertation. Ohio University, 2018. OhioLINK Electronic Theses and Dissertations Center. 23 Sep 2018.

Hide/Show Chicago Citation

Ruengvirayudh, Pornchanok "A Monte Carlo Study of Parallel Analysis, Minimum Average Partial, Indicator Function, and Modified Average Roots for Determining the Number of Dimensions with Binary Variables in Test Data: Impact of Sample Size and Factor Structure ." Electronic Thesis or Dissertation. Ohio University, 2018. https://etd.ohiolink.edu/

Files

Full text release has been delayed at the author's request until June 01, 2020