Practical Considerations in Computer Based Testing

Author: Cynthia G. Parshall
Publisher: Springer Science & Business Media
ISBN: 1461300835
Format: PDF
Download Now
This book introduces computer-based testing, addressing both nontechnical and technical considerations. The material is oriented toward practitioners and graduate students. The practical emphasis will be useful to measurement professionals who are or will be responsible for implementing a computerized testing program. The instructional information is also designed to be suitable for a one-semester graduate course in computerized testing in an educational measurement or quantitative methods program. While certain theoretical concepts are addressed, the focus of the book is on the applied nature of computerized testing. For this reason, the materials include such features as example applications, figures, and plots to illustrate critical points in the discussions. A wide range ofnontechnical issues need to be considered in implementing a computer-based testing program. Separate chapters are provided on test administration and development issues, examinee issues, software issues, and innovative item types. Test administration and delivery issues include the location of exam administration, selection of hardware and software, security considerations, scheduling of administration frequency and time limits, cost implications, and program support as well as approaches for addressing reliability, validity, comparability, and data analysis. Examinee issues include the influence ofexaminees' reactions to adaptive testing, the effect ofcomputer based task constraints, and the impact of examinees' prior computer experience. Software issues include usability studies and software evaluation as tools in selecting and developing appropriate software, based on the test program needs.

Computerized Multistage Testing

Author: Duanli Yan
Publisher: CRC Press
ISBN: 146650580X
Format: PDF, ePub, Mobi
Download Now
Devising tests that evaluate a nation’s educational standing and implement efficacious educational reforms requires a careful balance among the contributions of technology, psychometrics, test design, and the learning sciences. Unlike other forms of adaptive testing, multistage testing (MST) is highly suitable for testing educational achievement because it can be adapted to educational surveys and student testing. Computerized Multistage Testing: Theory and Applications covers the methodologies, underlying technology, and implementation aspects of this type of test design. The book discusses current scientific perspectives and practical considerations for each step involved in setting up an MST program. It covers the history of MST, test design and implementation for various purposes, item pool development and maintenance, IRT-based and classical test theory-based methodologies for test assembly, routing and scoring, equating, test security, and existing software. It also explores current research, existing operational programs, and innovative future assessments using MST. Intended for psychologists, social scientists, and educational measurement scientists, this volume provides the first unified source of information on the design, psychometrics, implementation, and operational use of MST. It shows how to apply theoretical statistical tools to testing in novel and useful ways. It also explains how to explicitly tie the assumptions made by each model to observable (or at least inferable) data conditions. Winner of the 2016 AERA Award for Significant Contribution to Educational Measurement and Research Methodology The 2016 American Education Research Association (AERA) Div. D award committee for Significant Contributions to Educational Measurement and Research Methodology has recognized unanimously this collaborative work advancing the theory and applications of computerized MST. This annual award recognizes published research judged to represent a significant conceptual advancement in the theory and practice of educational measurement and/or educational research methodology. The 2016 award was made under the heading: Measurement, Psychometrics, and Assessment. This collective work, published in 2014 as an edited volume titled Computerized Multistage Testing: Theory and Applications, was cited by the committee both for the originality of the conceptual foundations presented in support of multistage testing and for arguing persuasively for its potential impact on the practice of educational measurement.

Elements of Adaptive Testing

Author: Wim J. van der Linden
Publisher: Springer Science & Business Media
ISBN: 0387854614
Format: PDF, Kindle
Download Now
The arrival of the computer in educational and psychological testing has led to the current popularity of adaptive testing---a testing format in which the computer uses statistical information about the test items to automatically adapt their selection to a real-time update of the test taker’s ability estimate. This book covers such key features of adaptive testing as item selection and ability estimation, adaptive testing with multidimensional abilities, sequencing adaptive test batteries, multistage adaptive testing, item-pool design and maintenance, estimation of item and item-family parameters, item and person fit, as well as adaptive mastery and classification testing. It also shows how these features are used in the daily operations of several large-scale adaptive testing programs.

Handbook of Psychology Research Methods in Psychology

Author: John A. Schinka
Publisher: John Wiley & Sons
ISBN: 0471264431
Format: PDF, ePub, Docs
Download Now
Includes established theories and cutting-edge developments. Presents the work of an international group of experts. Presents the nature, origin, implications, an future course of major unresolved issues in the area.

Test Equating Scaling and Linking

Author: Michael J. Kolen
Publisher: Springer Science & Business Media
ISBN: 1493903179
Format: PDF, Kindle
Download Now
This book provides an introduction to test equating, scaling and linking, including those concepts and practical issues that are critical for developers and all other testing professionals. In addition to statistical procedures, successful equating, scaling and linking involves many aspects of testing, including procedures to develop tests, to administer and score tests and to interpret scores earned on tests. Test equating methods are used with many standardized tests in education and psychology to ensure that scores from multiple test forms can be used interchangeably. Test scaling is the process of developing score scales that are used when scores on standardized tests are reported. In test linking, scores from two or more tests are related to one another. Linking has received much recent attention, due largely to investigations of linking similarly named tests from different test publishers or tests constructed for different purposes. In recent years, researchers from the education, psychology and statistics communities have contributed to the rapidly growing statistical and psychometric methodologies used in test equating, scaling and linking. In addition to the literature covered in previous editions, this new edition presents coverage of significant recent research. In order to assist researchers, advanced graduate students and testing professionals, examples are used frequently and conceptual issues are stressed. New material includes model determination in log-linear smoothing, in-depth presentation of chained linear and equipercentile equating, equating criteria, test scoring and a new section on scores for mixed-format tests. In the third edition, each chapter contains a reference list, rather than having a single reference list at the end of the volume The themes of the third edition include: * the purposes of equating, scaling and linking and their practical context * data collection designs * statistical methodology * designing reasonable and useful equating, scaling, and linking studies * importance of test development and quality control processes to equating * equating error, and the underlying statistical assumptions for equating

Modern Statistics for the Social and Behavioral Sciences

Author: Rand Wilcox
Publisher: CRC Press
ISBN: 1439834563
Format: PDF, ePub
Download Now
In addition to learning how to apply classic statistical methods, students need to understand when these methods perform well, and when and why they can be highly unsatisfactory. Modern Statistics for the Social and Behavioral Sciences illustrates how to use R to apply both standard and modern methods to correct known problems with classic techniques. Numerous illustrations provide a conceptual basis for understanding why practical problems with classic methods were missed for so many years, and why modern techniques have practical value. Designed for a two-semester, introductory course for graduate students in the social sciences, this text introduces three major advances in the field: Early studies seemed to suggest that normality can be assumed with relatively small sample sizes due to the central limit theorem. However, crucial issues were missed. Vastly improved methods are now available for dealing with non-normality. The impact of outliers and heavy-tailed distributions on power and our ability to obtain an accurate assessment of how groups differ and variables are related is a practical concern when using standard techniques, regardless of how large the sample size might be. Methods for dealing with this insight are described. The deleterious effects of heteroscedasticity on conventional ANOVA and regression methods are much more serious than once thought. Effective techniques for dealing heteroscedasticity are described and illustrated. Requiring no prior training in statistics, Modern Statistics for the Social and Behavioral Sciences provides a graduate-level introduction to basic, routinely used statistical techniques relevant to the social and behavioral sciences. It describes and illustrates methods developed during the last half century that deal with known problems associated with classic techniques. Espousing the view that no single method is always best, it imparts a general understanding of the relative merits of various techniques so that the choice of method can be made in an informed manner.

Multidimensional Item Response Theory

Author: M.D. Reckase
Publisher: Springer Science & Business Media
ISBN: 9780387899763
Format: PDF, ePub, Mobi
Download Now
First thorough treatment of multidimensional item response theory Description of methods is supported by numerous practical examples Describes procedures for multidimensional computerized adaptive testing

Research on PISA

Author: Manfred Prenzel
Publisher: Springer Science & Business Media
ISBN: 9400744587
Format: PDF, ePub, Docs
Download Now
The Programme for International Student Assessment (PISA) is an important part of the OECD's Indicator Programme. It collects data and provides comparative indicators of education systems in OECD member and partner countries. PISA provides datasets of outstanding quality regarding samples, instruments and analyses. In addition to its important function for educational monitoring, the PISA datasets are the basis of a wide range of secondary analyses from a number of different scientific perspectives and disciplines. The aim of this book is to make some of the outstanding PISA related research results available for a wider audience. Specifically four research areas will be focused: (1) Content related research; (2) Methodological research; (3) Context related research; (4) Research on trends in PISA. Each part of the book is devoted to one of these areas and will start with an introduction from a leading expert in the field followed by chapters covering research conducted in this field.

Psychological Testing

Author: Theresa J.B. Kline
Publisher: SAGE Publications
ISBN: 1506315941
Format: PDF, ePub, Mobi
Download Now
Psychological Testing: A Practical Approach to Design and Evaluation offers a fresh and innovative approach for graduate students and faculty in the fields of testing, measurement, psychometrics, research design, and related areas of study. Author Theresa J.B. Kline guides readers through the process of designing and evaluating a test, while ensuring that the test meets the highest professional standards. The author uses simple, clear examples throughout and fully details the required statistical analyses. Topics include—but are not limited to—design of item stems and responses; sampling strategies; classical and modern test theory; IRT program examples; reliability of tests and raters; validation using content, criterion-related, and factor analytic approaches; test and item bias; and professional and ethical issues in testing.