Validating survey instruments

The PSEQ was piloted with institutions in 2009 and will be offered as an option to all institutions from 2010.The PSEQ is conducted online only and takes 15 minutes or less to complete.Average overall grade is captured in a single item, and the other six are composite measures which reflect responses to several items: Three different survey instruments used to collect data as part of the AUSSE.These are the Student Engagement Questionnaire (SEQ) which is administered to first- and third-year undergraduate students, the Postgraduate Student Engagement Questionnaire (PSEQ) which is administered to postgraduate coursework students, and the Staff Student Engagement Questionnaire (SSEQ) which is used to survey academic staff.Helpful tips on how to reduce survey bias using pre and post tests. Crafting Questions with Less Bias This fact sheet by Nancy Ellen Kiernan, Penn State University, is on developing less biased yes or no questions. Cover Letter for a Survey This fact sheet by Nancy Ellen Kiernan, Penn State University, discusses how to construct a survey cover letter to enhance response rate. Provides useful alternative to yes-no questions to get data that better meets your purpose for asking the question. Measuring Barriers to Change This fact sheet by Nancy Ellen Kiernan, Penn State University, presents how to include survey questions on barriers to change.Helpful tips on how to develop and use surveys to determine why changes may not have occurred. Pre- and Post-Testing with More Impact This Journal of Extension article by Greg La Barge, Ohio State University, discusses removing the element of guessing by pre-post test respondents. Program Evaluation Network User's Guide This guide by Joseph L.Donaldson, University of Tennessee, is specifically designed for using with their internal reporting system, contains useful information on program assessment and evaluation.Access to the PEN system is not possible for those outside the UT system.

Cases are selected to achieve 10% validation of each interviewer's caseload.To confirm that the interview was conducted properly, respondents are asked whether the interview took place, length of the interview, mode of the interview, number of sessions required, and whether the incentive payments were made.To assess data quality, respondents are asked a few questions from the survey. The data are analyzed to compare the responses in the interview and validation reinterview.The SEQ is based on the USA National Survey of Student Engagement (NSSE) College Student Report and has been extensively validated for use in Australasian higher education through a series of focus groups, consultations, cognitive interviews, pilot testing, expert reviews and psychometric analyses.These validation processes builds upon the extensive validation conducted in the USA.Designing Surveys and Questions: Chapter from book Survival Statistics This tutorial by David Walonick, is an on-line except from the book Survival Statistics, written by a former university professor. A Field Guide to Designing Quantitative Instruments to Measure Program Impact This how to guide by Dr. Barkman, Purdue University, is an easy to use, step by step guide to determining and developing appropriate survey instruments. Designing an Effective Questionnaire This fact sheet by Christine Chavez, Loyola Marymount University, highlights five common steps in good survey design and can serve as a guide when designing your own surveys. Example Extension Program Evaluation Tools This how to guide by Richard L. Samples of Surveys & Related Evaluation Tools (conducted via mail, telephone, personal interview & web)This website by Keith Diem, Rutgers University, offers an array of survey samples and related instruments in conducting evaluations. Choosing Appropriate Answer Categories This fact sheet by Janet Bechman, Purdue University, focuses on choosing survey question answer categories. Helpful tips on how to develop and use answer categories. Good examples of how to encourage and clarify responses, limit responses and control an interview. Question Order This fact sheet by Nancy Ellen Kiernan, Penn State University, discusses how question order can bias responses.

569

Leave a Reply