Presented March 10, 2015
In this workshop, faculty, staff, and students from across our college and centers provided examples of how they use Qualtrics to support research, teaching, and administrative tasks. Use case examples included how to use Qualtrics to:
- Collect longitudinal data as part of a modified Delphi survey technique
- Administer surveys in a facilitated, face-to-face workshop format
- Monitor voting on alumni related matters
- Collect in-house course evaluations to complement the OSU SEI and to document E (fail) and I (incomplete) grades
- Conduct assessment and enhance instruction, particularly course evaluation and providing coaching to instructors in a college-success course
- Facilitate major changes for students, applications to majors, and applications for scholarships
- Keep electronic records to review and evaluate the student’s performance at the end of the semester
- Create email triggers for personalized responses
- Refer people to the appropriate contact and keep thousands of emails out of mailboxes
- Collect student samples and set up Qualtrics to work with Amazon Mturk
- Use location tracking functions and various randomization techniques to look for between group differences
Presenters
Dorinda Gallant, Associate Professor & Program Chair, QREM.
Use Case: Using Qualtrics to collect longitudinal data as part of a modified Delphi survey technique
Brooke Parker, Research Specialist, CETE
Use Case: Administering surveys in a facilitated, face-to-face workshop format using Qualtrics
Sean Thompson, Director, Alumni Relations
Use Case: Using Qualtrics for voting on alumni related matters
Ivan Stefano, Program Coordinator, ESL Composition Program
Use Case: Using Qualtrics for in-house course evaluations to complement the OSU SEI and to document E (fail) and I (incomplete) grades
The ESL Composition Program offers academic writing courses for undergraduate and graduate students across the disciplines at the university. With a total enrollment of about 1,700 each year, our program uses Qualtrics to streamline the internal end-of-term course evaluations process. Through Qualtrics, we are able to design a variety of course evaluations containing a combination of standard and customized questions. To collect responses, we distribute the anonymous course evaluations to the students. Then, after the final course grades have been submitted to Buckeyelink, we share the results of the course evaluations with the instructors through the collaborate feature within Qualtrics. This eliminates the use of paper and creates electronic records. Additionally, we use Qualtrics to document E and I grades.
Lauren Hensley, Associate Director, Dennis Learning Center
Use Case: Using Qualtrics in college-success course (ES EPSY 1259) to conduct assessment and enhance instruction, particularly course evaluation and providing coaching to instructors
Ramsey Piazza, Assistant Director, Scholarships & Undergraduate Curriculum
Use Case: Using Qualtrics as a survey to facilitate major changes for students, applications to majors, and applications for scholarships
Using Qualtrics for Applications
Pros
- Appropriate appearance looks like what you expect it to look like. Does not seem like a third party site and questionable.
- For short applications like major change or specific scholarships where you need little information excellent.
- Attached to our online info session, immediate alert through email for shorter turnaround.
- Excellent interface applications look good easy for applicant very accessible
- Skip logic reduces lengthy lists applicants have to look through. Example: select which department – Ed studies, T&L, Human Sciences, then list programs.
- Uploading of documents straightforward and an asset.
Cons
- Lengthy detailed applications that require skip logic generates multiple columns in export for something that should be one column. Example graduate department. You will have to manually collapse multiple columns into one.
- Export requires significant clean up when intention is to import into a database application
- Finding in process applications is difficult given how Qualtrics organizes results. Unless the individual has very particular data on when they filled out the survey it becomes very difficult to search for as there is no results search tool I am aware of.
- No reporting tool, designed for you to export data and process elsewhere. Excel is not appropriate to manage a large application data set. Mail merge was used with excel data and word to generate reports. That is clunky and data cannot be organized for any analysis. You need a third party database. In our case Access for reporting and data organizing features.
- Qualtrics is not designed for scoring applications or selecting applications. It can only collect data. Those functions would need to be in a third part solution.
Recommendations
- Short applications
- Requiring essays? Consider uploads or be specific with word limit if you have people entering the essay into a field.
- We moved away from major applications and are using TK20 instead – worth considering as an alternative.
Kristall Day, Senior Lecturer, Department of Educational Studies & EdTPA Coordinator, Office of Accreditation, Placement, and Licensure
Use Case: Using Qualtrics as an efficient way to keep electronic records to review to evaluate the student’s performance at the end of the semester
Lisa Barlage, Extension Educator
Use Case: Using Qualtrics to refer people to the appropriate contact and keep thousands of emails out of mailboxes
Milos Bujisic, Assistant Professor, Human Sciences
Use Case: Using student samples and setting up Qualtrics to work with Amazon Mturk
Mturk is an online labor marketplace managed by Amazon. Lately it became a popular tool to distribute cost effective surveys. Several studies have shown that samples obtained with Mturk are at least as good as typical online samples; however the cost is significantly smaller compared to sample obtained by online marketing agency.
Qualtrics and Mturk function are compatible and relatively easy to setup. After the survey is created in qualtrics a link to the survey is distributed to Mturk “workers”. At the end of the survey each worker that qualifies for payment is provided with a unique code that is used for payment processing. Typical surveys cost between 25 cents and 1 dollar per participant.
I primarily use Mturk samples for consumer behavior surveys and online experiments that are created in Qualtrics.
Drew Hanks, Assistant Professor, Human Sciences
Use Case: Using location tracking functions and various randomization techniques to look for between group differences in Qualtrics
Deirdre Rosenfeld, Assistant Coordinator of Student Personnel Assistantship Program
Use Case: Using email triggers for personalized responses within Qualtrics
Additional Resources
Sign up for a Qualtrics account – How to get an EHE Qualtrics account.
Qualtrics University – Access to support and training including live training webinars, online training programs, tutorials, and additional resources.
Contact Qualtrics Customer Support at 800-340-9194.
