Question:
Why do I have more responses than expected for my Qualtrics survey that was anonymously distributed? Why are there responses recorded that are unfinished and don't answer all of the questions?
Answer:
- Qualtrics records incomplete surveys. This is the most common reason survey responses could be unfinished or for many more survey responses recorded than expected.
- Sometimes, respondents will get partway through a survey but not finish; for example, they may get an email and forget to go back to the survey. By default, Qualtrics records these responses, even though the user didn't click Submit.
- Instructions and an explanation of the Recording incomplete responses are here.
For an existing survey, you can check to be sure each response is a completed submission. In your data, add a filter for "Survey Metadata -> Finished -> Is -> True" (alternatively, filter for False and then delete those responses).
- If the survey should remain anonymous but you need to make sure it isn't taken multiple times, you can turn on "Prevent multiple submissions", which will prevent the same device and browser from submitting the survey more than once. You can also turn on "Duplicate Detection", which will do the same check after the survey is submitted.
- Qualtrics records each submission, including auto-generated tests and survey previews.
- When someone is working on creating the survey and tests it using the "Preview" button, this response gets recorded; if Qualtrics generates test responses, these responses are recorded. True responses come from an IP address, which means a device outside of a test or preview response.
- Instructions and an explanation of the Multiple Submission setting are here.
For an existing survey, you can check to be sure each response is a true submission. In your data, add a filter for "Survey Metadata -> Response Type -> Is -> IP Address" (alternatively, filter on Is Not and then delete those responses).