These are the first two pretests. I have a vague concern about the research, not knowing exactly what the focus or story is. I am considering xx. Created a qualification in MTurk for one participant to allow him to be in future problem pit studies. I need to create an acceptance sampling method to keep the number of pre-test participants bounded.
- The questions they wanted to ask seemed to be very specific to the problem, much more specific than we were thinking. Their main concerns were logistic issues, issues of confidentiality, security, what to do with the frame, how it works.
- They seemed to base their questions on what would concern them, confirming the self-projection theory.
- Both participants were U.S. and had MTurk masters qualification.
- Both said they would not enroll. Seems like they were being more honest than the last sample.
- "The survey itself was nicely designed, but it was frustrating to have to advance the page so often. More than one question per page is preferable, in my opinion. I didn't really like the Recruitment Document being in a separate window, I think it could be included in the survey itself, as an example, and it would be easier to reference. I thought it was really too long, with too many questions that seemed like variations on the same theme. Those are pretty much the only suggestions that I have to offer, outside of what I answered in the survey itself."
- Has too many questions to make a decision to enroll.
- How does the frame work?
- How does it affect privacy?
- Who has access to photos/data? Who owns the rights?
- What happens if they withdraw from the study?
- Do they have to give the frame back at the end of the study?
- Advancing page too often
- Include recruitment document in the survey itself, rather than a separate window
- Too long
- Redundant questions
- Broke the questionnaire up into multiple pages, with a random subset of two questions on each page.
- Cut the length by having participants do two-thirds (55) of the predictions.