Top

Creating Custom Questions: Strategies for Success Print or save as PDF

Custom questions allow you to tailor your survey implementation to your local needs in addition to providing a powerful tool to further the interpretation of your overall survey results. To maximize the impact of these questions, we recommend the following 5-step approach.

  1. Identify area of inquiry
  2. Determine your target participants
  3. Determine purpose of information
  4. Ensure participants can respond from experience
  5. Choose an appropriate response format
  6. Use words that lead to actionable results and avoid common pitfalls

Focus groups 

You may want to ask a custom question, but first would like to find out how students would interpret the question, to make sure that they understand what is asked of them. Focus groups can be used to test new survey questions before you include them in the survey. See our Focus Group Recommendations article for more information.

 

  1. Identify an area of inquiry
    It is important to decide on an area that will assist with school improvement planning or provide further insight into the setting of an ongoing research initiative.

  2. Determine your target participants

    Is your district currently using, or considering adding multiple surveys from the OurSCHOOL suite? Consider developing questions to capture valuable information from multiple sources. The process of developing custom questions is the same across the student, parent, and teacher surveys. You can create custom questions to measure specific areas of interest for each survey type that you use or consider developing a question to tap into the opinions of all of your stakeholders. 

    Using the same custom question(s) across all three surveys will allow you to easily compare the attitudes and experiences of your whole school community. Do students and teachers feel your new mental health initiatives are effective? How do parents and teachers think they can maximize one-on-one meetings? Do any of your stakeholders have recommendations about how to increase parent involvement at your school? The more perspectives you can capture, the more complete your school picture.


  3. Determine the purpose of the additional information being sought
    Be clear on why you want to gain insight into that particular area and how the information will help with the school planning process. Custom questions can be used to:

    a. Collect information or feedback pertaining to a specific focus area or initiative

    Ex. You may have a working group on student voice and would like to find out the most effective way to engage all students in the decision-making process.

    b. Collect further information or follow up on the results of a previous survey

    Ex. Last year, you may have noticed a decline in the results of a particular measure (Participation in Clubs) and would like to collect more detailed information to inform strategic planning (how the school can make participation in clubs more accessible to students).

     

  4. Ensure that the content allows participants to respond through their experience
    To maximize the reliability of information collected through custom questions, participants must be able to speak from their personal experience as opposed to guessing about the experiences of others. Consider using an illustrative scenario to help prompt participants to reflect on a situation that could easily be applicable to themselves.

    Ex. “If your friend told you they were having trouble with their homework, what would you tell them to do?”


  5. Choose an appropriate response format
    Consider the purpose for collecting data and how you plan to analyse the responses. It is important to consider how responses will be reported and whether this format provides actionable feedback. Some questions are better suited as multiple choice, some as multiple answer, and some as open-ended.

    Note: Open-Ended Questions are only available at the school level.
      • Open-Ended Questions (OEQs) are best utilised as a means of gathering a wide range of responses, collecting a variety of suggestions, and encouraging further dialogue. They can be used to collect qualitative data, general feedback, follow up on quantitative findings, generate ideas, and find evidence of successes or areas in which the school could be doing better.

        Ex. “Please list three courses you would like to see added to the fall catalogue.”
      • Multiple-Choice Questions (MCQs) are used to collect numerical data that can be used to demonstrate facts and uncover patterns related to prevalent trends in thought, opinion, attitudes, behaviours, and other specific variables. MCQs are reported as the total percentage of respondents that selected each response option, and can be used to drill down in the Interactive Charts. To learn more about this feature, click here.

        Ex. “Which of the following courses would you like to see added to the course catalogue?”
      • Multiple-Answer Questions (MAQs) also provide the opportunity to collect measurable quantities of data that can be used to demonstrate facts and discover patterns in thought, opinion, attitudes, behaviors, and other contextually relevant variables. Unlike MCQs, MAQs are reported as the total number of respondents that selected each response option. Since each respondent has the option to select multiple answers, MAQs cannot be used as drill-downs in the Interactive Charts.

        Ex. “Please select any of the following courses you would like to see added to the fall catalogue.”

Did you know?

For more examples of each type of custom question, see our sample custom questions for the Student (OEQ, MCQ, MAQ), Parent, and Teacher Surveys.

 

6. Use words that will yield actionable results and avoid common pitfalls
Pay careful attention to the wording of questions and be specific. Things to take into consideration when crafting questions…

  • Length: Too long or too short
  • Double-barreled/ too complicated
    • Original: Do you think what you are learning in school is interesting and useful for your future career choice?
    • Revised: Do you think what you are learning in school is useful for your future career choice?
  • Redundant (they are already covered in survey content)
  • Inviting the identification of students or staff
  • Likely to cause divisions in your school community
  • Difficult to act upon
    • For example, questions regarding sleep habits of students
  • Spelled incorrectly or grammatically incorrect
  • Contain difficult terms students are not familiar with
  • Negatively worded questions
    • Original: Students should not be marked absent if they are late for class?
    • Revised: Students should be marked absent if they are late for class?
  • Sensitive topics that may make students uncomfortable or that may require additional preparation. Ensure you have resources to support these topics.

Need support in crafting your custom questions?

Feel free to also reach out to the OurSCHOOL Engagement/ Research Team who can work with you one-on-one to craft actionable questions to capture the voices of your school community.