Skip to main content

Understanding the Impact of Editing Survey Questions After Launch

Learn the impact of editing survey questions after launch and how changes may affect your results and data interpretation.

Written by Jared Ellis

Who can use this feature?

Available on:

  • All Culture Amp subscriptions that include Engagement or Effectiveness (Manager and Team Effectiveness surveys).

Editing the survey questions can be problematic if your survey has already been launched. If some respondents have already answered the question, changing the question can make the results difficult to interpret as respondents taking the survey were effectively answering different questions.

There are scenarios where you want to edit survey questions after the survey has launched. The following table summarizes the impact this may have on results, and the recommended approach for making the change.

Scenario

Impact

Recommended Approach

There is a spelling or grammatical error in a question

None

Update the question

I’d like to update a question to clarify what it means.

Minor

Update the question but ensure the edits only clarify the meaning and don’t change the meaning

The question referred to Department X when it should have referred to Department Y

Major

Update the question and note the results and n-size collected so far for context when reviewing results later.

For onboard and exit surveys, move the original question to "questions not shown to participants" in your survey configuration, and create a new one for the correct department instead. These surveys are continuous, meaning participants respond over time, so simply editing the question would permanently and indefinitely mix wrong-department and correct-department responses together in reporting.
Moving the question to the 'not shown to participants' section preserves existing responses if ever needed, while stopping it from appearing to new participants.

To also hide the question from report viewers, remove it from its Reporting Factor as well.

Note: Deleting a question will permanently delete all responses connected to it, so is not recommended unless you are ok with this.

I want to stop asking a question

Major

Edit the question’s Section field and choose the blank option at the top of the drop-down list. It will no longer appear in future surveys, but will remain in reports.

The question is a Rating question, but the wrong scale was selected

None

Correct the Scale type, done on Answer Details tab of question.

The question was set up as a Rating question (e.g. agreement scale) when it should have been a Single Select question

Major

Correct the question type to a Single Select question and be aware that you will not see results for any respondents that answered the question as a Rating question (it’s highly likely that these won’t make much sense anyway!)

Another option would be to assign the Rating question to the questions not shown to participants section and create a new question using the Single Select option.

The question was set up as a Rating question (e.g. agreement scale) when it should have been a Free Text

Major

Correct the question type to a Free Text question and be aware that you will not see results for any respondents that answered the question as a Rating question (it’s highly likely that these won’t make much sense anyway!).

Another option would be to assign the Rating question to the questions not shown to participants section and create a new question using the Free Text option.

I need to update one of the options in a Single Select Question to correct a spelling mistake

Minor

Make the update. As the option represents the same ‘thing’ – e.g. Manager name John Smith is corrected to be Jon Smith there will be no impact to results.

I need to update the Single Select question where I ask respondents to ‘select their manager’ to reflect that ‘John Smith’ has left and a new manager ‘Jane Doe’ has started

It depends

In this scenario you should take care to remove the option that you no longer want to be an option (John Smith) and add a new option that you would like to be available (Jane Doe). You should never relabel an existing option for this scenario as all of the previous results and new results will end up mixed in to the same option.

I’d like to add another question to the survey

None

Add the question. Just remember that the question will only be added to surveys that are yet to be submitted

I’d like to remove an option from a Single Select question

None

Remove the option. Remember that if respondents had already selected the option when they submitted their survey response, then the option will still appear in the reporting. If the option is yet to be selected then it will disappear from the reporting completely.

I'd like to add a new select option to a demographic question

Minor

Add the option. Just keep in mind that, any options added post-survey launch can only be seen by participants that have not taken the survey yet.

I'd like to make a question mandatory

It depends

There's an article here explaining why Culture Amp does not recommend mandatory questions. Results may skew especially when there are participants who have already responded to the survey and skipped the question before making it mandatory.

If you follow these guidelines when editing a live survey, the impact on results should be minimized. If you get stuck or would like some advice, just reply with "Ask a Person" in a Support Conversation to speak with a Product Support Specialist.

FAQs


If I delete a question from a live survey, will I lose the responses for that question?

Yes! Deleting a question will permanently delete all responses submitted for it. This action cannot be undone.

To avoid losing data while stopping new responses, we recommend moving the question to the "questions not shown to participants" section. This keeps the question and its data in your reports for anyone who has already answered it, but hides it from the remaining participants when taking the survey.

If you also want to hide the question from report viewers while keeping the data intact, take one additional step after moving the question to "questions not shown to participants":

  1. Move the question to "questions not shown to participants" — future participants won't see it, and existing responses are preserved.

  2. Remove the question from its Reporting Factor on the Reporting Factors page — report viewers won't see it in results.

This way, the response data is retained and accessible if ever needed, but the question won't appear to new participants or in reports going forward.


💬 Need help? Just reply with "Ask a Person" in a support conversation to speak with a Product Support Specialist.

Did this answer your question?