Follow

Text analytics in reports


What can I learn from this page?

How to interpret Text analytics 

Who is this guide for?

Account Admins, Survey Admins, Survey Creators, Report Viewers

 

Quick Links:

 

NOTE: Text Analytics is available for Engagement, Manager Effectiveness, Lifecycle (onboarding/exit) and Team Effectiveness surveys only. It is not available for Reviewer notes in Lifecycle surveys or Individual Effectiveness surveys. 

Text Analytics is a set of tools backed by smart algorithms designed to help you get maximum insight from written feedback. How does it work?

  • automatically classifies every comment into one or more of nineteen pre-defined high-level themes (like ‘leadership’, ‘work-life’ or ‘salary’ – see the full list)
  • analyzes responses for sentiment (‘positive’, ‘negative’ or ‘neutral’)
  • provides topic, sentiment, rating and question filters that allow you to slice and dice comments into the most useful subset
  • visualizes all the comments in a bubble chart that gives you a bird’s-eye view of what people are saying and how they’re feeling

You will find Text Analytics in the Comments Report via the link in the reporting navigation.

How to read the Topic Sentiment chart

Screen_Shot_2021-08-27_at_10.05.48_AM.png

This chart combines topic and sentiment analysis to give you an immediately digestible view of all the comments in your survey. The topic bubbles show the % of comments that have been assigned to that particular topic. 

The further to the right of the chart a topic appears, the more positive it is, and more negative topics appear on the left. Neutral or polarized topics sit closer to the center of the chart. The biggest bubbles represent the largest groups of comments, and the average sentiment line shows you whether, overall, comments in your survey are more positive or negative.

Hovering over any topic bubble will give you a quick view of the sentiment breakdown for the topic – particularly helpful in the case of more neutrally-positioned topics – along with the overall number of comments in that set.

The percentages shown on the bubbles represent the proportion of comments that this bubble represents.

How to use Comment Filters

Screen_Shot_2021-08-27_at_11.02.27_AM.png

We have four additional ways to filter comments: by question, by topic, by sentiment and by rating. You can combine these filters to further narrow the comments in a set – for example, you might like to see negative comments left on positively-rated questions, or just the comments about ‘Salary’ in response to a specific question. 

You can also apply standard demographic filters.

The Text Analytics report can be exported in CSV or Excel format. The Excel export contains a summary sheet in addition to a sheet of all comments and their classifications. Both CSV and Excel exports respect the currently applied demographic and comment filters.

How to edit a sentiment or topic tag

You can delete or reclassify / retag the sentiment and topic of any comment using the edit function.  

Admins can still only choose from the prescribed 4 sentiment options (Positive, Negative, Neutral, No sentiment)  and 19 prescribed topics (Autonomy, Career, Collaboration, Communication, Company Performance, Environment, Feedback, Feeling good, Innovation, Leadership, Learning & Development, Manager, Product & Services, Recognition, Salary, Systems & Resources, Work Life, No comment, Unclassified) with only 1 sentiment tag and a restriction of 2 topics allowed.

mceclip1.png

mceclip2.png

Save comments to return to later

To save any comments, click save next to the comment in your reporting view:

mceclip0.png

Each user has their own list of saved comments which are unique to them. Other users are not able to see which comments you have saved within this view.

mceclip1.png

Use keyword search for comments

  1. Go to the comments report 
  2. To the right of the report you will see the search field
  3. This appears on any survey with a 'comments report' (excludes 360 & performance surveys) on open and closed surveys

mceclip0.png

Whatever word you enter into the search bar will return comments with exact word matches in any order sequence within the one comment. For example when searching: "Hot desk" you might see: "my desk gets hot being near the window" or "I really like the idea of hot desk". Key points to note:

  • Special characters eg: $!@ are ignored in searches
  • This is an exact match feature eg: when searching for "on" the results will show all comments with "on" NOT "only" or "one."
  • Some languages that use picture characters (such as Chinese or Japanese)can be searched, but require a space between the picture characters to find a match. The platform searches whole words only, not partial words.

FAQ's

Who can see text analytics in the comments report?

The access to the Text Analytics report is the same as for the Comments report. If you allow comments access, then Text Analytics will be enabled as well.

Which topics does the classifier recognize?

Our algorithm is trained on over half a million pieces of employee feedback to recognize this set of common topics.

  • Career: Career progress and development
  • Salary: Compensation and benefits
  • Learning & Development: Learning and development
  • Collaboration: Inter and intra team collaboration
  • Autonomy: Autonomy as individuals or team in making decisions
  • Company Performance: General company performance
  • Products & Services: Related to products and services offered by the company
  • Innovation: Innovation / general improvements in products/services
  • Communication: Management and general organizational communication
  • Systems & Resources: Internal systems. processes and resources
  • Environment: Aspects related to the workplace environment and facilities
  • Feedback: Performance reviews and general feedback
  • Recognition: Role and work recognition
  • Leadership: Related to senior leaders and management in general
  • Manager: Manager-specific comments
  • Work Life: Work life balance
  • Feeling Good: Short comments expressing positive sentiment
  • No comment: Comments that are synonyms for ‘no comment’.
  • Unclassified: Comments that are unable to be classified

Can I create my own custom topics?

Not at this time.

Are there benchmarks to help me understand whether my results are 'normal'?

We don't have benchmarks in the platform yet, but this article documents some of our findings including which topics are popular in which industries and regions, which topics people talk most negatively about, and which topics people talk most positively about, in general.

Text Analytics isn't very helpful for me – can it be disabled?

Yes! By default, your Comments report will show the topic sentiment bubble chart and topic and sentiment tags for each comment, but you can ask Support to disable this functionality at an account or survey level. Eventually we'll put this power in your hands, but for now you'll need to ask one of our team to do it for you.

Who can adjust the comment sentiment and topics?

Only those with admin permissions can adjust comment sentiment and topics.

How many topics can be assigned per comment? 

Only two topics maximum can be assigned per comment.

I have strong feelings about the Comments report and Text Analytics. Can I share them with you?

By all means! Please send your ideas and feedback to support@cultureamp.com and they'll forward them onto our product team. It's a great time to share your thoughts, because we'll be investing a lot of time in this part of the platform over the next few months.

#Engagement #Experience #Effectiveness #Attributed #Unattributed #Continuous #TeamEffectiveness #ManagerEffectiveness #ReportingViews #Comments/TextAnalytics

 

 



Was this article helpful?
0 out of 2 found this helpful
Have more questions? Submit a request

Comments