Qualitative analysis of survey responses
Client
A public company established over 100 years ago, employing nearly 2000 individuals, and serving more than 300,000 clients daily.
Context
Over the past two decades, a 40% increase in employees has significantly transformed the company's managerial culture. To understand and measure these changes, the company needed a fresh perspective on its current management practices and how managers perceive the company's values. Collaborating with sociologists, the HR office designed a comprehensive survey aimed at aligning management expectations with behavioural principles and professional practices,ultimately providing actionable recommendations for cultural change.
Project and Results
The HR office called Team Argusa to analyse the survey, which consisted of numerous open-ended questions, and to create dashboards for presentation to senior management. Analysing free-text answers and qualitative survey is inherently challenging due to language variability and the need for contextual understanding. Traditional methods often fall short to extract consistent insights from such diverse and complex data.
Team Argusa addressed these challenges using advanced NLP techniques like Sentence-BERT and sentiment analysis to generate contextualized embeddings and categorize sentiments expressed in the survey responses. This approach captures the true semantic meaning of sentences, enabling more accurate comparisons. Our expertise allowed us to handle the complex dataset, delivering actionable insights and precise reports that highlighted our technical proficiency and commitment to leveraging cutting-edge technology for our clients' needs.
The following diagram illustrates the detailed process we employed for analyzing the survey responses using SBERT:
The analysis not only confirmed many intuitive assumptions but also uncovered interesting insights into how managerial expectations differ and converge across various company positions. This deeper understanding will allow the company to better align its values and improve communication by focusing on the concerns that are most important to employees.
In two weeks,we conducted the analysis and delivered a detailed dashboard, along with precise documentation of the method:
- NLP Techniques Applied: Utilized advanced NLP methods to analyse open-ended survey responses.
- Value Alignment Analysis: Compared survey responses with the company’s core values and reported on the most prevalent themes.
- Sentiment Analysis: Conducted sentiment analysis on various themes, such as the evolution of the company over the years.
- Documentation Creation: Developed comprehensive documentation and examples to facilitate easy interpretation of comparison scores.
- Dashboard Creation: Designed interactive dashboards that analysed each question individually and provided comparative insights across relevant questions, offering a global view of the survey results.
Conclusion
In just two weeks, Team Argusa provided a thorough analysis and insightful reporting, enabling the company to gain a deep understanding of its managerial culture and employee perceptions. The actionable recommendations derived from this analysis will guide the company in implementing effective cultural change.
Tools
Tableau Desktop and Server, Python
Client
A public company established over 100 years ago, employing nearly 2000 individuals, and serving more than 300,000 clients daily.
Context
Over the past two decades, a 40% increase in employees has significantly transformed the company's managerial culture. To understand and measure these changes, the company needed a fresh perspective on its current management practices and how managers perceive the company's values. Collaborating with sociologists, the HR office designed a comprehensive survey aimed at aligning management expectations with behavioural principles and professional practices,ultimately providing actionable recommendations for cultural change.
Project and Results
The HR office called Team Argusa to analyse the survey, which consisted of numerous open-ended questions, and to create dashboards for presentation to senior management. Analysing free-text answers and qualitative survey is inherently challenging due to language variability and the need for contextual understanding. Traditional methods often fall short to extract consistent insights from such diverse and complex data.
Team Argusa addressed these challenges using advanced NLP techniques like Sentence-BERT and sentiment analysis to generate contextualized embeddings and categorize sentiments expressed in the survey responses. This approach captures the true semantic meaning of sentences, enabling more accurate comparisons. Our expertise allowed us to handle the complex dataset, delivering actionable insights and precise reports that highlighted our technical proficiency and commitment to leveraging cutting-edge technology for our clients' needs.
The following diagram illustrates the detailed process we employed for analyzing the survey responses using SBERT:
The analysis not only confirmed many intuitive assumptions but also uncovered interesting insights into how managerial expectations differ and converge across various company positions. This deeper understanding will allow the company to better align its values and improve communication by focusing on the concerns that are most important to employees.
In two weeks,we conducted the analysis and delivered a detailed dashboard, along with precise documentation of the method:
- NLP Techniques Applied: Utilized advanced NLP methods to analyse open-ended survey responses.
- Value Alignment Analysis: Compared survey responses with the company’s core values and reported on the most prevalent themes.
- Sentiment Analysis: Conducted sentiment analysis on various themes, such as the evolution of the company over the years.
- Documentation Creation: Developed comprehensive documentation and examples to facilitate easy interpretation of comparison scores.
- Dashboard Creation: Designed interactive dashboards that analysed each question individually and provided comparative insights across relevant questions, offering a global view of the survey results.
Conclusion
In just two weeks, Team Argusa provided a thorough analysis and insightful reporting, enabling the company to gain a deep understanding of its managerial culture and employee perceptions. The actionable recommendations derived from this analysis will guide the company in implementing effective cultural change.
Tools
Tableau Desktop and Server, Python