Engagement & Satisfaction Surveys Webinar 2 ăƒť August 2014
Answer these five questions: 1. Why conduct the survey? 2. How to design the survey? 3. How to collect the data? 4. How to analyze the data? 5. What to do with the results? Š 2015 Lawyer Metrics
2
Why Conduct an Engagement Survey?
© 2015 Lawyer Metrics
3
Why Conduct an Engagement Survey? Organizations with higher engagement have: • Higher Retention Rates • Higher Productivity • More Passionate and Energetic Workers • Less Worker Stress • Higher Profitability © 2015 Lawyer Metrics
4
Professional Development Staff versus Management Professional Development may be on the frontlines of issues regarding the workforce but often times cannot persuasively communicate this to Management.
Š 2015 Lawyer Metrics
5
Professional Development Staff working with Management To convey the issues in a way that management will hear, present them with objective data.
Š 2015 Lawyer Metrics
6
How to Design the Survey?
Š 2015 Lawyer Metrics
7
How to Design the Survey? What do engagement surveys typically measure? 1. Attitudes – positive/negative orientations toward object. 2. Beliefs – opinions about state of the world. © 2015 Lawyer Metrics
8
Measuring an Attitude Q: Which of the following describes your position on opening an office in Las Vegas? 1. 2. 3. 4. 5.
Strongly Opposed. Opposed. Neutral. In Favor. Strongly In Favor. Š 2015 Lawyer Metrics
9
Measuring a Belief Q: Most of the time, I know what is expected of me at the firm. 1. 2. 3. 4. 5.
Strongly Disagree. Disagree. Neutral. Agree. Strongly Agree. Š 2015 Lawyer Metrics
10
How to Design the Survey? What to consider when designing an engagement survey? • • • •
Topic Areas Question Types Common Pitfalls Odds and Ends © 2015 Lawyer Metrics
11
Topic Areas Organize questions around broad themes. For example: • Flexibility/Life Balance • Communication
© 2015 Lawyer Metrics
12
Question Types Two types of questions possible: • Open-Ended – allow people to answer in their own words. • Closed-Ended – offer a series of alternatives from which participant must choose. © 2015 Lawyer Metrics
13
Open-Ended Question Q: Are you are granted an appropriate level of responsibility at the firm? Why or why not?
Š 2015 Lawyer Metrics
14
Closed-Ended Question Q: I am offered increasing levels of responsibility when I am ready.
Strongly Disagree
Disagree
Neutral
Š 2015 Lawyer Metrics
Agree
Strongly Agree
15
Pitfalls to Avoid Common problems with survey questions include: • Ambiguous Phrasing • Multiple Stimuli • Loaded Questions © 2015 Lawyer Metrics
16
Ambiguous Phrasing Q: In the last few months, I have received enough feedback on my work.
Š 2015 Lawyer Metrics
17
Ambiguous Phrasing Q: In the last few months, I have received enough feedback on my work. Q: Partners at the firm provide me with feedback on my work.
Š 2015 Lawyer Metrics
18
Multiple Stimuli Q: Partners provide feedback on my work product and business development skills.
Š 2015 Lawyer Metrics
19
Multiple Stimuli Q: Partners provide feedback on my work product and business development skills. Q: Partners provide feedback on my work product.
Š 2015 Lawyer Metrics
20
Loaded Questions Q: The esteemed leaders of the firm are usually responsive to staff members.
Š 2015 Lawyer Metrics
21
Loaded Questions Q: The esteemed leaders of the firm are usually responsive to staff members. Q: Firm leaders are responsive to staff members.
Š 2015 Lawyer Metrics
22
How to Collect the Data?
Š 2015 Lawyer Metrics
23
How to Collect the Data? 1. Collect using electronic tool.
Š 2015 Lawyer Metrics
24
How to Collect the Data? 1. Collect using electronic tool. 2. Emphasize anonymity.
Š 2015 Lawyer Metrics
25
How to Collect the Data? 1. Collect using electronic tool. 2. Emphasize anonymity. 3. Send reminders.
Š 2015 Lawyer Metrics
26
How to Collect the Data? 1. 2. 3. 4.
Collect using electronic tool. Emphasize anonymity. Send reminders. Track response rates.
Š 2015 Lawyer Metrics
27
How to Analyze the Data?
Š 2015 Lawyer Metrics
28
How to Analyze the Quantitative Data? • With quantitative questions, can calculate and compare average scores to identify strengths and weaknesses. • Also possible to identify strongest drivers of general engagement using regression analysis. © 2015 Lawyer Metrics
29
Topic Area Strengths & Weaknesses
Š 2015 Lawyer Metrics
30
Strength: Professional Development
Š 2015 Lawyer Metrics
31
Weakness: Flexibility & Life Balance
Š 2015 Lawyer Metrics
32
How to Analyze the Qualitative Data? • Qualitative analysis of comments brings concrete, easy-to-grasp examples to bear on quantitative results. • Themes in the comments enrich understanding about the quantitative results. © 2015 Lawyer Metrics
33
Strength: Professional Development
Š 2015 Lawyer Metrics
34
Qualitative Data on Strength: Professional Development Comments provide information on what the employees are thinking. It allows you to dig deeper into the quantitative data.
Š 2015 Lawyer Metrics
35
General Engagement “Overall I am happy working at the firm.”
Strongly Disagree
Disagree
Neutral
© 2015 Lawyer Metrics
Agree
Strongly Agree
36
What to do with the Results?
Š 2015 Lawyer Metrics
37
What to do with the Results? Most effective way to deliver results to management is by connecting quantitative results with qualitative examples.
Š 2015 Lawyer Metrics
38
What to do with the Results? Equally as important, ensure that the participants know that you have analyzed the data, reviewed the comments, looked closely at the themes that emerged, so that they feel they have been heard.
Š 2015 Lawyer Metrics
39
Confidentiality Concerns One issue with doing an internal survey is confidentiality concerns. To work around this you have two options:
Š 2015 Lawyer Metrics
40
Confidentiality Concerns 1. Use a survey platform that allows you to get results that are not identifiable in any way.
Š 2015 Lawyer Metrics
41
Confidentiality Concerns 1. Use survey platform that allows you to get results that are not identifiable in any way. 2. Use a third party or outside company to run the survey and do the reporting.
Š 2015 Lawyer Metrics
42
How Lawyer Metrics Can Help • Anonymity • Objective review of narrative comments • Statistical analysis to help set priorities • Explaining findings, especially using graphics • Year-to-year comparisons © 2015 Lawyer Metrics
43