BUILDING AND MAINTAINING EFFECTIVE RISK DASHBOARDS

Page 1

Tuesday, June 17 8:30 – 10:00 a.m. Session 42 Session Sponsor: Joint Risk Management Building and Maintaining Effective Risk Dashboards Moderator: Karen J. DeToro, FSA, MAAA Presenters: Karen J. DeToro, FSA, MAAA; Michel Rochette, FSA Risk dashboards can be an effective way for companies to measure and manage their risk exposures. Ideally, dashboards allow management to identify potential problem areas before an adverse event is realized. In this session, attendees will: x x x

Hear about the measures or “indicators” that companies are incorporating into their risk dashboards Be exposed to best practice presentation formats Understand the challenges companies have faced in building and maintaining risk dashboards

Value Ladder: Employer/Client Coordinator: David T. (Todd) Henderson, FSA, MAAA, CERA

Tuesday, June 17 8:30 – 10:00 a.m. Session 43 Session Sponsor: Product Development Cracking the Code: Insurer Solutions to Baby Boomer Retirement Income Needs Moderator: Brian T. Woolfolk, FSA, MAAA Presenters: John M. Fenton, FSA, MAAA; Francois Gadenne, CFA*; Jeyaraj Vadiveloo, FSA, MAAA Everyone is scrambling to find the panacea that will satisfy the incredible demand for reliable retirement income created as baby boomers begin to retire. Insurance carriers look to refresh traditional SPIA products, create new deferred immediate annuities, longevity insurance, and guaranteed lifetime income options on annuity chassis. At the same time, investment houses are developing their own insured and non-insured income solutions. Which of these products will ultimately command the market? Is there a "better" chassis for lifetime withdrawal benefits? Will SPIAs be a solution? Or will the insurance industry lose out to the investment banks? This session will feature presentations from industry experts discussing current solutions, where product development is headed in this space, and how consumers are responding (or not) to the myriad of choices. The pros and cons of various solutions will be discussed - which will aid you in making the right choice of product offering for your firm and customers. Attendees will be able to: x discuss the different retirement income solutions available x describe the pros and cons of the solutions presented x recommend the product solutions that best fit their organizations capabilities Value Ladder: Market Coordinator: John David Currier, FSA, MAAA


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Life 2008 Spring Meeting June 16-18, 2008 Session 42, Building and Maintaining Effective Risk Dashboards Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com). Moderator David T. (Todd) Henderson, FSA, MAAA, CERA Authors Karen J. DeToro, FSA,MAAA Michel Rochette, FSA

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Building & Maintaining Effective Risk Dashboards

Session 42 Society of Actuaries Spring Meeting Quebec City Tuesday, June 17, 2008 8:30am – 10:00am

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Building & Maintaining Effective Risk Dashboards Todd Henderson The Western & Southern Financial Group Michel Rochette AON Global Risk Consulting Karen DeToro Deloitte Consulting LLP

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

1


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Risk Dashboards z

Tool providing consolidated and timely reporting of risk exposures across an enterprise – – – –

All important exposures, at a glance Drilled down and sliced as necessary Early warnings of emerging exposures Allowing preemptive, remedial action

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Keys To Success z

Algorithmics –

– – –

Integrate market risk, credit risk and asset liability reports in a single dashboard Easily created and configured new reports Rich set of visualization elements Interactive and responsive

Source: www.ermsymposium.org/2007/pdf/handouts/CI/CI5_combo.pdf

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

2


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Keys To Success z

ABN Amro/LaSalle Bank – – – –

Comprehensive risk assessment Integrated view of risk, reward and strategy Forward-looking, actionable, risk escalation tool Executive sponsorship

Source: www.ermsymposium.org/2007/pdf/handouts/CI/CI5_combo.pdf

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Keys To Success z

COGNOS – –

– –

Data must be trustworthy The business must be involved in shaping the requirements Content first, then aesthetics Technology and architecture

Source: www.ermsymposium.org/2007/pdf/handouts/CI/CI5_combo.pdf

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

3


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Comprehensive View of Risk Corporate

SBU

SBU

SBU

Credit Market Interest Rate Insurance Operational Business

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Drill Downs & Diagnostics SBU Value AtCorporate Risk = $643 Million

SBU

SBU

Credit Market Interest Rate Insurance Operational Business

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

4


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Forward Looking z

Credit – –

z

Credit spread widening Watchlist increases

Market – –

z

z

Insurance – –

z

Value at Risk Volatility

Underwriting errors Pandemic Alerts

Operational –

Capacity measures

Interest Rate –

Volatility

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Actionable Corporate

SBU

SBU

SBU

Credit Market Interest Rate

Underwriting Limit Breaches = 7

Insurance Operational Business

Chief Underwriter installs system edit prohibiting limit breaches

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

5


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Executive Ownership z

Each measure must be owned by a senior manager – –

z

Ongoing monitoring Remedial action

Business units should be intricately involved in developing requirements – –

Special knowledge Buy-in

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Building & Maintaining Effective Risk Dashboards

Session 42 Society of Actuaries Spring Meeting Quebec City Tuesday, June 17, 2008 8:30am – 10:00am

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

6


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Risk Dashboards Society of Actuaries Spring Meeting

Date June 17th, 2008

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

What is a Risk Dashboard? ¬ As part of ERM, Decision Makers need an integrated view of risk across their enterprise. ¬ Provide an approach to see correlation/links within a risk category and between risks. ¬ Forces the organization to adopt a structured process to understand risk and opportunities: – Review outstanding risk issues – Prioritize management actions – Be forward looking in risk management. – Monitor compliance to existing risk policies

2

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

1


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Audiences: Different Needs ¬ Risk has to be communicated to different groups: – Board level: • To allow them to satisfy their fiduciary duties, making sure that management is actually managing risk. • To assess the level of risk in light of the company’s risk appetite. • To provide with a consolidated view of major threats and opportunities that may affect the value of the company to the different stakeholders.

– Management level: • To provide them with a consolidated view of their company’s risks, a horizontal view instead of a silo view. • To allow them to assess the cost/benefit of implementing controls to reduce risk to the company’s desired risk tolerance/appetite.

– Business level: • To allow them to assess the effectiveness of “control” the risks under their jurisdiction.

3

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Case Study: Sub prime ¬ Sub prime credits were issued in the mortgage department of the retail bank. ¬ Treasury department securitized sub prime credits, created SPVs and sponsored CDOs and the like in line with the new strategic models of banks to issue and sell not hold to maturity as before. ¬ Asset management departments/pension plans of the same banks invested in CDOs. ¬ Retail banks/mutual funds, some owned by the same banks, created new short-term “guaranteed” investment vehicles for retail customers, investing in asset-back securities. ¬ Banks provided liquidity enhancements to SPVs. ¬ Pricing/Valuation models were not stressed tested.

4

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

2


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

How a Dashboard Would Have Helped ¬ A Dashboard should have consolidated the credit exposure for a single FI coming from: – Issuance of the subprime credit – Credit exposure of the SPV. Fis had to consolidate credit exposure back on their balance sheet after August 08 due to Reputational considerations. Ex. Banque Nationale/Desjardins in Quebec, c Citigroup in the US. – Investment by the asset management arm/pension plan.

¬ A Dashboard should have identified the inherent risks of the securitization business: – Operational risk exposure of models used should have been identified. – Liquidity reports of the FI should have taken into consideration the liquidity guarantees offered by banks to SPV. – Market risk reports should have taken into consideration the market risk of position held by the asset management arm/pension plan of Fis. – Potential liabilities/regulatory/compliance issues should have been identified.

5

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Applications of a Dashboard ¬ Presents risk information consistently across the enterprise. ¬ Consolidate risks across the enterprise including outsourced operations. ¬ Allow enterprise to compare/analyze impact of external/emerging events on firm. ¬ Allow firm to monitor adherence to risk appetite using appropriate risk metrics: VAR, EAR, CashFlow at Risk. ¬ Allow firm to publish consistent information to both internal and external audiences.

6

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

3


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Dashboard: In line with Risk Concerns Reputational Risk (52)

Regulatory Risk (40)

Human Capital Risk (40)

IT RISK (35)

Financial, Market, Credit and Insurance Risk (30)

Crime, security, political, natural hazard, FX, Terrorism, Country Risk (20)

Source: Economist Intelligence Unit, 2005 Max Scale: 100 7

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Info: Vulnerability to critical processes

Information on Risk

Measures: Reputational Risk (52)

Regulatory Risk (40)

Physical security breaches Loss events

Human Capital Risk (40)

IT RISK (35)

Fraud incidents Environmental risk

Financial, Market, Credit, FX and Insurance Risk (30)

Operational Risk: Crime, security, political, natural hazard, Terrorism, Country Risk (20)

Source: Economist Intelligence Unit, 2005 Max Scale: 100 8

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

4


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Info: Assets are impaired/capital at risk

Information on Risk

Measures: Reputational Risk (52)

Regulatory Risk (40)

Default rates Liquidity measures Price risk

Human Capital Risk (40)

ALM risk IT RISK (35)

Financial, Market, Credit, FX and Insurance Risk (30) Operational Risk: Crime, security, political, natural hazard, FX, Terrorism, Country Risk (20)

Source: Economist Intelligence Unit, 2005 Max Scale: 100 9

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Info: Malfunction in systems which impede business

Information on Risk Reputational Risk (52)

Regulatory Risk (40)

Human Capital Risk (40)

IT RISK (35) Financial, Market, Credit, FX and Insurance Risk (30)

Measures: System Downtime Information security breaches Business continuity readiness Disaster recovery

Operational Risk: Crime, security, political, natural hazard, FX, Terrorism, Country Risk (20)

Source: Economist Intelligence Unit, 2005 Max Scale: 100 10

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

5


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Info: Employees unavailable/unwilling to perform functions.

Information on Risk

Measures:

Reputational Risk (52)

Staff Turnover

Regulatory Risk (40)

Key personnel attrition Human Capital Risk (40)

Compensation Competiveness

IT RISK (35)

Financial, Market, Credit, FX and Insurance Risk (30)

Accident rates

Operational Risk: Crime, security, political, natural hazard, FX, Terrorism, Country Risk (20)

Source: Economist Intelligence Unit, 2005 Max Scale: 100 11

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Info: Compliance with external/internal regulations

Information on Risk Reputational Risk (52)

Regulatory Risk (40)

Measures: Fines imposed # of investigations

Human Capital Risk (40) IT RISK (35)

Financial, Market, Credit, FX and Insurance Risk (30)

Status of implementation of internal policies New regulations discussions

Operational Risk: Crime, security, political, natural hazard, FX, Terrorism, Country Risk (20)

Source: Economist Intelligence Unit, 2005 Max Scale: 100 12

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

6


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Information on Risk Reputational Risk (52)

Info: Impact of previous risks on value of the firm including external factors. Measures:

Regulatory Risk (40)

Chain of events impacts

Human Capital Risk (40)

IT RISK (35)

Impact of new strategic initiatives

Financial, Market, Credit, FX and Insurance Risk (30)

Business risks: Price/volume

Operational Risk: Crime, security, political, natural hazard, FX, Terrorism, Country Risk (20)

competition Source: Economist Intelligence Unit, 2005 Max Scale: 100 13

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

External Requirements: Consistency ¬ Regulatory Standards: – Basel II/Solvency II Pillar III: Info on risk exposure and governance – SEC: information on risks in 10-K

¬ Accounting Standards: – IFRS: Provisions as related to risk events – Brief description of the obligation, timing and uncertainty of outflows and expected reimbursements;

¬ Risk Standards: – COSO ERM II – Standards: ISO 31000/ANZ Australian Standards

14

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

7


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Building and Maintaining Effective Risk Dashboards Implementation Issues Karen DeToro Deloitte Consulting LLP June 17, 2008

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Key Challenges in Implementation The most common challenges in implementing effective risk dashboards occur in the following key areas: Data Issues Integration into Decision Making

-2-

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

042DeToro.ppt

Legal Issues

1


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Data Issues Data issues can be grouped into 3 general areas:

Controls

Reconciliation to Other Reports

Non-financial data may not be well controlled The processes for gathering data (financial and non-financial) may not be well controlled Variety of data sources may create challenges in reconciling data to published internal and external sources

-3-

042DeToro.ppt

Data Availability

Different data is required to be aggregated in a different way than for other reporting Timeliness of data is critical for supporting key management decisions

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Approaches for Addressing Data Issues Think broadly about universe of needed data at dashboard initiation Create centralized database to hold all key data to facilitate controls and timely automated reporting Build in sufficient flexibility to dashboard processes to be responsive as key risks change over time Implement controls similar to those used for SOX 404; leverage existing controls over data where possible Leverage commonalities with other data flows in organization

-4-

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

042DeToro.ppt

Develop a strong relationship with IT and business units supplying data to better understand the data and build a reliable pipeline for data

2


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Integration into Decision Making In order to fully support decision making, the dashboard must be: Actionable – Data must be relevant to management – There must be the right level and amount of information targeted to the right audiences

Integrated into a process that drives action – Push v. pull strategies for distributing data

Tied in to incentives

042DeToro.ppt

– Variable compensation must be partially based on performance against risk objectives

-5-

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Legal Implications Companies are concerned about disclosing too much risk information that may be subject to legal discovery Companies’ responses to this issue fall somewhere on a spectrum:

Ideal State Acknowledge the risk Collect data Do the right thing

Middle Road Acknowledge the risk Collect data Do the “wrong” thing

Head in the Sand Do not acknowledge the risk Do not collect data

-6-

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

042DeToro.ppt

Many companies (and their general counsel) presume that the middle road is more dangerous than burying one’s head in the sand

3


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Ford Motor Company: The Middle Road Done Wrong The situation: 1970’s Ford Pinto The risk: Gas tanks would rupture easily in the event of a rear-end collision The data: The risk became apparent during the design and crash studies of the Ford Pinto Cost of repairing the flaw: $11 per car ($137 million cost)1 Value of the benefit: $200,000 saved per life lost ($49.5 million benefit)2 Internal documents indicated that a cost-benefit analysis did not support fixing the flaw

-7-

042DeToro.ppt

Outcome: Estimates put the impact at over 500 deaths3, and significant financial and reputational damage to Ford

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Major Conglomerate: The Middle Road Done Right The situation: Income tax return for a major US conglomerate The risk: The company pursued a tax accounting policy, despite some concern that it might not be deemed acceptable by the IRS The data: The company documented their rationale for interpreting the tax law as they did, and quantified the impact of their interpretation versus another interpretation commonly in use. This information was clearly documented

-8-

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

042DeToro.ppt

Outcome: The company was taken to court by the IRS. Although the company’s interpretation was ruled to be invalid, fines and penalties were substantially reduced because of the company’s ability to document its rationale

4


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Taking the Middle Road – Other Lessons Lessons can be learned from the approaches hospitals have taken in dealing with medical errors 1999 Institute of Medicine report: medical errors cost $17B to $29B per year and are the 8th leading cause of death in the US4 Pressure on hospitals to disclose errors so patients can make informed choices about where to obtain care Hospitals have mechanisms in place to disclose adverse medical events as learning opportunities for doctors – Weekly Mortality & Morbidity (“M&M”) conferences

-9-

042DeToro.ppt

– Hospital risk managers

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Taking the Middle Road – Hospitals’ Responses Hospitals have responded to pressures for full disclosure in several ways: Traditional approach was “defend and deny” – No admission of wrongdoing – Cases cited of risk managers and doctors denying knowledge of medical errors to protect colleagues Proposed legislation – IOM proposed mandatory reporting of errors to make health care safer; simultaneously proposed legislation to extend peer-review protections to reports of errors (currently extend to M&M) Improve processes to reduce errors – Medical community adopting similar checks and protocols to the airline industry Apologize and disclose – Discussed in next case study

- 10 -

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

042DeToro.ppt

“With malpractice premiums soaring and a national patients’ rights movement pushing for full disclosure of medical errors, the industry is rethinking the traditional approach known as ‘defend and deny’.”5

5


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Lexington VA: The Middle Road Refined The situation: Hospitals use weekly Mortality & Morbidity (“M&M”) conferences and other disclosures of adverse events as learning opportunities to teach doctors how to address complications The risk: Admissions of mistakes may be used against doctors in malpractice suits. The data: Lexington VA implemented a mandatory disclosure policy, requiring all doctors to report errors to a committee which then informed the family and offered compensation. Outcome: Instead, after implementation, the average cost of errorrelated payouts was only $15,632, which was in the lowest quarter of the 35 VA hospitals in the country, and Lexington VA is deemed one of the safest VA hospitals in the country.6

042DeToro.ppt

“”Being honest defused situations that would otherwise lead to litigation.”7 - 11 -

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Legal Issues - Summary Companies can live more comfortably with the middle road by: Acting responsibly, prudently and reasonably with the data they gather Disclosing and apologizing when things go wrong Utilizing lessons learned from risk events to move closer to the ideal state by improving processes to limit future adverse events

Middle Road Acknowledge the risk Collect data Do the “wrong” thing

Head in the Sand Do not acknowledge the risk Do not collect data

- 12 -

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

042DeToro.ppt

Ideal State Acknowledge the risk Collect data Do the right thing

6


Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Bibliography End Notes

Mark Dowie. “Pinto Madness.” Mother Jones. Sept / Oct 1977.

Ibid.

Ibid.

Stephanie Mencimer, “Casualties of Medicine.” Legal Affairs. May / June 2003.

Rachel Zimmerman. “Doctors’ New Tool to Fight Lawsuits: Saying I’m Sorry.” Wall Street Journal. May 18, 2004, page A1.

Ibid.

Stephanie Mencimer, “Casualties of Medicine.” Legal Affairs. May / June 2003.

Sara Nathan and Guillermo X. Garcia. “Ford visit led to settlement.” USA Today. Jan. 9, 2000.

Jane Garbutt et al. “Lost Opportunities: How Physicians Communicate About Medical Errors.” Health Affairs. Vol. 27, No. 1, 2008.

Karen Lundegaard. “Study Raises Roof-Safety Questions.” Safety Issues. Vol. 4, Issue 41, April 2005. - 13 -

042DeToro.ppt

Other Sources

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

Copyright © 2008 Deloitte Development LLC. All rights reserved.

Changed with the DEMO VERSION of CAD-KAS PDF-Editor (http://www.cadkas.com).

7


SOCIETY OF ACTUARIES

Life 2008 Spring Meeting (June 2008) Session Topic:

Building & Maintaining Effective Risk Dashboards

Value Ladder:

E/C

Overall Rating

Session:

All Sessions

042

Expected Attendance

3,572

41

Actual Attendance

3,203

32

This Session

Number of responses

1,324

24

All Sessions

Return rate (# of resp./actual att.)

41%

75%

Overall rating of this session

3.77

3.79

Provided you with practical technical information

3.92

4.00

Will enable you to make better business decisions

3.82

4.08

Prepared you to impact industry-wide changes

3.66

3.65

Knowledge of Subject

4.27

4.17

Effectiveness of Delivery

3.83

4.41

1

1

Knowledge of Subject

4.27

4.13

Effectiveness of Delivery

3.83

3.57

1

0

3.88

3.50

4.66

5.10

1

Learning Experience

2

Indicate your level of agreement with the following. This session:

3.79 3.77 4.00 3.92 4.08 3.82 3.65 3.66

Presenter Effectiveness1

Karen J. DeToro

Number of participants indicating presenter included commercial promotion in presentation

4.17 4.27 4.41 3.83 1 1

Michel Rochette

Number of participants indicating presenter included commercial promotion in presentation

Moderator Effectiveness 1 : Rate the moderator's skills in managing this session

Rate the level of audience interaction for this session (7=high, 1=low)

4.13 4.27 3.57 3.83 0 1 3.50 3.88 5.10 4.66

1

The rating scale used: Excellent (5), Very Good (4), Good (3), Fair (2), Poor (1), and N/A (no value).

2

The rating scale used: Strongly Agree (5), Agree (4), Neither Agree nor Disagree (3), Disagree (2), Strongly Disagree (1), and N/A (no value).

Evaluation Tips to keep in mind when reviewing the responses: Numerical evaluations tend to give you a pretty good feeling for how well the attendees responded to the session as a whole. Scores in the range of 3 to 5 are considered successful programs. Written comments come from people who may have a strong opinion, therefore they tend to be very good or very bad. Repetitive comments that point to the same theme could be an indication of an area you may want to capitalize on in the future or work on for future presentations.

Perception Solutions, Inc.

www.perceptionsolutions.com

7/17/2008


SOCIETY OF ACTUARIES

Life 2008 Spring Meeting (June 2008) Session Evaluation (Participants' Comments) Session 042

Value Ladder

042

E/C

E/C

Perception Solutions, Inc.

Overall Comments Regarding This Session It would have been nice to show actual dashboards from their respective companies, as a real life example. Most of the discussion was in generalities. Topics covered were interesting, but not as closely related to session name as hoped.

www.perceptionsolutions.com 7/14/2008

Comments- 1


Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.