Beverly Parsons • bparsons@insites.org • www.insites.org
Key Message
Beverly Parsons • bparsons@insites.org • www.insites.org
Social Innovation Evaluation: From Afterthought to Forethought
2
Then: Our Stable, limited Changing connections
World Now: Social Complex, connected, Systems dynamic
Beverly Parsons • bparsons@insites.org • www.insites.org
3
Then: Individual programs, policies
Our Changing World Now: Social Multi-faceted, Interventions overlapping, dynamic Beverly Parsons • bparsons@insites.org • www.insites.org
4
Then: Formative and Summative
Our Changing World Now: Evaluation Developmental with Approach Nested Formative and Summative Beverly Parsons • bparsons@insites.org • www.insites.org
5
Beverly Parsons • bparsons@insites.org • www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
Traditional Strategy Approach
Beverly Parsons • bparsons@insites.org • www.insites.org
Establish goals Develop action plan Implement plan Evaluate results
9
Evaluation and Strategy Repositioned and Redesigned Adaptive STRATEGY Developmental EVALUATION
Beverly Parsons • bparsons@insites.org • www.insites.org
Developing an Evaluation Framework
Step 1. Articulate Fundamental Social Innovation Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with Social Change
Beverly Parsons • bparsons@insites.org • www.insites.org
11
Framework for Social Innovation Evaluation ____________________ (innovation) Baseline Understanding To what extent:
Trying Out Interventions
Tipping Point
Sustainable Adaptive Balancing
_________________________ (initiative)
Points of Systemic Influence (Individual/ relationship) (Community: informal) (Community: formal) (Societal—City, state, national) (Learning & Capacity Building) (Networks/ Partnerships)
bparsons@insites.org • www.insites.org
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation
13
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation See the big picture
14
Placeholder ZOOM 1
From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai. Used by permission of Viking Penguin, a division of Penguin Group 15 (USA) LLC.
Placeholder ZOOM 2
From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai. Used by permission of Viking Penguin, a division of Penguin Group 16 (USA) LLC.
Placeholder ZOOM 3
From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai. Used by permission of Viking Penguin, a division of Penguin Group 17 (USA) LLC.
Placeholder ZOOM 4
From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai. Used by permission of Viking Penguin, a division of Penguin Group 18 (USA) LLC.
Placeholder ZOOM 5
From ZOOM by Istvan Banyai, Š 1995 by Istvan Banyai. Used by permission of Viking Penguin, a division of Penguin Group 19 (USA) LLC.
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation See the big picture Map actions among partners
20
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation See the big picture Map actions among partners Be transparent
21
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation See the big picture Map actions among partners Be transparent Map progress over time 22
Articulate Fundamental Social Innovation
Beverly Parsons • bparsons@insites.org • www.insites.org
23
Concrete Support in Times of Need Children’s Social/Emotiona l Competence
Center for the Study of Social Policy (www.cssp.org)
Identify Points of Systemic Influence First: Identify Relevant Domains of the Social Ecology
Beverly Parsons • bparsons@insites.org • www.insites.org
25
Beverly Parsons • bparsons@insites.org • www.insites.org
26
Beverly Parsons • bparsons@insites.org • www.insites.org
27
Identify Points of Systemic Influence First: Identify Relevant Domains of the Social Ecology Second: Identify Potential Levers for Change
Beverly Parsons • bparsons@insites.org • www.insites.org
28
Beverly Parsons • bparsons@insites.org • www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
Framework for Social Innovation Evaluation _________________________ (initiative) Strengthening Families Innovation
Points of Systemic Influence
Baseline Understanding To what extent:
Trying Out Interventions
Tipping Point
Sustainable Adaptive Balancing
CaregiverChild-Family
Neighborhood/Co mmunity Organizations, Providers (Norms, infrastructures,
policy) Societal Actors (State & national) (Norms, policies, infrastructures)
Stakeholder Learning & Capacity Building
Networks/ Partnerships
bparsons@insites.org •
Identify Actors within the Domains of Social Ecology
Identify Actors within the Domains of Social Ecology
Theory of Change in Complex Systems Framework for Social Innovation ____________________ (innovation) Trying Out Sustainable Adaptive Balancing Tipping Point Evaluation Interventions Points of Systemic Influence
Baseline Understanding To what extent:
(Individual/ relationship)
(Community: informal)
(Community: formal)
(Societal—City, state, national)
(Learning & Capacity Building)
(Networks/ Partnerships)
bparsons@insites.org •
Developing an Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Step 1. Articulate Fundamental Social Innovation Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with Social Change
35
Weave strategy & evaluation with social change over time Beverly Parsons • bparsons@insites.org • www.insites.org
Assessing Where We Are in relation to our vision Beverly Parsons • bparsons@insites.org • www.insites.org
Trying Out Interventions within & across system domains, dimensions, and across time Beverly Parsons • bparsons@insites.org • www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
Reaching a Tipping Point: Activities are clearer, scaled up, and crossing more parts of the system
Beverly Parsons • bparsons@insites.org • www.insites.org
Sustainable Adaptive Balancing: We are here, new things happen, system changes, and we are able to adapt
Eventually the cycle begins again with a new paradigm shift. Beverly Parsons • bparsons@insites.org • www.insites.org
Weave strategy & evaluation with social change over time Beverly Parsons • bparsons@insites.org • www.insites.org
Framework for Social Innovation ____________________ (innovation) Evaluation Points of Systemic Influence
Baseline Understanding To what extent:
Trying Out Interventions
Tipping Point
Sustainable Adaptive Balancing
(Individual/ relationship) (Community: informal)
(Community: formal)
(Societal—City, state, national)
(Learning & Capacity Building)
(Networks/ Partnerships)
bparsons@insites.org • www.insites.org
Developing an Evaluation Framework
Step 1. Articulate Fundamental Social Innovation Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with Social Change
Beverly Parsons • bparsons@insites.org • www.insites.org
44
Identify Indicators of Social Benefit
Beverly Parsons • bparsons@insites.org • www.insites.org
45
Framework for Social in Innovation Evaluation Theory of Change Complex Systems Strengthening Families Innovation
Points of Systemic Influence
Baseline Understanding To what extent:
Trying Out Interventions
Tipping Point
Sustainable Adaptive Balancing
CaregiverChild-Family
Neighborhood/Co mmunity Organizations, Providers (Norms, infrastructures, policy) Societal Actors (State & national) (Norms, policies, infrastructures) Stakeholder Learning & Capacity Building
Networks/ Partnerships
bparsons@insites.org •
Framework for Social Innovation EvaluationStrengthening Families Innovation
Framewor of SocialinInnovat ion St rat egy and Theory ofkChange Complex Systems p 1 Strengthening Families(initiative) Example _________________________ S te
Points of Systemic Influence
CaregiverChild-Family
Step
3
Baseline Understanding To what extent: of and Are families aware factors? Do e practicing protectiv anized and rg parents use both o ? adaptive dynamics
Trying Out Interventions
protective f o e s u t s te nges in Families a h c e in m r e t e factors and d and boundaries in relationships ilies learn to selfm daily life. Fa rotective factors. of p assess use s pilot ie it n u m m o /c
y and Evaluat ion i n Complex Social Sy st ems ms
ut ons
tective changes in daries in n to selfve factors.
nities pilot g that are factors and
ilot new
Tipping Point
Sustainable Adaptive Balancing
bitually using a h re a s e ili Enough fam rotective factors that p f and building are shifting in support o . family norms tors framework for living c protective fa g realized. in e b Benefits
Caregivers are connecte d family members who are with other caregivers and sk ing protective factors. Fa illed at using and buildmily norms support protec tive factors. (Evidence of well-being of families an d levels of child maltreatm ent regularly monitored.)
e commit to us rs e d a le & s d Neighborhoo rotective factors. They p rt o p p and su and adaptive n d e iz n a rg o e leverag l cohesio esired socia dynamics. D . ed/supported being achiev
Neighborhoods & leade rs itions in community and adjust to social condemphasis on supporting protective factors. They consider and reflect on their ways of functioning . (Evidence monitored.)
to iders commit ies that v ro /p s n o ti a res/polic Organiz orms/structu amework & n d e n ig s e d re ctors fr protective fa e d an d
Organizations/providers use caregiver, child, fam outcome and other data ily to adjust to social conditions in community wi presence of protective fac th emphasis on tors. Organiza
Framework for Social Innovation Evaluation Strengthening Families Innovation Points of Systemic Influence
Baseline Understanding To what extent:
Trying Out Interventions
Tipping Point
Sustainable Adaptive Balancing
CaregiverChild-Family
Neighborhood/Co mmunity Organizations, Providers (Norms, infrastructures, policy) Societal Actors (State & national) (Norms, policies, infrastructures) Stakeholder Learning & Capacity Building Networks/ Partnerships bparsons@insites.org •
Developing an Evaluation Framework
Step 1. Articulate Fundamental Social Innovation Using Existing Evidence Step 2. Identify Points of Systemic Influence Step 3. Weave Strategy and Evaluation with Social Change
Beverly Parsons • bparsons@insites.org • www.insites.org
50
Process for Developing an Evaluation Framework
Who:
Leadership Team Evaluator
Stakeholders When: Near beginning Review, revise, adapt
Beverly Parsons • bparsons@insites.org • www.insites.org
51
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation
52
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation See the big picture
53
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation See the big picture Map actions among partners
54
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation See the big picture Map actions among partners Be transparent
55
Value of the Evaluation Framework
Beverly Parsons • bparsons@insites.org • www.insites.org
Link strategy and evaluation See the big picture Map actions among partners Be transparent Map progress over time 56
? Q&A Beverly Parsons • bparsons@insites.org • www.insites.org
57
bparsons@insites.org www.insites.org
Beverly Parsons • bparsons@insites.org • www.insites.org
58