HP 2007 Microenterprise Development Program 2007 Client Survey
Prepared for Hewlett – Packard By Program Evaluator Independent Contractor, Kathy Holmes-Bass
Table of Contents
I. Executive Summary/Background ............................................................ 3 II. Methodology ............................................................................................. 5 III. Quantitative Analysis............................................................................. 7 IV. Qualitative Analysis ............................................................................. 12 V. Future Activities..................................................................................... 15 VI. Recommendations ................................................................................ 16 VII. Appendix.............................................................................................. 17 VIII. Survey Monkey Responses ............................................................... 18
2007 HP Client Survey
2
I. Executive Summary/Background The Impact of Technology on MDOs In 2007, a Request for Proposals was disseminated by HP to microenterprise programs across the country and in Puerto Rico. The stated goal of the RFP was to “combine the power of information technology with creative and effective partnerships which can create economic and social value for communities around the world.” Microenterprises, the smallest of small businesses, are the fastest growing businesses and the biggest source of new jobs globally. While more and more low income entrepreneurs are moving toward self-sufficiency, few are using technology effectively to accelerate their business. HP provided Microenterprise Development Organizations (MDOs) a package that included the following equipment: Each organization received: Five HP wireless Tablet PCs Fifteen HP wireless notebook computers One HP twenty-unit laptop cart One HP desktop PC with flat panel monitor 1 HP digital camera 1 HP all-in-one printer/scanner/copier/fax 1 HP LaserJet printer 1 wireless access point router 1 digital projector $20,000 cash grant to be used toward the purchase of relevant software, equipment configuration and expenses related to technology installation and support The HP-sponsored small business technology training curriculum: “Smart Technology for a Smarter Business” As of April 2008, the impact of technology on these MDOs has been demonstrated in various ways. The grantees were able to establish technology centers through the use of the HP equipment and software. Prior to the grant awards, some organizations indicated they were limited in providing services to clients due to inadequate software or equipment. The Mid-Cycle report that was disseminated to the grantees in April 2008 showed that there was a favorable impact for the MDOs that had installed the HP technology. The agencies reported that a positive impact occurred mainly in their ability to train clients in business literacy, financial literacy, and computer literacy.
2007 HP Client Survey
3
Other examples of the positive impact of the HP grant include the ability for agencies to purchase professional licenses for software packages which increased the number of computer stations for entrepreneurs; this increase in work stations impacted other increases for participants. MDOs were able to increase the number of training/services for participants, as well as modify the adaptation for special populations, service needs and provide technical assistance to all low and moderate income entrepreneurs. In addition, entrepreneurs have been introduced to the HP Smart Curriculum as well as new technology. The HP tech centers have impacted the MDOs by providing the means for individual entrepreneurs to access a technology center for the promotion and expansion of their businesses. Approximately, forty programs were awarded contracts for the purpose of advancing HP’s stated goal. HP targets non-profit microenterprise development organizations (MDOs) that serve clients in low-income communities in the United States and Puerto Rico and has the following goals: 1. Assist MDOs to increase their productivity, efficiency and effectiveness through the integration of technology into their operations and core services; and, 2. Enable MDOs to provide technology access to their microenterprise clients. HP also has a very strong emphasis on supporting best practices in the use of technology for microenterprise development. This report contains quantitative and qualitative descriptions and analysis of HP results and progress to date. HP MAP continues to be a great success overall. HP and AEO have done an excellent job in helping MDOs throughout the country become more innovative, technology driven organizations focused on meeting the entrepreneurial needs of low-income and disadvantaged Americans. The technology investment of over 2 million dollars in this grant award made by HP was impressive and demonstrates the power of private sector and non-profit organizations partnering together in order to make a tangible difference for low-income Americans. It serves as a model illustrating how people power can be matched with technology in order to create economic opportunities, revitalize neighborhoods and communities and make non-profit organizations more productive, cost efficient and customer friendly. The evaluator has measured the effectiveness, efficiency, and sustainability of these contracts through a post awards survey disseminated to the grantees in April 2008 and a subsequent client survey disseminated to the entrepreneurs through June/August 2008. A mid cycle report was delivered to AEO which evaluated the program, while the client survey is an evaluation of the individual entrepreneurs who utilize the technology centers.
2007 HP Client Survey
4
The following information was collected by the Independent Contractor, Kathy HolmesBass and a complete draft submitted for final revisions and recommendations to AEO on October 1, 2008.
II. Methodology
This interim analysis attempts to help HP, AEO, and MDO Program Managers understand whether and how their efforts have assisted appropriate entrepreneurs and delivered services that meet client satisfaction and achieve program targets. Task (1) The evaluator focused on developing evaluation tools to ensure validity and reliability. Unstructured interviews were conducted in order to coordinate the administration of the surveys. Task (2) The surveys were disseminated and the data collected for review. Task (3) The evaluator conducted unstructured interviews for the purpose of analyzing the data collected via surveys. During this phase of the project, the evaluator gathered information for the purpose of concluding the evaluation and summarizing the project. Task (4) A draft was to be submitted to AEO with the evaluator’s findings and recommendations. The evaluator has previously collected information through a post awards survey (April 2008), which was disseminated to the HP grantees. A mid-cycle report was written and delivered to AEO by the independent contractor in June of 2008. The mid-cycle report was responded to by key contract persons at the respective agencies. No information was gathered from individual entrepreneurs in the post-award’s survey. The evaluator in coordination with AEO disseminated an on-line survey to be answered by individual entrepreneurs who had received training on the HP technology at the HP center which was funded through the Request for Proposals process of 2007. The evaluator designed a seven item survey in February of 2008 and after consultation and revision, the survey was approved by AEO and distributed on-line to all of the forty agencies. The agencies, in turn, were asked to encourage entrepreneurs to respond to the survey. Clear instructions were given to all grantees regarding the requirement for entrepreneurs to participate in this particular survey: Entrepreneurs must have had some access to HP training via HP funded technology which had been awarded through the RFP of 2007. This survey was designed to determine the impact of technology on the entrepreneur. The survey was also used to determine the comfort level of the entrepreneur with technology usage. Questions were designed to determine whether the technology centers funded by HP had 2007 HP Client Survey
5
an effect on the acceleration of micro enterprises. The questions were distributed to the grantee via the agencies. Agencies allowed entrepreneurs to complete a survey on-line while utilizing HP technology. This electronic submission was collected through the use of Survey Monkey, a statistical survey program. A conference call was held with respective agencies for instruction on the utilization of Survey Monkey with their participating entrepreneurs. No financial incentives were given to entrepreneurs for their participation. The agencies were instructed only to use entrepreneurs that were trained using HP technology. Based on the number of clients presented as having been trained (post award survey April 2008) the evaluator with the consent of AEO requested that all agencies attempt to secure a minimum of ten clients for participation in the on-line survey. The agencies were given two months to identify the entrepreneurs and to guide the entrepreneur feedback via the on-line survey. The survey was accessible to the agencies and the entrepreneurs from the period of June 2008 to August 15, 2008. The evaluator utilized quantitative and qualitative analysis for the presentation of the findings (i.e. the entrepreneurs’ response). The following information will provide the quantitative and qualitative results and findings of the survey which was disseminated to the entrepreneurs.
2007 HP Client Survey
6
III. Quantitative Analysis In April 2008 a periodic screening report was distributed to the agencies which were awarded HP grants. The findings of this report was forwarded to AEO, those findings did not represent any information collected from entrepreneurs of the HP grantees. Through the use of survey monkey from June of 2008 to August of 2008, individual entrepreneurs had access to an on-line survey for feedback regarding their participation in the HP training center or at an HP training lab. The evaluator assessed the post-installation impact of the information and technology on economic growth and development for low to moderate business owners. The method that was used to evaluate these entrepreneurs was a survey. The evaluator conducted a survey of program participants/entrepreneurs. The evaluator utilized nominal level of measurement, a Likert Scale, and open-ended and close-ended questions to gather information from the entrepreneurs. The unit of analysis was the individual entrepreneurs within each respective program. The survey consisted of seven questions. The following are the seven questions: 1. Is Technology more accessible for you now because you have access to the HP equipment at this lab/center or technology training program? Answer yes or no. 2. Are you more comfortable using technology now? (Scale 1-5 with 1 not comfortable and 5 being extremely comfortable.) 3. Have you used the HP Technology at this lab/center or technology training program to grow your business? Answer yes or no. 4. Expound on question 3 by answering how the lab/center or technology training program was used to grow your business. 5. Which of the following technologies do you think could help you advance your business? Check all that apply (HP Wireless Tablet PC, HP Wireless Notebook Computer, HP Digital Camera, HP Printer, Wireless Access Point Router, Digital Projector, Other). 6. What other technology support services do you need from this lab/center or technology training program? 7. Please choose the lab/center or training program with which you are associated.
2007 HP Client Survey
7
Results: After the close of the survey in August of 2008, there were 261 entrepreneurs from the 40 agencies who had participated in the online survey. The following is the quantitative analysis of the responses given by the entrepreneurs. The entrepreneurs were asked in question 1:
Of the 261 respondents, 236 said yes and 25 said no or 90.4 % said yes and 9.6% said no. Positive Outcome: 90.4% of the entrepreneurs responded favorably when asked if “Technology more accessible for you now because you have access to the HP equipment at this lab/center or technology training program”.
2007 HP Client Survey
8
The entrepreneurs were asked in question 2: Are you more comfortable using technology now? (Scale 1-5 with 1 not comfortable and 5 being extremely comfortable.) Of the 261 respondents, 5 responded that they were not comfortable, or 1.9% stated they were not comfortable. Of the 261 respondents 29 responded that they were somewhat uncomfortable or 11.1 % stated that they were somewhat uncomfortable. Of the 261 respondents, 71 responded that they were comfortable, or 27.2 % stated they were comfortable. Of the 261 respondents, 62 responded that they were somewhat comfortable, or 23.8% stated that they were somewhat comfortable. Of the 261 respondents, 94 responded that they were extremely comfortable, or 36.0% stated they were extremely comfortable. Positive Outcome: 36% of the entrepreneurs surveyed indicated that they were extremely comfortable using technology since they had encountered the HP training lab/center. 23.8% of the entrepreneurs reported as having been somewhat comfortable using technology since they had encountered the HP training center/lab. 27.2% of the entrepreneurs stated that they were comfortable using technology since they had encountered the HP training lab/center. Overall, 87% of the respondents reported a favorable increase in their comfort level after access to training or technology at the HP training center/lab.
2007 HP Client Survey
9
The entrepreneurs were asked in question 3:
Of the 261 respondents, 192 said yes, or 73.6% said yes. Of the 261 respondents 69 said no or 26.4% said no. Positive Outcome: 73.6% reported favorably that their businesses had grown as a result of using the HP technology center/lab. The entrepreneurs were asked in question 4: Expound on question 3 by answering how the lab/center or technology training program was used to grow your business. Of the 261 respondents, 178 answered the question in short answer form 1 . 1
see qualitative section for the details of this response
2007 HP Client Survey
10
The entrepreneurs were asked in question 5:
Of the 261 respondents 38.3% or 100 respondents chose HP Wireless Tablet PC. Of the 261 respondents 72.8% or 190 chose HP Wireless Notebook Computer. Of the 261 respondents 47.1% or 123 respondents chose HP Digital Camera. Of the 261 respondents 52.9% or 138 respondents chose HP Printer. Of the 261 respondents 33.0% or 86 respondents chose Wireless Access Point Router. Of the 261 respondents, 33.0% or 86 respondents chose Digital Projector, and out of the 261 respondents 9.6 % or 25 respondents chose “Other”. Positive Outcome: Of the 261 entrepreneurs that were questioned on this item, responses could have arranged from the number of 0 (no persons utilizing any equipment) to 1827 (indicating every entrepreneur had utilized every equipment and other). The number of favorable responses tallied for this survey was 745 of a possible 1827. This calculation represents 41% of utilization of the HP technology by the entrepreneurs surveyed. It is difficult to determine the reliability due to the self reporting of the entrepreneurs at the agency.
2007 HP Client Survey
11
IV. Qualitative Analysis The following two questions: 4. Expound on question 3 by answering how the lab/center or technology training program was used to grow your business. -And6. What other technology support services do you need from this lab/center or technology training program? Details of Question 4: Of the 261 respondents, 178 answered the question “if so how”. The following is a summary of how the entrepreneurs responded to the question “How have you used the HP Technology at this lab/center or technology training program to grow your business? The usage was reported in the following areas: 1. Finding information on the internet 2. creating a business plan 3. create emails 4. create business cards 5. learning to type to advance the business through technology 6. learning how to create business letters 7. understanding how to utilize computers in business overall 8. increasing marketing presence 9. creating websites 10. utilizing the internet 11. expediting work overall 12. increased efficiency overall 13. utilizing QuickBooks software 14. utilizing Microsoft Office software 15. electronic filing of inspection reports 16. able to handle payroll utilizing appropriate software 17. digital photographs 18. able to secure travel arrangements on-line 19. software utilization in financial reports 20. more effective training practices for employees 21. The creation of flyers 22. The preparation of newsletters 23. Preparing invoices
2007 HP Client Survey
12
During the conference call with AEO and the evaluator, program managers requested that the responses of their entrepreneurs be returned to the respective programs. The program managers implied that they would like to view the suggestions of their specific clients.
The entrepreneurs were asked in question 6: What other technology support services do you need from this lab/center or technology training program?
25.00%
20.00%
15.00%
10.00%
5.00%
0.00%
Series1
Trainings-26
Equipment41
9.35%
14.74%
2007 HP Client Survey
Specific Software-34 Classses-21 Classes &Training-42 12.23%
7.55%
15.10%
NOS-68
24.48%
Technical Other/Unsur Assistance/O n-Site Staffe-14 32 5.03%
13
11.51%
26 entrepreneurs or 9.35 % said training, 41entrepreneurs or 14.74% said equipment, 34 entrepreneurs or 12.23% said software, 21entrepreneurs or 7.55% classes , 42 entrepreneurs or 15.10 % said specific classes and training ,68 entrepreneurs or 24.48 % said no, 14 entrepreneurs or 5.03% said others/unsure, 32 entrepreneurs or 11.51% said technical assistance/on-site staff . Positive Outcome: Through this compilation of data, MDO’s and HP can identify the areas of need as identified by the participating entrepreneurs which responded to the survey. The entrepreneurs were asked in question 7: Please choose the lab/center or training program with which you are associated. 2
2
See appendix for this response
2007 HP Client Survey
14
V. Future Activities The evaluator desires to select an entrepreneur from each respective agency/program to participate in an on-line focus group. With the assistance AEO, the evaluator will provide technical expertise for the facilitation of this focus group. All information gathered will be evaluated and assessed for its feasibility. The evaluator will develop questionnaires that address the knowledge, skills and attitudes of the entrepreneurs as they relate to technology application for business development. Through the focus groups, discussion will be centered on the effectiveness, efficiency and sustainability of the grantees. The post-test will ideally measure the impact of technology on business acceleration for the entrepreneurs who have participated in the project for the contract year.
2007 HP Client Survey
15
VI. Recommendations
Below are seven recommendations for each of the grantee agencies: Recommendation 1: Each agency should submit training schedules and training manuals for sharing within the HP learning community. This peer-to-peer collaboration will facilitate more entrepreneurs’ access to HP trainings and HP technology. Recommendation 2: Programs should consider flexible scheduling for trainings, i.e. extended hours and weekends. Recommendation 3: Programs should track their entrepreneurs. Programs identified difficulty in securing entrepreneurs. The evaluator recommended in the mid-cycle report the need for documentation and monitoring of program participants. This again is a recommendation for HP grantees. Recommendation 4: Entrepreneurs should be provided an extended opportunity to complete the on-line survey. Programs can benefit from this in that it will provide feedback from clients to program managers and staff. Recommendation 5: Programs should coordinate efforts to provide entrepreneurs with a staff to train on all HP equipment. Entrepreneurs consistently requested more or advanced trainings, and more staff for technical assistance. Recommendation 6: Programs should identify entrepreneur for participation in the webinar/ on-line focus group. Programs should consult with staff for identification of entrepreneur who is representative of that specified low to moderate population. Recommendation 7: All programs should comply with submission of requested surveys or questionnaires.
2007 HP Client Survey
16
VII. Appendix
Question 7 Question number seven consists of a table that lists the lab centers where the entrepreneurs participated in training program or utilized the lab/center. Although 261 persons participated in the survey, 178 entrepreneurs chose to identify the HP-center where they had received their training. The responses are as follows in the following bar graph:
2007 HP Client Survey
17
VIII. Survey Monkey Responses
Survey monkey results via web address : http://www.surveymonkey.com/sr.aspx?sm=PYCLZqSfTVs95YVRuUwEzGRAVo sXKD_2bL_2bw5vaNFHaMQ_3d Page: Questions 1. Is Technology more accessible for you now because you have access to the HP equipment at this lab/center or technology training program?
Response Percent
Response Count
Yes
90.4%
236
No
9.6%
25
answered question
261
skipped question
2
2. Are you more comfortable using technology now? (Scale 1-5 with 1 not comfortable and 5 being extremely comfortable.)
Response Percent
Response Count
1 = Not Comfortable
1.9%
5
2= Somewhat Comfortable
11.1%
29
3= Comfortable
27.2%
71
2007 HP Client Survey
18
2. Are you more comfortable using technology now? (Scale 1-5 with 1 not comfortable and 5 being extremely comfortable.)
4= Somewhat comfortable
23.8%
62
5= Extremely Comfortable
36.0%
94
answered question
261
skipped question
2
3. Have you used the HP Technology at this lab/center or technology training program to grow your business?
Response Percent
Response Count
Yes
73.6%
192
No
26.4%
69
answered question
261
skipped question
2
4. If so, how?
Response Count
178
answered question
178
skipped question
85
5. Which of the following technologies do you think could help you advance your business? Check all that apply:
HP Wireless
2007 HP Client Survey
Response Percent
Response Count
38.3%
100
19
5. Which of the following technologies do you think could help you advance your business? Check all that apply:
Tablet PC
HP Wireless Notebook computer
72.8%
190
HP Digital Camera
47.1%
123
HP Printer
52.9%
138
Wireless access point router
33.0%
86
Digital Projector
33.0%
86
Other
9.6%
25
Other (please specify)
33
answered question
261
skipped question
2
6. What other technology support services do you need from this lab/center or technology training program?
Response Count
261
answered question
261
skipped question
2
7. Please choose the lab/center or training program with which you are associated.
2007 HP Client Survey
20
7. Please choose the lab/center or training program with which you are associated.
Response Percent
Response Count
ACCION New York
1.7%
4
Agriculture & Land Based Training Association (ALBA)
12.4%
30
ALT Consulting, Inc
0.4%
1
Alternatives Venture Fund
0.4%
1
Atlanta Micro Fund
0.0%
0
Center for Entrepreneurial Growth
1.2%
3
Center for Women and Enterprise
0.8%
2
CHARO Community Development Corporation
0.4%
1
Chemeketa Small Business Development Center
4.1%
10
Coastal Enterprises, Inc
4.1%
10
The Colorado Enterprise Fund
3.3%
8
Empowerment Group
0.0%
0
EnterpriseWorks
2.1%
5
Eastern West Virginia Community & Technical College
2.1%
5
2007 HP Client Survey
21
7. Please choose the lab/center or training program with which you are associated.
Extend the Dream Foundation
0.0%
0
Fort Greene SNAP
0.0%
0
Greater Newark Business Development Consortium (GNBDC)
0.8%
2
Good Work Network
4.6%
11
Hammond Development Corporation
8.7%
21
Latin American Economic Development Association (LAEDA)
5.0%
12
Lane MicroBusiness
2.5%
6
Latino Economic Development Center (LEDC)
10.8%
26
Mutual Assistance Network of Del Paso Heights
0.4%
1
Microbusiness Advancement Center
0.0%
0
Northeast Veterans Business Resource Center
0.4%
1
Neighborhood Self Employment Initiative
0.0%
0
ONABEN
0.8%
2
Rural Opportunities/Puerto Rico, Inc
0.0%
0
2007 HP Client Survey
22
7. Please choose the lab/center or training program with which you are associated.
South Asian Help and Referral Agency (SAHARA)
4.6%
11
Southern Good Faith Fund
0.0%
0
Sinte Gleska University Tribal Business Information Center
0.8%
2
Stone Soup
3.3%
8
Syracuse University South Side Innovation Center
5.0%
12
The Business Center
1.7%
4
Valley CDC
5.0%
12
Women's Business Development Center
1.7%
4
Puerto Rico Women's Business Institute
0.0%
0
Women's Employment Opportunity Project (WEOP)
2.5%
6
Western Dairyland
3.3%
8
YWCA of Delaware
5.0%
12
answered question
241
skipped question
22
Page: Default Section 8. Thank you for your responses! This information will be used only for the purpose of Program Evaluations.
Response Percent
2007 HP Client Survey
Response Count
23
8. Thank you for your responses! This information will be used only for the purpose of Program Evaluations.
100.0%
229
99.1%
227
100.0%
229
100.0%
229
100.0%
229
100.0%
229
100.0%
229
Email Address:
100.0%
229
Phone Number:
100.0%
229
answered question
229
skipped question
34
Name:
Your Business Name:
Address:
City/Town:
State:
ZIP/Postal Code:
Country:
2007 HP Client Survey
24