Forum: "ICT for Rural Economic Development" November, 2010
2. How to analyze the socio-economic impact in rural areas?
23/11/2010
Question 2. How to analyze the socio-economic impact of ICT in rural areas?
Опубликовано Karl Jonas - пт, 11/26/2010 - 09:06
humble engineer's comment, ready to take experts bashing:
It is transparency. It is crowd sourcing.
Ask the people. They know it all. Make information about the projects available. To everybody. What did it cost? What was planned? If you bring ICT to a school: ask the parents (two years afte the end of the project!) if it had an impact. Ask the owners of the kiosk if new services had an impact.
A blog on the internet. For every project. Known to everybody. Open to everybody.
karl
Опубликовано Jenny Aker - пт, 11/26/2010 - 13:14
Karl,
I agree, but with transparency and crowdsourcing comes the need for verification. When Ushahidi was used to report violence in Kenya, it required independent observers to confirm those reports - -the same with swine flu in Mexico and the food riots in Mozambique. Crowdsourcing is a great opportunity for sharing information, but also the potential for misinformation.
Jenny
Опубликовано Anja Kiefer - пт, 11/26/2010 - 16:05
The method of assessing impact should be related to the objective of the analysis.
If we want to know whether farmers experience a benefit, we should ask the farmers. If we want to know whether young people enjoy the communication possibilities of mobile phones, we should conduct a survey among youth.
But problems start when we wish to show rigid scientific proof of the impact of ICT on certain factors, e.g. income generation. I don't think that it is enough to ask farmers if their income has increased. Even if that were the case, many other factors influence changing incomes - world market prices, changes in supply and demand, weather conditions...
If we need to prove that ICT have had a direct impact, these factors need to be taken into account. Probably, methods other than surveys or questionnaires have to be used as well to get scientificly valid results.
Опубликовано Roxanna Samii - вс, 11/28/2010 - 15:58
Jenny is right, crowdsourcing requires verification, but the very nature of crowdsourcing implies a self verification. If out of 50 messages, 40 say the same thing, then one would assume that the information is correct.
Опубликовано Jenny Aker - пн, 11/29/2010 - 14:08
While I agree that the "strength in numbers" might give us an indication of accuracy, I think that this really depends upon the context and how crowdsourcing is being used. It might work really well for certain (easily observable) topics, like riots (Mozambique), electoral violations (Kenya, Mozambique) and earthquake survivors (Haiti). But it might work less well for other aspects in the medical field -- like using Ushahidi to report cases of the swine flu in Mexico (where fevers can be swine flu or something else).
I don't think that ths minimizes or negates the power of crowdsourcing -- it is a powerful tool and one that allows individuals and groups (who might not have otherwise had a voice) to participate. This cannot and should not be overlooked. But at the same time, I think that it can/should be used with other data collection tools.
Опубликовано stephen kimole - пт, 11/26/2010 - 14:28
I can’t agree with Karl more, the beneficiaries have the best experiences- “he who wears the shoe knows where it pinches, and not the manufacturer”. I remember last year I was conducting a survey on some tillage techniques productivity and one of the respondents took me to his store to see the amount of maize he had got from his farm, and there was my answer.
Опубликовано Rami Eid-Sabbagh - вт, 11/30/2010 - 10:48
i agree with you karl. this a good way to get an indication about the impact. however as jenny said, a second round for verification might be desirable. also doing the measuremnts while the projects runs would help to steer the project impact into the right direction.
if we look at blogs or wikipedia there is often only a few people driving it (e.g. wikipedia maybe 5% of user are contributers which is still a lot, and of course you have all others who verify), so maybe we get only one view.
nonetheless as you said it should be participatory and transparent.
Опубликовано Olaf Erz - пт, 11/26/2010 - 10:03
One of the M&E components that IICD has put in place is designed to promote learning within and between projects at various levels. It allows IICD, its partners to receive feedback on the outcomes of the project implementation during focus group discussions. These ones provide also opportunities for the stakeholders to reflect on the progress and achievements of the project, as well as, take appropriate actions, where necessary, to ensure that the project interventions achieve the desired results. All active projects are subjected to at least one evaluation every year. In an effort to increase ownership at the project and participant levels, IICD and its M&E partners are gradually transferring responsibility for the project level focus group discussions to the project implementing partners to organise so that they can take ownership of the process and build their internal capacity over time for the use generation and use of evaluation information.
Опубликовано Olaf Erz - пт, 11/26/2010 - 10:05
In addition to project focus group discussions, IICD and its partners hold annual national focus groups in which partners review the general outcomes of all projects evaluated, discuss themes and issues that have emerged from the evaluation, and draw lessons learned as a means of cross fertilising the activities of the individual projects in the coming years. Outcomes and commitments are incorporated into an annual learning report. The commitments serve as the basis for action plans of the partners for the subsequent years of the project. The national focus group discussion provides an opportunity for IICD and partners to review general trends and challenges confronting the use of ICT as an instrument for development. Participants collectively find ways in which success stories can be mainstreamed across different projects/sectors and further discuss and suggest ways in which common challenges can be tackled, especially through the adoption of joint strategies to common issues.
Опубликовано P S Janaki Krishna (Dr.Mrs.) - пт, 11/26/2010 - 12:12
Use participatory approaches. Ask the endusers to analyse the merits and demerits of ICT. Take the feed back. Study and identify the gaps. Ask for solutions from the people side. Do SWOT analysis. Focus on the parameters that enhance their knowledge, skills and access while improving their incomes. Take suggestions from the people.Conduct mid term assessments. Note short term and long term impacts. Make the entire process simple. Focus on tangible and intangible benefits. Try to take mid course corrections. In my opinion rural areas have to be empowered by ICT as information and access to information are key factors for development.
Analysis may be done based on these four important criteria
Affordability
Access (connectivity here in this case) to information
Quality of the Information
Utility of the Information in improving incomes
Janaki
Опубликовано stephen kimole - пт, 11/26/2010 - 14:10
The fact that we want to measure the impact means that we are in agreement there is an impact. But when it come to measuring, I think it will be dependent on several factors for example the ICT tools being used, scale, socio economic status of the people among others. Some of the tools are used simultaneously and rarely do they work in isolation which complicates the process of measuring the impact. But one thing is for sure, ICT is here with us and it’s here to stay whether we measure the impact or not. The only thing that matters is the end user approval, if they like it they will adopt it whether it has scientific backing or not. A good example is the case of SRI where research was only done recently years after the method had widespread application by farmers.
Опубликовано Roxanna Samii - вс, 11/28/2010 - 16:00
Kimole - you took the words out of my mouth! Well said. Your analysis is right on.
Опубликовано Jenny Aker - пн, 11/29/2010 - 14:14
Thank you for your thoughtful and accurate posting. I completely agree that measuring the impact of ICTs can be complex, that they are (probably) here to stay, and that adoption signals that is it useful to them.
At the same time, if we are going to use public funding for ICT-based projects -- which might be replacing another type of project, say in health, agriculture or education -- I do think that we should be measuring the impact (at least at the initial stages). This will help us to know whether the ICT-based approach is "better" than the traditional approach (maybe users were using the traditional approach as well); whether the ICT-based approach is more cost-effective than the traditional approach; how it affects certain groups (some -- like the users - - might be positively affected, others might be negatively affected); and whether the impacts are in the same in different contexts (namely, different countries). An ICT-based project that worked really well in India might not succeed in Ghana.
I don't think that we need a "rigorous' impact evaluation for every project, but at least for new pilot projects in new contexts, I think that this is important -- especially when public funding is involved.
Опубликовано Ian Thomson - сб, 11/27/2010 - 03:03
I think it is important to focus on systemic change and innovation, both of which often take many years to show themselves. ITCs are only tools and it is how well the tool is used over time that is important.
Typically when ICTs are introduced there is some incremental change, but as it becomes widely adopted, significant process re-engineering becomes possible and transformative change becomes available if there is an innovation present.
This is what we need to focus on and report on.
ICT enabled change management is the hardest part of ICT4D and it is often the local bureaucracy, not the end user that prevents change and causes ICT4D projects to "fail"
Опубликовано Irfan Kasana - сб, 11/27/2010 - 19:33
Well, it is a bit difficult to analyze the socio-economic impact of ICT but yes we can quantify it in one or the other way. Prior to analyze we must add on a continuous pace of educating the rural community about the benefits/uses/values of ICTs tools and application and keep them updating. Perhaps it is a two way parallel approach, at one side feed in and on the other side evaluating the results.
At very beginning we have to study out the socio-culture of the community and then build up a web portal that encompasses the information/links that exactly matched with the desire both in English and regional language equipped with a real time feedback.
In second phase the feed community up with trainings, how they get benefits from the given information on the web and how they can access more desired/needed information and when and where they can contact to get real time solutions to their problem.
In third phases, evaluation to those parameters fed up to community earlier in a precise manner. A successful implementation/execution of such ICT tool can change the life of rural communities. A farmer can get weather forecast, market price information, demand and supply in markets, a student can have the access to universities, scholarships, a graduate can apply for jobs, a lady can buy grocery/cosmetics/health services while sitting her house. This all magic can be done with simple ICT application and can bring revolutions in rural life.
Опубликовано Raymond Erick Zvavanyange - пн, 11/29/2010 - 09:36
In order to analyze the socio-economic impact of ICT in rural areas one has to understand the power-plays in rural communities for this is a critical factor in the launch and success/failure of the ICT projects. Indicators drafted at the initial stage of implementation are also important guides but note that this is usually idealistic. It would also help to understand the culture of the community.
Опубликовано Andrew Kizito - пн, 11/29/2010 - 19:19
To conduct social-economic impact analysis, one needs to be very specific about the ICT in reference, its application (usage), stakeholders, the performance indicators, and the social-economic impact indicators.
For example, one needs to be specific about the ICT in reference: Is it cell phones (for voice and SMS), cell phone towers, broadcast radio, broadcast television, an internet connected computer, or an individual email account? One then has to state what the ICT is used for. Is the ICT used to transmit or diffuse market information (e.g., market prices), production or agronomic information, health information (e.g., malaria control or treatment messages), or financial transactions (e.g., money transfer)?
Next, one has to state who the beneficiaries are. Some projects identify farmers as their main clientele when in reality their main clientele are traders, government policy makers, or donors. Next, one has to identify the performance indicators as viewed by the users (e.g., reliability, accuracy, timelines, and accessibility).
Next, one has to identify the social-economic indicators to be measured. These can be numerable or non-numerable, and vary depending on the ICT usage. Examples include price received, revenue or income, quality and or quantity of food produced or bought, government policies that increase food security, new friends, better health, increased production and productivity, employment, improved property rights, and improved security.
Once the social-economic indicators are well stated, one can then think of methods to measure the marginal contribution (impact) of: (1) a particular ICT if its effects can be truly isolated from other factors such as the ability of the person who wrote the project proposal; or (2) a group of ICT if one tries to account for the complementarities within ICT usage, and between ICT usage and other intervention such as government policies.
Опубликовано Sonigitu Ekpe-Aji - вт, 11/30/2010 - 02:29
Once we get proper co-ordination of up-dated population figures and distribution and not estimations.
Today the youths are very active than the older ones in terms of ICT utilization. We can determine what is used by who and where.
I totally agree with Karl Jonas, make the project open to all stakeholders. Lets understand on thing, once you can track the distribution of people you can also get feedback easy.
Many countries today give wrong information on population data because of national interest or political reasons and this has hamper economic growth. Kizito points are very clear, the broad complexity will be narrowed once there is a database of real people. You can make findings via emails, voice, sms and video clips. This creates more openings, clarity to both the urban and rural dwellers; learning will be more interesting as people will have to adjust to the technological changes.
The complexity of ICT will be more easier when we face the reality of controls, within the global village. Everybody eats then lets get down to solving the problem of matching real figures.
Thank you