[ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us


#1

Glen,

We will be publishing a literature review on the current knowledge base of
real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir

··· --------------------------- Samir K. Doshi, Ph.D. | Senior Scientist U.S. Global Development Lab | US Agency for International Development E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be great
to see what you learn.

Glen Burnett

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti
data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of projects
that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to
others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org
http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter Support our work today [image:
Donate online] http://practicalaction.org/signature
Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#2

Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edu

··· > On May 11, 2016, at 9:45 AM, Samir Doshi wrote: > > Glen, > > We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management. > > The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year. > > Kind regards, > Samir > > --------------------------- > Samir K. Doshi, Ph.D. | Senior Scientist > U.S. Global Development Lab | US Agency for International Development > E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab > > On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.uk > wrote: > Merrick, will you be publishing results of this review? It would be great to see what you learn. > > > > Glen Burnett > > > > From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com ] On Behalf Of Merrick Schaefer > Sent: Tuesday, May 10, 2016 5:12 PM > To: ICT4D Principles > Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us. > > > > Hey Everyone, > > > > USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work. > > > > > We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research. > > > > > > Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below. > > > > > > The best five contributions will receive a copy of "Time to Listen," by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one > case study, please reuse this form and submit your > cases by 5/17/2016 in order to be considered and to win a copy of "Time to Listen." > > > > > > Your help and support are much appreciated! Also, please forward along to others that could contribute. > > > > https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform > > > Best, > > > > Merrick > > -- > You received this message because you are subscribed to the Google Groups "ICT4D Principles" group. > To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com . > To post to this group, send email to ict4d-principles@googlegroups.com . > For more options, visit https://groups.google.com/d/optout . > > > Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.org > Support our work today > Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ > Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954 > VAT Reg No. 880992476 | Reg Charity No. 247257. > > -- > You received this message because you are subscribed to the Google Groups "ICT4D Principles" group. > To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com . > To post to this group, send email to ict4d-principles@googlegroups.com . > For more options, visit https://groups.google.com/d/optout . > > > -- > You received this message because you are subscribed to the Google Groups "ICT4D Principles" group. > To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com . > To post to this group, send email to ict4d-principles@googlegroups.com . > For more options, visit https://groups.google.com/d/optout .

#3

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709
kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

··· On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji wrote:

Dear Samir,
Please keep me in the information loop. I am
particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base of
real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < > Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be great
to see what you learn.

Glen Burnett

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is
ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of
projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to
others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org
http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter Support our work today [image:
Donate online] http://practicalaction.org/signature
Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#4

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

··· > On May 11, 2016, at 5:06 PM, Robert Kirkpatrick wrote: > > Dear Shyamdas, > > We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here! > > Warm regards, > > Robert > > Robert Kirkpatrick > Director > United Nations Global Pulse > Executive Office of the Secretary-General > +1 650.796.5709 > kirkpatrick@un.org @rgkirkpatrick > > The Data Revolution in Action: 20 Case Studies by Global Pulse: > http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series > On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.net > wrote: > Dear Samir, > Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks. > Best, > Shyamadas Banerji > sbanerji@alum.mit.edu > > >> On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.gov > wrote: >> >> Glen, >> >> We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management. >> >> The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year. >> >> Kind regards, >> Samir >> >> --------------------------- >> Samir K. Doshi, Ph.D. | Senior Scientist >> U.S. Global Development Lab | US Agency for International Development >> E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab >> >> On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.uk > wrote: >> Merrick, will you be publishing results of this review? It would be great to see what you learn. >> >> >> >> Glen Burnett >> >> >> >> From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com ] On Behalf Of Merrick Schaefer >> Sent: Tuesday, May 10, 2016 5:12 PM >> To: ICT4D Principles >> Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us. >> >> >> >> Hey Everyone, >> >> >> >> USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work. >> >> >> >> >> We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research. >> >> >> >> >> >> Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below. >> >> >> >> >> >> The best five contributions will receive a copy of "Time to Listen," by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one >> case study, please reuse this form and submit your >> cases by 5/17/2016 in order to be considered and to win a copy of "Time to Listen." >> >> >> >> >> >> Your help and support are much appreciated! Also, please forward along to others that could contribute. >> >> >> >> https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform >> >> >> Best, >> >> >> >> Merrick >> >> -- >> You received this message because you are subscribed to the Google Groups "ICT4D Principles" group. >> To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com . >> To post to this group, send email to ict4d-principles@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout . >> >> >> Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.org >> Support our work today >> Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ >> Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954 >> VAT Reg No. 880992476 | Reg Charity No. 247257. >> >> -- >> You received this message because you are subscribed to the Google Groups "ICT4D Principles" group. >> To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com . >> To post to this group, send email to ict4d-principles@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout . >> >> >> -- >> You received this message because you are subscribed to the Google Groups "ICT4D Principles" group. >> To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com . >> To post to this group, send email to ict4d-principles@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout . > > > -- > You received this message because you are subscribed to the Google Groups "ICT4D Principles" group. > To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com . > To post to this group, send email to ict4d-principles@googlegroups.com . > For more options, visit https://groups.google.com/d/optout . >

#5

Hello Robert,

Perhaps the best way to achieve what you want is to organize data into a
Geographic Information System knowledgebase, organized at the ecosystem and
eco-region level (using the Terrestrial Eco-regions files held by World
Wildlife Fund). Thus, information shows up in the eco-regions and
ecosystems for which it is likely to be relevant. If input by every person
in each region is afforded, considered, and celebrated, and ways are found
to support their proposals and base actions on their analyses, communities
will accept it as a useful, respectful tool.

I gave a talk at the 5th International Symposium on Digital Earth (ISDE5,
UC Berkeley, July 2007) on collaboration between the community of science
and communities on the ground, based on common interests in specific
ecosystem problems. The scientist gets access to extremely fine-grained
data, and if she supports communication on the subject with a large sample
or class of the people involved, it will add up to big data. The community
gets access to cross-cutting research results and interpretation, and,
potentially, exposure to a very wide range of experiences from many parts
of the world. If the community is also afforded access to databases such as
introduced above, and supply chain and distribution channel software is
integrated into the db, and if not already present, concepts of
cooperatives are introduced, it becomes possible for communities to design
their own production and business ecosystems, based on the surplus capacity
of their natural ecosystems.

Whether there is sufficient engagement for a single ecosystem to generate
’big data’ or not, when you look at results from 867 eco-regions and
thousands of ecosystems, and start looking for environmental, cultural,
craft and technological commonalities, using them to empower people in each
ecosystem, and assisting those who decide to use the db as a tool, you will
rapidly wind up working with big data.

Regards,

Mark Roest
International Development
SeaWave Battery

Co-founder and Research Director
DesignEarth.net

··· On Wed, May 11, 2016 at 7:49 PM, Shyamadas Banerji wrote:

Dear Robert,
Many thanks for your interest in the question I raised. First, I should
mention that I am delighted to learn of your data analytics initiative. If
I can assist in any way , kindly let me know. I look forward to reading
Michael’s draft reports.
As someone who has undertaken evaluations of development programs and
projects for over two decades at the World Bank , ADB and other agencies,
I have been troubled that evaluators rely mainly on experience and
judgments in conducting evaluations, including conducting impact
evaluations, taking into consideration experimental trials and methods.
The standard DAC criteria used in program and project evaluations
-relevance, efficiency, efficacy, outcome and impact -are usually not well
defined or quantified a priori at appraisal , so that project evaluators
assign a subjective rating during ex-post evaluation which can be
erroneous. The log frame of the project may not be logical or evidence
based. The indicators used to assess each of the evaluation criteria may
fail to reflect the achievements taking into account broader sectoral
and country experience . And since these indicators are specified by the
project formulators at appraisal , weak or faulty indicators may constrain
the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the
logical framework and the conceptual underpinning of the project.
Recently, I have seen quite a few bird nests of TOC diagrams which contain
many assumptions about the logical process of change and transformation
which the project is trying to achieve without providing any empirical
evidence about how the change actually happens, the risks and why the
proposed intervention is the best or optimal method of achieving the
outcomes desired. Applications of Program Theory suffer from similar
deficiencies which I can elaborate on.
My interest is to explore *how one could use big data
analytics/artificial intelligence/machine learning to strengthen the
evidence base *of project formulation and evaluation in different sectors
or development issues. I would like to know how one could strengthen the
formulation of TOC for projects in different problem areas based on
actual field evidence from learning and implementation of a wide cross
section of completed projects . This would lead to a deeper understanding
of change pathways and risk variables at the
society/community/institutional levels depending on the level of project
intervention and how monitoring and mitigating actions can be built into
the project to achieve desired goals. Various development agencies could
contribute to providing data for building the data base. The data base
would provide a full picture of real life experiences on how development
problems in various areas have been defined and addressed and with what
results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies
have built data banks of projects they have supported and have undertaken
large meta studies of project interventions in specific areas to learn
some generalizable lessons. My experience looking at these meta studies is
that they are not particularly useful for designing new specific project
interventions and that the lessons of earlier projects are inadequately
reflected in new projects.
I am thinking of the value of developing a large multi country ,
multi agency data base which can be queried for evidence to help with
project design, implementation and evaluation. Can one build a data bank
which can use an IBM Watson type approach of artificial intelligence to
learn from past project interventions in different areas to design better
future interventions? The feedback loop between evaluation results and new
project designs can then be finally closed.
This is just a quick response to your question and I hope it will
stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick < > kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709
kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:

http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net > wrote:

Dear Samir,
Please keep me in the information loop. I am
particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base
of real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < >> Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be
great to see what you learn.

Glen Burnett

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is
ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of
projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016
in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along
to others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org
http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter Support our work
today [image: Donate online] http://practicalaction.org/signature
Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#6

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:

  • Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
  • Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
  • Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
  • Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

··· From: "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.net> Date: Wednesday, May 11, 2016 at 10:49 PM To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.org> Cc: Samir Doshi <sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.com>, "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.com> Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-serieshttp://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887 [http://bit.ly/YestUa] http://practicalaction.org/blogs [http://bit.ly/XpFkRI] http://practicalaction.org/get-our-e-newsletter Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257. [http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#7

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.

··· ---- Siobhan Green Sonjara, Inc. Digital Solutions that Serve the Greater Good Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev 207 Park Ave, B6, Falls Church, VA, USA www.sonjara.com | www.fakoli.org | www.griot.us Email: sio@sonjara.com Skype: sewgreen O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:

  • Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
  • Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
  • Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
  • Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#8

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

··· From: Siobhan Green <sio@sonjara.com> Date: Thursday, May 12, 2016 at 11:02 AM To: James BonTempo <James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:

  • Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
  • Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
  • Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
  • Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#9

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan

··· ---- Siobhan Green Sonjara, Inc. Digital Solutions that Serve the Greater Good Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev 207 Park Ave, B6, Falls Church, VA, USA www.sonjara.com | www.fakoli.org | www.griot.us Email: sio@sonjara.com Skype: sewgreen O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#10

+1 to this

··· On 12 May 2016 at 12:02, Siobhan Green wrote:

I actually don’t like using the term “big data” with this stuff. Most of
this is not really big. Sizable, yes, it can be, some of it is larger than
one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or
even terabytes if we have maps in there. It also is not high volume – the
data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an
excel spreadsheet or even database) but not using standard formats or
taxonomies, already aggregated, and often stripped of context or
information about methodology of capture. Quality of the data collected is
really varied.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM

To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to
create these kinds of “big data” repositories to mine for solutions were
underway :slight_smile:

*From: *Siobhan Green sio@sonjara.com
*Date: *Thursday, May 12, 2016 at 11:02 AM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of
the data right now on the DDL is not usable in this context.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policy
https://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way
for USAID and its partners to draw from an increasingly robust,
data-rich environment to create these breakthrough insights and solutions

in support of our mission well into the future. Specifically, the policy:

? Establishes the Development Data Library (DDL) as the Agency’s
repository of USAID-funded, machine readable data created or collected by
the Agency and its implementing partners;

? Requires USAID staff and implementing partners (via associated
changes to procurement instruments) to submit datasets generated with USAID
funding to the DDL in machine-readable, non-proprietary formats;

? Implements a data tagging protocol in keeping with the
President’s Executive Order and Office of Management and Budget policy on
Open Data; and

? Defines a data clearance process to ensure that USAID makes as
much data publicly available as possible, while still affording all
protections for individual privacy, operational and national security, and
other considerations allowable by law.”

James

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <
banerji1@comcast.net>
*Date: *Wednesday, May 11, 2016 at 10:49 PM
*To: *Robert Kirkpatrick kirkpatrick@unglobalpulse.org
*Cc: *Samir Doshi sdoshi@usaid.gov, Glen Burnett <
Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <
merrickweb@gmail.com>, "ict4d-principles@googlegroups.com" <
ict4d-principles@googlegroups.com>, Michael Bamberger <
jmichaelbamberger@gmail.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Dear Robert,

Many thanks for your interest in the question I raised. First, I should
mention that I am delighted to learn of your data analytics initiative. If
I can assist in any way , kindly let me know. I look forward to reading
Michael’s draft reports.

As someone who has undertaken evaluations of development programs and
projects for over two decades at the World Bank , ADB and other agencies,
I have been troubled that evaluators rely mainly on experience and
judgments in conducting evaluations, including conducting impact
evaluations, taking into consideration experimental trials and methods.
The standard DAC criteria used in program and project evaluations
-relevance, efficiency, efficacy, outcome and impact -are usually not well
defined or quantified a priori at appraisal , so that project evaluators
assign a subjective rating during ex-post evaluation which can be
erroneous. The log frame of the project may not be logical or evidence
based. The indicators used to assess each of the evaluation criteria may
fail to reflect the achievements taking into account broader sectoral
and country experience . And since these indicators are specified by the
project formulators at appraisal , weak or faulty indicators may constrain
the ex-post evaluation exercise.

Another issue is the the Theory of Change (TOC) which supports the
logical framework and the conceptual underpinning of the project.
Recently, I have seen quite a few bird nests of TOC diagrams which contain
many assumptions about the logical process of change and transformation
which the project is trying to achieve without providing any empirical
evidence about how the change actually happens, the risks and why the
proposed intervention is the best or optimal method of achieving the
outcomes desired. Applications of Program Theory suffer from similar
deficiencies which I can elaborate on.

My interest is to explore *how one could use big data
analytics/artificial intelligence/machine learning to strengthen the
evidence base *of project formulation and evaluation in different sectors
or development issues. I would like to know how one could strengthen the
formulation of TOC for projects in different problem areas based on
actual field evidence from learning and implementation of a wide cross
section of completed projects . This would lead to a deeper understanding
of change pathways and risk variables at the
society/community/institutional levels depending on the level of project
intervention and how monitoring and mitigating actions can be built into
the project to achieve desired goals. Various development agencies could
contribute to providing data for building the data base. The data base
would provide a full picture of real life experiences on how development
problems in various areas have been defined and addressed and with what
results and reasons for the outcomes and the lessons.

I am aware that the evaluation departments some development agencies
have built data banks of projects they have supported and have undertaken
large meta studies of project interventions in specific areas to learn
some generalizable lessons. My experience looking at these meta studies is
that they are not particularly useful for designing new specific project
interventions and that the lessons of earlier projects are inadequately
reflected in new projects.

I am thinking of the value of developing a large multi country , multi
agency data base which can be queried for evidence to help with project
design, implementation and evaluation. Can one build a data bank which can
use an IBM Watson type approach of artificial intelligence to learn from
past project interventions in different areas to design better future
interventions? The feedback loop between evaluation results and new
project designs can then be finally closed.

This is just a quick response to your question and I hope it will
stimulate some thinking and generate some more focused ideas.

Kind regards,

Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick < > kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick

Director
United Nations Global Pulse
Executive Office of the Secretary-General

+1 650.796.5709
kirkpatrick@un.org

@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:

http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net > wrote:

Dear Samir,

                 Please keep me in the information loop. I am

particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.

Best,

Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base of
real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,

Samir


Samir K. Doshi, Ph.D. | Senior Scientist

U.S. Global Development Lab | US Agency for International Development

E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < > Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be great
to see what you learn.

Glen Burnett

*From:*ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti
data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of projects
that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to
others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org

http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter

Support our work today [image: Donate online]
http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#11

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

··· From: "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.com> Date: Thursday, May 12, 2016 at 3:02 PM To: James BonTempo <James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#12

Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan

··· ---- Siobhan Green Sonjara, Inc. Digital Solutions that Serve the Greater Good Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev 207 Park Ave, B6, Falls Church, VA, USA www.sonjara.com | www.fakoli.org | www.griot.us Email: sio@sonjara.com Skype: sewgreen O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#13

I think the term “fat data” is generally more accurate. Short, wide and
variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are
so important. Standards like Hxl show some progress and hopefully some
type geocoding tied to osm.

··· On Thursday, May 12, 2016, Siobhan Green wrote:

Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of
“sizable” data sets, I believe, require different tools and approaches. I
believe a lot of the key in mining big data sets is the constancy of how
the data is captured and collected – it just happens to be very large and
complex.

The challenge with the DDL is that there is minimal consistency in how
data is captured and collected, or even what it is about – meaning that
creating or using software tools to automate the process is a lot harder.
There is a ton of background knowledge needed about the specific data and
project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that
read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text
explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has
to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a
small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com <javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);>
Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>
[mailto:ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>] *On
Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles <ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety
& velocity. Alas, the idea of gathering & opening the data for mining &
learning is a good one & progress is being made…

*From: *“ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>” <
ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>> on
behalf of Siobhan Green <sio@sonjara.com
<javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);>>
*Date: *Thursday, May 12, 2016 at 3:02 PM
*To: *James BonTempo <James.BonTempo@jhu.edu
<javascript:_e(%7B%7D,‘cvml’,‘James.BonTempo@jhu.edu’);>>, “
ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>” <
ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of
this is not really big. Sizable, yes, it can be, some of it is larger than
one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or
even terabytes if we have maps in there. It also is not high volume – the
data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an
excel spreadsheet or even database) but not using standard formats or
taxonomies, already aggregated, and often stripped of context or
information about methodology of capture. Quality of the data collected is
really varied.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com <javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);>
Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);> [
mailto:ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>] *On
Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to
create these kinds of “big data” repositories to mine for solutions were
underway :slight_smile:

*From: *Siobhan Green <sio@sonjara.com
<javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);>>
*Date: *Thursday, May 12, 2016 at 11:02 AM
*To: *James BonTempo <James.BonTempo@jhu.edu
<javascript:_e(%7B%7D,‘cvml’,‘James.BonTempo@jhu.edu’);>>, “
ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>” <
ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of
the data right now on the DDL is not usable in this context.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com <javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);>
Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);> [
mailto:ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>] *On
Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policy
https://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way
for USAID and its partners to draw from an increasingly robust,
data-rich environment to create these breakthrough insights and solutions

in support of our mission well into the future. Specifically, the policy:

? Establishes the Development Data Library (DDL) as the Agency’s
repository of USAID-funded, machine readable data created or collected by
the Agency and its implementing partners;

? Requires USAID staff and implementing partners (via associated
changes to procurement instruments) to submit datasets generated with USAID
funding to the DDL in machine-readable, non-proprietary formats;

? Implements a data tagging protocol in keeping with the
President’s Executive Order and Office of Management and Budget policy on
Open Data; and

? Defines a data clearance process to ensure that USAID makes as
much data publicly available as possible, while still affording all
protections for individual privacy, operational and national security, and
other considerations allowable by law.”

James

*From: *“ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>” <
ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>> on
behalf of Shyamadas Banerji <banerji1@comcast.net
<javascript:_e(%7B%7D,‘cvml’,‘banerji1@comcast.net’);>>
*Date: *Wednesday, May 11, 2016 at 10:49 PM
*To: *Robert Kirkpatrick <kirkpatrick@unglobalpulse.org
<javascript:_e(%7B%7D,‘cvml’,‘kirkpatrick@unglobalpulse.org’);>>
*Cc: *Samir Doshi <sdoshi@usaid.gov
<javascript:_e(%7B%7D,‘cvml’,‘sdoshi@usaid.gov’);>>, Glen Burnett <
Glen.Burnett@practicalaction.org.uk
<javascript:_e(%7B%7D,‘cvml’,‘Glen.Burnett@practicalaction.org.uk’);>>,
Merrick Schaefer <merrickweb@gmail.com
<javascript:_e(%7B%7D,‘cvml’,‘merrickweb@gmail.com’);>>, “
ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>” <
ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>,
Michael Bamberger <jmichaelbamberger@gmail.com
<javascript:_e(%7B%7D,‘cvml’,‘jmichaelbamberger@gmail.com’);>>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Dear Robert,

Many thanks for your interest in the question I raised. First, I should
mention that I am delighted to learn of your data analytics initiative. If
I can assist in any way , kindly let me know. I look forward to reading
Michael’s draft reports.

As someone who has undertaken evaluations of development programs and
projects for over two decades at the World Bank , ADB and other agencies,
I have been troubled that evaluators rely mainly on experience and
judgments in conducting evaluations, including conducting impact
evaluations, taking into consideration experimental trials and methods.
The standard DAC criteria used in program and project evaluations
-relevance, efficiency, efficacy, outcome and impact -are usually not well
defined or quantified a priori at appraisal , so that project evaluators
assign a subjective rating during ex-post evaluation which can be
erroneous. The log frame of the project may not be logical or evidence
based. The indicators used to assess each of the evaluation criteria may
fail to reflect the achievements taking into account broader sectoral
and country experience . And since these indicators are specified by the
project formulators at appraisal , weak or faulty indicators may constrain
the ex-post evaluation exercise.

Another issue is the the Theory of Change (TOC) which supports the
logical framework and the conceptual underpinning of the project.
Recently, I have seen quite a few bird nests of TOC diagrams which contain
many assumptions about the logical process of change and transformation
which the project is trying to achieve without providing any empirical
evidence about how the change actually happens, the risks and why the
proposed intervention is the best or optimal method of achieving the
outcomes desired. Applications of Program Theory suffer from similar
deficiencies which I can elaborate on.

My interest is to explore *how one could use big data
analytics/artificial intelligence/machine learning to strengthen the
evidence base *of project formulation and evaluation in different sectors
or development issues. I would like to know how one could strengthen the
formulation of TOC for projects in different problem areas based on
actual field evidence from learning and implementation of a wide cross
section of completed projects . This would lead to a deeper understanding
of change pathways and risk variables at the
society/community/institutional levels depending on the level of project
intervention and how monitoring and mitigating actions can be built into
the project to achieve desired goals. Various development agencies could
contribute to providing data for building the data base. The data base
would provide a full picture of real life experiences on how development
problems in various areas have been defined and addressed and with what
results and reasons for the outcomes and the lessons.

I am aware that the evaluation departments some development agencies
have built data banks of projects they have supported and have undertaken
large meta studies of project interventions in specific areas to learn
some generalizable lessons. My experience looking at these meta studies is
that they are not particularly useful for designing new specific project
interventions and that the lessons of earlier projects are inadequately
reflected in new projects.

I am thinking of the value of developing a large multi country , multi
agency data base which can be queried for evidence to help with project
design, implementation and evaluation. Can one build a data bank which can
use an IBM Watson type approach of artificial intelligence to learn from
past project interventions in different areas to design better future
interventions? The feedback loop between evaluation results and new
project designs can then be finally closed.

This is just a quick response to your question and I hope it will
stimulate some thinking and generate some more focused ideas.

Kind regards,

Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick < > kirkpatrick@unglobalpulse.org > <javascript:_e(%7B%7D,‘cvml’,‘kirkpatrick@unglobalpulse.org’);>> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick

Director
United Nations Global Pulse
Executive Office of the Secretary-General

+1 650.796.5709
kirkpatrick@un.org <javascript:_e(%7B%7D,‘cvml’,‘kirkpatrick@un.org’);>

@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:

http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.net > <javascript:_e(%7B%7D,‘cvml’,‘banerji1@comcast.net’);>> wrote:

Dear Samir,

                 Please keep me in the information loop. I am

particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.

Best,

Shyamadas Banerji
sbanerji@alum.mit.edu
<javascript:_e(%7B%7D,‘cvml’,‘sbanerji@alum.mit.edu’);>

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.gov > <javascript:_e(%7B%7D,‘cvml’,‘sdoshi@usaid.gov’);>> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of
real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,

Samir


Samir K. Doshi, Ph.D. | Senior Scientist

U.S. Global Development Lab | US Agency for International Development

E: sdoshi@usaid.gov <javascript:_e(%7B%7D,‘cvml’,‘sdoshi@usaid.gov’);> |
P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < > Glen.Burnett@practicalaction.org.uk > <javascript:_e(%7B%7D,‘cvml’,‘Glen.Burnett@practicalaction.org.uk’);>> > wrote:

Merrick, will you be publishing results of this review? It would be great
to see what you learn.

Glen Burnett

*From:*ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>
[mailto:ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>] *On
Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti
data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of projects
that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to
others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org

http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter

Support our work today [image: Donate online]
http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>
.
To post to this group, send email to ict4d-principles@googlegroups.com
<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


#14

Fantastic story, Siobhan!

··· On May 12, 2016 2:50 PM, "Sanjay Jain" wrote:

Open means nothing if it is not usable for good decision making.

All technology (in fact pretty much everything else as well) requires that
users understand what it is, before using it. Traffic lights are only
useful because we’ve been trained to understand them.

Having some erroneous data points should not make the data set unusable.
And it also does not mean that it should not be open.

True, we can clean up the data for those who are likely to use it without
understanding it, but I’d advocate for both the raw and cleaned up data
sets to be made available. The transition to an “open” mindset is going to
take time and no doubt some mistakes will be made along the way, but it’s a
transition well worth making imo.

~sanjay

PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green sio@sonjara.com wrote:

Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe
pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL
as well as standardized indicators can make a huge difference in
interoperability.

Also – what methodology was used to capture the data? I cannot use it for
decision making if I don’t know what the data means and how much I can
trust it.

Case in point. A friend used to live in a small village in Ireland with
her husband, who worked on a mining project in Nigeria. He travelled weekly
to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was
asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my
husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the
form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the
village. When she asked about it, they informed her the census results came
back and it turns out according to the results, village residents commuted
an average of 50 miles a week (for context, Ireland is 174 miles wide and
302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: Matt Berg [mailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green sio@sonjara.com
Cc: James BonTempo James.BonTempo@jhu.edu; ICT4D Principles <
ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and
variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards
are so important. Standards like Hxl show some progress and hopefully some
type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green sio@sonjara.com wrote:

Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of
“sizable” data sets, I believe, require different tools and approaches. I
believe a lot of the key in mining big data sets is the constancy of how
the data is captured and collected – it just happens to be very large and
complex.

The challenge with the DDL is that there is minimal consistency in how
data is captured and collected, or even what it is about – meaning that
creating or using software tools to automate the process is a lot harder.
There is a ton of background knowledge needed about the specific data and
project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that
read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in
text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone
has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a
small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume,
variety & velocity. Alas, the idea of gathering & opening the data for
mining & learning is a good one & progress is being made…

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Siobhan Green <
sio@sonjara.com>
*Date: *Thursday, May 12, 2016 at 3:02 PM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of
this is not really big. Sizable, yes, it can be, some of it is larger than
one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or
even terabytes if we have maps in there. It also is not high volume – the
data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an
excel spreadsheet or even database) but not using standard formats or
taxonomies, already aggregated, and often stripped of context or
information about methodology of capture. Quality of the data collected is
really varied.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts
to create these kinds of “big data” repositories to mine for solutions were
underway :slight_smile:

*From: *Siobhan Green sio@sonjara.com
*Date: *Thursday, May 12, 2016 at 11:02 AM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most
of the data right now on the DDL is not usable in this context.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policy
https://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way
for USAID and its partners to draw from an increasingly robust,
data-rich environment to create these breakthrough insights and solutions

in support of our mission well into the future. Specifically, the policy:

? Establishes the Development Data Library (DDL) as the Agency’s
repository of USAID-funded, machine readable data created or collected by
the Agency and its implementing partners;

? Requires USAID staff and implementing partners (via associated
changes to procurement instruments) to submit datasets generated with USAID
funding to the DDL in machine-readable, non-proprietary formats;

? Implements a data tagging protocol in keeping with the
President’s Executive Order and Office of Management and Budget policy on
Open Data; and

? Defines a data clearance process to ensure that USAID makes as
much data publicly available as possible, while still affording all
protections for individual privacy, operational and national security, and
other considerations allowable by law.”

James

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <
banerji1@comcast.net>
*Date: *Wednesday, May 11, 2016 at 10:49 PM
*To: *Robert Kirkpatrick kirkpatrick@unglobalpulse.org
*Cc: *Samir Doshi sdoshi@usaid.gov, Glen Burnett <
Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <
merrickweb@gmail.com>, "ict4d-principles@googlegroups.com" <
ict4d-principles@googlegroups.com>, Michael Bamberger <
jmichaelbamberger@gmail.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Dear Robert,

Many thanks for your interest in the question I raised. First, I should
mention that I am delighted to learn of your data analytics initiative. If
I can assist in any way , kindly let me know. I look forward to reading
Michael’s draft reports.

As someone who has undertaken evaluations of development programs and
projects for over two decades at the World Bank , ADB and other agencies,
I have been troubled that evaluators rely mainly on experience and
judgments in conducting evaluations, including conducting impact
evaluations, taking into consideration experimental trials and methods.
The standard DAC criteria used in program and project evaluations
-relevance, efficiency, efficacy, outcome and impact -are usually not well
defined or quantified a priori at appraisal , so that project evaluators
assign a subjective rating during ex-post evaluation which can be
erroneous. The log frame of the project may not be logical or evidence
based. The indicators used to assess each of the evaluation criteria may
fail to reflect the achievements taking into account broader sectoral
and country experience . And since these indicators are specified by the
project formulators at appraisal , weak or faulty indicators may constrain
the ex-post evaluation exercise.

Another issue is the the Theory of Change (TOC) which supports the
logical framework and the conceptual underpinning of the project.
Recently, I have seen quite a few bird nests of TOC diagrams which contain
many assumptions about the logical process of change and transformation
which the project is trying to achieve without providing any empirical
evidence about how the change actually happens, the risks and why the
proposed intervention is the best or optimal method of achieving the
outcomes desired. Applications of Program Theory suffer from similar
deficiencies which I can elaborate on.

My interest is to explore *how one could use big data
analytics/artificial intelligence/machine learning to strengthen the
evidence base *of project formulation and evaluation in different
sectors or development issues. I would like to know how one could
strengthen the formulation of TOC for projects in different problem areas
based on actual field evidence from learning and implementation of a
wide cross section of completed projects . This would lead to a deeper
understanding of change pathways and risk variables at the
society/community/institutional levels depending on the level of project
intervention and how monitoring and mitigating actions can be built into
the project to achieve desired goals. Various development agencies could
contribute to providing data for building the data base. The data base
would provide a full picture of real life experiences on how development
problems in various areas have been defined and addressed and with what
results and reasons for the outcomes and the lessons.

I am aware that the evaluation departments some development agencies
have built data banks of projects they have supported and have undertaken
large meta studies of project interventions in specific areas to learn
some generalizable lessons. My experience looking at these meta studies is
that they are not particularly useful for designing new specific project
interventions and that the lessons of earlier projects are inadequately
reflected in new projects.

I am thinking of the value of developing a large multi country , multi
agency data base which can be queried for evidence to help with project
design, implementation and evaluation. Can one build a data bank which can
use an IBM Watson type approach of artificial intelligence to learn from
past project interventions in different areas to design better future
interventions? The feedback loop between evaluation results and new
project designs can then be finally closed.

This is just a quick response to your question and I hope it will
stimulate some thinking and generate some more focused ideas.

Kind regards,

Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick < >> kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick

Director
United Nations Global Pulse
Executive Office of the Secretary-General

+1 650.796.5709
kirkpatrick@un.org

@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:

http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net >> wrote:

Dear Samir,

                 Please keep me in the information loop. I am

particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.

Best,

Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base
of real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,

Samir


Samir K. Doshi, Ph.D. | Senior Scientist

U.S. Global Development Lab | US Agency for International Development

E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < >> Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be great
to see what you learn.

Glen Burnett

*From:*ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is
ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of projects
that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to
others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org

http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter

Support our work today [image: Donate online]
http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.com


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#15

Open means nothing if it is not usable for good decision making.

All technology (in fact pretty much everything else as well) requires that
users understand what it is, before using it. Traffic lights are only
useful because we’ve been trained to understand them.

Having some erroneous data points should not make the data set unusable.
And it also does not mean that it should not be open.

True, we can clean up the data for those who are likely to use it without
understanding it, but I’d advocate for both the raw and cleaned up data
sets to be made available. The transition to an “open” mindset is going to
take time and no doubt some mistakes will be made along the way, but it’s a
transition well worth making imo.

~sanjay

PS - interesting story!

··· On Thu, May 12, 2016 at 3:32 PM, Siobhan Green wrote:

Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe
pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as
well as standardized indicators can make a huge difference in
interoperability.

Also – what methodology was used to capture the data? I cannot use it for
decision making if I don’t know what the data means and how much I can
trust it.

Case in point. A friend used to live in a small village in Ireland with
her husband, who worked on a mining project in Nigeria. He travelled weekly
to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked
the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my
husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the
form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the
village. When she asked about it, they informed her the census results came
back and it turns out according to the results, village residents commuted
an average of 50 miles a week (for context, Ireland is 174 miles wide and
302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: Matt Berg [mailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green sio@sonjara.com
Cc: James BonTempo James.BonTempo@jhu.edu; ICT4D Principles <
ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and
variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are
so important. Standards like Hxl show some progress and hopefully some
type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green sio@sonjara.com wrote:

Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of
“sizable” data sets, I believe, require different tools and approaches. I
believe a lot of the key in mining big data sets is the constancy of how
the data is captured and collected – it just happens to be very large and
complex.

The challenge with the DDL is that there is minimal consistency in how
data is captured and collected, or even what it is about – meaning that
creating or using software tools to automate the process is a lot harder.
There is a ton of background knowledge needed about the specific data and
project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that
read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text
explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has
to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a
small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety
& velocity. Alas, the idea of gathering & opening the data for mining &
learning is a good one & progress is being made…

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Siobhan Green <
sio@sonjara.com>
*Date: *Thursday, May 12, 2016 at 3:02 PM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of
this is not really big. Sizable, yes, it can be, some of it is larger than
one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or
even terabytes if we have maps in there. It also is not high volume – the
data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an
excel spreadsheet or even database) but not using standard formats or
taxonomies, already aggregated, and often stripped of context or
information about methodology of capture. Quality of the data collected is
really varied.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to
create these kinds of “big data” repositories to mine for solutions were
underway :slight_smile:

*From: *Siobhan Green sio@sonjara.com
*Date: *Thursday, May 12, 2016 at 11:02 AM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of
the data right now on the DDL is not usable in this context.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policy
https://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way
for USAID and its partners to draw from an increasingly robust,
data-rich environment to create these breakthrough insights and solutions

in support of our mission well into the future. Specifically, the policy:

? Establishes the Development Data Library (DDL) as the Agency’s
repository of USAID-funded, machine readable data created or collected by
the Agency and its implementing partners;

? Requires USAID staff and implementing partners (via associated
changes to procurement instruments) to submit datasets generated with USAID
funding to the DDL in machine-readable, non-proprietary formats;

? Implements a data tagging protocol in keeping with the
President’s Executive Order and Office of Management and Budget policy on
Open Data; and

? Defines a data clearance process to ensure that USAID makes as
much data publicly available as possible, while still affording all
protections for individual privacy, operational and national security, and
other considerations allowable by law.”

James

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <
banerji1@comcast.net>
*Date: *Wednesday, May 11, 2016 at 10:49 PM
*To: *Robert Kirkpatrick kirkpatrick@unglobalpulse.org
*Cc: *Samir Doshi sdoshi@usaid.gov, Glen Burnett <
Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <
merrickweb@gmail.com>, "ict4d-principles@googlegroups.com" <
ict4d-principles@googlegroups.com>, Michael Bamberger <
jmichaelbamberger@gmail.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Dear Robert,

Many thanks for your interest in the question I raised. First, I should
mention that I am delighted to learn of your data analytics initiative. If
I can assist in any way , kindly let me know. I look forward to reading
Michael’s draft reports.

As someone who has undertaken evaluations of development programs and
projects for over two decades at the World Bank , ADB and other agencies,
I have been troubled that evaluators rely mainly on experience and
judgments in conducting evaluations, including conducting impact
evaluations, taking into consideration experimental trials and methods.
The standard DAC criteria used in program and project evaluations
-relevance, efficiency, efficacy, outcome and impact -are usually not well
defined or quantified a priori at appraisal , so that project evaluators
assign a subjective rating during ex-post evaluation which can be
erroneous. The log frame of the project may not be logical or evidence
based. The indicators used to assess each of the evaluation criteria may
fail to reflect the achievements taking into account broader sectoral
and country experience . And since these indicators are specified by the
project formulators at appraisal , weak or faulty indicators may constrain
the ex-post evaluation exercise.

Another issue is the the Theory of Change (TOC) which supports the
logical framework and the conceptual underpinning of the project.
Recently, I have seen quite a few bird nests of TOC diagrams which contain
many assumptions about the logical process of change and transformation
which the project is trying to achieve without providing any empirical
evidence about how the change actually happens, the risks and why the
proposed intervention is the best or optimal method of achieving the
outcomes desired. Applications of Program Theory suffer from similar
deficiencies which I can elaborate on.

My interest is to explore *how one could use big data
analytics/artificial intelligence/machine learning to strengthen the
evidence base *of project formulation and evaluation in different sectors
or development issues. I would like to know how one could strengthen the
formulation of TOC for projects in different problem areas based on
actual field evidence from learning and implementation of a wide cross
section of completed projects . This would lead to a deeper understanding
of change pathways and risk variables at the
society/community/institutional levels depending on the level of project
intervention and how monitoring and mitigating actions can be built into
the project to achieve desired goals. Various development agencies could
contribute to providing data for building the data base. The data base
would provide a full picture of real life experiences on how development
problems in various areas have been defined and addressed and with what
results and reasons for the outcomes and the lessons.

I am aware that the evaluation departments some development agencies
have built data banks of projects they have supported and have undertaken
large meta studies of project interventions in specific areas to learn
some generalizable lessons. My experience looking at these meta studies is
that they are not particularly useful for designing new specific project
interventions and that the lessons of earlier projects are inadequately
reflected in new projects.

I am thinking of the value of developing a large multi country , multi
agency data base which can be queried for evidence to help with project
design, implementation and evaluation. Can one build a data bank which can
use an IBM Watson type approach of artificial intelligence to learn from
past project interventions in different areas to design better future
interventions? The feedback loop between evaluation results and new
project designs can then be finally closed.

This is just a quick response to your question and I hope it will
stimulate some thinking and generate some more focused ideas.

Kind regards,

Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick < > kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick

Director
United Nations Global Pulse
Executive Office of the Secretary-General

+1 650.796.5709
kirkpatrick@un.org

@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:

http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net > wrote:

Dear Samir,

                 Please keep me in the information loop. I am

particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.

Best,

Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base of
real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,

Samir


Samir K. Doshi, Ph.D. | Senior Scientist

U.S. Global Development Lab | US Agency for International Development

E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < > Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be great
to see what you learn.

Glen Burnett

*From:*ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti
data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of projects
that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to
others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org

http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter

Support our work today [image: Donate online]
http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax


#16

Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as well as standardized indicators can make a huge difference in interoperability.

Also – what methodology was used to capture the data? I cannot use it for decision making if I don’t know what the data means and how much I can trust it.

Case in point. A friend used to live in a small village in Ireland with her husband, who worked on a mining project in Nigeria. He travelled weekly to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the village. When she asked about it, they informed her the census results came back and it turns out according to the results, village residents commuted an average of 50 miles a week (for context, Ireland is 174 miles wide and 302 miles long).

Open means nothing if it is not usable for good decision making.

··· ---- Siobhan Green Sonjara, Inc. Digital Solutions that Serve the Greater Good Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev 207 Park Ave, B6, Falls Church, VA, USA www.sonjara.com | www.fakoli.org | www.griot.us Email: sio@sonjara.com Skype: sewgreen O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: Matt Berg [mailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green sio@sonjara.com
Cc: James BonTempo James.BonTempo@jhu.edu; ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are so important. Standards like Hxl show some progress and hopefully some type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.com<javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);> Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);> [mailto:ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles <ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>" <ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>> on behalf of Siobhan Green <sio@sonjara.com<javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);>>
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo <James.BonTempo@jhu.edu<javascript:_e(%7B%7D,‘cvml’,‘James.BonTempo@jhu.edu’);>>, "ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>" <ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.com<javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);> Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);> [mailto:ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.com<javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);>>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edu<javascript:_e(%7B%7D,‘cvml’,‘James.BonTempo@jhu.edu’);>>, "ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>" <ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.com<javascript:_e(%7B%7D,‘cvml’,‘sio@sonjara.com’);> Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From:ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);> [mailto:ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
• Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
• Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
• Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
• Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>" <ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>> on behalf of Shyamadas Banerji <banerji1@comcast.net<javascript:_e(%7B%7D,‘cvml’,‘banerji1@comcast.net’);>>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.org<javascript:_e(%7B%7D,‘cvml’,‘kirkpatrick@unglobalpulse.org’);>>
Cc: Samir Doshi <sdoshi@usaid.gov<javascript:_e(%7B%7D,‘cvml’,‘sdoshi@usaid.gov’);>>, Glen Burnett <Glen.Burnett@practicalaction.org.uk<javascript:_e(%7B%7D,‘cvml’,‘Glen.Burnett@practicalaction.org.uk’);>>, Merrick Schaefer <merrickweb@gmail.com<javascript:_e(%7B%7D,‘cvml’,‘merrickweb@gmail.com’);>>, "ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>" <ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>>, Michael Bamberger <jmichaelbamberger@gmail.com<javascript:_e(%7B%7D,‘cvml’,‘jmichaelbamberger@gmail.com’);>>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.org<javascript:_e(%7B%7D,‘cvml’,‘kirkpatrick@unglobalpulse.org’);>> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709
kirkpatrick@un.org<javascript:_e(%7B%7D,‘cvml’,‘kirkpatrick@un.org’);>
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.net<javascript:_e(%7B%7D,‘cvml’,‘banerji1@comcast.net’);>> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edu<javascript:_e(%7B%7D,‘cvml’,‘sbanerji@alum.mit.edu’);>

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.gov<javascript:_e(%7B%7D,‘cvml’,‘sdoshi@usaid.gov’);>> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.gov<javascript:_e(%7B%7D,‘cvml’,‘sdoshi@usaid.gov’);> | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.uk<javascript:_e(%7B%7D,‘cvml’,‘Glen.Burnett@practicalaction.org.uk’);>> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);> [mailto:ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles%2Bunsubscribe@googlegroups.com’);>.
To post to this group, send email to ict4d-principles@googlegroups.com<javascript:_e(%7B%7D,‘cvml’,‘ict4d-principles@googlegroups.com’);>.
For more options, visit https://groups.google.com/d/optout.


#17

Was reminded of this thread today as I read this article in the New England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable and Useful Data Sharinghttp://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production of ‘data dumpsters’: repositories of data without the metadata, data dictionaries, or documentation needed for meaningful or correct reanalysis. Fulfilling an obligation to share data before good practices in data formatting and documentation have been established and replicated may allow researchers to check the ‘data shared’ box, but it may also result in an epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think are relevant & useful. Definitely worth the 5 minutes to read…

··· From: "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> on behalf of Rose Shuman <roseshuman@gmail.com> Date: Thursday, May 12, 2016 at 5:52 PM To: Sanjay Jain <sanjay@aghstrategies.com> Cc: "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Fantastic story, Siobhan!

On May 12, 2016 2:50 PM, “Sanjay Jain” <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com> wrote:

Open means nothing if it is not usable for good decision making.

All technology (in fact pretty much everything else as well) requires that users understand what it is, before using it. Traffic lights are only useful because we’ve been trained to understand them.

Having some erroneous data points should not make the data set unusable. And it also does not mean that it should not be open.

True, we can clean up the data for those who are likely to use it without understanding it, but I’d advocate for both the raw and cleaned up data sets to be made available. The transition to an “open” mindset is going to take time and no doubt some mistakes will be made along the way, but it’s a transition well worth making imo.

~sanjay

PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as well as standardized indicators can make a huge difference in interoperability.

Also – what methodology was used to capture the data? I cannot use it for decision making if I don’t know what the data means and how much I can trust it.

Case in point. A friend used to live in a small village in Ireland with her husband, who worked on a mining project in Nigeria. He travelled weekly to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the village. When she asked about it, they informed her the census results came back and it turns out according to the results, village residents commuted an average of 50 miles a week (for context, Ireland is 174 miles wide and 302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: Matt Berg [mailto:mberg@ona.iomailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Cc: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>; ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are so important. Standards like Hxl show some progress and hopefully some type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com on behalf of Siobhan Green sio@sonjara.com
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo James.BonTempo@jhu.edu, "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green sio@sonjara.com
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo James.BonTempo@jhu.edu, "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com on behalf of Shyamadas Banerji banerji1@comcast.net
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick kirkpatrick@unglobalpulse.org
Cc: Samir Doshi sdoshi@usaid.gov, Glen Burnett Glen.Burnett@practicalaction.org.uk, Merrick Schaefer merrickweb@gmail.com, "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com, Michael Bamberger jmichaelbamberger@gmail.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick kirkpatrick@unglobalpulse.org wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709tel:%2B1%20650.796.5709
kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett Glen.Burnett@practicalaction.org.uk wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#18

Not that I’m advocating for not providing data in a meaningful way, but I
wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it
could overcome some of these limitations.

~sanjay

··· On Wed, May 25, 2016 at 9:44 AM, James BonTempo wrote:

Was reminded of this thread today as I read this article in the New
England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable
and Useful Data Sharing
http://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production
of ‘data dumpsters’: repositories of data without the metadata, data
dictionaries, or documentation needed for meaningful or correct reanalysis.
Fulfilling an obligation to share data before good practices in data
formatting and documentation have been established and replicated may allow
researchers to check the ‘data shared’ box, but it may also result in an
epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think
are relevant & useful. Definitely worth the 5 minutes to read…

From: "ict4d-principles@googlegroups.com" <
ict4d-principles@googlegroups.com> on behalf of Rose Shuman <
roseshuman@gmail.com>
Date: Thursday, May 12, 2016 at 5:52 PM
To: Sanjay Jain sanjay@aghstrategies.com
Cc: "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com

Subject: Re: [ICT4D Principles] Does your project use real time data? Is
ti data driven? Tell us.

Fantastic story, Siobhan!
On May 12, 2016 2:50 PM, “Sanjay Jain” sanjay@aghstrategies.com wrote:

Open means nothing if it is not usable for good decision making.

All technology (in fact pretty much everything else as well) requires
that users understand what it is, before using it. Traffic lights are only
useful because we’ve been trained to understand them.

Having some erroneous data points should not make the data set unusable.
And it also does not mean that it should not be open.

True, we can clean up the data for those who are likely to use it without
understanding it, but I’d advocate for both the raw and cleaned up data
sets to be made available. The transition to an “open” mindset is going to
take time and no doubt some mistakes will be made along the way, but it’s a
transition well worth making imo.

~sanjay

PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green sio@sonjara.com wrote:

Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe
pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL
as well as standardized indicators can make a huge difference in
interoperability.

Also – what methodology was used to capture the data? I cannot use it
for decision making if I don’t know what the data means and how much I can
trust it.

Case in point. A friend used to live in a small village in Ireland with
her husband, who worked on a mining project in Nigeria. He travelled weekly
to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was
asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and
my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the
form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of
the village. When she asked about it, they informed her the census results
came back and it turns out according to the results, village residents
commuted an average of 50 miles a week (for context, Ireland is 174 miles
wide and 302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: Matt Berg [mailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green sio@sonjara.com
Cc: James BonTempo James.BonTempo@jhu.edu; ICT4D Principles <
ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and
variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards
are so important. Standards like Hxl show some progress and hopefully some
type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green sio@sonjara.com wrote:

Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of
“sizable” data sets, I believe, require different tools and approaches. I
believe a lot of the key in mining big data sets is the constancy of how
the data is captured and collected – it just happens to be very large and
complex.

The challenge with the DDL is that there is minimal consistency in how
data is captured and collected, or even what it is about – meaning that
creating or using software tools to automate the process is a lot harder.
There is a ton of background knowledge needed about the specific data and
project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that
read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in
text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone
has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a
small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume,
variety & velocity. Alas, the idea of gathering & opening the data for
mining & learning is a good one & progress is being made…

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Siobhan Green <
sio@sonjara.com>
*Date: *Thursday, May 12, 2016 at 3:02 PM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of
this is not really big. Sizable, yes, it can be, some of it is larger than
one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or
even terabytes if we have maps in there. It also is not high volume – the
data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in
an excel spreadsheet or even database) but not using standard formats or
taxonomies, already aggregated, and often stripped of context or
information about methodology of capture. Quality of the data collected is
really varied.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts
to create these kinds of “big data” repositories to mine for solutions were
underway :slight_smile:

*From: *Siobhan Green sio@sonjara.com
*Date: *Thursday, May 12, 2016 at 11:02 AM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most
of the data right now on the DDL is not usable in this context.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policy
https://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way
for USAID and its partners to draw from an increasingly robust,
data-rich environment to create these breakthrough insights and solutions

in support of our mission well into the future. Specifically, the policy:

? Establishes the Development Data Library (DDL) as the Agency’s
repository of USAID-funded, machine readable data created or collected by
the Agency and its implementing partners;

? Requires USAID staff and implementing partners (via associated
changes to procurement instruments) to submit datasets generated with USAID
funding to the DDL in machine-readable, non-proprietary formats;

? Implements a data tagging protocol in keeping with the
President’s Executive Order and Office of Management and Budget policy on
Open Data; and

? Defines a data clearance process to ensure that USAID makes as
much data publicly available as possible, while still affording all
protections for individual privacy, operational and national security, and
other considerations allowable by law.”

James

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <
banerji1@comcast.net>
*Date: *Wednesday, May 11, 2016 at 10:49 PM
*To: *Robert Kirkpatrick kirkpatrick@unglobalpulse.org
*Cc: *Samir Doshi sdoshi@usaid.gov, Glen Burnett <
Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <
merrickweb@gmail.com>, "ict4d-principles@googlegroups.com" <
ict4d-principles@googlegroups.com>, Michael Bamberger <
jmichaelbamberger@gmail.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Dear Robert,

Many thanks for your interest in the question I raised. First, I should
mention that I am delighted to learn of your data analytics initiative. If
I can assist in any way , kindly let me know. I look forward to reading
Michael’s draft reports.

As someone who has undertaken evaluations of development programs and
projects for over two decades at the World Bank , ADB and other agencies,
I have been troubled that evaluators rely mainly on experience and
judgments in conducting evaluations, including conducting impact
evaluations, taking into consideration experimental trials and methods.
The standard DAC criteria used in program and project evaluations
-relevance, efficiency, efficacy, outcome and impact -are usually not well
defined or quantified a priori at appraisal , so that project evaluators
assign a subjective rating during ex-post evaluation which can be
erroneous. The log frame of the project may not be logical or evidence
based. The indicators used to assess each of the evaluation criteria may
fail to reflect the achievements taking into account broader sectoral
and country experience . And since these indicators are specified by the
project formulators at appraisal , weak or faulty indicators may constrain
the ex-post evaluation exercise.

Another issue is the the Theory of Change (TOC) which supports the
logical framework and the conceptual underpinning of the project.
Recently, I have seen quite a few bird nests of TOC diagrams which contain
many assumptions about the logical process of change and transformation
which the project is trying to achieve without providing any empirical
evidence about how the change actually happens, the risks and why the
proposed intervention is the best or optimal method of achieving the
outcomes desired. Applications of Program Theory suffer from similar
deficiencies which I can elaborate on.

My interest is to explore *how one could use big data
analytics/artificial intelligence/machine learning to strengthen the
evidence base *of project formulation and evaluation in different
sectors or development issues. I would like to know how one could
strengthen the formulation of TOC for projects in different problem areas
based on actual field evidence from learning and implementation of a
wide cross section of completed projects . This would lead to a deeper
understanding of change pathways and risk variables at the
society/community/institutional levels depending on the level of project
intervention and how monitoring and mitigating actions can be built into
the project to achieve desired goals. Various development agencies could
contribute to providing data for building the data base. The data base
would provide a full picture of real life experiences on how development
problems in various areas have been defined and addressed and with what
results and reasons for the outcomes and the lessons.

I am aware that the evaluation departments some development agencies
have built data banks of projects they have supported and have undertaken
large meta studies of project interventions in specific areas to learn
some generalizable lessons. My experience looking at these meta studies is
that they are not particularly useful for designing new specific project
interventions and that the lessons of earlier projects are inadequately
reflected in new projects.

I am thinking of the value of developing a large multi country ,
multi agency data base which can be queried for evidence to help with
project design, implementation and evaluation. Can one build a data bank
which can use an IBM Watson type approach of artificial intelligence to
learn from past project interventions in different areas to design better
future interventions? The feedback loop between evaluation results and new
project designs can then be finally closed.

This is just a quick response to your question and I hope it will
stimulate some thinking and generate some more focused ideas.

Kind regards,

Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick < >>> kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick

Director
United Nations Global Pulse
Executive Office of the Secretary-General

+1 650.796.5709
kirkpatrick@un.org

@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:

http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net >>> wrote:

Dear Samir,

                 Please keep me in the information loop. I am

particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.

Best,

Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base
of real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,

Samir


Samir K. Doshi, Ph.D. | Senior Scientist

U.S. Global Development Lab | US Agency for International Development

E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < >>> Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be
great to see what you learn.

Glen Burnett

*From:*ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is
ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of projects
that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along
to others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org

http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter

Support our work today [image: Donate online]
http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google
Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.com


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax


#19

Interesting… And I can sorta see what you might be implying. But can you say a little bit more about the little bit you know about Watson (& similar systems) & how it might be applied?

··· From: "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <sanjay@aghstrategies.com> Date: Wednesday, May 25, 2016 at 11:23 AM To: "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu> wrote:
Was reminded of this thread today as I read this article in the New England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable and Useful Data Sharinghttp://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production of ‘data dumpsters’: repositories of data without the metadata, data dictionaries, or documentation needed for meaningful or correct reanalysis. Fulfilling an obligation to share data before good practices in data formatting and documentation have been established and replicated may allow researchers to check the ‘data shared’ box, but it may also result in an epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think are relevant & useful. Definitely worth the 5 minutes to read…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Rose Shuman <roseshuman@gmail.commailto:roseshuman@gmail.com>
Date: Thursday, May 12, 2016 at 5:52 PM
To: Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Cc: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Fantastic story, Siobhan!

On May 12, 2016 2:50 PM, “Sanjay Jain” <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com> wrote:

Open means nothing if it is not usable for good decision making.

All technology (in fact pretty much everything else as well) requires that users understand what it is, before using it. Traffic lights are only useful because we’ve been trained to understand them.

Having some erroneous data points should not make the data set unusable. And it also does not mean that it should not be open.

True, we can clean up the data for those who are likely to use it without understanding it, but I’d advocate for both the raw and cleaned up data sets to be made available. The transition to an “open” mindset is going to take time and no doubt some mistakes will be made along the way, but it’s a transition well worth making imo.

~sanjay

PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as well as standardized indicators can make a huge difference in interoperability.

Also – what methodology was used to capture the data? I cannot use it for decision making if I don’t know what the data means and how much I can trust it.

Case in point. A friend used to live in a small village in Ireland with her husband, who worked on a mining project in Nigeria. He travelled weekly to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the village. When she asked about it, they informed her the census results came back and it turns out according to the results, village residents commuted an average of 50 miles a week (for context, Ireland is 174 miles wide and 302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: Matt Berg [mailto:mberg@ona.iomailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Cc: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>; ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are so important. Standards like Hxl show some progress and hopefully some type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com on behalf of Siobhan Green sio@sonjara.com
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo James.BonTempo@jhu.edu, "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green sio@sonjara.com
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo James.BonTempo@jhu.edu, "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com on behalf of Shyamadas Banerji banerji1@comcast.net
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick kirkpatrick@unglobalpulse.org
Cc: Samir Doshi sdoshi@usaid.gov, Glen Burnett Glen.Burnett@practicalaction.org.uk, Merrick Schaefer merrickweb@gmail.com, "ict4d-principles@googlegroups.com" ict4d-principles@googlegroups.com, Michael Bamberger jmichaelbamberger@gmail.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick kirkpatrick@unglobalpulse.org wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709tel:%2B1%20650.796.5709
kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett Glen.Burnett@practicalaction.org.uk wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#20

I think we have to be careful about expectations around what semantic searching can do.

For example, you cannot take a pile of business receipts and invoice payments, point Watson at it and get a P&L statement for your firm.

Meaning comes from context, and if context is lost when capturing the data, it may be impossible to reconstitute.

··· ---- Siobhan Green Sonjara, Inc. Digital Solutions that Serve the Greater Good Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev 207 Park Ave, B6, Falls Church, VA, USA www.sonjara.com | www.fakoli.org | www.griot.us Email: sio@sonjara.com Skype: sewgreen O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Wednesday, May 25, 2016 12:14 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Interesting… And I can sorta see what you might be implying. But can you say a little bit more about the little bit you know about Watson (& similar systems) & how it might be applied?

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Date: Wednesday, May 25, 2016 at 11:23 AM
To: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu> wrote:
Was reminded of this thread today as I read this article in the New England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable and Useful Data Sharinghttp://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production of ‘data dumpsters’: repositories of data without the metadata, data dictionaries, or documentation needed for meaningful or correct reanalysis. Fulfilling an obligation to share data before good practices in data formatting and documentation have been established and replicated may allow researchers to check the ‘data shared’ box, but it may also result in an epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think are relevant & useful. Definitely worth the 5 minutes to read…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Rose Shuman <roseshuman@gmail.commailto:roseshuman@gmail.com>
Date: Thursday, May 12, 2016 at 5:52 PM
To: Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Cc: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Fantastic story, Siobhan!
On May 12, 2016 2:50 PM, “Sanjay Jain” <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com> wrote:

Open means nothing if it is not usable for good decision making.
All technology (in fact pretty much everything else as well) requires that users understand what it is, before using it. Traffic lights are only useful because we’ve been trained to understand them.
Having some erroneous data points should not make the data set unusable. And it also does not mean that it should not be open.
True, we can clean up the data for those who are likely to use it without understanding it, but I’d advocate for both the raw and cleaned up data sets to be made available. The transition to an “open” mindset is going to take time and no doubt some mistakes will be made along the way, but it’s a transition well worth making imo.

~sanjay
PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as well as standardized indicators can make a huge difference in interoperability.

Also – what methodology was used to capture the data? I cannot use it for decision making if I don’t know what the data means and how much I can trust it.

Case in point. A friend used to live in a small village in Ireland with her husband, who worked on a mining project in Nigeria. He travelled weekly to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the village. When she asked about it, they informed her the census results came back and it turns out according to the results, village residents commuted an average of 50 miles a week (for context, Ireland is 174 miles wide and 302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: Matt Berg [mailto:mberg@ona.iomailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Cc: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>; ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are so important. Standards like Hxl show some progress and hopefully some type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709tel:%2B1%20650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.