[ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us


#21

Just as a comment.

Accounting systems are probably the BEST model for good data management, globally.

And just think about how much money and effort goes into good accounting.

That is where business put so much of their effort into organizing their data for usage.

Followed by inventory management and then maybe sales/business development. In fact capacity assessments of businesses link these processes to the maturity and sustainability of an organization – without good data management processes for these areas, the firm is considered to be higher risk/lower capacity.

And none of these use AI to sort out their structure, and I am not sure how they could use AI effectively.

These are great examples in our daily lives of how we use real time data for decision making and performance management – in one corner of our current organizations.

··· ---- Siobhan Green Sonjara, Inc. Digital Solutions that Serve the Greater Good Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev 207 Park Ave, B6, Falls Church, VA, USA www.sonjara.com | www.fakoli.org | www.griot.us Email: sio@sonjara.com Skype: sewgreen O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Wednesday, May 25, 2016 12:14 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Interesting… And I can sorta see what you might be implying. But can you say a little bit more about the little bit you know about Watson (& similar systems) & how it might be applied?

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Date: Wednesday, May 25, 2016 at 11:23 AM
To: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu> wrote:
Was reminded of this thread today as I read this article in the New England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable and Useful Data Sharinghttp://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production of ‘data dumpsters’: repositories of data without the metadata, data dictionaries, or documentation needed for meaningful or correct reanalysis. Fulfilling an obligation to share data before good practices in data formatting and documentation have been established and replicated may allow researchers to check the ‘data shared’ box, but it may also result in an epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think are relevant & useful. Definitely worth the 5 minutes to read…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Rose Shuman <roseshuman@gmail.commailto:roseshuman@gmail.com>
Date: Thursday, May 12, 2016 at 5:52 PM
To: Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Cc: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Fantastic story, Siobhan!
On May 12, 2016 2:50 PM, “Sanjay Jain” <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com> wrote:

Open means nothing if it is not usable for good decision making.
All technology (in fact pretty much everything else as well) requires that users understand what it is, before using it. Traffic lights are only useful because we’ve been trained to understand them.
Having some erroneous data points should not make the data set unusable. And it also does not mean that it should not be open.
True, we can clean up the data for those who are likely to use it without understanding it, but I’d advocate for both the raw and cleaned up data sets to be made available. The transition to an “open” mindset is going to take time and no doubt some mistakes will be made along the way, but it’s a transition well worth making imo.

~sanjay
PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as well as standardized indicators can make a huge difference in interoperability.

Also – what methodology was used to capture the data? I cannot use it for decision making if I don’t know what the data means and how much I can trust it.

Case in point. A friend used to live in a small village in Ireland with her husband, who worked on a mining project in Nigeria. He travelled weekly to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the village. When she asked about it, they informed her the census results came back and it turns out according to the results, village residents commuted an average of 50 miles a week (for context, Ireland is 174 miles wide and 302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: Matt Berg [mailto:mberg@ona.iomailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Cc: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>; ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are so important. Standards like Hxl show some progress and hopefully some type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709tel:%2B1%20650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#22

Like how you pulled in an example from a different “corner." Of course, $$ is key to a successful organization, so systems to manage it have been prioritized & are well developed :wink:

··· From: "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.com> Date: Wednesday, May 25, 2016 at 12:32 PM To: James BonTempo <James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.com> Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Just as a comment.

Accounting systems are probably the BEST model for good data management, globally.

And just think about how much money and effort goes into good accounting.

That is where business put so much of their effort into organizing their data for usage.

Followed by inventory management and then maybe sales/business development. In fact capacity assessments of businesses link these processes to the maturity and sustainability of an organization – without good data management processes for these areas, the firm is considered to be higher risk/lower capacity.

And none of these use AI to sort out their structure, and I am not sure how they could use AI effectively.

These are great examples in our daily lives of how we use real time data for decision making and performance management – in one corner of our current organizations.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Wednesday, May 25, 2016 12:14 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Interesting… And I can sorta see what you might be implying. But can you say a little bit more about the little bit you know about Watson (& similar systems) & how it might be applied?

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Date: Wednesday, May 25, 2016 at 11:23 AM
To: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu> wrote:
Was reminded of this thread today as I read this article in the New England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable and Useful Data Sharinghttp://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production of ‘data dumpsters’: repositories of data without the metadata, data dictionaries, or documentation needed for meaningful or correct reanalysis. Fulfilling an obligation to share data before good practices in data formatting and documentation have been established and replicated may allow researchers to check the ‘data shared’ box, but it may also result in an epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think are relevant & useful. Definitely worth the 5 minutes to read…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Rose Shuman <roseshuman@gmail.commailto:roseshuman@gmail.com>
Date: Thursday, May 12, 2016 at 5:52 PM
To: Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Cc: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Fantastic story, Siobhan!
On May 12, 2016 2:50 PM, “Sanjay Jain” <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com> wrote:

Open means nothing if it is not usable for good decision making.
All technology (in fact pretty much everything else as well) requires that users understand what it is, before using it. Traffic lights are only useful because we’ve been trained to understand them.
Having some erroneous data points should not make the data set unusable. And it also does not mean that it should not be open.
True, we can clean up the data for those who are likely to use it without understanding it, but I’d advocate for both the raw and cleaned up data sets to be made available. The transition to an “open” mindset is going to take time and no doubt some mistakes will be made along the way, but it’s a transition well worth making imo.

~sanjay
PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as well as standardized indicators can make a huge difference in interoperability.

Also – what methodology was used to capture the data? I cannot use it for decision making if I don’t know what the data means and how much I can trust it.

Case in point. A friend used to live in a small village in Ireland with her husband, who worked on a mining project in Nigeria. He travelled weekly to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the village. When she asked about it, they informed her the census results came back and it turns out according to the results, village residents commuted an average of 50 miles a week (for context, Ireland is 174 miles wide and 302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: Matt Berg [mailto:mberg@ona.iomailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Cc: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>; ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are so important. Standards like Hxl show some progress and hopefully some type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709tel:%2B1%20650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#23

Hello Siobhan and all,

Expert systems are part of AI, and they enable people to take one mastered
and documented set of categorical relationships and apply it to others. A
global knowledgebase, loaded with expert systems and many other structured
collections of data and applications to manage them, with AI supporting the
way everything works, is integrated, and is retrievable in ways that meet
user needs, whoever the users are, would also be a major, and meta-,
example of AI utility. The whole thing would be organized around earth’s
867 terrestrial eco-regions (shape-files at WWF website), each of which is
a consistent pattern of ecosystems, with further subdivision for
ecosystems, and in parallel, cultures and all their information management
needs.

I’ve been thinking of this for about 35 years and counting.

Regards,

Mark Roest

··· On Wed, May 25, 2016 at 9:32 AM, Siobhan Green wrote:

Just as a comment.

Accounting systems are probably the BEST model for good data management,
globally.

And just think about how much money and effort goes into good accounting.

That is where business put so much of their effort into organizing their
data for usage.

Followed by inventory management and then maybe sales/business
development. In fact capacity assessments of businesses link these
processes to the maturity and sustainability of an organization – without
good data management processes for these areas, the firm is considered to
be higher risk/lower capacity.

And none of these use AI to sort out their structure, and I am not sure
how they could use AI effectively.

These are great examples in our daily lives of how we use real time data
for decision making and performance management – in one corner of our
current organizations.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Wednesday, May 25, 2016 12:14 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Interesting… And I can sorta see what you might be implying. But can you
say a little bit more about the little bit you know about Watson (& similar
systems) & how it might be applied?

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <
sanjay@aghstrategies.com>
*Date: *Wednesday, May 25, 2016 at 11:23 AM
*To: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I
wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it
could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo James.BonTempo@jhu.edu > wrote:

Was reminded of this thread today as I read this article in the New
England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable
and Useful Data Sharing
http://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production
of ‘data dumpsters’: repositories of data without the metadata, data
dictionaries, or documentation needed for meaningful or correct reanalysis.
Fulfilling an obligation to share data before good practices in data
formatting and documentation have been established and replicated may allow
researchers to check the ‘data shared’ box, but it may also result in an
epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think
are relevant & useful. Definitely worth the 5 minutes to read…

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Rose Shuman <
roseshuman@gmail.com>
*Date: *Thursday, May 12, 2016 at 5:52 PM
*To: *Sanjay Jain sanjay@aghstrategies.com
*Cc: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com>

*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Fantastic story, Siobhan!

On May 12, 2016 2:50 PM, “Sanjay Jain” sanjay@aghstrategies.com wrote:

Open means nothing if it is not usable for good decision making.

All technology (in fact pretty much everything else as well) requires that
users understand what it is, before using it. Traffic lights are only
useful because we’ve been trained to understand them.

Having some erroneous data points should not make the data set unusable.
And it also does not mean that it should not be open.

True, we can clean up the data for those who are likely to use it without
understanding it, but I’d advocate for both the raw and cleaned up data
sets to be made available. The transition to an “open” mindset is going to
take time and no doubt some mistakes will be made along the way, but it’s a
transition well worth making imo.

~sanjay

PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green sio@sonjara.com wrote:

Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe
pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as
well as standardized indicators can make a huge difference in
interoperability.

Also – what methodology was used to capture the data? I cannot use it for
decision making if I don’t know what the data means and how much I can
trust it.

Case in point. A friend used to live in a small village in Ireland with
her husband, who worked on a mining project in Nigeria. He travelled weekly
to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked
the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my
husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the
form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the
village. When she asked about it, they informed her the census results came
back and it turns out according to the results, village residents commuted
an average of 50 miles a week (for context, Ireland is 174 miles wide and
302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: Matt Berg [mailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green sio@sonjara.com
Cc: James BonTempo James.BonTempo@jhu.edu; ICT4D Principles <
ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and
variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are
so important. Standards like Hxl show some progress and hopefully some
type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green sio@sonjara.com wrote:

Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of
“sizable” data sets, I believe, require different tools and approaches. I
believe a lot of the key in mining big data sets is the constancy of how
the data is captured and collected – it just happens to be very large and
complex.

The challenge with the DDL is that there is minimal consistency in how
data is captured and collected, or even what it is about – meaning that
creating or using software tools to automate the process is a lot harder.
There is a ton of background knowledge needed about the specific data and
project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that
read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text
explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has
to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a
small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety
& velocity. Alas, the idea of gathering & opening the data for mining &
learning is a good one & progress is being made…

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Siobhan Green <
sio@sonjara.com>
*Date: *Thursday, May 12, 2016 at 3:02 PM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of
this is not really big. Sizable, yes, it can be, some of it is larger than
one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or
even terabytes if we have maps in there. It also is not high volume – the
data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an
excel spreadsheet or even database) but not using standard formats or
taxonomies, already aggregated, and often stripped of context or
information about methodology of capture. Quality of the data collected is
really varied.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to
create these kinds of “big data” repositories to mine for solutions were
underway :slight_smile:

*From: *Siobhan Green sio@sonjara.com
*Date: *Thursday, May 12, 2016 at 11:02 AM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of
the data right now on the DDL is not usable in this context.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policy
https://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way
for USAID and its partners to draw from an increasingly robust,
data-rich environment to create these breakthrough insights and solutions

in support of our mission well into the future. Specifically, the policy:

? Establishes the Development Data Library (DDL) as the Agency’s
repository of USAID-funded, machine readable data created or collected by
the Agency and its implementing partners;

? Requires USAID staff and implementing partners (via associated
changes to procurement instruments) to submit datasets generated with USAID
funding to the DDL in machine-readable, non-proprietary formats;

? Implements a data tagging protocol in keeping with the
President’s Executive Order and Office of Management and Budget policy on
Open Data; and

? Defines a data clearance process to ensure that USAID makes as
much data publicly available as possible, while still affording all
protections for individual privacy, operational and national security, and
other considerations allowable by law.”

James

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <
banerji1@comcast.net>
*Date: *Wednesday, May 11, 2016 at 10:49 PM
*To: *Robert Kirkpatrick kirkpatrick@unglobalpulse.org
*Cc: *Samir Doshi sdoshi@usaid.gov, Glen Burnett <
Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <
merrickweb@gmail.com>, "ict4d-principles@googlegroups.com" <
ict4d-principles@googlegroups.com>, Michael Bamberger <
jmichaelbamberger@gmail.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Dear Robert,

Many thanks for your interest in the question I raised. First, I should
mention that I am delighted to learn of your data analytics initiative. If
I can assist in any way , kindly let me know. I look forward to reading
Michael’s draft reports.

As someone who has undertaken evaluations of development programs and
projects for over two decades at the World Bank , ADB and other agencies,
I have been troubled that evaluators rely mainly on experience and
judgments in conducting evaluations, including conducting impact
evaluations, taking into consideration experimental trials and methods.
The standard DAC criteria used in program and project evaluations
-relevance, efficiency, efficacy, outcome and impact -are usually not well
defined or quantified a priori at appraisal , so that project evaluators
assign a subjective rating during ex-post evaluation which can be
erroneous. The log frame of the project may not be logical or evidence
based. The indicators used to assess each of the evaluation criteria may
fail to reflect the achievements taking into account broader sectoral
and country experience . And since these indicators are specified by the
project formulators at appraisal , weak or faulty indicators may constrain
the ex-post evaluation exercise.

Another issue is the the Theory of Change (TOC) which supports the
logical framework and the conceptual underpinning of the project.
Recently, I have seen quite a few bird nests of TOC diagrams which contain
many assumptions about the logical process of change and transformation
which the project is trying to achieve without providing any empirical
evidence about how the change actually happens, the risks and why the
proposed intervention is the best or optimal method of achieving the
outcomes desired. Applications of Program Theory suffer from similar
deficiencies which I can elaborate on.

My interest is to explore *how one could use big data
analytics/artificial intelligence/machine learning to strengthen the
evidence base *of project formulation and evaluation in different sectors
or development issues. I would like to know how one could strengthen the
formulation of TOC for projects in different problem areas based on
actual field evidence from learning and implementation of a wide cross
section of completed projects . This would lead to a deeper understanding
of change pathways and risk variables at the
society/community/institutional levels depending on the level of project
intervention and how monitoring and mitigating actions can be built into
the project to achieve desired goals. Various development agencies could
contribute to providing data for building the data base. The data base
would provide a full picture of real life experiences on how development
problems in various areas have been defined and addressed and with what
results and reasons for the outcomes and the lessons.

I am aware that the evaluation departments some development agencies
have built data banks of projects they have supported and have undertaken
large meta studies of project interventions in specific areas to learn
some generalizable lessons. My experience looking at these meta studies is
that they are not particularly useful for designing new specific project
interventions and that the lessons of earlier projects are inadequately
reflected in new projects.

I am thinking of the value of developing a large multi country , multi
agency data base which can be queried for evidence to help with project
design, implementation and evaluation. Can one build a data bank which can
use an IBM Watson type approach of artificial intelligence to learn from
past project interventions in different areas to design better future
interventions? The feedback loop between evaluation results and new
project designs can then be finally closed.

This is just a quick response to your question and I hope it will
stimulate some thinking and generate some more focused ideas.

Kind regards,

Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick < > kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick

Director
United Nations Global Pulse
Executive Office of the Secretary-General

+1 650.796.5709
kirkpatrick@un.org

@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:

http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net > wrote:

Dear Samir,

                 Please keep me in the information loop. I am

particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.

Best,

Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base of
real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,

Samir


Samir K. Doshi, Ph.D. | Senior Scientist

U.S. Global Development Lab | US Agency for International Development

E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < > Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be great
to see what you learn.

Glen Burnett

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti
data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of projects
that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to
others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org

http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter

Support our work today [image: Donate online]
http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Sanjay Jain

Nonprofit Database Specialist

AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax

aghstrategies.com


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Sanjay Jain

Nonprofit Database Specialist

AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax

aghstrategies.com


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#24

Exactly! There are also legal compliance requirements that are checked (audits) and tangible consequences for poor performance and dedicated line items for accounting software and staff.

Now, we may never go there (nor need to) for the data we are talking about, but it does make you realize how much prioritization is worth…

··· ---- Siobhan Green Sonjara, Inc. Digital Solutions that Serve the Greater Good Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev 207 Park Ave, B6, Falls Church, VA, USA www.sonjara.com | www.fakoli.org | www.griot.us Email: sio@sonjara.com Skype: sewgreen O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Wednesday, May 25, 2016 12:43 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Like how you pulled in an example from a different “corner." Of course, $$ is key to a successful organization, so systems to manage it have been prioritized & are well developed :wink:

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Wednesday, May 25, 2016 at 12:32 PM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Just as a comment.

Accounting systems are probably the BEST model for good data management, globally.

And just think about how much money and effort goes into good accounting.

That is where business put so much of their effort into organizing their data for usage.

Followed by inventory management and then maybe sales/business development. In fact capacity assessments of businesses link these processes to the maturity and sustainability of an organization – without good data management processes for these areas, the firm is considered to be higher risk/lower capacity.

And none of these use AI to sort out their structure, and I am not sure how they could use AI effectively.

These are great examples in our daily lives of how we use real time data for decision making and performance management – in one corner of our current organizations.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703 981-9982

From: ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Wednesday, May 25, 2016 12:14 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Interesting… And I can sorta see what you might be implying. But can you say a little bit more about the little bit you know about Watson (& similar systems) & how it might be applied?

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Date: Wednesday, May 25, 2016 at 11:23 AM
To: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu> wrote:
Was reminded of this thread today as I read this article in the New England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable and Useful Data Sharinghttp://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production of ‘data dumpsters’: repositories of data without the metadata, data dictionaries, or documentation needed for meaningful or correct reanalysis. Fulfilling an obligation to share data before good practices in data formatting and documentation have been established and replicated may allow researchers to check the ‘data shared’ box, but it may also result in an epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think are relevant & useful. Definitely worth the 5 minutes to read…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Rose Shuman <roseshuman@gmail.commailto:roseshuman@gmail.com>
Date: Thursday, May 12, 2016 at 5:52 PM
To: Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Cc: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Fantastic story, Siobhan!
On May 12, 2016 2:50 PM, “Sanjay Jain” <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com> wrote:

Open means nothing if it is not usable for good decision making.
All technology (in fact pretty much everything else as well) requires that users understand what it is, before using it. Traffic lights are only useful because we’ve been trained to understand them.
Having some erroneous data points should not make the data set unusable. And it also does not mean that it should not be open.
True, we can clean up the data for those who are likely to use it without understanding it, but I’d advocate for both the raw and cleaned up data sets to be made available. The transition to an “open” mindset is going to take time and no doubt some mistakes will be made along the way, but it’s a transition well worth making imo.

~sanjay
PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as well as standardized indicators can make a huge difference in interoperability.

Also – what methodology was used to capture the data? I cannot use it for decision making if I don’t know what the data means and how much I can trust it.

Case in point. A friend used to live in a small village in Ireland with her husband, who worked on a mining project in Nigeria. He travelled weekly to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the village. When she asked about it, they informed her the census results came back and it turns out according to the results, village residents commuted an average of 50 miles a week (for context, Ireland is 174 miles wide and 302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: Matt Berg [mailto:mberg@ona.iomailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Cc: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>; ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are so important. Standards like Hxl show some progress and hopefully some type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709tel:%2B1%20650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#25

How are you defining adaptive management in the comments below? I see that term used a lot, but used by different sectors in development differently. Based on this conversation I would think it would be linked to things like satisfaction scores and promoter scores, but I don’t think there has been a large enough collection of data for that to have predictive power in development yet. I know when the private sector talks about promoter scores, they are dealing with simple promoter questions like “do I like my iphone enough that I would tell others to buy that iphone?”

One of the biggest challenges that people find who are analyzing this kind of user data for adaptive management is that it has been very difficult to come up with those predictive metrics that can determine when those shifts in management need to be done—it can tell you you aren’t delivering, but is anyone working on a project that gives enough unstructured data to know what shift needs to be made? You can look at organizations like Clarabridge, who will do evaluations of unstructured data from things like facebook for real time adaptive management, but when I have talked to them, we agreed between accessibility of data sets and nuance in language, the predictive power isn’t big enough to do adaptive management until more of the base of the pyramid gets reliably online.

The value for online classes is absolutely present, and there is a lot of data there that is coming in that allows us to use it on an adaptive level. Heck look at Tech Change’s success! That becomes more difficult if you aren’t engaging with users online, or able to record everything online. It’s almost like “and then the FIELD happens”. In those cases, you are dealing with an even more Complex environment, and adaptive management becomes even more important. How are people using data to manage that? And then where does unstructured qualitative data come in?

By the way, collecting data to prove the right algorithm for a functioning net promoter score inside development could be something that many organizations could relatively easily get behind. There are many in the private sector who argue about the true value of NPS, but it would be a big step for development to be able to have that argument. Perhaps a way that the ICT4D principles could promote as a group?

Glen

··· From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Christopher Neu Sent: Wednesday, May 25, 2016 1:27 PM To: Siobhan Green Cc: James BonTempo; ICT4D Principles Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Great conversation – really enjoyed Siobhan on context (and personally, I’d love a Watson for P&L) and James on data repositories.

I’m very curious about how real-time data will be treated as more and more of international development activities take place online, specifically around capacity building.

One of the driving forces behind TechChange providing a shared online learning platform for international developmenthttps://www.techchange.org/enterprise/ is to provide real-time data for improving online trainings and workshops as you go.

That said, a reliable platform won’t solve everything, but if you’re looking to evaluate adaptive management practices, then there’s nothing quite like hard data on user engagement and progress to keep improving as you go.

Also appreciated the side conversation on good decision making through data, and remembered an old Wired article on A/B testinghttp://www.wired.com/2012/04/ff_abtesting/:

“Google insiders, and A/B enthusiasts more generally, have a derisive term to describe a decisionmaking system that fails to put data at its heart: HiPPO—”highest-paid person’s opinion.” As Google analytics expert Avinash Kaushik declares, “Most websites suck because HiPPOs create them.””

Even with appropriate real-time data, if decision making is still just an intuitive judgement call then it’s not necessarily going to be a major improvement on where we are now.

On the other hand, in the digital realm you could have multiple courses, trainings, or projects exist in parallel, and then constantly test your assumptions in order to quickly make adjustments as helpful.

It won’t work for every development need, but capacity building could be a good place to start.

Just a thought,

  • C

On Wed, May 25, 2016 at 12:46 PM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Exactly! There are also legal compliance requirements that are checked (audits) and tangible consequences for poor performance and dedicated line items for accounting software and staff.

Now, we may never go there (nor need to) for the data we are talking about, but it does make you realize how much prioritization is worth…


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Wednesday, May 25, 2016 12:43 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Like how you pulled in an example from a different “corner." Of course, $$ is key to a successful organization, so systems to manage it have been prioritized & are well developed :wink:

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Wednesday, May 25, 2016 at 12:32 PM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Just as a comment.

Accounting systems are probably the BEST model for good data management, globally.

And just think about how much money and effort goes into good accounting.

That is where business put so much of their effort into organizing their data for usage.

Followed by inventory management and then maybe sales/business development. In fact capacity assessments of businesses link these processes to the maturity and sustainability of an organization – without good data management processes for these areas, the firm is considered to be higher risk/lower capacity.

And none of these use AI to sort out their structure, and I am not sure how they could use AI effectively.

These are great examples in our daily lives of how we use real time data for decision making and performance management – in one corner of our current organizations.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Wednesday, May 25, 2016 12:14 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Interesting… And I can sorta see what you might be implying. But can you say a little bit more about the little bit you know about Watson (& similar systems) & how it might be applied?

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Date: Wednesday, May 25, 2016 at 11:23 AM
To: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu> wrote:
Was reminded of this thread today as I read this article in the New England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable and Useful Data Sharinghttp://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production of ‘data dumpsters’: repositories of data without the metadata, data dictionaries, or documentation needed for meaningful or correct reanalysis. Fulfilling an obligation to share data before good practices in data formatting and documentation have been established and replicated may allow researchers to check the ‘data shared’ box, but it may also result in an epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think are relevant & useful. Definitely worth the 5 minutes to read…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Rose Shuman <roseshuman@gmail.commailto:roseshuman@gmail.com>
Date: Thursday, May 12, 2016 at 5:52 PM
To: Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Cc: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Fantastic story, Siobhan!
On May 12, 2016 2:50 PM, “Sanjay Jain” <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com> wrote:

Open means nothing if it is not usable for good decision making.
All technology (in fact pretty much everything else as well) requires that users understand what it is, before using it. Traffic lights are only useful because we’ve been trained to understand them.
Having some erroneous data points should not make the data set unusable. And it also does not mean that it should not be open.
True, we can clean up the data for those who are likely to use it without understanding it, but I’d advocate for both the raw and cleaned up data sets to be made available. The transition to an “open” mindset is going to take time and no doubt some mistakes will be made along the way, but it’s a transition well worth making imo.

~sanjay
PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as well as standardized indicators can make a huge difference in interoperability.

Also – what methodology was used to capture the data? I cannot use it for decision making if I don’t know what the data means and how much I can trust it.

Case in point. A friend used to live in a small village in Ireland with her husband, who worked on a mining project in Nigeria. He travelled weekly to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the village. When she asked about it, they informed her the census results came back and it turns out according to the results, village residents commuted an average of 50 miles a week (for context, Ireland is 174 miles wide and 302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: Matt Berg [mailto:mberg@ona.iomailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Cc: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>; ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are so important. Standards like Hxl show some progress and hopefully some type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709tel:%2B1%20650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400tel:(202)%20248-6400 phone
(202) 521-1363tel:(202)%20521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400tel:(202)%20248-6400 phone
(202) 521-1363tel:(202)%20521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Inline image 1]

Christopher Neu

Chief Operating Officer, TechChange

[https://docs.google.com/uc?export=download&id=0BzR8xWFGHwmHZmNNTkxpZWVOc1U&revid=0BzR8xWFGHwmHOUMvV1lSZGpmMFByM215eEtZNEhDYm0wNHpJPQ]http://www.facebook.com/techchange [https://docs.google.com/uc?export=download&id=0BzR8xWFGHwmHZlVsck9XLVdjNUU&revid=0BzR8xWFGHwmHYlJ4c0tkWG1ZZ1NFdTIxUlFoL2xUUVRhY3NrPQ] http://www.twitter.com/techchange [https://docs.google.com/uc?export=download&id=0BzR8xWFGHwmHZkVwbmNKbF84c1U&revid=0BzR8xWFGHwmHbnYxbWVrZCtvb3p6RDYwNXlQU0RKd0orRVhZPQ] https://www.linkedin.com/company/techchange-the-institute-for-technology-&-social-change

Check out our recent instructional designhttps://youtu.be/DDkL9OYv4RA and animation workhttps://www.youtube.com/watch?v=nlG0rOFjVEs

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#26

I want to come in late (argh! Computers!) and just second Siobhan’s point about accounting systems …

Ignoring the very interesting points about AI and semantics, there is really very few barriers today that we could not overcome with sufficient funding to get real time data out of projects and train/hire staff to use it. Technology is not the problem.

Accounting systems are usually owned by the CFO, who sits on the executive team, no-one blinks at a multi-million (scale to fit your organization) price tag, the systems function according to standards that have been worked on for over 700 years, and for which you can certified accountants in almost every country on earth who know GAAP.

Compare that to systems in ICT4D and all of those factors change.

Ernest

Ernest Ostro | Director, Software Systems
International Rescue Committee
122 East 42nd Street, NY, NY 10168 | Rescue.org
M. +1 347 688 2225| skype. ostro.ernest

[IRC%20eSignature%20Graphic]
In 2015, 23 million people in more than 40 countries and 26 U.S. cities benefited from IRC programs. Read more in our annual reporthttp://s.bl-1.com/h/zkw1VfK?url=http://feature.rescue.org/annual-report-2015/.

··· From: ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Mark Roest Sent: Wednesday, May 25, 2016 9:24 PM To: Siobhan Green Cc: James BonTempo ; ICT4D Principles Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hello Siobhan and all,
Expert systems are part of AI, and they enable people to take one mastered and documented set of categorical relationships and apply it to others. A global knowledgebase, loaded with expert systems and many other structured collections of data and applications to manage them, with AI supporting the way everything works, is integrated, and is retrievable in ways that meet user needs, whoever the users are, would also be a major, and meta-, example of AI utility. The whole thing would be organized around earth’s 867 terrestrial eco-regions (shape-files at WWF website), each of which is a consistent pattern of ecosystems, with further subdivision for ecosystems, and in parallel, cultures and all their information management needs.
I’ve been thinking of this for about 35 years and counting.
Regards,
Mark Roest

On Wed, May 25, 2016 at 9:32 AM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Just as a comment.

Accounting systems are probably the BEST model for good data management, globally.

And just think about how much money and effort goes into good accounting.

That is where business put so much of their effort into organizing their data for usage.

Followed by inventory management and then maybe sales/business development. In fact capacity assessments of businesses link these processes to the maturity and sustainability of an organization – without good data management processes for these areas, the firm is considered to be higher risk/lower capacity.

And none of these use AI to sort out their structure, and I am not sure how they could use AI effectively.

These are great examples in our daily lives of how we use real time data for decision making and performance management – in one corner of our current organizations.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Wednesday, May 25, 2016 12:14 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Interesting… And I can sorta see what you might be implying. But can you say a little bit more about the little bit you know about Watson (& similar systems) & how it might be applied?

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Date: Wednesday, May 25, 2016 at 11:23 AM
To: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu> wrote:
Was reminded of this thread today as I read this article in the New England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable and Useful Data Sharinghttp://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production of ‘data dumpsters’: repositories of data without the metadata, data dictionaries, or documentation needed for meaningful or correct reanalysis. Fulfilling an obligation to share data before good practices in data formatting and documentation have been established and replicated may allow researchers to check the ‘data shared’ box, but it may also result in an epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think are relevant & useful. Definitely worth the 5 minutes to read…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Rose Shuman <roseshuman@gmail.commailto:roseshuman@gmail.com>
Date: Thursday, May 12, 2016 at 5:52 PM
To: Sanjay Jain <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com>
Cc: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Fantastic story, Siobhan!
On May 12, 2016 2:50 PM, “Sanjay Jain” <sanjay@aghstrategies.commailto:sanjay@aghstrategies.com> wrote:

Open means nothing if it is not usable for good decision making.
All technology (in fact pretty much everything else as well) requires that users understand what it is, before using it. Traffic lights are only useful because we’ve been trained to understand them.
Having some erroneous data points should not make the data set unusable. And it also does not mean that it should not be open.
True, we can clean up the data for those who are likely to use it without understanding it, but I’d advocate for both the raw and cleaned up data sets to be made available. The transition to an “open” mindset is going to take time and no doubt some mistakes will be made along the way, but it’s a transition well worth making imo.

~sanjay
PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as well as standardized indicators can make a huge difference in interoperability.

Also – what methodology was used to capture the data? I cannot use it for decision making if I don’t know what the data means and how much I can trust it.

Case in point. A friend used to live in a small village in Ireland with her husband, who worked on a mining project in Nigeria. He travelled weekly to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the village. When she asked about it, they informed her the census results came back and it turns out according to the results, village residents commuted an average of 50 miles a week (for context, Ireland is 174 miles wide and 302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383 ext 101tel:%2B1%20571-297-6383 %20ext%20101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From: Matt Berg [mailto:mberg@ona.iomailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Cc: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>; ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are so important. Standards like Hxl show some progress and hopefully some type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green <sio@sonjara.commailto:sio@sonjara.com> wrote:
Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of “sizable” data sets, I believe, require different tools and approaches. I believe a lot of the key in mining big data sets is the constancy of how the data is captured and collected – it just happens to be very large and complex.

The challenge with the DDL is that there is minimal consistency in how data is captured and collected, or even what it is about – meaning that creating or using software tools to automate the process is a lot harder. There is a ton of background knowledge needed about the specific data and project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety & velocity. Alas, the idea of gathering & opening the data for mining & learning is a good one & progress is being made…

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 3:02 PM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of this is not really big. Sizable, yes, it can be, some of it is larger than one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or even terabytes if we have maps in there. It also is not high volume – the data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an excel spreadsheet or even database) but not using standard formats or taxonomies, already aggregated, and often stripped of context or information about methodology of capture. Quality of the data collected is really varied.

Siobhan


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to create these kinds of “big data” repositories to mine for solutions were underway :slight_smile:

From: Siobhan Green <sio@sonjara.commailto:sio@sonjara.com>
Date: Thursday, May 12, 2016 at 11:02 AM
To: James BonTempo <James.BonTempo@jhu.edumailto:James.BonTempo@jhu.edu>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: RE: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of the data right now on the DDL is not usable in this context.


Siobhan Green
Sonjara, Inc.
Digital Solutions that Serve the Greater Good
Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev
207 Park Ave, B6, Falls Church, VA, USA
www.sonjara.comhttp://www.sonjara.com/ | www.fakoli.orghttp://www.fakoli.org/ | www.griot.ushttp://www.griot.us/
Email: sio@sonjara.commailto:sio@sonjara.com Skype: sewgreen
O: +1 571-297-6383tel:%2B1%20571-297-6383 ext 101 or D: +1 (571) 421-1069tel:%2B1%20(571)%20421-1069 M: +1 703 981-9982tel:%2B1%20703%20981-9982

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policyhttps://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way for USAID and its partners to draw from an increasingly robust, data-rich environment to create these breakthrough insights and solutions in support of our mission well into the future. Specifically, the policy:
? Establishes the Development Data Library (DDL) as the Agency’s repository of USAID-funded, machine readable data created or collected by the Agency and its implementing partners;
? Requires USAID staff and implementing partners (via associated changes to procurement instruments) to submit datasets generated with USAID funding to the DDL in machine-readable, non-proprietary formats;
? Implements a data tagging protocol in keeping with the President’s Executive Order and Office of Management and Budget policy on Open Data; and
? Defines a data clearance process to ensure that USAID makes as much data publicly available as possible, while still affording all protections for individual privacy, operational and national security, and other considerations allowable by law.”

James

From: "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net>
Date: Wednesday, May 11, 2016 at 10:49 PM
To: Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org>
Cc: Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov>, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <merrickweb@gmail.commailto:merrickweb@gmail.com>, "ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com" <ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com>, Michael Bamberger <jmichaelbamberger@gmail.commailto:jmichaelbamberger@gmail.com>
Subject: Re: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Dear Robert,
Many thanks for your interest in the question I raised. First, I should mention that I am delighted to learn of your data analytics initiative. If I can assist in any way , kindly let me know. I look forward to reading Michael’s draft reports.
As someone who has undertaken evaluations of development programs and projects for over two decades at the World Bank , ADB and other agencies, I have been troubled that evaluators rely mainly on experience and judgments in conducting evaluations, including conducting impact evaluations, taking into consideration experimental trials and methods. The standard DAC criteria used in program and project evaluations -relevance, efficiency, efficacy, outcome and impact -are usually not well defined or quantified a priori at appraisal , so that project evaluators assign a subjective rating during ex-post evaluation which can be erroneous. The log frame of the project may not be logical or evidence based. The indicators used to assess each of the evaluation criteria may fail to reflect the achievements taking into account broader sectoral and country experience . And since these indicators are specified by the project formulators at appraisal , weak or faulty indicators may constrain the ex-post evaluation exercise.
Another issue is the the Theory of Change (TOC) which supports the logical framework and the conceptual underpinning of the project. Recently, I have seen quite a few bird nests of TOC diagrams which contain many assumptions about the logical process of change and transformation which the project is trying to achieve without providing any empirical evidence about how the change actually happens, the risks and why the proposed intervention is the best or optimal method of achieving the outcomes desired. Applications of Program Theory suffer from similar deficiencies which I can elaborate on.
My interest is to explore how one could use big data analytics/artificial intelligence/machine learning to strengthen the evidence base of project formulation and evaluation in different sectors or development issues. I would like to know how one could strengthen the formulation of TOC for projects in different problem areas based on actual field evidence from learning and implementation of a wide cross section of completed projects . This would lead to a deeper understanding of change pathways and risk variables at the society/community/institutional levels depending on the level of project intervention and how monitoring and mitigating actions can be built into the project to achieve desired goals. Various development agencies could contribute to providing data for building the data base. The data base would provide a full picture of real life experiences on how development problems in various areas have been defined and addressed and with what results and reasons for the outcomes and the lessons.
I am aware that the evaluation departments some development agencies have built data banks of projects they have supported and have undertaken large meta studies of project interventions in specific areas to learn some generalizable lessons. My experience looking at these meta studies is that they are not particularly useful for designing new specific project interventions and that the lessons of earlier projects are inadequately reflected in new projects.
I am thinking of the value of developing a large multi country , multi agency data base which can be queried for evidence to help with project design, implementation and evaluation. Can one build a data bank which can use an IBM Watson type approach of artificial intelligence to learn from past project interventions in different areas to design better future interventions? The feedback loop between evaluation results and new project designs can then be finally closed.
This is just a quick response to your question and I hope it will stimulate some thinking and generate some more focused ideas.
Kind regards,
Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick <kirkpatrick@unglobalpulse.orgmailto:kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,
We are working with Michael Bamberger (copied) on finalizing what we believe will be the seminal report (actually a pair of reports) on applications of analytics to development project evaluation. These reports will be available this summer. Happy to chat further on this topic. Would love to know more about your interests here!
Warm regards,
Robert

Robert Kirkpatrick
Director
United Nations Global Pulse
Executive Office of the Secretary-General
+1 650.796.5709tel:%2B1%20650.796.5709
kirkpatrick@un.orgmailto:kirkpatrick@un.org
@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:
http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji <banerji1@comcast.netmailto:banerji1@comcast.net> wrote:
Dear Samir,
Please keep me in the information loop. I am particularly interested in the application of big data analytics to ex-post and impact evaluation of development projects. Real time data probably has limited use in project evaluation since one evaluates projects for outcomes after a delay. But it would have use in project monitoring where the results need to be continuously measured such as in pollution abatement projects. If you or any one else in your group is working on big data applications in impact evaluations of development projects , I would be interested in learning about the initiative. many thanks.
Best,
Shyamadas Banerji
sbanerji@alum.mit.edumailto:sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi <sdoshi@usaid.govmailto:sdoshi@usaid.gov> wrote:

Glen,

We will be publishing a literature review on the current knowledge base of real-time data and the intersection with data informed decision making / adaptive management.

The survey responses will be compiled and then scoped for a comparative case study report that will include empirical investigation by a research consortium of how select cases are implementing RTD systems for best practice and purpose. This report will be published at the end of the year.

Kind regards,
Samir


Samir K. Doshi, Ph.D. | Senior Scientist
U.S. Global Development Lab | US Agency for International Development
E: sdoshi@usaid.govmailto:sdoshi@usaid.gov | P: +1.202.712.1380tel:%2B1.202.712.1380 | W: USAID.gov/GlobalDevLabhttp://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett <Glen.Burnett@practicalaction.org.ukmailto:Glen.Burnett@practicalaction.org.uk> wrote:
Merrick, will you be publishing results of this review? It would be great to see what you learn.

Glen Burnett

From:ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com [mailto:ict4d-principles@googlegroups.com] On Behalf Of Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of Development Studies and including the Overseas Development Institute, Reboot, and Feedback Labs are looking for case study examples of projects that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how they contribute to better strategic and operational decision-making, and ultimately how they might be used to enhance and support stronger adaptive managements approaches. We want to build the evidence base in this increasingly important but under-analysed area, and use this to development tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that utilize real-time data for improved decision-making by filling out the form in the link below.

The best five contributions will receive a copy of “Time to Listen,” by Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one case study, please reuse this form and submit your cases by 5/17/2016 in order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to others that could contribute.

Best,

Merrick

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
[http://bit.ly/1hl4Btr]http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor women and men around the world.www.practicalaction.orghttp://www.practicalaction.org/

[http://bit.ly/17osJ5h]http://www.facebook.com/practicalaction[http://bit.ly/12Eshft]http://www.twitter.com/practicalaction[http://bit.ly/17osOpB]http://www.youtube.com/practicalaction[http://bit.ly/Z5rh4c]http://www.flickr.com/photos/practicalaction[http://bit.ly/XpFdWm]http://www.linkedin.com/groups/Practical-Action-2428887[http://bit.ly/YestUa]http://practicalaction.org/blogs[http://bit.ly/XpFkRI]http://practicalaction.org/get-our-e-newsletter

Support our work today [Donate online] http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby, Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400tel:(202)%20248-6400 phone
(202) 521-1363tel:(202)%20521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Sanjay Jain
Nonprofit Database Specialist
AGH Strategies
(202) 248-6400tel:(202)%20248-6400 phone
(202) 521-1363tel:(202)%20521-1363 fax
aghstrategies.comhttp://aghstrategies.com/

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups “ICT4D Principles” group.
To unsubscribe from this group and stop receiving emails from it, send an email to ict4d-principles+unsubscribe@googlegroups.commailto:ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.commailto:ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


#27

Great conversation – really enjoyed Siobhan on context (and personally,
I’d love a Watson for P&L) and James on data repositories.

I’m very curious about how real-time data will be treated as more and more
of international development activities take place online, specifically
around capacity building.

One of the driving forces behind TechChange providing a shared online
learning platform for international development
https://www.techchange.org/enterprise/ is to provide real-time data for
improving online trainings and workshops as you go.

That said, a reliable platform won’t solve everything, but if you’re
looking to evaluate adaptive management practices, then there’s nothing
quite like hard data on user engagement and progress to keep improving as
you go.

Also appreciated the side conversation on good decision making through
data, and remembered an old Wired article on A/B testing
http://www.wired.com/2012/04/ff_abtesting/:

“Google insiders, and A/B enthusiasts more generally, have a derisive term
to describe a decisionmaking system that fails to put data at its heart:
HiPPO—”highest-paid person’s opinion.” As Google analytics expert Avinash
Kaushik declares, “Most websites suck because HiPPOs create them.””

Even with appropriate real-time data, if decision making is still just an
intuitive judgement call then it’s not necessarily going to be a major
improvement on where we are now.

On the other hand, in the digital realm you could have multiple courses,
trainings, or projects exist in parallel, and then constantly test your
assumptions in order to quickly make adjustments as helpful.

It won’t work for every development need, but capacity building could be a
good place to start.

Just a thought,

  • C

··· On Wed, May 25, 2016 at 12:46 PM, Siobhan Green wrote:

Exactly! There are also legal compliance requirements that are checked
(audits) and tangible consequences for poor performance and dedicated line
items for accounting software and staff.

Now, we may never go there (nor need to) for the data we are talking
about, but it does make you realize how much prioritization is worth…


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Wednesday, May 25, 2016 12:43 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Like how you pulled in an example from a different “corner." Of course, $$
is key to a successful organization, so systems to manage it have been
prioritized & are well developed :wink:

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Siobhan Green <
sio@sonjara.com>
*Date: *Wednesday, May 25, 2016 at 12:32 PM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Just as a comment.

Accounting systems are probably the BEST model for good data management,
globally.

And just think about how much money and effort goes into good accounting.

That is where business put so much of their effort into organizing their
data for usage.

Followed by inventory management and then maybe sales/business
development. In fact capacity assessments of businesses link these
processes to the maturity and sustainability of an organization – without
good data management processes for these areas, the firm is considered to
be higher risk/lower capacity.

And none of these use AI to sort out their structure, and I am not sure
how they could use AI effectively.

These are great examples in our daily lives of how we use real time data
for decision making and performance management – in one corner of our
current organizations.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Wednesday, May 25, 2016 12:14 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Interesting… And I can sorta see what you might be implying. But can you
say a little bit more about the little bit you know about Watson (& similar
systems) & how it might be applied?

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <
sanjay@aghstrategies.com>
*Date: *Wednesday, May 25, 2016 at 11:23 AM
*To: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I
wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it
could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo James.BonTempo@jhu.edu > wrote:

Was reminded of this thread today as I read this article in the New
England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable
and Useful Data Sharing
http://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production
of ‘data dumpsters’: repositories of data without the metadata, data
dictionaries, or documentation needed for meaningful or correct reanalysis.
Fulfilling an obligation to share data before good practices in data
formatting and documentation have been established and replicated may allow
researchers to check the ‘data shared’ box, but it may also result in an
epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think
are relevant & useful. Definitely worth the 5 minutes to read…

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Rose Shuman <
roseshuman@gmail.com>
*Date: *Thursday, May 12, 2016 at 5:52 PM
*To: *Sanjay Jain sanjay@aghstrategies.com
*Cc: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com>

*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Fantastic story, Siobhan!

On May 12, 2016 2:50 PM, “Sanjay Jain” sanjay@aghstrategies.com wrote:

Open means nothing if it is not usable for good decision making.

All technology (in fact pretty much everything else as well) requires that
users understand what it is, before using it. Traffic lights are only
useful because we’ve been trained to understand them.

Having some erroneous data points should not make the data set unusable.
And it also does not mean that it should not be open.

True, we can clean up the data for those who are likely to use it without
understanding it, but I’d advocate for both the raw and cleaned up data
sets to be made available. The transition to an “open” mindset is going to
take time and no doubt some mistakes will be made along the way, but it’s a
transition well worth making imo.

~sanjay

PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green sio@sonjara.com wrote:

Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe
pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as
well as standardized indicators can make a huge difference in
interoperability.

Also – what methodology was used to capture the data? I cannot use it for
decision making if I don’t know what the data means and how much I can
trust it.

Case in point. A friend used to live in a small village in Ireland with
her husband, who worked on a mining project in Nigeria. He travelled weekly
to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked
the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my
husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the
form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the
village. When she asked about it, they informed her the census results came
back and it turns out according to the results, village residents commuted
an average of 50 miles a week (for context, Ireland is 174 miles wide and
302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: Matt Berg [mailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green sio@sonjara.com
Cc: James BonTempo James.BonTempo@jhu.edu; ICT4D Principles <
ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and
variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are
so important. Standards like Hxl show some progress and hopefully some
type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green sio@sonjara.com wrote:

Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of
“sizable” data sets, I believe, require different tools and approaches. I
believe a lot of the key in mining big data sets is the constancy of how
the data is captured and collected – it just happens to be very large and
complex.

The challenge with the DDL is that there is minimal consistency in how
data is captured and collected, or even what it is about – meaning that
creating or using software tools to automate the process is a lot harder.
There is a ton of background knowledge needed about the specific data and
project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that
read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text
explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has
to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a
small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety
& velocity. Alas, the idea of gathering & opening the data for mining &
learning is a good one & progress is being made…

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Siobhan Green <
sio@sonjara.com>
*Date: *Thursday, May 12, 2016 at 3:02 PM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of
this is not really big. Sizable, yes, it can be, some of it is larger than
one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or
even terabytes if we have maps in there. It also is not high volume – the
data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an
excel spreadsheet or even database) but not using standard formats or
taxonomies, already aggregated, and often stripped of context or
information about methodology of capture. Quality of the data collected is
really varied.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to
create these kinds of “big data” repositories to mine for solutions were
underway :slight_smile:

*From: *Siobhan Green sio@sonjara.com
*Date: *Thursday, May 12, 2016 at 11:02 AM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of
the data right now on the DDL is not usable in this context.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policy
https://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way
for USAID and its partners to draw from an increasingly robust,
data-rich environment to create these breakthrough insights and solutions

in support of our mission well into the future. Specifically, the policy:

? Establishes the Development Data Library (DDL) as the Agency’s
repository of USAID-funded, machine readable data created or collected by
the Agency and its implementing partners;

? Requires USAID staff and implementing partners (via associated
changes to procurement instruments) to submit datasets generated with USAID
funding to the DDL in machine-readable, non-proprietary formats;

? Implements a data tagging protocol in keeping with the
President’s Executive Order and Office of Management and Budget policy on
Open Data; and

? Defines a data clearance process to ensure that USAID makes as
much data publicly available as possible, while still affording all
protections for individual privacy, operational and national security, and
other considerations allowable by law.”

James

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <
banerji1@comcast.net>
*Date: *Wednesday, May 11, 2016 at 10:49 PM
*To: *Robert Kirkpatrick kirkpatrick@unglobalpulse.org
*Cc: *Samir Doshi sdoshi@usaid.gov, Glen Burnett <
Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <
merrickweb@gmail.com>, "ict4d-principles@googlegroups.com" <
ict4d-principles@googlegroups.com>, Michael Bamberger <
jmichaelbamberger@gmail.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Dear Robert,

Many thanks for your interest in the question I raised. First, I should
mention that I am delighted to learn of your data analytics initiative. If
I can assist in any way , kindly let me know. I look forward to reading
Michael’s draft reports.

As someone who has undertaken evaluations of development programs and
projects for over two decades at the World Bank , ADB and other agencies,
I have been troubled that evaluators rely mainly on experience and
judgments in conducting evaluations, including conducting impact
evaluations, taking into consideration experimental trials and methods.
The standard DAC criteria used in program and project evaluations
-relevance, efficiency, efficacy, outcome and impact -are usually not well
defined or quantified a priori at appraisal , so that project evaluators
assign a subjective rating during ex-post evaluation which can be
erroneous. The log frame of the project may not be logical or evidence
based. The indicators used to assess each of the evaluation criteria may
fail to reflect the achievements taking into account broader sectoral
and country experience . And since these indicators are specified by the
project formulators at appraisal , weak or faulty indicators may constrain
the ex-post evaluation exercise.

Another issue is the the Theory of Change (TOC) which supports the
logical framework and the conceptual underpinning of the project.
Recently, I have seen quite a few bird nests of TOC diagrams which contain
many assumptions about the logical process of change and transformation
which the project is trying to achieve without providing any empirical
evidence about how the change actually happens, the risks and why the
proposed intervention is the best or optimal method of achieving the
outcomes desired. Applications of Program Theory suffer from similar
deficiencies which I can elaborate on.

My interest is to explore *how one could use big data
analytics/artificial intelligence/machine learning to strengthen the
evidence base *of project formulation and evaluation in different sectors
or development issues. I would like to know how one could strengthen the
formulation of TOC for projects in different problem areas based on
actual field evidence from learning and implementation of a wide cross
section of completed projects . This would lead to a deeper understanding
of change pathways and risk variables at the
society/community/institutional levels depending on the level of project
intervention and how monitoring and mitigating actions can be built into
the project to achieve desired goals. Various development agencies could
contribute to providing data for building the data base. The data base
would provide a full picture of real life experiences on how development
problems in various areas have been defined and addressed and with what
results and reasons for the outcomes and the lessons.

I am aware that the evaluation departments some development agencies
have built data banks of projects they have supported and have undertaken
large meta studies of project interventions in specific areas to learn
some generalizable lessons. My experience looking at these meta studies is
that they are not particularly useful for designing new specific project
interventions and that the lessons of earlier projects are inadequately
reflected in new projects.

I am thinking of the value of developing a large multi country , multi
agency data base which can be queried for evidence to help with project
design, implementation and evaluation. Can one build a data bank which can
use an IBM Watson type approach of artificial intelligence to learn from
past project interventions in different areas to design better future
interventions? The feedback loop between evaluation results and new
project designs can then be finally closed.

This is just a quick response to your question and I hope it will
stimulate some thinking and generate some more focused ideas.

Kind regards,

Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick < > kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick

Director
United Nations Global Pulse
Executive Office of the Secretary-General

+1 650.796.5709
kirkpatrick@un.org

@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:

http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net > wrote:

Dear Samir,

                 Please keep me in the information loop. I am

particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.

Best,

Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base of
real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,

Samir


Samir K. Doshi, Ph.D. | Senior Scientist

U.S. Global Development Lab | US Agency for International Development

E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < > Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be great
to see what you learn.

Glen Burnett

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti
data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of projects
that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to
others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org

http://www.facebook.com/practicalaction
http://www.twitter.com/practicalaction
http://www.youtube.com/practicalaction
http://www.flickr.com/photos/practicalaction
http://www.linkedin.com/groups/Practical-Action-2428887
http://practicalaction.org/blogs
http://practicalaction.org/get-our-e-newsletter

Support our work today [image: Donate online]
http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Sanjay Jain

Nonprofit Database Specialist

AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax

aghstrategies.com


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Sanjay Jain

Nonprofit Database Specialist

AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax

aghstrategies.com


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[image: Inline image 1]

Christopher Neu

Chief Operating Officer, TechChange

http://www.facebook.com/techchange http://www.twitter.com/techchange
https://www.linkedin.com/company/techchange-the-institute-for-technology-&-social-change

Check out our recent instructional design
https://youtu.be/DDkL9OYv4RA and animation
work https://www.youtube.com/watch?v=nlG0rOFjVEs


#28

Hello Ernest and all,

This is the cue for Peter Burgess, Community Accountancy, who has been
tackling the problem for 20-30 years. He started as an engineer, and
learned accounting to protect engineers from accountants. Then he worked
overseas for a career.

Regards,

Mark Roest

··· On Thu, May 26, 2016 at 5:36 PM, Ernest Ostro wrote:

I want to come in late (argh! Computers!) and just second Siobhan’s point
about accounting systems …

Ignoring the very interesting points about AI and semantics, there is
really very few barriers today that we could not overcome with sufficient
funding to get real time data out of projects and train/hire staff to use
it. Technology is not the problem.

Accounting systems are usually owned by the CFO, who sits on the executive
team, no-one blinks at a multi-million (scale to fit your organization)
price tag, the systems function according to standards that have been
worked on for over 700 years, and for which you can certified accountants
in almost every country on earth who know GAAP.

Compare that to systems in ICT4D and all of those factors change.

Ernest

*Ernest Ostro | Director, Software Systems *International Rescue Committee
122 East 42nd Street, NY, NY 10168 | Rescue.org
M. +1 347 688 2225| skype. ostro.ernest

[image: IRC%20eSignature%20Graphic]

In 2015, 23 million people in more than 40 countries and 26 U.S. cities
benefited from IRC programs. Read more in our annual report
http://s.bl-1.com/h/zkw1VfK?url=http://feature.rescue.org/annual-report-2015/
.

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *Mark Roest
Sent: Wednesday, May 25, 2016 9:24 PM
To: Siobhan Green sio@sonjara.com
Cc: James BonTempo James.BonTempo@jhu.edu; ICT4D Principles <
ict4d-principles@googlegroups.com>
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Hello Siobhan and all,

Expert systems are part of AI, and they enable people to take one mastered
and documented set of categorical relationships and apply it to others. A
global knowledgebase, loaded with expert systems and many other structured
collections of data and applications to manage them, with AI supporting the
way everything works, is integrated, and is retrievable in ways that meet
user needs, whoever the users are, would also be a major, and meta-,
example of AI utility. The whole thing would be organized around earth’s
867 terrestrial eco-regions (shape-files at WWF website), each of which is
a consistent pattern of ecosystems, with further subdivision for
ecosystems, and in parallel, cultures and all their information management
needs.

I’ve been thinking of this for about 35 years and counting.

Regards,

Mark Roest

On Wed, May 25, 2016 at 9:32 AM, Siobhan Green sio@sonjara.com wrote:

Just as a comment.

Accounting systems are probably the BEST model for good data management,
globally.

And just think about how much money and effort goes into good accounting.

That is where business put so much of their effort into organizing their
data for usage.

Followed by inventory management and then maybe sales/business
development. In fact capacity assessments of businesses link these
processes to the maturity and sustainability of an organization – without
good data management processes for these areas, the firm is considered to
be higher risk/lower capacity.

And none of these use AI to sort out their structure, and I am not sure
how they could use AI effectively.

These are great examples in our daily lives of how we use real time data
for decision making and performance management – in one corner of our
current organizations.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: ict4d-principles@googlegroups.com [mailto:
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Wednesday, May 25, 2016 12:14 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Interesting… And I can sorta see what you might be implying. But can you
say a little bit more about the little bit you know about Watson (& similar
systems) & how it might be applied?

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Sanjay Jain <
sanjay@aghstrategies.com>
*Date: *Wednesday, May 25, 2016 at 11:23 AM
*To: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Not that I’m advocating for not providing data in a meaningful way, but I
wonder if cognitive computing/search changes this problem.

The little I know about how IBM’s Watson works seems to indicate that it
could overcome some of these limitations.

~sanjay

On Wed, May 25, 2016 at 9:44 AM, James BonTempo James.BonTempo@jhu.edu > wrote:

Was reminded of this thread today as I read this article in the New
England Journal of Medicine, "Avoiding Data Dumpsters — Toward Equitable
and Useful Data Sharing
http://www.nejm.org/doi/full/10.1056/NEJMp1605148.”

"One of the risks posed by these expanding repositories is the production
of ‘data dumpsters’: repositories of data without the metadata, data
dictionaries, or documentation needed for meaningful or correct reanalysis.
Fulfilling an obligation to share data before good practices in data
formatting and documentation have been established and replicated may allow
researchers to check the ‘data shared’ box, but it may also result in an
epidemic of accessible data of limited usefulness.”

There is also mention of issues around capacity & attribution that I think
are relevant & useful. Definitely worth the 5 minutes to read…

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Rose Shuman <
roseshuman@gmail.com>
*Date: *Thursday, May 12, 2016 at 5:52 PM
*To: *Sanjay Jain sanjay@aghstrategies.com
*Cc: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com>

*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Fantastic story, Siobhan!

On May 12, 2016 2:50 PM, “Sanjay Jain” sanjay@aghstrategies.com wrote:

Open means nothing if it is not usable for good decision making.

All technology (in fact pretty much everything else as well) requires that
users understand what it is, before using it. Traffic lights are only
useful because we’ve been trained to understand them.

Having some erroneous data points should not make the data set unusable.
And it also does not mean that it should not be open.

True, we can clean up the data for those who are likely to use it without
understanding it, but I’d advocate for both the raw and cleaned up data
sets to be made available. The transition to an “open” mindset is going to
take time and no doubt some mistakes will be made along the way, but it’s a
transition well worth making imo.

~sanjay

PS - interesting story!

On Thu, May 12, 2016 at 3:32 PM, Siobhan Green sio@sonjara.com wrote:

Ooh, I love fat data. We have a ton of it, but it is flabby… : ) Maybe
pushing the metaphor too far?

Yes, I agree. Coding standards are really important. Using IATI and HXL as
well as standardized indicators can make a huge difference in
interoperability.

Also – what methodology was used to capture the data? I cannot use it for
decision making if I don’t know what the data means and how much I can
trust it.

Case in point. A friend used to live in a small village in Ireland with
her husband, who worked on a mining project in Nigeria. He travelled weekly
to Nigeria, back Thursday night, off again Sunday PM.

When the Irish census came around, they interviewed the wife who was asked
the question “How far does your household commute weekly?“

She replied, “well, it is not really a fair question. I don’t work and my
husband commutes to Nigeria.”

But the census takers insisted they had to have a number to fill in the
form. So she said “4500 miles”.

A few months later, she noticed bus stop being added in the middle of the
village. When she asked about it, they informed her the census results came
back and it turns out according to the results, village residents commuted
an average of 50 miles a week (for context, Ireland is 174 miles wide and
302 miles long).

Open means nothing if it is not usable for good decision making.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

From: Matt Berg [mailto:mberg@ona.io]
Sent: Thursday, May 12, 2016 3:23 PM
To: Siobhan Green sio@sonjara.com
Cc: James BonTempo James.BonTempo@jhu.edu; ICT4D Principles <
ict4d-principles@googlegroups.com>

Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I think the term “fat data” is generally more accurate. Short, wide and
variable. :slight_smile:

In all seriousness, the discussion below is why data coding standards are
so important. Standards like Hxl show some progress and hopefully some
type geocoding tied to osm.

On Thursday, May 12, 2016, Siobhan Green sio@sonjara.com wrote:

Agree.

My bigger point is that mining 2 or 3 big data sets and mining 1000s of
“sizable” data sets, I believe, require different tools and approaches. I
believe a lot of the key in mining big data sets is the constancy of how
the data is captured and collected – it just happens to be very large and
complex.

The challenge with the DDL is that there is minimal consistency in how
data is captured and collected, or even what it is about – meaning that
creating or using software tools to automate the process is a lot harder.
There is a ton of background knowledge needed about the specific data and
project before even starting an analysis.

Some of the datasets I am taking about are literally are CSV files that
read HS_1, HS_2, HS_3 as headers, and under that, numbers like 32 , 2, 11…

There is no data dictionary but there is a PDF attachment that has in text
explanations of the analysis of the dataset.

To turn that dataset back into data that is possible to reuse, someone has
to do a lot of reverse engineering.

If anyone has a counter example, I would love to hear it.

Basically, building a repository is an important step, but honestly a
small one.

Building an ecosystem of reusable data – essential.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 3:06 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

True, it doesn’t necessarily meet the “3 V’s” of big data: volume, variety
& velocity. Alas, the idea of gathering & opening the data for mining &
learning is a good one & progress is being made…

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Siobhan Green <
sio@sonjara.com>
*Date: *Thursday, May 12, 2016 at 3:02 PM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

I actually don’t like using the term “big data” with this stuff. Most of
this is not really big. Sizable, yes, it can be, some of it is larger than
one excel spreadsheet can easily handle, absolutely.

But not big. Big is petabytes of data. This stuff is maybe gigabytes or
even terabytes if we have maps in there. It also is not high volume – the
data is captured maybe 1-2 times a year?

What we have is semi-structured data. In that it may be structured (in an
excel spreadsheet or even database) but not using standard formats or
taxonomies, already aggregated, and often stripped of context or
information about methodology of capture. Quality of the data collected is
really varied.

Siobhan


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 1:33 PM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Indeed! There is still a ways to go. Was just pointing out that efforts to
create these kinds of “big data” repositories to mine for solutions were
underway :slight_smile:

*From: *Siobhan Green sio@sonjara.com
*Date: *Thursday, May 12, 2016 at 11:02 AM
*To: *James BonTempo James.BonTempo@jhu.edu, “
ict4d-principles@googlegroups.comict4d-principles@googlegroups.com
*Subject: *RE: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Yes.

However, there is a huge gap right now that needs to be addressed. Most of
the data right now on the DDL is not usable in this context.


Siobhan Green

Sonjara, Inc.

Digital Solutions that Serve the Greater Good

Tech Evaluation | Tech Consulting | Rapid Web and Mobile App Dev

207 Park Ave, B6, Falls Church, VA, USA

www.sonjara.com | www.fakoli.org | www.griot.us

Email: sio@sonjara.com Skype: sewgreen

O: +1 571-297-6383 ext 101 or D: +1 (571) 421-1069 M: +1 703
981-9982

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *James BonTempo
Sent: Thursday, May 12, 2016 11:01 AM
To: ICT4D Principles ict4d-principles@googlegroups.com
Subject: Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Isn’t this what is essentially behind USAID’s open data policy?

From Announcing USAID’s Open Data Policy
https://blog.usaid.gov/2014/10/announcing-usaids-open-data-policy/:

"One of the reasons this policy is so important is that it paves the way
for USAID and its partners to draw from an increasingly robust,
data-rich environment to create these breakthrough insights and solutions

in support of our mission well into the future. Specifically, the policy:

? Establishes the Development Data Library (DDL) as the Agency’s
repository of USAID-funded, machine readable data created or collected by
the Agency and its implementing partners;

? Requires USAID staff and implementing partners (via associated
changes to procurement instruments) to submit datasets generated with USAID
funding to the DDL in machine-readable, non-proprietary formats;

? Implements a data tagging protocol in keeping with the
President’s Executive Order and Office of Management and Budget policy on
Open Data; and

? Defines a data clearance process to ensure that USAID makes as
much data publicly available as possible, while still affording all
protections for individual privacy, operational and national security, and
other considerations allowable by law.”

James

*From: *“ict4d-principles@googlegroups.com” <
ict4d-principles@googlegroups.com> on behalf of Shyamadas Banerji <
banerji1@comcast.net>
*Date: *Wednesday, May 11, 2016 at 10:49 PM
*To: *Robert Kirkpatrick kirkpatrick@unglobalpulse.org
*Cc: *Samir Doshi sdoshi@usaid.gov, Glen Burnett <
Glen.Burnett@practicalaction.org.uk>, Merrick Schaefer <
merrickweb@gmail.com>, "ict4d-principles@googlegroups.com" <
ict4d-principles@googlegroups.com>, Michael Bamberger <
jmichaelbamberger@gmail.com>
*Subject: *Re: [ICT4D Principles] Does your project use real time data?
Is ti data driven? Tell us.

Dear Robert,

Many thanks for your interest in the question I raised. First, I should
mention that I am delighted to learn of your data analytics initiative. If
I can assist in any way , kindly let me know. I look forward to reading
Michael’s draft reports.

As someone who has undertaken evaluations of development programs and
projects for over two decades at the World Bank , ADB and other agencies,
I have been troubled that evaluators rely mainly on experience and
judgments in conducting evaluations, including conducting impact
evaluations, taking into consideration experimental trials and methods.
The standard DAC criteria used in program and project evaluations
-relevance, efficiency, efficacy, outcome and impact -are usually not well
defined or quantified a priori at appraisal , so that project evaluators
assign a subjective rating during ex-post evaluation which can be
erroneous. The log frame of the project may not be logical or evidence
based. The indicators used to assess each of the evaluation criteria may
fail to reflect the achievements taking into account broader sectoral
and country experience . And since these indicators are specified by the
project formulators at appraisal , weak or faulty indicators may constrain
the ex-post evaluation exercise.

Another issue is the the Theory of Change (TOC) which supports the
logical framework and the conceptual underpinning of the project.
Recently, I have seen quite a few bird nests of TOC diagrams which contain
many assumptions about the logical process of change and transformation
which the project is trying to achieve without providing any empirical
evidence about how the change actually happens, the risks and why the
proposed intervention is the best or optimal method of achieving the
outcomes desired. Applications of Program Theory suffer from similar
deficiencies which I can elaborate on.

My interest is to explore *how one could use big data
analytics/artificial intelligence/machine learning to strengthen the
evidence base *of project formulation and evaluation in different sectors
or development issues. I would like to know how one could strengthen the
formulation of TOC for projects in different problem areas based on
actual field evidence from learning and implementation of a wide cross
section of completed projects . This would lead to a deeper understanding
of change pathways and risk variables at the
society/community/institutional levels depending on the level of project
intervention and how monitoring and mitigating actions can be built into
the project to achieve desired goals. Various development agencies could
contribute to providing data for building the data base. The data base
would provide a full picture of real life experiences on how development
problems in various areas have been defined and addressed and with what
results and reasons for the outcomes and the lessons.

I am aware that the evaluation departments some development agencies
have built data banks of projects they have supported and have undertaken
large meta studies of project interventions in specific areas to learn
some generalizable lessons. My experience looking at these meta studies is
that they are not particularly useful for designing new specific project
interventions and that the lessons of earlier projects are inadequately
reflected in new projects.

I am thinking of the value of developing a large multi country , multi
agency data base which can be queried for evidence to help with project
design, implementation and evaluation. Can one build a data bank which can
use an IBM Watson type approach of artificial intelligence to learn from
past project interventions in different areas to design better future
interventions? The feedback loop between evaluation results and new
project designs can then be finally closed.

This is just a quick response to your question and I hope it will
stimulate some thinking and generate some more focused ideas.

Kind regards,

Shyamadas

On May 11, 2016, at 5:06 PM, Robert Kirkpatrick < > kirkpatrick@unglobalpulse.org> wrote:

Dear Shyamdas,

We are working with Michael Bamberger (copied) on finalizing what we
believe will be the seminal report (actually a pair of reports) on
applications of analytics to development project evaluation. These reports
will be available this summer. Happy to chat further on this topic. Would
love to know more about your interests here!

Warm regards,

Robert

Robert Kirkpatrick

Director
United Nations Global Pulse
Executive Office of the Secretary-General

+1 650.796.5709
kirkpatrick@un.org

@rgkirkpatrick

The Data Revolution in Action: 20 Case Studies by Global Pulse:

http://unglobalpulse.org/blog/big-data-development-action-global-pulse-project-series

On Wed, May 11, 2016 at 3:23 PM, Shyamadas Banerji banerji1@comcast.net > wrote:

Dear Samir,

                 Please keep me in the information loop. I am

particularly interested in the application of big data analytics to ex-post
and impact evaluation of development projects. Real time data probably has
limited use in project evaluation since one evaluates projects for outcomes
after a delay. But it would have use in project monitoring where the
results need to be continuously measured such as in pollution abatement
projects. If you or any one else in your group is working on big data
applications in impact evaluations of development projects , I would be
interested in learning about the initiative. many thanks.

Best,

Shyamadas Banerji
sbanerji@alum.mit.edu

On May 11, 2016, at 9:45 AM, Samir Doshi sdoshi@usaid.gov wrote:

Glen,

We will be publishing a literature review on the current knowledge base of
real-time data and the intersection with data informed decision making /
adaptive management.

The survey responses will be compiled and then scoped for a comparative
case study report that will include empirical investigation by a research
consortium of how select cases are implementing RTD systems for best
practice and purpose. This report will be published at the end of the year.

Kind regards,

Samir


Samir K. Doshi, Ph.D. | Senior Scientist

U.S. Global Development Lab | US Agency for International Development

E: sdoshi@usaid.gov | P: +1.202.712.1380 | W: USAID.gov/GlobalDevLab
http://www.usaid.gov/GlobalDevLab

On Tue, May 10, 2016 at 5:29 PM, Glen Burnett < > Glen.Burnett@practicalaction.org.uk> wrote:

Merrick, will you be publishing results of this review? It would be great
to see what you learn.

Glen Burnett

*From:*ict4d-principles@googlegroups.com [
mailto:ict4d-principles@googlegroups.com
ict4d-principles@googlegroups.com] *On Behalf Of *Merrick Schaefer
Sent: Tuesday, May 10, 2016 5:12 PM
To: ICT4D Principles
Subject: [ICT4D Principles] Does your project use real time data? Is ti
data driven? Tell us.

Hey Everyone,

USAID, the mSTAR project, and a research consortium led by Institute of
Development Studies and including the Overseas Development Institute,
Reboot, and Feedback Labs are looking for case study examples of projects
that are using real-time data in development work.

We want to better understand how real-time data initiatives work and how
they contribute to better strategic and operational decision-making, and
ultimately how they might be used to enhance and support stronger adaptive
managements approaches. We want to build the evidence base in this
increasingly important but under-analysed area, and use this to development
tools and frameworks that can inform future police, practice and research.

Please do take a few minutes to share your examples of projects that
utilize real-time data for improved decision-making by filling out the form
in the link below.

The best five contributions will receive a copy of “Time to Listen,” by
Dayna Brown, Mary B. Anderson, & Isabella Jean. To contribute more than one
case study, please reuse this form and submit your cases by 5/17/2016 in
order to be considered and to win a copy of “Time to Listen.”

Your help and support are much appreciated! Also, please forward along to
others that could contribute.

https://docs.google.com/forms/d/1qZB8h1fcKDsNd9azeEjXqA0DLufOeq5jjpWSPq1ER5Q/viewform

Best,

Merrick


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[image: http://bit.ly/1hl4Btr] http://www.practicalaction.org/

Practical Action uses technology to challenge poverty, working with poor
women and men around the world.www.practicalaction.org

[image: http://bit.ly/17osJ5h] http://www.facebook.com/practicalaction[image:
http://bit.ly/12Eshft] http://www.twitter.com/practicalaction[image:
http://bit.ly/17osOpB] http://www.youtube.com/practicalaction[image:
http://bit.ly/Z5rh4c] http://www.flickr.com/photos/practicalaction[image:
http://bit.ly/XpFdWm]
http://www.linkedin.com/groups/Practical-Action-2428887[image:
http://bit.ly/YestUa] http://practicalaction.org/blogs[image:
http://bit.ly/XpFkRI] http://practicalaction.org/get-our-e-newsletter

Support our work today [image: Donate online]
http://practicalaction.org/signature

Practical Action, The Schumacher Centre, Bourton on Dunsmore, Rugby,
Warwickshire, UK, CV23 9QZ
Practical Action is a charity registered in England and Wales, and a
company limited by guarantee in England no. 871954
VAT Reg No. 880992476 | Reg Charity No. 247257.

[image: http://bit.ly/17BommD]


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Sanjay Jain

Nonprofit Database Specialist

AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax

aghstrategies.com


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Sanjay Jain

Nonprofit Database Specialist

AGH Strategies
(202) 248-6400 phone
(202) 521-1363 fax

aghstrategies.com


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


You received this message because you are subscribed to the Google Groups
"ICT4D Principles" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to ict4d-principles+unsubscribe@googlegroups.com.
To post to this group, send email to ict4d-principles@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.