I want to learn about
or
I am a
With data scientist being hailed as the sexiest job of the 21st century, there has been an influx of “big data” companies, visualization tools, and other products. But unless the input data…
We use GitHub issues to keep track of all issues. Please do not report bugs or issues in this blog’s comments. Instead, post them on GitHub as an issue. Before submitting a comment…
Data Governance
Sorry! We don’t have any resources about this topic yet 🙁
Interested in writing about it? Email us at [email protected]
Data is most valuable when you have something to compare it to, but these comparisons aren’t helpful if the data is bad or irrelevant. Data is most valuable when you…
We’re so excited to announce the launch of our second online course about geospatial data in R. Sign up here. When you hear “geospatial data”, what comes to your mind?…
What happens in your brain when you read a map or untangle the meaning of a new word? A complex and rapid process of interpreting environmental stimuli, signals, and context…
Numbers are everywhere and drive our day-to-day lives. We take decisions based on numbers, both at work and in our personal lives. For example, an organization may rely on sales…
Data Analyst / Scientist
View All
Data sets are most valuable when people can understand them. When done right, data visualization is a great way to display large amounts of information simply and intuitively. However, in…
We use GitHub issues to keep track of all issues. Please do not report bugs or issues in this blog’s comments. Instead, post them on GitHub as an issue. Before submitting a comment…
The alternative data revolution isn’t about what alternative data to use. It’s about how to turn it into actionable insights. Road data for Pune, India, color-coded to show which roads…
Today hedge funds use alternative data to shape their investments. Why can’t organizations use it to shape their own future? In the fall of 2015, Chipotle (an American food chain famous…
Sean presented a talk about how he built this app at the December 2018 edition of the Delhi userR meetup. Learn more about the meetup here, or watch his talk below. https://www.youtube.com/watch?v=c07AysEIo-g This was recorded as part of the community initiatives by SocialCops. If I told you that, according to the 2011 Census, 67% of Indian households had access to…
Data is most valuable when you have something to compare it to, but these comparisons aren’t helpful if the data is bad or irrelevant. Data is most valuable when you…
Paper-based data collection has been around as long as humans have had an interest in understanding the world around them — tick marks on parchment were used by ancient civilizations to track food inventory, and in the 1800s the first known census was collected via pen and paper. Now, digital and cloud-based systems for data collection are rapidly increasing, but…
We use GitHub issues to keep track of all issues. Please do not report bugs or issues in this blog’s comments. Instead, post them on GitHub as an issue. Before submitting a comment…
What is the first thing that comes to mind when we see data? The first instinct is to find patterns, connections, and relationships. We look at the data to find…
In our last post on Apache Airflow, we mentioned how it has taken the data engineering ecosystem by storm. We also talked about how we’ve been using it to move data across our internal systems and explained the steps we took to create an internal workflow. The ETL workflow (e)xtracted PDFs from a website, (t)ransformed them into CSVs and (l)oaded…
Even if you haven’t worked on Kubernetes, chances are you’ve at least heard or read about it. It is already one of the most popular open source projects ever, and…
At the 14 July R User Meetup, hosted at Atlan, I had the pleasure of briefly introducing the relatively new tidytext package, written by Julia Silge (@juliasilge) and David Robinson…
Landsat is without a doubt one of the best sources of free satellite data today. Managed by NASA and the United States Geological Survey, the Landsat satellites have been capturing multi-spectral imagery for over 40 years. The latest satellite, Landsat 8, orbits the Earth every 16 days and captures more than 700 satellite images per day across 9 spectral bands…
The development sector loves to measure — and maximize — its impact. Every penny spent is meant to reach beneficiaries, directly or indirectly. That means one of the biggest challenges…
Unleashing the power of alternative data to transform India’s battle against malaria Too many malaria cases, too little data Today, India is fighting one of its toughest battles against malaria. With a…
The alternative data revolution isn’t about what alternative data to use. It’s about how to turn it into actionable insights. Road data for Pune, India, color-coded to show which roads are well-lit at night. (Source: Atlan.) If there is one thing every business in the world wants, it is market intelligence. By offering an untapped source of market intelligence, alternative…
If you’re making decisions based just on internal data, you’re already behind the curve. The sudden decline of Blackberry came as a shock to the world. A year before its revenue…
Today hedge funds use alternative data to shape their investments. Why can’t organizations use it to shape their own future? In the fall of 2015, Chipotle (an American food chain famous…
What is the first thing that comes to your mind upon hearing the word ‘Airflow’? Data engineering, right? For good reason, I suppose. You are likely to find Airflow mentioned in every other blog post that talks about data engineering. Apache Airflow is a workflow management platform. To oversimplify, you can think of it as cron, but on steroids! It…
Numbers are everywhere and drive our day-to-day lives. We take decisions based on numbers, both at work and in our personal lives. For example, an organization may rely on sales…
Data collection is a minefield of errors. It doesn’t matter whether you’re a researcher with one survey in the field, an NGO with 10 data collection drives per month, or…
Today’s news is filled with stories of data misuse — for example, Cambridge Analytica harvesting personal data via Facebook and Amazon, Facebook’s Android app logging metadata on every call and text, and Grindr revealing its users’ HIV status to third parties. These companies are being roundly criticized for misusing their users’ data. In the midst of this uproar, companies are…
Imagine that you want to understand why your mother loves making pancakes for breakfast. You could sneak around the kitchen, tracking when and how she makes pancakes, or you could…
When discussing data collection, outliers inevitably come up. What is an outlier exactly? It’s a data point that is significantly different from other data points in a data set. While…
Observational data is a valuable form of research that can give researchers information that goes beyond numbers and statistics. In general, observation is a systematic way to collect data by observing people in natural situations or settings. There are many different types of observation, each with its strengths and weaknesses. Participant vs. Non-Participant Observation Participant observation: the researcher is involved…
One of the first things we are taught in Programming 101 is to write a well-structured and commented code. And as any newbie would, we ignore this lesson and focus…
Once your data is structured and cleaned at a basic level, you may need to carry out a series of functions across your data set. Delimiting and concatenating are two…
What is an outlier? In short, it’s a data point that is significantly different from other data points in a data set. The long story? There isn’t a strong mathematical definition for what is or isn’t an outlier. In the end, detecting and handling outliers is often a somewhat subjective exercise. So how can you dive into a new data…
The most challenging part about designing any survey is to identify and create the right set of questions. Typically, there are two types of survey questions – open-ended questions and…
You want to collect all the relevant data about your program, but you also want to be judicious about it. Otherwise you’ll end up being overwhelmed by data. Remember, there…
Nothing is more frustrating than wrapping up a lengthy data collection exercise, aggregating all the data and looking through it, only to find missing data. At best, these missing values are a nuisance that can be fixed with a bit of work. At worst, they pose an intimidating threat to data quality and your sample size. How can you assess…
What Is a Focus Group Discussion? A focus group discussion (or FGD) is a qualitative research method in the social sciences, with a particular emphasis and application in the developmental…
When I say that Impact Evaluation is history, I mean it. Some people will question this. After all, Impact Evaluation just became mainstream in the last decade, driven by great…
