Junior Data Engineer Job in IDinsight

Overview

IDinsight is hiring a full-time junior data engineer (0 to 4 years of relevant experience) to grow our data systems and broader software engineering capabilities. In this role the data engineer will work with project teams and clients to build data systems to drive social impact. You may build software to help manage on-the-ground efforts to locate out of school children, to introduce greater accountability and effectiveness into social safety net programs, or to deliver socioeconomic data to high level decision-makers in the social sector.We are a social-impact oriented organization, so can guarantee incredibly meaningful work tackling some of the worlds most complex international development challenges around the world.

About the Role

We are seeking candidates with a strong background in Python/SQL and core data engineering skills, and a passion for building solutions to difficult social problems. Most importantly, successful candidates should possess the ability to work independently to solve complex challenges, both human and technological.

As a junior data engineer, the day-to-day work may include:

• Working with clients to understand their needs: understanding their current processes and pain points and identifying which of these can be addressed through automating and streamlining data flows.
• Wrangling/cleaning government or client data, with an eye toward automation: from extracting data from SQL databases and making API calls to scraping websites and cleaning survey data.
• Creating and maintaining optimal data pipeline architecture.
• Working with analytical tools to provide actionable data insights to decision-makers.
• Working with other team members to test and deploy these solutions.

Required Technical Qualifications

• Proficiency working in Python and SQL is required.
• Proficiency building data pipelines in a production setting.
• Proficiency using Python packages like requests, scrapy, pandas, and sqlalchemy to perform extract, transform, and load operations.
• Proficiency working with third party APIs.
• Proficiency with data modelling techniques.
• Proficiency working with relational databases.
• Sound foundations in statistics and probability.
• B.S./B.S.E. degree in Applied Math, Data Science, Computer Science, Physics, Engineering or Similar Technical Field

Other required qualifications:

• Proven ability to work alone and with teams in a dynamic, multicultural environment.
• Passion for improving lives through evidence-informed policy.
• Strong oral and written communication skills in English.
• Fluency in languages spoken in countries where IDinsight works is a plus.
• Strong values aligned with IDinsights stated values.
• Ability and interest in sharing knowledge, mentoring others, presenting work and reviewing the work of others.
• Deeply passionate about global development and improving lives in disadvantaged populations
• Open-minded self-starter who will thrive while tackling new, unusual and unpredictable challenges

Preferred Qualifications:

The most competitive applicants will also have experience in one or more of the following:

• Experience living and working in developing country settings.
• Experience working with popular data engineering platforms like Airflow, PySpark, and Kafka.
• Experience working with a cloud hosting platform, preferably AWS.
• Experience working with devops tools like Docker and Terraform.
• Experience working with R and R Shiny.