Data Engineer Job in Terra Economics And Analytics Lab
Data Engineer
- Bengaluru, Bangalore Urban, Karnataka
- Not Disclosed
- Full-time
As a data engineer at TEAL, you'll be taking the plunge into a rich data lake that includes everything from complex geospatial data to legal court orders to transactions data. You'll be hustling and getting your hands dirty with every part of the data pipeline always having an implicit appreciation for how all of this data will ultimately power a revolutionary real estate risk platform.There are broadly 2 tracks that we will consider you for.
In the transformation & synthesis track, your day-to-day will largely include:
- Writing complex regular expressions and other parsers to extract usable data from messy PDF, HTML, JSON and other files that range in the millions to tens of millions
- Working with NLP tools, machine translators and language specialists to efficiently translate documents from languages ranging from Persian to Tamil
- Work with data annotators and QC experts to ensure data quality is at its highest
In the ingestion track, your day-to-day will largely include:
- Constantly scoping out new data sources to complement existing ones
- Creating and maintaining distributed web scrapers using Python, RabbitMQ
- Creating, using and maintaining web scraping libraries so that future scrapers can be built faster.
Regardless of what track you work in, we'd love it if you:
- Are proficient in Python or any other object-oriented language
- Have worked with large (millions to hundreds of millions of rows in a SQL database) interdisciplinary datasets
- Are patient and methodical with unstructured and messy data
- Are always hungry to learn newer and better technologies to make the data ecosystem faster, smoother and less silo-ed
In the last question of the form below, please identify which track you'd prefer.
Application for Data Engineer
Full nameEmail addressPublic code repo ResumeEnter a public link to your resumeIs there something that you've created that you're really proud of? Tell us about itIf you were suddenly endowed with the ability to learn something in just one day, what would it be and why? This could be behavioural, technical or even ideologicalWhat do you value the most in a workplace?Tell us about a time when you took initiative to change the way something was done/challenge the status quoLooking at the image above, what is the Base64 value of the answer?Finally, what drives you to want to join TEAL?Apply now!Fresher
2 - 4 Hires
