Etl Engineer Job in Ideas2it

LocationFull Time, Chennai

What is in it for you?

• A robust distributed platform to manage a self-healing swarm of bots on unreliable network/compute
• Large scale Cloud native applications
• Document Comprehension Engine leveraging RNN and other latest OCR techniques
• Completely data-driven Low code platform
• You will get to learn cutting edge technologies as you work with leading Silicon Valley startups
• Work in a culture that values capability over experience and continuous learning as a core tenant
• You will get to bring your ideas to the table and make a significant difference to the success of the product instead of being a small cog in a big wheel

Responsibilities

• Create and maintain data models/data structures and data pipelines
• Assemble large, complex data sets that meet functional/non-functional business requirements
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, NOSQL and AWS big data technologies
• Build processes supporting data transformation, data structures, metadata, dependency and workload management

Requirements

• Advanced knowledge and experience in working with SQL and NoSQL databases as part of BI/ analytical systems. Experience with implementing analytical/ machine learning algorithms is a plus
• AWS Services: Glue Jobs, Data Migration Service, RDS (Postgres), S3
• Technologies/Languages: Oracle, SQL, Python, Spark, PySpark
• AWS Redshift
• Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. is a plus
• Experience with healthcare data is a plus but not required.