Data Engineer Job in Sumo Digital Ltd.
Data Engineer
Sumo Digital Ltd.
4+ weeks ago
- Pune, Pune Division, Maharashtra
- Not Disclosed
- Full-time
- Permanent
Job Summary
Work with the Live-Ops Manager, and wider code team to build, extend and maintain data pipelines and structures to support our live service titles. Develop, maintain, and support ETL processes for data aggregation and cross-pollinating from multiple sources into a data warehouse. Maintain large, multi-terabyte data warehouse which includes performance tuning and data retention/purge processes Develop and manage various database scripts, processes, and tools to facilitate automation processes. Design database systems to support live-ops, and recommend improvements for performance Work with Data Science team to build, implement, and maintain ML data processes (churn prediction, for example). Experience with core AWS products Working with big data solutions (for example, Redshift, Spectrum, Athena, Glue) Experience streaming data technologies (kinesis, firehose) Experience with AWS Lambda, and Serverless Application Model (SAM) High proficiency in Python and SQL Strong understanding of IAM and security best practises Monitoring systems (Cloudwatch) Data modelling, design, and data structures Experience building ETL pipelines Designing and implementing Rest APIs experience (API Gateway, ALB, FastAPI) It would be great to have knowledge ith tools such as Apache Airflow Familiarity with data visualisation products (Apache Superset, Tableau, Looker, etc) Experience with AWS CloudFormation or Terraform for creating, deploying, and managing AWS resources Experience or understanding of using source control systems (Git, Perforce, etc.) Experience or understanding of working with large datasets, statistics and data analysis
In this role you will:
To be succesful you will have:
It's not required but would help if you have:
Experience Required :
Fresher
Vacancy :
2 - 4 Hires
Similar Jobs for you
Help us improve TheIndiaJobs
Need Help? Contact us