Data Engineer Job in Kanini Software Solutions
Data Engineer
- Chennai, Tamil Nadu
- Not Disclosed
- Full-time
- Permanent
Requirements
Experience with various data ingestion and transformation methodologies (EMR, ETL, Spark, Hadoop, etc)
Excellent communication skills to collaborate with the data engineering, analytics and science teams
Experience with the following cloud-based Big Data technologies: AWS EMR
Glue, Databricks, Spark, Jupyterhub, Hadoop, Redshift
Evaluate, configure and implement new technologies, methodologies and architecture design patterns to build data processing ETL pipeline
Data Warehousing, OLAP, SQL Queries, ETL/ELT design and development
Experience with infrastructure automation
Experience with Jenkins, GIT, and some familiarity with CI/CD
Experience with the following AWS and/or GCP Services (EKS/GKE, IAM,
KMS, VPC, EC2)
Experience working within the Agile/Scrum framework
Experience working from ticketing systems (JIRA/ServiceNow)
3 to 5 Years
2 - 4 Hires