Azure Data Engineer Job in Mindteck
Azure Data Engineer
- Gurgaon, Haryana
- Not Disclosed
- Full-time
- Permanent
Must have:
Strong hands-on experience on GCP, Azure Big Data Eng stack - ADF, Azure Databricks, ADLS, Azure SQL DB, Azure Synapse
Strong hands-on experience in PySpark, Cloudera, Hive, Impala, HDFS
Strong experience in SQL
Specific focus in Azure Data Factory, Azure Databricks, PySpark, SQL
Good knowledge on Azure Streaming Technologies, Event Hub
Knowledge on Kudu and Streamsets
Added Advantages:
CI/CD, Azure DevOps experience
Migration from Cloudera platform to Azure
Role of contractor:
Designing and building pipelines to ingest data from source systems into Azure Data Lake
Designing and building data transformation using Azure Data Factory, big data, Azure Databricks, PySpark and loading into Azure SQL DB/Synapse
Owning the code release management process for all environments
Working closely with internal architects and advise on industry best practices
Qualification : Any Engineering Degree
2 to 8 Years
2 - 4 Hires
