Sr Azure Data Engineer Job in Abzooba

Job Description Job Responsibilities: Design, develop, and implement robust and scalable data solutions using Azure technologies, including Azure Data Lake, Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks, and/or Azure Synapse Analytics. Collaborate with cross-functional teams and business teams to understand business requirements and translate them into technical designs and solutions. Build and maintain data pipelines, data integrations, and data transformations to enable efficient data processing, storage, and retrieval. Optimize data infrastructure and solutions for performance, scalability, and cost-efficiency, ensuring high availability and reliability. Implement security and compliance measures to protect sensitive data and ensure data privacy. Conduct data profiling, data validation, and data cleansing activities to ensure data integrity and accuracy. Stay up-to-date with the latest Azure data technologies, tools, and best practices, and provide recommendations for improvement and innovation. Mentor and provide technical guidance to junior data engineers, freshers/interns, fostering knowledge sharing and skills development within the team. Minimum Job Requirement: Extensive experience in designing, developing, and maintaining data solutions/pipelines in the Azure ecosystem, including Azure Data Lake, Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks, and/or Azure Synapse Analytics. Strong proficiency in programming languages such as Spark, Python, SQL for data manipulation, scripting, and automation. Solid understanding of data engineering principles, data modelling, data warehousing, and ETL/ELT processes which includes data testing, validation and reconciliation processes. Hands-on experience with data integration and data transformation frameworks, tools, and methodologies. Knowledge of data governance, data security, and data privacy practices. Experience with cloud-based data storage technologies, such as Azure Blob Storage and Azure Cosmos DB. Familiarity with Agile development methodologies and DevOps practices. Excellent problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related issues. Strong communication and collaboration skills, with the ability to effectively work in cross-functional teams. Good to have: Knowledge in streaming technologies, pipelines and frameworks like Kafka, EventHub, Azure Stream Analytics. Know-how on NoSQL databases like Cosmos DB, CouchDB, MongoDB etc Familiarity with machine learning/MLOps and advanced analytics techniques. Knowledge of data visualization tools, such as Power BI or Tableau. Experience with version control systems, CI/CD pipelines, and automated testing frameworks.