Data Engineer (azure Data Lake/spark/synapse/fabric) Job in Microsoft Corporation

Data Engineer (azure Data Lake/spark/synapse/fabric)

Apply Now
Job Summary
  • Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field - experience in business analytics, software development, data modeling or data engineering work.
  • OR equivalent experience.
  • 3+ years experience in utilizing a variety of data stores, including data warehouses, RDBMS and searchable document DBs.
  • Using profiling tools, debugging logs, performance metrics, and other data sources to make code- and application-level improvements.
  • Experience of incorporating data processing and workflow management tools into pipeline design.
  • Experience working with large data sets using SQL/Azure Data Lake/Spark, etc., to derive actionable insights.
  • Creating, managing, and optimizing data pipelines to support various workflows.
  • Developing and maintaining data pipelines and back-end services for real-time decision-making, reporting, optimization, and data collection.
  • Designing and implementing monitoring systems and dashboards to maintain the health and integrity of our data feeds and pipelines.
  • Collaborating with a diverse team of Technical Program Managers, Site Reliability Engineers, Data Scientists, and Engineers.
  • Developing for continuous integration and automated deployments.
Experience Required :

Minimum 3 Years

Vacancy :

2 - 4 Hires