Senior Data Engineer/data Architect Job in Qwinix Technologies

Project Role Description :Define the data requirements and structure for the application. Model and design the application data structure, storage and integration

Work Experience :8-15 years
Must Have Skills :Cloud Data Architecture (GCP/ AWS)
Good To Have Skills : Exposure to Cloud Native AI/ML solutions, BI tools (Looker/ Tableau)

Responsibilities :

Design, development and deployment of highly-available and fault-tolerant enterprise business software at scale using GCP Ecosystem

Develop complex code using Dataflow, write complex sql queries in Bigquery, schedule end to end Composer/Airflow based pipeline

Actively participates in the cloud design, configuration, and implementation to meet program and customer needs

Provides recommendations on cloud infrastructure upgrades and supports project integration as required.

Technical Expertise -

Must have proven expertise designing and implementing highly complex and various cloud platforms not limited to GCP

Should have proven expertise on DataLake/ Data warehouse implementation

Working Knowledge of GCP Platform Technologies

Develops and implements policies and procedures to ensure consistent cloud environment provisioning, up-time, regulatory compliance and data protection

Hands on experience with Dataflow/Dataproc/DataFusion/Cloud Function. Strong implementation experience with Google BigQuery and architecting data pipelines Experience with Cloud Source Repositories

Sound implementation knowledge on Python or Java

Understanding on BQML, Cloud AI Platform, AutoML ( Nice to have, but not mandatory)

Working knowledge on BI tools (preferable Looker) will get preference