Senior Data Engineer/data Architect Job in Qwinix Technologies
Senior Data Engineer/data Architect
- Mysore, Karnataka
- Not Disclosed
- Full-time
- Permanent
Project Role Description :Define the data requirements and structure for the application. Model and design the application data structure, storage and integration
Work Experience :8-15 years
Must Have Skills :Cloud Data Architecture (GCP/ AWS)
Good To Have Skills : Exposure to Cloud Native AI/ML solutions, BI tools (Looker/ Tableau)
Responsibilities :
Design, development and deployment of highly-available and fault-tolerant enterprise business software at scale using GCP Ecosystem
Develop complex code using Dataflow, write complex sql queries in Bigquery, schedule end to end Composer/Airflow based pipeline
Actively participates in the cloud design, configuration, and implementation to meet program and customer needs
Provides recommendations on cloud infrastructure upgrades and supports project integration as required.
Technical Expertise -
Must have proven expertise designing and implementing highly complex and various cloud platforms not limited to GCP
Should have proven expertise on DataLake/ Data warehouse implementation
Working Knowledge of GCP Platform Technologies
Develops and implements policies and procedures to ensure consistent cloud environment provisioning, up-time, regulatory compliance and data protection
Hands on experience with Dataflow/Dataproc/DataFusion/Cloud Function. Strong implementation experience with Google BigQuery and architecting data pipelines Experience with Cloud Source Repositories
Sound implementation knowledge on Python or Java
Understanding on BQML, Cloud AI Platform, AutoML ( Nice to have, but not mandatory)
Working knowledge on BI tools (preferable Looker) will get preference
8 to 15 Years
2 - 4 Hires