Sr. Data Architect Job in Valiance Analytics Pvt Ltd

Job Description

Overall, 6 years plus experience with minimum 2 years designing and architecting data pipelines for ingestion and transformation of structured & unstructured data sources. Deep understanding of various cloud platforms including AWS & GCP for constructing data pipelines and storage using cloud native services. Understanding of database and analytical technologies in the industry including NoSQL databases, Data Warehouse , BI reporting and Dashboard development. Should be able to understand customer requirements, define and plan project scope with resource requirements and timeline. Customer facing skills to represent Valiance well within the customer s environment and drive discussions with senior personnel regarding trade-offs, best practices, project management and risk mitigation. Should be able to propose and recommend technology architecture, choice of technology platforms based on different workloads, cost constraints and client requirements. Coach and mentor engineers to raise the technical ability of the rest of the team, and/or to become certified in required GCP technical certifications. Become a thought leader in data engineering for Valiance; representing the company in different technology events, support in pre-sales activities, build and grow data engineering practice.

Experience & Skillset Required

Python, SQL, Airflow, NIFI, PySpark, Hadoop, Hive, HDFS Cloud Platforms: GCP, AWS. Certifications: CGP Professional Data Engineer Hands-on knowledge of GCP managed services e.g., Big query + Data proc + Dataflow + pub/sub + Looker+ Cloud composer + Data prep + Data fusion + Cloud SQL