Principal Data Engineer Job in Tvs Motors

who we are

At TVS Motors. we like help people meet their mobility needs with our products. We offer our products (sports bikes, scooters, utility mopeds etc.) to users across India as well as 60+ countries in Asia, Africa and

Latin America.

We are a community of Data Scientists, Machine Learning Researchers and Data Engineers, working to drive TVS Motors research in machine learning & deep learning solutions. We work as embedded

developers amongst digital product teams through a range of applications like

Customer enquiry & sales management App, promotional offer personalisation

content personalisation TVSM Native Website and microsites

End-customer App for connected vehicles (telematics unit, bluetooth connectivity), content & promotional offer personalisation

Spares & accessories e-commerce, catalog personalisation

We are looking for a Principal Big Data Engineer with development & deployment experience of data capture, curation and consumption pipelines on Azure.

what will you learn and do

Provide subject matter expertise and hands on delivery of data capture, curation and consumption pipelines on Azure.

Build cloud data solutions and provide domain perspective on storage, big data platform services, serverless architectures, vendor products, RDBMS, DW/DM, NoSQL databases and security.

Participate in deep architectural discussions to build confidence and ensure customer success when building new solutions and migrating existing data applications on the Azure platform.

Conduct full technical discovery, identifying pain points, business and technical requirements, as is and to be scenarios.

who you are

Overall 10+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL and data warehouse solutions.

5+ years of hands on experience in programming languages such as python, pyspark, spark, SQL, Unix Shell/ etc.

3+ years of hands-on experience in Azure and Big Data technologies such as PowerShell, Python, SQL, ADLS/Blob, Spark/SparkSQL and streaming technologies such as Kafka, EventHub, NiFI etc.

Experience with implementing data migration and data processing using Azure services: Networking, Windows/Linux virtual machines, Container, Storage, ELB, Autoscaling, Azure Functions, Serverless

Architecture, ARM Templates, Azure SQL DB/DW, Data Factory, Azure Stream Analytics, Azure Analysis Service, Databricks Azure Data Catalog.

Cloud migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc.

Bachelors Degree in Computer Science, Engineering, or Information Technology related areas.

your qualifications

Cumulative 5+ years with sales, marketing and digital data warehouse.

At least One Large scale implementation projects using Azure Data Factory.

Experience in converting on-premise ETL scripts /Jobs to cloud Azure ETL

Proven ability to build, manage and foster a team-oriented environment.

Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing and curation: Kafka, Spark, Hive, etc.

We are committed to an inclusive and diverse company. TVS Motors is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation,

gender identity, age, disability, veteran status, genetic information, marital status or any other legally protected status.