Gcp Bigdata Architect Job in Knoldus Inc

Job Description

Responsibilities

• GCP data engineering professional with hands-on experience in GCP DataProc with Spark, Hive as core skills
• Hands-on experience in building data pipelines for PubSub to GCS & GCS to BigQuery
• Experience in migrating large scale data and workloads from on-prem to GCP :
• Code (HiveQL or Spark) On-prem To GCP (DataProc, BigQuery)
• Data (Teradata, Oracle, NoSQL, Data Lake, Data warehouse)
• On-prem To GCP (GCS, BigQuery)

Preferred Skills

• Good experience in building and maintaining data warehouses with BigQuery
• Experience in developing GCP Dataflow / Cloud Composer
• Understanding of Data Analytics tools such as BigQuery, Looker, Dataflow, Dataproc, Cloud composer, Cloud data fusion, Datacatalog, Google Marketing platform etc.
• Must have anyone Implementation and migration experience in Hadoop ecosystem such as Spark, Scala, Python, Hive, HDFS.
• Should be capable of doing basic programming on either Java or Scala .
• Good to have knowledge on Automation Runbooks
• Have in-depth knowledge in ETL/ELT Processing
• Good expertise in Data warehousing/Dimensional Modelling
• Should have experience in Agile projects with knowledge in Jira
• Must have handled Data Ingestion projects in GCP environment
• Prefer someone has knowledge on GitHub Integration and DevOps
• Ability to communicate efficient with customer s key Business and IT folks to present/defend architecture/design
• Familiar with tools such as Jira, Visio, etc.
• Familiar with CI/CD pipelines such as Jenkins
• Experience No SQL and Document databases
• Knowledge of microservices and API development.

About Company

Knoldus engineers digital systems with a product mindset to deliver an objective competitive advantage to the business. We modernize enterprises through cutting-edge digital engineering by leveraging Functional Programming (Scala, Rust, Java) and Fast Data (Spark, Flink) ecosystems.

Our mission is to provide reactive and streaming fast data solutions that are message-driven, elastic, resilient, and responsive to build High-Performance Systems. Knoldus is fortified by an expansive network of certified strategic partners like Lightbend (Scala ecosystem), IBM, Datastax(Cassandra and Graph ecosystem) , Confluent(Kafka ecosystem), and Databricks(Spark in the Big Data space); helps enterprise clients including many Fortune 500 companies to create the next-generation capabilities that set them apart and create new opportunities. With a team of 175+ seasoned experts,

Knoldus is headquartered in Canada with delivery centers in Chicago, New Delhi, Noida, and Singapore Some of our marquee clients include Google, HPE, EY, Elsevier, BoA, Cisco, VMWare, Huawei, Philips and quite a few silicon valley startups which have gone from being 2 people companies to 50 million dollars + companies Our process focus: Strongly Agile. Knoldus software development model called Knolway is based upon the best Agile practices built on the combination of Scrum and XP where concepts such as Domain Driven Design, Continuous Integration, Test Driven Development, and Pair Programming are used extensively.