Lead Data Engineer

Expired on: Apr 5, 2024
Job Category: Engineering
Job Experience: 7+ Years
Job Type: Full Time
Job Location: Work From Anywhere
Apply Now

GrowExx is looking for a smart and passionate Lead Data Engineer, who will design and fill a bespoke data warehousing environment for our company.

Key Responsibilities:

  • Design architecture for data activation inclusive of an API gateway that can be consumed by client applications.  
  • Develop and maintain scalable pipelines that deploy data out to product applications, website data Layers, and digital advertising platforms (Salesforce, Google, Facebook, etc.).  
  • Develop and deploy scalable new features.  
  • Identify and fix bugs to resolve data quality issues in a timely manner.  
  • Develop, maintain, update Tableau reporting views and data sources.  
  • Implement a data monitoring framework that ensures production tables are always accurate.  
  • Take data science/machine learning model prototypes and prepare them for production deployments.  
  • Improve real-time data availability on an as-needed basis for activation use-cases. 
  • Build pipelines that ingest digital advertising data on an as-needed basis.  
  • Document all pipelines and maintain a data catalogue. 

Key Skills:

  • Experience in data modelling, ETL development, and data warehousing.  
  • Expert SQL skills querying and transforming large datasets in Snowflake.  
  • Expert python programming skills. 
  • Experience in ETL Tools like Airflow, Glue, Spark, Flink etc.  
  • Experience with Cloud Platforms like Azure/GCP/AWS.  
  • Experience with Adobe Experience Cloud, Salesforce, Facebook, Google, Bing developer APIs.  
  • Experience with Software development lifecycle and using tools such as Airflow and GitHub.  
  • Experience with real-time event stream data.  
  • Experience with solving complex problems with multi-layered data sets.  
  • Experience with data structures, algorithm design, and complexity analysis is preferred.  
  • Experience with optimizing machine learning libraries and frameworks is preferred.  
  • Experience with developing an API Gateway is preferred 

Education and Experience:

  • B Tech or B. E. (Computer Science / Information Technology)
  • 7+ years as an ETL Developer or similar roles
  • Must have experience in team leading 

Analytical and Personal skills:

  • Must have sound logical reasoning and analytical skills
  • Good communication skills in English – both written and verbal
  • Demonstrate Ownership and Accountability of their work
  • Attention to details
Sorry! This job has expired.