Join us
We are a global integration partner, capable of steering complex programmes, orchestrating the entire software vendor ecosystem, and mobilising the expertise needed to deploy robust, scalable critical platforms ready for future transformation requirements
Discover
Lead Data Engineer Azure Databricks
Casablanca
  • Participate in the technical scoping of the project and the analysis of data sources.
  • Perform Data Mapping between Apollo data in the Silver layer and existing commercial data in the Platinum layer.
  • Design transformation and data joining rules.
  • Develop transformation pipelines using Databricks / Microsoft Fabric.
  • Develop the PySpark and SQL scripts required to create the Platinum Merchandising tables.
  • Cross-reference Apollo spatio-temporal data with sales, stock, and markdown facts.
  • Implement the data models required for Merchandising analysis.
  • Ensure the quality, consistency, and reliability of the produced data.
  • Participate in technical testing and the validation of transformations.
  • Collaborate with the Business Analyst and Power BI Data Analyst to ensure alignment between produced data and decision-making needs.
  • Contribute to technical documentation and knowledge transfer.


  • Profile

  • Over 5 years of experience in Data Engineering.
  • Proficiency in Azure Databricks.
  • Proficiency in PySpark and SQL.
  • Experience with Microsoft Fabric.
  • Strong understanding of Data Lake / Lakehouse architectures and data layers.
  • Experience in complex decision-making modeling.
  • Proficiency in spatio-temporal data joins and transformations.
  • Experience in building data pipelines and analytical tables.
  • Good understanding of data quality, performance, and reliability challenges.
  • Experience in Retail / FMCG is an asset.


  • Apply
    Back
    Moving forward together

    Are you looking for a partner capable of steering your integration projects? We are ready to support you

    Speak with our experts