Senior Data Engineer

What You'll Be Doing

Technical Leadership

• Lead the architecture, design, and implementation of enterprise-scale data platforms from project inception through production deployment.
• Own technical delivery across multiple client engagements while ensuring high-quality engineering standards.
• Define solution architecture, technical roadmaps, and implementation strategies aligned with client business goals.
• Conduct architecture reviews, code reviews, and establish engineering best practices across project teams.
• Mentor and coach Data Engineers while fostering technical excellence and continuous learning.
• Serve as the primary technical leader for complex engineering initiatives and critical project decisions.

Client Partnership

• Partner directly with Fortune 500 clients to understand business requirements and translate them into scalable technical solutions.
• Lead discovery workshops, architecture sessions, and technical planning meetings with both business and engineering stakeholders.
• Present solution designs, delivery plans, and architectural recommendations to technical leadership and executive audiences.
• Build trusted relationships with client teams while providing technical guidance throughout project execution.
• Support pre-sales activities by contributing technical expertise, solution estimates, and implementation approaches when required.

Data Engineering & Platform Development

• Design, develop, and optimize enterprise-grade data pipelines using the Databricks Unified Analytics Platform.
• Build scalable ETL and ELT frameworks capable of processing large-scale structured and unstructured datasets.
• Design and implement Lakehouse architectures using Delta Lake and Medallion design patterns.
• Develop high-performance Spark applications for batch and real-time data processing.
• Integrate data from enterprise applications, APIs, streaming platforms, and cloud storage solutions.
• Ensure data quality, integrity, and reliability through automated validation, testing, and monitoring.

Cloud & DevOps

• Architect cloud-native data platforms across AWS, Azure, or Google Cloud Platform.
• Implement Infrastructure-as-Code using Terraform or similar technologies.
• Build and maintain CI/CD pipelines supporting automated testing and deployment.
• Optimize cloud infrastructure for scalability, reliability, security, and cost efficiency.
• Monitor platform performance and proactively resolve operational issues.

Data Governance & Security

• Implement enterprise data governance frameworks and security best practices.
• Configure Unity Catalog, metadata management, lineage, and role-based access controls.
• Ensure compliance with organizational security standards and regulatory requirements.
• Promote data observability and operational excellence across production environments.

Cross-Functional Collaboration

• Partner closely with Product Managers, Data Scientists, Analytics Engineers, Machine Learning Engineers, and Software Engineers to deliver high-impact data products.
• Enable AI and machine learning initiatives through scalable feature engineering pipelines and production-ready datasets.
• Contribute reusable frameworks, accelerators, and engineering standards that improve delivery across client engagements.

What You'll Bring

• Bachelor's or Master's degree in Computer Science, Data Engineering, Software Engineering, or a related technical discipline.
• 8+ years of experience designing and building enterprise-scale data platforms.
• 5+ years of hands-on experience with Databricks and Apache Spark.
• Proven experience leading enterprise data engineering projects from architecture through production delivery.
• Strong expertise in Python, SQL, and Spark for large-scale data processing.
• Deep understanding of Delta Lake, Lakehouse architecture, and modern data platform design.
• Experience working with AWS, Azure, or Google Cloud Platform.
• Strong knowledge of ETL/ELT frameworks, distributed computing, and data modeling.
• Experience implementing CI/CD pipelines and Infrastructure-as-Code.
• Strong understanding of data governance, security, metadata management, and data quality practices.
• Experience optimizing distributed data processing workloads for performance and cost.
• Excellent communication and stakeholder management skills with experience working directly with enterprise clients.
• Demonstrated ability to mentor engineers and lead technical initiatives.

Nice to Have

• Databricks Certified Professional Data Engineer certification.
• Experience with Delta Live Tables, MLflow, Unity Catalog, and Databricks SQL.
• Experience with Kafka, Kinesis, Event Hubs, or other streaming technologies.
• Hands-on experience with Snowflake, dbt, Airflow, or modern data orchestration tools.
• Experience with Kubernetes, Docker, and Terraform.
• Knowledge of AI/ML data platforms, Feature Stores, or Retrieval-Augmented Generation (RAG) architectures.
• Previous consulting or professional services experience delivering solutions for enterprise clients.
• Experience within retail, e-commerce, financial services, logistics, healthcare, or ad-tech environments.

Salary Range

$140,000 – $180,000 (CAD)