Simple is looking for a Senior Data Engineer to join our Tech team. Push the pace of innovation and build a future of a healthier world with us!
Key Responsibilities:
- Design, build, and maintain streaming pipelines.
- Develop custom ingestion pipelines from third-party APIs, webhooks, and SDKs.
- Migrate existing data ingestion pipelines from SaaS tools to our own infrastructure.
- Deliver data to the raw layer of our Snowflake warehouse with schema consistency, idempotency, and resilience to malformed or late data.
- Evolve the existing AWS streaming stack (Kinesis, SQS, Lambda, API Gateway), improving cost efficiency, observability, and resilience.
- Maintain infrastructure as code (Terraform) for ingestion and processing resources.
- Monitor pipelines, troubleshoot, and resolve incidents.
- Contribute to our ongoing work on safe data access for AI agents and tooling.
- Continuously improve ingestion architecture, tooling, and engineering practices.
What we’re looking for:
- 5+ years of commercial Python experience in a backend or data engineering role.
- Solid understanding of distributed systems architecture, including load balancing, sharding, and trade-offs between synchronous and asynchronous processing.
- Hands-on experience with cloud services, preferably AWS (Lambda, API Gateway, containers in ECS/EKS).
- Experience building streaming pipelines (Kinesis, SQS, or equivalents).
- Experience with infrastructure as code (Terraform or equivalents).
- Working knowledge of SQL: ability to read and write queries, including joins and window functions.
- Commercial experience with real-world production data: ability to design systems that gracefully handle messy, duplicated, delayed, or malformed input.