Senior Data Engineer (AI / Databricks)

At CI&T, we help large companies transform AI potential into real business impact through AI implementation, AI-native development, and technologically integrated business solutions. With 30 years of experience in technological transformations, we accelerate innovation through expertise in Agentic SDLC, Application Modernization, Data & AI, MarTech, and Business Strategy. We are 8,000 CI&Ters in over 25 countries, collaborating to create solutions with real impact. AI is already part of how we work, grow, and innovate every day. Important: If you reside in the metropolitan region of Campinas, your presence in the city's offices will be mandatory according to the current attendance policy.

We are looking for a Senior Data Engineer to join our Client Data Transformation management team. This professional will play a key role in developing and maintaining data pipelines in the Azure environment using data engineering best practices.

Your Mission:

• Develop and maintain data pipelines/flows in Azure using Databricks.
• Implement automated pipelines for data ingestion, transformation, and delivery.
• Ensure data quality and governance throughout the entire cycle.
• Collaborate with multidisciplinary teams to evolve the data architecture.
• Process large volumes of client registration data.
• Monitor indicators and result quality.
• Automate processes and requests.
• Analyze data to identify problems and propose solutions.

Responsibilities and Authorities:

• Pipeline Development: Create and maintain data pipelines (ETL/ELT) in the Azure environment using Databricks for processing and integration.
• Deployment Automation: Implement CI/CD practices for automating deployments and code versioning in GitHub.
• Data Modeling: Design and optimize data models to ensure scalability, performance, and governance.
• Cloud Migration: Support cloud migration projects, ensuring data security, quality, and integrity.
• Team Collaboration: Work collaboratively with business and data science teams to deploy AI models in the cloud environment.
• Data Quality: Ensure data quality and consistency by applying data profiling and monitoring techniques.
• Documentation: Document processes, architectures, and data engineering best practices.

Requirements and Qualifications:

• Solid experience with Azure Data Services, Databricks, and PySpark.
• Proficiency in Python and SQL for data manipulation and transformation.
• Knowledge of CI/CD and version control using GitHub.
• Familiarity with ETL/ELT processes.
• Experience with data modeling (conceptual, logical, and physical).
• Experience with Microsoft Azure: ADF, Synapse, Data Lake Storage, and Spark.
• Familiarity with Git/GitHub and Azure DevOps for version control and deployment automation.
• Experience working on cloud migration and large-scale data integration projects.
• Experience deploying AI models and using tools like Azure ML is a plus.

Advantages:

• Experience with AI projects and pipeline automation.
• Knowledge of data-oriented architectures and governance best practices.
• Participation in MDM (Master Data Management) initiatives.
• Familiarity with Databricks MLflow for model management.
• Experience with Data Lake and Data Warehouse environments.

Our Benefits:

• Health and Dental Insurance;
• Food and Meal Vouchers;
• Childcare Allowance;
• Extended Parental Leave;
• Partnership with gyms and health and wellness professionals through Wellhub (Gympass) TotalPass;
• Profit and Results Sharing (PLR);
• Life Insurance;
• Continuous Learning Platform (CI&T University);
• Discount Club;
• Free online platform focused on strengthening physical, mental health, and well-being;
• Courses for pregnant women and responsible parenting;
• Partnership with online course platforms;
• Language learning platform;
• And many others

At CI&T, inclusivity starts from the first contact. If you are a person with a disability, it is important to provide your medical report (laudo) during the selection process. Click here to see what data should be in the report. This way, we can guarantee the support and adaptations you deserve. If you don't have the report yet, don't worry: we can help you get one.

We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups that will be with you every step of the way. Count on us to walk this path together.