BI Data Engineer Intern at IT company "Lotsia". Work with ETL processes, DBT, Dagster, Postgres, Clickhouse, and BI reports in Apache Superset.
Responsibilities:
- Building ETL processes: developing and configuring pipelines for collecting and transforming data from various sources
- Working with a modern transformation stack: mastering and applying DBT to transform "raw" data into clean analytical marts
- Data orchestration: configuring and maintaining workflows (pipelines) in Dagster to ensure data in reports is updated on time and without failures
- Managing data warehouses: working with Postgres and the high-performance columnar database Clickhouse to ensure fast report performance
- Visualizing insights: developing interactive BI reports in Apache Superset that will help the business make data-driven decisions
- Optimizing queries: analyzing and accelerating heavy queries to improve the performance of the entire reporting system
Requirements:
- SQL: confident command of the language (complex queries, aggregate functions, understanding query optimization principles)
- Databases: understanding the structure of relational databases (in particular, PostgreSQL) and the general principles of building analytical data warehouses
- Python: basic knowledge of the language, ability to write scripts for data processing and automation of simple tasks
- Analytical mindset: ability to work with large datasets, identify patterns, and structure information
- Will be a plus: BI tools: experience in creating dashboards in Apache Superset, Tableau, Power BI, or similar systems
- Will be a plus: ETL/ELT: understanding the concepts of data extraction, transformation, and loading
- Will be a plus: data architecture: understanding the difference between OLTP and OLAP systems (e.g., why Clickhouse is used for analytics)
- Will be a plus: modern stack: interest in DBT (Data Build Tool) tools or data orchestrators (Airflow, Dagster)
Conditions:
- Work format: remote work is possible
Skills:
- SQL
- PostgreSQL
- Python
- DBT
- Dagster
- Clickhouse
- Apache Superset
- ETL
- ELT
- OLTP
- OLAP
- Airflow
- Tableau
- Power BI
