Data Engineer

Remote | 280 - 300 thousand RUB gross

✅Salary Range: 280,000 - 300,000 RUB gross💰

✅Employment: Full-time

✅Location and Citizenship: Russian Federation 📌

✅Registration: As an Individual Entrepreneur (IE/Sole Proprietor)

👋Hello! My name is Irina. I represent the group of companies Top Selection.

🔥We are currently looking for a Data Engineer🔥

🛠Requirements:

• At least 4 years of commercial development experience and at least 2 years of developing systems that have been put into production;

• At least 2 years of experience with BigData;

• Experience and knowledge of the stack: Python 3.5+, Spark 2.2+, Hadoop, Hive, Airflow, Kubernetes (K8S), SQLAlchemy, PostgreSQL, Greenplum, PyTest, Unittest, Flake8, PyLint, Black, Docker, Git, GitLab, CI/CD, Shell, Linux.

• Deep theoretical knowledge of the technology stack and practical experience;

• Ability to give and receive feedback;

• Experience working with business requirements (gathering, formulating requirements, analysis), experience working in an environment of constantly changing requirements;

• Experience writing distributed computing programs (Spark) and ETL processes;

• Experience conducting Code Review;

• Experience/understanding of database architecture development and design, creating and manipulating databases;

• Experience in query optimization;

• Understanding of CI/CD processes;

• Experience in query optimization;

• Experience writing unit tests.

📌Responsibilities:

• Development of low-level architecture for big data systems based on information received from analysts and architects;

• Development of a document describing the low-level architecture of the big data systems being developed;

• Development of source code for big data systems;

• Preparation of documentation describing the algorithms of the developed big data systems;

• Development of Unit Tests for the source code of big data systems;

• Preparation and building of installation packages for deploying the developed solutions to the production environment;

• Conducting scheduled work to optimize the source code of the developed big data systems;

• Fixing defects in developed applications;

• Preparation and release of update packages containing defect fixes and optimization of the source code of big data systems.