MTS Bank is one of the key directions of the MTS ecosystem. We use modern digital solutions and develop technological banking services accessible to everyone.

Our teams are improving products for B2B and B2C. They create websites using TypeScript + React + Next.js with SSR. And implement projects in a Kubernetes environment to ensure reliability for millions of MTS Bank customers.

Infrastructure Engineer. The main mission is to organize reliable deployment, monitoring, and resource optimization for training and inference of models, guaranteeing the uninterrupted operation of banking services.

Technology Stack: Docker, Linux, Kubernetes, Bash, GitLab CI, Ansible, Terraform, Airflow, Python, vllm, cuda, triton, Prometheus/Victoria Metrics, Grafana, SQL, Postgres, Elasticsearch, MLflow, Qdrant, Nexus, Vault

You will:

• deploy and integrate models, accompanying services and tools, automate delivery and optimize resource consumption
• monitor and maintain operability
• ensure compliance with information security policies and reliability standards when deploying ML solutions

What is important to us:

• confident Linux administration, understanding of network protocols and potential failure points
• experience in configuring and distributing graphics card capacities for training and inference of models
• experience in setting up infrastructure monitoring and model degradation metrics
• experience with vllm, Triton Inference Server, FastAPI, KServe or TorchServe
• experience in building complex multi-stage pipelines with a focus on security