Company: QLAN is a technology integrator that implements end-to-end AI solutions into the business processes of large companies and the public sector.
Tasks:
- Write custom parsers for social networks, media hosting, and marketplaces
- Implement services in Python
- Develop and maintain data collection services
Requirements:
- 3+ years of experience in developing and supporting high-load parsers/scrapers;
- Python 3+ years;
- understanding of different proxy server types (proxy rotation, quality monitoring), CAPTCHA principles;
- working with rate limiting;
- Playwright;
- AsyncIO, aiohttp/httpx
- experience in reverse engineering internal APIs of web and mobile applications
- experience with databases (PostgreSQL / ClickHouse / Redis)
- excellent understanding of HTTP/TCP, CDN operation, REST API, GraphQL, anti-bot systems, and methods of bypassing them;
Will be a plus:
- Experience in developing parsers for platforms: Instagram, YouTube, Tik Tok, Trip Advisor, Spotify, X, Flickr, LinkedIn, Reddit, and similar
- Experience with Grafana/Prometheus
Kubernetes;
- Kafka/RabbitMQ;
We offer:
- Project-based employment with a flexible work format
- Direct communication with technical management without bureaucracy
- Opportunity to grow into a full-fledged technical role within the company
Contacts:
recruiter contact