Datenna is a fast-growing tech scale-up combining cutting-edge open-source intelligence (OSINT) and AI technologies to provide governments worldwide with critical insights into China’s techno-economic landscape. Our platform transforms OSINT into actionable insights on China’s Defense Industrial Base and broader technological ecosystem through advanced data processing and analysis.
The RoleWe\'re looking for a Senior Scraping Infrastructure Engineer to own the correctness, robustness and scalability of our data acquisition systems. You\'ll focus on utilizing the latest (AI) tools and techniques to ready our systems for the future and will build a new foundation which is designed for scalability and resilience, keeping our scrapers running at scale.
Your Mission at Datenna- Utilize the latest (AI) tools, frameworks and technologies to build a foundation which is ready for the future
- Design and maintain proxy infrastructure with intelligent rotation strategies
- Ensure proper behavior of scrapers and monitor conformance to established guidelines
- Collaborate with scraper developers to validate that infrastructure solutions meet their requirements
- Instrument systems for observability — tracking success rates, failure rates and cost efficiency
- Document operational playbooks
- 5+ years of experience in web scraping
- Hands-on experience with browser automation (Playwright, Puppeteer, or similar)
- Strong knowledge of proxies and rotation strategies
- Proficiency reading Python code; strong proficiency writing Python or Go code
- Experience with Linux systems administration and networking fundamentals
- Experience with building distributed systems and algorithms
- Pragmatic engineering mindset — you optimize for what works, not what\'s elegant
- Knowledge of Scrapy, Selenium Grid or other (distributed) scraping frameworks
- Experience with containerization (Docker, Kubernetes)
- Familiarity with cloud platforms (Azure preferred) and bare-metal deployments
- Understanding of cost management for proxy and compute spend
Please know that applicants may be subject to a screening process.
AI at DatennaAI is part of how we build. We use AI tools extensively to move faster and raise quality, and we focus our human attention on the work where judgment, creativity, and responsibility matter most. We expect every candidate to be comfortable using AI in their day-to-day work in a responsible manner and to continuously look for better ways to apply it.
Benefits & Opportunities- Work on globally impactful projects in geopolitical intelligence
- Lead innovation in OSINT and AI technologies
- Competitive compensation and benefits
- Dynamic, international team environment
- Significant growth opportunities in a scale-up
When you apply to this position, we will process your personal data according to our Recruitment Privacy Notice.
#J-18808-Ljbffr