Backend Infrastructure Engineer, Anti-Bot (Web Data for AI)

A Series B startup that supplies web data to AI developers needs an infrastructure engineer for a very specific fight: keeping large-scale data extraction working on sites that deliberately try to stop it. Ownership of real production systems starts immediately, and the pace is intentionally fast.

Responsibilities

• Design and operate proxy rotation, IP and session handling, and isolated egress nodes at scale
• Maintain strong success rates on sites that push back with aggressive bot detection and scraping countermeasures
• Build and maintain browser and TLS fingerprint management plus infrastructure for solving challenges and CAPTCHAs
• Be accountable for proxy-tier cost, reliability and unit economics
• Hunt down intermittent failures that only appear under hostile conditions, anywhere in the system, and make fixes stick

Profile

• Three or more years of hands-on work in adversarial web-infrastructure, recent and as an individual contributor
• Personally built proxy systems, evasion tooling or extraction pipelines that beat defenses in production
• Go and/or Python, with solid networking fundamentals (TCP/IP, HTTP/2, connection pooling, proxy orchestration)
• Comfortable being fully accountable for a production service, including on-call
• A bias toward shipping, measuring and iterating
• Not a fit: general backend, SRE or platform backgrounds, or defensive bot-blocking work

Hybrid in the San Francisco Bay Area. Visa transfers considered.