Search Engineer (AI Data Infrastructure, Series B)

A Series B infrastructure company that helps developers and AI agents convert web pages into usable data is growing its search group. Search is among its fastest-expanding products, and the company wants engineers who can keep the crawl, ranking and retrieval layers quick, dependable and inexpensive as volume increases. Responsibility for live systems begins immediately rather than after a ramp-up of small tickets.

Scope

• Build and run the engine powering the company’s search product, from web crawling and index construction through sharding, query serving, data freshness and response time
• Be accountable for result quality and relevance in retrieval used by LLM applications
• Drive down both latency and spend per query while traffic climbs
• Carry services from design to launch, then monitor and refine them in production
• Shape the roadmap alongside the search lead and teammates

Profile

• Three or more years building or running the indexing and serving tiers of a live search engine at meaningful scale
• Practical relevance experience layered on that engine: BM25, hybrid or vector search, plus RAG and re-ranking
• Ranking changes you released that shifted a production metric, with the figure to back it up
• Equal attention to speed, cost and correctness
• Backend fluency in Go, Rust or Python, and ease turning open-ended problems into running systems
• A preference for shipping, measuring and iterating over polishing plans on paper

On-site in the San Francisco Bay Area or Silicon Valley. Visa transfers considered; no new sponsorship petitions.