Senior Software Engineer (Agentic Search) - Web Access Engineer
Key Skills
Job Description
About Tavily
We're building the infrastructure layer for agentic web interaction at scale. Our API is designed from the ground up to power Retrieval-Augmented Generation (RAG) and real-time reasoning in AI systems. By connecting LLMs to high-quality, trustworthy web content, we help developers build agents that are not only intelligent — but also informed.
We work with some of the most innovative teams in AI — from small startups shaping the ecosystem to the largest enterprises deploying AI at scale. Whether it's powering sales assistants, research copilots, or internal knowledge tools, we're the missing link between LLMs and the real world.
The Role
We are looking for a Senior Software Engineer to build the web access infrastructure behind a novel search engine designed for agentic AI.
In this role, you will investigate how modern websites communicate with browsers and translate that understanding into production systems operating at internet scale. You will build browser infrastructure and tooling that enables reliable, efficient access to web content across a rapidly changing web.
Your responsibilities will include:
- Research and analyse how modern websites communicate with browsers across the complete request lifecycle
- Investigate browser fingerprinting, client verification mechanisms, and modern web technologies to enable reliable web access
- Build tooling for browser instrumentation, debugging, observability, and large-scale experimentation
- Translate technical research into production systems operating at internet scale
Requirements
You have 5+ years of experience as a software engineer working on production backend or infrastructure systems, and are an expert in several of the following areas:
Browser Technologies
- Chromium architecture and browser internals
- Browser lifecycle and navigation
- Chrome DevTools Protocol (CDP)
- Playwright, Puppeteer, Selenium, or similar browser automation frameworks
- Browser instrumentation and debugging
Web Platform
- HTTP/1.1, HTTP/2, HTTP/3 — TLS, DNS, and browser networking
- Cookies, browser storage, caching, redirects, and session management
- JavaScript execution and modern client-side rendering
- Resource loading, page lifecycle, and browser networking
- Browser fingerprinting concepts and browser characteristics
Nice to Have
- Experience working on browser engines or browser infrastructure
- Experience reverse engineering browser or web application behaviour
- Experience building internet-scale distributed systems
- Go, C++, Rust, or Python
- Kubernetes and cloud infrastructure
We conduct coding interviews as part of the process.
Why Tavily?
- Full ownership — small team, you own the entire infrastructure, not a slice of it
- Real scaling challenges — bursty scraping workloads, cache invalidation, multi-region, millions of daily requests
- AI-native company — your infra directly powers AI agents used by leading companies in the space.
Core Responsibilities
You will build and maintain the web access infrastructure for an agentic search engine, focusing on how websites communicate with browsers. This involves developing tooling for browser instrumentation, debugging, and large-scale experimentation to ensure reliable web content access.
Requirements
Candidates must have 5+ years of experience in backend or infrastructure systems with deep expertise in browser technologies and web platform internals. Proficiency in browser automation frameworks and networking protocols is essential for this role.
About Tavily
Industry: Technology, Information and Internet
Company size: 51-200 employees
With Tavily, your agents can search, extract, and reason with real-time web data through a single API. Our mission is to onboard the next billion AI agents to the web while delivering high-quality, fresh, and structured web context. Agents need to stay grounded as they scale from prototypes to production. That's why real-time web data across research, enrichment, conversational AI, and the products you ship is important. If you're looking for research agents that don't miss, hallucinate, or fall behind, try Tavily. A few of the ways different teams use Tavily include: - Prepping sales meetings with auto-generated account briefs (Sales & GTM) - Researching candidates and executives using live web profiles, while flagging reputational risks (Recruiting) - Tracking competitor positioning, release notes, and industry benchmarks using live reports, docs, and marketing materials (Product) - Researching investments across current news, filings and analyst commentary with citations you can trust (Finance) - Staying ahead of legal and regulatory changes by monitoring official government and regulator sites (Legal) - Monitoring supply chain disruptions across news, trade publications and regulatory feeds to keep procurement one step ahead (Risk) - Monitoring cybersecurity threats and vulnerabilities using live advisories, CVE feeds, vendor blogs and security forums on the web (Security) - Enhancing underwriting and claims decisions by enriching entities (policyholders, businesses, locations) with external data like financial health, legal history, and exposure indicators (Monitoring) - Tracking destination trends, events, and local sentiment by aggregating travel blogs, news, and social content to inform pricing, marketing, and planning (Events) Those are just a few examples. What do you want to build? Give it a try on Tavily.