Backend Software Engineer (Evals)
About the Team The Support Automation team at OpenAI scales the organization by applying cutting-edge AI models to real-world challenges, automating and enhancing work across the organization. From customer operations to engineering, we develop an ecosystem of automation products that empower our colleagues and drive i
What this role actually needs.
About the Team The Support Automation team at OpenAI scales the organization by applying cutting-edge AI models to real-world challenges, automating and enhancing work across the organization. From customer operations to engineering, we develop an ecosystem of automation products that empower our colleagues and drive i Responsibilities: - Design eval pipelines that are reliable, reproducible, and extendable - Build the infrastructure for continuous eval monitoring frameworks (regression/drift monitoring, building robust golden datasets) along with feedback loops that ultimately strengthen support automation - Design, build, and maintain backend services and APIs to support intelligent automation and knowledge systems - Integrate and structure data across internal platforms, transforming it into formats optimized for use by downstream systems and AI workflows. - Collaborate closely with data, research, and engineering teams to integrate OpenAI models into high-leverage workflows - Own the full development lifecycle of new backend systems and internal platform capabilities Company context: OpenAI builds frontier AI systems, research infrastructure, and applied products for developers, enterprises, and global users.
Day-to-day expectations
OpenAI lists these responsibilities for the Backend Software Engineer (Evals) role.
- Design eval pipelines that are reliable, reproducible, and extendable
- Build the infrastructure for continuous eval monitoring frameworks (regression/drift monitoring, building robust golden datasets) along with feedback loops that ultimately strengthen support automation
- Design, build, and maintain backend services and APIs to support intelligent automation and knowledge systems
- Integrate and structure data across internal platforms, transforming it into formats optimized for use by downstream systems and AI workflows.
- Collaborate closely with data, research, and engineering teams to integrate OpenAI models into high-leverage workflows
- Own the full development lifecycle of new backend systems and internal platform capabilities
Why this listing is more than a copied job post.
Backend Software Engineer (Evals) is framed against UpJobz source checks, country scope, compensation visibility, and work-authorization signals so candidates can make a faster go/no-go decision.
United States tech market
United States roles on UpJobz are filtered for high-tech relevance, source freshness, and actionable employer detail before they are allowed into SEO surfaces.
Compensation read
$230K - $385K is visible before the click, so candidates can compare the role against local market expectations before applying.
Work authorization read
Current extracted signal: United States residents. UpJobz treats this as a search signal, not legal advice, and links visa-sensitive roles back to the relevant visa hub where possible.
Location read
On-site roles in San Francisco should be compared against commute, local salary bands, and nearby employer demand.
Browse similar jobs
Turn this listing into an application plan.
This is the first pass at the premium UpJobz layer: a fast brief that helps serious applicants move with more clarity.
Next moves
- Tailor your resume around ai and llm instead of sending a generic application.
- Use the first two bullets of your application to connect your background directly to backend software engineer (evals) is a high-signal on-site role in san francisco, and it is most realistic for united states residents.
- Open the role quickly if it fits and bookmark three similar jobs before you leave the page.
Interview themes
Watchouts
- $230K - $385K is visible, so calibrate your application around the posted range.
- Use united states residents as part of your positioning so the recruiter does not have to infer it.
- Show concrete examples of succeeding in on-site environments.
Keywords to match against your background
Use these terms to decide whether your resume, portfolio, and recent projects line up with the role.
Apply through the employer source
Open the source listing from jobs.ashbyhq.com, confirm the role is still active, then apply on the employer or ATS page.
Source: jobs.ashbyhq.com · Source ID: 3d064454-c0c3-4225-bc2c-6d8c0f8735b2 · Confidence: 97/100 · Last checked: May 7, 2026
How UpJobz verifies job sourcesContinue browsing tech jobs