- Career Center Home
- Search Jobs
- Principal AI Engineer
Results
Job Details
Explore Location
Salesforce
San Francisco, California, United States
(on-site)
Posted
14 hours ago
Salesforce
San Francisco, California, United States
(on-site)
Job Type
Full-Time
Principal AI Engineer
The insights provided are generated by AI and may contain inaccuracies. Please independently verify any critical information before relying on it.
Principal AI Engineer
The insights provided are generated by AI and may contain inaccuracies. Please independently verify any critical information before relying on it.
Description
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job Category
Software Engineering
Job Details
About Salesforce
Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all.
Ready to level-up your career at the company leading workforce transformation in the agentic era? You're in the right place! Agentforce is the future of AI, and you are the future of Salesforce.
We are seeking a highly skilled AI Platform Engineer to play a pivotal role in building the next generation of our ML/AI platform that doesn't just support ML models, but powers autonomous AI agents at enterprise scale. This role sits at the intersection of platform infrastructure and agent systems engineering. You'll build and maintain the core infrastructure, CI/CD pipelines, and platform services that underpin our machine learning initiatives and go further in designing the harnesses, sandboxes, and evaluation frameworks that let AI agents be developed, tested, and trusted in production.
You'll work on systems that directly impact marketing, sales, service, and product growth verticals across the organization.
This isn't a traditional infrastructure role. You should be comfortable wearing multiple hats of software engineering, agent systems design, and evaluation tooling. We're looking for engineers who think in flywheels: build →evaluate → improve → ship → repeat.
What You'll Do
Agent Harness & Flywheel Engineering
- Design and build agent harness infrastructure: the scaffolding that wraps LLM calls, manages tool use, handles retries, enforces policy, and feeds results back into iterative improvement loops.
- Implement agentic loop patterns with multi-turn reasoning, tool orchestration, memory management, and structured output handling as reusable platform primitives
- Build the agent flywheel: automated pipelines that collect agent traces, surface regressions, route failures to evaluation, and close the loop from production signal back to prompt/model improvement
- Own the end-to-end lifecycle from agent experiment to production deployment, including versioning, rollout controls, and rollback mechanisms
Sandboxing & Safe Execution
- Build sandboxed execution environments for agent tools with isolating code execution, API calls, and file system access so agents can act without unconstrained blast radius
- Design tiered autonomy models: define which actions agents can take automatically, which require human approval, and which are off-limits and enforced at the infrastructure layer
- Implement replay and dry-run capabilities so new agent versions can be tested against real traces before going live
Agent Evaluation, Observability & Optimization
- Implement evaluation frameworks for agent behavior using a combination of vendor , open source or in house built tools - covering task success, tool selection accuracy, trajectory evaluation, hallucination rates, latency, and cost
- Build and maintain eval datasets, golden trace libraries, and regression test suites that run automatically on every agent code change
- Instrument agent traces end-to-end: LLM calls, tool invocations, intermediate reasoning, final outputs - surfaced in Grafana or equivalent observability tooling
- Define and track agent quality metrics over time; own the signal that tells the team whether agents are getting better or worse
- Drive continuous quality, latency, and cost improvements across deployed agents by closing the loop between production traces, evaluations, and agent design. Optimization may be done through a variety of techniques e.g. prompt tuning, tool calling optimizations, context engineering, right-sizing model selection per task and explore distillation or fine-tuning (SFT, DPO, RLHF) on curated trace data to name a few
- Validate every optimization through A/B tests, shadow deployments, and replay against golden traces, with the eval suite gating rollout so wins are real and regressions are caught before they reach users
CI/CD & Workflow Automation
- Build and optimize CI/CD pipelines (GitHub Actions, ArgoCD) that cover not just code deployment but agent evaluation gates - no agent ships without passing its eval suite
- Automate Docker and package builds, security scanning, and agent integration tests as first-class pipeline steps
- Design self-healing CI patterns where agent-based automation can diagnose and fix common pipeline failures
Tooling, Developer Experience & Architecture
- Build internal tools and developer self-service interfaces that let ML engineers and data scientists iterate on agents without platform team involvement
- Maintain a comprehensive view of how all platform components -> infrastructure, agent harnesses, evaluation pipelines, observability - work together
- Create architecture diagrams and drive long-term platform vision; own the "how does this scale to 10x" conversation
Monitoring, Security & Reliability
- Establish alerting (Grafana, PagerDuty) for both traditional platform health and agent-specific signals (error rates, tool call failures, eval score drift)
- Ensure all agent infrastructure adheres to security best practices: sandboxed execution, auditable traces, access controls on every tool
- Participate in security reviews; own compliance for agent workloads
What We're Looking For
- 9+ years as a Platform Engineer, ML Infrastructure Engineer, or Software Engineer
- Demonstrated experience building agent harness infrastructure using agentic loops, tool orchestration, structured output handling, multi-turn conversation management
- Hands-on experience with agent evaluation frameworks like Braintrust, LangSmith, or equivalent , including building eval datasets, running automated regression suites, and tracking quality metrics over time
- Strong understanding of sandboxing and safe agent execution like isolation patterns, tiered autonomy, blast radius controls
- Experience with context Engineering as it relates to Agent orchestration.
- Strong Python engineering skills for building scalable tools, automation, and platform components
- Deep expertise in AWS
- Extensive experience with CI/CD tooling, especially GitHub Actions and ArgoCD
- Proficiency in infrastructure-as-code (Terraform)
- Experience with containerization (Docker) and orchestration (Kubernetes)
- Experience with AgentOps concepts and production Multi Agent systems
- Strong problem-solving skills and ability to manage multiple priorities across a complex platform
- Preferred Qualifications (Bonus Points):
- Experience with Salesforce Ecosystem including Agentforce and Data360
- Experience with unstructured databases(vector or graph databases) and RAG pipelines
- Experience working with modern data platforms and real-time processing frameworks, including cloud data warehouses (e.g., snowflake), streaming technologies (e.g. kafka, flink)
Unleash Your Potential
When you join Salesforce, you'll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best , and our AI agents accelerate your impact so you can do your best . Together, we'll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future - but to redefine what's possible - for yourself, for AI, and the world.
Accommodations
If you need a reasonable accommodation during the application or the recruiting process, please submit a request via this Accommodations Request Form .
Please note that Salesforce uses artificial intelligence (AI) tools to help our recruiters assess and evaluate candidates' resumes and qualifications throughout the recruiting process. Humans will always make any candidate selection and hiring decisions. Please see our Candidate Privacy Statement for more information about how we use your personal data and your rights, including with regard to use of AI tools and opt out options.
Posting Statement
Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that's inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications - without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.
In the United States, compensation offered will be determined by factors such as location, job level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, and benefits. Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com.Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records.
At Salesforce, we believe in equitable compensation practices that reflect the dynamic nature of labor markets across various regions. The typical base salary range for this position is $172,500 - $313,700 annually. In select cities within the San Francisco and New York City metropolitan area, the base salary range for this role is $207,800 - $334,700 annually. The range represents base salary only, and does not include company bonus, incentive for sales roles, equity or benefits, as applicable.
Requisition #: JR344074
pca3lyuhf
Job ID: 84452449
In a difficult market, the most inspiring and promising careers can be found in the few companies that are still leading, not following. Like salesforce.com: the enterprise cloud computing company.
View Full Profile
More Jobs from Salesforce
Senior Director - Portfolio Product Strategy & AI Alignment
San Francisco, California, United States
14 hours ago
Director, Agentic Workforce Modeling & Capacity Planning
Chicago, Illinois, United States
14 hours ago
Lead Engineer - AI Trust & Governance
San Francisco, California, United States
14 hours ago
Jobs You May Like
Median Salary
Net Salary per month
$7,294
Cost of Living Index
95/100
95
Median Apartment Rent in City Center
(1-3 Bedroom)
$3,556
-
$6,030
$4,793
Safety Index
39/100
39
Utilities
Basic
(Electricity, heating, cooling, water, garbage for 915 sq ft apartment)
$130
-
$416
$215
High-Speed Internet
$45
-
$105
$74
Transportation
Gasoline
(1 gallon)
$5.07
Taxi Ride
(1 mile)
$3.27
Data is collected and updated regularly using reputable sources, including corporate websites and governmental reporting institutions.
Loading...

