Judge jobs in san francisco USA
112 judge jobs found in san francisco: showing 51 - 100
Korean Linguistic Qa - Fully Remote
Company: Mercor |
, relevance, and response timing. Evaluate the assistant's use of spatial and directional language. Judge the appropriatenessLocation: San Francisco, CA, USA
| Salary: US$24 - 30 per hour | Date posted: 27 Aug 2026
Developer Relations
Company: Arango |
evaluation harnesses in real-world scenarios and have informed opinions about LLM-as-judge approaches. Experience as an earlyLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 27 Aug 2026
Principal Research Scientist - Evaluations
Company: Canva |
and downstream product outcomes, quantifying judge bias, and catching benchmark saturation and contamination before they quietly stop...-training (RLHF, RLAIF) and inference-time selection, and being explicit about where a good judge does not translate into a goodLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 27 Aug 2026
Senior Litigation Paralegal - Hybrid
Company: Chelsea Search Group |
. Assisting with calendaring case deadlines/comfortable with researching Local Rules, Rules of Civil Procedure and JudgeLocation: San Francisco, CA, USA
| Salary: US$160000 - 180000 per year | Date posted: 27 Aug 2026
Principal Research Scientist - Evaluations
Company: Canva |
metrics against human preference and downstream product outcomes, quantifying judge bias, and catching benchmark saturation... about where a good judge does not translate into a good reward model. Vision-Language Models for quality understanding. NovelLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 26 Aug 2026
Court Reporter (500c)
Company: unknown |
by a judge or commissioner; continuous contact with judicial officers, attorneys, litigants, other staff and the general publicLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 26 Aug 2026
Paid Growth Marketing Expert
Company: Mercor |
reference answers and criteria distinguishing strong responses from plausible-but-wrong ones. Review and judge AI agentLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 25 Aug 2026
Diagnostic Imaging Expert - Visage 7
Company: Mercor |
to the record, impacting downstream readers. Judge study completeness: ensure interpretability, availability of the correctLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 25 Aug 2026
Korean Ai Session Reviewer
Company: Mercor |
, relevance, and response timing. Evaluate the assistant's use of spatial and directional language. Judge the appropriatenessLocation: San Francisco, CA, USA
| Salary: US$24 - 30 per hour | Date posted: 25 Aug 2026
Content Marketing Expert - Ai Environments
Company: Mercor |
. Review AI agent attempts and judge them against your standards. Evaluate AI-generated content to improve model outputsLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 25 Aug 2026
Frontend Code Evaluation Specialist
Company: Mercor |
a reference page and two candidate replications at 19201080. Judge which is the closer reproduction, state by state. Diff visualLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 25 Aug 2026
Marketing Analytics Expert - Ai Environments
Company: Mercor |
. Review AI agent attempts and judge them against established standards. Evaluate AI-generated content in Marketing AnalyticsLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 25 Aug 2026
Brand Marketing Expert - Strategist
Company: Mercor |
. Review AI agent attempts. Judge them against your standards. Evaluate AI capabilities in diagnosing data, prioritizingLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 25 Aug 2026
Senior Product Marketing Manager
Company: Workstream |
, a channel) and you bias hard toward action; former founders welcome! Commercially minded: you judge your own work by pipelineLocation: San Francisco, CA, USA
| Salary: US$140000 per year | Date posted: 24 Aug 2026
Business Operations Expert - Evaluator
Company: Mercor |
. Currently or recently practicing to judge work as a working professional would. Ability to write a clear, specific, evidenceLocation: San Francisco, CA, USA
| Salary: US$60 - 80 per hour | Date posted: 23 Aug 2026
Biotech Investment Analyst - Specialist
Company: Mercor |
, competitive position, and value drivers. Judge the quality of an investment-style thesis and flag weak, overconfident, or missingLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 23 Aug 2026
Accounting Expert - Financial Reporting
Company: Mercor |
attempts at realistic accounting tasks and judge whether each conclusion is correct and adequately supported. Confirm work... or overstated work, including invented support and unsupported figures. Judge completeness and ensure the right method is appliedLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 23 Aug 2026
Clinical Expert - Drug Evaluation
Company: Mercor |
commercial drugs and drug-development programs. Interpret clinical trial endpoints and judge whether results would changeLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 23 Aug 2026
Pro Tem Court Reporter (501c)
Company: unknown |
be performed at various locations throughout the County to report proceedings as directed by and presided over by a judgeLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 22 Aug 2026
Product Manager
Company: Loft Orbital |
of your time with engineering: understanding architectures, constraints, and dependencies well enough to judgeLocation: San Francisco, CA, USA
| Salary: US$160000 - 190000 per year | Date posted: 20 Aug 2026
Pharma Analyst - Fully Remote
Company: Mercor |
, competitive position, and value drivers. Judge the quality of an investment-style thesis and flag weak, overconfident, or missingLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 20 Aug 2026
Senior Engineer, Backend & Ai Systems
Company: Varite |
infrastructure by defining what "good looks like for our AI systems, build LLM-as-judge pipelines, and drive quality improvementsLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 20 Aug 2026
Part- Time Customer Service Agent - Sfo Airport
Company: PrimeFlight Aviation Services |
and right while eyes are fixed on a given point); depth perception (three-dimensional vision, ability to judge distancesLocation: San Francisco, CA, USA
| Salary: US$22.51 per hour | Date posted: 20 Aug 2026
Sales Development Representative Manager
Company: AppsFlyer |
, set the qualification and disqualification logic, and review what the agents produce before it reaches a prospect. JudgeLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 20 Aug 2026
Senior Engineer, Backend & Ai Systems
Company: Software Guidance & Assistance |
the eval infrastructure by defining what "good looks like for our AI systems, build LLM-as-judge pipelines, and driveLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 19 Aug 2026
Market Access Expert - Gross-to-net
Company: Mercor |
by drug class. Judge whether coverage, rebating, and tiering assumptions reflect how payers actually behaveLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 18 Aug 2026
Frontend Code Evaluation Specialist - Ai Trainer
Company: Mercor |
a reference page and two candidate replications at 19201080. Judge which is the closer reproduction, state by state. Diff visualLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 18 Aug 2026
Enterprise Sales Expert - Ai Projects
Company: Mercor |
Review multi-step enterprise sales workflows. Judge if the AI handles them as a strong seller would. Flag discrepanciesLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 18 Aug 2026
Red Team Specialist - Cyber
Company: OpenAI |
and use that expertise to judge whether a model's behavior meaningfully changes attacker capability. Alternatively, you mayLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 18 Aug 2026
Epidemiologist - Drug Development Expert
Company: Mercor |
, incidence, and treatment pathways. Judge the soundness and sourcing of patient-population estimates, flagging overLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 18 Aug 2026
Research Engineer – Benchmarking
Company: Mercor |
and evaluation decisions; balance rigor with scalability (human vs. model-as-judge, calibration, agreement). Data qualityLocation: San Francisco, CA, USA
| Salary: US$15000 per year | Date posted: 18 Aug 2026
Senior Operations Analyst, User Safety & Risk Operations
Company: OpenAI |
. You will typically own a small number of high-impact problems at a time and will be expected to judge what needs to be built, what canLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 18 Aug 2026
Ml/ai Engineer, Applied Ai
Company: Recruiting From Scratch |
and online evaluation Build LLM-as-judge and human review workflows to measure model performance Design and improve multi-step... Experience with golden datasets, regression testing, LLM-as-judge, or human review workflows Experience with agent or toolLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 18 Aug 2026
Ml/ai Engineer, Applied Ai
Company: Recruiting From Scratch |
and online evaluation Build LLM-as-judge and human review workflows to measure model performance Design and improve multi-step... Experience with golden datasets, regression testing, LLM-as-judge, or human review workflows Experience with agent or toolLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 17 Aug 2026
Frontend Code Evaluator - Expert - Ai Trainer
Company: Mercor |
Responsibilities Render a reference page and two candidate replications side by side at desktop width. Judge which is the closerLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 15 Aug 2026
Security Review Expert - Soc 2
Company: Mercor |
capturing how an experienced security reviewer would judge a request or renewal. Assess data-handling and sub-processor riskLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 15 Aug 2026
Pharmacy Expert - Lexidrug Specialist
Company: Mercor |
, stale patient data, and monograph guidance superseded by newer Special Alerts. Judge completeness of the clinical pictureLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 15 Aug 2026
Sales Domain Specialist - Fully Remote
Company: Mercor |
Review multi-step enterprise sales workflows. Judge AI handling against strong seller standards. Flag discrepanciesLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 13 Aug 2026
Vendor Risk Specialist - Fully Remote
Company: Mercor |
capturing how an experienced security reviewer would judge a request or renewal. Assess data-handling and sub-processor riskLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 13 Aug 2026
Enterprise Sales Expert - Ai Lab
Company: Mercor |
Review multi-step enterprise sales workflows. Judge AI handling against strong seller standards. Flag discrepanciesLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 13 Aug 2026
Bankruptcy Attorney - Remote
Company: YO AI Labs |
with a bankruptcy or federal judge, is highly preferred. Experience teaching law, serving as an adjunct faculty member, guest lecturerLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 11 Aug 2026
Epidemiologist - Drug Development Expert
Company: Mercor |
and incidence. Judge the soundness and sourcing of patient-population estimates, flagging over- or under-counting. Apply expertiseLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 11 Aug 2026
Biostatistics Epidemiologist - Fully Remote
Company: Mercor |
and incidence. Judge the soundness and sourcing of patient-population estimates, flagging over- or under-counting. Apply expertiseLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 11 Aug 2026
Procurement Expert - Vendor Management
Company: Mercor |
-level rubrics and golden responses that capture how an experienced procurement lead would judge a request or renewal. AuditLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 11 Aug 2026
Market Access Expert - Biotech
Company: Mercor |
by drug class. Judge whether coverage, rebating, and tiering assumptions reflect how payers actually behave. Apply expertiseLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 11 Aug 2026
Therapeutic Clinician - Fully Remote
Company: Mercor |
-development programs. Interpret clinical trial endpoints and judge whether results would change prescribing. Assess implicationsLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 11 Aug 2026
Pharmacy Expert - Lexidrug Specialist
Company: Mercor |
, stale patient data, and monograph guidance superseded by newer Special Alerts. Judge completeness of the clinical pictureLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 11 Aug 2026
Bankruptcy Attorney - Remote
Company: YO AI Labs |
with a bankruptcy or federal judge, is highly preferred. Experience teaching law, serving as an adjunct faculty member, guest lecturerLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 11 Aug 2026
Payer Strategy Specialist - Fully Remote
Company: Mercor |
by drug class. Judge whether coverage, rebating, and tiering assumptions reflect how payers actually behave. Apply expertiseLocation: San Francisco, CA, USA
| Salary: unspecified | Date posted: 11 Aug 2026
Pharma Forecasting Expert - Launch Curves
Company: Mercor |
-development programs. Build or critique a launch curve, including uptake, peak share, and trajectory. Judge the defensibility