In-Demand Judge Jobs | SimplyHired

AI Evaluator - Healthcare - Fully Remote (Australia)
Grayde.ai —Remote
- $30 - $40 an hour
- Remote
- Nursing
- Medicine
- Doctoral degree
Quick Apply
2d
GAZ - APS 5 - QLD - Associate to a Judge - FCFCOA
Federal Court of Australia —Brisbane QLD
- $88,834 - $96,829 a year
- Full-time
- Management
- Microsoft Office
- AI
4d
IT Support Trainee - ES 1-2
Victorian Government —Macedon VIC
- Full-time
- Management
- Senior Secondary Certificate of Education
- Organisational skills
4d
Account Verification and Fraud Specialist
Up —Melbourne VIC
- $72,000 - $82,000 a year
- Hybrid work
- Financial services
- AI
- Employee assistance program
9d
Residential Cleaner
It's About Time Cleaning —Bacchus Marsh VIC
- $33 an hour
- Cleaning
- In-person
- Travel reimbursement
Quick Apply
6d
Associate to the Honourable Associate Justice Goulden, Associate Judges' Chambers, Supreme Court of Victoria
Victorian Government —Melbourne VIC
- $81,496 - $90,227 a year
- Full-time
- Communication skills
3d
Associate to Judicial Registrar Roberts
Victorian Government —Melbourne VIC
- $81,496 - $90,227 a year
- Full-time
- Writing skills
- Communication skills
5d
Associate to a Judicial Officer of the County Court of Victoria (Criminal, Common, Commercial)
Victorian Government —Melbourne VIC
- $81,496 - $90,227 a year
- Full-time
- Writing skills
- Analysis skills
- Associate degree
4d
Broker Analyst
Nixil —Eight Mile Plains QLD
- Full-time
- Management
- Sales
- Communication skills
2d
Senior Staff Software Engineer (AI Team)
splose —Adelaide SA
- Full-time
- Hybrid work
- Master's degree
- Databases
- AWS
Quick Apply
2026 Investment Banking Case Competition - Australia
JPMorganChase —Sydney NSW
- Full-time
- Bachelor's degree
2d
Associate to the Honourable Associate Justice Goulden, Associate Judges' Chambers, Supreme Court of Victoria
Court Services Victoria —Melbourne City Centre VIC
- Full-time
- Communication skills
3d
Engineering Tradesperson - Air-conditioning and Refrigeration Mechanic
Queensland Government —New Townsville City QLD
- Call employer
- Annual leave
13d
GAZ - APS 4 - NSW - Legal Associate - FCFCOA
Federal Court of Australia —Newcastle NSW
- $79,125 - $86,246 a year
- Full-time
- Research
- Organisational skills
- Computer skills
7d
Engineering Tradesperson - Mechanical (Fitter and Turner)
Queensland Government —New Townsville City QLD
- Call employer
- Annual leave
13d
Head of Engineering AI & Data
REA Group —Richmond VIC
- Full-time
- Hybrid work
- Master's degree
- AWS
- Financial services
- Parental leave
Electrician
PHE —Brisbane QLD
- Full-time
- CPR Certification
- Electrical experience
9d
Women's Artistic Gymnastics Coach (Intermediate & Higher Levels)
Sunshine Coast Gymnastics Academy —Sunshine Coast QLD
- $35 - $41 an hour
- CPR Certification
- First Aid Certification
- Organisational skills
Quick Apply
Power Systems Engineer
PHE —Fortitude Valley QLD
- Full-time
- AutoCAD
- In-person
Security Consultant
BAE Systems —Canberra ACT
- Communication skills

I want to receive the latest job alert for judge

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

AI Evaluator - Healthcare - Fully Remote (Australia)

Grayde.ai
Remote

Quick Apply

Job Details

Freelance
$30 - $40 an hour
2 days ago

Qualifications

Nursing
Medicine
Clinical research
Doctoral degree
Data analysis skills
Master's degree
Databases
Pharmacy
AI

Full Job Description

About Grayde

Grayde.ai is a specialised healthcare and life science AI data and evaluation company. We work with the best clinicians and life science researchers to make medical AI models better.

Overview

Rank pairs of AI-generated drug information responses as RLHF preference data, judging clinical accuracy, completeness, and appropriate sourcing against a scoring rubric.

About this job

We're seeking medical information/drug information specialists to produce preference-ranking data for RLHF by comparing AI-generated responses to HCP and patient drug queries, covering dosing, interactions, contraindications, and off-label use questions. You will judge which responses are most accurate, complete, and appropriately sourced, ranking them according to a defined rubric.

You will use authoritative drug information resources and clinical databases such as DrugBank, Micromedex, Lexicomp, FDA drug labeling, and PubMed to validate AI-generated responses and support evidence-based ranking decisions.

Your rankings will train the model's reward signal, so consistency and clear rationale matter as much as the final ranking.

What you'll do

1. Rank multiple AI-generated drug information responses by quality to produce RLHF preference pairs.

2. Verify dosing, interaction, and contraindication accuracy.

3. Assess whether responses appropriately cite evidence or labelling.

4. Use drug information databases such as DrugBank, Micromedex, Lexicomp, and FDA labelling to validate medication information.

5. Check handling of off-label and unapproved-use questions.

6. Flag responses that could mislead a prescriber or patient.

7. Apply a structured rubric consistently across ranking batches.

8. Write comparative rationale explaining each preference judgment.

Who can apply

Degree: MBBS / MBChB (Primary medical), MD (Doctor of Medicine), BPharm / MPharm, PharmD, MN / MSN (Nursing)

Field of study: Pharmacology, Toxicology, Pharmacy (General), Pharmaceutical Sciences, Clinical Pharmacy, Pharmacovigilance

Pay: $30.00 – $40.00 per hour

Work Location: Remote

Quick Apply

Refine Your Search

judge jobs

AI Evaluator - Healthcare - Fully Remote (Australia)

GAZ - APS 5 - QLD - Associate to a Judge - FCFCOA

IT Support Trainee - ES 1-2

Account Verification and Fraud Specialist

Residential Cleaner

Associate to the Honourable Associate Justice Goulden, Associate Judges' Chambers, Supreme Court of Victoria

Associate to Judicial Registrar Roberts

Associate to a Judicial Officer of the County Court of Victoria (Criminal, Common, Commercial)

Broker Analyst

Senior Staff Software Engineer (AI Team)

2026 Investment Banking Case Competition - Australia

Associate to the Honourable Associate Justice Goulden, Associate Judges' Chambers, Supreme Court of Victoria

Engineering Tradesperson - Air-conditioning and Refrigeration Mechanic

GAZ - APS 4 - NSW - Legal Associate - FCFCOA

Engineering Tradesperson - Mechanical (Fitter and Turner)

Head of Engineering AI & Data

Electrician

Women's Artistic Gymnastics Coach (Intermediate & Higher Levels)

Power Systems Engineer

Security Consultant

I want to receive the latest job alert for judge

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected