Open expert roles.

Job Description

Bring senior defense expertise to AI evaluation projects focused on defense systems, requirements, logistics, and operational constraints. Review model responses and worked examples for incorrect system assumptions, missing operational constraints, and unsupported analytic confidence. Assess whether the reasoning meets professional standards for the stated task. Write reference answers and scoring criteria grounded in defense systems, requirements, logistics, and operational constraints. Explain consequential errors, evidence gaps, and the reasoning behind your corrections. This is remote, project-based contract work. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.

Why Apply

• Expert-level compensationEarn $170 - $220/hr for work that values your professional judgment.
• Flexible remote workContribute asynchronously around your existing professional commitments.
• Meaningful model impactHelp advanced AI systems reason more accurately in aerospace, defense & security.
• Focused projectsAccept only the opportunities that fit your experience and availability.

Responsibilities

• Evaluate advanced domain tasks and AI-generated responses for factual accuracy and professional judgment.
• Apply current standards, methods, and risk considerations from aerospace, defense & security.
• Document errors, edge cases, and the reasoning behind an ideal response.
• Collaborate asynchronously with Alpheva's research and evaluation teams.

Required Qualifications

• 7+ years of substantive experience in defense program or systems engineering.
• Demonstrated senior-level judgment in defense systems, requirements, logistics, and operational constraints, with substantial responsibility for reviewing or delivering this work.
• Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.
• Use only public or project-authorized material; do not submit classified or restricted information.

Company Description

Alpheva AI builds the expert data, evaluations, and real-world environments that help frontier AI systems become more capable and reliable. We partner with experienced professionals whose judgment can teach models how high-quality work is actually done.