AI Model Evaluation Specialist

Remote
Contract
Posted September 5, 2025
open

Required Skills

Machine LearningPythonStatistical AnalysisModel EvaluationAI Ethics

Tags

AIEvaluationRemoteContract

Job Description

We are seeking an expert to evaluate and improve our AI models through comprehensive testing and analysis. You will be responsible for designing evaluation frameworks, conducting model assessments, and providing actionable insights for model improvement.

Key Responsibilities:
• Design and implement evaluation metrics for AI models
• Conduct thorough testing of model performance across different scenarios
• Analyze model outputs for bias, fairness, and accuracy
• Collaborate with ML engineers to implement improvements
• Document findings and recommendations

Ideal Candidate:
• PhD or Masters in Computer Science, ML, or related field
• 5+ years experience in AI/ML model evaluation
• Strong background in statistical analysis
• Experience with evaluation frameworks and metrics
• Excellent communication skills

Apply for This Role

Ready to contribute your expertise to this project?

You'll be guided through our expert onboarding process

Details

Domain:AI/ML
Work Type:Contract
Location:Remote
Location Requirements:
🌍 Global - All countries welcome
Posted:September 5, 2025

Similar Opportunities

Legal Document Analysis for AI Training

We need legal experts to help train our AI systems for legal document analysis. This role involves reviewing, categorizing, and annotating legal documents to create training data for our legal AI platform. Responsibilities: • Review and categorize legal documents • Identify key legal concepts and entities • Annotate contracts and legal texts • Ensure accuracy and legal compliance • Provide feedback on AI model outputs Qualifications: • JD from accredited law school • 3+ years practicing law • Experience with contract review • Understanding of legal AI applications • Strong analytical skills

Financial Risk Assessment AI Trainer

Help us build the next generation of financial risk assessment AI. You will work with financial data to train and validate AI models for risk prediction and analysis. Key Tasks: • Analyze financial datasets for risk patterns • Label and categorize financial transactions • Validate AI model predictions • Identify edge cases and anomalies • Contribute to model improvement strategies Requirements: • CFA, FRM, or similar financial qualification • 5+ years in financial risk management • Experience with quantitative analysis • Knowledge of regulatory requirements • Strong analytical and communication skills

Computer Vision Annotation Expert

We are looking for computer vision experts to help annotate images and videos for training advanced AI models. This role involves working with diverse visual content to create high-quality training datasets. Responsibilities: • Annotate images and videos with bounding boxes, segmentation masks • Quality control for annotation accuracy • Develop annotation guidelines and standards • Train junior annotators • Collaborate with ML engineers on data requirements Qualifications: • MS/PhD in Computer Vision or related field • Experience with annotation tools (CVAT, Labelbox, etc.) • Strong understanding of object detection and segmentation • Python programming skills • Attention to detail and quality