Quality Assurance (QA) Analyst – AI Data Annotation

About Expedock We are a tech-enabled workforce augmentation platform leveraging top 1% offshore talent & cutting edge technology to enable businesses to unlock their full potential

Role Overview The QA Analyst is responsible for ensuring the accuracy, consistency, and quality of annotated data across all workflows. This role plays a critical part in maintaining high-quality datasets used for training AI/ML models by auditing outputs, providing feedback, and driving continuous improvement among annotators.

Key Responsibilities

1. Quality Auditing

• Review annotated data (images, text, video, or audio) based on defined guidelines
• Perform random and targeted 25% sampling (initial)
• Identify errors, inconsistencies, and edge cases

2. Error Analysis & Reporting

• Categorize errors (e.g., labeling, bounding box accuracy, classification mistakes)
• Track QA metrics such as accuracy rate, defect rate, and rework volume
• Provide daily/weekly QA reports with actionable insights

3. Feedback & Coaching

• Deliver structured feedback to annotators
• Conduct calibration sessions to ensure alignment on guidelines
• Support Team Leads in coaching low-performing annotators

4. Guideline Adherence & Improvement

• Ensure strict compliance with annotation guidelines and client requirements
• Flag ambiguous cases and recommend guideline improvements
• Collaborate with Ops/Training teams to refine SOPs

5. Process Improvement

• Identify trends and recurring quality issues
• Recommend workflow enhancements to improve accuracy and efficiency
• Support pilot runs and new workflow validation

Key Metrics (KPIs)

• Annotation Accuracy (%)
• QA Pass Rate
• Error Rate / Defect Density
• Turnaround Time (TAT) for QA reviews
• Rework Reduction Rate

Qualifications

• Bachelor’s degree or equivalent experience
• 1–2 years experience in QA, data annotation, or BPO operations (preferred)
• Strong attention to detail and analytical skills
• Experience reviewing datasets (image, text, or video) is a plus
• Familiarity with annotation tools (e.g., CVAT, Labelbox, etc.) is an advantage

Tools & Systems (Nice to Have)

• Annotation platforms (CVAT, Labelbox, Supervisely)
• Google Sheets / Excel for tracking and reporting
• QA dashboards or internal tools

Candidate Data & Privacy Notice By submitting your application to Expedock, you acknowledge and consent to the collection, use, and processing of your personal information for recruitment and hiring purposes. Your information will be used to:

• Evaluate your qualifications and suitability for current and future roles
• Communicate with you throughout the recruitment process, improve our hiring processes, and overall candidate experience
• Maintain talent pools for future opportunities, where permitted by law

We handle candidate data with care and in accordance with applicable data protection and privacy regulations. Your information will only be accessed by authorized team members and will not be shared with third parties without your consent, unless required by law.