inhousefyi
← Back to listings

Data Annotation Reviewer (QA) — Egocentric Video

WorkstreamRemote · Posted 1 month ago
Full-timeRemote
Apply now

Description

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this market has been heavily underserved by technology and deserves better. Workstream has been purpose-built for the hourly workforce from day one so that these businesses and their employees can thrive.

Our customers include leading brands from multiple sectors, including Burger King, Carl's Jr./Hardee's, IHOP, KFC, and Culvers. We are a high growth series B company and quickly expanding our product portfolio to deliver on our vision. We are backed by legendary VCs and industry experts like Founders Fund, BOND, and Coatue.

Grow With Us

We produce high-quality training data for a leading AI/robotics client building a large-scale egocentric (first-person) video dataset. Our pipeline auto-generates annotations at scale; your job is to review the segments flagged as potentially inaccurate, judge them against the client's guidelines, and correct or reject them so only clean data is delivered.

This is precision quality-assurance work under a strict standard — audited batches must pass at a high accuracy threshold, and low-scoring batches are rejected outright. Your judgment directly affects whether our deliveries get accepted.

Day In The Life

You will review:

  • Language annotations — check that written descriptions and action labels accurately, clearly, and consistently describe what's happening in each video, following detailed labeling guidelines.
  • Action segmentation & timing — verify that videos are broken into correctly timed, non-overlapping action segments.
  • Hand-pose tracking — sanity-check machine-generated hand and motion tracking, flagging errors and implausible results.
  • Compliance — flag privacy issues (e.g. faces or personal information) and any content that doesn't meet collection quality or content standards.

Quality standards

  • Contribute to a high, continuously audited accuracy target — consistency matters as much as speed, since weak batches can be rejected as a whole.
  • Maintain alignment with other reviewers on shared calibration sets.
  • Meet the throughput target

Who You Are

  • At least one year experience as a Data Annotation Reviewer
  • Excellent written and reading English comprehension — you must accurately apply detailed, nuanced guidelines. This is the single most important requirement.
  • Sharp attention to detail and the stamina for focused, cognitively demanding review.
  • Consistent, well-reasoned judgment on ambiguous, edge-case segments.
  • Reliable high-speed internet and a device capable of smooth video playback.
  • Comfort in a remote, target-driven environment with regular calibration checks.

Nice to have

  • Prior data annotation, labeling, QA, or content-review experience.
  • Familiarity with video annotation / labeling tools.
  • Exposure to computer vision, robotics, or hand/gesture tracking concepts.

Know More About Workstream

Additional Information

Workstream provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

We are committed to the full inclusion of all qualified individuals.

Similar jobs

WorkstreamRemote

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-timeRemote
WorkstreamMetro Manila, Philippines

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamLehi, Utah, United States

Est. 124,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamRemote

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-timeRemote
WorkstreamRemote

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-timeRemote
WorkstreamRemote

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-timeRemote
WorkstreamMenlo Park, California, United States

Est. 135,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamLehi, Utah, United States

Est. 140,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
Product Manager3 months ago
WorkstreamSan Francisco, California, United States

Est. 160,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamLehi, Utah, United States

Est. 62,500 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamLehi, Utah, United States

Est. 120,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamSan Francisco, California, United States

Est. 175,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamSan Francisco, California, United States

Est. 155,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamLehi, Utah, United States

Est. 175,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamLehi, Utah, United States

Est. 155,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamLehi, Utah, United States

Est. 120,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamSan Francisco, California, United States

Est. 142,500 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamMenlo Park, California, United States

Est. 142,500 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamMenlo Park, California, United States

Est. 85,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamSan Francisco, California, United States

Est. 225,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamLehi, Utah, United States

Est. 130,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamRemote

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-timeRemote
WorkstreamLehi, Utah, United States

Est. 70,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamSan Francisco, California, United States

Est. 135,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
WorkstreamSan Francisco, California, United States

Est. 140,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time
Account Executive9 months ago
WorkstreamLehi, Utah, United States

Est. 125,000 USD

Workstream is a mission-driven company building the all-in-one HR, payroll, and hiring platform for managing the hourly workforce. There are 2.7 billion hourly workers, making up 80% of the global workforce, but this mar…

Full-time

Queue Manager / Annotation Lead with Trust & Safety Background (AI Data Ops) Start date: Immediate / TBC End Date: TBC Location: Remote Type of contract: Freelance Languages required: English Hourly Rate: Include the…

Full-timeRemote
InstaworkBengaluru, Karnataka, India

Instawork is on a mission to create meaningful economic opportunities for skilled hourly professionals in communities around the globe. Our AI-powered labor marketplace helps local businesses scale, and enables global te…

Full-time
Software EngineerMay 27, 2025
JustworksNew York, New York, United States

Est. 150,000 USD

Who We Are At Justworks, you’ll enjoy a welcoming and casual environment, great benefits, wellness program offerings, company retreats, and the ability to interact with and learn from leaders in the startup community. We…

Full-time
InstaworkBengaluru, Karnataka, India

Instawork is on a mission to create meaningful economic opportunities for skilled hourly professionals in communities around the globe. Our AI-powered labor marketplace helps local businesses scale, and enables global te…

Full-time