Graphic Design Expert
Evaluates graphic design samples against objective quality criteria to help train AI models that assess visual content. Requires formal design training or 2–3 years of professional experience, strong design-principles knowledge, and consistent attention to detail during repetitive evaluation.
About the job
Responsibilities
- Review and rate graphic design elements in Label Studio Enterprise across:
- Typography quality, including readability, hierarchy, and font pairing
- Visual hierarchy, including clarity, balance, and focal-point strength
- Design-element execution, including icon quality, illustration polish, and image selection
- Color palette effectiveness, including harmony, contrast, and accessibility
- Layout and composition, including grid usage, spacing, and alignment
- Overall design effectiveness and professional polish
- Apply consistent 1–5 rating scales across hundreds of design examples.
- Provide clear, objective assessments based on established design principles.
- Follow detailed rating guidelines and rubrics.
- Process high volumes of design samples with sustained attention to detail.
- Participate in weekly calibration sessions.
- Meet quality benchmarks for rating consistency and inter-rater reliability.
- Flag edge cases and unclear examples and document them clearly.
Requirements
- Formal training in graphic design, visual arts, or a related field through a degree, certificate, or bootcamp, or 2–3 years of professional graphic design experience.
- Strong proficiency in composition, color theory, typography, and visual hierarchy.
- Ability to objectively critique and evaluate design work against industry standards.
- Experience reviewing design work or providing design feedback.
- Exceptional attention to detail and ability to maintain focus during repetitive tasks.
- Strong visual discrimination and consistent aesthetic judgment.
- Reliability and consistency in applying rating standards.
- Ability to work independently on repetitive tasks.
- Strong communication skills.
- Availability for a minimum of 10 hours per week for at least 3 months.
Nice-to-Haves
- Portfolio demonstrating diverse design work and a critical eye.
- Experience as a design reviewer, art director, or in quality assurance.
- Understanding of WCAG and inclusive design principles.
- Knowledge of branding, editorial, digital, or UX/UI design.
- Experience teaching or mentoring design concepts.
- Experience with Figma, Sketch, or other modern design tools.
- Prior data annotation, content moderation, or quality evaluation experience.
- Exposure to machine learning or computer vision concepts.
- Familiarity with design systems and component libraries.
- Previous remote work experience with self-directed tasks.
Compensation and Work Terms
- Remote, part-time contract.
- 15+ hours per week for 2 weeks, with a 30-hour minimum commitment.
- Duration of 2 weeks, with potential for ongoing work.
- Compensation: $3.13 per delivered milestone of 120 tasks ($6.25/hour equivalent).
Skills
Typography, Color Theory, Visual Hierarchy, Composition, Figma, Sketch, Wcag, Design Systems, Data Annotation, Content Moderation, Machine Learning, Computer Vision
Similar jobs
Brand Design jobs
Thyme Care
Remote
Creates multichannel marketing campaigns, digital experiences, presentations, and brand materials while maintaining and extending an established visual system. Requires 4+ years of professional design experience, strong visual craft, and proficiency in Figma and Adobe Creative Suite.
Hinge Health
Remote
Leads motion design strategy and hands-on execution across brand, product, marketing, and digital experiences. The role requires 8+ years of motion or related creative experience, advanced production skills, strong storytelling, and the ability to build scalable systems and mentor creative partners.
OpenLoop
Remote
Owns the creative function across multiple brands, designing and shipping performance-driven landing pages, funnels, and campaign creative. Requires 3+ years of design experience, strong Figma craft, hands-on Webflow or Framer skills, and a data-informed approach to conversion.
Circle
Remote
Leads Circle’s creative narrative and direction across launches, campaigns, advertising, video, events, and partnerships. The role requires exceptional storytelling, writing, creative judgment, visual fluency, and the ability to influence cross-functional teams without formal authority.