[Remote] Generalist – Labeling and Preference Ranking

Note: The job is a remote job and is open to candidates in USA. Skillmorph is an internationally recognized HR consultancy firm that utilizes an Artificial Intelligence System to match candidates with potential roles. They are seeking detail-oriented generalists to evaluate and rank AI-generated model outputs across various domains, requiring nuanced judgment and independent work in a remote setup.

Responsibilities

• Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness.
• Assign preference rankings to pairs or sets of model outputs.
• Follow detailed labeling guidelines and adjust based on evolving criteria.
• Provide brief written explanations for ranking decisions when required.
• Flag edge cases or inconsistencies in task design or model output.

Skills

• Prior experience in data labeling, content moderation, or preference ranking tasks.
• Excellent critical thinking and reading comprehension skills.
• Comfort working with evolving guidelines and ambiguity.
• Strong attention to detail and consistency across repetitive tasks.
• Availability for regular part-time work on a weekly basis.
• A degree in Business, Accounting, Finance, Financial, Marketing, Economics, Actuarial, Management Information Systems, Risk Management, Accountancy, Industrial Engineering, Management, Applied Mathematics, Mathematics, Mathematical Statistics, Mathematics and Statistics, Quantitative Science or related field.
• Must be authorized to work in the US.

Company Overview

• Skill Morph focuses on what you can become. It was founded in 2023, and is headquartered in Lewisville, Texas, US, with a workforce of 11-50 employees. Its website is .