Job Summary
- Role: Evaluate search engine results for relevance, helpfulness, and quality. You’ll review queries, rate web pages/content using detailed guidelines (true/false questions, “Needs Met” ratings, Page Quality, etc.), and provide feedback that helps train and improve AI/search systems.
- Requirements: Strong English skills (native or fluent), good judgment, attention to detail. No prior technical experience needed — full guidelines and training are provided.
- Schedule: Fully remote, flexible — set your own hours. Minimum 10 hours/week, up to 29 hours/week (hours can vary based on project demand).
- Employment: W2 Part-Time Employee (US-based only). Paid every 2 weeks. Project length: 12 months (possible extension).
- Benefits (after eligibility): Medical, Dental, Vision, HSA, 401(k), Paid Sick Time, Employee Assistance Program, and other voluntary insurances.
- Hiring Locations: Specific US states only — Alabama, Florida, Georgia, Indiana, Kansas, Kentucky, Missouri, Montana, New Hampshire, North Carolina, Ohio, Oklahoma, Pennsylvania, South Carolina, Tennessee, Texas, Utah, Virginia, West Virginia, Wisconsin. (You must live in one of these states.)
- Age: 18+
Pay (Realistic Expectation)
Most reliable reports indicate around $15 per hour for US English Search Quality Rater roles. It’s not extremely high-paying, but it works well as a side hustle for extra income with full flexibility.
Pros
- Truly remote and flexible (work when you want).
- Meaningful work — directly helps improve AI/search quality.
- W2 employment with some benefits (rare for this type of gig).
- No interview for many applicants (assessment-based).
- Legitimate company (Welocalize has been operating for decades and works with major tech clients).
Cons (Common Feedback)
- Work volume is inconsistent — some weeks you may get plenty of tasks, other weeks very few (yet you still need to meet the minimum hours when work is available).
- The initial qualification exam/assessment is quite difficult for many people (covers Page Quality, Needs Met, user intent, etc.). A lot of applicants fail it.
- Pay is modest compared to some other remote gigs.
- Hours can fluctuate based on project needs.
Is Welo Data / Welocalize Legitimate?
Yes, it is a real company (Welo Data is the AI/data services arm of Welocalize). They have been providing Search Quality Rater and similar AI training roles for years.
However:
- There are many scam impersonators on social media, WhatsApp, Telegram, etc. who pretend to be from Welo Data/Welocalize. They may ask for money, fees, or personal details.
- Never pay any money to get the job. The real company will never ask for payment for equipment, training, or “portal fees.”
- Official applications only come through their verified career site (jobs.lever.co/welocalize) or official @welocalize.com / @welodata.ai emails.
How to Apply Safely
- Go to the official careers page: https://jobs.lever.co/welocalize
- Search for “Search Quality Rater – English (United States)” or similar current posting.
- Apply directly there (avoid links from random social media posts).
- Prepare for a qualification exam after applying (YouTube has helpful guide videos for Welocalize/Welo Data Search Quality Rater exam — search for “Needs Met” and “Page Quality” examples).
Better Alternatives (if this doesn’t suit you)
Similar roles are also offered by:
- TELUS International AI (formerly Lionbridge) – Personalized Internet Assessor
- Appen
- Others like RaterLabs or DataAnnotation (for different AI tasks)
These have their own pros/cons regarding consistency and pay.
Would you like:
- Tips on how to prepare for the qualification exam?
- Resume/cover note suggestions for this type of role?
- Comparison with TELUS or Appen rater jobs?
- Or help checking if you’re in one of the eligible states?
Just let me know your situation (which state you’re in, English level, how many hours you can commit, etc.) and I can give more personalized advice. Good luck!

