Writing.io Jobs

Find the best remote jobs. Answer a few questions and we'll deploy a powerful assistant to help you search, create alerts, and more.

1 What roles are you open to?

2 Experience level

3 Work style

Did you know? If memory is enabled, Writing.io can remember your job search preferences and help you to improve your resume, craft customized outreach and more.

Trainer German - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback and ratings to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

German AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of German speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $20.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in German, as spoken in Germany.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Japanese - AI Product Evaluator at Productive Playhouse

Evaluates and tests AI chatbots through structured conversations and voice interactions in Japanese to improve model quality and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Japanese AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Japanese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $24.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Japanese, as spoken in Japan.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Indonesian - AI Product Evaluator at Productive Playhouse

Test and evaluate AI chatbots through structured conversations and provide ratings/feedback to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Indonesian - AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Indonesian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $10.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Indonesian, as spoken in Indonesia.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Spanish (Latin America) - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback and ratings to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Spanish - AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Spanish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $14.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Spanish, as spoken in Latin America
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Hindi - AI Product Evaluator at Productive Playhouse

Evaluates and tests AI chatbots through structured interactions in Hindi, providing feedback to improve model responses and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Hindi AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Hindi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $8.00 USD per hour

100% remote

  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Hindi, as spoken in India.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Korean - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured conversations and voice interactions in Korean, providing feedback to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Korean AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Korean speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $20.00 USD per hour

100% remote

  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Korean, as spoken in South Korea.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer German - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback and ratings to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

German AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of German speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $20.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in German, as spoken in Germany.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Japanese - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured conversations and voice interactions, providing feedback to improve model quality and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Japanese AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Japanese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $24.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Japanese, as spoken in Japan.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Indonesian - AI Product Evaluator at Productive Playhouse

Evaluates and tests AI chatbots through structured interactions, providing feedback and ratings to improve model quality and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Indonesian - AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Indonesian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $10.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Indonesian, as spoken in Indonesia.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Spanish (Latin America) - AI Product Evaluator at Productive Playhouse

Test and evaluate AI chatbots through structured conversations and voice interactions, providing ratings and feedback to improve model quality.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Spanish - AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Spanish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $14.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Spanish, as spoken in Latin America
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Hindi - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured conversations and interactions to provide feedback that improves model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Hindi AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Hindi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $8.00 USD per hour

100% remote

  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Hindi, as spoken in India.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Korean - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback and ratings to improve model quality and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Korean AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Korean speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $20.00 USD per hour

100% remote

  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Korean, as spoken in South Korea.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer German - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured conversations and voice interactions, providing feedback to improve model quality and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

German AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of German speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $20.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in German, as spoken in Germany.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Japanese - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions in Japanese, providing feedback and ratings to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Japanese AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Japanese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $24.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Japanese, as spoken in Japan.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Indonesian - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured conversations and interactions to assess model capabilities, safety, and helpfulness.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Indonesian - AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Indonesian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $10.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Indonesian, as spoken in Indonesia.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Spanish (Latin America) - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback to improve model responses and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Spanish - AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Spanish speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $14.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Spanish, as spoken in Latin America
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Hindi - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions in Hindi, providing feedback to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Hindi AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Hindi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $8.00 USD per hour

100% remote

  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Hindi, as spoken in India.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Korean - AI Product Evaluator at Productive Playhouse

Evaluates and tests AI chatbots through structured interactions, providing feedback and ratings to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Korean AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Korean speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models.

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $20.00 USD per hour

100% remote

  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Korean, as spoken in South Korea.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact [email protected].

Read the full description
Trainer Polish AI Product Tester at Productive Playhouse

Test and provide feedback on AI-powered notification management features on Google Pixel devices by using apps naturally and completing daily sorting tasks.

Junior Remote Posted 2 days ago RemoteFirstJobs Product
What this role involves

Polish AI Product Tester

No Google Pixel device? No problem at all! We will happily lend and ship the required phone directly to your home for the duration of the project.

Active Project Status: This project is now live, and we are urgently onboarding participants to begin immediately. Because we are moving quickly, we kindly ask that you keep a close eye on your communication (email and messages) after applying. It is essential that you respond promptly so we can get you cleared and ready to start without delay.

Location: 100% Remote, located in the U.S.

Device: Applicants must use a qualifying Google Pixel device for the duration of the project

Compensation: USD $250.00 upon successful completion of the 14 qualified submissions.(each submission should take 10–15 minutes of activity per day)

Please note: To ensure eligibility for this project, applicants must be located in the U.S.

Project Requirements

  • Native or expert-level fluency in Polish spoken in Poland (ISO: pl-PL)
  • Must be comfortable using a Google Pixel 9 or newer device
  • Must be comfortable downloading and using common mobile applications that generate notifications (messaging apps, email apps, social media apps, etc.)
  • Must be comfortable using the Google Pixel device as their primary phone for the duration of the project
  • Must be willing to participate daily for 14-21 consecutive days
  • Must be 18 or older to meet project eligibility requirements
  • Must have access to reliable Wi-Fi/internet
  • Participants must be able to read and understand instructions and company communications in English

The Project

We are seeking detail-oriented and motivated speakers to participate in an upcoming notification sorting project.

Participants will use a Google Pixel 9 or newer device throughout the project period while interacting naturally with apps that generate notifications. Participants will complete daily project tasks involving notification organization/sorting workflows and provide related feedback/documentation as instructed.

Participants will also complete a short daily feedback/check-in form throughout the duration of the pilot to assist with participation tracking and troubleshooting support.

This project is part of an ongoing effort to improve emerging mobile AI and notification-management technologies for international users.

Workload

  • Participants will engage with the project daily until 14 qualified submissions have been submitted.
  • Expected daily participation time may vary slightly depending on notification volume and project tasks, but participants should expect approximately 10–15 minutes of activity per day.
  • This is project-based work, and there is no guarantee of additional work beyond the pilot period. However, participants who perform well may be considered for future related projects.

Duties

  • Use a Google Pixel 9 or newer device throughout the project duration
  • Interact naturally with apps that generate notifications
  • Complete assigned notification sorting / organization tasks
  • Submit required daily feedback and documentation
  • Follow all provided project instructions carefully
  • Communicate promptly regarding technical issues or project blockers
  • Perform all work with attention to quality, completeness, and detail

Engagement Requirements

While participating in this project, adherence to the confidentiality terms outlined in the User Agreement is required. Any information accessed or received related to this project is confidential and may not be shared or disclosed to third parties.

Participants must:

Use a qualifying Google Pixel device.

Qualifying Device Examples

Google Pixel 9

Google Pixel 9 Pro

Google Pixel 10

Google Pixel Fold (newer generation)

Please note:Google Pixel 9a and Pixel 10a devices are not compatible with project requirements.

About Us:

As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children’s language acquisition, our commitment to excellence, forward-thinking strategies, and world-wide cultural experience has proven key for delivering exceptional service.

Originally founded as an educational production company, Productive Playhouse made a mark with our award winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider.

Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity.  Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.

At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time.

Disclaimer:

All engagements are contingent upon successful completion of a background screening. Productive Playhouse is committed to diversity and inclusion across our global contractor network. We welcome applicants of all backgrounds and abilities.

Read the full description
Trainer Polish AI Product Tester at Productive Playhouse

Test and provide feedback on AI-powered notification management features on Google Pixel devices through daily interaction and documentation.

Junior Remote Posted 2 days ago RemoteFirstJobs Product
What this role involves

Polish AI Product Tester

No Google Pixel device? No problem at all! We will happily lend and ship the required phone directly to your home for the duration of the project.

Active Project Status: This project is now live, and we are urgently onboarding participants to begin immediately. Because we are moving quickly, we kindly ask that you keep a close eye on your communication (email and messages) after applying. It is essential that you respond promptly so we can get you cleared and ready to start without delay.

Location: 100% Remote, located in the U.S.

Device: Applicants must use a qualifying Google Pixel device for the duration of the project

Compensation: USD $250.00 upon successful completion of the 14 qualified submissions.(each submission should take 10–15 minutes of activity per day)

Please note: To ensure eligibility for this project, applicants must be located in the U.S.

Project Requirements

  • Native or expert-level fluency in Polish spoken in Poland (ISO: pl-PL)
  • Must be comfortable using a Google Pixel 9 or newer device
  • Must be comfortable downloading and using common mobile applications that generate notifications (messaging apps, email apps, social media apps, etc.)
  • Must be comfortable using the Google Pixel device as their primary phone for the duration of the project
  • Must be willing to participate daily for 14-21 consecutive days
  • Must be 18 or older to meet project eligibility requirements
  • Must have access to reliable Wi-Fi/internet
  • Participants must be able to read and understand instructions and company communications in English

The Project

We are seeking detail-oriented and motivated speakers to participate in an upcoming notification sorting project.

Participants will use a Google Pixel 9 or newer device throughout the project period while interacting naturally with apps that generate notifications. Participants will complete daily project tasks involving notification organization/sorting workflows and provide related feedback/documentation as instructed.

Participants will also complete a short daily feedback/check-in form throughout the duration of the pilot to assist with participation tracking and troubleshooting support.

This project is part of an ongoing effort to improve emerging mobile AI and notification-management technologies for international users.

Workload

  • Participants will engage with the project daily until 14 qualified submissions have been submitted.
  • Expected daily participation time may vary slightly depending on notification volume and project tasks, but participants should expect approximately 10–15 minutes of activity per day.
  • This is project-based work, and there is no guarantee of additional work beyond the pilot period. However, participants who perform well may be considered for future related projects.

Duties

  • Use a Google Pixel 9 or newer device throughout the project duration
  • Interact naturally with apps that generate notifications
  • Complete assigned notification sorting / organization tasks
  • Submit required daily feedback and documentation
  • Follow all provided project instructions carefully
  • Communicate promptly regarding technical issues or project blockers
  • Perform all work with attention to quality, completeness, and detail

Engagement Requirements

While participating in this project, adherence to the confidentiality terms outlined in the User Agreement is required. Any information accessed or received related to this project is confidential and may not be shared or disclosed to third parties.

Participants must:

Use a qualifying Google Pixel device.

Qualifying Device Examples

Google Pixel 9

Google Pixel 9 Pro

Google Pixel 10

Google Pixel Fold (newer generation)

Please note:Google Pixel 9a and Pixel 10a devices are not compatible with project requirements.

About Us:

As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children’s language acquisition, our commitment to excellence, forward-thinking strategies, and world-wide cultural experience has proven key for delivering exceptional service.

Originally founded as an educational production company, Productive Playhouse made a mark with our award winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider.

Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity.  Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.

At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time.

Disclaimer:

All engagements are contingent upon successful completion of a background screening. Productive Playhouse is committed to diversity and inclusion across our global contractor network. We welcome applicants of all backgrounds and abilities.

Read the full description