Home › Companies › Productiveplayhouse › AI Chatbot Evaluator
AI Chatbot Evaluator
Productiveplayhouse · San Francisco, CA, 64103 · Remote · Deleted · JazzHR / ApplyToJob
Job facts
| Field | Value |
|---|---|
| Company | Productiveplayhouse |
| Title | AI Chatbot Evaluator |
| Normalized title | - |
| Department / team | - |
| Location | San Francisco, CA, United States |
| Work model | Remote / Remote |
| Employment type | Contract |
| Salary | USD |
| Status | deleted |
| ATS provider | JazzHR / ApplyToJob |
| Posted / first seen | 2026-05-22 / 2026-05-30 |
| Changed / last seen | 2026-06-04 / 2026-06-02 |
Related slices
| Page | What it contains | Open |
|---|---|---|
| Company jobs | Active postings from Productiveplayhouse. | Open |
| Company breakdowns | Role, location, ATS, and work model facets for this company. | Open |
| ATS provider jobs | Active postings observed through JazzHR / ApplyToJob. | Open |
| Provider filtered search | The same provider as a filtered job collection. | Open |
| City jobs | Active postings in San Francisco. | Open |
| Work model jobs | Active Remote postings. | Open |
| Lifecycle events | Open, update, close, and reopen events for this posting. | Open |
| Original posting | Canonical source or apply URL captured from the ATS. | Open |
Linked records
| Company | Productiveplayhouse |
| Source | 4d36fa7e-5a52-4e6d-bfbf-56be0b9e2e14 |
| ATS provider | JazzHR / ApplyToJob |
Description
Position: AI Chatbot Evaluator (Health & Wellness Study)
Ideal candidates are AI enthusiasts who regularly use and converse with AI chatbots, are very comfortable following step-by-step instructions independently and typically do not need a manual to get started, open to feedback and comfortable collaborating on an iterative workflow to provide thoughtful, detailed feedback on their AI interactions.
Project Type: Contractor Assignment
Location: Remote (U.S.)
Compensation: $180 flat fee-minimum of 4 tasks, $45 for any additional tasks completed
Time Commitment: ~ 2-3 hours total (including about 30 minutes for instructions/setup and 30 minutes for task completion).
Project Summary Productive Playhouse is supporting a new upcoming project to evaluate the performance of leading AI chatbots on health and wellness topics. The objective of this study is to determine whether personalization improves response quality when users interact with these AI models.
Participants will use their existing personal accounts and conversation history to engage with their preferred AI chatbot, such as Gemini, ChatGPT, or Claude. The goal is to evaluate how effectively the chatbot uses user context to deliver high-quality, meaningful, and personalized insights.
What You'll Do: Interact with your assigned AI model on designated health and wellness topics. Use your personal AI chatbot account and existing conversation history to evaluate personalized response quality. Assess how well the system adapts to your inputs and provides accurate, relevant responses. Address feedback and implement revisions to support high quality submissions. Complete a structured evaluation form based on your experience. Requirements: Must be 18 years of age or older Currently residing in the United States. Must be fully proficient in reading and writing instructions in English. Must have one of the following existing, active personal accounts: A personal Google account to use Gemini, not newly created or a test account; An active, paid ChatGPT subscription; or An active, paid Claude Pro subscription.
**The selected AI chatbot account must have at least 1 month of active usage history.
As this project continues to evolve, we want to ensure we set clear expectations from the start. Given the iterative nature of this test, there will be times when we need to adapt and make adjustments along the way. We ask that you remain flexible and open to changes as they arise Application Process Apply now and check your email immediately to complete the mandatory Intake Form (where you will specify which AI platform you currently use). Once submitted, our project leads will review your application and contact qualified participants with setup instructions as soon as the project goes live.
About Us:
As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and worldwide cultural experience has proven key for delivering exceptional service.
Originally founded as an educational production company, Productive Playhouse made a mark with our award-winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider.
Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity. Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.
At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time.
Disclaimer
The job description provided is designed to convey information essential to understanding the scope of the position and the general nature of the work performed. It is not intended to be an exhaustive list of duties, responsibilities, or qualifications associated with the job. Productive Playhouse reserves the right to modify or revise the job description as necessary
Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees. Employment with Productive Playhouse is at-will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice.
All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location. Productive Playhouse participates in E-Verify.
Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities. If you need assistance or accommodation due to a disability, please contact the Human Resources Department.
Full job record
| Job ID | 658f529c07beee97d1a29dc956443079fdf172f2 |
| Org ID | f6894bf7-6644-4173-bf86-e0b24767a578 |
| Source ID | 4d36fa7e-5a52-4e6d-bfbf-56be0b9e2e14 |
| Board ID | 4d36fa7e-5a52-4e6d-bfbf-56be0b9e2e14 |
| Provider | jazzhr |
| Provider Job Key | AlYDEeNiO0 |
| Title | AI Chatbot Evaluator |
| Normalized Title | — |
| Status | deleted |
| Active | no |
| Location Text | San Francisco, CA, 64103 |
| Department | — |
| Team | — |
| Employment Type | contract |
| Workplace Type | remote |
| Remote Policy | remote |
| Country | United States |
| Region | CA |
| City | San Francisco |
| Salary Raw | USD |
| Salary Min | — |
| Salary Max | — |
| Salary Currency | — |
| Salary Period | — |
| Source URL | https://productiveplayhouse.applytojob.com/apply/AlYDEeNiO0/AI-Chatbot-Evaluator |
| Apply URL | https://productiveplayhouse.applytojob.com/apply/AlYDEeNiO0/AI-Chatbot-Evaluator |
| First Seen At | 2026-05-30 05:48:34Z |
| Last Seen At | 2026-06-02 12:38:03Z |
| Last Checked At | 2026-06-04 14:29:56Z |
| Last Changed At | 2026-06-04 14:29:56Z |
| Inactive At | 2026-06-04 14:29:56Z |
| Source Posted At | 2026-05-22 00:00:00Z |
| Source Updated At | — |
| Raw Payload Uri | s3://bluework-jobs-prod-raw-590183727216/raw/provider=jazzhr/board=productiveplayhouse/date=2026-06-02/2026-06-02T12-37-45-790Z-3d36cd2978337540f2a0bb3d3003c2ead9625100a731f2d8931365a60b094501.json |
Event Fields
{
"content_hash": "9ddddc0ef5a8e290edb41eb2eaaaf4a27a0c7cbd33658b78964e4f802f60c825",
"source_hash": "3912819027fd636164c58d892ec9dd07f2746d2e9733c4d3655e19c8123e9f18",
"last_changed_at": "2026-06-04T14:29:56.702Z",
"active_status": "deleted"
}Parsed Structured
{
"language": "en",
"location": {
"raw": "San Francisco, CA, 64103",
"city": "San Francisco",
"region": "CA",
"country": "United States",
"is_remote": true,
"confidence": 0.9
},
"salary_max": null,
"salary_min": null,
"inferred_at": "2026-06-02T12:38:02.703Z",
"launch_scope": {
"reason": "jazzhr_production_catalog",
"included": true,
"location": {
"raw": "San Francisco, CA, 64103",
"city": "San Francisco",
"region": "CA",
"country": "United States",
"is_remote": true,
"confidence": 0.9
},
"countries": [
"United States"
]
},
"remote_policy": "remote",
"salary_period": null,
"workplace_type": "remote",
"salary_currency": null
}Extensions
{}Native Structured
{
"detail": {
"url": "https://productiveplayhouse.applytojob.com/apply/jobs/details/AlYDEeNiO0?&",
"heading": "AI Chatbot Evaluator",
"html_title": "JazzHR » Job Listings",
"canonical_url": "https://productiveplayhouse.applytojob.com/apply/AlYDEeNiO0/AI-Chatbot-Evaluator",
"description_html": "<p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Position:</span></span></span><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> AI Chatbot Evaluator (Health & Wellness Study)</span></span></span></span></span></span><br><br><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Ideal candidates are AI enthusiasts who regularly use and converse with AI chatbots, are very comfortable following step-by-step instructions independently and typically do not need a manual to get started, open to feedback and comfortable collaborating on an iterative workflow to provide thoughtful, detailed feedback on their AI interactions.</span></span></span></span></span></span></p><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Project Type:</span></span></span></span></span></span><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> Contractor Assignment</span></span></span></span></span></span></p><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Location:</span></span></span></span></span></span><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> Remote (U.S.)</span></span></span></span></span></span></p><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Compensation:</span></span></span><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> $180 flat fee-minimum of 4 tasks, $45 for any additional tasks completed</span></span></span></span></span></span></p><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Time Commitment:</span></span></span><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> ~ </span></span></span></span></span></span><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">2-3 hours total (including about 30 minutes for instructions/setup and 30 minutes for task completion). </span></span></span></span></span></span></p><h3 style=\"line-height:1.38;margin-top:19px;margin-bottom:5px;\"><span style=\"font-size:13pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Project Summary</span></span></span></span></span></span></h3><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Productive Playhouse is supporting a new upcoming project to evaluate the performance of leading AI chatbots on health and wellness topics. The objective of this study is to determine whether personalization improves response quality when users interact with these AI models.<br><br>Participants will use their existing personal accounts and conversation history to engage with their preferred AI chatbot, such as Gemini, ChatGPT, or Claude. The goal is to evaluate how effectively the chatbot uses user context to deliver high-quality, meaningful, and personalized insights.</span></span></span></span></span></span></p><h3 style=\"line-height:1.38;margin-top:19px;margin-bottom:5px;\"><span style=\"font-size:13pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">What You'll Do:</span></span></span></span></span></span></h3><ul><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Interact with your assigned AI model on designated health and wellness topics.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Use your personal AI chatbot account and existing conversation history to evaluate personalized response quality.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Assess how well the system adapts to your inputs and provides accurate, relevant responses.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Address feedback and implement revisions to support high quality submissions.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Complete a structured evaluation form based on your experience.</span></span></span></span></span></span></li></ul><h3 style=\"line-height:1.38;margin-top:19px;margin-bottom:5px;\"><span style=\"font-size:13pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Requirements:</span></span></span></span></span></span></h3><ul><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Must be 18 years of age or older</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Currently residing in the United States.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Must be fully proficient in reading and writing instructions in English.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Must have one of the following existing, active personal accounts:</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">A personal Google account to use Gemini, not newly created or a test account;</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">An active, paid ChatGPT subscription; or</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">An active, paid Claude Pro subscription.</span></span></span></span></span></span><br><br><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">**The selected AI chatbot account must have at least 1 month of active usage history.</span></span></span></span></span></span><br><br><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">As this project continues to evolve, we want to ensure we set clear expectations from the start. Given the iterative nature of this test, there will be times when we need to adapt and make adjustments along the way. We ask that you remain flexible and open to changes as they arise</span></span></span></span></span></span></li></ul><h3 style=\"line-height:1.38;margin-top:19px;margin-bottom:5px;\"><span style=\"font-size:13pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Application Process</span></span></span></span></span></span></h3><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Apply now and </span></span></span></span></span></span><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">check your email immediately</span></span></span><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> to complete the mandatory Intake Form (where you will specify which AI platform you currently use). Once submitted, our project leads will review your application and contact qualified participants with setup instructions as soon as the project goes live.</span></span></span></span></span></span><br><br> </p><p><strong>About Us: </strong></p><p>As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and worldwide cultural experience has proven key for delivering exceptional service. </p><p>Originally founded as an educational production company, Productive Playhouse made a mark with our award-winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider. </p><p>Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity. Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.</p><p>At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time. <br> </p><p><strong>Disclaimer</strong></p><p>The job description provided is designed to convey information essential to understanding the scope of the position and the general nature of the work performed. It is not intended to be an exhaustive list of duties, responsibilities, or qualifications associated with the job. Productive Playhouse reserves the right to modify or revise the job description as necessary</p><p>Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees. Employment with Productive Playhouse is at-will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice.</p><p>All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location. Productive Playhouse participates in E-Verify.</p><p>Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities. If you need assistance or accommodation due to a disability, please contact the Human Resources Department.</p><br> ",
"description_text": "Position: AI Chatbot Evaluator (Health & Wellness Study)\n Ideal candidates are AI enthusiasts who regularly use and converse with AI chatbots, are very comfortable following step-by-step instructions independently and typically do not need a manual to get started, open to feedback and comfortable collaborating on an iterative workflow to provide thoughtful, detailed feedback on their AI interactions.\n Project Type: Contractor Assignment\n Location: Remote (U.S.)\n Compensation: $180 flat fee-minimum of 4 tasks, $45 for any additional tasks completed\n Time Commitment: ~ 2-3 hours total (including about 30 minutes for instructions/setup and 30 minutes for task completion).\n Project Summary\n Productive Playhouse is supporting a new upcoming project to evaluate the performance of leading AI chatbots on health and wellness topics. The objective of this study is to determine whether personalization improves response quality when users interact with these AI models.\nParticipants will use their existing personal accounts and conversation history to engage with their preferred AI chatbot, such as Gemini, ChatGPT, or Claude. The goal is to evaluate how effectively the chatbot uses user context to deliver high-quality, meaningful, and personalized insights.\n What You'll Do:\n Interact with your assigned AI model on designated health and wellness topics.\n Use your personal AI chatbot account and existing conversation history to evaluate personalized response quality.\n Assess how well the system adapts to your inputs and provides accurate, relevant responses.\n Address feedback and implement revisions to support high quality submissions.\n Complete a structured evaluation form based on your experience.\n Requirements:\n Must be 18 years of age or older\n Currently residing in the United States.\n Must be fully proficient in reading and writing instructions in English.\n Must have one of the following existing, active personal accounts:\n A personal Google account to use Gemini, not newly created or a test account;\n An active, paid ChatGPT subscription; or\n An active, paid Claude Pro subscription.\n **The selected AI chatbot account must have at least 1 month of active usage history.\n As this project continues to evolve, we want to ensure we set clear expectations from the start. Given the iterative nature of this test, there will be times when we need to adapt and make adjustments along the way. We ask that you remain flexible and open to changes as they arise\n Application Process\n Apply now and check your email immediately to complete the mandatory Intake Form (where you will specify which AI platform you currently use). Once submitted, our project leads will review your application and contact qualified participants with setup instructions as soon as the project goes live.\n About Us:\n As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and worldwide cultural experience has proven key for delivering exceptional service.\n Originally founded as an educational production company, Productive Playhouse made a mark with our award-winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider.\n Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity. Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.\n At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time.\n Disclaimer\n The job description provided is designed to convey information essential to understanding the scope of the position and the general nature of the work performed. It is not intended to be an exhaustive list of duties, responsibilities, or qualifications associated with the job. Productive Playhouse reserves the right to modify or revise the job description as necessary\n Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees. Employment with Productive Playhouse is at-will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice.\n All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location. Productive Playhouse participates in E-Verify.\n Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities. If you need assistance or accommodation due to a disability, please contact the Human Resources Department.",
"jsonld_jobposting": {
"url": "https://productiveplayhouse.applytojob.com/apply/AlYDEeNiO0/AI-Chatbot-Evaluator",
"@type": "JobPosting",
"title": "AI Chatbot Evaluator",
"@context": "http://schema.org/",
"baseSalary": {
"@type": "MonetaryAmount",
"value": {
"@type": "QuantitativeValue",
"maxValue": 45,
"minValue": 22.5,
"unitText": "HOUR"
},
"currency": "USD"
},
"datePosted": "2026-05-22",
"description": "<p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Position:</span></span></span><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> AI Chatbot Evaluator (Health & Wellness Study)</span></span></span></span></span></span><br><br><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Ideal candidates are AI enthusiasts who regularly use and converse with AI chatbots, are very comfortable following step-by-step instructions independently and typically do not need a manual to get started, open to feedback and comfortable collaborating on an iterative workflow to provide thoughtful, detailed feedback on their AI interactions.</span></span></span></span></span></span></p><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Project Type:</span></span></span></span></span></span><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> Contractor Assignment</span></span></span></span></span></span></p><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Location:</span></span></span></span></span></span><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> Remote (U.S.)</span></span></span></span></span></span></p><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Compensation:</span></span></span><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> $180 flat fee-minimum of 4 tasks, $45 for any additional tasks completed</span></span></span></span></span></span></p><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Time Commitment:</span></span></span><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> ~ </span></span></span></span></span></span><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">2-3 hours total (including about 30 minutes for instructions/setup and 30 minutes for task completion). </span></span></span></span></span></span></p><h3 style=\"line-height:1.38;margin-top:19px;margin-bottom:5px;\"><span style=\"font-size:13pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Project Summary</span></span></span></span></span></span></h3><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Productive Playhouse is supporting a new upcoming project to evaluate the performance of leading AI chatbots on health and wellness topics. The objective of this study is to determine whether personalization improves response quality when users interact with these AI models.<br><br>Participants will use their existing personal accounts and conversation history to engage with their preferred AI chatbot, such as Gemini, ChatGPT, or Claude. The goal is to evaluate how effectively the chatbot uses user context to deliver high-quality, meaningful, and personalized insights.</span></span></span></span></span></span></p><h3 style=\"line-height:1.38;margin-top:19px;margin-bottom:5px;\"><span style=\"font-size:13pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">What You'll Do:</span></span></span></span></span></span></h3><ul><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Interact with your assigned AI model on designated health and wellness topics.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Use your personal AI chatbot account and existing conversation history to evaluate personalized response quality.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Assess how well the system adapts to your inputs and provides accurate, relevant responses.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Address feedback and implement revisions to support high quality submissions.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Complete a structured evaluation form based on your experience.</span></span></span></span></span></span></li></ul><h3 style=\"line-height:1.38;margin-top:19px;margin-bottom:5px;\"><span style=\"font-size:13pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Requirements:</span></span></span></span></span></span></h3><ul><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Must be 18 years of age or older</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Currently residing in the United States.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Must be fully proficient in reading and writing instructions in English.</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Must have one of the following existing, active personal accounts:</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">A personal Google account to use Gemini, not newly created or a test account;</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">An active, paid ChatGPT subscription; or</span></span></span></span></span></span></li><li style=\"list-style-type:disc;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">An active, paid Claude Pro subscription.</span></span></span></span></span></span><br><br><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">**The selected AI chatbot account must have at least 1 month of active usage history.</span></span></span></span></span></span><br><br><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">As this project continues to evolve, we want to ensure we set clear expectations from the start. Given the iterative nature of this test, there will be times when we need to adapt and make adjustments along the way. We ask that you remain flexible and open to changes as they arise</span></span></span></span></span></span></li></ul><h3 style=\"line-height:1.38;margin-top:19px;margin-bottom:5px;\"><span style=\"font-size:13pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Application Process</span></span></span></span></span></span></h3><p style=\"line-height:1.38;margin-top:16px;margin-bottom:16px;\"><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">Apply now and </span></span></span></span></span></span><span style=\"font-size:11pt;font-variant:normal;white-space:pre-wrap;\"><span style=\"font-family:Arial, sans-serif;\"><span style=\"color:#000000;\"><span style=\"font-weight:700;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\">check your email immediately</span></span></span><span style=\"font-weight:400;\"><span style=\"font-style:normal;\"><span style=\"text-decoration:none;\"> to complete the mandatory Intake Form (where you will specify which AI platform you currently use). Once submitted, our project leads will review your application and contact qualified participants with setup instructions as soon as the project goes live.</span></span></span></span></span></span><br><br> </p><p><strong>About Us: </strong></p><p>As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and worldwide cultural experience has proven key for delivering exceptional service. </p><p>Originally founded as an educational production company, Productive Playhouse made a mark with our award-winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider. </p><p>Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity. Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.</p><p>At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time. <br> </p><p><strong>Disclaimer</strong></p><p>The job description provided is designed to convey information essential to understanding the scope of the position and the general nature of the work performed. It is not intended to be an exhaustive list of duties, responsibilities, or qualifications associated with the job. Productive Playhouse reserves the right to modify or revise the job description as necessary</p><p>Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees. Employment with Productive Playhouse is at-will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice.</p><p>All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location. Productive Playhouse participates in E-Verify.</p><p>Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities. If you need assistance or accommodation due to a disability, please contact the Human Resources Department.</p><br> ",
"jobLocation": {
"@type": "Place",
"address": {
"@type": "PostalAddress",
"postalCode": "64103",
"addressRegion": "CA",
"addressLocality": "San Francisco"
}
},
"validThrough": "2026-08-20",
"uniqueJobCode": "job_20260520172639_FMMCYRFRIYCGEBEB",
"employmentType": "CONTRACTOR",
"jobLocationType": "TELECOMMUTE",
"hiringOrganization": {
"logo": "https://s3.amazonaws.com/resumator/customer_20221102144422_FOPFAJPWQK804S3X/logos/20230327212215_2022_PPH_Full_Logo_3.jpg",
"name": "Productive Playhouse",
"@type": "Organization",
"sameAs": "http://www.productiveplayhouse.com"
},
"experienceRequirements": "Mid Level",
"applicantLocationRequirements": {
"name": "US",
"@type": "Country"
}
}
},
"list_job": {
"id": "AlYDEeNiO0",
"title": "AI Chatbot Evaluator",
"detailUrl": "https://productiveplayhouse.applytojob.com/apply/jobs/details/AlYDEeNiO0?&"
},
"detail_errors": []
}Get this page with API
Rendered from the bluedoor Job Postings API. Reproduce it:
GET https://api.bluedoor.sh/job-postings/v1/jobs/658f529c07beee97d1a29dc956443079fdf172f2?include=descriptionJSONGET https://api.bluedoor.sh/job-postings/v1/orgs/f6894bf7-6644-4173-bf86-e0b24767a578JSONGET https://api.bluedoor.sh/job-postings/v1/sources/4d36fa7e-5a52-4e6d-bfbf-56be0b9e2e14JSONGET https://api.bluedoor.sh/job-postings/v1/jobs/658f529c07beee97d1a29dc956443079fdf172f2/eventsJSON