RocketHuntSmart job search
Girl Effect
Kenya12 days ago
Title: Request for Proposal Evaluation of the WAZZII Chatbot Digital Health and AI Evaluation, Kenya Location: Kenya
Girl Effect is an international non-profit that builds media and technology that girls want, trust and need. We use youth-centred design and behaviour-change approaches to help adolescent girls and young women access trusted information, services and support and make informed choices about their health and futures.
Girl Effect is implementing three programmes in Kenya that use WAZZII, its digital chatbot, alongside multimedia, community engagement and service linkages to improve access to sexual and reproductive health (SRH) and maternal and newborn health (MNH) information and services.
Girl Effect seeks an independent research partner to evaluate WAZZII across the three programmes, assessing user experience, AI performance and safety, behavioural outcomes, equity and progression from digital engagement to service uptake.
The evaluation will assess WAZZII’s performance, usefulness and safety, and its contribution to SRH/MNH outcomes and service pathways.
Specifically, it will:
Develop an evaluation protocol, indicator framework, sampling strategy and analysis plan. Review chatbot analytics to assess user characteristics, engagement, repeat use, conversation patterns and drop-off points. Map the pathway from programme exposure and chatbot engagement to human support, referral and service uptake.
Integrate platform analytics, user surveys, qualitative research and available referral/service data. Where feasible, follow chatbot users over time. Clearly document data gaps, selection bias and limitations to attributing outcomes to chatbot use.
Assess WAZZII’s accuracy, reliability, relevance, comprehension, accessibility, privacy and trust. For AI Mobiliser, conduct structured testing of representative SRH questions, including contraception, DMPA-SC/self-injection, sensitive disclosures, misinformation risks and referral information.
Review available AI performance monitoring, safeguarding alerts, failure records and escalation processes. Assess whether inappropriate responses and higher-risk situations are identified and managed correctly. Apply the existing 22-metric Product-Level Scorecard where appropriate.
Use user surveys, interviews or usability sessions to identify barriers and opportunities for improvement.
Assess whether users with different levels of digital access can engage with and benefit from WAZZII. Consider shared-device access, connectivity, digital literacy, privacy, language, disability and geography.
Analyse differences in engagement, experience, referral and outcomes by relevant user characteristics, where data permits. Examine how chatbot use interacts with multimedia, community mobilisation and human support, particularly within AI Mobiliser.
Assess reported knowledge, confidence, decision-making, intentions and service-seeking using programme-relevant measures.
For AI Mobiliser, examine progression along the contraceptive-care pathway, including referrals offered, completed visits and service uptake.
Use referral codes, provider records, voucher redemption or other approved verification methods where available.
Clearly distinguish verified service uptake from self-reported uptake.
Where feasible, assess outcomes by engagement intensity and combinations of programme exposure. Any claims about effectiveness must be supported by the evaluation design; associations should not automatically be interpreted as causal effects.
Triangulate findings across analytics, AI testing, user research and service data..
Identify priority improvements in AI safety, product design, accessibility, referral systems and programme implementation.
The assignment will cover evaluation design, data-feasibility assessment, product analytics, AI performance and safety testing, participant research, service-pathway analysis and reporting.
All final deliverables must be completed and accepted by 31 December 2026.
The agency will report to Girl Effect’s designated Evidence and Insights focal point and work closely with the relevant product, programme, safeguarding, operations and country teams.
Any risk to the agreed scope, quality, budget or final deadline must be reported immediately with a proposed mitigation plan.
The research partner should demonstrate experience in digital health or AI evaluation, mixed-methods research, usability testing, digital analytics, AI safety assessment, SRH/MNH, safeguarding and research ethics.
Experience conducting research in Kenya and measuring referral and service uptake is essential.
Invited agencies must submit separate technical and financial proposals.
The technical proposal should not exceed 10 pages, including CVs, references, company documents and supporting evidence.
The technical proposal should include:
The financial proposal must be submitted in Kenya shillings and include:
Prices must remain valid for 90 days from the proposal deadline.
Any cost not expressly excluded or identified as conditional may be treated as included in the proposed fixed price.
Proposals will be evaluated in the following order:
Evaluation Criterion
Girl Effect may request:
The lowest-priced proposal will not necessarily be selected.
Email the technical and financial proposals as separate attachments to: recruiter contact
Use the subject line: WAZZII Chatbot Evaluation – Kenya
Clarification questions must be submitted to the stated procurement contact by the clarification deadline.
Proposals must be received by 26 October 2026
Clarification questions must be submitted to the stated procurement contact by the clarification deadline.
Late or non-compliant submissions may not be evaluated.
Only successful bidders will be notified.
Contracting and Payment: The successful agency will sign Girl Effect’s applicable agreement. Payments will be linked to satisfactory delivery and written acceptance of agreed milestones and receipt of a correct invoice.
Pricing, Taxes and Expenses: Prices must be quoted in Kenya shillings and remain firm for the proposal-validity period. Taxes, licences, participant costs, third-party costs and approved reimbursable expenses must be itemised separately. No unapproved cost will be reimbursed.
Research Data and Intellectual Property: Subject to the final agreement, Girl Effect will own the commissioned tools, test sets, scoring frameworks, datasets, codebooks, analysis syntax, reports and other outputs. The agency may not publish, reuse, retain or disclose them without prior written approval.
Confidentiality, Data Protection and Security: The agency must protect chatbot conversations, personal data, system information and confidential materials. It must use approved systems, encryption and access controls; report incidents promptly; and securely return or delete data as instructed.
External AI Tools: Girl Effect data, chatbot conversations, personal information and confidential materials must not be uploaded to public or third-party AI systems without prior written approval and documented security controls.
Safeguarding, AI Safety and Research Ethics: The agency must comply with approved research and safeguarding protocols and promptly escalate high-risk findings. Testing must not create avoidable harm, expose real users to unsafe content or interfere with live services without written approval.
Personnel, Consortia and Subcontracting: The lead agency remains accountable for all consortium partners and subcontractors. Changes to key personnel and material subcontractors require prior written approval.
Changes to Scope: Material changes to the approved design, data sources, sample, scope, budget or schedule require prior written authorisation. Corrections arising from agency error or non-compliance will not be treated as additional scope.
Conflicts and Independence: Bidders must disclose conflicts of interest, prior involvement with WAZZII or relevant platform providers and any circumstance that may affect evaluation independence.
Equal Opportunity: Girl Effect welcomes proposals from organisations and consortia with diverse professional and cultural backgrounds and a strong understanding of the communities and users included in the evaluation.
Right to Award: Girl Effect may seek clarification, negotiate, amend or cancel the process, reject any or all proposals, award all or part of the requirement or make no award. Girl Effect is not liable for proposal-preparation or negotiation costs.
Proposal Validity: Proposals must remain valid for 90 days from the submission deadline.
Employment
Project work
English Level
B2 - Upper-Intermediate
AI writes it from your resume. You only have to send it.
RocketHunt estimate from real salaries
RocketHunt estimate from real salaries
