AI Content Safety Quality Assurance

Job description / Role

You will focus on identifying and mitigating risks associated with AI-generated content, ensuring adherence to safety and ethical standards. Your deep understanding of LLM APIs, combined with your technical expertise in Python, will allow you to develop and execute effective testing strategies.

Client Details
An entity supporting the technology strategy and digital transformation initiatives of a major financial firm.

Description
* Content Safety Testing: Design, develop, and execute comprehensive test plans to ensure the security and reliability of content generated by large language models.
* LLM Integration: Work with LLM APIs (e.g., OpenAI's API) to integrate AI models into automated testing workflows, ensuring consistent and thorough content evaluation.
* Prompt Engineering: Leverage prompt engineering skills to enhance testing strategies and optimize LLM behaviour for safe and reliable output.
* Defect Identification & Resolution: Identify and document content safety issues or model behaviour concerns, and collaborate with AI developers to resolve them.
* Automation & Scripting: Develop automated testing scripts using Python to streamline LLM testing processes and ensure scalable and efficient content safety evaluations.

Job Offer
* Opportunity to work with cutting edge technologies and support the development of ethical and secure AI use cases
* Excellent overall compensation package and benefits

* Master's or Bachelor's degree in Computer Science, Engineering, or a related field
* Proficient in Python programming and comfortable working with LLM APIs (e.g., OpenAI)
* Experienced in testing the safety, security, and reliability of AI-generated content
* Knowledgeable in prompt engineering techniques and how they can enhance content safety
* Passionate about AI technologies and committed to ensuring the ethical and secure use of AI-generated content
* At least 1 year of hands-on experience with LLM APIs

About the Company

Michael Page is one of the world's leading professional recruitment consultancies, specializing in the placement of candidates in permanent, contract, temporary and interim positions with clients around the world.

The Group has operations in the UK, Continental Europe, Asia-Pacific and the Americas. In the Middle East we focus on the areas of:

Finance & Accounting Banking & Financial Services Procurement Property & Construction Engineering & Supply Chain Oil & Gas Technical and Engineering Human Resources Sales Marketing Technology Secretarial Executive Search Legal

The Group operates through 161 offices in 33 countries and employs over 5,000 employees worldwide.