Senior AI Test Engineer (Carseldine)

Senior AI Test Engineer

Initial 6 month contract + Possible extension Hybrid and Flexible Working / Role based in Carseldine (North Brisbane)

In conjunction with our Queensland State Government client, we're recruiting a Senior AI Test Engineer to support the delivery of a large-scale digital transformation program focused on modernising transactional service platforms. This role sits within a high-performing technology team driving iterative delivery, with a strong emphasis on quality engineering, automation, and emerging technologies including AI and large language models.

You'll play a key role in shaping testing strategy, implementing modern automation frameworks, and ensuring solutions are delivered to a high standard in a fast-paced, delivery-focused environment.

What you'll be doing
- Design, implement and continuously improve testing processes aligned to established frameworks
- Develop automated testing solutions across complex systems, including AI-enabled platforms
- Create and execute test cases (manual and automated) across system, integration and regression levels
- Build automated scenarios to validate AI model accuracy, consistency and decision logic
- Analyse user stories, requirements and use cases to ensure testability and completeness
- Collaborate with cross-functional teams to define acceptance criteria and drive quality outcomes
- Maintain test traceability, documentation and reporting across the delivery lifecycle
- Execute testing strategies aligned to CI/CD practices and delivery pipelines
- Provide explicit reporting on test progress, coverage and overall quality metrics
- Contribute to solution design discussions, estimations and implementation decisions What you need to bring
- Proven experience as a Senior Test Engineer in complex delivery environments
- Strong hands-on expertise in test automation frameworks and tools
- Experience designing and executing end-to-end testing strategies
- Ability to build, manage and maintain scalable automated test suites
- Solid understanding of Agile delivery practices and collaborative team environments
- Experience working with CI/CD pipelines and automated testing integration
- Strong analytical skills with the ability to assess requirements for validity and feasibility
- Excellent communication skills and ability to influence quality outcomes Bonus points for
- Experience testing AI-enabled systems or working with Large Language Models
- Hands-on experience with Playwright
- Exposure to AWS environments
- Experience using GitHub for version control and CI/CD workflows
- Familiarity with Confluent Kafka
- Experience with Snowflake
- Knowledge of domain-driven design principles Important to know
- Role is located in Carseldine, North Brisbane
- Hybrid and Flexible working arrangements available Apply on Kit Job: kitjobau.com/job/3qk2oa