bluebill
bluebill
Quality and review
QA and Test Automation Engineer
Write the tests that make tasks trustworthy, and build tasks where agents must write good tests themselves.
- Pay
- $85 to $130 AUD an hour
- Hours
- 5 to 20 hours a week while a project runs. Project-based. Work is offered as customer projects open, and you choose when you work.
- Type
- Contract
- Location
- Remote (Australia and international)
- Posted
- 5 Oct 2026
Apply on a laptop or desktop with a camera and microphone.
What you will do
- Write unit, integration and end-to-end tests that catch real defects without being brittle.
- Create tasks where an agent must write the tests that expose a bug.
- Judge and rank AI-written test suites and explain what they miss.
- Review other engineers' tasks for realism, reproducibility and test quality.
What you will need
- 3+ years in test automation or quality engineering.
- Comfortable with at least one test framework and CI.
- Clear written English.
Nice to have
- Experience with property-based or contract testing.
- Performance testing experience.
How you are assessed
test quality, defect detection, realism, clear explanation.
Applications and work are reviewed against these criteria.
How to apply
A 20 minute video interview: five engineering questions, up to 3 minutes each.