Table of Contents
1. High-level Instructions
User-focused flows with flexible implementation
2. Persona Based Tests
User-specific experiences and permissions
3. Exploratory Tests
Discovering edge cases and behaviors
4. Other Useful Prompts
Additional patterns for specific testing scenarios
1. High-Level Instructions
When to Use
Ideal for testing user flows where specific implementation details aren’t critical
Examples
Completing a flow
This is an example of a high-level step that uses the agent’s ability to
figure out what the right action is at each moment.
Responding to Messages
This example demonstrates how to leverage the agent’s natural language understanding to handle complex message interactions without specifying exact UI elements or steps.
Tips
Clear End Goals
Clear End Goals
Include a goal or stopping point, so the agent knows when to finish.
User-Centric Approach
User-Centric Approach
Focus on user goals rather than specific elements.
Implementation Flexibility
Implementation Flexibility
Allow flexibility in implementation details.
Verification Points
Verification Points
Include key verification points to ensure the test is successful.
2. Persona Based Tests
When to Use
Useful for uncovering user frustrations and difficulties, as well as clarity of designed user flows.
Examples
UI/UX Tester
This example shows how you can give the agent a persona and then ask that persona
to do certain actions. In this case, we ask the UI expert to note any issues
with our app.
User Demographic Personas
You can use personas to see how different types of users will interact with your
site. This example shows an obvious use case, testing the accessibility of your
site, but this can also be applied across different demographics and can pull
insights there.
Tips
Clear Persona Definition
Clear Persona Definition
Define persona characteristics clearly. These can be as long as you would like.
Test Output Definition
Test Output Definition
Explicitly define the output of the test, even if it is general like “all UI issues”.
3. Exploratory Tests
When to Use
Perfect for discovering edge cases and unexpected behaviors
Examples
Security Exploration
Using a persona, give the agent free rein to explore the site and achieve their goal. This test is an example where the agent tries to find security vulnerabilities.
Tips
Exploration Boundaries
Exploration Boundaries
Define exploration boundaries to guide the agent’s testing scope.
Continuous Navigation
Continuous Navigation
4. Other Useful Prompts
When to Use
For specialized testing scenarios that require specific approaches
Examples
Initiating a Conversation with a Chatbot
This prompt is useful for testing an AI chatbot, to give it unique responses and validate that the chatbot’s responses are acceptable.
Tips
Experiment with Prompts
Experiment with Prompts
Try and experiment with different test step prompts to find what works best for your specific testing needs.
Next Steps
- Review the Prompting 101 Guide
- Try writing your first test
- Explore available actions