Get an instant usability testing report of your design with the AI AppAgent. Inspired by AppAgent: Multimodal Agents as Smartphone Users, Klever is a Figma plugin project designed to empower designers and developers by providing AI-driven insights into their UI designs.

• GPT-4o Powered Multimodal Agents: Utilize advanced AI to understand both screenshots and text descriptions, simulating real-world user interactions with your UI.
• Instant Usability Reports: Receive comprehensive usability testing reports within seconds, highlighting potential usability issues and offering actionable recommendations.
• Persona Simulation: Experiment with different user personas to see how various users might experience your design.
• Seamless Figma Integration: Analyze your designs directly within Figma, streamlining your workflow.

1. Open the design file you want to analyze in Figma.
2. Navigate to Plugins > Klever and open the plugin.
3. Enter your OpenAI API key. If you don't have one, get it from here. Make sure you have access to GPT-4 Vision.
4. Select the frame or component you want to analyze.
5. (Optional) Create a Task for the AI to perform and set up different personas.
6. Click "Submit" or press "Cmd/Ctrl Enter" to receive your AI-powered usability testing report.

• Install dependencies with yarn.
• Start webpack in watch mode with yarn build:watch.
• Import the plugin into Figma by navigating to Plugins -> Development -> Import plugin from manifest... and selecting the manifest.json file from this repo.

This project uses:

• React Webpack for the UI.
• TypeScript for type safety.
• Prettier for code formatting.
• Figma plugin API for interacting with Figma.

We aim to improve Klever by enhancing the AppAgent Figma prototype. If you're interested in contributing, please visit our repository and follow the guidelines:

• Contribute to AppAgent

Your contributions can significantly impact designers and developers worldwide.

This project was inspired by Tencent's research on AppAgent: Multimodal Agents as Smartphone Users. We are grateful for their groundbreaking work in AI and usability testing.