Aloria

This project uses AI agents to plan tasks, parse images and execute steps of all kinds of tasks by operating on a web browser. Users need to login with their wallet, pay the node that host the service to ask AI agents to complete tasks like booking tickets, monitoring news or price changes, gathering information from reddit, etc. Users can also publish their task prompts to claim ownership. XMTP sends users asynchronous updates about their tasks.

The app is built with next.js and typescript and we use:

• React for frontend
• Claude agents to plan for tasks
• Gemini to parse screenshots of web browser content to decide the most appropriate next interaction
• Playwright to operate on web browsers
• Sharp to process screenshots and images
• Story to publish user prompts
• XMTP to send out agent updates to user wallets
• Dynamics to allow user login with different wallets
• Walrus to store/retrieve the screenshots of task execution