Hands free onchain experiences for the visually impaired and everyone else
Prize Pool
Prize Pool
"Look Ma, No Hands!" is a hands-free wallet that’s changing the game for how people interact with blockchain technology. Designed with inclusivity in mind, it’s perfect for visually impaired users, those with mobility challenges, or anyone who could use a hands-free solution—whether you’re driving, juggling a busy schedule, or even enjoying a relaxing massage. By combining advanced voice tech with secure blockchain protocols, the app makes on-chain transactions effortless, safe, and totally stress-free.
This project focuses on bringing Intents, AI agents, and ERC 7730 together. Because we believe that these technologies have a great potential to serve those who are most in need of hands free and simplified interaction with blockchain applications.
Technologies and How They’re Integrated
Voice-Agent Layer:
We utilized OpenAI models to power our voice agent. These models were trained specifically to understand intent-based prompts for on-chain transactions. For example, when a user says, “Buy 10 ETH” or “Sell $500 worth of Dogecoin,” the agent parses the command and translates it into actionable instructions for the blockchain. This voice layer ensures smooth communication between the user and the app, enabling natural language interaction. Wallet Integration:
We used the Coinbase Wallet SDK to handle wallet creation, funding, and transaction execution. This allowed us to offer a streamlined onboarding experience and ensure secure storage and management of assets. The SDK also made it easy to integrate with various chains, supporting flexibility for the user. Clear Signing Protocol:
Security is a cornerstone of this project, so we integrated Ledger’s ERC-7730 clear signing protocol. This ensures that users can confidently approve transactions, knowing exactly what they’re signing without visual confirmation. For voice-powered transactions, this was a game-changer for user trust. Swap Execution:
For intent-based token swaps, we leveraged 1inch Fusion Plus. This decentralized exchange aggregator provided efficient and competitive rates for transactions, allowing us to demonstrate seamless swaps during our demo. Transaction Feedback:
To confirm that transactions were successfully processed, we integrated BlockScout Explorer APIs. These APIs provided real-time feedback on transaction outcomes, giving users the assurance they needed after completing a trade. How These Technologies Work Together The process starts when a user interacts with the voice agent, which interprets their intent and constructs a transaction request. The app communicates with the Coinbase Wallet SDK to prepare the wallet for the transaction. 1inch Fusion Plus handles the actual swap execution, while Ledger’s clear signing ensures the user approves the transaction with full transparency. Once the transaction is processed, the BlockScout API verifies the outcome and relays confirmation back to the user, either audibly or through another hands-free feedback mechanism. Partner Technologies and Their Benefits OpenAI: Enabled advanced voice recognition and natural language understanding, crucial for building a hands-free solution. Coinbase Wallet SDK: Simplified wallet operations, making it easy to onboard users and manage funds securely. Ledger ERC-7730: Boosted user confidence by delivering human-readable transaction details for approval. 1inch Fusion Plus: Optimized token swaps with competitive rates, ensuring smooth and cost-effective trading. BlockScout: Provided seamless transaction tracking and feedback, adding a layer of transparency and reliability. Hacky and Notable Implementations Custom Training for Intent Recognition:
We fine-tuned OpenAI models to not only understand typical trading commands but also to handle ambiguous or slang-laden inputs. For example, “Buy a bit of BTC” would be interpreted as a default amount set by the user. Error-Handling via Voice Feedback:
Instead of requiring a screen, we implemented dynamic voice feedback for transaction errors or unclear intents, making the app truly hands-free. Multi-Chain Compatibility:
While most solutions focus on a single chain, we designed the app to work across multiple chains (e.g., Gnosis, Arbitrum, Base, Polygon) without any additional setup for the user. Ledger Integration with Voice Commands:
This was a unique challenge. By pairing Ledger’s clear signing with voice-based interactions, we bridged the gap between hardware-level security and accessibility-focused design.