Speaky

Speaky lets you control your Ethereum wallet through natural conversation. Just speak to check your balance or send transactions - no complex interfaces needed.

We're building the voice interface for Web3. Currently, you can connect your MetaMask wallet and use voice commands like "What's my balance?" or "Send 0.01 ETH" to interact with the blockchain. The AI understands natural language variations.

Our vision extends beyond a voice assistant. We're developing a 3D holographic character that will live in your browser and eventually break free through AR, making blockchain interactions as natural as talking to a friend. Think of it as bringing the blockchain to life - a speaking, visual entity you can interact with naturally.

The project includes three live deployments:

• speaky.wtf - Main voice wallet interface
• deck.speaky.wtf - Project presentation
• changelog.speaky.wtf - Development progress tracking

With ENS resolution allowing sends to addresses like "vitalik.eth". Future phases will introduce the 3D character and AR capabilities, transforming how people interact with Web3.

Speaky combines OpenAI's Realtime API with WebRTC for instant voice processing. When you speak, your voice streams directly to OpenAI's model, which understands your intent and executes blockchain operations through our custom tool system.

The technical stack:

• Voice Processing: WebRTC establishes a real-time audio channel, streaming to OpenAI's Realtime API for natural language understanding
• Blockchain Integration: Ethers.js handles all Ethereum operations - wallet connection, balance queries, and transaction sending through MetaMask
• Frontend: Built with Nuxt 4 and deployed on Vercel, providing a responsive interface with real-time wallet status updates
• Tool Architecture: Custom function-calling system allows the AI to execute wallet operations based on voice commands

The most interesting challenge was bridging the async nature of blockchain transactions with real-time voice feedback. We implemented a state management system that tracks wallet status, pending transactions, and provides immediate voice responses while operations complete in the background.

All three sites (main app, deck, changelog) are separate Nuxt applications deployed on Vercel, demonstrating modularity and clean separation of concerns. The presentation deck uses Slidev for smooth animations, while the changelog automatically fetches GitHub releases.

Next steps include beginning work on the 3D character using Three.js, then targeting WebXR for AR experiences.