PLUTO

Pluto (Personal Ledger & Utility Teaching Oracle) is an open-source hardware and software platform for personal crypto asset management, transaction automation, and real-time education. At its core, Pluto combines a secure hardware wallet with an intelligent voice assistant. Users can speak natural questions or commands—such as asking for token balances, simulating swaps, or requesting explanations of DeFi concepts—and Pluto will display answers, perform mock or real actions, and respond with voice and visual feedback.

The hardware is built around a Raspberry Pi 4, featuring an OLED display for expressive robot eyes and text, a Bluetooth speaker for TTS audio, and an onboard Microchip ATECC608A secure element for cryptographic operations. The software stack includes a voice-to-intent pipeline (speech-to-text, NLP intent routing), direct integrations with crypto subgraphs (for on-chain data), the Uniswap SDK (for swap simulation), Pyth oracles (for real market prices), and Gemini AI for educational Q&A. The system is modular: additional DeFi integrations can be plugged in without major rewrites, making Pluto a versatile oracle and wallet that acts as a true personal assistant for both newcomers and crypto veterans.

Pluto’s hardware layer uses a Raspberry Pi 4 as the main hub, connecting peripherals directly via GPIO and I²C. The OLED display (SH1106) and Microchip ATECC608A secure element share the Pi’s I²C bus. Audio output is handled by a Bluetooth speaker running through system PulseAudio.

On the software side, the backend API is written in Node.js (Express for HTTP endpoints), managing the voice pipeline and intent routing. Speech recognition is performed using Whisper and Google Speech APIs, while NLP-based intent classification is implemented via custom rules—mapping transcripts to “educational,” “integrations,” or “interactions” branches.

Subgraphs (on The Graph) fetch token balances and history, Uniswap’s SDK simulates swaps for quoted output, and Pyth oracles deliver live asset prices. For Q&A and explanations, Pluto calls the Gemini API directly. The hardware API, written in Python, offers endpoints for display text, emotion rendering, and TTS, which are invoked as needed based on software responses. This separation keeps hardware management robust while letting the assistant evolve through new service integrations.

Notable hacks: Multiplexing I²C bus with external pull-up resistors to allow the OLED and ATECC608A to coexist; modularizing API endpoints for easy future partnerships (e.g., plugging in new DeFi protocols in a few lines); and using both real and simulated transaction flows—so Pluto can teach users safely or execute for power-users.

Partner technologies provided reliable real-time speech, crypto market data, and swap simulation, allowing highly interactive features without the boilerplate of custom contract calls or direct node management. This synergy made Pluto much easier to rapidly prototype and expand!