Digital assistant for DeFi that uses AI-powered local speech-to-text.
This project uses Whisper ML models for speech to text and uses that as a primary interface to manage a DeFi wallet. Simply speak to it as you would to other digital assistants such as Siri and it will carry out operations with the wallet such as sending tokens or making trades on decentralized exchanges.
This project uses Whisper model hosted on HuggingFace and loads it locally in Javascript. It uses Vite for the web bundler and ReactJS for the UI. I plan to integrate other technologies as well for interactions for the wallet. It will integrated with various protocols to enable different operations.