project screenshot 1
project screenshot 2
project screenshot 3

Vitalik

Video streaming AI assistant helping you with full world context

Vitalik

Created At

ETHGlobal New York 2025

Winner of

Flow Foundation

Flow - Flow Builder Pool Prize

Prize Pool

ENS

ENS - Best use of L2 Primary Names

Project Description

πŸ₯½ Vitalik - Personal Smart Glasses Assistant

Transform your smart glasses into an AI-powered shopping assistant that understands what you're looking at and handles cryptocurrency payments with just your voice.

🎯 What is Vitalik?

Vitalik is a cutting-edge AI shopping assistant designed for the next generation of AR/smart glasses. Simply look at any product, say "Hey Vitalik," and instantly get prices, make purchases, and complete transactions using cryptocurrency - all through natural voice commands.

See It. Ask About It. Buy It.

No screens. No typing. Just natural conversation.

✨ Key Features

πŸ‘οΈ Visual Intelligence

  • Real-time object recognition - Identifies products just by looking at them
  • Context-aware responses - Understands what you're looking at and provides relevant information
  • Multi-item detection - Can identify multiple products in your field of view

πŸŽ™οΈ Voice-First Experience

  • Wake word activation - "Hey Vitalik" or "Okay Vitalik" to start
  • Natural language processing - Speak naturally, no rigid commands
  • Audio-only feedback - Designed for screenless interaction

πŸ’° Instant Crypto Payments

  • PYUSD on Arbitrum - Lightning-fast stablecoin transactions
  • Flow blockchain - Support for Flow tokens and NFTs
  • One-voice checkout - Confirm purchases with a simple "yes"
  • On-chain verification - Every transaction is real and verifiable

πŸ” Enterprise-Grade Security

  • Authorized vendors only - Curated list of trusted merchants
  • Voice confirmation required - No accidental purchases
  • Duplicate protection - Smart detection prevents double-charging
  • Blockchain transparency - All transactions on public testnets

πŸš€ Live Demo

Experience the future of shopping:

  1. Enable camera and microphone when prompted
  2. Say "Hey Vitalik" to activate
  3. Show any product to the camera (try a Coke can, phone charger, or water bottle)
  4. Ask about pricing - "What does this cost?"
  5. Make a purchase - "I want to buy this"
  6. Confirm with voice - Say "yes" to complete the transaction

πŸ’‘ Use Cases

Retail Shopping

Walk through stores and instantly get product information and prices without pulling out your phone.

Vending Machines

Look at items in a vending machine and purchase with voice commands - no physical interaction needed.

Museum & Gallery Tours

Get information about artifacts and artwork, with optional donation or purchase capabilities.

Accessibility

Empowers visually impaired users with voice-guided shopping and audio confirmations.

🌟 Vision

We believe the future of shopping is:

  • Frictionless - No apps, no cards, no checkout lines
  • Intuitive - As natural as asking a friend
  • Transparent - Every transaction on-chain
  • Accessible - Voice-first for everyone

Vitalik is more than a shopping assistant - it's a glimpse into a world where technology disappears into the background, leaving only natural human interaction with instant, global, programmable money.

How it's Made

πŸ› οΈ Technology Stack

  • AI Vision: Google Gemini 2.5 Flash for real-time visual analysis
  • Blockchain: Arbitrum Sepolia (PYUSD) & Flow Testnet
  • Voice Processing: WebRTC streaming with live transcription
  • ENS Integration: L2 optimistic name resolution
  • Framework: Next.js with React

πŸ—οΈ Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”     β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”     β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   Smart Glasses │────▢│   Gemini AI     │────▢│   Blockchain    β”‚
β”‚   Camera + Mic  β”‚     β”‚  Vision + Voice  β”‚     β”‚  Arbitrum/Flow  β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜     β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜     β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
         β”‚                       β”‚                        β”‚
         β”‚                       β–Ό                        β”‚
         β”‚              β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”              β”‚
         └─────────────▢│   Voice Output   β”‚β—€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚   Confirmation   β”‚
                        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
background image mobile

Join the mailing list

Get the latest news and updates