0rbit

0rbit is a Web3 platform that combines AI image editing with blockchain tokenization.

0rbit

Created At

ETHGlobal New Delhi

Project Description

0rbit is a decentralized image editing and AI token generation platform that combines Web3 technology with AI-powered creative tools. Users can upload images, enhance them with AI processing, generate meme token metadata, and mint intelligent NFTs while maintaining full provenance and creator ownership. Key Features: AI-powered image editing and enhancement Automatic meme token generation with AI-created metadata NFT minting with on-chain provenance Decentralized storage via IPFS/Lighthouse Web3 wallet integration Creator XP tracking system Tech Stack: Next.js 14 with TypeScript Smart contracts on Ethereum Fluence integration for secure AI processing 0G Labs infrastructure for compute and storage IPFS for decentralized file storage The platform serves as a bridge between traditional image editing and Web3, allowing creators to monetize their work through tokenization while maintaining the security and decentralization benefits of blockchain technology.

How it's Made

How It's Made

Architecture Overview

0rbit is built as a full-stack Web3 application that integrates decentralized infrastructure with traditional web technologies. The platform uses Next.js for the frontend, smart contracts for blockchain logic, and multiple decentralized services for processing and storage.

Core Technology Stack

Frontend & Backend

  • Next.js 14 with App Router for server-side rendering and API routes
  • TypeScript for type safety across the entire application
  • Tailwind CSS + shadcn/ui for modern, responsive design
  • React with custom hooks for state management

Web3 Integration

  • Wagmi + Viem for Ethereum interactions
  • WalletConnect for multi-wallet support
  • Custom smart contracts for NFT minting and token generation

Decentralized Infrastructure

  • Fluence for secure AI processing (VM ID: 01998e2a-a8a5-7643-af46-1fdf20afd01c)
  • Lighthouse for IPFS storage and file management
  • 0G Labs for compute and storage primitives

The Complete Pipeline

1. Image Upload & Processing

Image Normalization: Custom algorithm that standardizes images across different formats (RAW, JPEG, PNG) EXIF Extraction: Uses exifreader library to extract camera metadata, GPS data, and editing history XMP Sidecar Generation: Creates XML metadata files that track every edit operation for audit trails

2. AI Processing via Fluence

Why Fluence?

  • Security: API keys never exposed to frontend clients
  • Decentralization: Distributed AI processing across multiple nodes
  • Reliability: Fault-tolerant network with automatic failover
  • Privacy: User data processed through decentralized network

3. AI Token Generation Pipeline

AI Processing Steps:

  1. Image Analysis: AI examines the uploaded image for visual elements, style, and content
  2. Metadata Generation: Creates creative token name, symbol, description
  3. Social Links: Generates relevant Twitter, Telegram, and website suggestions
  4. JSON Parsing: Extracts structured data from AI response

4. Decentralized Storage with Lighthouse

Storage Strategy:

  • Original Images: Stored on IPFS with permanent links
  • Edited Versions: Each edit creates new IPFS entry
  • XMP Sidecars: Metadata files linked to original assets
  • Audit Trails: Complete history of all operations

5. Smart Contract Integration

Blockchain Logic:

  • NFT Minting: Each creation becomes a unique NFT
  • Provenance Tracking: On-chain record of creator and timestamp
  • Metadata Storage: IPFS hashes stored on-chain
  • Royalty System: Built-in creator royalties

6. 0G Labs Integration

0G Labs Benefits:

  • Verifiable Compute: AI operations with cryptographic proofs
  • Decentralized Storage: Permanent, censorship-resistant storage
  • INFT Support: Intelligent NFTs with dynamic behaviors
  • Audit Trails: Immutable records of all operations

Manual Editing Features

Editing Capabilities:

  • Real-time Preview: Live editing with instant feedback
  • Edit History: Complete undo/redo functionality
  • XMP Tracking: Every edit recorded in metadata
  • Batch Operations: Multiple edits in sequence

Hacky Solutions & Notable Implementations

1. Base64 Image Processing

Efficient base64 handling for large images with compression for API calls

2. XMP Sidecar Generation

Custom XMP metadata tracking that records every edit operation with timestamps and parameters

3. Fluence Integration Hack

Direct endpoint routing through Fluence network, bypassing OpenAI's servers entirely for better security and performance

Partner Technology Benefits

Fluence Network

  • Decentralized AI: No single point of failure
  • Privacy: User data never leaves decentralized network
  • Cost: Lower processing costs than centralized providers
  • Reliability: Distributed processing with automatic failover

Lighthouse IPFS

  • Permanent Storage: Files stored permanently on IPFS
  • Fast Retrieval: Optimized for web applications
  • Metadata Support: Rich metadata and search capabilities
  • Cost Effective: Affordable decentralized storage

0G Labs

  • Verifiable Compute: Cryptographic proofs of AI operations
  • Decentralized Storage: Censorship-resistant asset storage
  • INFT Support: Intelligent NFTs with dynamic behaviors
  • Audit Trails: Immutable records of all operations

Performance Optimizations

1. Image Compression

Smart image compression for API calls while maintaining quality

2. Lazy Loading

Lazy load images and components for better performance

3. Caching Strategy

Cache AI responses and IPFS data for faster retrieval

Security Measures

1. API Key Protection

  • Server-side Only: API keys never exposed to frontend
  • Fluence Routing: All AI requests go through decentralized network
  • Environment Variables: Secure key management

2. Data Privacy

  • Local Processing: Images processed locally before upload
  • Encrypted Storage: All data encrypted before IPFS storage
  • Audit Trails: Complete transparency of all operations

Notable Technical Achievements

1. Seamless Web3 Integration

The platform successfully bridges traditional web development with Web3 technologies, making blockchain interactions feel native to users.

2. Decentralized AI Processing

By routing AI requests through Fluence, we've created a truly decentralized AI processing pipeline that maintains privacy and security.

3. Comprehensive Metadata Tracking

The XMP sidecar system creates a complete audit trail of every edit operation, ensuring full provenance and transparency.

4. Cost-Effective Storage

By combining IPFS with 0G Labs storage, we've created a cost-effective, permanent storage solution that scales with the platform.

This architecture creates a robust, decentralized platform that maintains the user experience of traditional web applications while providing the security, transparency, and ownership benefits of Web3 technology.

background image mobile

Join the mailing list

Get the latest news and updates