ZenPass

ZenPass is a next-generation POAP (Proof of Attendance Protocol) platform that transforms event participation into a dynamic, interactive digital experience. By combining geo-fencing, augmented reality (AR), AI-Agent powered booth recognition, and multi-chain support via NodIt, CCIP/Chainlink, ZenPass enables attendees to collect unique, branded POAPs that serve as verifiable proof of their participation—minted on the ideal blockchain network based on the intent.

ZenPass is a full-stack, geo-fenced, AR-powered, multichain POAP platform designed for real-world event engagement. It bridges Web3, AI, and immersive experiences by combining various bleeding-edge tools and protocols.

🔧 Core Tech Stack

• Frontend:
  Built using React, TailwindCSS, and TypeScript for responsive, strongly-typed UI components. We also use React Fibre and Three.js to render dynamic AR overlays in the browser.

• AI Booth Recognition:
  The camera captures booth banners which are sent to a lightweight vision model hosted via Replicate (or local fallback inference). The model identifies which booth the user is facing (e.g., “Nodit”, “Polygon” or "World-Coin").

• Geo-Fencing:
  Browser-based Geolocation API ensures the user is within the defined event zone before proceeding with any interaction. We use GPS radius checks around event coordinates.

• Stylized Image Generation for Social Sharing:
  Post-interaction, we pass the booth snapshot through a style transfer pipeline (e.g., Ghibli or pixel-art GAN). The output is cached and offered as a shareable image, ideal for socials.

🌉 Smart Contract + Blockchain Infra

• Source Chain (Mint Trigger):
  A smart contract is deployed on Base Sepolia. Once AI + geo verification is done, the mint function is triggered here.

• Ai MultiChain POAP Minting using Intents:
  Chainlink CCIP handles the secure routing of mint instructions to the appropriate destination chain (e.g., Polygon). This ensures that POAPs are minted natively on the brand’s chain of choice.

• POAP Contracts:
  These live on the target chain and handle minting of NFTs that include:

  • Booth identifier
  • Geo-coordinates
  • Stylized image (stored via IPFS)

🔔 Nodit Protocol Integration

• Webhook Notifications:
  We integrate Nodit Webhooks to notify users in real-time when their POAP mint is successful—this includes toast messages and push notifications.

• Web3 Data APIs:
  Nodit’s APIs power the user dashboard, showing a list of collected POAPs including metadata (location, style, event name). This enables a dynamic profile experience.

🧪 Hacky But Cool

• We used a base64-encoded visual classifier prompt to switch between on-device and cloud AI recognition, reducing latency while retaining flexibility.

• All validations (AR + Geo + AI) are performed off-chain, and only the validated payload is submitted on-chain—cutting gas costs and failures.

• The image stylizer uses a cascaded two-model pipeline (scene simplifier → pixel-art / Ghibli style) to generate ready-to-share art in ~2-3s.

🤝 Partner Tech Benefits

• MultiChain with Polygon: Abstracted away cross-chain logic, allowing us to focus on UX without sacrificing decentralization.

• Nodit Protocol: Supercharged notifications and data sync. No need to roll our own infra for real-time alerts or historical POAP tracking.

• World ID Integration: Used at the app level as proof of personhood, ensuring that only unique human users can mint POAPs. This added a Sybil-resistant layer of trust to our AR-based, real-world engagement flow.