project screenshot 1
project screenshot 2
project screenshot 3
project screenshot 4
project screenshot 5
project screenshot 6

The Grid

Created a search engine of 10M+ free 3D models with AR Experience. Users can mint models as NFTs with metadata of artist. Integrated Coinbase AI wallet that reward user based on prompts. Features an AR experience like Minecraft Earth to showcase that nft

The Grid

Created At

ETHGlobal San Francisco

Winner of

Neon EVM - Develop a EVM-based application 1st place

Project Description

This project is a comprehensive 3D model search engine with a unique combination of AI, blockchain, and AR technologies. It offers over 10 million free 3D models available in the widely supported GLB format, sourced from platforms like GitHub, Google, and others, all licensed under Creative Commons. The models are ready to be used in creative projects, with a strong focus on adhering to CC licensing rules to ensure proper attribution and usage rights. The platform's search engine is designed for 3D creators who want easy access to high-quality assets, with efficient filtering and fast search results. Once a model is chosen, users can mint it as an NFT. The minting process stores the details about 3d model like name etc and also metadata about the artist who originally created the model, ensuring proper recognition for the original creator. This feature is powered by Metaplex Core, a framework that standardizes the metadata for NFTs and makes them compatible across multiple platforms. Each minted NFT carries data of its creator, making it a verifiable digital asset. In addition to search and minting capabilities, the platform includes an AI-powered feature that integrates with Coinbase's AI wallet. Users can input a prompt, and the AI will suggest three relevant 3D models based on their query. The user is then asked to choose the model that best matches their needs, providing feedback that helps the AI learn and refine its recommendations. In return for their feedback, users are rewarded. This feedback loop enhances the AI's ability to prioritize the most relevant models in future searches, improving the overall search experience for all users. The project also offers a highly immersive augmented reality (AR) experience, inspired by games like Minecraft Earth and Pokémon GO. Users can explore the real world with their mobile devices, viewing 3D models in AR. These models can be placed in the real world, allowing users to experience them in a more tangible way. Cross platform integration as both mobile and PC players to interact and place 3D models in the AR world. Players can also fetch NFTs they’ve previously minted and place them in the AR world. This gamified interaction with digital assets not only enhances user engagement but also bridges the gap between virtual and physical spaces. The entire platform is built on blockchain technology, particularly the neon evm and Coinbase blockchain, to ensure decentralized ownership and secure transactions. Users can see and download their digital assets, including their minted NFTs, through their wallets. This combination of AR, blockchain, AI, and creative tools provides a one-stop platform for 3D creators, gamers, and collectors alike, making it a revolutionary tool in the 3D creative community.

How it's Made

The project is built using a variety of cutting-edge technologies that work together to create an advanced, multi-functional platform. Here's a breakdown of how each component fits into the overall structure: Blockchain Layer: Neon EVM and Metaplex Core • Neon EVM (Ethereum Virtual Machine) allows for the deployment of Ethereum smart contracts on the Solana blockchain. By using Neon, the project can leverage Solana’s high-speed, low-cost transactions while maintaining compatibility with Ethereum's robust developer ecosystem. This is crucial for managing the NFT minting process efficiently and cost-effectively. • Metaplex Core is used for minting the NFTs. It simplifies the process of creating NFTs by standardizing metadata storage and enabling seamless interaction with various platforms. Metaplex ensures that when users mint a 3D model as an NFT, the metadata for the artist, is embedded into the token. AI Integration: Coinbase AI Wallet • Coinbase AI wallet is integrated to provide AI-powered 3D model recommendations. Users enter a prompt, and the AI suggests three models based on the input. After users select the most relevant model, they provide feedback that enhances the AI’s future performance. This creates a continuous loop of improvement for the search functionality and rewards users for their engagement. Web Search Engine: AWS EC2 and Three.js • The AWS EC2 instance serves as the backbone for the search engine, managing the large volume of 3D models (10 million+). AWS EC2 was chosen for its scalability and reliability, ensuring fast search results and uninterrupted service. Augmented Reality: Google Geospatial Creator and Unity 3D • Google Geospatial Creator enables the AR functionality of the platform. It leverages Google’s extensive location-based data to create realistic, geo-referenced AR experiences. This feature is key to allowing users to place 3D models in real-world locations, similar to games like Pokémon GO or Minecraft Earth. • Unity 3D powers the AR game aspect, allowing users to interact with their minted NFTs in a virtual version of the real world. Unity’s robust AR development tools, combined with Google Geospatial, provide an immersive, location-based experience where users can see and manipulate 3D models in real time. Frontend: HTML, CSS and threejs • The HTML, CSS and threejs framework is used for the frontend interface, ensuring a clean, responsive design that makes the platform accessible across multiple devices. It provides users with an intuitive experience when searching for models, and engaging with AR content. Notable Hacks • A notable hack is the integration of Neon EVM to use Solana's blockchain with Ethereum compatibility. This allows the project to benefit from Solana’s speed and low fees while maintaining the broader Ethereum ecosystem, which opens up additional possibilities for future integrations. • Another unique feature is the AI feedback loop with the Coinbase AI wallet. By encouraging users to select the best models from AI suggestions and rewarding them for their feedback, the system not only personalizes search results but also improves the model ranking algorithm over time.

background image mobile

Join the mailing list

Get the latest news and updates