project screenshot 1
project screenshot 2
project screenshot 3
project screenshot 4
project screenshot 5
project screenshot 6

HarmonyLens

Our unique social media platform, built on Lens Protocol, uses AI to analyze emotions from users' posts and creates personalized music. Stored securely on Filecoin, this music enhances user engagement, offering an interactive experience.

HarmonyLens

Created At

ETHGlobal Lisbon

Winner of

trophy

🏊 The Graph — Pool Prize

Project Description

Our project is a groundbreaking social media platform that revolutionizes the way users interact and express themselves. The platform is built on the Lens Protocol, a Web3 social graph hosted on the Polygon Proof-of-Stake blockchain. This ensures that users own their data and relationships, breaking free from the constraints of traditional, centralized social networks. By ensuring data portability, users can seamlessly transport their data across different applications built on top of the Lens Protocol, amplifying their freedom and control.

One of the distinctive features of our platform is the use of an AI model for emotion analysis. When a user posts on our platform, the AI model scans the content of the post and extracts the underlying emotions. This could range from happiness, sadness, excitement, to anger, among others. The analysis is not only accurate but also provides a unique way for users to understand and visualize their emotional states.

The platform then takes this emotion analysis a step further. Using ChatGPT, a state-of-the-art language model developed by OpenAI, it generates a unique note flow based on the identified emotions. This note flow is then transformed into a piece of music, creating a unique and personalized sonic reflection of the user's emotional state.

To ensure the secure and permanent storage of these unique pieces of content, the platform leverages Filecoin, a decentralized storage network. Once the music is generated, it is stored on Filecoin, from where it can be accessed, listened to, and shared by the user within the platform. This not only ensures the longevity of the content but also enhances the sharing and community experience within the platform.

In essence, our platform is more than just a social media site. It's a unique space where emotions find a new mode of expression - transforming into music. By blending emotion analysis, AI-powered music generation, and secure blockchain storage, the platform offers a unique, engaging, and secure social media experience that truly resonates with users.

As we look towards the future, we plan to integrate with more social media platforms, improve our music generation capabilities, and expand our blockchain integration. Our aim is to continually innovate and evolve, offering a unique, engaging, and secure social media experience that sets new standards in the industry.

How it's Made

Our platform is made through the integration of several cutting-edge technologies and frameworks, each serving a crucial role in the system. Here's a step-by-step breakdown of how it's made:

  1. Lens Protocol & Polygon Blockchain: The foundation of our platform is the Lens Protocol, a Web3 social graph hosted on the Polygon Proof-of-Stake blockchain. This allows for the creation of a user-owned, open social graph where users can control their own data and social relationships. The Polygon blockchain enables high-speed and low-cost transactions, making it a suitable choice for our platform.

  2. AI Emotion Analysis: We use a sophisticated AI model to analyze the emotional content in users' posts. This model has been trained on a large dataset to accurately identify various emotions. It processes the user's text and determines the predominant emotional state.

  3. Music Generation with ChatGPT: Once the emotional state has been determined, we use ChatGPT, an advanced language model developed by OpenAI, to generate a unique note flow. This note flow is based on the emotion detected in the user's post and is used to generate a piece of music that reflects that emotional state.

  4. Filecoin for Storage: The generated music is then stored on Filecoin, a decentralized storage network. Filecoin ensures the secure and reliable storage of the music, allowing users to access and share their music at any time.

  5. User Interface: The front-end of our platform is designed to provide a user-friendly and intuitive interface. Users can easily create posts, view the results of the emotion analysis, listen to the generated music, and share their music with others on the platform.

  6. Security Measures: Throughout the development process, security measures have been integrated into our platform. User data is encrypted and securely stored, and data transmission is protected using advanced encryption protocols.

In terms of programming languages and tools, our platform might typically involve the use of JavaScript (with frameworks like React for the frontend and Node.js for the backend), Solidity for smart contracts on the Polygon blockchain, Python for AI and machine learning components, and IPFS (InterPlanetary File System) for interaction with Filecoin. However, the exact tools and languages used could vary based on specific project requirements and the development team's preferences.

background image mobile

Join the mailing list

Get the latest news and updates