Gogaku!!!
Learn foreign languages with a voice-based game using LINE Talk & ChatGPT interface. Easily practice listening & speaking with NFT conversation scenarios—buy, exchange & complete to earn proof NFTs
Project Description
This project is a language learning service that combines the popular Japanese messaging app LINE, OpenAI's ChatGPT, and non-fungible tokens (NFTs). LINE is widely used in Japan with a monthly user base of 94 million people.
Users add GOGAKU!!! as a friend on LINE to gain access to the service. When users request a question, GOGAKU!!! provides a conversational-style prompt in audio format. Users respond with voice messages, and ChatGPT reviews the content for appropriateness and checks for grammatical errors, providing a score. If a user scores over 8 out of 10, they clear the theme and can mint an NFT as proof of their success.
How it's Made
This project is a language learning service that combines the popular Japanese messaging app LINE, OpenAI's ChatGPT, and non-fungible tokens (NFTs).
The service is built on LINE Messaging API, and it creates quizzes using OpenAI's API. Google Text-to-Speech reads the quizzes aloud, and audio files are generated and sent to users via LINE. Users then respond to the quizzes using voice messages.
On the backend, the Whisper API is employed to transcribe voice messages into text, and ChatGPT is utilized to grade the responses. When users achieve a certain score, they earn the right to mint NFTs. The rights to mint NFTs are managed off-chain through Firebase, allowing users to mint NFTs at their convenience.
The NFTs are issued as ERC1155 tokens using ThirdWeb's signature minting feature. The frontend is built using Next.js, and the Scroll network is adopted for NFT transactions.
In summary, this project is an innovative language learning service that combines the LINE messaging app, ChatGPT, and NFTs. Users can practice speaking and listening through interactive quizzes, and their progress is rewarded with NFTs that can be minted and exchanged.
