0xNARC

Recognition and Motivation: Traditional hackathons often provide limited recognition to participants, especially those who don't win top prizes. By issuing soulbound NFTs, every participant who makes a valid submission receives a unique and permanent digital token of recognition.

Encouraging SDK Utilization: By tying the reward to the utilization of a sponsor's SDK, this approach encourages participants to engage more deeply with the sponsor's technology.

Time Constraints: Thoroughly evaluating each submission requires time, which can be a scarce resource in large-scale competitions.

Ensuring a fair and standardised evaluation of projects and measuring utilisation, as well as accurately reporting specific instances where sponsor code was used. The challenge here was mostly in consistency of judgement results, which we drastically improved with various context-stuffing and prompt engineering techniques.

We use the docs and bounty requirements specified by each sponsor to validate the completeness of the implementation.

A thorough evaluation can cost up to $1 in gpt4 api usage. Similar scoring processes can be performed with local open source models, but see a drop in evaluation accuracy, especially for large codebases.