Final month, we partnered with Lablab.ai to host the Llama 2 Hackathon with Clarifai. The Hackathon aimed to nurture creativity within the improvement of AI-first merchandise utilizing the highly effective Llama 2 LLM from Meta, with any one of many 7B, 13B, and 70B parameter variants. A complete of 1,765 fans comprising 227 groups registered, leading to a powerful 51 challenge submissions.
With so many nice entries, the duty of choosing the winners proved to be a difficult one! Listed below are a few of the standout initiatives.
Constructing with Llama 2 & different fashions from Clarifai Neighborhood
The problem required contributors to make Llama 2 the core part of their initiatives whereas additionally leveraging different groundbreaking fashions like Secure Diffusion XL, Code Llama, GPT-4, and extra.
1st Place 🥇: SightCom
SightCom, received the highest prize with a cell app designed for visually impaired people utilizing the Flutter framework. It makes use of Blip 2, Colour Recognition mannequin, Optical Character Recognition mannequin, Llama 2 7B and BARCODE-QRCODE-Reader workflow within the backend.
It gives 5 distinctive accessibility options, all seamlessly activated via voice instructions:
1. Scene Description: Utilizing Blip 2, a picture captioning mannequin, the app narrates the objects it identifies via the digital camera, serving to customers perceive their environment.
2. Colour Recognition: It identifies the colours of objects, enhancing their consciousness of the visible world utilizing Clarifai’s Colour Recognition Mannequin
3. Textual content Recognition: Utilizing an Optical Character Recognition mannequin, textual content inside the digital camera’s view is transformed into spoken phrases.
4. Product Reader: By scanning barcodes with the BARCODE-QRCODE-Reader Workflow, the app gives detailed details about merchandise, empowering customers to make knowledgeable decisions whereas purchasing.
5. QnA Chatbot: Powered by Llama 2 7B mannequin, the app additionally gives a digital assistant that responds to customers questions.
2nd Place 🥈: FINGU: Your personal Private Finance Assistant
FINGU received second place with its answer aimed toward dealing with private funds. Think about FINGU as a monetary knowledgeable that continually learns out of your monetary interactions, behaviors, and market tendencies.
Here is how FINGU works:
1. Consumer Interplay: The bot interacts with customers via Telegram messages. It takes instructions, prompts, and uploads of CSV recordsdata as inputs.
2. Llama 2 7B Mannequin: To generate significant monetary recommendation, it makes use of the Llama 2 7B mannequin to know consumer inputs and generate contextually related responses.
3. Position Immediate Optimization: The bot begins every dialog with a fastidiously designed function immediate that guides the bot’s habits. This function immediate gives helpful responses, eliminating extreme randomness.
4. CSV Interplay: Customers can add CSV recordsdata, and the bot processes the content material of the file utilizing common expressions to take away date and time codecs. It then makes use of this processed content material to formulate a dialog with the consumer.
5. Reminiscence Administration: It additionally employs LangChain’s reminiscence administration that enables the bot to take care of separate dialog histories for every consumer. This permits the bot to recall previous interactions and supply extra customized recommendation.
It additionally employs end-to-end encryption to maintain data confidential and reliable.
third Place 🥉: Slide Deck AI
SlideDeck AI, the third-place winner, is an AI-powered answer that creates presentation slide decks in just some easy steps.
Begin by describing the subject of your presentation, and based mostly in your description, SlideDeck AI generates the content material and descriptions in your slides utilizing the Llama 2 13 B Mannequin. It then transforms your pure language content material into structured JSON information utilizing GPT 3.5. Subsequent it creates a PowerPoint slide deck utilizing that information.
However SlideDeck AI does not cease there. It additionally fetches useful assets from the net in your presentation matter, supplying you with beneficial analysis materials, and it even creates idea artwork associated to your matter utilizing the Secure Diffusion XL 1.0 mannequin.
Llama 2 Hackathon Finalists 🏆
IntelliSum – Clever Summarizer for Textual content
IntelliSum is a browser-compatible extension powered by Llama 2 to reinforce the net expertise. It does Summarization and extraction of textual content from a given URL, generates AI prompts utilizing the summarized textual content and also can generate photos for that immediate utilizing the Secure Diffusion mannequin.
Definetely-Not-Jarvis
Positively-Not-Jarvis one other finalist is an app for immediate and correct question decision. It makes use of Llama 2 at its core, understands varied technical, informational, or informal queries and delivers swift and exact responses.
It may be built-in into any Slack workspace as a customized bot. Plus, it retains studying and bettering out of your questions, adapting to your group’s distinctive communication fashion for even higher responses over time.
DefendIQ Empowering Navy Operations via AI
DefendIQ is a safety answer that mixes AI and IoT units for unparalleled safety. The customizable AI adapts to distinctive wants, whereas IoT units like cameras and drones work collectively to verify all the pieces stays protected. DefendIQ enhances human capabilities by studying from real-time responses and coaching in your information. It makes use of Clarifai’s weapon detection and Meta’s Llama 2 70 B fashions.
Llama2 GPT CodePilot VSCode Extension
Llama2 GPT CodePilot VSCode Extension is a useful instrument that makes use of CodeLlama to help builders in constructing and debugging code.
Present it with enter, and it generates related responses, making coding experiences extra handy. You will discover it on the VSCode extension market beneath the title Llama2-GPT-CodePilot.
Last Phrases
Due to Lablab.ai for partnering and internet hosting this hackathon, and congratulations to the entire hackers that got here collectively to make it successful. You may take a look at all the submitted ideas, prototypes and pitches within the Lablab.ai submission web page right here.
This was our first hackathon utilizing generative AI and LLMs, and the good concepts, vitality, and collaboration from all hackers concerned helped us notice this to a higher degree than we might’ve hoped. We have been actually delighted and shocked by each the quantity and high quality of the submissions.
Need to keep within the loop for the subsequent Clarifai Hackathon? Comply with us on Twitter to remain updated!