Meet the Clarifai Champs of the Streamlit LLM Hackathon

In September, Clarifai was excited to be a part of an LLM Hackathon hosted by Streamlit. The Hackathon was meant to nurture creativity within the growth of AI-first merchandise utilizing highly effective LLMs.

Constructing with LLMs and different fashions from Clarifai group

The problem required contributors to create a Streamlit app by using know-how from Clarifai and 4 different companions: LangChain, AssemblyAI, Weaviate, and LlamaIndex.

A complete of 36 spectacular initiatives had been constructed utilizing Clarifai and submitted for judging. With so many nice entries, choosing two Clarifai winners proved difficult! Listed below are the initiatives that stood out probably the most!

Winner: GPT Analysis Buddy

GPT Analysis Buddy, one of many winners, is a Q&A and summarization bot leveraging the Nougat Transformer to learn analysis papers from sources like Arxiv and the ACL Anthology. It makes use of LLamaIndex to create a vector-based index for Q&A discussions and likewise leverages GPT 3.5 Turbo, Open AI’s Textual content Embedding, and Textual content Moderation fashions from the Clarifai Group, together with the Nougat Transformer.

Here is how GPT Analysis Buddy works:

1. With the user-provided URL of the arXiv or ACL Anthology analysis paper, it makes use of Nougat Transformer to learn the paper contents and get the markdown illustration of the paper.
2. Subsequent, it makes use of LLamaIndex to create a vector-based index for Q&A discussions to generate key insights from the paper, parallelly spinning up a customized chatbot engine.
3. Now, you possibly can ask the chatbot questions particular to the analysis paper. Earlier than answering, the question will probably be handed via a moderation engine, which decides whether or not the question is poisonous, hateful, or biased, utilizing Clarifai’s textual content moderation mannequin.

Winner: Persona Simulator

Persona Simulator options 5 completely different personas, every with their very own personalities, current actions, targets, and a set of obtainable instruments to find out their actions. These personas can create paintings, compose weblog posts, and share social media updates. The venture makes use of the Secure Diffusion XL 1.0 and GPT-4 fashions from the Clarifai Group.

Here is how Persona Simulator works:

The app accommodates a number of distinct personas, every represented by a paragraph of textual content, an inventory of pursuits, a bodily description, and a writing type description. It additionally has entry to quite a lot of instruments for inner reflection and exterior expression. Moreover, a workflow has been established during which every persona is guided independently to pick a activity primarily based on the instruments they will entry. Subsequently, they plan how one can execute the duty after which proceed to do it.

To get began, you choose a persona of your alternative and provides them their subsequent thought. Because it progresses, you’ll see their thought course of as they collect analysis, journal about their emotional response, create artwork and make numerous kinds of postings.

The instruments out there to the 5 AI personas embrace:

1. Learn the newest blogs: Retrieves the contents of the final three weblog posts for continuity.
2. Learn from journal: Retrieves the contents of the final three journal entries.
3. Create artwork: Generates numerous types of artwork, resembling pictures, work, and digital artwork.
4. Write in journal: Information data in a journal, facilitating thought processing after duties like QueryForInfo.
5. Put up on social media: Shares quick messages on social media, optionally together with pictures created utilizing CreateArt.
6. Write weblog submit: Allows writing long-format weblog posts for rapid publication.
7. Question for information: Serves as the first interface for asking questions and buying data for use in weblog entries.

Congratulations to those two winners!!

Honorable mentions🏆

Take a look at another superior initiatives under – the Honorable Mentions. Notice that they’re listed in no explicit order.

DocuTalk

DocuTalk is an LLM-powered chatbot that makes use of Clarifai’s documentation (Clarifai docs) as its data base and solutions questions.  It additionally leverages the embedding mannequin together with GPT-4 out there within the Clarifai Group. 

Tube-to-Textual content-Coach

Tube-to-Textual content-Coach is a exercise companion that transforms follow-along train movies into health routines.  Enter your favourite exercise video and it creates a exercise routine leveraging GPT-4 out there within the Clarifai Group.

Design Help

Design Help is a design assistant that helps information the design course of via questions, downside assertion era, product mock-ups, a pattern person journey, interviews from digital customers, and report era. This makes use of Open AI embeddings, GPT-4, content material moderation, and Secure Diffusion XL fashions all out there within the Clarifai Group. 

Remaining Phrases

Due to Streamlit for partnering and internet hosting this hackathon and a particular due to the opposite companions LangChain, AssemblyAI, Weaviate, and LlamaIndex. Additionally congratulations to the lots of of hackers that got here collectively to construct, be taught, and have enjoyable. We love seeing your nice concepts, power, and collaboration. As soon as once more we’re impressed with the quantity and high quality of the initiatives constructed with Clarifai.