Making LLMs read papers on LLMs

I came across a tweet by Greg Kamradt that reminded me of a project I built a little while ago.

arXiv, in their own words, is a free distribution service and an open-access archive for nearly 2.4 million scholarly articles in the fields of physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering and systems science, and economics.

I crawled their AI section and pulled the information from all the papers listed. I then built a call to Claude 3.5 to rank the relevance score of each paper's abstract based on a user supplied query. It also supplies a explanation of why the LLM thought the paper was relevant or not.

For example: I'm interested in vision now, so I'd put vision and get a ranked list of papers that are relevant to vision and why the score is what it is.

The front end is in Next.js (UI from Shadcn). The backend is python, Instructor, shout out to Jason Liu, and fastapi.

Here's a video:

Always happy to explain in greater detail.