Clelia (Astra) Bertelli PRO
AI & ML interests
Recent Activity
Articles
Organizations
as-cle-bert's activity
If the answer is yes, then this post might be for you!โ
I recently created ๐จ๐๐ฌ๐ข๐๐ข๐๐ง-๐๐ข๐ ๐๐ฌ๐ญ, a Google Gemini-powered application that gives you feedback on style and contents of the documents you have been working on๐ง
Repo ๐ https://github.com/AstraBert/obsidian-digest
PyPi Package ๐ https://pypi.org/project/obsidian-digest/
The app is available as:
- ๐๐จ๐ฆ๐ฆ๐๐ง๐-๐ฅ๐ข๐ง๐ ๐ญ๐จ๐จ๐ฅ: install it as a python package with ๐ฝ๐ถ๐ฝ, and execute it from terminal anytime!๐ฆ
-๐๐ข๐ฌ๐๐จ๐ซ๐ ๐๐จ๐ญ ๐๐ฎ๐ข๐ฅ๐ญ ๐๐ซ๐จ๐ฆ ๐ฌ๐จ๐ฎ๐ซ๐๐ ๐๐จ๐๐: clone the GitHub repo, install the needed dependencies through ๐ฐ๐ผ๐ป๐ฑ๐ฎ, and run the bot: you will get hourly messages with suggestions and considerations about your activity on Obsidian in the previous hour๐ค
- ๐๐ข๐ฌ๐๐จ๐ซ๐ ๐๐จ๐ญ ๐๐๐ฉ๐ฅ๐จ๐ฒ๐๐ ๐ฅ๐จ๐๐๐ฅ๐ฅ๐ฒ ๐ฐ๐ข๐ญ๐ก ๐๐จ๐๐ค๐๐ซ ๐๐จ๐ฆ๐ฉ๐จ๐ฌ๐: clone the GitHub repo and launch ๐ฑ๐ผ๐ฐ๐ธ๐ฒ๐ฟ ๐ฐ๐ผ๐บ๐ฝ๐ผ๐๐ฒ ๐๐ฝ. Docker builds an image on the fly with all the needed dependencies and scripts, and runs them. You'll have the same functionalities as the ones from source code, but with a way easier deployment process๐
Go check out the GitHub repo for more info ๐ https://github.com/AstraBert/obsidian-digest
Have fun!โจ
Hi and thanks a lot for the specification!๐ฅฐ
Just as a note from my side, in the article I specify that there is a difference between "open weights" and "open source" models, and I link this blog post: https://www.agora.software/en/llm-open-source-open-weight-or-proprietary/ for a deeper explanation of the difference. I never (and I would never) claimed that Llama is open source, let alone a free software (see the introduction in this article of mine on privacy and data "stealing" risks: https://huggingface.co/blog/as-cle-bert/build-an-ai-powered-search-engine-from-scratch).
And I would have gladly used also DeepSeek, if it had been available on HuggingChat! :)
I nevertheless highly appreciate your comment and I'll for sure be more cautious in using the word "open/open source" in the future. Thanks!โจ
Both PdfItDown and SenTrEv only work with text for now: in future releases, support for image will be added :)
For text extraction, I use PyPDF + Langchain
Hi HuggingFacers๐ค, I decided to ship early this year, and here's what I came up with:
๐๐๐๐๐ญ๐๐จ๐ฐ๐ง (https://github.com/AstraBert/PdfItDown) - If you're like me, and you have all your RAG pipeline optimized for PDFs, but not for other data formats, here is your solution! With PdfItDown, you can convert Word documents, presentations, HTML pages, markdown sheets and (why not?) CSVs and XMLs in PDF format, for seamless integration with your RAG pipelines. Built upon MarkItDown by Microsoft
GitHub Repo ๐ https://github.com/AstraBert/PdfItDown
PyPi Package ๐ https://pypi.org/project/pdfitdown/
๐๐๐ง๐๐ซ๐๐ฏ ๐ฏ๐.๐.๐ (https://github.com/AstraBert/SenTrEv/tree/v1.0.0) - If you need to evaluate the ๐ฟ๐ฒ๐๐ฟ๐ถ๐ฒ๐๐ฎ๐น performance of your ๐๐ฒ๐ ๐ ๐ฒ๐บ๐ฏ๐ฒ๐ฑ๐ฑ๐ถ๐ป๐ด models, I have good news for you๐ฅณ๐ฅณ
The new release for ๐๐๐ง๐๐ซ๐๐ฏ now supports ๐ฑ๐ฒ๐ป๐๐ฒ and ๐๐ฝ๐ฎ๐ฟ๐๐ฒ retrieval (thanks to FastEmbed by Qdrant) with ๐๐ฒ๐ ๐-๐ฏ๐ฎ๐๐ฒ๐ฑ ๐ณ๐ถ๐น๐ฒ ๐ณ๐ผ๐ฟ๐บ๐ฎ๐๐ (.docx, .pptx, .csv, .html, .xml, .md, .pdf) and new ๐ฟ๐ฒ๐น๐ฒ๐๐ฎ๐ป๐ฐ๐ฒ ๐บ๐ฒ๐๐ฟ๐ถ๐ฐ๐!
GitHub repo ๐ https://github.com/AstraBert/SenTrEv
Release Notes ๐ https://github.com/AstraBert/SenTrEv/releases/tag/v1.0.0
PyPi Package ๐ https://pypi.org/project/sentrev/
Happy New Year and have fun!๐ฅ
As my last 2024 contribution, I decided to write an article about a Competitive Debate Championship simulation I ran with 5 LLMs as competitors and 2 as judges:
https://huggingface.co/blog/as-cle-bert/debate-championship-for-llms
The article covers code, analyses and results, and you can find everything to reproduce this tournament in the GitHub repo ๐ https://github.com/AstraBert/DebateLLM-Championship
I also released a dataset related to the data (motions, arguments, topics, winners...) collected during the tournament ๐ as-cle-bert/DebateLLMs
Happy reading and happy new yeAIr!๐
Get yours here on HuggingFace ๐ as-cle-bert/what-a-git-year
GitHub repo with the code to reproduce it ๐ https://github.com/AstraBert/what-a-git-year
Hope that everybody had a Git year!๐
As my last 2024 project, I've dropped a Discord Bot that knows a lot about Pokemons๐ฆ
GitHub ๐ https://github.com/AstraBert/Pokemon-Bot
Demo Space ๐ as-cle-bert/pokemon-bot
The bot integrates:
- Chat features (Cohere's Command-R) with RAG functionalities (hybrid search and reranking with Qdrant) and chat memory (managed through PostgreSQL) to produce information about Pokemons
- Image-based search to identify Pokemons from their images (via Qdrant)
- Card package random extraction and description
HuggingFace๐ค, as usual, plays the most important role in the application stack, with the following models:
- sentence-transformers/LaBSE
- prithivida/Splade_PP_en_v1
- facebook/dinov2-large
And datasets:
- Karbo31881/Pokemon_images
- wanghaofan/pokemon-wiki-captions
- TheFusion21/PokemonCards
Have fun!๐
I just published a blog article on building PrAIvateSearch (https://github.com/AstraBert/PrAIvateSearch), a user-owend, local and open-source AI-powered search engine๐:
https://huggingface.co/blog/as-cle-bert/build-an-ai-powered-search-engine-from-scratch
"Own your AI, search the web with it๐๐"
Feel free to try it out and contribute to it on GitHub: let's make OSS AI grown and thrive!๐
December is here and time has come, for most of us, to wrap up our code projects and take stock of our 2024 contributions๐๏ธ
In order to do this, I made a small Gradio application,
what-a-git-year
:as-cle-bert/what-a-git-year
that scrapes information from your GitHub profile and summarizes them, producing also nice plots๐
Find also the GitHub repo here: https://github.com/AstraBert/what-a-git-year โญ
Hope that everyone had a Git year!๐
I just deployed a Streamlit-based space on HF that fetches your Home Feed on BlueSky and summarizes it with Cohere's CommandR via Langchain๐งช
Find it here:
as-cle-bert/bsky-feedllama-demo
I'm also working on a Gradio local implementation with Llama3.2 that for now only works with source code and doesn't have docs, but that will be soon supported by Docker๐ณ and have a nice README:
https://github.com/AstraBert/bluesky-feedllama
Contributions and feedback are always welcome!๐ค๐ฆ
I'm thrilled to introduce my latest project: ๐ฆ๐ฒ๐ป๐ง๐ฟ๐๐ (๐ฆ๐ฒ๐ปtence ๐ง๐ฟansformers ๐๐aluator), a python package that offers simple customizable evaluation for text retrieval accuracy and time performance of Sentence Transformers-compatible text embedders on PDF data!๐
Learn more in my LinkedIn post: https://www.linkedin.com/posts/astra-clelia-bertelli-583904297_python-embedders-semanticsearch-activity-7266754133557190656-j1e3
And on the GitHub repo: https://github.com/AstraBert/SenTrEv
Have fun!๐
If you're into biomedical sciences, you will know the pain that, sometimes, searching PubMed can be๐โโ๏ธ
For these purposes, I built a bot that scrapes PubMed for you, starting from the exact title of a publication or key word search - all beautifully rendered through Gradioโ
Find it here: as-cle-bert/BioMedicalPapersBot
And here's the GitHub repository๐ฑ: https://github.com/AstraBert/BioMedicalPapersBot
It's also available as a Docker image!๐ณ
docker pull ghcr.io/astrabert/biomedicalpapersbot:main
Best of luck with your research!
PS: in the very near future some AI summarization features will be included!
Are you working with Streamlit on Spaces and struggling with authentication and user management?๐ง
Well, you can check out my last community article (https://huggingface.co/blog/as-cle-bert/streamlit-supabase-auth-ui) on a new python package I've been working on, that connects Supabase to Streamlit UI, in order to create a seamless authentication for your seamless Streamlit apps!๐
You can find a demo of it on Spaces: as-cle-bert/streamlit-supabase-auth-ui
Have fun!๐
As you may have probably heard, in the past weeks three Tech Giants (Microsoft, Amazon and Google) announced that they would bet on nuclear reactors to feed the surging energy demand of data centers, driven by increasing AI data and computational flows.
I try to explain the state of AI energy consumptions, its environmental impact and the key points of "turning AI nuclear" in my last article on HF community blog: https://huggingface.co/blog/as-cle-bert/ai-is-turning-nuclear-a-review
Enjoy the reading!๐ฑ
Have you ever dreamt of an improbable books crossover, like Frodo from ๐๐ฐ๐ณ๐ฅ ๐ฐ๐ง ๐ต๐ฉ๐ฆ ๐๐ช๐ฏ๐จ๐ด becoming the main character of the ๐๐ฅ๐บ๐ด๐ด๐ฆ๐บ or Emma Bovary from ๐๐ข๐ฅ๐ข๐ฎ๐ฆ ๐๐ฐ๐ท๐ข๐ณ๐บ acting as a modern-days Shakespearean Juliet?
Well, all of this is now possible! I'm thrilled to introduce my latest opensource product for storytelling: ๐๐จ๐จ๐ค๐ฌ-๐ฆ๐ข๐ฑ๐๐ซ-๐๐ข ๐ฏ๐.๐.๐ !
Built with ReactJS and shipped directly to you on Spaces thanks to Docker, this webapp combines the power of two AI tools:
- gpt-4o-mini by OpenAI, which takes care of cooking new and intriguing plots starting from the user's instructions, the titles and the summaries of the two books to mix (summaries are scraped through Wikipedia)
- text2img realtime API by ModelsLab, which provides a stable diffusion pipeline to create a thumbnail for your newly-generated story
Everything is provided under a simple and intuitive UI, which uses chatscope's React template kit.
Curious of trying? The app is already live at:
as-cle-bert/books-mixer-ai
And you can also have a tour of the GitHub repo (and leave a little โญ while you're there):
https://github.com/AstraBert/books-mixer-ai
The documentation is still under construction, but will become available soon๐
Have fun!๐๐
In the past days, OpenAI announced their search engine, SearchGPT: today, I'm glad to introduce you SearchPhi, an AI-powered and open-source web search tool that aims to reproduce similar features to SearchGPT, built upon microsoft/Phi-3-mini-4k-instruct, llama.cpp๐ฆ and Streamlit.
Although not as capable as SearchGPT, SearchPhi v0.0-beta.0 is a first step toward a fully functional and multimodal search engine :)
If you want to know more, head over to the GitHub repository (https://github.com/AstraBert/SearchPhi) and, to test it out, use this HF space: as-cle-bert/SearchPhi
Have fun!๐ฑ
Hope y'all are as excited as me for the release of Llama 3.1! ๐ฆ
Following the release, I built a space exploiting HF Inference API, thanks to a recipe you can find in this awesome GitHub repo (https://github.com/huggingface/huggingface-llama-recipes/): you can now run Llama-3.1-405B customizing its system instructions and other parameters, for free! ๐
Follow this link: as-cle-bert/Llama-3.1-405B-FP8 and let the fun begin!๐
Good news concerning as-cle-bert/smolLM-arena, the chat arena where you can compare some of the Small Language Models (<1.7B) on the Hub and cast your vote to choose the best!๐ฑ
The space now has a new interface with chatbots instead of textboxs, it runs faster and it also comes with usage instructions :)
Have fun!๐
The SmolLM series is specifically designed to run on devices like smartphones, yes :) And, concerning the arena for models 7 to 20B, I didn't want to spoiler it, but It's coming soon! ;)