Clelia (Astra) Bertelli PRO
AI & ML interests
Recent Activity
Articles
Organizations
as-cle-bert's activity
If the answer is yes, then this post might be for you!โ
I recently created ๐จ๐๐ฌ๐ข๐๐ข๐๐ง-๐๐ข๐ ๐๐ฌ๐ญ, a Google Gemini-powered application that gives you feedback on style and contents of the documents you have been working on๐ง
Repo ๐ https://github.com/AstraBert/obsidian-digest
PyPi Package ๐ https://pypi.org/project/obsidian-digest/
The app is available as:
- ๐๐จ๐ฆ๐ฆ๐๐ง๐-๐ฅ๐ข๐ง๐ ๐ญ๐จ๐จ๐ฅ: install it as a python package with ๐ฝ๐ถ๐ฝ, and execute it from terminal anytime!๐ฆ
-๐๐ข๐ฌ๐๐จ๐ซ๐ ๐๐จ๐ญ ๐๐ฎ๐ข๐ฅ๐ญ ๐๐ซ๐จ๐ฆ ๐ฌ๐จ๐ฎ๐ซ๐๐ ๐๐จ๐๐: clone the GitHub repo, install the needed dependencies through ๐ฐ๐ผ๐ป๐ฑ๐ฎ, and run the bot: you will get hourly messages with suggestions and considerations about your activity on Obsidian in the previous hour๐ค
- ๐๐ข๐ฌ๐๐จ๐ซ๐ ๐๐จ๐ญ ๐๐๐ฉ๐ฅ๐จ๐ฒ๐๐ ๐ฅ๐จ๐๐๐ฅ๐ฅ๐ฒ ๐ฐ๐ข๐ญ๐ก ๐๐จ๐๐ค๐๐ซ ๐๐จ๐ฆ๐ฉ๐จ๐ฌ๐: clone the GitHub repo and launch ๐ฑ๐ผ๐ฐ๐ธ๐ฒ๐ฟ ๐ฐ๐ผ๐บ๐ฝ๐ผ๐๐ฒ ๐๐ฝ. Docker builds an image on the fly with all the needed dependencies and scripts, and runs them. You'll have the same functionalities as the ones from source code, but with a way easier deployment process๐
Go check out the GitHub repo for more info ๐ https://github.com/AstraBert/obsidian-digest
Have fun!โจ
Hi and thanks a lot for the specification!๐ฅฐ
Just as a note from my side, in the article I specify that there is a difference between "open weights" and "open source" models, and I link this blog post: https://www.agora.software/en/llm-open-source-open-weight-or-proprietary/ for a deeper explanation of the difference. I never (and I would never) claimed that Llama is open source, let alone a free software (see the introduction in this article of mine on privacy and data "stealing" risks: https://huggingface.co/blog/as-cle-bert/build-an-ai-powered-search-engine-from-scratch).
And I would have gladly used also DeepSeek, if it had been available on HuggingChat! :)
I nevertheless highly appreciate your comment and I'll for sure be more cautious in using the word "open/open source" in the future. Thanks!โจ
Both PdfItDown and SenTrEv only work with text for now: in future releases, support for image will be added :)
For text extraction, I use PyPDF + Langchain
Hi HuggingFacers๐ค, I decided to ship early this year, and here's what I came up with:
๐๐๐๐๐ญ๐๐จ๐ฐ๐ง (https://github.com/AstraBert/PdfItDown) - If you're like me, and you have all your RAG pipeline optimized for PDFs, but not for other data formats, here is your solution! With PdfItDown, you can convert Word documents, presentations, HTML pages, markdown sheets and (why not?) CSVs and XMLs in PDF format, for seamless integration with your RAG pipelines. Built upon MarkItDown by Microsoft
GitHub Repo ๐ https://github.com/AstraBert/PdfItDown
PyPi Package ๐ https://pypi.org/project/pdfitdown/
๐๐๐ง๐๐ซ๐๐ฏ ๐ฏ๐.๐.๐ (https://github.com/AstraBert/SenTrEv/tree/v1.0.0) - If you need to evaluate the ๐ฟ๐ฒ๐๐ฟ๐ถ๐ฒ๐๐ฎ๐น performance of your ๐๐ฒ๐ ๐ ๐ฒ๐บ๐ฏ๐ฒ๐ฑ๐ฑ๐ถ๐ป๐ด models, I have good news for you๐ฅณ๐ฅณ
The new release for ๐๐๐ง๐๐ซ๐๐ฏ now supports ๐ฑ๐ฒ๐ป๐๐ฒ and ๐๐ฝ๐ฎ๐ฟ๐๐ฒ retrieval (thanks to FastEmbed by Qdrant) with ๐๐ฒ๐ ๐-๐ฏ๐ฎ๐๐ฒ๐ฑ ๐ณ๐ถ๐น๐ฒ ๐ณ๐ผ๐ฟ๐บ๐ฎ๐๐ (.docx, .pptx, .csv, .html, .xml, .md, .pdf) and new ๐ฟ๐ฒ๐น๐ฒ๐๐ฎ๐ป๐ฐ๐ฒ ๐บ๐ฒ๐๐ฟ๐ถ๐ฐ๐!
GitHub repo ๐ https://github.com/AstraBert/SenTrEv
Release Notes ๐ https://github.com/AstraBert/SenTrEv/releases/tag/v1.0.0
PyPi Package ๐ https://pypi.org/project/sentrev/
Happy New Year and have fun!๐ฅ
As my last 2024 contribution, I decided to write an article about a Competitive Debate Championship simulation I ran with 5 LLMs as competitors and 2 as judges:
https://huggingface.co/blog/as-cle-bert/debate-championship-for-llms
The article covers code, analyses and results, and you can find everything to reproduce this tournament in the GitHub repo ๐ https://github.com/AstraBert/DebateLLM-Championship
I also released a dataset related to the data (motions, arguments, topics, winners...) collected during the tournament ๐ as-cle-bert/DebateLLMs
Happy reading and happy new yeAIr!๐
Debate Championship for LLMs
Debate Championship for LLMs
Get yours here on HuggingFace ๐ as-cle-bert/what-a-git-year
GitHub repo with the code to reproduce it ๐ https://github.com/AstraBert/what-a-git-year
Hope that everybody had a Git year!๐
As my last 2024 project, I've dropped a Discord Bot that knows a lot about Pokemons๐ฆ
GitHub ๐ https://github.com/AstraBert/Pokemon-Bot
Demo Space ๐ as-cle-bert/pokemon-bot
The bot integrates:
- Chat features (Cohere's Command-R) with RAG functionalities (hybrid search and reranking with Qdrant) and chat memory (managed through PostgreSQL) to produce information about Pokemons
- Image-based search to identify Pokemons from their images (via Qdrant)
- Card package random extraction and description
HuggingFace๐ค, as usual, plays the most important role in the application stack, with the following models:
- sentence-transformers/LaBSE
- prithivida/Splade_PP_en_v1
- facebook/dinov2-large
And datasets:
- Karbo31881/Pokemon_images
- wanghaofan/pokemon-wiki-captions
- TheFusion21/PokemonCards
Have fun!๐
I just published a blog article on building PrAIvateSearch (https://github.com/AstraBert/PrAIvateSearch), a user-owend, local and open-source AI-powered search engine๐:
https://huggingface.co/blog/as-cle-bert/build-an-ai-powered-search-engine-from-scratch
"Own your AI, search the web with it๐๐"
Feel free to try it out and contribute to it on GitHub: let's make OSS AI grown and thrive!๐