...
"How to" Blog Posts
- Demo using https://unstructured.io/ 's
partition_pdf
(): high-precision-rag-for-table-heavy-documents-using-langchain-unstructured-io-kdb-ai-22f7830eac9a - unstructured.io and Mistral: https://medium.com/django-unleashed/leveraging-unstructured-io-and-mistralai-for-advanced-pdf-data-processing-331c2c3683fb
- Demo using ColPali (Vision Language Model) to create embeddings from rendered PDF pagesPDFs (rendered and extracted text) and images: https://blog.vespa.ai/the-rise-of-vision-driven-document-retrieval-for-rag/
...
- https://github.com/Unstructured-IO/unstructured (as of this writing, uses poppler, tesseract, libreoffice and pandoc). Also has commercial API and platform options.
Select Open Source Tools that haven't been updated in the last year (no particular order/not an endorsement)
- https://github.com/clovaai/donut
- https://github.com/facebookresearch/nougat (Meta's package to process academic documents, built on top of donut)
Commercial Tools (no particular order/not an endorsement)
...