By clicking "Accept", you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. See our Privacy Policy for more information
Open Datasets
OlmoCR Mix 2025 Benchmarkset
Text

OlmoCR Mix 2025 Benchmarkset

This dataset includes 10,000 PDF files extracted from a larger corpus, intended to assess the speed of OCR models and calibrate quantization. It is useful for OCR tasks on various documents.

Download dataset
Size

10,000 PDF files, approximately 2.48 GB

Licence

ODC-by

Description

‍

OlmoCR Mix 2025 Benchmarkset is a set of 10,000 PDF documents used primarily for OCR performance benchmarking and the calibration of quantified models. These files cover various types of documents and provide a basis for testing the robustness of OCR systems.

‍

‍

What is this dataset for?

‍

  • Benchmarking the speed and accuracy of OCR systems
  • Quantization calibration for OCR models
  • Evaluating models on a variety of PDF documents

‍

‍

Can it be enriched or improved?

‍

The dataset can be enriched with additional manual annotations (corrected text extraction) to improve the quality of the benchmarks and allow supervised training tasks.

‍

‍

🔎 In summary

Criterion Evaluation
🧩 Ease of use⭐⭐⭐⭐✩ (Standard PDF format, easy to handle)
🧼 Need for cleaning⭐⭐⭐⭐✩ (Moderate – variable quality depending on documents)
🏷️ Annotation richness⭐⭐✩✩✩ (Limited – dataset without corrected text annotations)
📜 Commercial license⚡ Yes (ODC-By)
👨‍💻 Beginner friendly🌟 Yes – perfect for testing OCR
🔁 Fine-tuning ready⚠️ Possible with additional annotations
🌍 Cultural diversityN/A Not specified

‍

‍

🧠 Recommended for

  • OCR researchers
  • QA engineers
  • Quantified model developers

‍

‍

🔧 Compatible tools

  • Tesseract
  • EasyOCR
  • PyTorch OCR pipelines

‍

‍

💡 Tip

Combine this dataset with corrected annotations for effective supervised training.

Frequently Asked Questions

Does this dataset contain corrected text annotations?

No, it is mainly used for benchmarking and calibration, with no corrected annotations provided.

Can this dataset be used to train an OCR model?

Not directly, except by adding quality manual or automatic annotations.

What is the main file format?

The dataset consists of PDF files representing various documents.

Similar datasets

See more
Category

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique.

Category

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique.

Category

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique.