By clicking "Accept", you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. See our Privacy Policy for more information
Open Datasets
AM-Thinking-V1 RL Dataset
Text

AM-Thinking-V1 RL Dataset

Dataset designed for reinforcement training (RL) of language models dedicated to advanced reasoning in mathematics and code. Each example contains a system instruction, a user request, and the expected results to evaluate the response.

Download dataset
Size

Several thousand examples in JSON, Verl structured format, math queries and code with associated verification

Licence

Apache 2.0

Description

‍

The dataset AM-Thinking-V1 RL Dataset is intended for training by learning by reinforcement of language models specialized in mathematics and programming. It includes queries with system instructions and user questions, accompanied by test verifications or expected answers according to the Verl format.

‍

‍

What is this dataset for?

‍

  • Train LLM models to improve mathematical reasoning and programming.
  • Test the ability of models to solve problems with automatic validation via test-case.
  • Optimize reinforcement learning models by following specific reward criteria.

‍

‍

Can it be enriched or improved?

‍

Yes, this dataset can be supplemented by new specific queries, additional validation tests, or adapted to other areas of reasoning. Annotating results manually or automatically can improve the quality of the reward signal.

‍

‍

🔎 In summary

Criterion Evaluation
🧩 Ease of use⭐⭐⭐⭐✩ (Structured JSON format ready-to-use, requires understanding of Verl format)
🧼 Need for cleaning⭐⭐⭐⭐⭐ (Low – well-formatted and validated data)
🏷️ Annotation richness⭐⭐⭐⭐✩ (Good – includes expected results and evaluation rules)
📜 Commercial license✅ Yes (Apache 2.0)
👨‍💻 Beginner friendly⚠️ Moderate – requires knowledge of reinforcement learning
🔁 Fine-tuning ready🎯 Perfect for RL training and specialized fine-tuning
🌍 Cultural diversity⚠️ Mostly English, technical content focused on math and code

‍

‍

🧠 Recommended for

  • AI researchers
  • LLM Model Developers
  • R&D teams in reinforcement learning

‍

‍

🔧 Compatible tools

  • RL frameworks (e.g. RLHF)
  • JSON libraries
  • LLM training environments

‍

‍

💡 Tip

Use the reward_model fields to precisely guide optimization during reinforcement learning.

Frequently Asked Questions

What technical skills are needed to use this dataset effectively?

A good understanding of language models, the JSON Verl format, and reinforcement learning is recommended.

Is this dataset suitable for use outside of academic research?

Yes, it can be used in industrial projects aimed at improving intelligent assistants in mathematics and programming.

Can you add your own data to the dataset?

Yes, the dataset is modular and can be enriched with additional examples, respecting the existing format.

Similar datasets

See more
Category

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique.

Category

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique.

Category

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique.