All issues

Search results

[RFC] Criteria for removing code from trl.experimental

Status: Open.

#7182 In huggingface/trl;

· albertvillanova opened on Sep 11, 2026

DPO/KTO training goes NaN with the default SDPA backend on torch 2.13 (cuDNN attention); clean with enable_cudnn_sdp(False) or eager

Status: Open.

Bug

#7181 In huggingface/trl;

· qgallouedec opened on Sep 11, 2026

[GRPO] Pad per minibatch instead of per generation batch

Status: Open.

#7179 In huggingface/trl;

· qgallouedec opened on Sep 10, 2026

Where the GPU runner hours go in the Tests workflow

🔧 maintenanceCI, tooling, tests, or repo upkeepCI, tooling, tests, or repo upkeep

Status: Open.

#7169 In huggingface/trl;

· albertvillanova opened on Sep 10, 2026

Align tiny test model configs with their reference models

Status: Open.

#7137 In huggingface/trl;

· albertvillanova opened on Sep 9, 2026

Agree on an explicit criterion for raising a dependency version floor

Status: Open.

#7116 In huggingface/trl;

· albertvillanova opened on Sep 8, 2026

AsyncGRPO FSDP2 weight sync hangs: interleaved full_tensor() and is_checkpoint_format=True

Status: Open.

#7103 In huggingface/trl;

· sfc-gh-truwase opened on Sep 8, 2026

CI emits 462 transformers Trainer log warnings: "The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config"

Status: Open.

#7093 In huggingface/trl;

· albertvillanova opened on Sep 7, 2026

RLOO uses higher-variance KL Estimator and should use lower variance k3

Status: Open.

#7086 In huggingface/trl;

· AMindToThink opened on Sep 6, 2026

Support precomputed reference log-probs in fused DPO training

Status: Open.

#7083 In huggingface/trl;

· alay2shah opened on Sep 6, 2026

[Tracking] Move off liger-kernel and make the memory-efficient loss the default

Status: Open.

#7063 In huggingface/trl;

· qgallouedec opened on Sep 4, 2026

RLOO _tokenize_prompts skips VLM string-content normalization that GRPO and Distillation apply

Status: Open.

#7049 In huggingface/trl;

· YeonwooSung opened on Sep 4, 2026