Skip to content

Fix the hugging face tokenizer build issues - #211

Open
declancm wants to merge 1 commit into
meta-pytorch:mainfrom
declancm:export-D117725862
Open

Fix the hugging face tokenizer build issues#211
declancm wants to merge 1 commit into
meta-pytorch:mainfrom
declancm:export-D117725862

Conversation

@declancm

Copy link
Copy Markdown

Summary:

  • Move nlohmann-json from exported_external_deps to exported_deps to fix compatibility with certain build configurations. The explicit "fbsource//third-party/nlohmann-json:nlohmann-json" dep is already used in the headers target so it felt like a safe change.
  • Add override to ~HFTokenizer() to fix -Winconsistent-missing-destructor-override warning.

Differential Revision: D117725862

Summary:
- Move `nlohmann-json` from `exported_external_deps` to `exported_deps` to fix compatibility with certain build configurations. The explicit `"fbsource//third-party/nlohmann-json:nlohmann-json"` dep is already used in the headers target so it felt like a safe change.
- Add override to `~HFTokenizer()` to fix `-Winconsistent-missing-destructor-override warning`.

Differential Revision: D117725862
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Meta Open Source bot. label Aug 28, 2026
@meta-codesync

meta-codesync Bot commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

@declancm has exported this pull request. If you are a Meta employee, you can view the originating Diff in D117725862.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot. meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant