Add enterprise blog HTML extraction and stricter ECL errors - #30
Open
hyeonseo2 wants to merge 2 commits into
Open
Add enterprise blog HTML extraction and stricter ECL errors#30hyeonseo2 wants to merge 2 commits into
hyeonseo2 wants to merge 2 commits into
Conversation
Collaborator
|
LGTM 입니다! 늦게 리뷰해서 죄송합니다! HTML까지 번역되니 좋습니다 :) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
요약
원본 Markdown을 제공하지 않는 Hugging Face Enterprise Article도 번역 플로우에서 처리할 수 있도록 HTML 기반 source Markdown 추출 경로를 추가했습니다.
GitHub Actions의 일일 번역 워크플로우에서는
--enterprise-source html을 사용하도록 설정해, raw Markdown이 없는 Enterprise Article을 기본 skip하지 않고 렌더링된 HTML에서 번역 소스를 생성합니다.또한 ECL 번역 파이프라인에서 모델 응답 파싱 실패나 일부 블록 누락이 발생했을 때 원문 English block을 그대로 섞어 출력하지 않고 즉시 실패하도록 변경했습니다.
주요 변경 사항
--enterprise-source옵션 추가skip: 기존처럼 raw Markdown이 없는 Enterprise Article을 건너뜀html: Enterprise Article의 렌더링된 HTML에서 source Markdown 합성--enterprise-source html적용source_extraction: html기록enterprise_source인자와 호환되도록 수정번경 영향도
테스트