Skip to content

Added initial PressMint-ES-PV files#28

Open
x2gg wants to merge 41 commits into
clarin-eric:datafrom
x2gg:data
Open

Added initial PressMint-ES-PV files#28
x2gg wants to merge 41 commits into
clarin-eric:datafrom
x2gg:data

Conversation

@x2gg

@x2gg x2gg commented Nov 24, 2025

Copy link
Copy Markdown
Collaborator

No description provided.

@matyaskopp

Copy link
Copy Markdown
Collaborator

@github-actions github-actions Bot added the upstream-updated fork is not up to date !!! label Nov 27, 2025
@github-actions github-actions Bot removed the upstream-updated fork is not up to date !!! label Nov 29, 2025
@github-actions github-actions Bot added the upstream-updated fork is not up to date !!! label Jan 15, 2026
@github-actions github-actions Bot added upstream-updated fork is not up to date !!! and removed upstream-updated fork is not up to date !!! labels Jan 27, 2026
@github-actions github-actions Bot removed the upstream-updated fork is not up to date !!! label Feb 2, 2026
@github-actions github-actions Bot added the upstream-updated fork is not up to date !!! label Apr 16, 2026
@github-actions github-actions Bot removed the upstream-updated fork is not up to date !!! label Apr 17, 2026
@matyaskopp

Copy link
Copy Markdown
Collaborator

@x2gg

  • empty words when ' present in text

you have empty words in your samples:

            <s xml:id="PressMint-ES_1921-05-01-ARGIA1920501.ana.p224.s224">
<w msd="UPosTag=PROPN|Case=Loc|Definite=Def|Number=Sing" lemma="Biaritz.-emen">Biaritz.-Emengo</w>
<w msd="UPosTag=NOUN|Case=Erg|Definite=Def|Number=Sing" lemma="udal">Udalak</w>
<w msd="UPosTag=CCONJ" lemma="edo">edo</w>
<w msd="UPosTag=NOUN|Case=Erg|Definite=Def|Number=Sing" lemma="ayuntamentu">Ayuntamentuak</w>
<w msd="UPosTag=PROPN" lemma="Ondarabi" join="right">Ondarabi</w>
<w msd="UPosTag=NOUN|Animacy=Inan|Case=Loc|Definite=Def|Number=Sing" lemma="ko">ko</w>
<w msd="UPosTag=NOUN" lemma="arantzale">arantzale</w>
<w msd="UPosTag=ADJ|Case=Ben|Definite=Def|Number=Plur" lemma="zoritxartu">zoritxartuentzat</w>
<w msd="UPosTag=NUM|NumType=Card" lemma="500">500</w>
<w msd="UPosTag=NOUN|Case=Abs|Definite=Ind" lemma="fran">franko</w>
<w msd="UPosTag=NUM|NumType=Card" lemma="bi-">bi-</w>
<w msd="UPosTag=NOUN|Case=Ess|Definite=Ind" lemma="e">etzat</w>
<w msd="UPosTag=NUM|NumType=Card" lemma="500">500</w>
<w msd="UPosTag=VERB|Case=Abs|VerbForm=Fin" lemma="daldu">daltzea</w>
<w msd="UPosTag=VERB|Aspect=Perf|VerbForm=Part" lemma="erabaki">erabaki</w>
<w msd="UPosTag=AUX|Mood=Ind|Number[abs]=Sing|Number[erg]=Sing|Person[abs]=3|Person[erg]=3|VerbForm=Fin" lemma="dun" join="right">zun</w>
<pc msd="UPosTag=PUNCT">,</pc>
<w msd="UPosTag=CCONJ" lemma="eta">eta</w>
<w msd="UPosTag=PROPN" lemma="Ondarabi" join="right">Ondarabi</w>
<!-- HERE: -->
<w msd="UPosTag=PUNCT" lemma=""/><w msd="UPosTag=NOUN|Case=Loc|Definite=Def|Number=Sing" lemma="ko">ko</w>
<w msd="UPosTag=NOUN|Case=Dat|Definite=Def|Number=Sing" lemma="lldalari">lldalari</w>
<w msd="UPosTag=NOUN|Animacy=Inan|Case=All|Definite=Def|Number=Sing" lemma="adixkide-agu" join="right">adixkide-agura</w>
<pc msd="UPosTag=PUNCT">.</pc>
</s>

In a non-annotated version: Ayuntamentuak Ondarabi'ko, and it shouldn't be w, but it should be pc element

  • no structure in document

there is only one paragraph per whole document. Are you able to add more structure to data and

@github-actions github-actions Bot added the upstream-updated fork is not up to date !!! label Apr 17, 2026
@github-actions github-actions Bot removed the upstream-updated fork is not up to date !!! label Apr 21, 2026
@github-actions github-actions Bot added the upstream-updated fork is not up to date !!! label Apr 27, 2026
@github-actions github-actions Bot removed the upstream-updated fork is not up to date !!! label Apr 27, 2026
@matyaskopp

Copy link
Copy Markdown
Collaborator
  • volume and issue numbers:

source:

    "issue_number": "33",
    "volume_number": 11,

result https://github.com/x2gg/PressMint/blob/586a077f4c70ee2d8c6a3337a1eca98349b752c4/Samples/PressMint-ES-PV/1911/PressMint-ES-PV_1911-06-15-EUSKAL-ESNALEA.xml#L31-L32

               <biblScope unit="volume">11</biblScope>
               <biblScope unit="issue">11</biblScope>   

@matyaskopp

matyaskopp commented Apr 28, 2026

Copy link
Copy Markdown
Collaborator
  • more detailed info on used tools and models

https://github.com/x2gg/PressMint/blob/586a077f4c70ee2d8c6a3337a1eca98349b752c4/Samples/PressMint-ES-PV/PressMint-ES-PV.ana.xml#L138-L141

            <application version="2.0" ident="udpipe">
               <label>UDPipe</label>
               <desc xml:lang="en">Linguistic processing with ud, available from <ref target="https://github.com/ufal/udpipe/tree/udpipe-2">https://github.com/ufal/udpipe/tree/udpipe-2</ref>.</desc>
            </application>

Please use something like below to record which model has been used:

CZ sample:

            <application ident="UDPipe" version="2">
               <label>UDPipe 2 (czech-pdt-ud-2.15-241121 model)</label>
               <desc xml:lang="en">POS tagging and lemmatization done with UDPipe 2 (<ref target="http://ufal.mff.cuni.cz/udpipe/2">http://ufal.mff.cuni.cz/udpipe/2</ref>) with czech-pdt-ud-2.15-241121 model</desc>
            </application>

@matyaskopp

Copy link
Copy Markdown
Collaborator
  • paragraphs in TEI version do not match the paragraphs in TEI.ana version

TEI:

<p ana="#quality.low"> EUSKAL-ESNALEA<!-- skipping -->jai-egunetan.
      </p>

TEI.ana

        <pb facs="#PressMint-ES-PV_1911-06-15-EUSKAL-ESNALEA.ana.page1"/>
        <p ana="#quality.high">
<s>
<w msd="UPosTag=NOUN|Case=Abs|Definite=Def|Number=Sing" lemma="euskal-esnale">EUSKAL-ESNALEA</w>
</s>
<!-- skipping-->
        </p>
        <p ana="#quality.high"><!-- skipping--></p>
        <p ana="#quality.high"><!-- skipping--></p>
        <p ana="#quality.high"><!-- skipping--></p>
        <p ana="#quality.high"><!-- skipping--></p>
        <p ana="#quality.high">
<!-- skipping-->
<w msd="UPosTag=NOUN|Animacy=Inan|Case=Ine|Definite=Def|Number=Plur" lemma="jai-egun" join="right">jai-egunetan</w>
<pc msd="UPosTag=PUNCT" join="right">.</pc>
</s>
        </p>

@github-actions github-actions Bot added the upstream-updated fork is not up to date !!! label Apr 28, 2026
@matyaskopp matyaskopp changed the title Added initial PressMint-ES files Added initial PressMint-ES-PV files Apr 28, 2026
@github-actions github-actions Bot removed the upstream-updated fork is not up to date !!! label Jun 15, 2026
@github-actions

Copy link
Copy Markdown

PressMint Preview

A sample has been generated for this PR.

Preview branch:

preview-pr-28--ES-PV

Sample URL:
https://github.com/clarin-eric/PressMint/tree/preview-pr-28--ES-PV/Samples/PressMint-ES-PV

Preview sample PR:
#69

@github-actions github-actions Bot added the upstream-updated fork is not up to date !!! label Jun 17, 2026
@github-actions github-actions Bot removed the upstream-updated fork is not up to date !!! label Jun 17, 2026
github-actions Bot pushed a commit that referenced this pull request Jun 17, 2026
@github-actions github-actions Bot added the upstream-updated fork is not up to date !!! label Jun 18, 2026
@github-actions github-actions Bot added upstream-updated fork is not up to date !!! and removed upstream-updated fork is not up to date !!! labels Jun 29, 2026
github-actions Bot pushed a commit that referenced this pull request Jun 30, 2026
@github-actions github-actions Bot added upstream-updated fork is not up to date !!! and removed upstream-updated fork is not up to date !!! labels Jun 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

upstream-updated fork is not up to date !!!

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants