The English/Spanish parallel Corpus, PaEnS, is part of an ongoing major project, PaCorES, Parallel Corpora Spanish, which aims to collect a series of bilingual parallel corpora with Spanish as the central language. So far German/Spanish (www.corpuspages.eu), French/Spanish (www.corpuspafres.eu) and this one.
PaEnS is a bilingual parallel corpus composed of two major parts: the core corpus and the supplements.
The core corpus is comprised so far of 148 of original texts in English and Spanish and their respective translations. It includes works of fiction —novels and short stories, making up around 80%— as well as non-fiction — especially psychology, essays and popular science texts. The selected works are represented not by the full texts, but rather by samples, allowing for a better cross-section of the texts. Breaks in the text (original and translation) are marked.
This part of PaEnS (s. tables below) contains nearly 37 million tokens and more than one million bisegments, i.e. pairs of aligned text chunks (sentences or subsentential units/segments).
To guarantee overall quality, the texts have been manually verified at different levels. The automatic alignment of the bisegments, performed by LF-Aligner, some with youalign or Gargantua, has been manually reviewed. The English texts have been lemmatized and pos-tagged by Treetagger and the Spanish texts by Freeling. After performing a manual check for systematic errors, the tags of both have been subsequently mapped to the Universal POS tags, that mark the core part-of-speech categories. In the future it is expected to offer a more fine-grained categories.
For each occurrence, the original source is provided, which includes information on the author, title, year of the first publication, and — if applicable —the edition used and the part or chapter within the work to which the specific occurrence belongs. The complete bibliographic data of the works included in PaEnS can be found here.
The supplements contain a total of more than 110 million words. If not otherwise specified, they are not undertaken any manual review. The supplements include so far:
In the near future, new collections of bilingual texts of diverse origin are expected to be added.
We aim at building a multifunctional and representative language resource for the language pair English / Spanish that is able to meet differentiated need of users and that can be exploited for multiple purposes such as general research in contrastive linguistics, linguistic typology, translation studies and bilingual lexicography, as well as the supply of training data to machine translation systems. PaEnS has also proven to be a very useful and widely used resource by translators and learners of English or Spanish as Foreign Languages at intermediate and advanced levels to obtain a multitude of translation suggestions made by humans and presented within examples of real language use.
Despite our best efforts, some mistakes have undoubtedly slipped through. If you come across any, please let us know by by clicking here.
Notice:
If you use PaEnS in your work, please indicate it and let us know: corpuspaens@usc.es. This way you contribute to the sustainability of the project.
Statistics PaEnS
PaEnS: Core Corpus
LANGUAGE | TOKENS | WORDS | MSTTRATIO* | BISEGMENTS | WORKS |
English Original | 10.747.688 | 9.322.434 | 0,526 | 631.927 | 78 |
Spanish Translation | 11.276.785 | 9.899.639 | 0,534 | ||
Spanish Original | 7.267.961 | 6.381.143 | 0,539 | 395.791 | 70 |
English Translation | 7.518.400 | 6.578.254 | 0,523 | ||
Total | 36.810.834 | 32.181.470 | 0,531 | 1.027.718 | 148 |
Supplements 1: Europarl v7
LANGUAGE | TOKENS | WORDS | MSTTRATIO* | BISEGMENTS |
English | 39.481.818 | 35.918.308 | 0,485 | 1.536.548 |
Spanish | 41.476.923 | 37.600.223 | 0,465 | |
Total | 80.958.741 | 73.518.531 | 0,475 | 1.536.548 |
Supplements 2: TED-Talks
LANGUAGE | TOKENS | WORDS | MSTTRATIO* | BISEGMENTS |
English | 8.676.842 | 7.043.470 | 0,476 | 431.095 |
Spanish | 8.338.726 | 6.816.425 | 0,506 | |
Total | 17.015.568 | 13.859.895 | 0,491 | 431.095 |
Supplements 3: Global Voices
LANGUAGE | TOKENS | WORDS | MSTTRATIO* | BISEGMENTS |
English | 15.285.853 | 12.724.972 | 0,558 | 680.530 |
Spanish | 16.361.642 | 13.826.084 | 0,528 | |
Total | 31.647.495 | 26.551.056 | 0.543 | 680.530 |
*MSTTR is the average TTR (Type/Token Ratio) for each non-overlapping segment of equal size (in this case 1000 tokens).