Word statistics of Turkish language on a large scale text corpus - TurCo

Determination of the statistical properties of a natural language is one of the most important part of the language analysis. Number of different words (NODW), and different word usage ratio (DWUR) concepts are some of the general characteristics of a corpus. These values are described and calculate...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Dalkilic, G., Cebi, Y.
Format:	Tagungsbericht
Sprache:	eng
Schlagworte:	Computer science Large-scale systems Natural languages Optical character recognition software Pattern analysis Pattern matching Probability Speech analysis Speech recognition Statistics
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Beschreibung
Zusammenfassung:	Determination of the statistical properties of a natural language is one of the most important part of the language analysis. Number of different words (NODW), and different word usage ratio (DWUR) concepts are some of the general characteristics of a corpus. These values are described and calculated for the Turkish corpus (TurCo). Also, word n-grams are calculated for Turkish which was done for English years ago but couldn't be done for Turkish because of the lack of a large scale corpus. Obtained results from n-grams were compared with the results of the Brown corpus (very known corpus for English) and similarity between TurCo and Brown corpus was examined.
DOI:	10.1109/ITCC.2004.1286654