Back to Search

Statistical Properties of Turkish Words

AUTHOR Dalkilic, Gokhan; Dalkili, Gkhan
PUBLISHER LAP Lambert Academic Publishing (06/29/2010)
PRODUCT TYPE Paperback (Paperback)

Description
For speech recognition, OCR, etc. determination of the structural properties of a natural language is essential. These properties can be analyzed under two different categories; morphological and statistical analysis. For statistical analysis, a corpus which is a representative sample of the natural language is needed. Word n-gram frequencies of that corpus can be determined by using suitable algorithms and missing n-grams can be estimated by using smoothing techniques. In this study, in order to compare and apply smoothing techniques to Turkish, a corpus named TurCo was created. In order to calculate word n-grams, different algorithms were tested. After finding n-gram word lists, their characteristics were analyzed. For generalization, Zipf's Law was applied, and to increase the accuracy in Zipf's Law, Mandelbrot Law was applied by finding the appropriate constants of Mandelbrot. As the corpus could not be big enough to represent all of the language, smoothing techniques were used to estimate the unseen word n-grams. This study can help professionals working on speech recognition, cryptanalysis, and author recognition in Turkish.
Show More
Product Format
Product Details
ISBN-13: 9783838351582
ISBN-10: 3838351584
Binding: Paperback or Softback (Trade Paperback (Us))
Content Language: English
More Product Details
Page Count: 140
Carton Quantity: 58
Product Dimensions: 6.00 x 0.33 x 9.00 inches
Weight: 0.47 pound(s)
Country of Origin: US
Subject Information
BISAC Categories
Computers | Information Technology
Descriptions, Reviews, Etc.
publisher marketing
For speech recognition, OCR, etc. determination of the structural properties of a natural language is essential. These properties can be analyzed under two different categories; morphological and statistical analysis. For statistical analysis, a corpus which is a representative sample of the natural language is needed. Word n-gram frequencies of that corpus can be determined by using suitable algorithms and missing n-grams can be estimated by using smoothing techniques. In this study, in order to compare and apply smoothing techniques to Turkish, a corpus named TurCo was created. In order to calculate word n-grams, different algorithms were tested. After finding n-gram word lists, their characteristics were analyzed. For generalization, Zipf's Law was applied, and to increase the accuracy in Zipf's Law, Mandelbrot Law was applied by finding the appropriate constants of Mandelbrot. As the corpus could not be big enough to represent all of the language, smoothing techniques were used to estimate the unseen word n-grams. This study can help professionals working on speech recognition, cryptanalysis, and author recognition in Turkish.
Show More
Your Price  $75.67
Paperback