Work with BigData in humanity
Лилия Васильевна Боднарь
South Ukrainian National Pedagogical University Named After K. D. Ushynsky
Таисия Николаевна Боднарь
South Ukrainian National Pedagogical University Named After K. D. Ushynsky
Иван Иванович Дончев
South Ukrainian National Pedagogical University Named After K. D. Ushynsky
PDF (Русский)

Keywords

Big Data
machine learning
Conan 3.0
Zipf’s Laws
Natural Language Toolkit

How to Cite

Боднарь, Л., Боднарь, Т., & Дончев, И. (2018). Work with BigData in humanity. New Computer Technology, 16, 30-35. https://doi.org/10.55056/nocote.v16i0.812
PDF (Русский)

Abstract

The aim of research is defining of possibility provided by the BigData processing tools in linguistic. The research object is the tools  for working with large databases. The research subject is using of Zipf’s laws for data processing. The modern methods of big data processing will be observed in this topic with special computer application “Conan 3.0”. Also the examples of applying the program in humanities area in order to working with big data in linguistic by using the modern Natural Language Toolkit will be done. Beside it the results of applying the original application for research Cyrillic texts based on Zipf’s laws will be provided.

PDF (Русский)

References

1. Cielen D. Introducing Data Science: Big Data, Machine Learning, and more, using Python tools / Davy Cielen, Arno Meysman, Mohamed Ali. – Shelter Island : Manning Publications, 2016. – 320 p.
2. Орлов А. Машинное обучение для Больших Данных [Электронный ресурс] / Андрей Орлов // Открытые системы. СУБД. – 2016. – № 1. – Режим доступа : https://www.osp.ru/os/2016/01/13048651.
3. Zipf G. K. Human behavior and the principle of least effort / George Kingsley Zipf. – Cambridge : Addison‐Wesley, 1949. – 573 р.
4. Mandelbrot В. An information theory of the statistical structure of languages / В. Mandelbrot // Communication Theory / Ed. W. Jackson. – Woburn : Butterworth, 1953. – Р. 486-502.
5. Manin Yu. I. Zipf’s Law and L. Levin Probability Distributions / Yuri I. Manin // Functional Analysis and Its Applications. – 2014. – Vol. 48. – Issue 2. – Р. 116-127.
6. Kiv А. Mathematical study of evolution of Russian language / A. Kiv, D. Goncharenko, Ye. Sedov, L. Bodnar, N. Yaremchuk // Computer Modeling & New Technologies. – 2008. – 12(1). – Р. 56-59.
7. Kiv А. Quantitative analysis of translation texts / A. Kiv, L. Bodnar, O. Britavska, E. Sedov, N. Yaremchuk, M. Yakovleva // Computer Modeling & New Technologies. – 2014. – 18(12C). – Р. 260-263.