Methods and tools for extracting personal data from theses abstracts

K.A. Kudim, G.Yu. Proskudina

Abstract


The problem of extraction of data about a person from scarce data collection is studied. The data collections are public resources on the internet. When these data are collected and parsed they present additional value for users. Collecting such data is problematic because of it’s weak structure restrictions. Thus the system is suggested to automate information gathering and parsing. The initial task is to process personal data from thesis documents publicly available on the internet. This data presents information about scientists which can’t be obtained from other sources. The goal is to be able to make requests to the data having its semantics in mind and not only plain text.

The prototype system is developed with PHP and XPath able to collect raw documents from digital repository of National Library of Ukraine by V. I. Vernadskiy. The system also extracts data from the collected documents and stores them locally in RDF data model suitable for specific data and for future exposition to the Semantic Web. The collection of more than 63000 documents was processed to test the system.

 


Keywords


data extraction; weakly structured documents; XPath technology; regular expressions; semantic web

References


PROSKUDINA G. & KUDIM K. (2017). About technologies of use of external data on creating and editing of encyclopedic text. Problems in programming. [online – pp.isofts.kiev.ua] (1). P. 67–82. (in Russian). Available from: http://pp.isofts.kiev.ua /ojs1/article/view/223 [Accessed 6/02/2017].

MARKUS KRÖTZSCH, MICHAEL GÜNTHER, MARKUS DAMM & GEORG WILD (2016). SQID - Searching, Querying, and Interacting with Data. [online – https://tools.wmflabs.org/sqid]. (in English). Available from: http://pp.isofts.kiev.ua/ojs1/ article/view/145 [Accessed 6/06/2017].




DOI: https://doi.org/10.15407/pp2019.02.038

Refbacks

  • There are currently no refbacks.