Under the Indian Languages Corpora Initiative phase –II (ILCI Phase-II) project, initiated by the MeitY, Govt. of India, Jawaharlal Nehru University, New Delhi had collected Gujarati monolingual text corpus. There are approx. 30,000 sentences of general domain in this corpus. These sentences have been POS tagged and Chunked properly. The chunking guideline is provided in supporting document. This corpus has following features: unique ID, UTF-8 encoding, and text file format.
Under the Indian Languages Corpora Initiative (ILCI) project initiated by the MeitY, Govt. of India, Jawaharlal Nehru University, New Delhi had collected corpus in Hindi as source language and translated it in Gujarati as target language. There are 70,000 sentences including Health, Tourism, Agriculture and Entertainment domain in this corpus. Each sentence has a unique ID. The translated sentences have been POS tagged and Chunked properly. The chunking guideline is provided in supporting document.
This is Author wise Marathi Language text corpus for research purpose that includes research area as Data or Text Mining that includes but not limited to Author Identification, Author Profiling, Sentiment Analysis, Text Summarization etc on Marathi Language text. There are two datasets based on two categories one is comedy articles and another category is mixed articles i.e. composed of comedy, novels, Lalit lekhan etc. of well-known authors in Marathi.
Dataset–I is a collection of articles on category comedy by 5 different authors. A file for each author is prepared which contain all articles by that author i.e. dataset-I contain 5 files with the file name as author name. A number of words by each author is ranging from minimum 7006 and maximum 10,411 words.
Dataset–II is composed of articles of the mixed category. In total 10 different authors with minimum 26874 and maximum 33722 words. A file for each author is prepared which contain all articles by that author with the file name as the name of the author name. These files are encoded with UTF 8 encoding.
The corpus was created in 2015 at Shrimad Rajchandra Institute of Management and Computer Application by its research group. The major purpose for creation of this corpus was lexical and morphological level data analysis of Gujarati text.
The corpus covers news articles from reputed newspapers published in Gujarati. Currently it contains 156, 210, 101 and 50 news articles in the domain of business, crime, politics and sports.
Malayalam tree bank data is in Shakti Standard Format (SSF). SSF is a common representation for data. SSF allows information in a sentence to be represented in the form of one or more trees together with a set of attribute-value pairs with nodes of the trees. The attribute-value pairs allow features or properties to be specified with every node. Sentence
level SSF is used to store the analysis of a sentence. It occurs as part of text level SSF. The analysis of a sentence may mark any or all of the following kinds of information as appropriate: part of speech of the words in the sentence; morphological analysis of the words including properties such as root, gender, number, person, tense, aspect, modality; phrase-structure or dependency structure of the sentence; and properties of units such as chunks, phrases, local word groups, tags, etc. SSF is theory neutral and allows both phrase structure as well as dependency structure to be coded, and even mixed in well defined ways. The SSF representation for a sentence consists of a sequence of trees. Each tree is made up of one or more related nodes. Total size of the Malayalam tree bank corpus is 9512 monolingual sentence ids ,6010 parallel sentence ids and approx. 251 verb frames. Following supporting documents are provided:
1. BIS Tag set
2. Chunk Guidelines
3. Dependency guidelines_Malayalam
5.morph guidelines final
Tags: TreeBank, Malayalam treebank, Malayalam Treebank Corpus, Tree Bank Data
Added on February 27, 2018
Contributed by : IL dependency tree bank, IIIT Hyd