Shared Task
Indian Native Language Identification-(INLI)
                                                                [Held in conjunction with the FIRE 2017 :8th - 10th December 2017,IISc-Bangalore]
Task Description :-                                                                                                                                                                                                                            Visitor No.

In India, English is the most important language and has a status of the associated language. After Hindi, it is the most commonly spoken language in India and certainly the most read and written language. The number of second language speakers of English has constantly been on the increase and this has also contributed to its rich variation. English is blended with most of the Indian languages and is used as a second language or the third language frequently. Regional and educational differentiation distinguish the language usage and shows the stylistic variations in English. Spoken English shows great variation across the states of India and it is relatively easy to identify the native speaker using their English accent. But finding the native language of the user based on the comments or posts written in English is a challenging task in the current scenario

Native Language Identification (NLI) is the well-known shared task its focus was to identify the native language of non-native speakers, First Native Language Identification task conducted at 2013 based on essays and 2016 spoken responses used to identify the native language globally. Recently announced NLI shared task (co-joined with EMNLP) is proposed to conduct using the essays and spoken responses from the two previous tasks. A well-known workshop PAN included the "language variety identification in Twitter" in their Author Profiling task - 2017 . Here, we have proposed a shared task to identify the native language of an Indian user based on their comments in social media

The task is to identify the native language of the writer from the given Text/XML file which contains a set of Facebook comments in English language.

Six Indian languages are proposed to consider for this shared task they are Tamil, Hindi, Kannada, Malayalam, Bengali and Telugu.

Native Language Identification (NLI) can be important for a number of applications. In forensics, native language is often used as an important feature for authorship profiling and identification. Nowadays due to the huge usage of social media sites and online interactions, receiving a violent threat is a common issue faced by commuters. If a comment or post poses any type of threat, then identifying the native language of the person will be one of the significant measures in finding the source.


Dataset creation :-

* Six India languages named as classes TA, MA, HI, BE, TE and KA covering different states of India are considered for this INLI shared task.
* We have identified the official Facebook pages of prominent regional language newspapers of the each region and extracted the comments.
* We assume that only native region individuals interested in the regional language newspaper apart from others.
* We have removed the native and Mixed script text from the Facebook posts.
* Especially, we have extracted only the comments related to the general news in all over India (Ex: Noteban, Elections, National politics and Sports),
  omitted most of the region specific comments in order to avoid the dataset to be biased by its region.

Languages Covered in India

                                                                                                                  Kindly use the Version 2.0 data set for Experimentations
Time Line :-

                   *7 th July
             : Registration Starts
                  * 25 th July            :  Training data release Training data released
                                                   Training data Version 2.0 has been released

                  * 10 thSeptember  : Test data release
                     14 thSeptember
                  * 15 th September : Run submission deadline
                     25 thSeptember
                  * 20 th SeptemberResults declared
                     30 th September
                  * 15 th October     : Working notes due
                  * 8 th- 10 th Dec.  : FIRE 2017 Conference at ISI, Bangalore

Evaluation :-

The participants systems will be evaluated using Accuracy


Task Coordinators :-

* Anand Kumar M, CEN, Amrita Vishwa Vidyapeetham, Coimbatore, India
* Soman K P, CEN, Amrita Vishwa Vidyapeetham, Coimbatore, India
* Paolo Rosso, PRHLT Research Center, Universitat Politècnica de València, Spain

Contact us @

E-mail          :

INLI group  :