open domain question answering system

19
Open Domain Question Answering System using Cognitive Computing

Upload: sri-vennela-vaishnapu

Post on 10-Apr-2017

83 views

Category:

Data & Analytics


0 download

TRANSCRIPT

Page 1: Open Domain Question Answering System

Open Domain Question Answering System using Cognitive Computing

Page 2: Open Domain Question Answering System

Contents1. Introduction2. Methodologies3. Proposed Architecture4. Implementation5. Advantages6. Disadvantages7. Conclusion

Page 3: Open Domain Question Answering System

1. IntroductionOpen Domain Question Answering System is the new way of searching for the information present on the internet .

Main objective: To retrieve correct answers to the queries posed by the users in search engines.

Data source:world wide web or local database collection.

Improvised in an efficient way by using:➔ Cognitive Computing

Page 4: Open Domain Question Answering System

What is Cognitive Computing and how is it used in this system to make it more efficient?

Page 5: Open Domain Question Answering System

2.Methodologies1. Personalized e-learning recommender.

2. Answering English questions by computer.

3. Template based question answering system.

4. DBpedia and Freebase.

5. The Proposed System

Page 6: Open Domain Question Answering System

3. Proposed ArchitectureTraditional question answering questions are of two types:

➔ Open Domain System*anything and everything can be answered.

➔ Closed domain system*data is restricted to particular domain.

Page 7: Open Domain Question Answering System

Modelling of question answering system at psychological level

Question Interpretation

Question category Identification

Apply question answering procedure to relevant knowledge data structures

Articulate answers

Page 8: Open Domain Question Answering System

4. Implementation1. Indexing

2. Question processing

3. Query generation

4. Candidate Answer Extraction

5. Answer Ranking and scoring

Page 9: Open Domain Question Answering System

Indexing● collecting, parsing, and storing data

to facilitate fast and accurate information retrieval.

● Documents cleaned from SGML markup.

● Splitting document up into tokens.● Storing in inverted index.

Page 10: Open Domain Question Answering System

Question processing

● Answer extraction in a collection of large number of texts and documents.

Two phases

1.parsing the query 2. Computing the answer type

Classify the question

Identify the answer

Light weight process

Page 11: Open Domain Question Answering System

● To generate a query that will retrieve candidate

passage.

● Parts of speech tagging.

● Matching it with passage.

Query generation

Page 12: Open Domain Question Answering System

Candidate Answer Extraction

Answer Extraction

Based on textual pattern

Similarity between query and candidate sentences

Feature based method

Page 13: Open Domain Question Answering System

Answer ranking and scoring● Confidence score is generated on various parameters which is

used for ranking.

Parameters:

● Number of consecutive terms

which are present both in

passage and query.

● Synonyms of query.

Page 14: Open Domain Question Answering System

ArchitectureUser query

Analyze natural language query

Tokenization and POS tagging

Extract keywords

Determine answer type

Execute Search

Answer Extraction

Answer ranking

qFinding conceptual terms

Passage retrieval

Query keywords

Page 15: Open Domain Question Answering System

5.Advantages● User need not wade through huge

amount of data.

● It can interpret natural language.

● Time saving process

● Accurate answers

Page 16: Open Domain Question Answering System

6.Disadvantages

● Database maintenance.

Page 17: Open Domain Question Answering System

ConclusionMany users want to have answers of their queries posed in search bar as we humans do answer instead of browsing a collection of web documents returned as results.This is an efficient way of implementing it .In future work we can add speech recognition to identify the question from the end user.

Page 18: Open Domain Question Answering System

Any Questions

?

Page 19: Open Domain Question Answering System

THANK YOU!!