The NLP progresses seems to me that has split in two big group of thoughts: Deep
ID: 649791 • Letter: T
Question
The NLP progresses seems to me that has split in two big group of thoughts:
Deep learning have a neural network with multiple layers that has been trained and learned to represent knowledge and understand the meaning of sentences. However, such system would be difficult to debug and correct
Logic and inference, label parts of speech and learn by inference and using tools such as Natural logic.
Can someone point out if anything is wrong in these conclusions? Is there any other stream of thoughts that I should be taking into consideration?
Explanation / Answer
Very briefly:
Option 1 faces difficulties since certain connectionist models are incapable of learning natural languages.
Option 2 faces grave difficulties due to many negative results, notably Gold's theorem. There's a nice overview which includes a discussion of probabilistic approaches.
Generally, the response to these difficulties has been to look at other sources of information beyond the linguistic input alone.
Related Questions
drjack9650@gmail.com
Navigate
Integrity-first tutoring: explanations and feedback only — we do not complete graded work. Learn more.