deep learning & unstructured data

Deep Learning & Unstructured

Dataor why you should use ☺

??

The problem of doing justice to the implicit, the imponderable, and the unknown is of course not unique in politics. It is always with us in science, it is with us in the most trivial of personal affairs, and it is one of the great problems of writing and of all forms

of art. The means by which it is solved is sometimes called style. It is style

which complements affirmation with limitation and with humility; it is style which makes it possible to act effectively, but not absolutely; it is style which, in the domain of foreign policy, enables us to find harmony between the pursuit of ends essential to us, and the regard for the views, the sensibilities, the aspirations of

those to whom the problem may appear in another light; it is style which is the deference that action pays to uncertainty; it is above all style through which power defers to reason.

Elements of styleFrom: David Gonzalez <davidbgonzalez@gmail.com>Mime-Version: 1.0 (1.0)Date: Mon, 6 Mar 2011 14:57:38 -0700Delivered-To: davidbgonzalez@gmail.comMessage-ID: <4484555894252760987@unknownmsgid>Subject: Should I take Friday off?To: Mindy Gonzalez <******@gmail.com>Content-Type: text/plain; charset=ISO-8859-1

We could go out early and maybe just get take-out for the kiddos?

??

data?

Gathering text

store

{u'message_id': 4484555894252760987, u’subject’: 'Should I take Friday off', u’body’: 'We could go out early and maybe just get take-out for the kiddos. \n ??', u’time_sent’: u’Mon, 6 Mar 2011 14:57:38 -0700’, u'user_id': 1}

Options?

Lexicon● Curated● Easy to understand● Often wrong● Not great w/

novelty

NN-style● More accurate● Domain specific● Not great w/

novelty

Optimize Response?

Optimize Sentiment?

Optimize Emotion?

Options?

Lexicon?

Unsupervised?

What counts?

Subjective vs Objective statements

Polarity+, ?, -

Sentiment “Lexicon”

Sentiment “Lexicon”

Emotional State

Emotional State?

Lexicon

Sponsors!