Natural Language Processing Agent-based modeling and unification-based NLP Pieter Wellens 2012-2013

Thursday 18 April 13

Thursday 18 April 13

Functional Models

Thursday 18 April 13

The Evolution of Language

Thursday 18 April 13

Grammaticalization -ibus!

-is!

Thursday 18 April 13

ne pas (cont)

Thursday 18 April 13

Complex Adaptive System

Thursday 18 April 13

Semiotic Cycle Language Games speaker sensorimotor systems

hearer world

world model

goal

world model

reference

reference meaning

meaning

Thursday 18 April 13

action

interpretation

conceptualisation

production

sensorimotor systems

utterance parsing

Thursday 18 April 13

Deep Language Processing

Thursday 18 April 13

http://arti.vub.ac.be Thursday 18 April 13

http://www.csl.sony.fr

The Talking Heads

speaker

hearer joint attention

sensorimotor systems

world

world model

goal

sensorimotor systems world model

action

interpretation

conceptualisation reference

reference meaning

meaning

utterance production

Thursday 18 April 13

parsing

Thursday 18 April 13

Communicative Success 40 35 0.8

30 25

0.6

20 0.4

15 10

0.2

communicative success average lexicon size lexicon coherence

0 0

10000

20000

30000

number of interactions Thursday 18 April 13

40000

5 0 50000

lexicon size

communicative success / coherence

1

Perspective Reversal

Thursday 18 April 13

Thursday 18 April 13

mark their perspective choice in language. They manage again to anise a spatial language system.

Cognitive Effort

Thursday 18 April 13

The Naming Game

Thursday 18 April 13

Semiotic Networks

Thursday 18 April 13

Body Posture and Language

Figure 2: Aspects of visual processing. Fro

the source image, the foreground/background of object segmentation (focusing on the upper signature of this posture represented as a graph centralised normalised moments.

ferent individuals. Figure 1: Experimental setup. Left: Two Sony QRIO humanoid A humanoid robot stands before a mirror and performs robots face each otheran andontology play an Action and Game. lexicon The speaker for ask To evolve or behaviors thus observing what visualthebody-images hearer to achieve a certain posture, like raise the left arm, o the visual image schemata they generate, Thursday 18 April 13

lex-entry-determiner

initial

lex-entry-determiner lex-entry-beisst lex-entry-mann

Natural Language

lex-entry-determiner lex-entry-determiner lex-entry-beisst

4- The Final linguistic structure

The final linguistic structure looks as follows (click to expand): new-unit-21 form ((string new-unit-21 "Hund")) footprints (lex-entry-hund)

det-unit-12

np-unit-12

meaning ((determined hund))

footprints (det-noun-cxn)

sem-cat (determiner) referent hund footprints (lex-entry-determiner) new-unit-21 meaning ((dog hund))

np-unit-12 referent hund sem-cat (ref-expression (sem-role patient)) footprints (det-noun-cxn)

syn-cat ((person 3) (case ((acc + + - - -) (dat - - - - -) (nom - - - - -))) (phrase np))

det-unit-12

form ((meets det-unit-12 new-unit-21))

syn-cat ((person 3) (case ((nom - - - - -) (acc + + - - -) (dat - - - - -))) (pos det))

sem-cat (entity) footprints (lex-entry-hund) new-unit-23

det-unit-11

footprints (lex-entry-beisst)

meaning ((determined mann)) referent mann footprints (lex-entry-determiner) new-unit-22 meaning ((man mann))

new-unit-24 footprints (transitive-cxn)

np-unit-11 referent mann sem-cat (ref-expression (sem-role agent))

sem syn top ◀ ▶ top

new-unit-24 footprints (transitive-cxn)

form ((string new-unit-23 "beißt")) syn-cat ((number ((pl -) (sg +))) (person 3) (val (transitive (subject np-unit-11) (object np-unit-12))) (pos verb))

footprints (det-noun-cxn)

new-unit-22 form ((string new-unit-22 "Mann"))

sem-cat (entity) referent mann footprints (lex-entry-mann)

footprints (lex-entry-mann) np-unit-11

new-unit-23 meaning ((bite ev-1 mann hund)) referent ev-1 footprints (lex-entry-beisst) sem-cat (event (val (agent-acts-on-patient ev-1 (agent mann) (patient hund))))

footprints (det-noun-cxn)

5- Utterance: "den Hund beißt der Mann"

syn-cat ((pos noun))

syn-cat ((case ((acc - - - - -) (dat - - - - -) (nom + + - - -))) (person 3) (phrase np))

det-unit-11

form ((meets det-unit-11 new-unit-22))

syn-cat ((person 3) (case ((nom + + - - -) (acc - - - - -) (dat - - - - -))) (pos det))

http://www.fcg-net.org

Thursday 18 April 13

form ((stem det-unit-12 "der") (string det-unit-12 "den"))

footprints (lex-entry-determiner den-morph)

referent hund

sem-cat (determiner)

syn-cat ((pos noun))

form ((stem det-unit-11 "der") (string det-unit-11 "der"))

footprints (lex-entry-determiner der-morph)