Skip to content
/ jedi Public

JEDI an automated system to jointly extract typed named entities and Freebase relations using dependency pattern

License

Notifications You must be signed in to change notification settings

jkirsch/jedi

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

31 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

JEDI

JEDI is an automated system to jointly extract typed named entities and Freebase relations using dependency pattern from text.

Running

You need to setup the pattern-relation assignment lucene index, hosted here http://www.user.tu-berlin.de/jkirsch/datasets/acl2016-jedi/freepal-index.tar.bz2 (900 MB) Download and extract it into the root directory of the project

curl -O http://www.user.tu-berlin.de/jkirsch/datasets/acl2016-jedi/freepal-index.tar.bz2
tar xvfj freepal-index.tar.bz2
rm freepal-index.tar.bz2

If you place the index directory into a different location, adjust the index.directory location field in the properties file sample/src/main/resources/application.properties

To start a simple test once setup, run

./mvnw install -DskipTests 
./mvnw spring-boot:run -pl sample

Example result

For the sample sentence

Bill Gothard received his B.A. in Biblical Studies from Wheaton College in 1957.

The system produces

Object Relation Subject Pattern
Bill Gothard /people/person/education. /education/education/degree B.A. [X] receive [Y] [1-dobj-2,1-nsubj-0]
Bill Gothard /people/person/education. /education/education/major_field_of_study Biblical Studies [X] receive in [Y] [1-nsubj-0,1-prep-2,2-pobj-3]
Bill Gothard /people/person/education. /education/education/institution Wheaton College [X] receive from [Y] [1-nsubj-0,1-prep-2,2-pobj-3]
B.A. /education/educational_degree/people_with_this_degree. /education/education/major_field_of_study Biblical Studies receive [X] in [Y] [0-dobj-1,0-prep-2,2-pobj-3]
B.A. /education/educational_degree/people_with_this_degree. /education/education/institution Wheaton College receive [X] from [Y] [0-dobj-1,0-prep-2,2-pobj-3]
Biblical Studies /education/field_of_study/students_majoring. /education/education/institution Wheaton College receive in [X] from [Y] [0-prep-1,0-prep-3,1-pobj-2,3-pobj-4]

Jedi also detects inverse relation, if they are specified in Freebase

Usage

You can use to import the maven dependencies into your code.

For maven, add a new repository pointing to jitpack.

<repository>
    <id>jitpack.io</id>
    <url>https://jitpack.io</url>
</repository>

And add the following dependency, which uses the latest master version.

<dependency>
    <groupId>com.github.jkirsch.jedi</groupId>
    <artifactId>core</artifactId>
    <version>master-SNAPSHOT</version>
</dependency>

Sample Code for embedding JEDI

// initialize text annotation pipeline
TextAnnotationPipeline annotationPipeline =
    TextAnnotationPipeline.withOptions("-annotateCoreferences");

// create pattern feature extractor
AbstractShortestPathFeatureExtractor featureExtractor
    = new AllPairsShortestPathFeatureExtractor(
        " -lemmatize " +
        " -resolveCoreferences " +
        " -selectionType " + N.class.getName() +
        " -additionalSelectionType " + ADJ.class.getName() +
        " -name all");


// initialize detection service with defaults
JediService jediService = new JediService(annotationPipeline, featureExtractor);

String sentence = "Bill Gothard received his B.A. in Biblical Studies from Wheaton College in 1957.";

// execute relation detection
RelationDetectionResults<Annotation> relations = jediService.detectRelations(sentence);

Full example code

About

JEDI an automated system to jointly extract typed named entities and Freebase relations using dependency pattern

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published