commit | dd0fb74d1317f8759152ce23c3b00a977906c22d | [log] [tgz] |
---|---|---|
author | Matt Post <post@cs.jhu.edu> | Mon Jun 15 10:34:46 2015 -0400 |
committer | Matt Post <post@cs.jhu.edu> | Mon Jun 15 10:34:46 2015 -0400 |
tree | 6622cf86ceaabd843cf2bee5078fe4b780ae35f8 | |
parent | 1c91fd4de1ee9e0c89c6c8e039552d37211f6721 [diff] |
Glue grammar line now deleted for phrase-based models
Joshua is a statistical machine translation toolkit for both phrase-based (new in version 6.0) and syntax-based decoding. It can be run with pre-built language packs available for download, and can also be used to build models for new language pairs. Among the many features of Joshua are:
The latest release of Joshua is always linked to directly from the Home Page
Joshua 6.0 includes the following new features:
Joshua includes a number of “language packs”, which are pre-built models that allow you to use the translation system as a black box, without worrying too much about how machine translation works. You can browse the models available for download on the Joshua website.
Joshua includes a pipeline script that allows you to build new models, provided you have training data. This pipeline can be run (more or less) by invoking a single command, which handles data preparation, alignment, phrase-table or grammar construction, and tuning of the model parameters. See the documentation for a walkthrough and more information about the many available options.
To run the decoder in any form requires setting a few basic environment variables: $JAVA_HOME
, $JOSHUA
, and potentially $MOSES
.
export JAVA_HOME=/path/to/java # maybe /usr/java/home export JOSHUA=/path/to/joshua
You might also find it helpful to set these:
export LC_ALL=en_US.UTF-8 export LANG=en_US.UTF-8
Then, compile Joshua by typing:
cd $JOSHUA ant
The basic method for invoking the decoder looks like this:
cat SOURCE | JOSHUA m MEM -c CONFIG OPTIONS > OUTPUT
Some example usage scenarios and scripts can be found in the examples/ directory.