Main Page

From EDRDG Wiki
Revision as of 06:11, 15 November 2024 by JimBreen (talk | contribs) (→‎Documentation and Links)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Electronic Dictionary Research and Development Group

Welcome to the Wiki of the Electronic Dictionary Research and Development Group. The Wiki has been developed as a repository of information and documentation about the Group's work and projects.

User Accounts

Sorry but we no longer provide user accounts. We've been hit by link spammers which led to disabling of self-creation of accounts, and it's all too much a distraction.

If you have any edits you would like to suggest, email Jim Breen (jimbreen-at-gmail.com) with the details.

The JMdict/EDICT Project

This project is to build and maintain a freely-usable general Japanese electronic dictionary database.

History

The project began in 1991 with the EDICT Japanese-English text file in a simple format. In 1999 this was expanded into the XML-format JMdict file with a more complex format allowing for much better treatment of Japanese words and expressions. From 1999 the data was maintained by Jim Breen in a mark-up system from which the JMdict file, in both English and multiple-language editions, the EDICT file, and the extended EDICT2 file were generated. Public input into the project was mainly via WWW forms incorporated in the WWWJDIC server, and new editions of the files were generated daily.

In July 2010 maintenance of the JMdict data moved to an online database, from which the daily distributions are prepared. In September 2014 the maintenance of the [JMnedict] named-entity data was moved to that database too.

Documentation and Links

Some useful links are:

Current Version & Downloads

The project's master database is continuously being updated and new versions of the files are generated daily. The date of generation is included in the header of the files.

The files are currently distributed via the EDRDG ftp server, (formerly at Monash University) which also provides an rsync service. The main files available are:

  • JMdict.gz - the full JMdict file, including English, German, French, Russian, Spanish, Hungarian, Slovenian and Dutch glosses;
  • JMdict_e.gz - the JMdict file with only English glosses;
  • JMdict_b.gz - the basic JMdict file with only English glosses. This file omits several thousand proper name entries from JMnedict;;
  • JMdict_e_examp.gz - the above JMdict file with example sentence pairs from the Tanaka_Corpus;
  • edict.gz - the "traditional" EDICT file.
  • edict2.gz - the extended EDICT2 file.

JMdictDB Database

The maintenance of the JMdict/EDICT and JMnedict/ENAMDICT dictionary files is now handled by the online JMdict Database (JMdictDB) system developed by Stuart McGraw, and operational since June 2010. For more information see:

The Tanaka Corpus

This project is to maintain and extend the Tanaka Corpus which is a large collection of parallel Japanese/English sentence pairs.

The Corpus is now maintained within the Tatoeba Project. This project has extended the file to include many other languages, and many sentences are available in three or more languages. The project WWW site has extensive facilities for searching and editing the sentences, and has an active community of people entering and editing sentences.

An important aspect of the Tanaka Corpus and its ongoing maintenance and expansion is its use as a source of examples in dictionary systems such as WWWJDIC, Denshi Jisho , etc. This is achieved via a set of indices attached to each sentence pair. There is a detailed description of this process.

While the Tatoeba Project and Tanaka Corpus are largely independent of the JMdict project there are two areas of overlap:

  • in the indexing of sentences the JMdict sequence numbers are occasionally used to distinguish between otherwise identical surface forms;
  • a special version of JMdict (JMdict_e_examp.gz) is available which has the "priority" example sentences from the Tatoeba Project embedded within the relevant entries. This version is automatically generated.

The KANJIDIC Project

The KANJIDIC Project has compiled files of comprehensive information on kanji used in Japanese text processing. The files cover the kanji in three Japanese standards:

The COMPDIC Project

The COMPDIC project involved the compilation of a glossary of terms used in the computing and telecommunications industries. The file was in the "EDICT" format. See the brief documentation.

In 2008 the entries in the COMPDIC file were included in the JMdict/EDICT file. While it is no longer maintained as a separate file, an extract of the entries relating to computing and telecommunications is still generated.

The ENAMDICT/JMnedict Project

The JMnedict/ENAMDICT files contain about 740,000 proper names in Japanese, covering place-names, surnames, given names, company names, names of artistic and literary works, product names, etc.. There is a basic documentation page.

  • JMnedict (the Japanese-Multilingual named entity dictionary) is in XML format and is in Unicode/UTF-8 coding. (download)
  • ENAMDICT is in a variant of the EDICT format, with part-of-speech and other tags omitted and replaced with some special tags to indicate the type of proper name. (download)

The information in the files is held in the same database as the JMdict/EDICT information. To use the online edit system follow this link and select "jmnedict" from the drop-down Corpus menu.

Several thousand common entries from JMnedict are also included in the JMdict distribution.

The KRADFILE/RADKFILE Project

This project provides a decomposition of kanji into a number of visual elements or radicals to support software that provides a lookup service using kanji components. These elements can be seen in the WWWJDIC server, the Jisho.org server, and Ben Bullock's SLJFAQ page.

There is an information page about the data files. The files can be downloaded - use the links in that page.

The WWWJDIC Dictionary Server

WWWJDIC is a dictionary WWW server first developed by Jim Breen in 1998. Its (rather clunky) name came about because it is based on code and techniques developed in the earlier JDIC (DOS) and XJDIC (Unix/X11) applications.

The home site of the server is here, and there are several mirror sites which are updated daily from the home site. The server has links at the dictionary entry level to other sites and to the JMdict database for editing entries.

The main documentation is the WWWJDIC User's Guide.

A number of elements in the server's display can be configured by users, and the interface language can be set to Japanese (as part of the WWWJDIC in Japanese project.)

Wishlist

This is a set of wishlist items for the various projects. Feel free to add suggestions.

There is also an old wishlist page. Some of the items in this section have been copied from it.

Mailing List

There is a mailing list for people engaged in the EDRDG projects.

How Can I Help?

From time to time people ask how they can best contribute to the projects. There are many ways of assisting, the main ones being:

  • adding to and enhancing the main (EDICT/JMdict) dictionary file. This is best done by using the Search and New Entry pages of the JMdictDB system.
  • adding extra Japanese-English sentence pairs to the collection based on the Tanaka Corpus. This is done by adding them to the Tatoeba Project as a linked sentence pair, the contact Jim Breen to have them indexed.
  • assisting with the translation of the WWWJDIC interface into other languages. At present the priority is to make it fully available in Japanese. See the WWWJDIC in Japanese page.
  • work through the lists of words Paul Blay has place on the Talk:Tanaka_Corpus page, which could become new dictionary entries.
  • join and participate in the mailing list for people engaged in the EDRDG projects.