[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [edict-jmdict] [rare] tag for obscure kanji?

To: <edict-jmdict@***************>
Subject: Re: [edict-jmdict] [rare] tag for obscure kanji?
From: eiennohito@*********
Date: 15 Mar 2019 03:31:25 +0000

I am one of the Kyoto people.

We have newer (and larger) 10B web corpus and I can compute n-gram statistics for it.

The thing is I am not sure how to match JMDict entries with JUMAN/Juman++ analysis results.

JMDict is not a morphological analysis dictionary as Unidic/Jumandic/IPAdic are and there are multiple many-to-many matchings possible. Phrases are problematic as well. We also don't really do disambiguation of hiragana.

Follow-Ups:
- Re: [edict-jmdict] [rare] tag for obscure kanji?
  - From: Jim Breen <jimbreen@*********>

References:
- [rare] tag for obscure kanji?
  - From: Marcus Richert <superbrightfuture@*********>
- Re: [edict-jmdict] [rare] tag for obscure kanji?
  - From: Jim Breen <jimbreen@*********>
- Re: [edict-jmdict] [rare] tag for obscure kanji?
  - From: Marcus Richert <superbrightfuture@*********>
- Re: [edict-jmdict] [rare] tag for obscure kanji?
  - From: Marcus Richert <superbrightfuture@*********>
- Re: [edict-jmdict] [rare] tag for obscure kanji?
  - From: Darren Cook <darren@*********>
- Re: [edict-jmdict] [rare] tag for obscure kanji?
  - From: Jim Breen <jimbreen@*********>

Prev by Date: Re: [edict-jmdict] [rare] tag for obscure kanji?
Next by Date: Re: [edict-jmdict] [rare] tag for obscure kanji?
Previous by thread: Re: [edict-jmdict] [rare] tag for obscure kanji?
Next by thread: Re: [edict-jmdict] [rare] tag for obscure kanji?
Index(es):
- Date
- Thread