sigpwned/berkeleylm issues and pull requests

#24 - createKneserNeyLmFromTextFiles function

Issue - State: open - Opened by GoogleCodeExporter over 9 years ago
Labels: Priority-Medium, Type-Defect, auto-migrated

#23 - Calculating log probability over larger document

Issue - State: open - Opened by GoogleCodeExporter over 9 years ago
Labels: Priority-Medium, Type-Defect, auto-migrated

#22 - Frequency Map

Issue - State: open - Opened by GoogleCodeExporter over 9 years ago - 1 comment
Labels: Priority-Medium, Type-Defect, auto-migrated

#21 - Trying to build a language model on higher-order n-grams.

Issue - State: closed - Opened by GoogleCodeExporter over 9 years ago - 3 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

#20 - Getting NAN on last trigram when using google binary

Issue - State: open - Opened by GoogleCodeExporter over 9 years ago - 1 comment
Labels: Priority-Medium, Type-Defect, auto-migrated

#19 - StarPos and EndPos for ngram log probability

Issue - State: closed - Opened by GoogleCodeExporter over 9 years ago - 3 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

#18 - broken link on http://tomato.banatao.berkeley.edu:8080/berkeleylm_binaries/

Issue - State: closed - Opened by GoogleCodeExporter over 9 years ago - 1 comment
Labels: Priority-Medium, Type-Defect, auto-migrated

#17 - Unrealistic perplexity

Issue - State: open - Opened by GoogleCodeExporter over 9 years ago - 3 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

#16 - Cannot train unigram model with Kneser-Ney

Issue - State: closed - Opened by GoogleCodeExporter over 9 years ago - 2 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

#15 - Are the log probabilities comparable across language models?

Issue - State: closed - Opened by GoogleCodeExporter over 9 years ago - 4 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

#14 - ArrayOutOfBoundsException when reading in a large ARPA file.

Issue - State: closed - Opened by GoogleCodeExporter over 9 years ago - 7 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

#13 - Can I feed this library raw counts instead of text files, and have it compute the Kneser Ney probabilities for me?

Issue - State: open - Opened by GoogleCodeExporter over 9 years ago - 1 comment
Labels: Priority-Medium, Type-Defect, auto-migrated

#12 - What's the log base of NgramLanguageModel.getLogProb() ?

Issue - State: open - Opened by GoogleCodeExporter over 9 years ago - 5 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

#11 - Runtime exception: Hash map is full with 100 keys. Should never happen.

Issue - State: closed - Opened by GoogleCodeExporter over 9 years ago - 16 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

#10 - ArrayIndexOutOfBoundsException while calling getLogProb

Issue - State: closed - Opened by GoogleCodeExporter over 9 years ago - 8 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

#9 - creating and reading arpa files is 1. locale dependant 2. seems to have problems with multiple tabs in the text 3. seems to have some problem with the lack of newlines

Issue - State: closed - Opened by GoogleCodeExporter over 9 years ago - 3 comments
Labels: Priority-Medium, Type-Defect, auto-migrated

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Issues

GitHub / sigpwned/berkeleylm issues and pull requests

#24 - createKneserNeyLmFromTextFiles function

#23 - Calculating log probability over larger document

#22 - Frequency Map

#21 - Trying to build a language model on higher-order n-grams.

#20 - Getting NAN on last trigram when using google binary

#19 - StarPos and EndPos for ngram log probability

#18 - broken link on http://tomato.banatao.berkeley.edu:8080/berkeleylm_binaries/

#17 - Unrealistic perplexity

#16 - Cannot train unigram model with Kneser-Ney

#15 - Are the log probabilities comparable across language models?

#14 - ArrayOutOfBoundsException when reading in a large ARPA file.

#13 - Can I feed this library raw counts instead of text files, and have it compute the Kneser Ney probabilities for me?

#12 - What's the log base of NgramLanguageModel.getLogProb() ?

#11 - Runtime exception: Hash map is full with 100 keys. Should never happen.

#10 - ArrayIndexOutOfBoundsException while calling getLogProb

#9 - creating and reading arpa files is 1. locale dependant 2. seems to have problems with multiple tabs in the text 3. seems to have some problem with the lack of newlines

#8 - MakeKneserNeyArpaFromText throws ArrayIndexOutOfBoundsException

#7 - Exception in thread "main" java.lang.NoClassDefFoundError: edu/berkeley/nlp/lm/io/MakeKneserNeyArpaFromText

#6 - -mx1000m not appropriate for Google n-grams

#5 - How to train on Google n-grams

#4 - Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException

#3 - Get raw ngram count in addition to logProb

#1 - What is the status of the code?