Solr搜索引擎 — 中文全拼简拼分词

搞定了中文分词下一个就是要来搞定拼音分词了，拼音分词有分为全拼和简拼

附上:

喵了个咪的博客：http://w-blog.cn

Solr官网：http://lucene.apache.org/solr/

PS：8.0.0版本已经发布，本文使用此时较为稳定的7.7.1版本

一，全拼分词

1> wget http://files.cnblogs.com/files/wander1129/pinyin.zip
2> unzip pinyin.zip
3> mv pinyin4j-2.5.0.jar  server/solr-webapp/webapp/WEB-INF/lib
4> mv pinyinAnalyzer4.3.1.jar  server/solr-webapp/webapp/WEB-INF/lib
5
6
7> vim server/solr/new_core/conf/managed-schema
8
9<fieldType name="text_pinyin" class="solr.TextField" positionIncrementGap="0">
10    <analyzer type="index">
11        <tokenizer class="org.wltea.analyzer.lucene.IKTokenizerFactory"/>
12        <filter class="com.shentong.search.analyzers.PinyinTransformTokenFilterFactory" minTermLenght="2" />
13        <filter class="com.shentong.search.analyzers.PinyinNGramTokenFilterFactory" minGram="1" maxGram="20" />
14    </analyzer>
15    <analyzer type="query">
16        <tokenizer class="org.wltea.analyzer.lucene.IKTokenizerFactory"/>
17        <filter class="com.shentong.search.analyzers.PinyinTransformTokenFilterFactory" minTermLenght="2" />
18        <filter class="com.shentong.search.analyzers.PinyinNGramTokenFilterFactory" minGram="1" maxGram="20" />
19    </analyzer>
20</fieldType>

自制分词规则

1> webapps/solr/WEB-INF/classes/
2> cd /usr/local/solr-7.7.1/server/solr-webapp/webapp/WEB-INF
3> mkdir classes
4
5
6> wget http://pic.w-blog.cn/ikanalyzer-solr5.zip
7> unzip ikanalyzer-solr5.zip 
8> cd ikanalyzer-solr5/
9> mv ext.dic ../server/solr-webapp/webapp/WEB-INF/classes/
10> mv IKAnalyzer.cfg.xml ../server/solr-webapp/webapp/WEB-INF/classes/
11> mv stopword.dic ../server/solr-webapp/webapp/WEB-INF/classes/
12
13
14> vim ext.dic
15
16美团

简拼分词

1> wget http://pic.w-blog.cn/pinyinTokenFilter-1.1.0-RELEASE.jar
2> mv pinyinTokenFilter-1.1.0-RELEASE.jar server/solr-webapp/webapp/WEB-INF/lib
3
4
5> vim server/solr/new_core/conf/managed-schema
6
7<fieldType name="text_jian_pinyin" class="solr.TextField">  
8    <analyzer type="index">  
9        <tokenizer class="org.wltea.analyzer.lucene.IKTokenizerFactory" isMaxWordLength="false" useSmart="false" />  
10        <filter class="solr.LowerCaseFilterFactory" />  
11        <filter class="top.pinyin.index.solr.PinyinTokenFilterFactory" pinyin="true" isFirstChar="true" minTermLenght="2" />  
12        <filter class="com.shentong.search.analyzers.PinyinNGramTokenFilterFactory" minGram="2" maxGram="20" />  
13    </analyzer>  
14    <analyzer type="query">  
15        <tokenizer class="org.wltea.analyzer.lucene.IKTokenizerFactory" isMaxWordLength="false" useSmart="false" />  
16        <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true" />  
17        <filter class="solr.LowerCaseFilterFactory" />  
18    </analyzer>  
19</fieldType>  

<field name="app_name" type="text_jian_pinyin" indexed="true" stored="true" />