Solr进行Distinct 获取Count

由于solr的ISearch并没有相关的Distinct功能.想到一个解决方案是用Solr的Facet分组进行GrupBy,但是因为Facet只能返回100条,而数据肯定大于100个分组.所有该方案PASS了。 

后来在网上搜到Solr Count Distinct,这么一个东西,是Solr已经发布的脚本（Solr Search Requests）其中有类似的功能 

A 100% accurate count of distinct values (count distinct) is not generally possible without actually observing all of the values together. However there are a number of ways to estimate the count. 

“unique” Facet Function 

The unique facet function is Solr’s fastest implementation to calculate the number of distinct values. 

It always provides exact counts on a single Solr node. For distributed search over multiple nodes, it provides exact counts when the number of values per node does not exceed 100 (by default). 

When the number of unique values does exceed 100 in any given shard, the following algorithm is used: 

It estimates the count by sending the top 100 results from each shard along with the total exact “unique” count for each shard. 

totalSeen is the number of actual results we saw from all shards (i.e. not deduped yet). uniqueSeen is the number of unique values we saw from all shards (i.e. deduped). notSeen is the number of unique values from each shard that were not sent (because of the 100 cutoff). 

factor = uniqueSeen / totalSeen (i.e. what fraction of values that we saw were unique) estimate = uniqueSeen + ( notSeen * factor ) (i.e. we simply apply the factor to the number of values we didn’t see) Example use: 

$ curl http://localhost:8983/solr/techproducts/query -d ' 

q=*:*& 

json.facet={ 

x : "unique(manu_exact)" // manu_exact is the manufacturer indexed as a single string }' 

For more facet functions, adding facet functions to each facet bucket, or sorting by facet function, see Solr Facet Functions 

Aggregation Functions 

Faceting involves breaking up the domain into multiple buckets and providing information about each bucket. 

There are multiple aggregation functions / statistics that can be used: 

下面是我写的一个例子 

curl http://192.168.1.1:8080/solr/xxshard/query?q=*:* -d ' 

 json.facet={ 

 x:"unique(RB040002)" 

 }' 

写在最后：  

码字不易看到最后了，那就点个关注呗，只收藏不点关注的都是在耍流氓！ 关注并私信我“架构”，免费送一些Java架构资料，先到先得！