Document contains at least one immense term in field=“****“ (whose UTF8 encoding is longer than t

浅浅的花香味﹌ 2023-01-23 09:53 16阅读 0赞

使用的es版本是6.2.3，在入数据的时候，有些数据没有入进去，报了这个错误：

java.lang.IllegalArgumentException: Document contains at least one immense term in field="message" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Pleas
    e correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[60, 63, 120, 109, 108, 32, 118, 101, 114, 115, 105, 111, 110, 61, 34, 49, 46, 48, 34, 32, 101, 11
    0, 99, 111, 100, 105, 110, 103, 61, 34]...', original message: bytes can be at most 32766 in length; got 60465
    	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:692)
    	at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:365)
    	at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:321)
    	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:234)
    	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:450)
    	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1477)
    	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1256)
    	at org.elasticsearch.index.engine.InternalEngine.innerCreateNoLock(InternalEngine.java:434)
    	at org.elasticsearch.index.engine.InternalEngine.innerCreate(InternalEngine.java:375)
    	at org.elasticsearch.index.engine.InternalEngine.create(InternalEngine.java:346)
    	at org.elasticsearch.index.shard.IndexShard.create(IndexShard.java:545)
    	at org.elasticsearch.index.engine.Engine$Create.execute(Engine.java:810)
    	at org.elasticsearch.action.index.TransportIndexAction.executeIndexRequestOnPrimary(TransportIndexAction.java:236)
    	at org.elasticsearch.action.bulk.TransportShardBulkAction.shardIndexOperation(TransportShardBulkAction.java:327)
    	at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:120)
    	at org.elasticsearch.action.bulk.TransportShardBulkAction.shardOperationOnPrimary(TransportShardBulkAction.java:68)
    	at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase.doRun(TransportReplicationAction.java:648)
    	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
    	at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:279)
    	at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryOperationTransportHandler.messageReceived(TransportReplicationAction.java:271)
    	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:77)
    	at org.elasticsearch.transport.TransportService$4.doRun(TransportService.java:376)
    	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37)
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    	at java.lang.Thread.run(Thread.java:748)
    Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 60465
    	at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:284)
    	at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:150)
    	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:682)
    	... 25 more

keyword类型的最大支持的长度为32766个UTF-8类型的字符。  
text对字符长度没有限制。  
因此将mapping修改为：

{
    "type":"text"
    }