DocValues and ConcurrentModificationException

[avleen]

Possibly a bug in Lucene rather than Elasticsearch:

[2014-02-12 19:46:55,768][DEBUG][action.admin.indices.stats] [hostname] [logstash-2014.02.12][0], node[idCsLCeJQOuc_GEON7LCCQ], [R], s[STARTED]: Failed to execute [org.elasticsearch.action.admin.indices.stats.IndicesStatsRequest@10e4c9b1]
org.elasticsearch.transport.RemoteTransportException: [hostname][inet[/ip.add.re.ss:9300]][indices/stats/s]
Caused by: java.util.ConcurrentModificationException
        at java.util.HashMap$HashIterator.nextEntry(HashMap.java:926)
        at java.util.HashMap$ValueIterator.next(HashMap.java:954)
        at org.apache.lucene.codecs.lucene45.Lucene45DocValuesProducer.ramBytesUsed(Lucene45DocValuesProducer.java:291)
        at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsReader.ramBytesUsed(PerFieldDocValuesFormat.java:308)
        at org.apache.lucene.index.SegmentDocValues.ramBytesUsed(SegmentDocValues.java:103)
        at org.apache.lucene.index.SegmentReader.ramBytesUsed(SegmentReader.java:555)
        at org.elasticsearch.index.engine.internal.InternalEngine.getReaderRamBytesUsed(InternalEngine.java:1123)
        at org.elasticsearch.index.engine.internal.InternalEngine.segmentsStats(InternalEngine.java:1135)
        at org.elasticsearch.index.shard.service.InternalIndexShard.segmentStats(InternalIndexShard.java:532)
        at org.elasticsearch.action.admin.indices.stats.CommonStats.<init>(CommonStats.java:161)
        at org.elasticsearch.action.admin.indices.stats.ShardStats.<init>(ShardStats.java:49)
        at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.shardOperation(TransportIndicesStatsAction.java:197)
        at org.elasticsearch.action.admin.indices.stats.TransportIndicesStatsAction.shardOperation(TransportIndicesStatsAction.java:53)
        at org.elasticsearch.action.support.broadcast.TransportBroadcastOperationAction$ShardTransportHandler.messageReceived(TransportBroadcastOperationAction.java:413)
        at org.elasticsearch.action.support.broadcast.TransportBroadcastOperationAction$ShardTransportHandler.messageReceived(TransportBroadcastOperationAction.java:399)
        at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:270)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)

Elasticsearch 1.0.0 (GA), when trying to bulk index.

[s1monw]

Yes this is a lucene issue. It should go away once everything is loaded so it's not a critical bug though although irritating. I will open a Lucene issues and fix it in Lucene

[s1monw]

here is he corresponding lucene issue: https://issues.apache.org/jira/browse/LUCENE-5443

[s1monw]

this one if fixed in lucene so it will be fixed with the 4.7 upgrade