[InterMine Dev] keyword_search_index size

Joe Carlson jwcarlson at lbl.gov
Thu Mar 6 03:53:18 GMT 2014


out of curiosity, what is the typical size of your lucene keyword search index (for example, for flymine)? And how long does it take expand it from the blob when a mine gets deployer?

For a relatively small subset of our data, I’m seeing 3 minutes to expand. (du of the keyword_search_index is ~ 2G) I’m shuddering when I think about how big it will get and how long it will take with all the data.



More information about the dev mailing list