Often times when a ticket is changed, it still shows up in searches and bins where it is no longer supposed to be -- and can stay in that state for a few minutes. If this is showing up now with the scale we have today, it's likely to grow worse as we migrate projects over to the beta.
We should investigate the cause of these delays, and determine what we can do to scale up SOLR write performance.
Probably our approach will be something like the following:
For better search performance, we should have two solr cores we use, a 'hot' core and a 'cold' core. The hot core will be the one all online updates go to, and it should be committed frequently. Periodically (maybe once a day), all the indexing operations on the hot core will be replayed to the cold core and the hot core will be cleared out, keeping its index small. Queries will need to query both cores, and will need to verify each document ID is not in a 'deleted' list if the document comes from the cold core.
Log in to post a comment.