2016-08-02 6 views
1

Seit einigen Tagen habe ich mehrere Absturz in meinem applog bekam, wenn ich einige Dokumente hinzufügen bin versucht everething fein gearbeitet ...Elasticsearch - transllog ist bereits geschlossen

Spur:

java.util.concurrent.ExecutionException: RemoteTransportException[[server][1.1.1.1:9300][indices:data/write/index]]; nested: IndexFailedEngineException[Index failed for [com.domain.util.SearchField#2257100]]; nested: AlreadyClosedException[translog is already closed]; 

jede Spur:

java.util.concurrent.ExecutionException: RemoteTransportException[[server][1.1.1.1:9300][indices:data/write/index]]; nested: IndexFailedEngineException[Index failed for [com.domain.util.SearchField#2257100]]; nested: AlreadyClosedException[translog is already closed]; 
 
\t at org.elasticsearch.common.util.concurrent.BaseFuture$Sync.getValue(BaseFuture.java:290) 
 
\t at org.elasticsearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:277) 
 
\t at org.elasticsearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:116) 
 
\t at com.utils.ElasticsearchHelper.add(ElasticsearchHelper.java:230) 
 
\t at com.dao.searchable.impl.DaoSearchable.merge(DaoSearchable.java:478) 
 
\t at com.dao.searchable.impl.DaoSearchable.merge(DaoSearchable.java:31) 
 
\t at com.dao.util.impl.DaoEventImpl.listenObject(DaoEventImpl.java:417) 
 
\t at com.dao.util.impl.DaoEventImpl.addSearchEvent(DaoEventImpl.java:193) 
 
\t at com.utils.ShapesDaoUtils.manageEvent(ShapesDaoUtils.java:82) 
 
\t at com.dao.impl.ShapesDaoBaseJpa.merge(ShapesDaoBaseJpa.java:230) 
 
\t at com.services.collectiondocument.impl.CollectionDocumentsServiceImpl.addTagToCollectionDocuments(CollectionDocumentsServiceImpl.java:691) 
 
\t at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
 
\t at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
 
\t at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
 
\t at java.lang.reflect.Method.invoke(Method.java:606) 
 
\t at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) 
 
\t at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) 
 
\t at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) 
 
\t at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96) 
 
\t at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260) 
 
\t at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94) 
 
\t at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) 
 
\t at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) 
 
\t at com.sun.proxy.$Proxy1174.addTagToCollectionDocuments(Unknown Source) 
 
\t at com.services.impl.SampleServiceImpl.generateTechPacks(SampleServiceImpl.java:1480) 
 
\t at com.services.impl.SampleServiceImpl.generateTechPacksById(SampleServiceImpl.java:1352) 
 
\t at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
 
\t at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
 
\t at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
 
\t at java.lang.reflect.Method.invoke(Method.java:606) 
 
\t at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) 
 
\t at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) 
 
\t at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) 
 
\t at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:96) 
 
\t at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:260) 
 
\t at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94) 
 
\t at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) 
 
\t at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) 
 
\t at com.sun.proxy.$Proxy1291.generateTechPacksById(Unknown Source) 
 
\t at com.controller.sample.SampleController.generateTechPacks(SampleController.java:210) 
 
\t at com.controller.sample.SampleController$$FastClassByCGLIB$$df54e710.invoke(<generated>) 
 
\t at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) 
 
\t at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:698) 
 
\t at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) 
 
\t at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:55) 
 
\t at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) 
 
\t at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) 
 
\t at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) 
 
\t at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:631) 
 
\t at com.controller.sample.SampleController$$EnhancerByCGLIB$$cccf0aef.generateTechPacks(<generated>) 
 
\t at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
 
\t at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
 
\t at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 
 
\t at java.lang.reflect.Method.invoke(Method.java:606) 
 
\t at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:219) 
 
\t at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:132) 
 
\t at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104) 
 
\t at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:745) 
 
\t at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:686) 
 
\t at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:80) 
 
\t at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:925) 
 
\t at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:856) 
 
\t at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:936) 
 
\t at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:838) 
 
\t at javax.servlet.http.HttpServlet.service(HttpServlet.java:650) 
 
\t at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:812) 
 
\t at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) 
 
\t at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) 
 
\t at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) 
 
\t at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) 
 
\t at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) 
 
\t at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) 
 
\t at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:748) 
 
\t at org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:486) 
 
\t at org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:411) 
 
\t at org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:338) 
 
\t at org.tuckey.web.filters.urlrewrite.NormalRewrittenUrl.doRewrite(NormalRewrittenUrl.java:213) 
 
\t at org.tuckey.web.filters.urlrewrite.RuleChain.handleRewrite(RuleChain.java:171) 
 
\t at org.tuckey.web.filters.urlrewrite.RuleChain.doRules(RuleChain.java:145) 
 
\t at org.tuckey.web.filters.urlrewrite.UrlRewriter.processRequest(UrlRewriter.java:92) 
 
\t at org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:394) 
 
\t at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) 
 
\t at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) 
 
\t at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118) 
 
\t at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:103) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:54) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:186) 
 
\t at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:166) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.saml.metadata.MetadataDisplayFilter.doFilter(MetadataDisplayFilter.java:75) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.saml.SAMLEntryPoint.doFilter(SAMLEntryPoint.java:99) 
 
\t at com.oxit.fwk.security.fallback.OxitFallbackEntryPoint.doFilter(OxitFallbackEntryPoint.java:71) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.saml.SAMLLogoutFilter.processLogout(SAMLLogoutFilter.java:158) 
 
\t at org.springframework.security.saml.SAMLLogoutFilter.doFilter(SAMLLogoutFilter.java:104) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.saml.SAMLLogoutProcessingFilter.processLogout(SAMLLogoutProcessingFilter.java:172) 
 
\t at org.springframework.security.saml.SAMLLogoutProcessingFilter.doFilter(SAMLLogoutProcessingFilter.java:95) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at com.oxit.fwk.loginaudit.filter.LoginAuditFilter.doFilter(LoginAuditFilter.java:75) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.saml.metadata.MetadataGeneratorFilter.doFilter(MetadataGeneratorFilter.java:70) 
 
\t at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) 
 
\t at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) 
 
\t at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) 
 
\t at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) 
 
\t at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:259) 
 
\t at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) 
 
\t at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) 
 
\t at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) 
 
\t at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) 
 
\t at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505) 
 
\t at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) 
 
\t at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) 
 
\t at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:957) 
 
\t at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) 
 
\t at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:423) 
 
\t at org.apache.coyote.ajp.AjpAprProcessor.process(AjpAprProcessor.java:188) 
 
\t at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:620) 
 
\t at org.apache.tomcat.util.net.AprEndpoint$SocketProcessor.doRun(AprEndpoint.java:2516) 
 
\t at org.apache.tomcat.util.net.AprEndpoint$SocketProcessor.run(AprEndpoint.java:2505) 
 
\t at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
 
\t at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
 
\t at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) 
 
\t at java.lang.Thread.run(Thread.java:745) 
 
Caused by: RemoteTransportException[[server][1.1.1.1:9300][indices:data/write/index]]; nested: IndexFailedEngineException[Index failed for [com.domain.util.SearchField#2257100]]; nested: AlreadyClosedException[translog is already closed]; 
 
Caused by: [pace][[pace][2]] IndexFailedEngineException[Index failed for [com.domain.util.SearchField#2257100]]; nested: AlreadyClosedException[translog is already closed]; 
 
\t at org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.java:473) 
 
\t at org.elasticsearch.index.shard.IndexShard.index(IndexShard.java:571) 
 
\t at org.elasticsearch.index.engine.Engine$Index.execute(Engine.java:836) 
 
\t at org.elasticsearch.action.support.replication.TransportReplicationAction.executeIndexRequestOnPrimary(TransportReplicationAction.java:1073) 
 
\t at org.elasticsearch.action.index.TransportIndexAction.shardOperationOnPrimary(TransportIndexAction.java:170) 
 
\t at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase.performOnPrimary(TransportReplicationAction.java:579) 
 
\t at org.elasticsearch.action.support.replication.TransportReplicationAction$PrimaryPhase$1.doRun(TransportReplicationAction.java:452) 
 
\t at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) 
 
\t at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
 
\t at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
 
\t at java.lang.Thread.run(Thread.java:745) 
 
Caused by: org.apache.lucene.store.AlreadyClosedException: translog is already closed 
 
\t at org.elasticsearch.index.translog.Translog.ensureOpen(Translog.java:1845) 
 
\t at org.elasticsearch.index.translog.Translog.add(Translog.java:513) 
 
\t at org.elasticsearch.index.engine.InternalEngine.innerIndex(InternalEngine.java:553) 
 
\t at org.elasticsearch.index.engine.InternalEngine.index(InternalEngine.java:468) 
 
\t ... 10 more

Ich verstehe nicht warum

Antwort

0

Vielleicht in den Index eine Menge von Dokumenten und _bulk Anfrage werden so lange ausgeführt. Und der Fehler tritt auf, wenn der translog im Aufnahmeprozess ist.

Änderungen an Lucene sind beharren nur auf der Festplatte während eines Lucene begehen, , die eine relativ schwere Operation und kann daher nicht nach jedem Index oder löscht Betrieb durchgeführt werden. Änderungen, die nach einem Commit und vor einem anderen auftreten, gehen verloren, wenn der Prozess beendet wird oder der HW ausfällt.

Ich half index.translog.sync_interval ändern: 10s in elasticsearch.yml und ändert die Anzahl der Dokumente (500-1000) in einer Bulk Anfrage.

Elasticsearch muss optimiert werden.

Verwandte Themen