So entfernen Sie die Ausnahme im Thread "http-bio-8080-exec-5" java.lang.OutOfMemoryError: GC-Overhead-Limit überschritten?

Question

In meiner Anwendung lese ich xlsx-Datei-Daten mit 30 MB Größe, die 500 000 Zeilen enthalten und in die Datenbank einfügen.

Wenn ich die Anwendung nach einiger Zeit ausführen, bekomme ich die folgende Ausnahme. Ich suchte nach Lösung, aber ich bin nicht in der Lage zu verstehen, wie es geht.

Exception in thread "http-bio-8080-exec-5" java.lang.OutOfMemoryError: GC overhead limit exceeded 
at org.apache.xmlbeans.impl.store.Cur$CurLoadContext.attr(Cur.java:3044) 
at org.apache.xmlbeans.impl.store.Cur$CurLoadContext.attr(Cur.java:3065) 
at org.apache.xmlbeans.impl.store.Locale$SaxHandler.startElement(Locale.java:3263) 
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.reportStartTag(Piccolo.java:1082) 
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseAttributesNS(PiccoloLexer.java:1802) 
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseOpenTagNS(PiccoloLexer.java:1521) 
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseTagNS(PiccoloLexer.java:1362) 
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseXMLNS(PiccoloLexer.java:1293) 
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseXML(PiccoloLexer.java:1261) 
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.yylex(PiccoloLexer.java:4812) 
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.yylex(Piccolo.java:1290) 
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.yyparse(Piccolo.java:1400) 
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.parse(Piccolo.java:714) 
at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3479) 
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1277) 
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1264) 
at org.apache.xmlbeans.impl.schema.SchemaTypeLoaderBase.parse(SchemaTypeLoaderBase.java:345) 
at org.apache.poi.POIXMLTypeLoader.parse(POIXMLTypeLoader.java:92) 
at org.openxmlformats.schemas.spreadsheetml.x2006.main.WorksheetDocument$Factory.parse(Unknown Source) 
at org.apache.poi.xssf.usermodel.XSSFSheet.read(XSSFSheet.java:173) 
at org.apache.poi.xssf.usermodel.XSSFSheet.onDocumentRead(XSSFSheet.java:165) 
at org.apache.poi.xssf.usermodel.XSSFWorkbook.parseSheet(XSSFWorkbook.java:417) 
at org.apache.poi.xssf.usermodel.XSSFWorkbook.onDocumentRead(XSSFWorkbook.java:382) 
at org.apache.poi.POIXMLDocument.load(POIXMLDocument.java:178) 
at org.apache.poi.xssf.usermodel.XSSFWorkbook.<init>(XSSFWorkbook.java:279) 
at com.dip.SendXlsxToDb.doPost(SendXlsxToDb.java:44) 
at javax.servlet.http.HttpServlet.service(HttpServlet.java:650) 
at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) 
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) 
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) 
at org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:747) 
at org.apache.catalina.core.ApplicationDispatcher.doInclude(ApplicationDispatcher.java:603) 

Mein Code:

import java.io.File; 
import java.io.FileInputStream; 
import java.io.IOException; 
import java.sql.Connection; 
import java.sql.DriverManager; 
import java.sql.PreparedStatement; 
import java.sql.ResultSet; 
import java.sql.Statement; 
import java.util.Iterator; 

import javax.servlet.ServletException; 
import javax.servlet.http.HttpServlet; 
import javax.servlet.http.HttpServletRequest; 
import javax.servlet.http.HttpServletResponse; 
import javax.servlet.http.HttpSession; 
import javax.swing.text.ZoneView; 

import org.apache.poi.ss.usermodel.Cell; 
import org.apache.poi.ss.usermodel.Row; 
import org.apache.poi.xssf.usermodel.XSSFSheet; 
import org.apache.poi.xssf.usermodel.XSSFWorkbook; 

public class SendXlsxToDb extends HttpServlet{ 

@Override 
public void doPost(HttpServletRequest request, HttpServletResponse response) throws ServletException, IOException { 
    try 
    { 
     RetriveData rdata= new RetriveData(); 
     //System.out.println("ZoneId is :"+rdata.zoneId); 
     //System.out.println("Location is :"+rdata.location); 
     HttpSession hs = request.getSession(false); 
     System.out.println("=======================SendXlsxToDb========================"); 
     //creating db connection 
     Class.forName("com.mysql.jdbc.Driver"); 
     Connection con1 = DriverManager.getConnection("jdbc:mysql://localhost:3306/xlsx","root","Inf123#"); 
     PreparedStatement ps = con1.prepareStatement("INSERT INTO userdetails(ZONEID, LOCATION, ID, NAME, AGE, GENDER, ADDRESS) VALUES(?, ?, ?, ?, ?, ?, ?)"); 


     FileInputStream file = new FileInputStream(new File("C:/Users/Desktop/New folder/"+hs.getAttribute("filename1"))); 

     //Create Workbook instance holding reference to .xlsx file 
     XSSFWorkbook workbook = new XSSFWorkbook(file); 

     //Get first/desired sheet from the workbook 
     XSSFSheet sheet = workbook.getSheetAt(0); 

     //Iterate through each rows one by one 
     Iterator<Row> rowIterator = sheet.iterator(); 
     while (rowIterator.hasNext()) 
     { 
      int i = 3; 
      Row row = rowIterator.next(); 
      //For each row, iterate through all the columns 
      Iterator<Cell> cellIterator = row.cellIterator(); 
      ps.setString(1, (String)hs.getAttribute("zoneId1")); 
      ps.setString(2, (String)hs.getAttribute("location1")); 
      while (cellIterator.hasNext()) 
      { 
       Cell cell = cellIterator.next(); 
       ps.setString(i, cell.toString()); 
       i++; 

       //Check the cell type and format accordingly 
       /* switch (cell.getCellType()) 
       { 
        case Cell.CELL_TYPE_NUMERIC: 
         System.out.print(cell.getNumericCellValue() + "\t"); 

         break; 
        case Cell.CELL_TYPE_STRING: 
         System.out.print(cell.getStringCellValue() + "\t"); 
         break; 
       }*/ 
      } 
      ps.executeUpdate(); 
      //System.out.println(""); 
     } 
     file.close(); 
     ps.close(); 
     con1.close(); 
     System.out.println("THE EXECUTION OF THE PROGRAM IS COMPLETED"); 
     request.setAttribute("message","The XLSX File Data Transferred Successfully"); 
    } 
    catch (Exception e) 
    { 
     e.printStackTrace(); 
    } 

} 


} 

Wie um diesen Fehler zu entfernen? Ich benutze Java 1.7 und Windows-System

Answer 1

Diese Ausnahme sagt Ihnen, dass die VM mehr als 98% seiner Zeit Müll sammeln ausgibt. Sie können versuchen, andere Collectors zu verwenden (z. B. -XX: + UseG1GC eignet sich sehr gut für große Heaps), aber es ist viel wahrscheinlicher, dass Sie irgendwo ein Speicherleck haben. Untersuchen Sie Ihren Code genau, vielleicht mit einem Tool wie VisualVM oder AntTracks, um herauszufinden, was sich in Ihrem Heap befindet.

EDIT: im Fall, dass Sie wirklich so viel Haufen, versuchen Sie die Heap-Größe mit -Xmx4G steigenden oder sogar mehr ...

Answer 2

versuchen, eine Datei statt eines Fileinputstream zu verwenden, wenn Ihre Arbeitsmappe Konstruktion:

https://poi.apache.org/spreadsheet/quick-guide.html#FileInputStream

Dies sollte weniger Speicher verbrauchen.

Versuchen Sie auch, SXSSFWorkbook anstelle von XSSFWorkbook zu verwenden, um einen geringen Speicherbedarf zu haben. Sehen Sie bitte diesen Link:

http://poi.apache.org/spreadsheet/how-to.html#sxssf