Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DO NOT MERGE YET: Upgrade to solr6: DO NOT MERGE YET #195

Open
wants to merge 7 commits into
base: master
Choose a base branch
from

Conversation

cmungall
Copy link
Member

@cmungall cmungall commented May 1, 2017

Fixes #194

Still to do, but can be punted:

  • variable names may still say 'server' even though solrj changed class name from Server to Client
  • We use HttpSolrClient which is deprecated; change to builder

cc @kltm

DO NOT MERGE YET

Still to do, but can be punted:

 - variable names may still say 'server' even though solrj changed class name from Server to Client
 - We use HttpSolrClient which is deprecated; change to builder
@cmungall
Copy link
Member Author

cmungall commented Feb 9, 2018

Tagging @nathandunn @kltm

@nathandunn
Copy link

Just resolved a conflict. Some white-space moved around as well.

This reverts commit fd8bb2b, reversing
changes made to 41daab9.
@nathandunn
Copy link

nathandunn commented Feb 13, 2018

  • test master vs SOLR3
  • test branch versus SOLR3
  • test branch versus SOLR7
    • create instructions for SOLR7 (put in PR?)
  • fix versus SOLR3 (a weird byte error)?
  • fix to make a publicly loadable gaf (client does not like https or github)
  • install biolink

@nathandunn
Copy link

nathandunn commented Feb 13, 2018

#!/bin/bash 
java -Xms1024M -DentityExpansionLimit=4086000 -Djava.awt.headless=true -Xmx12G -jar ./OWLTools-Runner/bin/owltools http://purl.obolibrary.org/obo/go/extensions/go-lego.owl http://purl.obolibrary.org/obo/eco.owl http://purl.obolibrary.org/obo/ncbitaxon/subsets/taxslim.owl http://purl.obolibrary.org/obo/cl/cl-basic.owl http://purl.obolibrary.org/obo/go/extensions/gorel.owl http://purl.obolibrary.org/obo/pato.owl http://purl.obolibrary.org/obo/po.owl http://purl.obolibrary.org/obo/chebi.owl http://purl.obolibrary.org/obo/uberon/basic.owl http://purl.obolibrary.org/obo/wbbt.owl http://purl.obolibrary.org/obo/go/extensions/go-modules-annotations.owl http://purl.obolibrary.org/obo/go/extensions/go-taxon-subsets.owl --log-info --merge-support-ontologies --merge-imports-closure --remove-subset-entities upperlevel --remove-disjoints --silence-elk --reasoner elk --solr-taxon-subset-name amigo_grouping_subset --solr-eco-subset-name go_groupings --solr-url http://localhost:8080/solr/ --solr-log /tmp/golr_timestamp.log --solr-config /home/bbop/local/src/git/amigo/metadata/ont-config.yaml --solr-load-ontology --solr-load-ontology-general --read-panther /home/bbop/local/src/svn/geneontology.org/trunk/experimental/trees/panther_data/ --solr-load-gafs http://www.geneontology.org/gene-associations/submission/paint/pre-submission/gene_association.paint_other.gaf http://www.geneontology.org/gene-associations/gene_association.GeneDB_Lmajor.gz http://www.geneontology.org/gene-associations/goa_chicken.gaf.gz http://www.geneontology.org/gene-associations/gene_association.pombase.gz http://www.geneontology.org/gene-associations/gene_association.zfin.gz --solr-load-panther --solr-load-panther-general --solr-optimize

@nathandunn
Copy link

@kltm Is there a way to make this command execute quicker?

I feel as though its correct. Also, about how long should it be running for?

#!/bin/bash 
java -Xms1024M -DentityExpansionLimit=4086000 -Djava.awt.headless=true -Xmx12G -jar ./OWLTools-Runner/bin/owltools http://purl.obolibrary.org/obo/go/extensions/go-lego.owl http://purl.obolibrary.org/obo/eco.owl http://purl.obolibrary.org/obo/ncbitaxon/subsets/taxslim.owl http://purl.obolibrary.org/obo/cl/cl-basic.owl http://purl.obolibrary.org/obo/go/extensions/gorel.owl http://purl.obolibrary.org/obo/pato.owl http://purl.obolibrary.org/obo/po.owl http://purl.obolibrary.org/obo/chebi.owl http://purl.obolibrary.org/obo/uberon/basic.owl http://purl.obolibrary.org/obo/wbbt.owl http://purl.obolibrary.org/obo/go/extensions/go-modules-annotations.owl http://purl.obolibrary.org/obo/go/extensions/go-taxon-subsets.owl --log-info --merge-support-ontologies --merge-imports-closure --remove-subset-entities upperlevel --remove-disjoints --silence-elk --reasoner elk --solr-taxon-subset-name amigo_grouping_subset --solr-eco-subset-name go_groupings --solr-url http://localhost:8080/solr/ --solr-log /tmp/golr_timestamp.log --solr-config /home/bbop/local/src/git/amigo/metadata/ont-config.yaml --solr-load-ontology --solr-load-ontology-general --read-panther /home/bbop/local/src/svn/geneontology.org/trunk/experimental/trees/panther_data/ --solr-load-gafs http://www.geneontology.org/gene-associations/submission/paint/pre-submission/gene_association.paint_other.gaf http://www.geneontology.org/gene-associations/gene_association.GeneDB_Lmajor.gz http://www.geneontology.org/gene-associations/goa_chicken.gaf.gz http://www.geneontology.org/gene-associations/gene_association.pombase.gz http://www.geneontology.org/gene-associations/gene_association.zfin.gz --solr-load-panther --solr-load-panther-general --solr-optimize

@nathandunn
Copy link

@kltm / @cmungall Any reason not to do SOLR7 as it seems to be a stable release, as well.

@nathandunn
Copy link

nathandunn commented Feb 13, 2018

Simplified command:

java -Xms1024M -DentityExpansionLimit=4086000 -Djava.awt.headless=true -Xmx8G -jar ./OWLTools-Runner/bin/owltools  \
http://purl.obolibrary.org/obo/go/extensions/go-lego.owl  \
http://purl.obolibrary.org/obo/eco.owl  \
http://purl.obolibrary.org/obo/ncbitaxon/subsets/taxslim.owl  \
http://purl.obolibrary.org/obo/cl/cl-basic.owl  \
http://purl.obolibrary.org/obo/go/extensions/gorel.owl  \
http://purl.obolibrary.org/obo/pato.owl  \
http://purl.obolibrary.org/obo/po.owl  \
http://purl.obolibrary.org/obo/chebi.owl  \
http://purl.obolibrary.org/obo/uberon/basic.owl  \
http://purl.obolibrary.org/obo/wbbt.owl  \
http://purl.obolibrary.org/obo/go/extensions/go-modules-annotations.owl  \
http://purl.obolibrary.org/obo/go/extensions/go-taxon-subsets.owl \
--log-info --merge-support-ontologies --merge-imports-closure --remove-subset-entities upperlevel --remove-disjoints --silence-elk --reasoner elk --solr-taxon-subset-name amigo_grouping_subset --solr-eco-subset-name go_groupings \
--solr-url http://localhost:8983/solr/ --solr-log /tmp/golr_timestamp.log  --solr-load-ontology --solr-load-ontology-general  --solr-load-gafs  \
http://www.geneontology.org/gene-associations/goa_chicken.gaf.gz  \
http://www.geneontology.org/gene-associations/gene_association.pombase.gz --solr-load-panther-general --solr-optimize 

@kltm
Copy link
Member

kltm commented Feb 13, 2018

#195 (comment)
I think this is mentioned in the various tickets, but latest Solr is fine. That said, there's a possibility of pulling ahead of the monarch stack. I think we should just jump to the latest either way.

Also, it's good to get design and work-through comments in the ticket rather than a PR.

@cmungall
Copy link
Member Author

Is there a way to make this command execute quicker

I'm not sure where to document this and I don't know if it's overloading this particular task, but there is a change we need to make ubiquitously across go/monarch. We frequently initialize from a large import chain available via http URLs. This is sensitive to network timeouts etc.

Two alternate strategies are possible.

  1. We run robot mirror http://robot.obolibrary.org/mirror on the root importer to make a local cache plus catalog. You can certainly investigate this for testing purposes.
  2. There is no support for owl-zip in the OWLAPI Add support for OWL/ZIP owlcs/owlapi#375

@kltm
Copy link
Member

kltm commented Feb 13, 2018

#195 (comment)
It's good to get design and work-through comments in the ticket rather than a PR.

I think that's probably overloading what we want to do here; I think it might be better in another ticket.

@nathandunn nathandunn changed the title DO NOT MERGE YET: Upgrade to solr6: DO NOT MERGE YET DO NOT MERGE YET: Upgrade to solr7: DO NOT MERGE YET Feb 14, 2018
@nathandunn nathandunn added the WIP label Feb 15, 2018
@nathandunn
Copy link

Error of new branch (with these changes) vs SOLR3 using the [same script] (https://github.com/nathandunn/owltools/blob/test-fixes/test3.sh) :

INFO: {} 0 29
Feb 14, 2018 6:50:17 PM org.apache.solr.common.SolrException log
SEVERE: org.apache.solr.common.SolrException: Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)
	at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:81)
	at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
	at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
	at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:326)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
	at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Caused by: com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)
	at com.ctc.wstx.sr.StreamScanner.throwFromIOE(StreamScanner.java:708)
	at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1086)
	at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:104)
	at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79)
	... 22 more
Caused by: java.io.CharConversionException: Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)
	at com.ctc.wstx.io.UTF8Reader.reportInvalidOther(UTF8Reader.java:313)
	at com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:204)
	at com.ctc.wstx.io.ReaderSource.readInto(ReaderSource.java:84)
	at com.ctc.wstx.io.BranchingReaderSource.readInto(BranchingReaderSource.java:57)
	at com.ctc.wstx.sr.StreamScanner.loadMore(StreamScanner.java:992)
	at com.ctc.wstx.sr.StreamScanner.getNext(StreamScanner.java:763)
	at com.ctc.wstx.sr.BasicStreamReader.nextFromProlog(BasicStreamReader.java:1995)
	at com.ctc.wstx.sr.BasicStreamReader.next(BasicStreamReader.java:1069)
	... 24 more

Feb 14, 2018 6:50:17 PM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/update params={wt=javabin&version=2} status=400 QTime=29 

@nathandunn
Copy link

And on the client:

15","obj":"GO:0005856","pred":"part_of"}],"meta":{}}[0x0][0xf]"
2018-02-14 18:50:17,398 DEBUG (wire:72)  << "HTTP/1.1 400 Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)[\r][\n]"
2018-02-14 18:50:17,399 DEBUG (wire:72)  << "Content-Type: text/html; charset=iso-8859-1[\r][\n]"
2018-02-14 18:50:17,399 DEBUG (wire:72)  << "Cache-Control: must-revalidate,no-cache,no-store[\r][\n]"
2018-02-14 18:50:17,399 DEBUG (wire:72)  << "Content-Length: 1464[\r][\n]"
2018-02-14 18:50:17,399 DEBUG (wire:72)  << "[\r][\n]"
2018-02-14 18:50:17,399 DEBUG (DefaultClientConnection:253) Receiving response: HTTP/1.1 400 Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)
2018-02-14 18:50:17,400 DEBUG (headers:256) << HTTP/1.1 400 Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)
2018-02-14 18:50:17,400 DEBUG (headers:259) << Content-Type: text/html; charset=iso-8859-1
2018-02-14 18:50:17,400 DEBUG (headers:259) << Cache-Control: must-revalidate,no-cache,no-store
2018-02-14 18:50:17,400 DEBUG (headers:259) << Content-Length: 1464
2018-02-14 18:50:17,401 DEBUG (SystemDefaultHttpClient:510) Connection can be kept alive indefinitely
2018-02-14 18:50:17,408 DEBUG (wire:72)  << "<html>[\n]"
2018-02-14 18:50:17,408 DEBUG (wire:72)  << "<head>[\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>[\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<title>Error 400 Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)</title>[\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "</head>[\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<body><h2>HTTP ERROR 400</h2>[\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<p>Problem accessing /solr/update. Reason:[\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<pre>    Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)</pre></p><hr /><i><small>Powered by Jetty://</small></i><br/>                                                [\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,409 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,410 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,410 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,410 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,410 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,410 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,410 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,410 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,410 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,411 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,411 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,411 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,411 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,411 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,411 DEBUG (wire:72)  << "<br/>                                                [\n]"
2018-02-14 18:50:17,411 DEBUG (wire:72)  << "[\n]"
2018-02-14 18:50:17,411 DEBUG (wire:72)  << "</body>[\n]"
2018-02-14 18:50:17,412 DEBUG (wire:72)  << "</html>[\n]"
2018-02-14 18:50:17,412 DEBUG (PoolingClientConnectionManager:262) Connection [id: 0][route: {}->http://localhost:8983][state: class org.apache.solr.client.solrj.impl.HttpSolrClient] can be kept alive indefinitely
2018-02-14 18:50:17,412 DEBUG (PoolingClientConnectionManager:269) Connection released: [id: 0][route: {}->http://localhost:8983][state: class org.apache.solr.client.solrj.impl.HttpSolrClient][total kept alive: 1; route allocated: 1 of 32; total allocated: 1 of 128]
Exception in thread "main" org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://localhost:8983/solr: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
<title>Error 400 Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)</title>
</head>
<body><h2>HTTP ERROR 400</h2>
<p>Problem accessing /solr/update. Reason:
<pre>    Invalid UTF-8 middle byte 0xe0 (at char #1, byte #-1)</pre></p><hr /><i><small>Powered by Jetty://</small></i><br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                

</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:578)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:106)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:71)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:85)
	at owltools.solrj.AbstractSolrLoader.addToServer(AbstractSolrLoader.java:169)
	at owltools.solrj.AbstractSolrLoader.addAllAndCommit(AbstractSolrLoader.java:153)
	at owltools.solrj.FlexSolrDocumentLoader.load(FlexSolrDocumentLoader.java:54)
	at owltools.cli.SolrCommandRunner.flexLoadOntologySolr(SolrCommandRunner.java:330)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at owltools.cli.CommandRunner.runSingleIteration(CommandRunner.java:4312)
	at owltools.cli.CommandRunnerBase.run(CommandRunnerBase.java:76)
	at owltools.cli.CommandRunnerBase.run(CommandRunnerBase.java:68)
	at owltools.cli.CommandLineInterface.main(CommandLineInterface.java:12)

@nathandunn
Copy link

nathandunn commented Feb 15, 2018

Instructions for SOLR7:

  • download / explode SOLR7
  • rm files managed-schema solrconfig.xml from files/conf
  • cp schema files (schema.xml solrconfig.xml) to files/conf
  • start server: ./bin/solr -e dih

@nathandunn
Copy link

Redid the SOLR3 vs this PR merge and it worked (yeah!) running this (https://github.com/nathandunn/owltools/blob/test-fixes/test3-local.sh)

though requires a local copy of the GAF file as the scripts don't like https (maybe something to fix).

Going to need to try again SOLR7 next.

@nathandunn
Copy link

nathandunn commented Feb 15, 2018

From: https://github.com/monarch-initiative/solr-docker-monarch-golr/blob/master/files/run.sh solr6 instructions:

@nathandunn
Copy link

Still getting:

018-02-15 13:49:26,369 DEBUG (PoolingClientConnectionManager:269) Connection released: [id: 0][route: {}->http://localhost:8983][state: class org.apache.solr.client.solrj.impl.HttpSolrClient][total kept alive: 1; route allocated: 1 of 32; total allocated: 1 of 128]
Exception in thread "main" org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://localhost:8983/solr: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>
<title>Error 404 Not Found</title>
</head>
<body><h2>HTTP ERROR 404</h2>
<p>Problem accessing /solr/update. Reason:
<pre>    Not Found</pre></p>
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:578)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)

@cmungall
Copy link
Member Author

If we are truly confident that this branch is compatible with both solr3 and solr6, then we can merge it, simplifying things a lot.

Perhaps set up a different PR for discussion of solr7 client code, or for dockerizing solr6/7?

@kltm
Copy link
Member

kltm commented Feb 15, 2018

Lemme bounce over and test...

@kltm
Copy link
Member

kltm commented Feb 15, 2018

...or not. The build fails for me on this branch, but not master with: mvn clean install -DskipTests -Dmaven.javadoc.skip=true -Dsource.skip=true in OWLTools-Parent

@nathandunn
Copy link

Confident with 3. Not confident with 6, though its probably an error on my part. I'm pretty confident that the migration between 6 and 7 shouldn't pose any problem.

@nathandunn
Copy link

nathandunn commented Feb 15, 2018 via email

@kltm
Copy link
Member

kltm commented Feb 15, 2018

Are you running the top-level build.sh?

About a hundred unfound symbols a la:

[ERROR] /home/sjcarbon/local/src/git/owltools/OWLTools-Solr/src/main/java/owltools/solrj/GafSolrDocumentLoader.java:[565,22] cannot find symbol
  symbol:   class SolrInputDocument
  location: class owltools.solrj.GafSolrDocumentLoader
[ERROR] /home/sjcarbon/local/src/git/owltools/OWLTools-Solr/src/main/java/owltools/solrj/GafSolrDocumentLoader.java:[570,17] cannot find symbol
  symbol:   class SolrInputDocument
  location: class owltools.solrj.GafSolrDocumentLoader
[ERROR] /home/sjcarbon/local/src/git/owltools/OWLTools-Solr/src/main/java/owltools/solrj/GafSolrDocumentLoader.java:[570,53] cannot find symbol
  symbol:   class SolrInputDocument
  location: class owltools.solrj.GafSolrDocumentLoader
[ERROR] /home/sjcarbon/local/src/git/owltools/OWLTools-Solr/src/main/java/owltools/solrj/PANTHERSolrDocumentLoader.java:[49,33] cannot find symbol
  symbol:   class SolrInputDocument
  location: class owltools.solrj.PANTHERSolrDocumentLoader
[INFO] 102 errors 

@nathandunn
Copy link

nathandunn commented Feb 15, 2018 via email

@nathandunn
Copy link

I think its working, but I need to update the schema.xml file for 6 / 7:

golr: org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Unable to use updateLog: _version_ field must exist in schema and be searchable (indexed or docValues) and retrievable(stored or docValues) and not multiValued (_version_ does not exist)

if you have one, great, otherwise I'll work through this:

https://stackoverflow.com/questions/36942477/solr-version-field-must-exist-in-schema-and-be-searchable

@nathandunn
Copy link

@nathandunn
Copy link

and change the --solr-url from http://localhost:8983/solr/ to http://localhost:8983/solr/golr/

@nathandunn
Copy link

2018-02-15 15:33:36,056 DEBUG (PoolingClientConnectionManager:269) Connection released: [id: 0][route: {}->http://localhost:8983][state: class org.apache.solr.client.solrj.impl.HttpSolrClient][total kept alive: 1; route allocated: 1 of 32; total allocated: 1 of 128]
Exception in thread "main" org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://localhost:8983/solr/golr: SolrCore 'golr' is not available due to init failure: fieldType 'text_general' not found in the schema
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:610)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:279)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:268)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:106)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:71)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:85)

@nathandunn nathandunn changed the title DO NOT MERGE YET: Upgrade to solr7: DO NOT MERGE YET DO NOT MERGE YET: Upgrade to solr6: DO NOT MERGE YET Feb 16, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants