commit | ca3f45d8f5000eceb026de6591ed18b4c7db8874 | [log] [tgz] |
---|---|---|
author | Nga Quach <ngathienquach@gmail.com> | Fri Mar 09 19:04:50 2018 -0800 |
committer | GitHub <noreply@github.com> | Fri Mar 09 19:04:50 2018 -0800 |
tree | f9cbb341389c4b1974cbfea38ecf788308676229 | |
parent | 421856accb0bb7227f63943ed41c6b70f471ebcf [diff] | |
parent | 1706f959e7cce0032e927ca384b0ff3fd5fca5b2 [diff] |
Merge pull request #7 from ntquach/SDAP-37 SDAP-37 Update SolrProxy to allow tile search by arbitrary tile metadata
The next generation cloud-based science data service platform
solr
, xd
, and kafka
Install and configure Apache Solr Cloud 5.3.x
Download JTS Topology Suite v1.13 and extract the zip.
From the exploded JTS zip, copy $JTS_ZIP/lib/jts-1.13.jar
and $JTS_ZIP/lib/jtsio-1.13.jar
into $SOLR_INSTALL_DIR/server/lib/ext
on all Solr nodes.
Configure Solr Cloud to use the /solr
chroot of zookeeper
On one of the Solr cloud nodes, upload the nexustiles
configuration (located in data-access/config/schemas/solr) as a configset
./zkcli.sh -cmd upconfig -z $ZK_SERVERS/solr -confname nexustiles -confdir /path/to/nexustiles/conf
Create a new collection with the name nexustiles. Use the nexustiles configset uploaded previously.
curl "http://<SOLR_HOST>/solr/admin/collections?action=CREATE&name=nexustiles&collection.configName=nexustiles"
Repeat steps 5 & 6 for the datasets collection.
/kafka
chroot of zookeeperxd
chrootnone
in $SPRING_XD_HOME/xd/lib
In order for streams to use the custom python and groovy scripts found in nexus-ingest, the machines that will be running Spring XD containers need to have some software installed on them.
Install Anaconda 4.0.0 with Python 2.7
Create an Anaconda environment
conda create --name nexus-xd-python-modules python
Install conda dependencies
conda install libnetcdf conda install netcdf4 conda install numpy
Install nexusproto
Install spring-xd-python
Install nexus-xd-python-modules
The nexus-messages JAR needs to be available via Maven. There are a number of ways to do this. One way is to explicitly install the dependency into the local maven cache on each XD Container node.
mvn install:install-file -DpomFile=nexus-messages-VERSION.xml -Dfile=nexus-messages-VERSION.jar