Hello,
I followed the instructions in the documentation at https://github.com/MI-DPLA/combine-docker
In particular, I followed the Linux instructions referenced above: https://github.com/MI-DPLA/combine-docker/blob/master/combine_docker_detailed_installation_instructions.pdf
Upon running the "build.sh" command, I notice the following fatal ERROR [1].
I attempted to solve this issue by editing combine/combine/requirements.txt and bumping mongoengine version to 0.20.0:
mongoengine==0.15.3 -> mongoengine==0.20.0
This resulted in a "successful" build, I think, as the build continued much further along than previously. It seems to have run to completion with no fatal ERROR messages.
However, I was wondering if the seemingly benign error messages [2] I still receive are any cause for concern.(I added "set -x" to the beginning of build.sh so you can see which command the error message belongs.)
Thanks for looking into this issue!
--Chris
[1] Error from build.sh:
Collecting mongoengine==0.15.3
Downloading mongoengine-0.15.3.tar.gz (145 kB)
ERROR: Command errored out with exit status 1:
command: /opt/conda/envs/combine/bin/python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-1o3lpuss/mongoengine_5adafc0a256a43b98782731d439c5354/setup.py'"'"'; file='"'"'/tmp/pip-install-1o3lpuss/mongoengine_5adafc0a256a43b98782731d439c5354/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(file) if os.path.exists(file) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-pum93_9h
cwd: /tmp/pip-install-1o3lpuss/mongoengine_5adafc0a256a43b98782731d439c5354/
Complete output (1 lines):
error in mongoengine setup command: use_2to3 is invalid.
----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/32/d0/74628eaa7839cd35cd68fdab69f76ee0807652996c668354308d61558d38/mongoengine-0.15.3.tar.gz#sha256=2ecc60f50d9f85d4ae7e2e8bd1dc19778af65d2883d5ad6d658d77f1560059d3 (from https://pypi.org/simple/mongoengine/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
ERROR: Could not find a version that satisfies the requirement mongoengine==0.15.3 (from versions: 0.4, 0.5, 0.5.1, 0.5.2, 0.6.1, 0.6.3, 0.6.4, 0.6.6, 0.6.7, 0.6.8, 0.6.10, 0.6.12, 0.6.13, 0.6.15, 0.6.16, 0.6.17, 0.6.19, 0.6.20, 0.7.0, 0.7.1, 0.7.2, 0.7.3, 0.7.4, 0.7.5, 0.7.8, 0.7.9, 0.7.10, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.8.5, 0.8.6, 0.8.7, 0.8.7.post2, 0.8.7.1, 0.8.8, 0.9.0, 0.10.0, 0.10.1, 0.10.4, 0.10.5, 0.10.6, 0.10.7, 0.10.9, 0.11.0, 0.12.0, 0.13.0, 0.14.3, 0.15.0, 0.15.3, 0.16.0, 0.16.1, 0.16.2, 0.16.3, 0.17.0, 0.18.0, 0.18.2, 0.19.0, 0.19.1, 0.20.0, 0.21.0, 0.22.0, 0.22.1, 0.23.0, 0.23.1, 0.24.0, 0.24.1)
ERROR: No matching distribution found for mongoengine==0.15.3
ERROR: Service 'combine-django' failed to build: The command '/bin/sh -c cd /opt/combine && pip install -r requirements.txt' returned a non-zero code: 1
[2] git error:
ubuntu@ip-172-31-21-92:~/combine-docker$ ./build.sh
++ echo 'Running Combine-Docker build script. Note: this may take some time, anywhere from 5-20 minutes depending on your hardware.'
Running Combine-Docker build script. Note: this may take some time, anywhere from 5-20 minutes depending on your hardware.
++ source ./.env
+++ COMBINE_BRANCH=v0.11.1
+++ COMBINE_DJANGO_HOST_PORT=8000
+++ COMBINE_DOCKER_VERSION=v0.11
+++ ELASTICSEARCH_HADOOP_CONNECTOR_VERSION=7.1.1
+++ HADOOP_VERSION=2.7.5
+++ HADOOP_VERSION_SHORT=2.7
+++ LIVY_TAGGED_RELEASE=v0.6.0-incubating
+++ SCALA_VERSION=2.11
+++ SPARK_VERSION=2.3.2
+++ SPARK_GIT=branch-2.3
+++ pwd
++ WORKDIR=/home/ubuntu/combine-docker
++ docker-compose down
Removing network combine-docker_default
WARNING: Network combine-docker_default not found.
++ touch /home/ubuntu/combine-docker/nginx/error.log
++ [[ ! -f /home/ubuntu/combine-docker/nginx/nginx.conf ]]
++ echo v0.11.1
v0.11.1
++ git submodule init
++ git submodule update
error: Your local changes to the following files would be overwritten by checkout:
requirements.txt
Please commit your changes or stash them before you switch branches.
Aborting
Unable to checkout '8e01ac83ca742ab792ba00e7e5c08bcfe8b48ef5' in submodule path 'combine/combine'
Hello,
I followed the instructions in the documentation at https://github.com/MI-DPLA/combine-docker
In particular, I followed the Linux instructions referenced above: https://github.com/MI-DPLA/combine-docker/blob/master/combine_docker_detailed_installation_instructions.pdf
Upon running the "build.sh" command, I notice the following fatal ERROR [1].
I attempted to solve this issue by editing combine/combine/requirements.txt and bumping mongoengine version to 0.20.0:
mongoengine==0.15.3 -> mongoengine==0.20.0
This resulted in a "successful" build, I think, as the build continued much further along than previously. It seems to have run to completion with no fatal ERROR messages.
However, I was wondering if the seemingly benign error messages [2] I still receive are any cause for concern.(I added "set -x" to the beginning of build.sh so you can see which command the error message belongs.)
Thanks for looking into this issue!
--Chris
[1] Error from build.sh:
Collecting mongoengine==0.15.3
Downloading mongoengine-0.15.3.tar.gz (145 kB)
ERROR: Command errored out with exit status 1:
command: /opt/conda/envs/combine/bin/python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-1o3lpuss/mongoengine_5adafc0a256a43b98782731d439c5354/setup.py'"'"'; file='"'"'/tmp/pip-install-1o3lpuss/mongoengine_5adafc0a256a43b98782731d439c5354/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(file) if os.path.exists(file) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-pum93_9h
cwd: /tmp/pip-install-1o3lpuss/mongoengine_5adafc0a256a43b98782731d439c5354/
Complete output (1 lines):
error in mongoengine setup command: use_2to3 is invalid.
----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/32/d0/74628eaa7839cd35cd68fdab69f76ee0807652996c668354308d61558d38/mongoengine-0.15.3.tar.gz#sha256=2ecc60f50d9f85d4ae7e2e8bd1dc19778af65d2883d5ad6d658d77f1560059d3 (from https://pypi.org/simple/mongoengine/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
ERROR: Could not find a version that satisfies the requirement mongoengine==0.15.3 (from versions: 0.4, 0.5, 0.5.1, 0.5.2, 0.6.1, 0.6.3, 0.6.4, 0.6.6, 0.6.7, 0.6.8, 0.6.10, 0.6.12, 0.6.13, 0.6.15, 0.6.16, 0.6.17, 0.6.19, 0.6.20, 0.7.0, 0.7.1, 0.7.2, 0.7.3, 0.7.4, 0.7.5, 0.7.8, 0.7.9, 0.7.10, 0.8.0, 0.8.1, 0.8.2, 0.8.3, 0.8.4, 0.8.5, 0.8.6, 0.8.7, 0.8.7.post2, 0.8.7.1, 0.8.8, 0.9.0, 0.10.0, 0.10.1, 0.10.4, 0.10.5, 0.10.6, 0.10.7, 0.10.9, 0.11.0, 0.12.0, 0.13.0, 0.14.3, 0.15.0, 0.15.3, 0.16.0, 0.16.1, 0.16.2, 0.16.3, 0.17.0, 0.18.0, 0.18.2, 0.19.0, 0.19.1, 0.20.0, 0.21.0, 0.22.0, 0.22.1, 0.23.0, 0.23.1, 0.24.0, 0.24.1)
ERROR: No matching distribution found for mongoengine==0.15.3
ERROR: Service 'combine-django' failed to build: The command '/bin/sh -c cd /opt/combine && pip install -r requirements.txt' returned a non-zero code: 1
[2] git error:
ubuntu@ip-172-31-21-92:~/combine-docker$ ./build.sh
++ echo 'Running Combine-Docker build script. Note: this may take some time, anywhere from 5-20 minutes depending on your hardware.'
Running Combine-Docker build script. Note: this may take some time, anywhere from 5-20 minutes depending on your hardware.
++ source ./.env
+++ COMBINE_BRANCH=v0.11.1
+++ COMBINE_DJANGO_HOST_PORT=8000
+++ COMBINE_DOCKER_VERSION=v0.11
+++ ELASTICSEARCH_HADOOP_CONNECTOR_VERSION=7.1.1
+++ HADOOP_VERSION=2.7.5
+++ HADOOP_VERSION_SHORT=2.7
+++ LIVY_TAGGED_RELEASE=v0.6.0-incubating
+++ SCALA_VERSION=2.11
+++ SPARK_VERSION=2.3.2
+++ SPARK_GIT=branch-2.3
+++ pwd
++ WORKDIR=/home/ubuntu/combine-docker
++ docker-compose down
Removing network combine-docker_default
WARNING: Network combine-docker_default not found.
++ touch /home/ubuntu/combine-docker/nginx/error.log
++ [[ ! -f /home/ubuntu/combine-docker/nginx/nginx.conf ]]
++ echo v0.11.1
v0.11.1
++ git submodule init
++ git submodule update
error: Your local changes to the following files would be overwritten by checkout:
requirements.txt
Please commit your changes or stash them before you switch branches.
Aborting
Unable to checkout '8e01ac83ca742ab792ba00e7e5c08bcfe8b48ef5' in submodule path 'combine/combine'