I’m no longer able to do parallel builds of nupic.core in OS X following instructions from README. In particular, here’s what I’m doing:
git clean -fdx
mkdir -p build/scripts
cd build/scripts/
cmake ../.. -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=../release -DPY_EXTENSIONS_DIR=/Users/amarshall/nta/nupic.core/bindings/py/nupic/bindings > cmake.stdout 2> cmake.stderr
make -j6 > make.stdout 2> make.stderr
Meanwhile, if I were to eliminate the -j6 from the make command, it works.
I don’t know if it’s an issue of the documentation being outdated or if it’s a new problem, but I would prefer to run make in parallel – it’s faster.
The referenced .std* files are available for viewing at https://gist.github.com/oxtopus/ef2476ebaa8288e07b56c132d32d9aba since I can’t upload them here and they get truncated if I include inline.
1 Like
I noticed this last week as well. I thought it was just something to do with my borked up environment. But don’t we don’t run in parallel in Bamboo:
# along with this program. If not, see http://www.gnu.org/licenses.
#
# http://numenta.org/licenses/
# ----------------------------------------------------------------------
set -o errexit
set -o xtrace
# Fixup $PATH for --user installation
export PATH=${HOME}/Library/Python/2.7/bin:${PATH}
DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )"
# Build and test the manylinux wheel; see build-and-test-nupic-bindings.sh for
# destination wheelhouse
BUILD_TYPE="Release" \
WHEEL_PLAT="macosx_10_9_intel" \
ARCHFLAGS="-arch x86_64" \
PIP_USER=1 \
${DIR}/../build-and-test-nupic-bindings.sh
I think the correct way to fix this is to update this script to use multiple processors and deal with the repercussions.
Go figure, but make -j50 worked. Not suggesting that we need to fish for a value that works, just thought that with a higher value we might have even more opportunity to get into race conditions.
Clearly, we have dependency issues in the build
Should be fixed via https://github.com/numenta/nupic.core/pull/1057 . I tested on my OS X machine both before and after.
The fix https://github.com/numenta/nupic.core/pull/1057 has been merged into nupic.core master.