| commit | 0854d22b6c279c94317267453c5d0652ca66b41f | [log] [tgz] |
|---|---|---|
| author | Dave Cottlehuber <dave@muse.net.nz> | Thu Jul 28 21:57:00 2011 +1200 |
| committer | Dave Cottlehuber <dave@muse.net.nz> | Thu Jul 28 21:57:00 2011 +1200 |
| tree | b3e98777e4b788bf18385fea0f36df602e43da35 | |
| parent | 21ac83ee27000810438a08b6b583d01964a1e53a [diff] |
add comments on using static build and cached config
#Glazier - automating building CouchDB on Windows #############################
Glazier is a set of scripts designed to help automate as much as practicable the build of CouchDB on Windows, from XP/2003 to Windows 7 or Server 2008. It assumes you're starting from a vanilla state.
Glazier requires 6 things to run successfully
%RELAX%, set to where you wish to have CouchDB and Erlang built within. If none is selected, c:\relax will be used.run %GLAZIER%\bin\glaze.cmd to fetch & cache the bits, install compiilers
you will need to select the cygwin modules individually
close any open command prompts or shells
run %GLAZIER%\bin\relax.cmd to start a valid build environment
select the erlang version you wish to build from
the first time around you will need to unpack your erlang and couchdb tarballs
cd /relax CYGWIN="nontsec nodosfilewarning" CL=/D_BIND_TO_CURRENT_VCLIBS_VERSION=1 tar xzf /relax/bits/apache-couchdb-1.0.2.tar.gz & tar xzf /relax/bits/curl-7.21.3.tar.gz & tar xzf /relax/bits/otp_src_R14B02.tar.gz & cd /relax/otp_src_R14B02 && tar xzf /relax/bits/tcltk85_win32_bin.tar.gz &
then run the following 4 scripts in order
erl_build.sh erl_config.sh couchdb_build.sh couchdb_config.sh
each of these scripts leaves logfiles in the root folder. If you have issues during compilation phase, load these onto http://friendpaste.com/ before emailing your issues to the mailing list
The full Cygwin install comprises several GiB of data. Run cygwin's setup.exe using defaults, optionally installing all components if you have the bandwidth, or alternatively with the following additional modules at a minimum:
After install, set up a link to where you plan to install related binaries, build erlang, and couchdb. I am using C:\relax so:
setx RELAX c:\relax
mkdir %RELAX%
junction.exe c:\cygwin\relax %RELAX%
The mozilla build toolchain is needed solely for building a javascript engine.
Both CouchDB and Erlang have dependencies on other opensource tools.
c:\opensslc:\relax\inno5c:\relax\nsisc:\relax\ - note this is the same as the one provided with VS2008 SP1 - this is critical to ensure that your compiled erlang, spidermonkey, couchdb all require the same runtime that is bundled with your distribution. The MD5 should be 2c79302d42817d54bb621216a6d4dc7f.to keep our paths clean later, and largely independent of compiler installations if you have pre-existing ones, start a new cmd.exe prompt with a fresh environment
this should have both VS90ComnTools and ProgramFiles environment vars defined from the previous install of Visual Studio
setup the following hard links (junction points), using either the included mklink tool (Windows 7 and later), or SysInternal's junction
junction c:\relax\openssl c:\openssl junction c:\relax\vs90 "%VS90COMNTOOLS%\..\.." junction c:\relax\SDKs "%programfiles%\Microsoft SDKs\Windows"
or using mklink.exe
mklink /j c:\relax\openssl c:\openssl
[etc...]
two components are used for building Erlang's graphical shell, werl.exe on windows
download [wxwidgets_bits] from WxWidgets website & unzip using cygwin into /relax/
the Erlang build expects to see wxWidgets in /opt/local/pgm/wxWidgets-2.8.11 by default
mkdir c:\cygwin\opt\local\pgm junction c:\cygwin\opt\local\pgm\wxWidgets-2.8.11 c:\relax\wxMSW-2.8.11
A number of manual changes are required to get WxWidgets to build cleanly. These can be done manually or simply apply the overlay from [wxoverlay] & skip through to the build instructions lower down.
Using a suitable editor (vi in the cygwin suite, or install notepadplus_bits for windows users) and
Edit c:\relax\wxMSW-2.8.11\include\wx\msw\setup.h to enable wxUSE_GLCANVAS, wxUSE_POSTSCRIPT and wxUSE_GRAPHICS_CONTEXT
open VSC++ & the project %RELAX%\wxMSW-2.8.11\build\msw\wx.dsw, accepting the automatic conversion to the newer VC++ format and save as \relax\wxMSW-2.8.11\build\msw\wx.sln
right-click on the project, and set up the dependencies for wx.dsw to achieve the below build order: jpeg, png, tiff, zlib, regex, expat, base, net, odbc, core, gl, html, media, qa, adv, dbgrid, xrc, aui, richtext, xml
Launch a new prompt from somewhere like Start -> Programs -> Microsoft Visual C++ -> Visual Studio Tools -> VS2008 Cmd Prompt
Then build all unicode release (and unicode debug) packages:
pushd %RELAX%\wxMSW*\build\msw set CL=/D_BIND_TO_CURRENT_VCLIBS_VERSION=1 vcbuild /useenv /platform:Win32 /M4 wx.sln "Unicode Release|Win32" vcbuild /useenv /platform:Win32 /M4 wx.sln "Unicode Debug|Win32" popd
open VSC++ & convert %RELAX%\wxMSW-2.8.11\contrib\build\stc\stc.dsw to %RELAX%\wxMSW-2.8.11\contrib\build\stc\stc.sln
pushd %RELAX%\wxMSW*\contrib\build\stc set CL=/D_BIND_TO_CURRENT_VCLIBS_VERSION=1 vcbuild /useenv /platform:Win32 /M4 stc.sln "Unicode Release|Win32" vcbuild /useenv /platform:Win32 /M4 stc.sln "Unicode Debug|Win32" popd
after installing VC++ 2008 Express, and most other Visual Studio solutions, call "%vs90comntools%\..\..\vc\vcvarsall.bat" x86 will automatically set up our 32-bit build environment correctly, independently if you have installed on 32 or 64bit windows, with the exception of the Windows v7.0 SDK.
in a cmd.exe shell
junction.exe %RELAX%\bin %GLAZIER%\bin junction.exe %RELAX%\bits %GLAZIER%\bits mkdir %RELAX%\release
in a cygwin shell, using these new junction points:
cd /relax && tar xzf /relax/bits/otp_src_R14B02.tar.gz &
then run from explorer, %GLAZIER%\bin\relax.cmd
optional components - used for debugger and java interfaces
cd $ERL_TOP && tar xvzf /relax/bits/tcltk85_win32_bin.tar.gz
or skip the whole damn lot this way
echo "skipping gs" > lib/gs/SKIP echo "skipping jinterface" > lib/jinterface/SKIP
check that which cl; which link; which mc return the MS ones, if not then sort them out manually. Refer to relax.cmd and relax.sh
Getting OTP to find vcredist_x86.exe is not easy. A simple solution is to hack $ERL_TOP/erts/etc/win32/nsis/find_redist.sh to look in $ERL_TOP/.. first.
# shortcut for locating vcredist_x86.exe is to put it into $ERL_TOP
if [ -f $ERL_TOP/vcredist_x86.exe ]; then
echo $ERL_TOP/vcredist_x86.exe
exit 0
fi
# or $ERL_TOP/.. to share across multiple builds
if [ -f $ERL_TOP/../vcredist_x86.exe ]; then
echo $ERL_TOP/../vcredist_x86.exe
exit 0
fi
Build Erlang using /relax/glazier/bin/erl_config.sh and /relax/glazier/bin/erl_build.sh, or manually as follows
./otp_build autoconf ./otp_build configure ./otp_build boot -a ./otp_build release -a ./otp_build installer_win32 # we need to set up erlang to run from this new source build to build CouchDB ./release/win32/Install.exe -s
More details are at erlang INSTALL-Win32.md on github
or using the relax tools:
start %glazier%\bin\relax.cmd :: [select an erlang build] erl_config.sh; erl_build.sh
CouchDB has been built & tested against the following components successfully
The Javascript engine used by CouchDB is Mozilla Spidermonkey. As there is no formal release for it, you can build from anywhere on trunk. The 1.8.5 source below is also used on the Mac OS X homebrew build of CouchDB.
to build and install from SpiderMonkey get spidermonkey_bits
run c:\mozilla-build\start-msvc9.bat even if you are on a 64-bit platform.
cd $RELAX tar xzf bits/tracemonkey-57a6ad20eae9.tar.gz cd ./tracemonkey-57a6ad20eae9/js/src autoconf-2.13 ./configure --enable-static make
C:/OpenSSL/ no further steps required:: cd /relax && tar xf /relax/bits/curl-7*
run from a Visual Studio command shell:
pushd %RELAX%\curl-7* set OPENSSL_PATH=%relax%\openssl set USE_SSLEAY=1 set USE_OPENSSL=1 set INCLUDE=%INCLUDE%;%OPENSSL_PATH%\include;%OPENSSL_PATH%\include\openssl; set LIBPATH=%LIBPATH%;%OPENSSL_PATH%\lib; set LIB=%LIB%;%OPENSSL_PATH%\lib; set CL=/D_BIND_TO_CURRENT_VCLIBS_VERSION=1 vcbuild /useenv /upgrade /platform:Win32 lib\libcurl.vcproj vcbuild /useenv /platform:Win32 lib\libcurl.vcproj "Release|Win32" xcopy lib\Release\libcurl.lib lib\ /y popd
Download and unzip the compiled libraries from icu_bits_curr
cd %RELAX%\ 7z x bits\icu*.zip
The generic configure script looks like this:
./configure \ --with-js-include=/cygdrive/c/path_to_spidermonkey/dist/include \ --with-js-lib=/cygdrive/c/path_to_spidermonkey/dist/lib \ --with-win32-icu-binaries=/cygdrive/c/path_to_icu_binaries_root \ --with-erlang=$ERL_TOP/release/win32/usr/include \ --with-win32-curl=/cygdrive/c/path/to/curl/root/directory \ --with-openssl-bin-dir=/cygdrive/c/path/to/openssl/bin \ --with-msvc-redist-dir=/cygdrive/c/dir/with/vcredist_platform_executable \ --prefix=$ERL_TOP/release/win32
This is the recommended config if you have used the above steps:
./configure \ --prefix=$ERL_TOP/release/win32 \ --with-erlang=$ERL_TOP/release/win32/usr/include \ --with-win32-icu-binaries=/relax/icu \ --with-win32-curl=/relax/curl-7.21.5 \ --with-openssl-bin-dir=/relax/openssl/bin \ --with-msvc-redist-dir=/relax \ --with-js-lib=/relax/tracemonkey-57a6ad20eae9/js/src/dist/lib \ --with-js-include=/relax/tracemonkey-57a6ad20eae9/js/src/dist/include \ 2>&1 | tee $COUCH_TOP/build_configure.txt
[vcredist]:
http://download.microsoft.com/download/d/d/9/dd9a82d0-52ef-40db-8dab-795376989c03/vcredist_x86.exe [win7sdk_32bit]: http://download.microsoft.com/download/2/E/9/2E911956-F90F-4BFB-8231-E292A7B6F287/GRMSDK_EN_DVD.iso [win7sdk_64bit]: http://download.microsoft.com/download/2/E/9/2E911956-F90F-4BFB-8231-E292A7B6F287/GRMSDKX_EN_DVD.iso [wxwidgets_bits]: http://sourceforge.net/projects/wxwindows/files/2.8.11/wxMSW-2.8.11.zip [wxoverlay]: https://github.com/dch/glazier/raw/master/bits/wxMSW-2.8.11_erlang_overlay.zip
http://zlib.net/zlib125-dll.zip & unzip
// TODO fix curl and zlib build scripts
compile OpenSSL from scratch
7z x %glazier%\bits\nasm-2.09.07-win32.zip -o%relax%
move %relax%\nasm* nasm 7z x %glazier%\bits\strawberry-perl-5.12.2.0-portable.zip -o%relax%\strawberry 7z x %glazier%\bits\openssl-1.0.0d.tar.gz -o%relax%\bits\
[open a VC++ shell] path=%path%;%relax%\nasm;%relax%\strawberry\perl\bin; pushd %relax%\openssl-* perl Configure VC-WIN32 --prefix=c:\openssl -- ms\do_nasm nmake -f ms\ntdll.mak
nmake -f ms\ntdll.mak install
compile ICU from scratch? no thanks..
aria2c.exe --force-sequential=false --max-connection-per-server=4 --check-certificate=false --auto-file-renaming=false bits.txt --max-concurrent-downloads=5 --dir=%GLAZIER%/bits --save-session=%GLAZIER%/a2session.txt
Must use 2008R2 64-bit edition ami-ee926087 m1.xlarge spot instances are a good deal create a 30GiB volume from relaxing snapshot this will provide backing store for the ram disk