Cross compiling toolchains in Docker images
Go to file
Bensuperpc cb4653ac7a Add scripts
Add scripts

Signed-off-by: Bensuperpc <bensuperpc@gmail.com>
2021-07-03 19:48:41 +02:00
.github Merge pull request #523 from bensuperpc/update_tools_scripts 2021-07-02 16:19:07 -04:00
android-arm Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
android-arm64 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
android-x86 Merge pull request #479 from dockcross/update-android-ndk 2021-04-17 17:44:53 -06:00
android-x86_64 Merge pull request #479 from dockcross/update-android-ndk 2021-04-17 17:44:53 -06:00
common Merge branch 'master' into clean_repos 2021-07-01 00:08:03 +02:00
imagefiles Add container-diff scripts and update others 2021-07-01 12:58:57 +02:00
linux-arm64 Update linux-arm64 to latest crosstool-ng version 2021-06-28 11:08:47 +02:00
linux-arm64-musl Add linux-arm64-musl image 2020-11-10 23:52:43 +01:00
linux-armv5 Disable GLIBC locales 2021-06-28 11:18:06 +02:00
linux-armv5-musl Update linux-armv5-musl to latest crosstool-ng version 2021-06-28 11:21:04 +02:00
linux-armv6 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
linux-armv6-musl Add linux-armv6-musl image 2020-12-04 14:04:29 +01:00
linux-armv7 Update linux-armv7 to latest crosstool-ng version 2021-06-28 11:12:30 +02:00
linux-armv7a Update linux-armv7a to latest crosstool-ng version 2021-06-28 11:07:51 +02:00
linux-armv7l-musl Add linux-armv7l-musl image 2020-11-13 13:38:47 +01:00
linux-mips Update linux-mips to latest crosstool-ng version 2021-06-28 11:18:36 +02:00
linux-ppc64le Update linux-ppc64le to latest crosstool-ng version 2021-06-28 11:19:27 +02:00
linux-riscv32 switch to rv64gc and rv32gc 2021-07-02 15:16:51 +02:00
linux-riscv64 switch to rv64gc and rv32gc 2021-07-02 15:16:51 +02:00
linux-s390x Fix build fail with ppc64le and s390x 2021-06-25 16:34:53 +02:00
linux-x64 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
linux-x64-clang Update to bullseye 2021-06-29 22:14:18 +02:00
linux-x86 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
manylinux1-x64 Fix CMake error on manylinux1 2021-06-30 15:07:13 +02:00
manylinux1-x86 Fix CMake error on manylinux1 2021-06-30 15:07:13 +02:00
manylinux2010-x64 Fix build fail with manylinux2010-x64 2021-05-26 21:05:35 +02:00
manylinux2010-x86 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
manylinux2014-aarch64 Fix error on manylinux2014-aarch64 2021-06-28 17:41:39 +02:00
manylinux2014-x64 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
manylinux2014-x86 Fix "yum" on manylinux2014-x86 2021-01-31 13:39:31 +01:00
manylinux-common Revert "manylinux: Update scikit-build from 0.8.1 to 0.9.0" 2019-10-24 10:25:13 -04:00
test base: Add cmake wrapper scripts for CMAKE_TOOLCHAIN_FILE 2016-07-22 08:48:59 -04:00
tools Add scripts 2021-07-03 19:48:41 +02:00
web-wasm web-wasm: Bump Emscripten to 2.0.24 2021-06-24 11:56:46 +02:00
windows-shared-x64 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
windows-shared-x64-posix Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
windows-shared-x86 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
windows-static-x64 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
windows-static-x64-posix Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
windows-static-x86 Introduce "common.label-and-env" 2021-04-18 19:15:26 +02:00
.gitattributes git: Ensure we use lf endings 2018-08-20 14:24:47 -04:00
.gitignore web-wasm: Rename image from browser-asmjs 2019-01-19 16:05:29 -05:00
Dockerfile.in Update to bullseye 2021-06-29 22:14:18 +02:00
LICENSE Update LICENSE copyright dates and add @jcfr 2018-03-19 15:50:28 -04:00
Makefile Add riscv32 and riscv64 2021-07-02 15:16:51 +02:00
README.md Update README 2021-06-29 17:30:05 +02:00

dockcross

Cross compiling toolchains in Docker images.

image

Features

  • Pre-built and configured toolchains for cross compiling.
  • Most images also contain an emulator for the target system.
  • Clean separation of build tools, source code, and build artifacts.
  • Commands in the container are run as the calling user, so that any created files have the expected ownership, (i.e. not root).
  • Make variables ([CC]{.title-ref}, [LD]{.title-ref} etc) are set to point to the appropriate tools in the container.
  • Recent CMake and ninja are precompiled.
  • Conan.io can be used as a package manager.
  • Toolchain files configured for CMake.
  • Current directory is mounted as the container's workdir, /work.
  • Works with the Docker for Mac and Docker for Windows.
  • Support using alternative container executor by setting [OCI_EXE]{.title-ref} environment variable. By default, it searches for [docker]{.title-ref} and
    [podman]{.title-ref}

Examples

  1. dockcross make: Build the Makefile in the current directory.
  2. dockcross cmake -Bbuild -H. -GNinja: Run CMake with a build directory ./build for a CMakeLists.txt file in the current directory and generate ninja build configuration files.
  3. dockcross ninja -Cbuild: Run ninja in the ./build directory.
  4. dockcross bash -c '$CC test/C/hello.c -o hello': Build the hello.c file with the compiler identified with the CC environmental variable in the build environment.
  5. dockcross bash: Run an interactive shell in the build environment.

Note that commands are executed verbatim. If any shell processing for environment variable expansion or redirection is required, please use [bash -c 'command args...']{.title-ref}.

Installation

This image does not need to be run manually. Instead, there is a helper script to execute build commands on source code existing on the local host filesystem. This script is bundled with the image.

To install the helper script, run one of the images with no arguments, and redirect the output to a file:

docker run --rm CROSS_COMPILER_IMAGE_NAME > ./dockcross
chmod +x ./dockcross
mv ./dockcross ~/bin/

Where [CROSS_COMPILER_IMAGE_NAME]{.title-ref} is the name of the cross-compiler toolchain Docker instance, e.g. [dockcross/linux-armv7]{.title-ref}.

Only 64-bit x86_64 images are provided; a 64-bit x86_64 host system is required.

Usage

For the impatient, here's how to compile a hello world for armv7:

cd ~/src/dockcross
docker run --rm dockcross/linux-armv7 > ./dockcross-linux-armv7
chmod +x ./dockcross-linux-armv7
./dockcross-linux-armv7 bash -c '$CC test/C/hello.c -o hello_arm'

Note how invoking any toolchain command (make, gcc, etc.) is just a matter of prepending the dockcross script on the commandline:

./dockcross-linux-armv7 [command] [args...]

The dockcross script will execute the given command-line inside the container, along with all arguments passed after the command. Commands that evaluate environmental variables in the image, like [$CC]{.title-ref} above, should be executed in [bash -c]. The present working directory is mounted within the image, which can be used to make source code available in the Docker container.

Cross compilers

dockcross/base

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls Docker Stars

Base image for other toolchain images. From Debian Jessie with GCC, make, autotools, CMake, Ninja, Git, and Python.

dockcross/android-arm

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

The Android NDK standalone toolchain for the arm architecture.

dockcross/android-arm64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

The Android NDK standalone toolchain for the arm64 architecture.

dockcross/android-x86

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

The Android NDK standalone toolchain for the x86 architecture.

dockcross/android-x86_64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

The Android NDK standalone toolchain for the x86_64 architecture.

dockcross/linux-arm64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Cross compiler for the 64-bit ARM platform on Linux, also known as AArch64.

dockcross/linux-arm64-musl

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Cross compiler for the 64-bit ARM platform on Linux (also known as AArch64), using musl as base "libc".

dockcross/linux-armv5

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux armv5 cross compiler toolchain for legacy devices like the Parrot AR Drone.

dockcross/linux-armv5-musl

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux armv5 cross compiler toolchain using musl as base "libc".

dockcross/linux-armv6

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux ARMv6 cross compiler toolchain for the Raspberry Pi, etc.

dockcross/linux-armv6-musl

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux ARMv6 cross compiler toolchain for the Raspberry Pi, etc, using musl as base "libc".

dockcross/linux-armv7

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Generic Linux armv7 cross compiler toolchain.

dockcross/linux-armv7a

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Toolchain configured for ARMv7-A used in Beaglebone Black single board PC with TI SoC AM3358 on board, Cortex-A8.

dockcross/linux-armv7l-musl

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Toolchain configured for ARMv7-L, using musl as base "libc".

dockcross/linux-mipsel

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux mipsel cross compiler toolchain for little endian MIPS GNU systems.

dockcross/linux-mips

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux mips cross compiler toolchain for big endian 32-bit hard float MIPS GNU systems.

dockcross/linux-s390x

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux s390x cross compiler toolchain for S390X GNU systems.

dockcross/linux-ppc64le

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux PowerPC 64 little endian cross compiler toolchain for the POWER8, etc. Important: Due to Issue #430, automatic build of newer images has been disabled.

dockcross/linux-x64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux x86_64 / amd64 compiler. Since the Docker image is natively x86_64, this is not actually a cross compiler.

dockcross/linux-x64-clang

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux clang x86_64 / amd64 compiler. Since the Docker image is natively x86_64, this is not actually a cross compiler.

dockcross/linux-x86

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Linux i686 cross compiler.

dockcross/manylinux2014-x64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Docker manylinux2014 image for building Linux x86_64 / amd64 Python wheel packages. It includes Python 3.5, 3.6, 3.7, 3.8, and 3.9. Also has support for the dockcross script, and it has installations of CMake, Ninja, and scikit-build. For CMake, it sets [MANYLINUX2014]{.title-ref} to "TRUE" in the toolchain.

dockcross/manylinux2014-x86

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Docker manylinux2014 image for building Linux i686 Python wheel packages. It includes Python 3.5, 3.6, 3.7, 3.8, and 3.9. Also has support for the dockcross script, and it has installations of CMake, Ninja, and scikit-build. For CMake, it sets [MANYLINUX2014]{.title-ref} to "TRUE" in the toolchain.

dockcross/manylinux2014-aarch64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Docker manylinux2014 image for building Linux aarch64 / arm64 Python wheel packages. It includes Python 3.5, 3.6, 3.7, 3.8, and 3.9. Also has support for the dockcross script, and it has installations of CMake, Ninja, and scikit-build. For CMake, it sets [MANYLINUX2014]{.title-ref} to "TRUE" in the toolchain.

dockcross/manylinux2010-x64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Docker manylinux2010 image for building Linux x86_64 / amd64 Python wheel packages. It includes Python 2.7, 3.4, 3.5, 3.6, 3.7 and 3.8. Also has support for the dockcross script, and it has installations of CMake, Ninja, and scikit-build. For CMake, it sets [MANYLINUX2010]{.title-ref} to "TRUE" in the toolchain.

dockcross/manylinux2010-x86

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Docker manylinux2010 image for building Linux i686 Python wheel packages. It includes Python 2.7, 3.4, 3.5, 3.6, 3.7 and 3.8. Also has support for the dockcross script, and it has installations of CMake, Ninja, and scikit-build. For CMake, it sets [MANYLINUX2010]{.title-ref} to "TRUE" in the toolchain.

dockcross/manylinux1-x64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Docker manylinux1 image for building Linux x86_64 / amd64 Python wheel packages. It includes Python 2.7, 3.4, 3.5, 3.6, 3.7 and 3.8. Also has support for the dockcross script, and it has installations of CMake, Ninja, and scikit-build. For CMake, it sets [MANYLINUX1]{.title-ref} to "TRUE" in the toolchain.

dockcross/manylinux1-x86

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

Docker manylinux1 image for building Linux i686 Python wheel packages. It includes Python 2.7, 3.4, 3.5, 3.6, 3.7 and 3.8. Also has support for the dockcross script, and it has installations of CMake, Ninja, and scikit-build. For CMake, it sets [MANYLINUX1]{.title-ref} to "TRUE" in the toolchain.

dockcross/web-wasm

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

The Emscripten WebAssembly/asm.js/JavaScript cross compiler.

dockcross/windows-static-x64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

64-bit Windows cross-compiler based on MXE/MinGW-w64 with win32 threads and static linking.

dockcross/windows-static-x64-posix

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

64-bit Windows cross-compiler based on MXE/MinGW-w64 with posix threads and static linking.

dockcross/windows-static-x86

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

32-bit Windows cross-compiler based on MXE/MinGW-w64 with win32 threads and static linking.

dockcross/windows-shared-x64

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

64-bit Windows cross-compiler based on MXE/MinGW-w64 with win32 threads and dynamic linking.

dockcross/windows-shared-x64-posix

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

64-bit Windows cross-compiler based on MXE/MinGW-w64 with posix threads and dynamic linking.

dockcross/windows-shared-x86

Docker Image Size (tag) MicroBadger Layers (tag) Docker Pulls

32-bit Windows cross-compiler based on MXE/MinGW-w64 with win32 threads and dynamic linking.

Articles

Built-in update commands

A special update command can be executed that will update the source cross-compiler Docker image or the dockcross script itself.

  • dockcross [--] command [args...]: Forces a command to run inside the container (in case of a name clash with a built-in command), use -- before the command.
  • dockcross update-image: Fetch the latest version of the docker image.
  • dockcross update-script: Update the installed dockcross script with the one bundled in the image.
  • dockcross update: Update both the docker image, and the dockcross script.

Download all images

To easily download all images, the convenience target display_images could be used:

curl https://raw.githubusercontent.com/dockcross/dockcross/master/Makefile -o dockcross-Makefile
for image in $(make -f dockcross-Makefile display_images); do
  echo "Pulling dockcross/$image"
  docker pull dockcross/$image
done

Install all dockcross scripts

To automatically install in ~/bin the dockcross scripts for each images already downloaded, the convenience target display_images could be used:

curl https://raw.githubusercontent.com/dockcross/dockcross/master/Makefile -o dockcross-Makefile
for image in $(make -f dockcross-Makefile display_images); do
  if [[ $(docker images -q dockcross/$image) == "" ]]; then
    echo "~/bin/dockcross-$image skipping: image not found locally"
    continue
  fi
  echo "~/bin/dockcross-$image ok"
  docker run dockcross/$image > ~/bin/dockcross-$image && \
  chmod u+x  ~/bin/dockcross-$image
done

Dockcross configuration

The following environmental variables and command-line options are used. In all cases, the command-line option overrides the environment variable.

DOCKCROSS_CONFIG / --config|-c <path-to-config-file>

This file is sourced, if it exists, before executing the rest of the dockcross script.

Default: ~/.dockcross

DOCKCROSS_IMAGE / --image|-i <docker-image-name>

The Docker cross-compiler image to run.

Default: Image with which the script was created.

DOCKCROSS_ARGS / --args|-a <docker-run-args>

Extra arguments to pass to the docker run command. Quote the entire set of args if they contain spaces.

Per-project dockcross configuration

If a shell script named .dockcross is found in the current directory where the dockcross script is started, it is executed before the dockcross script command argument. The shell script is expected to have a shebang like #!/usr/bin/env bash.

For example, commands like git config --global advice.detachedHead false can be added to this script.

How to extend Dockcross images

In order to extend Dockcross images with your own commands, one must:

  1. Use FROM dockcross/<name_of_image>.
  2. Set DEFAULT_DOCKCROSS_IMAGE to a name of the tag you're planning to use for the image. This tag must then be used during the build phase, unless you mean to pass the resulting helper script the DOCKCROSS_IMAGE argument.

An example Dockerfile would be:

FROM dockcross/linux-armv7

ENV DEFAULT_DOCKCROSS_IMAGE my_cool_image
RUN apt-get install nano

And then in the shell:

docker build -t my_cool_image .                   ## Builds the dockcross image.
docker run my_cool_image > linux-armv7                ## Creates a helper script named linux-armv7.
chmod +x linux-armv7                          ## Gives the script execution permission.
./linux-armv7 bash                            ## Runs the helper script with the argument "bash", which starts an interactive container using your extended image.

What is the difference between [dockcross]{.title-ref} and [dockbuild]{.title-ref} ?

The key difference is that dockbuild images do NOT provide a toolchain file but they use the same method to conveniently isolate the build environment as dockcross.

[dockbuild]{.title-ref} is used to build binaries for Linux x86_64 / amd64 that will work across most Linux distributions. [dockbuild]{.title-ref} performs a native Linux build where the host build system is a Linux x86_64 / amd64 Docker image (so that it can be used for building binaries on any system which can run Docker images) and the target runtime system is Linux x86_x64 / amd64.

[dockcross]{.title-ref} is used to build binaries for many different platforms. [dockcross]{.title-ref} performs a cross compilation where the host build system is a Linux x86_64 / amd64 Docker image (so that it can be used for building binaries on any system which can run Docker images) and the target runtime system varies.

---

Credits go to sdt/docker-raspberry-pi-cross-compiler, who invented the base of the dockcross script.