Provide a multiarch build (armhf/arm64) for the container

[georgr]

Please provide a multiarch build (armhf/arm64) for the container.

Awesome work!

[vincentsarago]

@georgr Please feel free to start a PR if this is something you want/need.

see https://github.com/vincentsarago/containers/pkgs/container/uvicorn-gunicorn

[vincentsarago]

@georgr sadly rasterio do not yet comes with wheels for arm64 so you'll need to have gdal installed first. I'm going to wait for rasterio wheels to be provided for the arm64 arch.

While this I'm going to add platform: linux/amd64 in docker-compose.yml and make sure we tag the image with it

[georgr]

@vincentsarago

I had success with following Dockerfile. The Dockerfile is by no means "ready for production", I think the size can be reduced and I do not get the idea why the root certificates has to be copied in the container.

Dockerfile:

FROM python:3.8 as builder RUN mkdir /build WORKDIR /build # Ensure root certificates are always updated at evey container build # and curl is using the latest version of them COPY src/titiler/ /tmp/titiler/ RUN apt-get update RUN apt-get install -y python3-numpy gdal-bin libgdal-dev RUN mkdir /usr/local/share/ca-certificates/cacert.org RUN cd /usr/local/share/ca-certificates/cacert.org && curl -k -O https://www.cacert.org/certs/root.crt RUN cd /usr/local/share/ca-certificates/cacert.org && curl -k -O https://www.cacert.org/certs/class3.crt RUN update-ca-certificates ENV CURL_CA_BUNDLE /etc/ssl/certs/ca-certificates.crt RUN pip install --prefix=/build /tmp/titiler/core /tmp/titiler/mosaic /tmp/titiler/application --no-cache-dir RUN pip install --prefix=/build uvicorn RUN rm -rf /tmp/titiler FROM python:3.8-slim as base COPY --from=builder /build /usr/local RUN apt-get update RUN apt-get install -y python3-numpy gdal-bin libgdal-dev RUN apt-get -y install curl RUN mkdir /usr/local/share/ca-certificates/cacert.org RUN cd /usr/local/share/ca-certificates/cacert.org && curl -k -O https://www.cacert.org/certs/root.crt RUN cd /usr/local/share/ca-certificates/cacert.org && curl -k -O https://www.cacert.org/certs/class3.crt RUN update-ca-certificates ENV CURL_CA_BUNDLE /etc/ssl/certs/ca-certificates.crt ENV MODULE_NAME titiler.application.main ENV VARIABLE_NAME app CMD ["uvicorn", "titiler.application.main:app", "--host", "0.0.0.0", "--port", "80"] 

I´m building the container with buildx:

docker buildx build --push --platform linux/arm64/v8,linux/amd64 --tag georam/titiler .

If you have an arm64 platform available you can either build the container yourself with the provided Dockerfile or test the container pushed on docker hub.

A major issue is in my opinion the build time for arm64 with about 20 minutes (on my intel platform) and over an hour for arm64 and armhf combined.

I´m not sure if this approach is feasible with this build times, but titiler is running on my k3s pi4 development cluster like a charm 😀

Do you have any thoughts on this?

[vincentsarago]

In tests we never really had issue with the image size, about build time, it's really weird, it shouldn't take more than 2 minutes.

Note:
in

RUN pip install --prefix=/build /tmp/titiler/core /tmp/titiler/mosaic /tmp/titiler/application --no-cache-dir 

you should do

RUN pip install --prefix=/build /tmp/titiler/core /tmp/titiler/mosaic /tmp/titiler/application --no-cache-dir --no-binary rasterio 

[f-skold]

I have seen similar difference in build times when porting a custom docker images with PHP.
If you build the same image on an Arm64 host (on for example AWS), build time was in the same range as building the image natively on the AMD64/x86_64.

@vincentsarago, I think I had to comment out the platform directive in the docker-compose.yml, to get the file to work on my machine:

services: titiler: # See https://github.com/developmentseed/titiler/discussions/387 # platform: linux/amd64 

Version information:

$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 20.04.4 LTS Release: 20.04 Codename: focal $ docker --version Docker version 20.10.16, build aa7e414 $ docker-compose --version docker-compose version 1.26.0, build d4451659 

[Firefishy]

Draft PR which builds a ARM64 container: #740
The PR needs work/refactoring, but here for comment.