I am able to build the container with the following command:
docker build --rm -t puckel/docker-airflow .

Then run the container with this command.
docker run -d -p 8080:8080 -v D:/airflow/local_dags/:/usr/local/airflow/dags --name airflow puckel/docker-airflow webserver

It fails and when I check the log I see it complaining about:
ModuleNotFoundError: No module named 'sqlalchemy.ext.declarative.clsregistry'

I added a pip install SQLAlchemy to Dockerfile:
&& pip install 'SQLAlchemy==1.3.23'
but that has not helped and still get the same result in the log.

Any idea how to get around this?