DEV Community

Cover image for Publishing Python Apps at Anaconda and further Automation
Niklas Tiede
Niklas Tiede

Posted on • Originally published at the-coding-lab.com

Publishing Python Apps at Anaconda and further Automation

#tooling #devops #productivity #python

Heya fellows,

The code of this post can be found on Github (see here).

When a setup.py file was already created, it's pretty simple to go a step further and create an Anaconda package. Anaconda packages store the necessary metadata within a meta.yaml file but when a setup.py file was already created its data can be easily imported by jinja2 templating.

{% set data = load_setup_py_data() %} package: name: 'tihttp' version: {{ data['version'] }} source: path: .. build: number: 0 entry_points: {% for entry_point in data['entry_points']['console_scripts'] %} - {{ entry_point }} {% endfor %} script: python -m pip install --no-deps --ignore-installed . requirements: build: - python - pip - setuptools run: - python {% for dep in data['install_requires'] %} - {{ dep.lower() }} {% endfor %} test: imports: - {{ data['name'] }} source_files: - tests requires: {% for test_dep in data['extras_require']['dev'] %} - {{ test_dep.lower() }} {% endfor %} commands: - pytest tests about: home: {{ data['url'] }} license: {{ data['license'] }} summary: {{ data['description'] }} doc_source_url: {{ data['url'] + '/blob/master/README.md' }}
Enter fullscreen mode Exit fullscreen mode

Now we can build the package.

$ conda build .
Enter fullscreen mode Exit fullscreen mode

The generated file tihttp-0.1.0-py37_0.tar.bz2 can be found within the anaconda3/conda-build/linux-64 directory. To upload the package to the anaconda repository we have to register and then we can use the anaconda upload command. The package was uploaded to your channel and is now ready for distribution! 😙

$ anaconda upload home/niklas/anaconda3/conda-build/linux-64/tihttp-0.1.0-py37_0.tar.bz2 $ conda install -c niklastiede tihttp
Enter fullscreen mode Exit fullscreen mode

But building and uploading packages for different Python interpreter versions and different operating systems is tedious. This work can be automated by a bash script:

#!/bin/bash export PATH=~/anaconda3/bin:$PATH pkg='tihttp' array=( 3.6 3.7 3.8 3.9 ) # delete old built packages if [[ -d $HOME/conda-bld/ ]]; then rm -r $HOME/conda-bld/ fi for i in $HOME/anaconda3/conda-bld/linux-64/$pkg*; do echo $i rm $i done echo "Deleting old conda packages done!" # building conda packages for i in "${array[@]}" do echo $i conda build --py $i . done echo "Building conda packages done!" # converting conda packages to other platforms platforms=( osx-64 linux-32 linux-64 win-32 win-64 ) for file in $HOME/anaconda3/conda-bld/linux-64/$pkg*; do echo $file conda convert --platform all $file -o $HOME/conda-bld/ for platform in "${platforms[@]}" do conda convert --platform $platform $file -o $HOME/conda-bld/ done done echo "converting packages to other platforms done!" # uploading packages find $HOME/conda-bld/**/$pkg*.tar.bz2 | while read file do anaconda upload $file done echo "Uploading conda packages done!"
Enter fullscreen mode Exit fullscreen mode

Instead of automating the build process locally we could instead use this nice github action Publish Conda! Here's the code snippet for the workflow:

name: publish_conda on: release: types: [published] jobs: publish: runs-on: ubuntu-latest steps: - uses: actions/checkout@v2 - name: publish-to-conda uses: fcakyon/conda-publish-action@v1.3 with: subdir: 'conda' anacondatoken: ${{ secrets.ANACONDA_TOKEN }} platforms: 'win osx linux'
Enter fullscreen mode Exit fullscreen mode

The world of anaconda does a great service to the data science community and I hope that this post decreases the barrier for publishing things at anaconda. 😄 I wish you all a great time!

Top comments (0)