Arch Linux User Repository

Hiya, throwing ==> ERROR: BUILDENV array contains unknown option '<option>' with all options in this package. Anyone know what I've f-ed up?

Cool, glad to help ;)

thank you again @Tjuh i was able to solve my problem by using bash instead fish

Also symlinked lld to point to ld; sudo ln /usr/bin/ld.lld /usr/bin/ld

Check out my makepkg.conf for suggestions;

#!/hint/bash # shellcheck disable=2034  DLAGENTS=('file::/usr/bin/curl -qgC - -o %o %u'           'ftp::/usr/bin/curl -qgfC - --ftp-pasv --retry 3 --retry-delay 3 -o %o %u'           'http::/usr/bin/curl -qgb "" -fLC - --retry 3 --retry-delay 3 -o %o %u'           'https::/usr/bin/curl -qgb "" -fLC - --retry 3 --retry-delay 3 -o %o %u'           'rsync::/usr/bin/rsync --no-motd -z %u %o'           'scp::/usr/bin/scp -C %u %o') VCSCLIENTS=('bzr::breezy'             'fossil::fossil'             'git::git'             'hg::mercurial'             'svn::subversion')  CARCH="x86_64" CHOST="x86_64-pc-linux-gnu" PACKAGECARCH="x86_64_v3"  CFLAGS="-v -march=znver3 -Ofast -pipe -fno-plt -fexceptions -Wp,-D_FORTIFY_SOURCE=3 -Wp,-D_GLIBCXX_ASSERTIONS -fstack-clash-protection -fcf-protection -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -ffp-contract=fast -munsafe-fp-atomics -mtgsplit -fplugin=LLVMPolly.so --param=ssp-buffer-size=4 -DNDEBUG -fPIC -falign-functions=32 -fcoroutines -fdata-sections -fexperimental-library -ffunction-sections -flto=thin -fmerge-all-constants -fopenmp -fopenmp-cuda-mode -fopenmp-enable-irbuilder -fopenmp-extensions -fopenmp-optimistic-collapse -funroll-loops -fvisibility-inlines-hidden -fwhole-program-vtables -mprefer-vector-width=256 -mrelax-all -mllvm -polly -mllvm -polly-num-threads=16 -mllvm -polly-omp-backend=LLVM -mllvm -polly-parallel -mllvm -polly-position=before-vectorizer -mllvm -polly-scheduling-chunksize=1 -mllvm -polly-scheduling=dynamic -mllvm -polly-vectorizer=stripmine -mllvm -polly-process-unprofitable -mllvm -polly-use-llvm-names -pthread -stdlib=libc++ -w -fno-threadsafe-statics -Wno-incompatible-pointer-types -Wno-sign-conversion -Wno-sizeof-pointer-memaccess -Wno-unused-function -Wno-unused-parameter -Wno-error -fno-finite-math-only" CXXFLAGS="$CFLAGS -std=gnu++23" LDFLAGS="-Wl,-O2,--sort-common,--as-needed,-zrelro,-znow,-zpack-relative-relocs,--emit-relocs,--gc-sections,--hash-style=gnu,--icf=safe,--ignore-data-address-equality,--ignore-function-address-equality,--optimize-bb-jumps,--print-gc-sections,--print-icf-sections,--strip-debug,--trace,--verbose,--thinlto-cache-dir=/tmp,--thinlto-jobs=16,-lmimalloc,-lomp,-lpthread,-zifunc-noplt,-znotext,-zmax-page-size=0x4000,-zseparate-code,-zseparate-loadable-segments,-zshstk,-lm" MAKEFLAGS="-j16" NINJAFLAGS="-j16"  #BUILDDIR="/tmp/makepkg" BUILDENV=(color !check !sign) OPTIONS=(!strip !docs !emptydirs !libtool !staticlibs) INTEGRITY_CHECK=(sha256) DOC_DIRS=(usr/share/{doc,gtk-doc,locale,metainfo,zsh,man,vim,ffmpeg,lua-examples,backgrounds,themes,licenses})  LOGDEST="/home/tjuh/logs" PKGDEST="/home/tjuh/packages" SRCDEST="/home/tjuh/sources"  PACKAGER="Tjuh <tjuh@proton.me>" COMPRESSZST=(zstd -c -z -vv --ultra -22 -T16 -) PKGEXT=".pkg.tar.zst" SRCEXT=".src.tar.gz" GITFLAGS="--filter=tree:0" chrt -iap 0 $$

thank you @Tjuh

it seems it is a bit more complicated :(

stderr: cc: error: unrecognized command-line option ‘-mllvm’ cc: error: unrecognized command-line option ‘-polly’ cc: error: unrecognized command-line option ‘-mllvm’ cc: error: unrecognized command-line option ‘-polly-num-threads=8’ cc: error: unrecognized command-line option ‘-mllvm’ cc: error: unrecognized command-line option ‘-polly-parallel’ cc: error: unrecognized command-line option ‘-Xclang’  

/usr/share/makepkg/buildenv/graphite.sh:

buildenv_graphite() {     if check_buildoption "graphite" "y" || check_buildoption "polly" "y"; then         graphiteflags=" -lgomp -mllvm -polly -mllvm -polly-num-threads=$(getconf _NPROCESSORS_ONLN) -mllvm -polly-parallel"         check_buildoption "polly" "y" && \             graphiteflags+=" -Xclang -load -fplugin=LLVMPolly.so"         check_buildoption "graphite" "y" && \             graphiteflags=" -fgraphite-identity -floop-interchange -floop-nest-optimize -floop-parallelize-all -ftree-loop-distribution -ftree-parallelize-loops=$(getconf _NPROCESSORS_ONLN) -ftree-vectorize"          CFLAGS+="$graphiteflags"         CXXFLAGS+="$graphiteflags"     fi 

Install polly and use this -fplugin=LLVMPolly.so instead of -Xclang -load -Xclang LLVMPolly.so. Also that PGO script doesn't work with Clang, only GCC.

hi,

it seems something isn't ok with makepkg-optimize-mold :( and pgo also doesn't work

error: unable to load plugin 'LLVMPolly.so': 'LLVMPolly.so: cannot open shared object file: No such file or directory' clang (LLVM option parsing): Unknown command line argument '-polly'.  Try: 'clang (LLVM option parsing) --help' clang (LLVM option parsing): Did you mean '--color'? clang (LLVM option parsing): Unknown command line argument '-polly-num-threads=8'.  Try: 'clang (LLVM option parsing) --help' clang (LLVM option parsing): Did you mean '--xcore-max-threads=8'? clang (LLVM option parsing): Unknown command line argument '-polly-parallel'.  Try: 'clang (LLVM option parsing) --help' clang (LLVM option parsing): Did you mean '--enable-pre'? make[1]: *** [<builtin>: conn_bomb] Error 1 make[1]: *** Waiting for unfinished jobs.... 

clang -march=native -O2 -pipe -pthread -lgomp -mllvm -polly -mllvm -polly-num-threads=8 -mllvm -polly-parallel -Xclang -load -Xclang LLVMPolly.so -flto=auto -fprofile-generate -fprofile-dir=/home/tom/compile/bpftune-git/bpftune-git.gen -lpthread -Wl,-O1 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,-z,pack-relative-relocs -flto=auto -lgcov --coverage conn_bomb.c -o conn_bomb

@ptr1337 I think this should have proper upstream (instead of wiki) and replace makepkg-optimize which is not maintained.

Peter @ptr1337, consider using oxipng instead of optipng

Why?

1) It does optimize better.

You can see that optipng is one of the dependencies of Calibre. Indeed, it's used internally by it:

https://github.com/kovidgoyal/calibre/blob/eb161166b05f33eb0ff6bda97bac1fafadca77c5/src/calibre/utils/img.py#L621-L625

CLI utility of calibre ebook-polish is using it. My experience is that after running epub-polish on EPUB book with PNG images, the latter can be further optimized with oxipng:

oxipng --opt max extracted_epub/**.png 

So it means that optipng doesn't optimally encodes PNGs. Worth noting that oxipng with --opt max doesn't use Zopfli, there is separate CLI switch for it, i.e. it's not why oxipng compresses files better.

2) oxipng is faster (multithreaded, uses all avaliable cores/threads by default).

As stated in the project's README:

The core goal of rewriting OptiPNG was to implement multithreading, which would be very difficult to do within the existing C codebase of OptiPNG. This also served as an opportunity to choose a more modern, safer language (Rust).

Multi-threading would be especially useful if you need to optimize only a few images (< $(nproc)), because you won't be able to utilize all your threads with single-threaded optipng, unlike with oxipng