Even when OpenSSL is already installed (brew install openssl), configure itself suggests a workaround, which worked for me:
./configure --with-http_ssl_module --add-module=../nginx-rtmp-module-master --with-openssl=/usropenssl=~/localGitHub/Cellaropenssl/openssl