Skip to content

Conversation

Guitaricet
Copy link
Contributor

Enhancement proposal.

It would be great if pip install git+https://github.com/bigscience-workshop/promptsource would install the package dependencies. I faced this inconvenience when installing T0 repository in a clean environment. T0 only specifies promptsource as a dependency and because the requirements.txt in promptsource are not propagated into its setup.py, the package is installed without sentencepiese and jinja2.

Enhancement proposal. It would be great if `pip install git+https://github.com/bigscience-workshop/promptsource` would install the package dependencies. I faced this inconvenience when installing T0 repository in a clean environment. T0 only specifies `promptsource` as a dependency and because the `requirements.txt` in promptsource are not propagated into its `setup.py`, the package is installed without `sentencepiese` and `jinja2`.
Copy link
Member

@VictorSanh VictorSanh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @Guitaricet !

readme = readme_file.read()

with open('requirements.txt') as requirements_file:
requirements = requirements_file.read().split('\n')
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i tried it and it works as if, but wanted to double check with you that we don't need to strip out the commented lines in requirements.txt
Currently, the list is:

['black', 'datasets>=1.7.0', 'flake8', 'isort==5.8.0', 'pytest', 'pyyaml>=5', 'streamlit==0.82', 'jinja2', 'plotly', 'requests', 'pandas', '##############################################################', '# Dependencies in this section are added for specific datasets', '##############################################################', 'py7zr', '##############################################################', '# End of dataset-specific dependencies', '##############################################################', '']
@thomasw21
Copy link
Member

Is there any reasons to still use requirements.txt? Like couldn't one copy everything into setup.py?

@VictorSanh VictorSanh merged commit 4f69052 into bigscience-workshop:main Jan 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
3 participants