Merge branch 'main' into evaluator

Author: michaelhhogue

CONTRIBUTING.md

@@ -9,14 +9,12 @@ We appreciate your contributions!
 5. Create new Pull Request
 
 ## Contribution Ideas
-- **Remove necessity for `pip install .`**: I think by uploading packages to PyPi we can reduce the installation code steps by consolidating `pip install -r requirements.txt` and `pip install .`. If that's possible that'd be great. 
+- **Develop an Automated End-to-End Testing System**:  Build an automated testing framework that can be run before merging PRs to `main` to confirm no test cases broke. An example of such a test case would be "go to google docs and write a poem". This testing system should be flexible to add new test cases in the future and reduce the time spent on manually testing each PR. 
 - **Improve performance by finding optimal screenshot grid**: A primary element of the framework is that it overlays a percentage grid on the screenshot which GPT-4v uses to estimate click locations. If someone is able to find the optimal grid and some evaluation metrics to confirm it is an improvement on the current method then we will merge that PR. 
 - **Improve the `SUMMARY_PROMPT`**
-- **Create an evaluation system**
 - **Improve Linux and Windows compatibility**: There are still some issues with Linux and Windows compatibility. PRs to fix the issues are encouraged. 
-- **Enabling New Mouse Capabilities**: (drag, hover, etc.)
 - **Adding New Multimodal Models**: Integration of new multimodal models is welcomed. If you have a specific model in mind that you believe would be a valuable addition, please feel free to integrate it and submit a PR.
-- **Framework Architecture Improvements**: Think you can enhance the framework architecture described in the intro? We welcome suggestions and PRs.
+- **Iterate `--accurate` flag functionality**: Look at https://github.com/OthersideAI/self-operating-computer/pull/57 for previous iteration
 
 ## Guidelines
 This will primarily be a [Software 2.0](https://karpathy.medium.com/software-2-0-a64152b37c35) project. For this reason: 

README.md

@@ -63,23 +63,23 @@ python3 -m venv venv
 ```
 source venv/bin/activate
 ```
-6. **Install Project Requirements and Command-Line Interface**:
+5. **Install Project Requirements and Command-Line Interface: Instead of using `pip install .`, you can now install the project directly from PyPI with:**
 ```
-pip install .
+pip install self-operating-computer
 ```
-7. **Then rename the `.example.env` file to `.env` so that you can save your OpenAI key in it.**
+6. **Then rename the `.example.env` file to `.env` so that you can save your OpenAI key in it.**
 ```
 mv .example.env .env
 ``` 
-8. **Add your Open AI key to your new `.env` file. If you don't have one, you can obtain an OpenAI key [here](https://platform.openai.com/account/api-keys)**:
+7. **Add your Open AI key to your new `.env` file. If you don't have one, you can obtain an OpenAI key [here](https://platform.openai.com/account/api-keys)**:
 ```
 OPENAI_API_KEY='your-key-here'
 ```
-9. **Run it**!
+8. **Run it**!
 ```
 operate
 ```
-10. **Final Step**: As a last step, the Terminal app will ask for permission for "Screen Recording" and "Accessibility" in the "Security & Privacy" page of Mac's "System Preferences".
+9. **Final Step**: As a last step, the Terminal app will ask for permission for "Screen Recording" and "Accessibility" in the "Security & Privacy" page of Mac's "System Preferences".
 
 <div align="center">
  <img src="https://github.com/OthersideAI/self-operating-computer/blob/main/readme/terminal-access-1.png" width="300" style="margin: 10px;"/>
@@ -132,4 +132,4 @@ Stay updated with the latest developments:
 
 ## OpenAI Rate Limiting Note
 The ```gpt-4-vision-preview``` model is required. To unlock access to this model, your account needs to spend at least \$5 in API credits. Pre-paying for these credits will unlock access if you haven't already spent the minimum \$5. 
-Learn more **[here](https://platform.openai.com/docs/guides/rate-limits?context=tier-one)**
+Learn more **[here](https://platform.openai.com/docs/guides/rate-limits?context=tier-one)**

operate/main.py

@@ -700,6 +700,8 @@ def search(text):
  pyautogui.press("space")
  pyautogui.keyUp("command")
 
+ time.sleep(1)
+
  # Now type the text
  for char in text:
  pyautogui.write(char)

setup.py

@@ -10,7 +10,7 @@
 
 setup(
  name="self-operating-computer",
- version="1.0.4",
+ version="1.0.5",
  packages=find_packages(),
  install_requires=required, # Add dependencies here
  entry_points={