Merge pull request #3 from testdrivenio/updates

Updates

Author: mjhea0

LICENSE

@@ -1,6 +1,6 @@
 MIT License
 
-Copyright (c) 2018 Michael Herman
+Copyright (c) 2019 Michael Herman
 
 Permission is hereby granted, free of charge, to any person obtaining a copy
 of this software and associated documentation files (the "Software"), to deal

README.md

@@ -8,7 +8,7 @@ Check out the [blog post](https://testdriven.io/concurrent-web-scraping-with-sel
 
 1. Fork/Clone
 
-1. Create and activate a virtualenv
+1. Create and activate a virtual environment
 
 1. Install the requirements
 
@@ -17,27 +17,29 @@ Check out the [blog post](https://testdriven.io/concurrent-web-scraping-with-sel
 1. Add the token to your environment:
 
  ```sh
- $ export DIGITAL_OCEAN_ACCESS_TOKEN=[your_token]
+ (env)$ export DIGITAL_OCEAN_ACCESS_TOKEN=[your_token]
  ```
 
 1. Spin up four droplets and deploy Docker Swarm:
 
  ```sh
- $ sh project/create.sh
+ (env)$ sh project/create.sh
  ```
 
 1. Run the scraper:
 
  ```sh
- $ NODE=$(docker service ps --format "{{.Node}}" selenium_hub)
- $ for i in {1..8}; do {
- python project/script.py ${i} $(docker-machine ip $NODE) &
- };
- done
+ (env)$ docker-machine env node-1
+ (env)$ eval $(docker-machine env node-1)
+ (env)$ NODE=$(docker service ps --format "{{.Node}}" selenium_hub)
+ (env)$ for i in {1..8}; do {
+ python project/script.py ${i} $(docker-machine ip $NODE) &
+ };
+ done
  ```
 
 1. Bring down the resources:
 
  ```sh
- $ sh project/destroy.sh
+ (env)$ sh project/destroy.sh
  ```

docker-compose.yml

@@ -1,9 +1,9 @@
-version: '3.5'
+version: '3.7'
 
 services:
 
  hub:
- image: selenium/hub:3.9.1
+ image: selenium/hub:3.141.59
  ports:
  - 4444:4444
  deploy:
@@ -14,7 +14,7 @@ services:
  - node.role == worker
 
  chrome:
- image: selenium/node-chrome:3.9.1
+ image: selenium/node-chrome:3.141.59
  volumes:
  - /dev/urandom:/dev/random
  depends_on:

requirements.txt

@@ -1,3 +1,3 @@
-beautifulsoup4==4.6.0
-requests==2.18.4
-selenium==3.8.1
+beautifulsoup4==4.7.1
+requests==2.21.0
+selenium==3.141.0