Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
52 commits
Select commit Hold shift + click to select a range
14d26bc
[1/x] Migrate all pre and most post scripts to subprocess in /scripts
Jibola Sep 6, 2024
56fafb8
command-type fix
Jibola Sep 6, 2024
71de21f
Merge branch 'master' into PYTHON-4069-1
Jibola Sep 6, 2024
f957a69
remove .evergreen/scripts/run-tests from this PR
Jibola Sep 6, 2024
94db687
Merge branch 'master' into PYTHON-4069-1
NoahStapp Nov 6, 2024
051e733
download_and_merge_coverage
NoahStapp Nov 6, 2024
ea5dff8
mockupdb, doctests, atlas
NoahStapp Nov 6, 2024
b10bd37
modwsgi, enterprise auth
NoahStapp Nov 6, 2024
a9b1c07
Fix modwsgi, aws auth
NoahStapp Nov 6, 2024
c017581
Fix aws auth, ocsp
NoahStapp Nov 6, 2024
6ce1f86
Standardize binary to bash
NoahStapp Nov 7, 2024
ec3c2c4
All but run_tests
NoahStapp Nov 7, 2024
312266f
Run tests
NoahStapp Nov 7, 2024
1b1abc8
Cleanup
NoahStapp Nov 7, 2024
b395f01
Debugging
NoahStapp Nov 7, 2024
7bda294
Fixes
NoahStapp Nov 8, 2024
3ef0084
Add run-with-env.sh
NoahStapp Nov 8, 2024
8176e6c
Fix client context OS var checks
NoahStapp Nov 8, 2024
c3bcada
Fix data lake tests
NoahStapp Nov 8, 2024
a49e630
Fix data lake tests
NoahStapp Nov 8, 2024
4a9ddf9
Add expansions to env
NoahStapp Nov 8, 2024
fbc5a0b
debugging
NoahStapp Nov 8, 2024
fe40a95
More env fixes
NoahStapp Nov 11, 2024
40a9984
Add setup-tests.sh
NoahStapp Nov 11, 2024
01704ba
Cleanup
NoahStapp Nov 12, 2024
57acb85
Cleanup
NoahStapp Nov 12, 2024
13c6e83
Merge branch 'master' into PYTHON-4721
NoahStapp Nov 12, 2024
707452b
Remove LOAD_BALANCER from system setup env
NoahStapp Nov 12, 2024
7617ac6
Fix unbound variables
NoahStapp Nov 12, 2024
3ff9a41
Add AUTH + SSL to bootstrap orchestration
NoahStapp Nov 12, 2024
2a3cc4c
Remove AUTH and SSL from system env
NoahStapp Nov 12, 2024
4a83e54
Fixes
NoahStapp Nov 13, 2024
9d2212f
Don't pass PYTHON_BINARY to CSFLE setup
NoahStapp Nov 13, 2024
9949ac9
Silent coverage
NoahStapp Nov 13, 2024
fb15895
Pass TEST_SUITES to run-tests
NoahStapp Nov 13, 2024
6f74878
Fix archive-logs
NoahStapp Nov 13, 2024
ae446f6
Remove unneeded s3 put
NoahStapp Nov 13, 2024
5f0b429
Add drivers-evergreen-tools teardown
NoahStapp Nov 13, 2024
3a3b542
More upload fixes
NoahStapp Nov 13, 2024
d7f79ca
More fixes
NoahStapp Nov 13, 2024
b8cd932
Remove TEST_SUITES from system-setup env, fix bucket
NoahStapp Nov 14, 2024
717c7c0
Add default TEST_SUITES to run-tests.sh
NoahStapp Nov 14, 2024
f7ad42d
Fix upload-coverage-report
NoahStapp Nov 14, 2024
68c9d29
run-with-env.sh should use -u not -eu
NoahStapp Nov 14, 2024
637a6cc
Add type:test back to run tests
NoahStapp Nov 14, 2024
ed73e72
Fix AUTH + SSL
NoahStapp Nov 19, 2024
18d82e0
Merge branch 'master' into PYTHON-4721
NoahStapp Nov 19, 2024
b4695c1
Fix bootstrap AUTH + SSL
NoahStapp Nov 19, 2024
7654361
Only pass PYTHON_BINARY where it was before
NoahStapp Nov 19, 2024
ebab2b6
Merge branch 'master' into PYTHON-4721
NoahStapp Nov 19, 2024
82dcf30
Cleanup
NoahStapp Nov 20, 2024
d5de764
AWS auth fix
NoahStapp Nov 20, 2024
File filter

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
debugging
  • Loading branch information
NoahStapp committed Nov 11, 2024
commit fbc5a0b021ea366815dafdd831dafed6be2a900b
7 changes: 4 additions & 3 deletions .evergreen/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ functions:
# Make an evergreen expansion file with dynamic values
- command: subprocess.exec
params:
include_expansions_in_env: ["is_patch", "project", "version_id", "AUTH", "SSL", "PYTHON_BINARY", "test_encryption", "test_encryption_pyopenssl", "test_crypt_shared", "test_pyopenssl", "SETDEFAULTENCODING", "test_loadbalancer", "test_serverless", "TEST_INDEX_MANAGEMENT", "SKIP_CSOT_TESTS", "MONGODB_STARTED", "DISABLE_TEST_COMMANDS", "GREEN_FRAMEWORK", "NO_EXT", "COVERAGE", "COMPRESSORS", "TEST_DATA_LAKE", "TEST_SUITES", "MONGODB_API_VERSION", "SKIP_HATCH", "skip_crypt_shared", "VERSION", "TOPOLOGY", "STORAGE_ENGINE", "ORCHESTRATION_FILE", "REQUIRE_API_VERSION", "LOAD_BALANCER"]
include_expansions_in_env: ["is_patch", "project", "version_id", "AUTH", "SSL", "PYTHON_BINARY", "test_encryption", "test_encryption_pyopenssl", "test_crypt_shared", "test_pyopenssl", "SETDEFAULTENCODING", "test_loadbalancer", "test_serverless", "SKIP_CSOT_TESTS", "MONGODB_STARTED", "DISABLE_TEST_COMMANDS", "GREEN_FRAMEWORK", "NO_EXT", "COVERAGE", "COMPRESSORS", "TEST_SUITES", "MONGODB_API_VERSION", "SKIP_HATCH", "skip_crypt_shared", "VERSION", "TOPOLOGY", "STORAGE_ENGINE", "ORCHESTRATION_FILE", "REQUIRE_API_VERSION", "LOAD_BALANCER"]
binary: bash
working_dir: "src"
args:
Expand Down Expand Up @@ -85,7 +85,7 @@ functions:
working_dir: "src"
include_expansions_in_env: ["AWS_ACCESS_KEY_ID", "AWS_SECRET_ACCESS_KEY", "AWS_SESSION_TOKEN"]
args:
- src/.evergreen/scripts/download-and-merge-coverage.sh
- .evergreen/scripts/download-and-merge-coverage.sh
- ${bucket_name}
- ${revision}
- ${version_id}
Expand Down Expand Up @@ -227,6 +227,7 @@ functions:
- command: subprocess.exec
params:
binary: bash
include_expansions_in_env: ["VERSION", "TOPOLOGY"]
args:
- src/.evergreen/scripts/run-with-env.sh
- src/.evergreen/scripts/bootstrap-mongo-orchestration.sh
Expand Down Expand Up @@ -305,7 +306,7 @@ functions:
params:
working_dir: "src"
binary: bash
include_expansions_in_env: ["AWS_ACCESS_KEY_ID", "AWS_SECRET_ACCESS_KEY", "AWS_SESSION_TOKEN"]
include_expansions_in_env: ["AWS_ACCESS_KEY_ID", "AWS_SECRET_ACCESS_KEY", "AWS_SESSION_TOKEN", "TEST_DATA_LAKE", "TEST_INDEX_MANAGEMENT", "test_serverless", "CRYPT_SHARED_LIB_PATH"]
args:
- .evergreen/scripts/run-with-env.sh
- .evergreen/scripts/run-tests.sh
Expand Down
18 changes: 7 additions & 11 deletions .evergreen/scripts/configure-env.sh
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ fi
export MONGO_ORCHESTRATION_HOME="$DRIVERS_TOOLS/.evergreen/orchestration"
export MONGODB_BINARIES="$DRIVERS_TOOLS/mongodb/bin"

cat <<EOT > $SCRIPT_DIR/env.sh
cat <<EOT > "$SCRIPT_DIR"/env.sh
set -o errexit
export PROJECT_DIRECTORY="$PROJECT_DIRECTORY"
export CURRENT_VERSION="$CURRENT_VERSION"
Expand All @@ -41,32 +41,28 @@ export PROJECT_DIRECTORY="$PROJECT_DIRECTORY"
export AUTH="${AUTH:-noauth}"
export SSL="${SSL:-nossl}"
export PYTHON_BINARY="${PYTHON_BINARY:-}"
export test_encryption="${test_encryption:-}"
export test_encryption_pyopenssl="${test_encryption_pyopenssl:-}"
export test_crypt_shared="${test_crypt_shared:-}"
export test_pyopenssl="${test_pyopenssl:-}"
export SETDEFAULTENCODING="${SETDEFAULTENCODING:-}"
export test_loadbalancer="${test_loadbalancer:-}"
export test_serverless="${test_serverless:-}"
export TEST_INDEX_MANAGEMENT="${TEST_INDEX_MANAGEMENT:-}"
export SKIP_CSOT_TESTS="${SKIP_CSOT_TESTS:-}"
export MONGODB_STARTED="${MONGODB_STARTED:-}"
export DISABLE_TEST_COMMANDS="${DISABLE_TEST_COMMANDS:-}"
export GREEN_FRAMEWORK="${GREEN_FRAMEWORK:-}"
export NO_EXT="${NO_EXT:-}"
export COVERAGE="${COVERAGE:-}"
export COMPRESSORS="${COMPRESSORS:-}"
export TEST_DATA_LAKE="${TEST_DATA_LAKE:-}"
export TEST_SUITES="${TEST_SUITES:-}"
export MONGODB_API_VERSION="${MONGODB_API_VERSION:-}"
export SKIP_HATCH="${SKIP_HATCH:-}"
export skip_crypt_shared="${skip_crypt_shared:-}"
export VERSION="${VERSION:-}"
export TOPOLOGY="${TOPOLOGY:-}"
export STORAGE_ENGINE="${STORAGE_ENGINE:-}"
export ORCHESTRATION_FILE="${ORCHESTRATION_FILE:-}"
export REQUIRE_API_VERSION="${REQUIRE_API_VERSION:-}"
export LOAD_BALANCER="${LOAD_BALANCER:-}"
test_encryption="${test_encryption:-}"
test_encryption_pyopenssl="${test_encryption_pyopenssl:-}"
test_crypt_shared="${test_crypt_shared:-}"
test_pyopenssl="${test_pyopenssl:-}"
test_loadbalancer="${test_loadbalancer:-}"
test_serverless="${test_serverless:-}"

export TMPDIR="$MONGO_ORCHESTRATION_HOME/db"
export PATH="$MONGODB_BINARIES:$PATH"
Expand Down
5 changes: 3 additions & 2 deletions .evergreen/scripts/run-tests.sh
Original file line number Diff line number Diff line change
@@ -1,5 +1,8 @@
#!/bin/bash

TEST_INDEX_MANAGEMENT="${TEST_INDEX_MANAGEMENT:-}"
TEST_DATA_LAKE="${TEST_DATA_LAKE:-}"

if [ -n "${test_encryption}" ]; then
./.evergreen/hatch.sh encryption:setup &
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We might need to break this out the way we handle it in the go driver, as a separate background command: https://github.com/mongodb/mongo-go-driver/blob/cf0348c9a63f6e4086e2c62aa62e70a9d3b3a986/.evergreen/config.yml#L508

fi
Expand Down Expand Up @@ -45,8 +48,6 @@ if [ -n "${SKIP_CSOT_TESTS}" ]; then
export SKIP_CSOT_TESTS=1
fi

python -c "import os; print([(k, v[:3]) for (k, v) in os.environ.items()])"

GREEN_FRAMEWORK=${GREEN_FRAMEWORK} \
PYTHON_BINARY=${PYTHON_BINARY} \
NO_EXT=${NO_EXT} \
Expand Down
2 changes: 1 addition & 1 deletion .evergreen/scripts/run-with-env.sh
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
if [ "${PWD##*/}" == "src" ]; then
. .evergreen/scripts/env.sh
else
. src/.evergreen/scripts/env.sh
. src/.evergreen/scripts/env.sh
fi

set -eu
Expand Down
2 changes: 1 addition & 1 deletion .evergreen/scripts/setup-encryption.sh
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/bin/bash

if [ -n "${test_encryption}" ]; then
./.evergreen/hatch.sh encryption:setup &
./.evergreen/hatch.sh encryption:setup
fi