Skip to content

Conversation

sararob
Copy link
Contributor

@sararob sararob commented Mar 22, 2022

Addresses b/225964107 🦕

I added a timeout arg and relevant tests to these methods:

  • Model.upload
  • Model.deploy
  • PipelineJob.submit
  • *TrainingJob.run
  • CustomJob.run
  • HyperparameterTuningJob.run
  • BatchPredictionJob.create
  • *Dataset.create
  • *Dataset.import_data
  • Tensorboard.create
  • TensorboardExperiment.create
  • TensorboardRun.create
  • Featurestore.create
  • Featurestore.create_entity_type
  • Featurestore.update
  • Featurestore.batch_serve_to_bq
  • Featurestore.batch_serve_to_gcs
  • Featurestore.batch_serve_to_df
  • EntityType.create
  • EntityType.update
  • EntityType.read
  • EntityType.create_feature
  • EntityType.batch_create_features
  • EntityType.ingest_from_bq
  • EntityType.ingest_from_gcs
  • EntityType.ingest_from_df
  • Feature.create
  • Feature.update

For most of these methods, I gave the timeout arg a name specific to the method (i.e. upload_request_timeout) to differentiate the timeout of initiating the request (what this PR applies to) vs. the timeout of the underlying job.

@sararob sararob requested a review from sasha-gitg March 22, 2022 16:17
@sararob sararob changed the title Add timeout arg feat: add timeout arg to model upload, dataset create and import, and tensorboard create Mar 22, 2022
@sararob sararob marked this pull request as draft March 22, 2022 18:38
@sararob sararob changed the title feat: add timeout arg to model upload, dataset create and import, and tensorboard create feat: add timeout arg across SDK Mar 22, 2022
@sararob sararob marked this pull request as ready for review March 25, 2022 22:31
Copy link
Member

@sasha-gitg sasha-gitg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with minor comments. Thanks Sara!

Overrides encryption_spec_key_name set in aiplatform.init.
create_request_timeout (float):
Optional. The timeout for initiating this create request in seconds. Note:
this does not set the timeout on the underlying create job, only on the time
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Preference to reduce this docstring to The timeout for the create request in seconds. throughout.

# import_request_timeout is None since user is issuing a single request with create and import
if isinstance(datasource, _datasources.DatasourceImportable):
dataset_obj._import_and_wait(datasource)
dataset_obj._import_and_wait(datasource, import_request_timeout=None)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Preference to handle this as a default in _import_and_wait instead of passing None directly.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In this case should create() accept both create_request_timeout and import_request_timeout parameters?

return dataset_obj

def _import_and_wait(self, datasource):
def _import_and_wait(self, datasource, import_request_timeout):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Preference to use this chance to include a docstring and type hints.

@product-auto-label product-auto-label bot added the size: xl Pull request size is extra large. label Apr 1, 2022
@sararob sararob requested a review from sasha-gitg April 1, 2022 17:12
@sararob sararob merged commit 184f7f3 into googleapis:main Apr 1, 2022
gcf-merge-on-green bot pushed a commit that referenced this pull request May 27, 2022
Adds e2e test for AutoML Forecasting and unit test for `TimeSeriesDataset`. Also adds `create_request_timeout` to `TimeSeriesDataset`, which #1099 seems to have missed. --- Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly: - [x] Make sure to open an issue as a [bug/issue](https://github.com/googleapis/python-aiplatform/issues/new/choose) before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea - [x] Ensure the tests and linter pass - [x] Code coverage does not decrease (if any source code was changed) - [x] Appropriate docs were updated (if necessary) Fixes #<issue_number_goes_here> 🦕
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size: xl Pull request size is extra large.

2 participants