Skip to content

Conversation

@aldogonzalez8
Copy link
Contributor

@aldogonzalez8 aldogonzalez8 commented Jan 7, 2025

What

New Feature for Universal File Transfers: Option for source to suppress subdirectory info during sync

How

When "Preserve Subdirectories in File Paths" disabled we will not replicate the directory structure in the source but put all the files in the stream root folder of the destination. This will be done by updating the relative_path (cdk change here).

image

Review guide

  1. Mainly cdk bump and new integration test for the feature. Underlying logic to preserve or not the directories structure is in the cdk changes merged here.

User Impact

User will now be able to preserve/remove sub directories structure when using file-transfer

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌
@aldogonzalez8 aldogonzalez8 self-assigned this Jan 7, 2025
@vercel
Copy link

vercel bot commented Jan 7, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 16, 2025 2:26pm
@aldogonzalez8 aldogonzalez8 merged commit d4c848c into master Jan 16, 2025
30 checks passed
@aldogonzalez8 aldogonzalez8 deleted the aldogonzalez8/source-sftp-bulk/not-mirroring-paths branch January 16, 2025 14:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/source/sftp-bulk

4 participants