ExploreConnectDocsChangelogPricingTemplatesPartnersString
Sign in
Sign up
← AWS + PostgreSQL integrations

Upsert Row with PostgreSQL API on Redshift - Updated Row from AWS API

Pipedream makes it easy to connect APIs for PostgreSQL, AWS and 2,800+ other apps remarkably fast.

Trigger workflow on
Redshift - Updated Row from the AWS API
Next, do this
Upsert Row with the PostgreSQL API
No credit card required
Intro to Pipedream
▶
Watch us build a workflow
Watch us build a workflow
8 min
Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo
Adyen logo
Appcues logo
Bandwidth logo
Checkr logo
ChartMogul logo
Dataminr logo
Gopuff logo
Gorgias logo
LinkedIn logo
Logitech logo
Replicated logo
Rudderstack logo
SAS logo
Scale AI logo
Webflow logo
Warner Bros. logo

Developers ♥ Pipedream

Getting Started

This integration creates a workflow with a AWS trigger and PostgreSQL action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

  1. Select this integration
  2. Configure the Redshift - Updated Row trigger
    1. Connect your AWS account
    2. Configure info
    3. Configure timer
    4. Select a AWS Region
    5. Select a Workgroup Name
    6. Select a Database Name
    7. Select a Schema
    8. Select a Table
    9. Select a Timestamp Column
  3. Configure the Upsert Row action
    1. Connect your PostgreSQL account
    2. Select a Schema
    3. Select a Table
    4. Select a Conflict Target
    5. Configure Row Values
  4. Deploy the workflow
  5. Send a test event to validate your setup
  6. Turn on the trigger

Details

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger

Redshift - Updated Row on AWS
Description:Emit new event when a row is updated, based on a selected timestamp column. [See the documentation](https://docs.aws.amazon.com/redshift/latest/APIReference/API_ExecuteStatement.html)
Version:0.0.1
Key:aws-redshift-updated-row

AWS Overview

The AWS API unlocks endless possibilities for automation with Pipedream. With this powerful combo, you can manage your AWS services and resources, automate deployment workflows, process data, and react to events across your AWS infrastructure. Pipedream offers a serverless platform for creating workflows triggered by various events that can execute AWS SDK functions, making it an efficient tool to integrate, automate, and orchestrate tasks across AWS services and other apps.

Trigger Code

import common from "../common/redshift-polling.mjs"; export default { ...common, key: "aws-redshift-updated-row", name: "Redshift - Updated Row", description: "Emit new event when a row is updated, based on a selected timestamp column. [See the documentation](https://docs.aws.amazon.com/redshift/latest/APIReference/API_ExecuteStatement.html)", type: "source", version: "0.0.1", dedupe: "unique", props: { ...common.props, info: { propDefinition: [ common.props.app, "info", ], }, timestampColumn: { label: "Timestamp Column", description: "A column with a timestamp that is updated when a row is modified.", propDefinition: [ common.props.app, "uniqueColumn", ({ region, database, workgroupName, schema, table, }) => ({ region, database, workgroupName, schema, table, filter: (column) => column.typeName === "timestamp", }), ], }, }, async run() { const { region, workgroupName, database, schema, table, timestampColumn, getValue, } = this; const lastTimestamp = this.db.get("lastTimestamp"); let sql = `SELECT * FROM ${schema}.${table}`; if (lastTimestamp) { sql += ` WHERE ${timestampColumn} > :lastTimestamp`; } sql += ` ORDER BY ${timestampColumn} DESC LIMIT 100`; const parameters = lastTimestamp ? [ { name: "lastTimestamp", value: lastTimestamp, }, ] : undefined; const response = await this.app.executeStatement({ region, workgroupName, database, sql, parameters, }); if (response?.Records?.length > 0) { const columnNames = response.ColumnMetadata.map((c) => c.name); const records = response.Records.map((record) => record.reduce((row, field, index) => ({ ...row, [columnNames[index]]: getValue(field), }), {})); records.reverse().forEach((record) => { const id = record[timestampColumn]; const ts = new Date(record[timestampColumn]).getTime(); this.$emit(record, { id, ts, summary: `Row Updated ${id}`, }); }); if (records?.length > 0) { const [ newLastTimestamp, ] = records.map((record) => record[timestampColumn]).reverse(); this.db.set("lastTimestamp", newLastTimestamp); } } }, };

Trigger Configuration

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.
LabelPropTypeDescription
AWSappappThis component uses the AWS app.
N/Adb$.service.dbThis component uses $.service.db to maintain state between executions.
timer$.interface.timer
AWS RegionregionstringSelect a value from the drop down menu.
Workgroup NameworkgroupNamestringSelect a value from the drop down menu.
Database NamedatabasestringSelect a value from the drop down menu.
SchemaschemastringSelect a value from the drop down menu.
TabletablestringSelect a value from the drop down menu.
Timestamp ColumntimestampColumnstringSelect a value from the drop down menu.

Trigger Authentication

AWS uses API keys for authentication. When you connect your AWS account, Pipedream securely stores the keys so you can easily authenticate to AWS APIs in both code and no-code steps.

Follow the AWS Instructions for creating an IAM user with an associated access and secret key.

As a best practice, attach the minimum set of IAM permissions necessary to perform the specific task in Pipedream. If your workflow only needs to perform a single API call, you should create a user and associate an IAM group / policy with permission to do only that task. You can create as many linked AWS accounts in Pipedream as you'd like.

Enter your access and secret key below.

About AWS

Amazon Web Services (AWS) offers reliable, scalable, and inexpensive cloud computing services.

Action

Upsert Row on PostgreSQL
Description:Adds a new row or updates an existing row. [See the documentation](https://node-postgres.com/features/queries)
Version:2.0.9
Key:postgresql-upsert-row

PostgreSQL Overview

On Pipedream, you can leverage the PostgreSQL app to create workflows that automate database operations, synchronize data across platforms, and react to database events in real-time. Think handling new row entries, updating records from webhooks, or even compiling reports on a set schedule. Pipedream's serverless platform provides a powerful way to connect PostgreSQL with a variety of apps, enabling you to create tailored automation that fits your specific needs.

Action Code

import postgresql from "../../postgresql.app.mjs"; import { parseRowValues } from "../../common/utils.mjs"; export default { name: "Upsert Row", key: "postgresql-upsert-row", description: "Adds a new row or updates an existing row. [See the documentation](https://node-postgres.com/features/queries)", version: "2.0.9", annotations: { destructiveHint: true, openWorldHint: true, readOnlyHint: false, }, type: "action", props: { postgresql, schema: { propDefinition: [ postgresql, "schema", ], }, table: { propDefinition: [ postgresql, "table", (c) => ({ schema: c.schema, }), ], }, conflictTarget: { propDefinition: [ postgresql, "column", (c) => ({ table: c.table, schema: c.schema, }), ], label: "Conflict Target", description: "If insert fails, update the row with the same value in this column.", }, rowValues: { propDefinition: [ postgresql, "rowValues", ], description: "JSON representation of your table row values. For example: `{ \"product_name\": \"Laptop Pro 15\", \"price\": 1200.50, \"stock_quantity\": 50 }`", }, }, async run({ $ }) { const { rowValues, ...args } = this; const parsedRowValues = parseRowValues(rowValues); const columns = Object.keys(parsedRowValues); const values = Object.values(parsedRowValues); const res = await this.postgresql.upsertRow({ columns, values, errorMsg: "Row not upserted due to an error. ", ...args, }); const summary = res ? "Row upserted" : "Row not upserted"; $.export("$summary", summary); return res; }, };

Action Configuration

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

LabelPropTypeDescription
PostgreSQLpostgresqlappThis component uses the PostgreSQL app.
SchemaschemastringSelect a value from the drop down menu.
TabletablestringSelect a value from the drop down menu.
Conflict TargetconflictTargetstringSelect a value from the drop down menu.
Row ValuesrowValuesobject

JSON representation of your table row values. For example: { "product_name": "Laptop Pro 15", "price": 1200.50, "stock_quantity": 50 }

Action Authentication

PostgreSQL uses API keys for authentication. When you connect your PostgreSQL account, Pipedream securely stores the keys so you can easily authenticate to PostgreSQL APIs in both code and no-code steps.

Connecting to Restricted Databases

Either enable the shared static IP for this account below, or configure a VPC to deploy any workflow in your workspace to a private network with a dedicated static IP. Learn more in our docs

SSL Setup

Configure SSL on your PostgreSQL database by providing the CA (Certificate Authority), and choosing between Full Verification, Verify Certificate Authority (CA), or Skip Verification. Skipping verification is not recommended as this has serious security implications

About PostgreSQL

PostgreSQL is a free and open-source relational database management system emphasizing extensibility and SQL compliance.

More Ways to Connect PostgreSQL + AWS

Other Popular Integrations

Delete Row(s) with PostgreSQL API on New Records Returned by CloudWatch Logs Insights Query from AWS API
AWS + PostgreSQL
 
Try it
Delete Row(s) with PostgreSQL API on New Scheduled Tasks from AWS API
AWS + PostgreSQL
 
Try it
Delete Row(s) with PostgreSQL API on New SNS Messages from AWS API
AWS + PostgreSQL
 
Try it
Execute Custom Query with PostgreSQL API on New Records Returned by CloudWatch Logs Insights Query from AWS API
AWS + PostgreSQL
 
Try it
Execute Custom Query with PostgreSQL API on New Scheduled Tasks from AWS API
AWS + PostgreSQL
 
Try it
Execute Custom Query with PostgreSQL API on New SNS Messages from AWS API
AWS + PostgreSQL
 
Try it
Find Row with PostgreSQL API on New Records Returned by CloudWatch Logs Insights Query from AWS API
AWS + PostgreSQL
 
Try it
Find Row with PostgreSQL API on New Scheduled Tasks from AWS API
AWS + PostgreSQL
 
Try it
Find Row with PostgreSQL API on New SNS Messages from AWS API
AWS + PostgreSQL
 
Try it
Execute Custom Query with PostgreSQL API on New Inbound SES Emails from AWS API
AWS + PostgreSQL
 
Try it
Delete Row(s) with PostgreSQL API on New Inbound SES Emails from AWS API
AWS + PostgreSQL
 
Try it
Find Row with PostgreSQL API on New Inbound SES Emails from AWS API
AWS + PostgreSQL
 
Try it
New Row with PostgreSQL API on New Records Returned by CloudWatch Logs Insights Query from AWS API
AWS + PostgreSQL
 
Try it
New Row with PostgreSQL API on New Scheduled Tasks from AWS API
AWS + PostgreSQL
 
Try it
New Row with PostgreSQL API on New SNS Messages from AWS API
AWS + PostgreSQL
 
Try it
Update Row with PostgreSQL API on New Records Returned by CloudWatch Logs Insights Query from AWS API
AWS + PostgreSQL
 
Try it
Update Row with PostgreSQL API on New Scheduled Tasks from AWS API
AWS + PostgreSQL
 
Try it
Update Row with PostgreSQL API on New SNS Messages from AWS API
AWS + PostgreSQL
 
Try it
New Row with PostgreSQL API on New Inbound SES Emails from AWS API
AWS + PostgreSQL
 
Try it
Update Row with PostgreSQL API on New Inbound SES Emails from AWS API
AWS + PostgreSQL
 
Try it

Popular Triggers

New Scheduled Tasks from the AWS API

Creates a Step Function State Machine to publish a message to an SNS topic at a specific timestamp. The SNS topic delivers the message to this Pipedream source, and the source emits it as a new event.

 
Try it
New SNS Messages from the AWS API

Creates an SNS topic in your AWS account. Messages published to this topic are emitted from the Pipedream source.

 
Try it
New Inbound SES Emails from the AWS API

The source subscribes to all emails delivered to a specific domain configured in AWS SES. When an email is sent to any address at the domain, this event source emits that email as a formatted event. These events can trigger a Pipedream workflow and can be consumed via SSE or REST API.

 
Try it
New Deleted S3 File from the AWS API

Emit new event when a file is deleted from a S3 bucket

 
Try it
New DynamoDB Stream Event from the AWS API

Emit new event when a DynamoDB stream receives new events. See the docs here

 
Try it
New Records Returned by CloudWatch Logs Insights Query from the AWS API

Executes a CloudWatch Logs Insights query on a schedule, and emits the records as invidual events (default) or in batch

 
Try it
New Restored S3 File from the AWS API

Emit new event when a file is restored into an S3 bucket

 
Try it
New S3 Event from the AWS API

Emit new S3 events for a given bucket

 
Try it
New S3 File from the AWS API

Emit new event when a file is added to an S3 bucket

 
Try it
New Update to AWS RDS Database (Instant) from the AWS API

Emit new event when there is an update to an AWS RDS Database.

 
Try it
Redshift - New Row from the AWS API

Emit new event when a new row is added to a table. See the documentation

 
Try it
Redshift - Updated Row from the AWS API

Emit new event when a row is updated, based on a selected timestamp column. See the documentation

 
Try it
New Column from the PostgreSQL API

Emit new event when a new column is added to a table. See the documentation

 
Try it
New or Updated Row from the PostgreSQL API

Emit new event when a row is added or modified. See the documentation

 
Try it
New Row from the PostgreSQL API

Emit new event when a new row is added to a table. See the documentation

 
Try it
New Row Custom Query from the PostgreSQL API

Emit new event when new rows are returned from a custom query that you provide. See the documentation

 
Try it
New Table from the PostgreSQL API

Emit new event when a new table is added to the database. See the documentation

 
Try it

Popular Actions

CloudWatch Logs - Put Log Event with the AWS API

Uploads a log event to the specified log stream. See docs

 
Try it
DynamoDB - Create Table with the AWS API

Creates a new table to your account. See docs

 
Try it
DynamoDB - Execute Statement with the AWS API

This operation allows you to perform transactional reads or writes on data stored in DynamoDB, using PartiQL. See docs

 
Try it
DynamoDB - Get Item with the AWS API

The Get Item operation returns a set of attributes for the item with the given primary key. If there is no matching item, Get Item does not return any data and there will be no Item element in the response. See docs

 
Try it
DynamoDB - Put Item with the AWS API

Creates a new item, or replaces an old item with a new item. If an item that has the same primary key as the new item already exists in the specified table, the new item completely replaces the existing item. See docs

 
Try it
DynamoDB - Query with the AWS API

The query operation finds items based on primary key values. See docs

 
Try it
DynamoDB - Scan with the AWS API

The Scan operation returns one or more items and item attributes by accessing every item in a table. See docs

 
Try it
DynamoDB - Update Item with the AWS API

Updates an existing item's attributes, or adds a new item to the table if it does not already exist. See docs

 
Try it
DynamoDB - Update Table with the AWS API

Modifies the settings for a given table. Only one type of modification is permitted per request. See docs

 
Try it
EventBridge - Send Event to Event Bus with the AWS API

Sends an event to an EventBridge event bus. See documentation

 
Try it
Lambda - Create Function with the AWS API

Create a Lambda function from source code. This action creates a zip file and deploys it to AWS Lambda. See the docs

 
Try it
Lambda - Invoke Function with the AWS API

Invoke a Lambda function using the AWS API. See the docs

 
Try it
Redshift - Create Rows with the AWS API

Insert rows into a table. See the documentation

 
Try it
Redshift - Delete Rows with the AWS API

Deletes row(s) in an existing table in Redshift. See the documentation

 
Try it
Redshift - Query Database with the AWS API

Run a SELECT query on a database. See the documentation

 
Try it
Redshift - Update Rows with the AWS API

Update row(s) in an existing table in Redshift. See the documentation

 
Try it
S3 - Download File to /tmp with the AWS API

Downloads a file from S3 to the /tmp directory. See the documentation

 
Try it
S3 - Generate Presigned URL with the AWS API

Creates a presigned URL to download from a bucket. See the documentation

 
Try it
S3 - Upload Base64 As File with the AWS API

Accepts a base64-encoded string and a filename, then uploads as a file to S3. See the documentation

 
Try it
S3 - Upload Files with the AWS API

Upload files to S3. Accepts either a file URL, a local file path, or a directory path. See the documentation

 
Try it
SNS - Send Message with the AWS API

Sends a message to a SNS Topic. See docs

 
Try it
SQS - Send Message with the AWS API

Sends a message to an SQS queue. See the docs

 
Try it
Execute SQL Query with the PostgreSQL API

Execute a custom PostgreSQL query. See our docs to learn more about working with SQL in Pipedream.

 
Try it
Delete Row(s) with the PostgreSQL API

Deletes a row or rows from a table. See the documentation

 
Try it
Find Row with the PostgreSQL API

Finds a row in a table via a lookup column. See the documentation

 
Try it
Find Row With Custom Query with the PostgreSQL API

Finds a row in a table via a custom query. See the documentation

 
Try it
Insert Row with the PostgreSQL API

Adds a new row. See the documentation

 
Try it
Query SQL Database with the PostgreSQL API

Execute a SQL Query. See our docs to learn more about working with SQL in Pipedream.

 
Try it
Update Row with the PostgreSQL API

Updates an existing row. See the documentation

 
Try it
Upsert Row with the PostgreSQL API

Adds a new row or updates an existing row. See the documentation

 
Try it

Explore Other Apps

1
-
24
of
2,800+
apps by most popular

Node
Node
Anything you can do with Node.js, you can do in a Pipedream workflow. This includes using most of npm's 400,000+ packages.
Python
Python
Anything you can do in Python can be done in a Pipedream Workflow. This includes using any of the 350,000+ PyPi packages available in your Python powered workflows.
Notion
Notion
Notion is a new tool that blends your everyday work apps into one. It's the all-in-one workspace for you and your team.
OpenAI (ChatGPT)
OpenAI (ChatGPT)
OpenAI is an AI research and deployment company with the mission to ensure that artificial general intelligence benefits all of humanity. They are the makers of popular models like ChatGPT, DALL-E, and Whisper.
Anthropic (Claude)
Anthropic (Claude)
AI research and products that put safety at the frontier. Introducing Claude, a next-generation AI assistant for your tasks, no matter the scale.
Google Sheets
Google Sheets
Use Google Sheets to create and edit online spreadsheets. Get insights together with secure sharing in real-time and from any device.
Telegram
Telegram
Telegram, is a cloud-based, cross-platform, encrypted instant messaging (IM) service.
Google Drive
Google Drive
Google Drive is a file storage and synchronization service which allows you to create and share your work online, and access your documents from anywhere.
HTTP / Webhook
HTTP / Webhook
Get a unique URL where you can send HTTP or webhook requests
Google Calendar
Google Calendar
With Google Calendar, you can quickly schedule meetings and events and get reminders about upcoming activities, so you always know what’s next.
Schedule
Schedule
Trigger workflows on an interval or cron schedule.
Pipedream Utils
Pipedream Utils
Utility functions to use within your Pipedream workflows
Shopify
Shopify
Shopify is a complete commerce platform that lets anyone start, manage, and grow a business. You can use Shopify to build an online store, manage sales, market to customers, and accept payments in digital and physical locations.
Supabase
Supabase
Supabase is an open source Firebase alternative.
MySQL
MySQL
MySQL is an open-source relational database management system.
PostgreSQL
PostgreSQL
PostgreSQL is a free and open-source relational database management system emphasizing extensibility and SQL compliance.
Premium
AWS
AWS
Amazon Web Services (AWS) offers reliable, scalable, and inexpensive cloud computing services.
Premium
Twilio SendGrid
Twilio SendGrid
Send marketing and transactional email through the Twilio SendGrid platform with the Email API, proprietary mail transfer agent, and infrastructure for scalable delivery.
Amazon SES
Amazon SES
Amazon SES is a cloud-based email service provider that can integrate into any application for high volume email automation
Premium
Klaviyo
Klaviyo
Email Marketing and SMS Marketing Platform
Premium
Zendesk
Zendesk
Zendesk is award-winning customer service software trusted by 200K+ customers. Make customers happy via text, mobile, phone, email, live chat, social media.
Premium
ServiceNow
ServiceNow
The smarter way to workflow
Slack
Slack
Slack is a channel-based messaging platform. With Slack, people can work together more effectively, connect all their software tools and services, and find the information they need to do their best work — all within a secure, enterprise-grade environment.
Microsoft Teams
Microsoft Teams
Microsoft Teams has communities, events, chats, channels, meetings, storage, tasks, and calendars in one place.
abcdefghijklmnopqrstuvwxyz#
Pipedream, Inc. — San Francisco, CA
AboutTwitterDocsCommunityTermsPrivacyTry String