Redshift - Updated Row from AWS API

Pipedream makes it easy to connect APIs for AWS and 2,800+ other apps remarkably fast.

Trigger workflow on

Redshift - Updated Row from the AWS API

Next, do this

Connect to 2,800+ APIs using code and no-code building blocks

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

Trigger a workflow on Redshift - Updated Row with AWS API. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Configure the Redshift - Updated Row trigger
1. Connect your AWS account
2. Configure info
3. Configure timer
4. Select a AWS Region
5. Select a Workgroup Name
6. Select a Database Name
7. Select a Schema
8. Select a Table
9. Select a Timestamp Column
Add steps to connect to 2,800+ APIs using code and no-code building blocks
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Integrations#

Get Film with SWAPI - Star Wars API on Redshift - Updated Row from AWS API

AWS + SWAPI - Star Wars

Try it

Send any HTTP Request with HTTP / Webhook API on Redshift - Updated Row from AWS API

AWS + HTTP / Webhook

Try it

Get Backlinks with Ahrefs API on Redshift - Updated Row from AWS API

AWS + Ahrefs

Try it

Execute SQL Query with Snowflake API on Redshift - Updated Row from AWS API

AWS + Snowflake

Try it

[Date/Time] Add/Subtract Time with Formatting API on Redshift - Updated Row from AWS API

AWS + Formatting

Try it

Details#

This is a pre-built, source-available component from Pipedream's GitHub repo. The component is developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Redshift - Updated Row on AWS

Description:Emit new event when a row is updated, based on a selected timestamp column. [See the documentation](https://docs.aws.amazon.com/redshift/latest/APIReference/API_ExecuteStatement.html)

Version:0.0.1

Key:aws-redshift-updated-row

View on GitHub

Code#

import common from "../common/redshift-polling.mjs"; export default { ...common, key: "aws-redshift-updated-row", name: "Redshift - Updated Row", description: "Emit new event when a row is updated, based on a selected timestamp column. [See the documentation](https://docs.aws.amazon.com/redshift/latest/APIReference/API_ExecuteStatement.html)", type: "source", version: "0.0.1", dedupe: "unique", props: { ...common.props, info: { propDefinition: [ common.props.app, "info", ], }, timestampColumn: { label: "Timestamp Column", description: "A column with a timestamp that is updated when a row is modified.", propDefinition: [ common.props.app, "uniqueColumn", ({ region, database, workgroupName, schema, table, }) => ({ region, database, workgroupName, schema, table, filter: (column) => column.typeName === "timestamp", }), ], }, }, async run() { const { region, workgroupName, database, schema, table, timestampColumn, getValue, } = this; const lastTimestamp = this.db.get("lastTimestamp"); let sql = `SELECT * FROM ${schema}.${table}`; if (lastTimestamp) { sql += ` WHERE ${timestampColumn} > :lastTimestamp`; } sql += ` ORDER BY ${timestampColumn} DESC LIMIT 100`; const parameters = lastTimestamp ? [ { name: "lastTimestamp", value: lastTimestamp, }, ] : undefined; const response = await this.app.executeStatement({ region, workgroupName, database, sql, parameters, }); if (response?.Records?.length > 0) { const columnNames = response.ColumnMetadata.map((c) => c.name); const records = response.Records.map((record) => record.reduce((row, field, index) => ({ ...row, [columnNames[index]]: getValue(field), }), {})); records.reverse().forEach((record) => { const id = record[timestampColumn]; const ts = new Date(record[timestampColumn]).getTime(); this.$emit(record, { id, ts, summary: `Row Updated ${id}`, }); }); if (records?.length > 0) { const [ newLastTimestamp, ] = records.map((record) => record[timestampColumn]).reverse(); this.db.set("lastTimestamp", newLastTimestamp); } } }, };

Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
AWS	`app`	`app`	This component uses the AWS app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
	`timer`	`$.interface.timer`
AWS Region	`region`	`string`	Select a value from the drop down menu.
Workgroup Name	`workgroupName`	`string`	Select a value from the drop down menu.
Database Name	`database`	`string`	Select a value from the drop down menu.
Schema	`schema`	`string`	Select a value from the drop down menu.
Table	`table`	`string`	Select a value from the drop down menu.
Timestamp Column	`timestampColumn`	`string`	Select a value from the drop down menu.

Authentication#

AWS uses API keys for authentication. When you connect your AWS account, Pipedream securely stores the keys so you can easily authenticate to AWS APIs in both code and no-code steps.

Follow the AWS Instructions for creating an IAM user with an associated access and secret key.

As a best practice, attach the minimum set of IAM permissions necessary to perform the specific task in Pipedream. If your workflow only needs to perform a single API call, you should create a user and associate an IAM group / policy with permission to do only that task. You can create as many linked AWS accounts in Pipedream as you'd like.

Enter your access and secret key below.

About AWS#

Amazon Web Services (AWS) offers reliable, scalable, and inexpensive cloud computing services.

More Ways to Use AWS#

Triggers#

New Scheduled Tasks from the AWS API

Creates a Step Function State Machine to publish a message to an SNS topic at a specific timestamp. The SNS topic delivers the message to this Pipedream source, and the source emits it as a new event.

Try it

New SNS Messages from the AWS API

Creates an SNS topic in your AWS account. Messages published to this topic are emitted from the Pipedream source.

Try it

New Inbound SES Emails from the AWS API

The source subscribes to all emails delivered to a specific domain configured in AWS SES. When an email is sent to any address at the domain, this event source emits that email as a formatted event. These events can trigger a Pipedream workflow and can be consumed via SSE or REST API.

Try it

New Deleted S3 File from the AWS API

Emit new event when a file is deleted from a S3 bucket

Try it

New DynamoDB Stream Event from the AWS API

Emit new event when a DynamoDB stream receives new events. See the docs here

Try it

Actions#

CloudWatch Logs - Put Log Event with the AWS API

Uploads a log event to the specified log stream. See docs

Try it

DynamoDB - Create Table with the AWS API

Creates a new table to your account. See docs

Try it

DynamoDB - Execute Statement with the AWS API

This operation allows you to perform transactional reads or writes on data stored in DynamoDB, using PartiQL. See docs

Try it

DynamoDB - Get Item with the AWS API

The Get Item operation returns a set of attributes for the item with the given primary key. If there is no matching item, Get Item does not return any data and there will be no Item element in the response. See docs

Try it

DynamoDB - Put Item with the AWS API

Creates a new item, or replaces an old item with a new item. If an item that has the same primary key as the new item already exists in the specified table, the new item completely replaces the existing item. See docs

Try it