Skip to main content
Artie supports connections through AWS PrivateLink. You can configure PrivateLink directly from the Artie dashboard.

Pre-requisites

  • VPC service
  • Region + availability zone IDs
  • Cross-region enabled if the region is not the same as the specified data plane
1

Open PrivateLink settings

Go to the PrivateLink connections tab under Settings.
2

Submit a request

Request a new endpoint and specify the environment, data plane (if your account uses more than one), VPC service name, AZ IDs, and region.
3

Wait for approval

The status will be “Under review” until an Artie team member approves the request.
4

Accept the endpoint connection

Once approved, Artie initiates a VPC endpoint request to your VPC service and the status changes to “Pending Acceptance”. Accept the endpoint connection in your AWS console under VPC > Endpoint Services > Endpoint Connections.
5

Start using the endpoint

Once accepted, Artie detects the change (checked every 20 minutes), the VPCe DNS will be displayed, and you can create a pipeline using it as the source address.
Artie runs a daily job to verify that all active PrivateLink connections are still connected and working.

FAQ

We have two options when it comes to connecting to multiple databases:
  1. Create one VPC endpoint per database (recommended if it’s extremely high throughput and you would like to have dedicated resources and isolate the traffic)
  2. Create one VPC endpoint and maintain target group mapping for each database in your NLB
Artie supports backfilling from a read-only database. However, if you are using PrivateLink you will want to create a new target group entry for the read-only database.Please see above What if I have multiple databases? for more information.
Aurora and RDS have dynamic IPs and you will need a static IP to add into your NLB target group.Here are common ways to achieve a static IP:
  1. Use a Lambda function that will periodically run dig or nslookup on the database and update the NLB target group with the static IP. (Recommended)
  2. Create an EC2 instance with static IP and do port forwarding