AWS Introduces Glue Custom Connector

AWS Glue custom connectors makes it easy to transfer data from SaaS applications and custom data sources to data lake in Amazon S3.

Recently, Amazon announced the availability of AWS Glue custom connectors, which is a new capability in AWS Glue and AWS Glue Studio that makes it convenient for users to transfer data from SaaS applications and custom data sources to their data lake in Amazon S3.

AWS Glue offers you built-in support for the most commonly used data stores using JDBC connections. The solution also enables you to use custom JDBC drivers in your extract, transform, and load (ETL) jobs. And, for data stores that are not natively supported, for example, SaaS applications, you can use connectors.

AWS Glue custom connectors enables you to search and select connectors from the AWS Marketplace - with just a few clicks - and begin your data preparation workflow in minutes.  So, now you can take advantage of connectors for Salesforce, SAP, and Snowflake.

Source: AWS

Glue custom connectors also enables you to build custom connectors and share them across teams, as well as integrate open source Spark connectors and Athena federated query connectors into your data preparation workflows. AWS Partner can develop custom connectors and share them on the AWS Marketplace as well.

The custom connectors integrates with AWS Secrets Managers and simplifies the configuration of credentials. Custom connectors also supports AWS Glue features like bookmarking for processing incremental data, source data filtering, data source authorization, and query response pagination.