Skip to Content

Azure Data Lake Storage connector for Jitterbit Integration Studio

Summary

The Azure Data Lake Storage connector establishes access to Azure Data Lake Storage.

The Azure Data Lake Storage connector provides an interface for creating an Azure Data Lake Storage connection, the foundation used for generating instances of Azure Data Lake Storage activities. These activities, once configured, interact with Azure Data Lake Storage through the connection.

The Azure Data Lake Storage connector is accessed from the design component palette's Project endpoints and connectors tab (see Design component palette).

Note

This connector can be used only with private agents. In addition, it is a Connector SDK-based connector, which may be referred to by Jitterbit when communicating changes made to connectors built with the Connector SDK.

Connection documentation

In addition to the Azure Data Lake Storage connection, see the comprehensive Azure Data Lake Storage connection details page. Configuration details such as these are included on that page:

  • Getting Started: Initial steps for establishing a connection.
  • Advanced Features: User-defined views and SSL configuration.
  • Data Model: The data model that the connector uses to represent the endpoint.
  • Advanced Configurations Properties: Properties that can be defined to configure a connection for both basic and advanced configurations.

Activity documentation

Together, a specific Azure Data Lake Storage connection and its activities are referred to as an Azure Data Lake Storage endpoint:

Azure Data Lake Storage activity types

  • Query: Retrieves records from a table at Azure Data Lake Storage and is intended to be used as a source in an operation.

  • Execute: Executes a procedure at Azure Data Lake Storage and is intended to be used as a target in an operation.

Prerequisites and supported API versions

The Azure Data Lake Storage connector requires the use of an agent version 10.1 or later. These agent versions automatically download the latest version of the connector when required.

This connector requires the use of a private agent.

Refer to the documentation for information on the schema nodes and fields.

OAuth authentication

OAuth authentication is supported as described in Configure OAuth connections.

Troubleshooting

If you experience issues with the Azure Data Lake Storage connector, these troubleshooting steps are recommended:

  1. Click the Test button in the connection configuration to ensure the connection is successful and to ensure the latest version of the connector is downloaded to the agent (unless using the Disable Auto Connector Update organization policy).

  2. Ensure any Microsoft Entra ID app registrations associated with the connection are not using the deprecated Azure AD Graph.

  3. Check the operation logs for any information written during execution of the operation.

  4. Enable operation debug logging for private agents to generate additional log files and data.

  5. Enable connector verbose logging for this connector using this specific configuration entry of logger name and level:

    <logger name="org.jitterbit.connector.verbose.logging.ADLS" level="TRACE"/>

  6. Check the agent logs for more information.

  7. For additional troubleshooting considerations, see Operation troubleshooting.