Skip to content

Configuring Sources

Notes:

Data Loading is currently in feature preview and as such documentation for this feature is still work in progress

Contact us to get on the waitlist

Sources define where data originates from in a Data Loader configuration. A single Data Loader can be configured with one or more sources, allowing data to be retrieved from multiple locations in a single execution.

What is a Source?

A source represents a connection to an external data system or location, such as:

  • SQL Server databases
  • FTP or SFTP servers
  • A file upload

Each source in a Data Loader configuration is independent and can be of a different type.

Adding a Source

To add a new source to a Data Loader configuration:

  • Navigate to the Sources section in the Data Loader configuration
  • Click the Add button (plus icon) to add a new source
  • Select the source type from the available options
  • Configure the connection properties specific to that source type

Note:

Multiple sources can be added to a single Data Loader configuration, allowing data to be combined from different systems.

Source Types

Data Loaders support several source types, each with specific configuration requirements.

SQL Server

SQL Server sources allow direct connections to Microsoft SQL Server, SQL Azure, and Microsoft Fabric.

Configuration Properties:

  • Host Name: The server address or hostname of the SQL Server instance
  • Port: The port number for the SQL Server connection (default is 1433)
  • User Name: The database user name with appropriate read permissions
  • Password: The password for the database user
  • Additional Connection Properties: Optional connection string properties (e.g., TrustServerCertificate=true;)

Connection String:

The connection properties are used to build a connection string that authenticates to the SQL Server database. Ensure the database user has appropriate permissions to read the required tables or execute queries.

Note:

Ensure firewalls are configured to allow traffic from xpna. For accessing Microsoft SQL Server from xpna, a single originating IP address can be provided for firewall configuration. Contact xpna support via email to support@xpna.com to request the IP address.

FTP/SFTP

FTP sources allow connections to file servers using FTP or SFTP protocols.

Configuration Properties:

  • Host Name: The FTP server address or hostname
  • Connection Type: Select either FTP or SFTP
  • Port: The port number for the connection (default is 21 for FTP, 22 for SFTP)
  • User Name: The FTP user name with appropriate access permissions
  • Password: The password for the FTP user

File Access:

Once connected, files can be accessed from the FTP server in the Source Items configuration.

Note:

Ensure firewalls are configured to allow traffic from xpna. For accessing SFTP on-premise, a single originating IP address can be provided for firewall configuration. Contact xpna support via email to support@xpna.com to request the IP address.

Upload

Upload sources allow files to be uploaded directly from the local system.

Configuration:

  • Select the Upload option
  • Files are uploaded when configuring Source Items
  • Multiple files can be uploaded for different source items

Testing Source Connections

After configuring source properties, it is important to test the connection:

  • Click the Connect or Test button (if available) to verify the connection
  • A successful connection confirms that the credentials and connection properties are correct
  • Connection errors will display specific messages to help troubleshoot the issue

Common Connection Issues:

  • Invalid Credentials: Verify the user name and password are correct
  • Network Access: Ensure the xpna service can reach the server hostname and port
  • Firewall Rules: Check that firewall rules allow connections from xpna
  • SSL/TLS Requirements: For SQL Server, additional connection properties may be needed (e.g., TrustServerCertificate=true;)

Managing Sources

Once sources are configured:

  • Sources can be edited by clicking on them in the sources list
  • Sources can be removed by clicking the delete/remove button
  • Each source is identified by its type and key properties (e.g., hostname)

Note:

Removing a source will also remove any associated Source Items and Targets that depend on it.

Next Steps

After configuring sources, the next step is to define Source Items that specify what data to retrieve from each source.