xpna

Appearance

Configuring Source Items ​

Notes:

Data Loading is currently in feature preview and as such documentation for this feature is still work in progress

Contact us to get on the waitlist

Source Items define what specific data to retrieve from each configured source. A single source can have one or more source items, allowing multiple datasets to be loaded from the same connection.

What is a Source Item? ​

A source item specifies the exact location and method for retrieving data from a source. The configuration options for source items depend on the type of source being used.

Adding a Source Item ​

To add a new source item:

  • Navigate to the Source Items section in the Data Loader configuration
  • Click the Add button (plus icon) to add a new source item
  • Select the source that this item belongs to
  • Configure the source item properties based on the source type

Note:

At least one source must be configured before source items can be added.

Source Item Types ​

The type of source item available depends on the configured source type.

SQL Server Source Items ​

For SQL Server sources, source items define which database and table or view to query.

Database and Table ​

The most common SQL Server source item configuration:

Configuration Properties:

  • Database Name: The name of the database on the SQL Server instance
  • Table or View Name: The name of the table or view to query

Data Retrieval:

When this source item is executed, all columns that have not been flagged as hidden in the sample data column configurations and rows from the specified table or view are retrieved.

Custom SQL Query ​

For more advanced scenarios, custom SQL queries can be used:

Configuration:

  • Enter a custom SQL SELECT statement
  • The query can include JOINs, WHERE clauses, and other SQL operations
  • Column names returned by the query are used in the Target mapping

FTP/SFTP Source Items ​

For FTP or SFTP sources, source items define which files to retrieve and how to parse them.

CSV Files ​

Configuration Properties:

  • File Location: The path to the file on the FTP server (e.g., /home/data/*.csv)
  • File Name or Pattern: The specific file name or a pattern to match multiple files (e.g., *.csv)

File Processing:

  • CSV files are parsed automatically
  • The first row is typically treated as column headers
  • Column headers are used in the Target mapping

CSV Upload Source Items ​

For uploaded CSV files, source items specify which uploaded file to use.

Configuration:

  • Click Manage Files to upload CSV files
  • Select the file from the list of uploaded files
  • The file's columns are automatically detected

Supported File Formats:

  • Standard CSV files with comma separators
  • Files with different delimiters may require special handling
  • First row should contain column headers

Testing Source Items ​

After configuring a source item, it is important to test that data can be retrieved:

  • Click the Test button to load sample data
  • A preview of the retrieved data is displayed
  • The preview shows column names and sample rows

Sample Data Display:

The sample data table shows:

  • All columns retrieved from the source
  • A limited number of rows (typically 10-20)
  • Data types and formatting

Note:

Testing source items loads sample data only and does not import data into xpna. This is useful for verifying configuration before running a full data load.

Column Information ​

When sample data is loaded, column information is displayed:

  • Column Name: The name of the column as retrieved from the source
  • Data Type: The detected data type (text, number, datetime)
  • Sample Values: Example values from the retrieved data

This information is used when configuring Targets to map columns to xpna dimensions.

Managing Source Items ​

Once source items are configured:

  • Source items can be edited by clicking on them in the list
  • Source items can be removed by clicking the delete/remove button
  • Each source item is identified by its source and key properties

Note:

Removing a source item will also remove any associated Targets that depend on it.

Common Issues ​

When configuring source items, common issues include:

  • Table Not Found: Verify the database and table names are correct and the user has read permissions
  • File Not Found: Check the file path and name on the FTP server
  • Permission Denied: Ensure the database or FTP user has appropriate read permissions
  • Invalid CSV Format: Verify the CSV file has a header row and valid delimiters

Next Steps ​

After configuring and testing source items, the next step is to configure Targets to map the retrieved data to xpna dimensions and entities.

Copyright © 2025 xpna