ELT Load Snap

reads/fetches/writes/parses/executes/transforms/calls/creates ....

Overview

ELT Load reads/fetches/writes/parses/executes/transforms/calls/creates ....

Use this Snap to ...

Prerequisites

None.

Limitations and known issues

None.

Snap views

View Description Examples of upstream and downstream Snaps
Input Examples:
Output Examples:
Error

Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter when running the pipeline by choosing one of the following options from the When errors occur list under the Views tab. The available options are:

  • Stop Pipeline Execution Stops the current pipeline execution when the Snap encounters an error.
  • Discard Error Data and Continue Ignores the error, discards that record, and continues with the remaining records.
  • Route Error Data to Error View Routes the error data to an error view without stopping the Snap execution.

Learn more about Error handling in Pipelines.

Snap settings

Note:
  • Suggestion icon (): Indicates a list that is dynamically populated based on the configuration.
  • Expression icon (): Indicates whether the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.
  • Add icon (): Indicates that you can add fields in the field set.
  • Remove icon (): Indicates that you can remove fields from the field set.
Field / Field set Type Description
Label String Required. Specify a unique name for the Snap. Modify this to be more appropriate, especially if there are more than one of the same Snap in the pipeline.
Snap execution Dropdown list Select one of the three modes in which the Snap executes.
Available options are:
  • Validate & Execute. Performs limited execution of the Snap and generates a data preview during pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during pipeline runtime.
  • Execute only. Performs full execution of the Snap during pipeline execution without generating preview data.
  • Disabled. Disables the Snap and all Snaps that are downstream from it.

Troubleshooting

File read error while uploading data from a CSV file.

The source CSV file contains a header row which the target database cannot recognize or interpret.

Depending on your target database, use the respective File Format Option in the ELT Load Snap.
  • For Snowflake: SKIP_HEADER = 1
  • For Azure Synapse: FIRSTROW = 2
  • For Databricks Lakehouse Platform: 'header' = 'true'
  • For Google BigQuery: skip_leading_rows = 1
  • For Redshift: IGNOREHEADER 1

When expanding the suggested list for the Schema Name or Target Table Name field: Database cannot be blank

You have not specified a valid value for the Database Name field in this Snap.

Specify the target Database Name in this Snap.

Time '"01:01:23"' is not recognized.

The CSV file you are trying to load into the Snowflake database contains single or double quotes for time and/or date values. Hence, the ELT Load Snap is unable to read and insert these values into the target table.

After you specify the CSV files in the ELT Load Snap’s settings, add an entry in the File Format Options field set with one of the following values to match the quotes used in the CSV files for date and/or time values in it:
  • FIELD_OPTIONALLY_ENCLOSED_BY='\''
  • FIELD_OPTIONALLY_ENCLOSED_BY='\"'

The Snap would then ignore these quotes used for the values in the CSV files.

SQL exception from Snowflake: Syntax error in one or more positions in the SQL query.

Improper casing in column names.

Column names in Snowflake tables are case-sensitive. It stores all columns in uppercase unless they are surrounded by quotes during the time of creation in which case the exact casing is preserved. Learn more: Identifier Requirements — Snowflake Documentation.

Follow the same casing for the column table names across the Pipeline.

Symptom or actual error message

...

...

Can be a div, instead of a p, if you need multiple paragraphs.

Symptom or actual error message

...

...

Can be a div, instead of a p, if you need multiple paragraphs.

Symptom or actual error message

...

...

Can be a div, instead of a p, if you need multiple paragraphs.

Symptom or actual error message

...

...

Can be a div, instead of a p, if you need multiple paragraphs.