Snaps
Key New Features
- Snap Packs with new Snaps:
- Amazon S3
- Azure Synapse SQL
- Marketo
Note: Read about the Snap features and fixes deployed in the
October Dot Releases,
which are part of the current GA version.
New Snaps
Amazon S3 Snap Pack
Introduced the following Snaps:
- S3 Archive: Enables you to archive or change the storage class of an S3 object.
- S3 Restore: Enables you to restore an archived S3 object.
- S3 Select: Enables you to retrieve a subset of data from an S3 object.
Azure Synapse SQL Snap Pack
Azure Synapse SQL is an analytics service from Microsoft that enables querying data to create, update, insert, or delete data in the Azure Synapse SQL. This Snap Pack offers the following Snaps:
- Azure Synapse SQL Bulk Load: Enables you to perform a bulk load operation from an external loction to the target table.
- Azure Synapse SQL Delete: Enables you to delete records from the target tables.
- Azure Synapse SQL Execute: Enables you to execute SQL queries.
- Azure Synapse SQL Insert: Enables you to insert new records into the target tables.
- Azure Synapse SQL Select: Enables you to fetch data from an Azure Synapse SQL Server database.
- Azure Synapse SQL Stored Procedure: Enables you to execute stored procedures in the Azure Synapse SQL database.
- Azure Synapse SQL Table List: Enables you to read data from Azure Synapse SQL and list the tables.
- Azure Synapse SQL Update: Enables you to to update existing records in the target tables with the specified conditions.
Note: This Snap Pack uses the 11.2x driver by default.
If you specify any specific driver, ensure that you provide a version higher than 9.1 for compatibility with Microsoft Authentication Library for JAVA, as this Snap Pack uses the MSAL4J; otherwise, you may run into issues.
Marketo Snap Pack
Introduced the following Snaps to manage bulk export and import in Marketo:
- Marketo Bulk Extract: Enables you to extract the specific entity from Marketo.
- Marketo Bulk Import: Enables you to import the specific entity from Marketo.
Enhancements
- The Azure Active Directory List Users, Azure Active Directory Get Group Members, and Azure Active Directory Get Role Members Snaps now include the Display Properties field, which allows you to enter the properties that you want to view in the output.
- The Azure SQL Snap Pack uses the 11.2x driver by default. If you specify any specific driver, ensure that you provide a version higher than 9.1 that is compatible with Microsoft Authentication Library for Java, as this Snap Pack uses the MSAL4J; otherwise, you may run into issues.
- The AWS S3 and S3 Dynamic accounts now support a maximum session duration of an IAM role defined in AWS.
- Exchange Online:
- The Exchange Online OAuth2 User Account
now does not encounter an
Access Denied (403)
error. Now only the current user details are fetched when you do not haveUser.Read.All
permission in your permissions scope. - The Exchange Online Read Email Snap
now shows the email folder suggestions and includes the subfolders' names successfully by prefixing the parent folder name with the
/
delimiter. - The Exchange Online Read Email Snap
now downloads the inline attachments correctly when you select the Download attachments checkbox.
The Snap now shows the email folder suggestions and includes the subfolder names by prefixing the parent folder name with the delimiter (
/
). For example,custom/subfolder
. - The Send Email Snap
supports sending the HTML Table in the email body using the following fields:
- HTML Table option under Email type
- Table Data Path
- Batch Size
- The Exchange Online OAuth2 User Account
now does not encounter an
- Eloqua
- The Eloqua Snaps
now include the Pass through checkbox, which enables the Snap to pass the input document to the output view under the key
original
. - The Custom Object Metadata ID field in the Eloqua Create Snap allows you to specify an ID for creating custom object data. This conditional field appears only when you select Custom Object Data as the Core object type.
- The Eloqua Snaps
now include the Pass through checkbox, which enables the Snap to pass the input document to the output view under the key
- The Excel Formatter and Excel Multi Sheet Formatter Snaps now include a Convert formula strings to formulas checkbox.
- The HTTP Client Snap
now accepts the default value
*/*
for theAccept
header, which communicates to the server that the Snap can handle all forms of response content types. - The Mapper Snap now has a Sorted checkbox in the Input Schema and Target Schema panels, which allows you to sort the input and target schemas. When unchecked, the Snap unsorts the input and the target schema.
- Marketo
- The Asset Write Snap now supports special characters.
- The Asset Read,
Asset Write,
Lead Read, and
Lead Write Snaps
now have a new field set, Query Parameters, which enables you to define additional parameters for retrieving the asset details.
Note: Ensure that the query parameters are unique and not defined in both input documents and properties.
- The PostgreSQL - Bulk Load Snap
can now process the records with more than 16 KB in the document without encountering the
BufferOverflowException
because the default value of 16 KB for byte buffer size is now removed. - The S3 Browser Snap output now includes the Storage Class field, which indicates the archived status of the S3 object.
- The Snowflake - Bulk Load Snap
now routes the
403-Access Denied
error to the error view (when the error view is enabled) when you do not haveDeleteObject
permission to delete the temporary files in the S3 bucket. - The Salesforce Bulk Query Snap now includes the following checkboxes:
- Match Data Type: Select this checkbox to match the data types of the bulk query job results.
- Object Type: This option appears on selecting the Match Data Type checkbox.
- Include Deleted Records: Select this checkbox to include deleted records in the query result.
- The SQL Server - Select Snap now has the Convert rowversion datatype to integer checkbox to support the ROWVERSION datatype. Select this checkbox to display the Rowversion datatype as integers in the output.
Fixed Issues
- Fixed the following issues in the Snowflake - Bulk Load Snap:
- The Snap failed when the Preserve case sensitivity field was not selected and the column names in the input document and the target table were the same but the cases were different. Now, the Snap does not fail and loads the data correctly to the target table.
- The Snap created a table when it did not exist with multiple columns in the target table when there were two input views, but the column name cases were different in both views. Now, the Snap creates the table from the metadata provided by the second input view and loads the data into the target table from the first input view.
- The Generic JDBC - Insert Snap previously took a long time to execute and was aborted after a few minutes, which affected the performance of the Snap. Now the Snap takes less time for execution.
- MySQL Insert,
Oracle Insert,
PostgreSQL Insert,
Redshift Insert,
Snowflake Insert,
and SQL Server - Insert:
These Database Insert Snaps now create the target table only from the table metadata of the second input view when the following conditions are met:
- The Create table if not present checkbox is selected.
- The target table does not exist.
- The table metadata is provided in the second input view.
- The S3 Download Snap no longer fails even when the Pipeline has multiple Snaps after 430patches18348.
Known Issues
- Marketo
does not support some special characters (for example, (
𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴
).
Upcoming
The following changes are scheduled for release in 2023 February:
- MySQL Snap Pack: The default JAR file of the MySQL Database account does not support connectivity to MYSQL8. To connect to MYSQL8, you must upload a compatible mysql-connector (v.5.1.47 or v8) JAR. In the upcoming February Release, we will upgrade the default MySQL JAR bundled with the MySQL Snap to the latest version that is backward compatible and able to connect to MySQL 8. Learn more about version compatibility in this MySQL article.