Snaps

Key New Features

  • Snap Packs with new Snaps:
    • Amazon S3
    • Azure Synapse SQL
    • Marketo
Note: Read about the Snap features and fixes deployed in the October Dot Releases, which are part of the current GA version.

New Snaps

Amazon S3 Snap Pack

Introduced the following Snaps:

  • S3 Archive: Enables you to archive or change the storage class of an S3 object.
  • S3 Restore: Enables you to restore an archived S3 object.
  • S3 Select: Enables you to retrieve a subset of data from an S3 object.
Azure Synapse SQL Snap Pack

Azure Synapse SQL is an analytics service from Microsoft that enables querying data to create, update, insert, or delete data in the Azure Synapse SQL. This Snap Pack offers the following Snaps:

Note: This Snap Pack uses the 11.2x driver by default. If you specify any specific driver, ensure that you provide a version higher than 9.1 for compatibility with Microsoft Authentication Library for JAVA, as this Snap Pack uses the MSAL4J; otherwise, you may run into issues.
Marketo Snap Pack

Introduced the following Snaps to manage bulk export and import in Marketo:

Enhancements

  • The Azure Active Directory List Users, Azure Active Directory Get Group Members, and Azure Active Directory Get Role Members Snaps now include the Display Properties field, which allows you to enter the properties that you want to view in the output.
  • The Azure SQL Snap Pack uses the 11.2x driver by default. If you specify any specific driver, ensure that you provide a version higher than 9.1 that is compatible with Microsoft Authentication Library for Java, as this Snap Pack uses the MSAL4J; otherwise, you may run into issues.
  • The AWS S3 and S3 Dynamic accounts now support a maximum session duration of an IAM role defined in AWS.
  • Exchange Online:
    • The Exchange Online OAuth2 User Account now does not encounter an Access Denied (403) error. Now only the current user details are fetched when you do not have User.Read.All permission in your permissions scope.
    • The Exchange Online Read Email Snap now shows the email folder suggestions and includes the subfolders' names successfully by prefixing the parent folder name with the / delimiter.
    • The Exchange Online Read Email Snap now downloads the inline attachments correctly when you select the Download attachments checkbox. The Snap now shows the email folder suggestions and includes the subfolder names by prefixing the parent folder name with the delimiter (/). For example, custom/subfolder.
    • The Send Email Snap supports sending the HTML Table in the email body using the following fields:
      • HTML Table option under Email type
      • Table Data Path
      • Batch Size
  • Eloqua
    • The Eloqua Snaps now include the Pass through checkbox, which enables the Snap to pass the input document to the output view under the key original.
    • The Custom Object Metadata ID field in the Eloqua Create Snap allows you to specify an ID for creating custom object data. This conditional field appears only when you select Custom Object Data as the Core object type.
  • The Excel Formatter and Excel Multi Sheet Formatter Snaps now include a Convert formula strings to formulas checkbox.
  • The HTTP Client Snap now accepts the default value */* for the Accept header, which communicates to the server that the Snap can handle all forms of response content types.
  • The Mapper Snap now has a Sorted checkbox in the Input Schema and Target Schema panels, which allows you to sort the input and target schemas. When unchecked, the Snap unsorts the input and the target schema.
  • Marketo
    • The Asset Write Snap now supports special characters.
    • The Asset Read, Asset Write, Lead Read, and Lead Write Snaps now have a new field set, Query Parameters, which enables you to define additional parameters for retrieving the asset details.
      Note: Ensure that the query parameters are unique and not defined in both input documents and properties.
  • The PostgreSQL - Bulk Load Snap can now process the records with more than 16 KB in the document without encountering the BufferOverflowException because the default value of 16 KB for byte buffer size is now removed.
  • The S3 Browser Snap output now includes the Storage Class field, which indicates the archived status of the S3 object.
  • The Snowflake - Bulk Load Snap now routes the 403-Access Denied error to the error view (when the error view is enabled) when you do not have DeleteObject permission to delete the temporary files in the S3 bucket.
  • The Salesforce Bulk Query Snap now includes the following checkboxes:
    • Match Data Type: Select this checkbox to match the data types of the bulk query job results.
    • Object Type: This option appears on selecting the Match Data Type checkbox.
    • Include Deleted Records: Select this checkbox to include deleted records in the query result.
  • The SQL Server - Select Snap now has the Convert rowversion datatype to integer checkbox to support the ROWVERSION datatype. Select this checkbox to display the Rowversion datatype as integers in the output.

Fixed Issues

  • Fixed the following issues in the Snowflake - Bulk Load Snap:
    • The Snap failed when the Preserve case sensitivity field was not selected and the column names in the input document and the target table were the same but the cases were different. Now, the Snap does not fail and loads the data correctly to the target table.
    • The Snap created a table when it did not exist with multiple columns in the target table when there were two input views, but the column name cases were different in both views. Now, the Snap creates the table from the metadata provided by the second input view and loads the data into the target table from the first input view.
  • The Generic JDBC - Insert Snap previously took a long time to execute and was aborted after a few minutes, which affected the performance of the Snap. Now the Snap takes less time for execution.
  • MySQL Insert, Oracle Insert, PostgreSQL Insert, Redshift Insert, Snowflake Insert, and SQL Server - Insert: These Database Insert Snaps now create the target table only from the table metadata of the second input view when the following conditions are met:
    • The Create table if not present checkbox is selected.
    • The target table does not exist.
    • The table metadata is provided in the second input view.
  • The S3 Download Snap no longer fails even when the Pipeline has multiple Snaps after 430patches18348.

Known Issues

  • Marketo does not support some special characters (for example, (𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴).

Upcoming

The following changes are scheduled for release in 2023 February:

  • MySQL Snap Pack: The default JAR file of the MySQL Database account does not support connectivity to MYSQL8. To connect to MYSQL8, you must upload a compatible mysql-connector (v.5.1.47 or v8) JAR. In the upcoming February Release, we will upgrade the default MySQL JAR bundled with the MySQL Snap to the latest version that is backward compatible and able to connect to MySQL 8. Learn more about version compatibility in this MySQL article.