Transform Snap Pack

Transform Snaps are essential components in SnapLogic's integration platform used to change, manipulate, and prepare data within pipelines. They serve as the middleware between source and target systems, enabling seamless data transformation and interoperability.

This Snap Pack includes the following key features:

  • Data format conversion: Converts data between various formats like CSV, JSON, XML, and Avro to ensure compatibility across systems. Convert binary data to document data and document data to binary data.
  • Data structuring and manipulation: Perform operations such as:
    • Aggregation of data
    • Apply conditions.
    • Grouping related information
    • Sorting data in specific orders
    • Filtering unwanted records
    • Pivoting data for different analytical views
    • Field mapping between source and target schemas
  • Advanced transformations: Support for encrypting/decrypting fields, parsing incoming data, and applying conditional logic to data processing workflows.
This Snap Pack contains the following Snaps:
Snaps Description
Aggregate Applies aggregate functions on input data using the Group By support. This Snap enables you to calculate an aggregate function on a set of values to return a single scalar value.
Avro Formatter Serializes the incoming SnapLogic document objects into Avro-formatted data.
Avro Parser Deserializes Avro-formatted data into SnapLogic document objects.
AutoPrep Prepares data for analysis, reporting, and machine learning without writing expressions, SQL scripts, or Python code. When you open AutoPrep, it uses introspection on a sample of the input data and calculates the probable data type and valid null handling for each field.
Binary to Document Converts binary data at the input view to document data at the output view.
Conditional Mimics an IF statement in most programming languages. Each row of the conditional table is equivalent to an if/else-if block in an if statement.
Constant Injects a block of text, including pipeline parameters and expression language.
CSV Formatter Reads a document at the input, formats it as CSV based on the specified parameters, and writes CSV data to the output.
CSV Generator

Generates a new CSV document for the next Snap in the pipeline.
CSV Parser Reads CSV binary data from its input view, parses it, and then writes it to its output view as CSV document data.
Decrypt Field Decrypts the input documents using the Passphrase Account with the selected algorithm.
Diff Compares two sorted streams of documents (Original and New) and returns four output streams: Deletions, Insertions, Modified, and Unmodified.
Document to Binary Converts structured document data into binary output, enabling file-style transmission or storage downstream.
Encrypt Field Encrypts specified document fields using a Passphrase Account and algorithm to protect sensitive data.
Excel Formatter Converts incoming documents into XLSX-formatted binary data, writing rows and cells into Excel sheets.
Excel Parser Parses XLSX binary data from input and outputs structured document rows for further processing.
Excel Multi Sheet Formatter Writes multi-sheet Excel XLSX files by mapping input documents to sheet definitions and cell configurations.
Fixed Width Formatter Formats structured documents into fixed-width text records using defined width and alignment settings.
Fixed Width Parser Parses fixed-width text input into structured documents by interpreting field boundaries and lengths.
GeoJSON Parser Parses GeoJSON-formatted binary or text data into structured geomapped SnapLogic document objects.
Group By Fields Groups documents by selected fields and applies aggregate expressions to produce grouped output data.
Group By N Groups incoming documents into fixed-size batches of N items for controlled batch processing.
In-Memory Lookup Performs fast lookup operations against an in-memory table constructed from a document stream.
Join Joins two incoming document streams using inner, left, or right join logic based on key expressions.
JSON Generator Generates new JSON document objects using defined structure and field mappings for downstream Snaps.
JSON Formatter Reads JSON document data and writes it as JSON binary output with optional formatting choices.
JSON Parser Parses JSON binary input and outputs structured JSON document data for further transformations.
JSON Splitter Splits JSON arrays into individual document records, emitting one output document per element.
Mapper Transforms documents using field mapping, expression evaluation, and structure reshaping capabilities.
Pivot Pivots rows into columns or columns into rows, restructuring document datasets dynamically.
Parquet Formatter Converts structured documents into Apache Parquet-formatted columnar binary output efficiently.
Parquet Parser Parses Parquet columnar binary input and outputs structured SnapLogic documents row by row.
Record Replay Captures and replays selected pipeline records for debugging, diagnostics, or controlled testing.
Sort Sorts incoming document streams based on one or more key expressions with ascending or descending order.
Sequence Generates incremental numeric sequences, often used for IDs, counters, or batching metadata.
Structure Restructures document schemas by adding, removing, or reorganizing fields as defined by configuration.
Transcoder Converts data between encodings, such as Base64, UTF-8, or binary-to-text transformations.
XML Formatter Converts document data into XML-formatted binary output using customizable element structures.
XML Generator Generates new XML document structures based on defined mappings and node definitions.
XML Parser Parses XML binary input and outputs structured document objects representing parsed nodes.
Unique Filters incoming documents to emit only unique values based on specified key expressions.
WKT Parser Parses Well-Known Text (WKT) geometric data and converts it into structured geometry documents.
XSLT Applies XSLT transformations to XML input documents, producing transformed XML output.