Bulk Load Employee data from a CSV file into a DLP instance

This example explains the scenario where we need the employee data from a CSV file to be fed into a DLP instance so that we can analyze the data.

• Databricks - Bulk Load
• Databricks - Select

Delete employee information from DLP table

This example explains the scenario where we want to delete information of certain employees from an intermediate data location that runs on DLP. We can achieve this through a Pipeline containing the Databricks - Delete Snap.

• Databricks - Delete

Replacing old data in a DLP table with the latest data

This example explains the scenario where the data in a DLP table becomes obsolete every few hours. We need to refresh the data in the table on a frequent basis. To do so, we can create the following Pipeline with only Databricks - Execute Snap.

• Databricks - Execute

Insert data from a Snowflake table into a DLP table

This example explains the scenario where we want to load data available in a Snowflake table into a table in your Databricks instance with the table schema in tact. This example demonstrates how we can use the Databricks - Insert Snap to achieve this result:

• Snowflake - Select
• Databricks - Insert

Updating Employee List in the DLP instance using a CSV file

This example explains the scenario where we have 100 rows of incremental data about employees stored as a CSV file in an S3 location and we need to load this data (insert and update the employee records, as appropriate) into our DLP instance.

• Databricks - Merge Into

Run Job on a Cluster

The following example pipeline demonstrates how to run a job specified in the notebook on a cluster.

• Databricks - Run Job
• Mapper

Inserting data from a Databricks table into a Snowflake table

This example explains the scenario where we want to load data available in a Databricks table into a new table in your Snowflake instance with the table schema in tact. This example demonstrates how we can use the Databricks - Select Snap to achieve this result.

• Databricks - Run Job
• Mapper

Unloading data from a table in DLP to a CSV file

This example explains the scenario where we want to unload the employee data for an organization from a DLP table to a CSV file. Let us see how we can achieve this using the Databricks - Unload Snap.

• Databricks - Unload