Harness Zero Copy knowledge sharing from Salesforce Information Cloud to Amazon Redshift for Unified Analytics – Half 1

This publish is co-authored by Rajkumar Irudayaraj, Sr. Director of Product, Salesforce Information Cloud.

In at present’s ever-evolving enterprise panorama, organizations should harness and act on knowledge to gas analytics, generate insights, and make knowledgeable choices to ship distinctive buyer experiences. Salesforce and Amazon have collaborated to assist prospects unlock worth from unified knowledge and speed up time to insights with bidirectional Zero Copy knowledge sharing between Salesforce Information Cloud and Amazon Redshift.

In a earlier publish, we confirmed how Zero Copy knowledge federation empowers companies to entry Amazon Redshift knowledge throughout the Salesforce Information Cloud to counterpoint buyer 360 knowledge with operational knowledge. This two-part sequence explores how analytics groups can entry buyer 360 knowledge from Salesforce Information Cloud inside Amazon Redshift to generate insights on unified knowledge with out the overhead of extract, rework, and cargo (ETL) pipelines. On this publish, we cowl knowledge sharing between Salesforce Information Cloud and prospects’ AWS accounts in the identical AWS Area. Half 2 covers cross-Area knowledge sharing between Salesforce Information Cloud and prospects’ AWS accounts.

What’s Salesforce Information Cloud?

Salesforce Information Cloud is an information platform that unifies your entire firm’s knowledge into Salesforce’s Einstein 1 Platform, giving each staff a 360-degree view of the shopper to drive automation, create analytics, personalize engagement, and energy trusted synthetic intelligence (AI). Salesforce Information Cloud creates a holistic buyer view by turning volumes of disconnected knowledge right into a unified buyer profile that’s simple to entry and perceive. This unified view helps your gross sales, service, and advertising groups construct customized buyer experiences, invoke data-driven actions and workflows, and safely drive AI throughout all Salesforce functions.

What’s Amazon Redshift?

Amazon Redshift is a quick, absolutely managed, petabyte-scale knowledge warehouse service that makes it easy and cost-effective to effectively analyze all of your knowledge utilizing your current enterprise intelligence (BI) instruments. It’s optimized for datasets starting from a couple of hundred gigabytes to petabytes and delivers higher price-performance in comparison with different knowledge warehousing options. With a completely managed, AI-powered, massively parallel processing (MPP) structure, Amazon Redshift makes enterprise decision-making fast and cost-effective. Amazon Redshift Spectrum allows querying structured and semi-structured knowledge in Amazon Easy Storage Service (Amazon S3) with out having to load the info into Redshift tables. Redshift Spectrum integration with AWS Lake Formation allows querying auto-mounted AWS Glue Information Catalog tables with AWS Id and Entry Administration (IAM) credentials and harnessing Lake Formation for permission grants and entry management insurance policies on Information Catalog views. Salesforce Information Cloud Information sharing with Amazon Redshift leverages AWS Glue Information Catalog assist for multi-engine views and Redshift Spectrum integration with Lake Formation.

What’s Zero Copy knowledge sharing?

Zero Copy knowledge sharing allows Amazon Redshift prospects to question buyer 360 knowledge saved in Salesforce Information Cloud with out the necessity for conventional ETL to maneuver or copy the info. As a substitute, you merely join and use the info in place, unlocking its worth instantly with on demand entry to the latest knowledge. Information sharing is supported with each Amazon Redshift Serverless and provisioned RA3 clusters. Information could be shared with a Redshift Serverless or provisioned cluster in the identical Area or with a Redshift Serverless cluster in a unique Area. To get an outline of Salesforce Zero Copy integration with Amazon Redshift, please check with this Salesforce Weblog.

Answer overview

Salesforce Information Cloud supplies a point-and-click expertise to share knowledge with a buyer’s AWS account. On the Lake Formation console, you’ll be able to settle for the info share, create the useful resource hyperlink, mount Salesforce Information Cloud objects as knowledge catalog views, and grant permissions to question the dwell and unified knowledge in Amazon Redshift.

The next diagram depicts the end-to-end course of concerned for sharing Salesforce Information Cloud knowledge with Amazon Redshift in the identical Area utilizing a Zero Copy structure. This structure follows the sample documented in Cross-account knowledge sharing greatest practices and issues.

The info share setup consists of the next high-level steps:

1. The Salesforce Information Cloud admin creates the info share goal with the goal account for the info share.
2. The Salesforce Information Cloud admin selects the info cloud objects to be shared with Amazon Redshift and creates an information share.
3. The Salesforce Information Cloud admin hyperlinks the info share to the info share goal, which invokes the next operations to create a cross-account useful resource share:
   1. Create a Information Catalog view for the Salesforce Information Cloud Apache Iceberg tables by invoking the Catalog API.
   2. Use Lake Formation sharing to create a cross-account Information Catalog share.
4. Within the buyer AWS account, the Lake Formation admin logs in to the Lake Formation console to simply accept the useful resource share, create a useful resource hyperlink, and grant entry permissions to the Redshift function.
5. The info analyst launches the Amazon Redshift Question Editor with the suitable function to question the info share and be part of with native Redshift tables.

Conditions

The next are the stipulations to allow knowledge sharing:

• A Salesforce Information Cloud account.
• An AWS account with AWS Glue and Lake Formation enabled.
• Both a Redshift Serverless or a Redshift provisioned cluster with RA3 occasion varieties (ra3.16xlarge, ra3.4xlarge, ra3.xlplus). Information sharing isn’t supported for different provisioned occasion varieties like DC2 or DS2 and have to be arrange earlier than accessing the info share. If you happen to don’t have an current provisioned Redshift RA3 cluster, we advocate utilizing a Redshift Serverless namespace for ease of operations and upkeep.
• The Amazon Redshift service have to be working in the identical Area the place the Salesforce Information Cloud is working.
• AWS admin roles for Lake Formation and Amazon Redshift:

Create the info share goal

Full the next steps to create the info share goal:

1. In Salesforce Information Cloud, select App Launcher and select Information Share Targets.
   

2. Select New and select Amazon Redshift, then select Subsequent.
   

3. Enter the small print for Label, API Title, and Account for the info share goal.
4. Select Save.

After you save these settings, the S3 Tenant Folder worth is populated.

5. Select the S3 Tenant Folder hyperlink and duplicate the verification token.

If you happen to’re not signed in to the AWS Administration Console, you’ll be redirected to the login web page.

6. Enter the verification token and select Save.
   

The info share goal turns to lively standing.

Create an information share

Full the next steps to create an information share:

1. Navigate to the Information Share tab in your Salesforce org.
2. Select App Launcher and select Information Shares.
   

Alternatively, you’ll be able to navigate to the Information Share tab out of your org’s dwelling web page.

3. Select New, then select Subsequent.
   

4. Present a label, title, knowledge house, and outline, then select Subsequent.
   

5. Choose the objects to be included within the share and select Save.
   

Hyperlink the info share goal to the info share

To hyperlink the info share goal to the info share, full the next steps:

1. On the info share report dwelling web page, select Hyperlink/Unlink Information Share Goal.
2. Choose the info share goal you wish to hyperlink to the info share and select Save.
   

The info share have to be lively earlier than you’ll be able to settle for the useful resource share on the Lake Formation console.

Settle for the info share in Lake Formation

This part supplies the detailed steps for accepting the info share invite and configuration steps to mount the info share with Amazon Redshift.

1. After the info share is efficiently linked to the info share goal, navigate to the Lake Formation console.

The info share invitation banner is displayed.

2. Select Settle for and create.
   

The Settle for and create web page exhibits a useful resource hyperlink and supplies the choice to arrange IAM permissions.

3. Within the Principals part, select the IAM customers and roles to grant the default permissions (describe and choose) for the info share useful resource hyperlink.
   

4. Select Create.
   

The useful resource hyperlink created within the earlier step seems subsequent to the AWS Glue database useful resource share on the Lake Formation console.

Question the info share from Redshift Serverless

Launch the question editor for Redshift Serverless and log in as a federated person with the function that has describe and choose permissions for the useful resource hyperlink.

The info share tables are auto-mounted, seem below awsdatacatalog, and could be queried as proven within the following screenshot.

Question the info share from the Redshift provisioned cluster

To question the info share from the Redshift provisioned cluster, log in to the provisioned cluster because the superuser.

On an editor tab, run the next SQL assertion to grant an IAM person entry to the Information Catalog:

GRANT USAGE ON DATABASE awsdatacatalog to "IAM:myIAMUser"

IAM:myIAMUser is an IAM person that you just wish to grant utilization privilege to the Information Catalog. Alternatively, you’ll be able to grant utilization privilege to IAMR:myIAMRole for an IAM function. For extra particulars, check with Querying the AWS Glue Information Catalog.

Log in because the person with the function from the earlier step utilizing non permanent credentials.

You need to be capable of develop awsdatacatalog and question the info share tables as proven within the following screenshot.

Conclusion

Zero Copy knowledge sharing between Salesforce Information Cloud and Amazon Redshift represents a major development in how organizations can use their buyer 360 knowledge. By eliminating the necessity for knowledge motion, this strategy presents real-time insights, diminished prices, and enhanced safety. As companies proceed to prioritize data-driven decision-making, Zero Copy knowledge sharing will play an important function in unlocking the complete potential of buyer knowledge throughout platforms.

This integration empowers organizations to interrupt down knowledge silos, speed up analytics, and drive extra agile customer-centric methods. To be taught extra, check with the next assets:

In regards to the Authors

Rajkumar Irudayaraj is a Senior Product Director at Salesforce with over 20 years of expertise in knowledge platforms and companies, with a ardour for delivering data-powered experiences to prospects.

Jason Berkowitz is a Senior Product Supervisor with AWS Lake Formation. He comes from a background in machine studying and knowledge lake architectures. He helps prospects turn out to be data-driven.

Ravi Bhattiprolu is a Senior Companion Options Architect at AWS. Ravi works with strategic ISV companions, Salesforce and Tableau, to ship progressive and well-architected merchandise & options that assist joint prospects obtain their enterprise and technical targets.

Avijit Goswami is a Principal Options Architect at AWS specialised in knowledge and analytics. He helps AWS strategic prospects in constructing high-performing, safe, and scalable knowledge lake options on AWS utilizing AWS managed companies and open supply options. Outdoors of his work, Avijit likes to journey, hike, watch sports activities, and hearken to music.

Ife Stewart is a Principal Options Architect within the Strategic ISV phase at AWS. She has been engaged with Salesforce Information Cloud during the last 2 years to assist construct built-in buyer experiences throughout Salesforce and AWS. Ife has over 10 years of expertise in know-how. She is an advocate for range and inclusion within the know-how subject.

Michael Chess is a Technical Product Supervisor at AWS Lake Formation. He focuses on enhancing knowledge permissions throughout the info lake. He’s captivated with making certain prospects can construct and optimize their knowledge lakes to fulfill stringent safety necessities.

Mike Patterson is a Senior Buyer Options Supervisor within the Strategic ISV phase at AWS. He has partnered with Salesforce Information Cloud to align enterprise targets with progressive AWS options to realize impactful buyer experiences. In his spare time, he enjoys spending time together with his household, sports activities, and outside actions.