Fivetran can simplify SAP data integration to cloud

⇨ Fivetran's connection to SAP NetWeaver allows businesses to perform high-volume, log-based change data capture (CDC) without requiring direct access to the database, optimizing data integration and access to critical business data.

⇨ The integration minimizes disruption to SAP applications and enhances data replication processes, allowing organizations to efficiently manage large initial data loads while focusing on reducing risks and load times.

⇨ Fivetran’s solution comprises two main components: one for communication with SAP applications via Remote Function Call and another as SAP transports that create ABAP functions, simplifying the setup and use of data integrations.

SAP ERP data is central to a company’s business processes and spans across finance, sales, distribution, production planning and more. According to SAP, 99 out of the 100 largest companies run SAP. Therefore, being able to access, combine and analyze data within SAP systems and other data sources can help businesses drive more informed decision-making. 

Often, enterprise data is stored away due to SAP license restrictions and complex data integration solutions that can have an impact on business operations.

NetWeaver Connection

To help businesses overcome these limitations, Fivetran, a cloud-based data integration platform provider, has developed a connection to SAP NetWeaver via the application later to perform high-volume, log-based change data capture (CDC). With this connection, table selection and initial load are handled through the SAP NetWeaver application layer. Access to the database is not required and customers can utilize Fivetran’s log-based CDC with the HANA Runtime license edition.

The integration optimizes initial load during the data replication process and simplifies data integration to ensure visibility and direct access without disruption. CDC has minimal impact on SAP applications as it captures changes independent of the source application. However, the initial data load is crucial during setup,  especially for tables with terabytes of data. After this process, CDC enables organizations to focus on reducing risks to business operations and load time.

Dual components

Fivetran’s connection to SAP NetWeaver consists of two main components. The first enables Fivetran to communicate with the SAP application leveraging Remote Function Call (RFC), where the connection can be made from the capture agent or the Fivetran Hub. SAP’s RFC libraries must be installed wherever Fivetran is connected. The connection to the SAP source can then be configured like any other connection in the Fivetran Hub.

The second component, provided as SAP transports (*.kbr), is installed on the SAP source system. Users can leverage standard SAP transport procedures to upload, check and activate these transports, which create ABAP functions in the Fivetran namespace within SAP. As it doesn’t connect directly to the database, AppConnect does not need a specific database user or schema.

Once the location is set up, users operate the system like other Fivetran SAP sources and targets. Features such as refresh, compare and unpack are compatible with Netweaver connections. The core process of capturing changes from Oracle and HANA database log files, utilizing proprietary log-parsing, remains unchanged. Fivetran encapsulates these changes with minimal latency and impact on the SAP source system.  

Fivetran’s connection to SAP NetWeaver enables enterprises to perform log-based CDC despite limitations for databases managed by SAP applications such as SAP HANA Runtime.