Salesforce as a source
Select the Salesforce endpoint in the data pipeline wizard or when editing a pipeline to load data from Salesforce. AutoSync uses the Salesforce Bulk API to load data. The Salesforce Bulk API 1.0 limits both queries and ingestion. In Bulk API 2.0, ingest jobs count against the limit, but queries don’t. The type of credentials you provide determine whether AutoSync uses Bulk API 1.0 or 2.0.
Track deleted records
AutoSync can track records deleted in Salesforce by adding an IsDeleted
column to the destination table.
On the first load, AutoSync adds all previously deleted records to the destination with a value of True
in the IsDeleted
column.
On synchronization, AutoSync inserts True
in the IsDeleted
column for records deleted since the last load.
Select the Include deleted records checkbox to enable this behavior when creating or editing an integration.
Ignore constraints
Because Salesforce doesn't strictly enforce constraints, loading errors can occur. Salesforce doesn't prevent a non-nullable field from containing a null value. Target endpoints do not allow nulls in non-nullable columns. In addition, decimal field values do not always fit in the corresponding target type. If you encounter failures for those reasons, check the Ignore constraints checkbox in the credential configuration. When checked, AutoSync loads data as follows:
- Non-nullable field values are loaded to nullable target columns.
- Decimal field values, regardless of precision and scale, are loaded to the target float type with a precision of 8.
Load types
- Full load
- Incremental (insert new, update changed)
- SCD2 (preserve change history)
- SystemModStamp
- LastModifiedDate
- CreatedDate
- LoginTime
Supported account types
To provide connection information, you can enter credentials in AutoSync, Designer, or Classic Manager. Designer and Classic Manager offer multiple account types for most endpoints and not all types are compatible with AutoSync. When you create or edit a data pipeline, the existing credentials list includes only compatible account assets. AutoSync supports the following Designer and Classic Manager account types:
- Salesforce.com Account - Uses Bulk API 1.0
- Salesforce OAuth2 Account - Uses Bulk API 2.0
Known limitations
Known limitations include:
- For efficiency and performance, AutoSync loads Salesforce objects in bulk. The Salesforce Bulk API does not support all object types, refer to Salesforce's documentation for more information.
- For accounts created in Classic Manager, AutoSync only supports the Salesforce.com and Salesforce OAuth2 account types. Other Salesforce account types aren't available to select when you create a data pipeline.
Connection configuration
To use the Salesforce Bulk API 2.0, you must create a Salesforce OAuth2 account asset in Classic Manager. When you save credentials in AutoSync.
- Enter the following properties:
- Credential label: A unique, meaningful name such as
Salesforce-Marketing-Shared
. If a configuration with the same name exists, AutoSync displays anAsset conflict error message
. - Username: A username for an account with the
correct permissions for AutoSync to load and synchronize data. For example,
Salesforce-Marketing-Admin
. - Password: The password for the account. Multiple retries with an invalid password can cause your account to be locked.
- Security token: (Optional) Enter the security token generated during Salesforce account configuration. To create a new security token, log in to your Salesforce account and go to . If you choose not to enter a security token, your Salesforce account must be set up so that this token is optional.
- Login URL: Enter the URL to log
in to Salesforce. For example,
https://login.salesforce.com/
. - Share: (Optional) Select a user group to share this configuration with. Environment admins create user groups to share credentials. If you are a member of a user group, you can select it from the dropdown. You can also select the global shared folder, which shares the credentials with everyone in your environment.
- Credential label: A unique, meaningful name such as
- Validate and save: After saving, AutoSync adds the configuration to the list of saved credentials.
- Include deleted records: Select to have AutoSync track deletions.
- Select objects: After selecting your configuration, choose the objects to synchronize. AutoSync populates the list from your Salesforce account.
- Ignore constraints: Select to have AutoSync load non-nullable fields to null columns and decimals to the corresponding target float type with a precision of 8. Refer to Ignore constraints for more details.