Flat File External Source Settings

DataSync allows connecting to local and remote CSV resources. Set the URI property to the CSV resource location, in addition to any other properties necessary to connect to your data source.

Basic authentication

	Local	HTTP or HTTPs	SharePoint Online SOAP	FTP or FTPS	SFTP
URI Formats	localPath file://localPath	http://remoteStream https://remoteStream	sp://remotePath	ftp://server:port/remotePath ftps://server:port/remotepath	sftp://server:port/remotePath
User		OPTIONAL	REQUIRED	REQUIRED	OPTIONAL
Password		OPTIONAL	REQUIRED	REQUIRED	OPTIONAL
AuthScheme		OPTIONAL

Amazon

	Amazon S3
URI Formats	s3://remotePath
AWSAccessKey	REQUIRED (your AccessKey)
AWSSecretKey	REQUIRED (your SecretKey)
AWSRegion	OPTIONAL

Azure

	Azure Blob Storage	Azure Data Lake Store Gen1	Azure Data Lake Store Gen2	Azure Data Lake Store Gen2 with SSL
URI Formats	azureblob://mycontainer/myblob/	adl://remotePath adl://Account.azuredatalakestore.net@remotePath	abfs://myfilesystem/remotePath	abfss://myfilesystem/remotePath
InitiateOAuth		REQUIRED
OAuthClientId		OPTIONAL
OAuthClientSecret		OPTIONAL
OAuthAccessToken		OPTIONAL
AuthScheme		REQUIRED
AzureAccount	REQUIRED	REQUIRED	REQUIRED	REQUIRED
AzureAccessKey	REQUIRED (your AccessKey)		REQUIRED (your AccessKey)	REQUIRED (your AccessKey)

OAuth

	Google Drive	OneDrive	Box	Dropbox	SharePoint Online REST	Google Cloud Storage
URI Formats	gdrive://remotePath	onedrive://remotePath	box://remotePath	dropbox://remotePath	sprest://remotePath	gs://bucket/remotePath;
InitiateOAuth	OPTIONAL	OPTIONAL	OPTIONAL	OPTIONAL	OPTIONAL	OPTIONAL
OAuthClientId	OPTIONAL	OPTIONAL	REQUIRED	REQUIRED	OPTIONAL	OPTIONAL
OAuthClientSecret	OPTIONAL	OPTIONAL	REQUIRED	REQUIRED	OPTIONAL	OPTIONAL
OAuthAccessToken	OPTIONAL	OPTIONAL	OPTIONAL	OPTIONAL	OPTIONAL	OPTIONAL
OAuthAccessTokenSecret	OPTIONAL	OPTIONAL	OPTIONAL	OPTIONAL		OPTIONAL
AuthScheme	REQUIRED	REQUIRED	REQUIRED	REQUIRED	REQUIRED	REQUIRED
ProjectId						REQUIRED

Others

	Wasabi	Oracle Cloud Storage
URI Formats	wasabi://bucket1/remotePath;	os://bucket/remotePath;
AccessKey	REQUIRED (your AccessKey)	REQUIRED (your AccessKey)
SecretKey	REQUIRED (your SecretKey)	REQUIRED (your SecretKey)
Region	OPTIONAL	OPTIONAL
OracleNamespace		REQUIRED

Connecting to Local Files

Set the URI to a folder containing CSV files.

Below is an example connection string:

URI=C:\folder1;

You can also connect to multiple CSV files which share the same schema. Below is an example connection string:

URI=C:\folder; AggregateFiles=True;

If you would prefer to expose all of the individual CSV files as tables instead, leave this property False.

URI=C:\folder; AggregateFiles=False;

Connecting to HTTP CSV Streams

Set the URI to the HTTP or HTTPS URL of the CSV resource you want to access as a table. For example:

URI=http://www.host1.com/streamname1;

To authenticate, set AuthScheme and the corresponding properties. Specify additional headers in CustomHeaders to modify the query string, set CustomUrlParams.

To query the CSV stream, reference streamedtable as the table name.

SELECT * FROM streamedtable

Connecting to Amazon S3

Set the URI to the bucket and folder. Additionally, set the following properties to authenticate:

• AWSAccessKey: Set this to an Amazon Web Services Access Key (a username).

• AWSSecretKey: Set this to an Amazon Web Services Secret Key.

For example:

URI=s3://bucket1/folder1; AWSAccessKey=token1; AWSSecretKey=secret1; AWSRegion=OHIO;

Optionally, specify AWSRegion in addition.

Connect to Azure Blob Storage

Set the URI to the name of your container and the name of the blob. Additionally, set the following properties to authenticate:

• AzureAccount: Set this to the account associated with the Azure blob.

• AzureAccessKey: Set this to the access key associated with the Azure blob.

For example:

URI=azureblob://mycontainer/myblob/; AzureAccount=myAccount; AzureAccessKey=myKey;

Connect to Azure Data Lake Store Gen 2

Set the URI to the name of the file system and the name of the folder which contacts your CSV files. Additionally, set the following properties to authenticate:

• AzureAccount: Set this to the account associated with the Azure data lake store.

• AzureAccessKey: Set this to the access key associated with the Azure data lake store.

For example:

URI=abfs://myfilesystem/folder1; AzureAccount=myAccount; AzureAccessKey=myKey;

URI=abfss://myfilesystem/folder1; AzureAccount=myAccount; AzureAccessKey=myKey;

Connecting to Box

Set the URI to the path to a folder containing CSV files. To authenticate to Box, use the OAuth authentication standard. See Connecting to Box for an authentication guide.

For example:

URI=box://folder1; InitiateOAuth=GETANDREFRESH; OAuthClientId=oauthclientid1; OAuthClientSecret=oauthcliensecret1; CallbackUrl=http://localhost:12345;

Connecting to Dropbox

Set the URI to the path to a folder containing CSV files. To authenticate to Dropbox, use the OAuth authentication standard. You can authenticate with a user account or a service account. In the user account flow, you do not need to set any connection properties for your user credentials, as shown in the connection string below:

URI=dropbox://folder1/; InitiateOAuth=GETANDREFRESH; OAuthClientId=oauthclientid1; OAuthClientSecret=oauthcliensecret1; CallbackUrl=http://localhost:12345;

Connecting to SharePoint Online SOAP

Set the URI to a document library containing CSV files. To authenticate, set User and Password and SharepointUrl.

For example:

URI=sp://Documents/folder1; User=user1; Password=password1; SharepointUrl=https://subdomain.sharepoint.com;

Connecting to SharePoint Online REST

Set the URI to a document library containing CSV files. SharepointUrl is optional. If not provided, the driver will work with the root drive. To authenticate, use the OAuth authentication standard.

For example:

URI=sp://Documents/folder1; InitiateOAuth=GETANDREFRESH; SharepointUrl=https://subdomain.sharepoint.com;

Connecting to FTP

Set the URI to the address of the server followed by the path to the folder to be used as the root folder. To authenticate, set User and Password.

For example:

URI=ftps://localhost:990/folder1; User=user1; Password=password1;

Connecting to Google Cloud Storage

Set the URI to the path to the name of the file system and the name of the folder which contacts your CSV files. To authenticate to Google APIs, provide a ProjectId.

For example:

URI=gs://bucket/remotePath/; ProjectId=PROJECT_ID;

Connecting to Oracle Cloud Object Storage

Set the URI to the bucket and folder. Additionally, set the following properties to authenticate:

• AccessKey: Set this to an Oracle cloud Access Key.

• SecretKey: Set this to an Oracle cloud Secret Key.

• OracleNamespace: Set this to an Oracle cloud namespace.

For example:

URI=os://bucket/remotePath/; AccessKey=token1; SecretKey=secret1; OracleNamespace=myNamespace; Region=us-ashburn-1;

Optionally, specify Region in addition.

Connecting to Wasabi

Set the URI to the bucket and folder. Additionally, set the following properties to authenticate:

• AWSAccessKey: Set this to a Wasabi Access Key (a username)

• AWSSecretKey: Set this to a Wasabi Secret Key.

Optionally, specify AWSRegion in addition.

For example:

URI=wasabi://bucket1/folder1; AWSAccessKey=token1; AWSSecretKey=secret1; AWSRegion=OHIO;