Connecting to JSON Data Sources
After connecting to your data source, set DataModel to more closely match the data representation to the structure of your data.
Connecting to JSON
Below are example connection strings to JSON files or streams, using the component's default data modeling configuration (see below)
| Service provider | URI formats | Connection example |
| Local | Single File Path (One table) file://localPath/file.json | URI=C:/folder1/file.json; |
| Directory Path (One aggregated table from all files) file://localPath | ||
| HTTP or HTTPS | http://remoteStream https://remoteStream | URI=http://www.host1.com/streamname1; |
| Amazon S3 | Single File Path (One table) s3://remotePath/file.json | URI=s3://bucket1/folder1/file.json; AWSSecretKey=secret1; AWSRegion=OHIO; |
| Directory Path (One aggregated table from all files) s3://remotePath | ||
| Azure Blob Storage | azureblob://mycontainer/myblob/file.json | URI=azureblob://mycontainer/myblob/file.json; AzureStorageAccount=myAccount; AzureAccessKey=myKey; URI=azureblob://mycontainer/myblob/file.json; AzureStorageAccount=myAccount; InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; |
| Google Drive | Single File Path (One table) gdrive://remotePath/file.json gdrive://SharedWithMe/remotePath/file.json | URI=gdrive://folder1/file.json;InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; URI=gdrive://SharedWithMe/folder1/file.json;InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; |
| Directory Path (One aggregated table from all files) gdrive://remotePath gdrive://SharedWithMe/remotePath | ||
| One Drive | Single File Path (One table) onedrive://remotePath/file.json onedrive://SharedWithMe/remotePath/file.json | URI=onedrive://folder1/file.json;InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; URI=onedrive://SharedWithMe/folder1/file.json;InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; |
| Directory Path (One aggregated table from all files) onedrive://remotePath onedrive://SharedWithMe/remotePath | ||
| Box | Single File Path (One table) box://remotePath/file.json | URI=box://folder1/file.json; InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; |
| Directory Path (One aggregated table from all files) box://remotePath | ||
| Dropbox | Single File Path (One table) dropbox://remotePath/file.json | URI=dropbox://folder1/file.json; InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; OAuthClientId=oauthclientid1; OAuthClientSecret=oauthcliensecret1; CallbackUrl=http://localhost:12345; |
| Directory Path (One aggregated table from all files) dropbox://remotePath | ||
| SharePoint SOAP | Single File Path (One table) sp://remotePath/file.json | URI=sp://Documents/folder1/file.json; User=user1; Password=password1; StorageBaseURL=https://subdomain.sharepoint.com; |
| Directory Path (One aggregated table from all files) sp://remotePath | ||
| SharePoint REST | Single File Path (One table) sprest://remotePath/file.json | URI=sprest://Documents/folder1/file.json; InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; StorageBaseURL=https://subdomain.sharepoint.com; |
| Directory Path (One aggregated table from all files) sprest://remotePath | ||
| FTP or FTPS | Single File Path (One table) ftp://server:port/remotePath/file.json ftps://server:port/remotepath/file.json | URI=ftps://localhost:990/folder1/file.json; User=user1; Password=password1; |
| Directory Path (One aggregated table from all files) ftp://server:port/remotePath ftps://server:port/remotepath; | ||
| SFTP | Single File Path (One table) sftp://server:port/remotePath/file.json | URI=sftp://127.0.0.1:22/folder1/file.json; User=user1; Password=password1; URI=sftp://127.0.0.1:22/folder1/file.json; SSHAuthmode=PublicKey; SSHClientCert=myPrivateKey |
| Directory Path (One aggregated table from all files) sftp://server:port/remotePath | ||
| Azure Data Lake Store Gen1 | adl://remotePath/file.json adl://Account.azuredatalakestore.net@remotePath/file.json | URI=adl://folder1/file.json; InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; AzureStorageAccount=myAccount; AzureTenant=tenant; URI=adl://myAccount.azuredatalakestore.net@folder1/file.json; InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; AzureTenant=tenant; |
| Azure Data Lake Store Gen2 | abfs://myfilesystem/remotePath/file.json abfs://[email protected]/remotepath/file.json | URI=abfs://myfilesystem/folder1/file.json; AzureStorageAccount=myAccount; AzureAccessKey=myKey; URI=abfs://[email protected]/folder1/file.json; AzureAccessKey=myKey; |
| Azure Data Lake Store Gen2 with SSL | abfss://myfilesystem/remotePath/file.json abfss://[email protected]/remotepath/file.json | URI=abfss://myfilesystem/folder1/file.json; AzureStorageAccount=myAccount; AzureAccessKey=myKey; URI=abfss://[email protected]/folder1/file.json; AzureAccessKey=myKey; |
| Wasabi | Single File Path (One table) wasabi://bucket1/remotePath/file.json | URI=wasabi://bucket/folder1/file.json; AccessKey=token1; SecretKey=secret1; Region='us-west-1'; |
| Directory Path (One aggregated table from all files) wasabi://bucket1/remotePath | ||
| Google Cloud Storage | Single File Path (One table) gs://bucket/remotePath/file.json | URI=gs://bucket/folder1/file.json; InitiateOAuth=GETANDREFRESH; AuthScheme=OAuth; ProjectId=test; |
| Directory Path (One aggregated table from all files) gs://bucket/remotePath | ||
| Oracle Cloud Storage | Single File Path (One table) os://bucket/remotePath/file.json | URI=os://bucket/folder1/file.json; AccessKey='myKey'; SecretKey='mySecretKey'; OracleNameSpace='myNameSpace' Region='us-west-1'; |
| Directory Path (One aggregated table from all files) os://bucket/remotePath | ||
| Azure File | Single File Path (One table) azurefile://fileShare/remotePath/file.json | URI=azurefile://bucket/folder1/file.json; AzureStorageAccount='myAccount'; AzureAccessKey='mySecretKey'; URI=azurefile://bucket/folder1/file.json; AzureStorageAccount='myAccount'; AzureSharedAccessSignature='mySharedAccessSignature'; |
| Directory Path (One aggregated table from all files) azurefile://fileShare/remotePath | ||
| IBM Object Storage Source | Single File Path (One table) ibmobjectstorage://bucket1/remotePath/file.json | URI=ibmobjectstorage://bucket/folder1/file.json; AuthScheme='IAMSecretKey'; AccessKey=token1; SecretKey=secret1; Region='eu-gb'; URI=ibmobjectstorage://bucket/folder1/file.json; ApiKey=key1; Region='eu-gb'; AuthScheme=OAuth; InitiateOAuth=GETANDREFRESH; |
| Directory Path (One aggregated table from all files) ibmobjectstorage://bucket1/remotePath | ||
| Hadoop Distributed File System | Single File Path (One table) webhdfs://host:port/remotePath/file.json | URI=webhdfs://host:port/folder1/file.json |
| Directory Path (One aggregated table from all files) webhdfs://host:port/remotePath | ||
| Secure Hadoop Distributed File System | Single File Path (One table) webhdfss://host:port/remotePath/file.json | URI=webhdfss://host:port/folder1/file.json |
| Directory Path (One aggregated table from all files) webhdfss://host:port/remotePath |
Modeling JSON Data
The DataModel property controls how your data is represented into tables.
- Document (default): Model a top-level, document view of your JSON data. The component returns nested object arrays as aggregated JSON objects.
- FlattenedDocuments: Implicitly join nested array objects and parent objects into a single table.
- Relational: View nested object arrays as individual, related tables containing a primary key and a foreign key that links to the parent document.
Next Steps
- See Parsing Hierarchical Data for examples showing how to query a dataset in each DataModel configuration.
- See Modeling JSON Data for information on customizing schema discovery and how to execute SQL to JSON.
- See Fine-Tuning Data Access for more advanced connection settings: fine-tune the default data modeling settings, connect through a firewall, or troubleshoot connections.