Cmdlets for Parquet

Build 24.0.9060

URI Parameter (Connect-Parquet Cmdlet)

The Uniform Resource Identifier (URI) for the Parquet resource location.

Syntax

Connect-Parquet -URI string

Data Type

cstr

Default Value

""

Remarks

Set the URI property to specify a path to a file or stream.

NOTE:

  • This connection property requires that you set ConnectionType.
  • If specifying a directory path, it is generally recommended to end the URI with a trailing path separator character, as an example 'folder1/' instead of 'folder1'.

See for more advanced features available for parsing and merging multiple files.

Below are examples of the URI formats for the available data sources:

Service provider URI formats
Local Single File Path One table

localPath/file.parquet

file://localPath/file.parquet

Directory Path (one table per file)

localPath

file://localPath

HTTP or HTTPS http://remoteStream

https://remoteStream

Amazon S3 Single File Path One table

s3://remotePath/file.parquet

Directory Path (one table per file)

s3://remotePath

Azure Blob Storage Single File Path One table

azureblob://mycontainer/myblob//file.parquet

Directory Path (one table per file)

azureblob://mycontainer/myblob/

OneDrive Single File Path One table

onedrive://remotePath/file.parquet

Directory Path (one table per file)

onedrive://remotePath

Google Cloud Storage Single File Path One table

gs://bucket/remotePath/file.parquet

Directory Path (one table per file)

gs://bucket/remotePath

Google Drive Single File Path One table

gdrive://remotePath/file.parquet

Directory Path (one table per file)

gdrive://remotePath

Box Single File Path One table

box://remotePath/file.parquet

Directory Path (one table per file)

box://remotePath

FTP or FTPS Single File Path One table

ftp://server:port/remotePath/file.parquet

Directory Path (one table per file)

ftp://server:port/remotePath

SFTP Single File Path One table

sftp://server:port/remotePath/file.parquet

Directory Path (one table per file)

sftp://server:port/remotePath

Sharepoint Single File Path One table

sp://https://server/remotePath/file.parquet

Directory Path (one table per file)

sp://https://server/remotePath

Example Connection Strings and Queries

Below are example connection strings to Parquet files or streams.

Service provider URI formats Connection example
Local Single File Path One table

localPath

file://localPath/file.parquet

Directory Path (one table per file)

localPath

file://localPath

URI=C:\folder1/file.parquet
Amazon S3 Single File Path One table

s3://bucket1/folder1/file.parquet

Directory Path (one table per file)

s3://bucket1/folder1

URI=s3://bucket1/folder1/file.parquet; AWSAccessKey=token1; AWSSecretKey=secret1; AWSRegion=OHIO;
Azure Blob Storage Single File Path One table

azureblob://mycontainer/myblob//file.parquet

Directory Path (one table per file)

azureblob://mycontainer/myblob/

URI=azureblob://mycontainer/myblob/; AzureStorageAccount=myAccount; AzureAccessKey=myKey;

URI=azureblob://mycontainer/myblob/; AzureStorageAccount=myAccount; AuthScheme=OAuth;

OneDrive Single File Path One table

onedrive://remotePath/file.parquet

Directory Path (one table per file)

onedrive://remotePath

URI=onedrive://folder1/file.parquet; AuthScheme=OAuth;

URI=onedrive://SharedWithMe/folder1/file.parquet; AuthScheme=OAuth;

Google Cloud Storage Single File Path One table

gs://bucket/remotePath/file.parquet

Directory Path (one table per file)

gs://bucket/remotePath

URI=gs://bucket/folder1/file.parquet; AuthScheme=OAuth; ProjectId=test;
Google Drive Single File Path One table

gdrive://remotePath/file.parquet

Directory Path (one table per file)

gdrive://remotePath

URI=gdrive://folder1/file.parquet;
Box Single File Path One table

box://remotePath/file.parquet

Directory Path (one table per file)

box://remotePath

URI=box://folder1/file.parquet; OAuthClientId=oauthclientid1; OAuthClientSecret=oauthcliensecret1; CallbackUrl=http://localhost:12345;
FTP or FTPS Single File Path One table

ftp://server:port/remotePath/file.parquet

Directory Path (one table per file)

ftp://server:port/remotePath

URI=ftps://localhost:990/folder1/file.parquet; User=user1; Password=password1;
SFTP sftp://server:port/remotePath URI=sftp://127.0.0.1:22/remotePath/file.parquet; User=user1; Password=password1;
Sharepoint sp://https://server/remotePath URI=sp://https://domain.sharepoint.com/Documents/file.parquet; User=user1; Password=password1;

Copyright (c) 2024 CData Software, Inc. - All rights reserved.
Build 24.0.9060