InsertMode
The behavior when using bulk inserts to create Parquet files.
Possible Values
create, overwrite, batchData Type
string
Default Value
"create"
Remarks
- Create: Create a new Parquet file using the table name specified in the Create Table Statement. You must specify a name for the new file that does not already exist in the system and set BatchSize to 0 (this triggers the driver to use a single batch during batch operations, which is required in this mode).
- Overwrite: Set this to overwrite any exisiting Parquet file with the same name as the new file. When using this mode, set the BatchSize to 0 (this triggers the driver to use a single batch during batch operations, which is required in this mode).
- Batch: Set this if using BatchSize > 0. This will create multiple Parquet files, each file containing data for a single batch. File names follow the pattern: '<Timestamp>_<Table Name>_<Batch ID>.parquet'.