Write a parquet file in the SRE

Wraps arrow::write_parquet but first writes to disk then moves to remote drive.

dipr_write_parquet(x, sink, overwrite = TRUE, ...)

Arguments

x

data.frame, RecordBatch, or Table

sink

A string file path, URI, or OutputStream, or path in a file system (SubTreeFileSystem)

overwrite

logical; should existing destination files be overwritten?

...

passed to arrow::write_parquet