
both uploading this 99MB big parquet file from a folder or from the csv/parquet wizard results in an error . … is it the fact that has been exported using compression?
COPY (
SELECT *
FROM read_parquet(
‘s3://urbansound8K-bucket/**/*.parquet’,
union_by_name = true,
filename = true
)
WHERE “class” = ‘gun_shot’
)
TO ‘./urbansound8k_gunshots.parquet’
(
FORMAT PARQUET,
COMPRESSION ZSTD,
COMPRESSION_LEVEL 19,
ROW_GROUP_SIZE 100000
);