Support Zstandard, LZ4, S2, and snappy as additional compression formats for S3 Select.
Showing the changes to docs/select (1 of 6 files). Show all
Unified · Split
| @@ -5,7 +5,8 @@ You can use the Select API to query objects with following features: · 4 unmodified lines | ||
| 5 | 5 | |
| 6 | 6 | - Objects must be in CSV, JSON, or Parquet(*) format. |
| 7 | 7 | - UTF-8 is the only encoding type the Select API supports. |
| 8 | −- GZIP or BZIP2 - CSV and JSON files can be compressed using GZIP or BZIP2. The Select API supports columnar compression for Parquet using GZIP, Snappy, LZ4. Whole object compression is not supported for Parquet objects. | |
| 8 | +- GZIP or BZIP2 - CSV and JSON files can be compressed using GZIP, BZIP2, [ZSTD](https://facebook.github.io/zstd/), and streaming formats of [LZ4](https://lz4.github.io/lz4/), [S2](https://github.com/klauspost/compress/tree/master/s2#s2-compression) and [SNAPPY](http://google.github.io/snappy/). | |
| 9 | +- Parquet API supports columnar compression for using GZIP, Snappy, LZ4. Whole object compression is not supported for Parquet objects. | |
| 9 | 10 | - Server-side encryption - The Select API supports querying objects that are protected with server-side encryption. |
| 10 | 11 | |
| 11 | 12 | Type inference and automatic conversion of values is performed based on the context when the value is un-typed (such as when reading CSV data). If present, the CAST function overrides automatic conversion. |