Flink: Add decimal write/read roundtrip test for FlinkParquetReaders#16346
Flink: Add decimal write/read roundtrip test for FlinkParquetReaders#16346wombatu-kun wants to merge 2 commits into
Conversation
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
Should we test this in the BaseFormatModelTests? |
…odelTests Per review feedback on apache#16346, instead of a Flink-only decimal Parquet test, add a StructWithDecimals generator to DataGenerators.ALL and a testDataWriterEngineWriteEngineRead case to BaseFormatModelTests. This exercises decimal(9,2)/(15,3)/(38,10) write-read roundtrips (Parquet INT32/INT64/FIXED_LEN_BYTE_ARRAY encodings) for Flink and Spark across Avro, Parquet and ORC, and closes the missing engine-write -> engine-read symmetry in the shared harness. The duplicated TestFlinkParquetReader decimal test is removed from Flink v1.20/v2.0/v2.1; the FlinkParquetReaders TODO stays resolved by the broader shared coverage. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
Good call, thanks @pvary — done in 6d2f777. Rather than a Flink-only test I added a One gap I hit while doing this: the generator-parameterized cases were only The duplicated |
Summary
FlinkParquetReaders.BinaryDecimalReaderby adding a Flink-writer → Flink-reader roundtrip test for decimals across precisions 9/2, 15/3 and 38/10 (covering INT32/INT64/FIXED_LEN_BYTE_ARRAY physical encodings).TestFlinkParquetReaderin v1.20, v2.0 and v2.1; the TODO comment is removed.