From e7564684233c694a230886542b4617d2b2940d2b Mon Sep 17 00:00:00 2001 From: liyixin Date: Tue, 6 May 2025 10:03:26 +0800 Subject: [PATCH 1/2] add duration.parquet --- data/README.md | 1 + data/duration.parquet | Bin 0 -> 493 bytes 2 files changed, 1 insertion(+) create mode 100644 data/duration.parquet diff --git a/data/README.md b/data/README.md index 8da8e3e..4ee62ed 100644 --- a/data/README.md +++ b/data/README.md @@ -60,6 +60,7 @@ | datapage_v2_empty_datapage.snappy.parquet | A compressed FLOAT column with DataPageV2, a single row, value is null, the file uses Snappy compression, but there is no data for uncompression (see [related issue](https://github.com/apache/arrow-rs/issues/7388)). The zero bytes must not be attempted to be uncompressed, as this is an invalid Snappy stream. | | unknown-logical-type.parquet | A file containing a column annotated with a LogicalType whose identifier has been set to an abitrary high value to check the behaviour of an old reader reading a file written by a new writer containing an unsupported type (see [related issue](https://github.com/apache/arrow/issues/41764)). | | int96_from_spark.parquet | Single column of (deprecated) int96 values that originated as Apache Spark microsecond-resolution timestamps. Some values are outside the range typically representable by 64-bit nanosecond-resolution timestamps. See [int96_from_spark.md](int96_from_spark.md) for details. | +| duration.parquet | Single column of duration values that generated by polars. See [related issue](https://github.com/apache/arrow-rs/issues/5625) for details. | TODO: Document what each file is in the table above. diff --git a/data/duration.parquet b/data/duration.parquet new file mode 100644 index 0000000000000000000000000000000000000000..edfb5e1dd9dc1c27ff03119b4787759e5d701bc0 GIT binary patch literal 493 zcmb7B!AiqG5S?8^DAGfP&XR={L@*Q#6h&^Z~N{tv@y)8G{Az%~z087DD zF1lt1TD2MJ{h(RvVgj(hK`8_ubo4g34ef~x>#7v$NvId$*Y^Gr(MwYQiq1g*C7`n=c?9qTZM5-Uh57en^)9igrV{tTZdvk{yehwdHeQ|5^z34{ zxE|izW!_Y@t!-`*TV${91ILfacU+}ThzdF&VxQ1@%=~z4`99HLzOE|nSbk#DU*u5* zqjPo%g?$PuA6Y%NN{1*OaZ{I5mlO`{9#$$G67_oExp97*jS6iHzf~XrV*cn)B{^WY literal 0 HcmV?d00001 From e3a6cdc29a8bde91d1b910f72bf832c2fe9fcb8c Mon Sep 17 00:00:00 2001 From: liyixin Date: Tue, 6 May 2025 15:41:45 +0800 Subject: [PATCH 2/2] use pyarrow to generate parquet file --- data/duration.parquet | Bin 493 -> 561 bytes 1 file changed, 0 insertions(+), 0 deletions(-) diff --git a/data/duration.parquet b/data/duration.parquet index edfb5e1dd9dc1c27ff03119b4787759e5d701bc0..d93035f47a5acb2d5ade73373685bfc5106997b6 100644 GIT binary patch literal 561 zcmcIiJx>Bb5S=;6d@oi5dZ8jGctwVWHrm@^}0tmgXv3 z|Bf?<#Ky+LSInDvvpXM~?eU;N1u9bMlpKOh0MEkB=XMDI2*{_c3S}sHms}fotJII@ zL-`j~Zm*Zu#Ab+?Aw(Z&sbHGm7EORda{LVaH}u~z+K;@y6gCwZ7s%1+ib67G!Bmez8+qpbCI8vq#$>{b)k5|e6975 wl$Yo-1mSF$K0c41s-xMgI!x2)B77OA^SkLo*l5-2wYsrZUilUQdh%Jm0DIhP^Z~N{tv@y)8G{Az%~z087DD zF1lt1TD2MJ{h(RvVgj(hK`8_ubo4g34ef~x>#7v$NvId$*Y^Gr(MwYQiq1g*C7`n=c?9qTZM5-Uh57en^)9igrV{tTZdvk{yehwdHeQ|5^z34{ zxE|izW!_Y@t!-`*TV${91ILfacU+}ThzdF&VxQ1@%=~z4`99HLzOE|nSbk#DU*u5* zqjPo%g?$PuA6Y%NN{1*OaZ{I5mlO`{9#$$G67_oExp97*jS6iHzf~XrV*cn)B{^WY