[WIP] CLI program to write ALP encode example parquet files by alamb · Pull Request #49154 · apache/arrow

alamb · 2026-02-05T13:55:26Z

This builds on the following PR from @prtkgaur

GH-48701: [C++][Parquet] Add ALPpd encoding #48345

It contains a binary that creates files using the new ALP encoding here:

GH-533: Adaptive Lossless Floating-Point (ALP) Encoding parquet-format#548

It was used to create the example in

Add single ALP test file (216KB, covers corner cases) parquet-testing#119

I don't intend to merge this PR, rather I plan to use it to create test parquet files, and am posting the PR in case anyone else is interested.

To build

cd cpp
cmake -S . -B build \
  -DCMAKE_BUILD_TYPE=Release \
  -DARROW_PARQUET=ON \
  -DPARQUET_BUILD_EXAMPLES=ON \
  -DARROW_WITH_ZSTD=ON
cmake --build build --target parquet-write-parquet

To run

build/release/parquet-write-parquet  /tmp > /tmp/alp_details.txt

This writes a file like this to /tmp: alp_extended.zip

And writes detailed layout information to stdout

Output Encoding

Wrote /tmp/alp_extended.zstd.parquet (215673 bytes)

File: /tmp/alp_extended.zstd.parquet
  rows: 9000, row groups: 4, columns: 8

Column 'float_plain' (FLOAT)
  Row group 0: rows=6144 encodings=[ RLE PLAIN ] compression=zstd null_count=0 compressed_bytes=21005
  Row group 1: rows=1024 encodings=[ RLE PLAIN ] compression=zstd null_count=0 compressed_bytes=3863
  Row group 2: rows=1024 encodings=[ RLE PLAIN ] compression=zstd null_count=0 compressed_bytes=47
  Row group 3: rows=808 encodings=[ RLE PLAIN ] compression=zstd null_count=8 compressed_bytes=2672

Column 'double_plain' (DOUBLE)
  Row group 0: rows=6144 encodings=[ RLE PLAIN ] compression=zstd null_count=0 compressed_bytes=24873
  Row group 1: rows=1024 encodings=[ RLE PLAIN ] compression=zstd null_count=0 compressed_bytes=5882
  Row group 2: rows=1024 encodings=[ RLE PLAIN ] compression=zstd null_count=0 compressed_bytes=53
  Row group 3: rows=808 encodings=[ RLE PLAIN ] compression=zstd null_count=8 compressed_bytes=2376

Column 'float_alp_1024' (FLOAT)
  Row group 0: rows=6144 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=16430
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=10 (vector_size=1024) num_elements=6144
    num_vectors=6 total_exceptions=1546
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      6   4   11  4294966296           0     
    1      1024      6   4   11  4294966296           7      0:nan, 476:nan, 976:inf, 977:-inf, 978:-0, ...
    2      1024      6   4   11  4294966297           1      452:3.1415927410125732
    3      1024      6   4   11  4294966296           2      28:44974936064, 639:-1243432448
    4      1024      6   4   11  4294966296           512    0:-5.6894025802612305, 2:-5.7471122741699219, 4:5.2631058692932129, 6:3.063255786895752, 8:7.4240894317626953, ...
    5      1024      6   4   0   0                    1024   0:0.98619550466537476, 1:-3.7603194713592529, 2:-0.34999150037765503, 3:0.1334528774023056, 4:-2.2552545070648193, ...
  Row group 1: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=2351
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=10 (vector_size=1024) num_elements=1024
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      6   2   18  4294867362           0     
  Row group 2: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=45
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=10 (vector_size=1024) num_elements=1024
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      10  8   0   777                  0     
  Row group 3: rows=808 encodings=[ RLE ALP ] compression=uncompressed null_count=8 compressed_bytes=1186
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=10 (vector_size=1024) num_elements=800
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      800       6   4   11  4294966297           0     

Column 'double_alp_1024' (DOUBLE)
  Row group 0: rows=6144 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=22638
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=10 (vector_size=1024) num_elements=6144
    num_vectors=6 total_exceptions=1546
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      14  12  11  18446744073709550616 0     
    1      1024      14  12  11  18446744073709550616 7      0:nan, 476:nan, 976:inf, 977:-inf, 978:-0, ...
    2      1024      14  12  11  18446744073709550617 1      452:3.1415926535897931
    3      1024      14  12  11  18446744073709550616 2      28:44974934523.343002, 639:-1243432432.3432
    4      1024      14  12  11  18446744073709550616 512    0:-5.6894026020883821, 2:-5.7471123414096521, 4:5.2631058917995048, 6:3.0632557599260757, 8:7.4240896660071236, ...
    5      1024      14  12  0   0                    1024   0:0.98619550441899628, 1:-3.7603195733564965, 2:-0.34999150139969903, 3:0.13345287723017574, 4:-2.2552545378626987, ...
  Row group 1: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=2355
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=10 (vector_size=1024) num_elements=1024
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      16  12  18  18446744073709451682 0     
  Row group 2: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=49
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=10 (vector_size=1024) num_elements=1024
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      16  14  0   777                  0     
  Row group 3: rows=808 encodings=[ RLE ALP ] compression=uncompressed null_count=8 compressed_bytes=1190
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=10 (vector_size=1024) num_elements=800
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      800       14  12  11  18446744073709550617 0     

Column 'float_alp_4096' (FLOAT)
  Row group 0: rows=6144 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=17786
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=12 (vector_size=4096) num_elements=6144
    num_vectors=2 total_exceptions=1546
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      4096      6   4   11  4294966296           10     1024:nan, 1500:nan, 2000:inf, 2001:-inf, 2002:-0, ...
    1      2048      6   4   11  4294966296           1536   0:-5.6894025802612305, 2:-5.7471122741699219, 4:5.2631058692932129, 6:3.063255786895752, 8:7.4240894317626953, ...
  Row group 1: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=2351
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=12 (vector_size=4096) num_elements=1024
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      6   2   18  4294867362           0     
  Row group 2: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=45
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=12 (vector_size=4096) num_elements=1024
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      10  8   0   777                  0     
  Row group 3: rows=808 encodings=[ RLE ALP ] compression=uncompressed null_count=8 compressed_bytes=1186
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=12 (vector_size=4096) num_elements=800
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      800       6   4   11  4294966297           0     

Column 'double_alp_4096' (DOUBLE)
  Row group 0: rows=6144 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=23978
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=12 (vector_size=4096) num_elements=6144
    num_vectors=2 total_exceptions=1546
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      4096      14  12  11  18446744073709550616 10     1024:nan, 1500:nan, 2000:inf, 2001:-inf, 2002:-0, ...
    1      2048      14  12  11  18446744073709550616 1536   0:-5.6894026020883821, 2:-5.7471123414096521, 4:5.2631058917995048, 6:3.0632557599260757, 8:7.4240896660071236, ...
  Row group 1: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=2355
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=12 (vector_size=4096) num_elements=1024
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      16  12  18  18446744073709451682 0     
  Row group 2: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=49
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=12 (vector_size=4096) num_elements=1024
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      1024      16  14  0   777                  0     
  Row group 3: rows=808 encodings=[ RLE ALP ] compression=uncompressed null_count=8 compressed_bytes=1190
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=12 (vector_size=4096) num_elements=800
    num_vectors=1 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      800       14  12  11  18446744073709550617 0     

Column 'float_alp_32' (FLOAT)
  Row group 0: rows=6144 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=18848
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=5 (vector_size=32) num_elements=6144
    num_vectors=192 total_exceptions=1546
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      32        6   4   11  4294966383           0     
    1      32        6   4   11  4294966316           0     
    2      32        6   4   11  4294966309           0     
    3      32        6   4   11  4294966310           0     
    4      32        6   4   11  4294966336           0     
    5      32        6   4   11  4294966502           0     
    6      32        6   4   11  4294966391           0     
    7      32        6   4   11  4294966485           0     
    8      32        6   4   11  4294966297           0     
    9      32        6   4   11  4294966418           0     
    10     32        6   4   11  4294966439           0     
    11     32        6   4   11  4294966297           0     
    12     32        6   4   11  4294966448           0     
    13     32        6   4   11  4294966312           0     
    14     32        6   4   11  4294966313           0     
    15     32        6   4   11  4294966450           0     
    16     32        6   4   11  4294966315           0     
    17     32        6   4   11  4294966300           0     
    18     32        6   4   11  4294966412           0     
    19     32        6   4   11  4294966389           0     
    20     32        6   4   11  4294966318           0     
    21     32        6   4   11  4294966307           0     
    22     32        6   4   11  4294966410           0     
    23     32        6   4   11  4294966332           0     
    24     32        6   4   11  4294966404           0     
    25     32        6   4   11  4294966324           0     
    26     32        6   4   11  4294966334           0     
    27     32        6   4   11  4294966353           0     
    28     32        6   4   11  4294966342           0     
    29     32        6   4   11  4294966336           0     
    30     32        6   4   11  4294966305           0     
    31     32        6   4   11  4294966296           0     
    32     32        6   4   11  4294966370           1      0:nan
    33     32        6   4   11  4294966376           0     
    34     32        6   4   11  4294966338           0     
    35     32        6   4   11  4294966342           0     
    36     32        6   4   11  4294966303           0     
    37     32        6   4   11  4294966320           0     
    38     32        6   4   11  4294966329           0     
    39     32        6   4   11  4294966299           0     
    40     32        6   4   11  4294966296           0     
    41     32        6   4   11  4294966305           0     
    42     32        6   4   11  4294966300           0     
    43     32        6   4   11  4294966384           0     
    44     32        6   4   11  4294966452           0     
    45     32        6   4   11  4294966310           0     
    46     32        6   4   11  4294966306           1      28:nan
    47     32        6   4   11  4294966346           0     
    48     32        6   4   11  4294966370           0     
    49     32        6   4   11  4294966320           0     
    50     32        6   4   11  4294966313           0     
    51     32        6   4   11  4294966350           0     
    52     32        6   4   11  4294966302           0     
    53     32        6   4   11  4294966377           0     
    54     32        6   4   11  4294966299           0     
    55     32        6   4   11  4294966322           0     
    56     32        6   4   11  4294966306           0     
    57     32        6   4   11  4294966356           0     
    58     32        6   4   11  4294966307           0     
    59     32        6   4   11  4294966342           0     
    60     32        6   4   11  4294966334           0     
    61     32        6   4   11  4294966311           0     
    62     32        6   4   11  4294966298           4      16:inf, 17:-inf, 18:-0, 19:1.4012984643248171e-45
    63     32        6   4   11  4294966306           1      31:nan
    64     32        6   4   11  4294966349           0     
    65     32        6   4   11  4294966298           0     
    66     32        6   4   11  4294966332           0     
    67     32        6   4   11  4294966302           0     
    68     32        6   4   11  4294966312           0     
    69     32        6   4   11  4294966332           0     
    70     32        6   4   11  4294966317           0     
    71     32        6   4   11  4294966316           0     
    72     32        6   4   11  4294966379           0     
    73     32        6   4   11  4294966501           0     
    74     32        6   4   11  4294966306           0     
    75     32        6   4   11  4294966297           0     
    76     32        6   4   11  4294966304           0     
    77     32        6   4   11  4294966302           0     
    78     32        6   4   11  4294966330           1      4:3.1415927410125732
    79     32        6   4   11  4294966447           0     
    80     32        6   4   11  4294966297           0     
    81     32        6   4   11  4294966309           0     
    82     32        6   4   11  4294966428           0     
    83     32        6   4   11  4294966414           0     
    84     32        6   4   11  4294966424           0     
    85     32        6   4   11  4294966381           0     
    86     32        6   4   11  4294966314           0     
    87     32        6   4   11  4294966397           0     
    88     32        6   4   11  4294966307           0     
    89     32        6   4   11  4294966316           0     
    90     32        6   4   11  4294966297           0     
    91     32        6   4   11  4294966305           0     
    92     32        6   4   11  4294966345           0     
    93     32        6   4   11  4294966558           0     
    94     32        6   4   11  4294966331           0     
    95     32        6   4   11  4294966353           0     
    96     32        6   4   11  4294966350           1      28:44974936064
    97     32        6   4   11  4294966409           0     
    98     32        6   4   11  4294966307           0     
    99     32        6   4   11  4294966390           0     
    100    32        6   4   11  4294966338           0     
    101    32        6   4   11  4294966378           0     
    102    32        6   4   11  4294966387           0     
    103    32        6   4   11  4294966360           0     
    104    32        6   4   11  4294966312           0     
    105    32        6   4   11  4294966338           0     
    106    32        6   4   11  4294966433           0     
    107    32        6   4   11  4294966414           0     
    108    32        6   4   11  4294966334           0     
    109    32        6   4   11  4294966498           0     
    110    32        6   4   11  4294966314           0     
    111    32        6   4   11  4294966407           0     
    112    32        6   4   11  4294966427           0     
    113    32        6   4   11  4294966333           0     
    114    32        6   4   11  4294966314           0     
    115    32        6   4   11  4294966345           1      31:-1243432448
    116    32        6   4   11  4294966483           0     
    117    32        6   4   11  4294966458           0     
    118    32        6   4   11  4294966316           0     
    119    32        6   4   11  4294966323           0     
    120    32        6   4   11  4294966317           0     
    121    32        6   4   11  4294966327           0     
    122    32        6   4   11  4294966303           0     
    123    32        6   4   11  4294966335           0     
    124    32        6   4   11  4294966555           0     
    125    32        6   4   11  4294966426           0     
    126    32        6   4   11  4294966336           0     
    127    32        6   4   11  4294966296           0     
    128    32        6   4   11  4294966437           16     0:-5.6894025802612305, 2:-5.7471122741699219, 4:5.2631058692932129, 6:3.063255786895752, 8:7.4240894317626953, ...
    129    32        6   4   11  4294966560           16     0:8.3615312576293945, 2:-7.4509210586547852, 4:-4.1556353569030762, 6:6.5207810401916504, 8:6.0981354713439941, ...
    130    32        6   4   11  4294966563           16     0:-4.0016179084777832, 2:1.9761660099029541, 4:8.0578994750976562, 6:7.5452351570129395, 8:1.8644313812255859, ...
    131    32        6   4   11  4294966474           16     0:-8.7062625885009766, 2:1.435447096824646, 4:3.8890092372894287, 6:-3.6610684394836426, 8:-0.71133530139923096, ...
    132    32        6   4   11  4294966388           16     0:-4.6208209991455078, 2:-8.5813560485839844, 4:-9.9415788650512695, 6:-0.55013293027877808, 8:8.1476030349731445, ...
    133    32        6   4   11  4294966677           16     0:0.25335460901260376, 2:-9.1122446060180664, 4:-2.0596992969512939, 6:-4.3087539672851562, 8:-7.7232322692871094, ...
    134    32        6   4   11  4294966715           16     0:4.4278688430786133, 2:2.7280275821685791, 4:-4.8478555679321289, 6:-9.1888256072998047, 8:3.7317984104156494, ...
    135    32        6   4   11  4294966368           16     0:-7.6852478981018066, 2:7.4739718437194824, 4:2.7575418949127197, 6:8.0490665435791016, 8:6.5803546905517578, ...
    136    32        6   4   11  4294966974           16     0:7.2348499298095703, 2:-1.0716096162796021, 4:-2.3152074813842773, 6:7.1512470245361328, 8:5.1870203018188477, ...
    137    32        6   4   11  4294966370           16     0:-1.8074220418930054, 2:-7.9748015403747559, 4:2.1155848503112793, 6:6.8344674110412598, 8:1.1937688589096069, ...
    138    32        6   4   11  4294966363           16     0:9.1183767318725586, 2:7.768073558807373, 4:9.8971595764160156, 6:-8.2359657287597656, 8:9.2227096557617188, ...
    139    32        6   4   11  4294966359           16     0:0.89655309915542603, 2:1.6093521118164062, 4:9.9942760467529297, 6:2.524686336517334, 8:-5.8538198471069336, ...
    140    32        6   4   11  4294966690           16     0:4.9172005653381348, 2:-7.5035834312438965, 4:3.6151180267333984, 6:7.541811466217041, 8:9.3921546936035156, ...
    141    32        6   4   11  4294966411           16     0:2.042339563369751, 2:6.1317868232727051, 4:-5.9905099868774414, 6:-8.8105688095092773, 8:-1.2170037031173706, ...
    142    32        6   4   11  4294966296           16     0:-4.4248027801513672, 2:0.57156217098236084, 4:-9.8227348327636719, 6:-5.9869794845581055, 8:6.5693860054016113, ...
    143    32        6   4   11  4294966340           16     0:-3.0235893726348877, 2:2.6417965888977051, 4:8.9537601470947266, 6:-7.9811758995056152, 8:-4.0086865425109863, ...
    144    32        6   4   11  4294966455           16     0:9.5796222686767578, 2:-5.7074384689331055, 4:2.9563488960266113, 6:-6.2431430816650391, 8:0.061678990721702576, ...
    145    32        6   4   11  4294966472           16     0:2.5911538600921631, 2:-4.569058895111084, 4:-3.6482639312744141, 6:-6.2192096710205078, 8:-9.0629615783691406, ...
    146    32        6   4   11  4294966470           16     0:-2.453639030456543, 2:3.5028011798858643, 4:3.7403855323791504, 6:1.2925810813903809, 8:6.8849740028381348, ...
    147    32        6   4   11  4294966505           16     0:-0.48064544796943665, 2:-5.8223457336425781, 4:5.4156122207641602, 6:-8.9528999328613281, 8:-6.2795400619506836, ...
    148    32        6   4   11  4294966312           16     0:-8.2931728363037109, 2:-2.6442804336547852, 4:6.4661884307861328, 6:0.31723803281784058, 8:-8.0026636123657227, ...
    149    32        6   4   11  4294966328           16     0:5.4584298133850098, 2:-7.3696346282958984, 4:-7.4889955520629883, 6:-8.4723014831542969, 8:6.1431107521057129, ...
    150    32        6   4   11  4294966528           16     0:-0.84008479118347168, 2:-6.9534440040588379, 4:-8.6861028671264648, 6:8.7475690841674805, 8:-0.31845855712890625, ...
    151    32        6   4   11  4294966300           16     0:-7.0607457160949707, 2:0.5453035831451416, 4:-2.2366857528686523, 6:2.8563783168792725, 8:-3.0961558818817139, ...
    152    32        6   4   11  4294966505           16     0:-4.5059237480163574, 2:5.2170867919921875, 4:0.93154287338256836, 6:-0.82804101705551147, 8:-6.6850042343139648, ...
    153    32        6   4   11  4294966381           16     0:-6.4780902862548828, 2:2.4468653202056885, 4:-6.1978468894958496, 6:4.6424522399902344, 8:8.8740320205688477, ...
    154    32        6   4   11  4294966424           16     0:8.5238809585571289, 2:6.095062255859375, 4:-5.5584826469421387, 6:-6.442237377166748, 8:4.5772285461425781, ...
    155    32        6   4   11  4294966569           16     0:2.440791130065918, 2:-4.9799723625183105, 4:1.4768251180648804, 6:3.1326212882995605, 8:8.0447282791137695, ...
    156    32        6   4   11  4294966335           16     0:-1.3979425430297852, 2:8.9291305541992188, 4:-1.981164813041687, 6:5.6073098182678223, 8:7.7777485847473145, ...
    157    32        6   4   11  4294966574           16     0:0.31318798661231995, 2:0.78189116716384888, 4:-4.1994161605834961, 6:-9.2485780715942383, 8:0.93401038646697998, ...
    158    32        6   4   11  4294966305           16     0:-3.9413819313049316, 2:6.36053466796875, 4:6.3355894088745117, 6:-7.4928703308105469, 8:8.0388040542602539, ...
    159    32        6   4   11  4294966404           16     0:4.2884831428527832, 2:1.201833963394165, 4:0.27708917856216431, 6:-6.5582156181335449, 8:-1.0237270593643188, ...
    160    32        6   4   0   0                    32     0:0.98619550466537476, 1:-3.7603194713592529, 2:-0.34999150037765503, 3:0.1334528774023056, 4:-2.2552545070648193, ...
    161    32        6   4   0   0                    32     0:0.030309226363897324, 1:-8.5821685791015625, 2:-3.74273681640625, 3:8.7059421539306641, 4:7.0136051177978516, ...
    162    32        6   4   0   0                    32     0:2.0220539569854736, 1:9.8072357177734375, 2:-3.4949219226837158, 3:8.8254489898681641, 4:8.2946224212646484, ...
    163    32        6   4   0   0                    32     0:1.0675803422927856, 1:2.8326382637023926, 2:4.0758461952209473, 3:-2.5348036289215088, 4:1.2731994390487671, ...
    164    32        6   4   0   0                    32     0:3.2998902797698975, 1:-0.039192099124193192, 2:4.8564996719360352, 3:-3.4591071605682373, 4:7.801140308380127, ...
    165    32        6   4   0   0                    32     0:-3.3393025398254395, 1:7.6992859840393066, 2:-2.334315299987793, 3:-0.12998028099536896, 4:-4.3339047431945801, ...
    166    32        6   4   0   0                    32     0:1.9769080877304077, 1:-5.9780254364013672, 2:1.8046531677246094, 3:-1.847342848777771, 4:-0.60948920249938965, ...
    167    32        6   4   0   0                    32     0:5.7271547317504883, 1:2.6443319320678711, 2:-2.5295965671539307, 3:-4.5700249671936035, 4:-5.3643283843994141, ...
    168    32        6   4   0   0                    32     0:4.6482772827148438, 1:7.6332497596740723, 2:-7.5700922012329102, 3:2.6927852630615234, 4:1.642876148223877, ...
    169    32        6   4   0   0                    32     0:0.24569518864154816, 1:-7.7142844200134277, 2:5.2960195541381836, 3:3.5779545307159424, 4:5.4597344398498535, ...
    170    32        6   4   0   0                    32     0:-4.3823604583740234, 1:-5.8408727645874023, 2:-9.1602916717529297, 3:-0.41479822993278503, 4:-6.3655343055725098, ...
    171    32        6   4   0   0                    32     0:-9.0268468856811523, 1:1.6203017234802246, 2:-1.4785804748535156, 3:0.9606471061706543, 4:0.42146375775337219, ...
    172    32        6   4   0   0                    32     0:4.4868879318237305, 1:4.9150676727294922, 2:1.1585489511489868, 3:1.693361759185791, 4:-7.3269882202148438, ...
    173    32        6   4   0   0                    32     0:-1.6951805353164673, 1:7.769282341003418, 2:6.4865379333496094, 3:2.6007976531982422, 4:7.1624078750610352, ...
    174    32        6   4   0   0                    32     0:-8.3955554962158203, 1:-3.7560725212097168, 2:-9.6851415634155273, 3:-9.6570043563842773, 4:8.3320655822753906, ...
    175    32        6   4   0   0                    32     0:0.080075323581695557, 1:8.984013557434082, 2:6.6566381454467773, 3:-2.7513735294342041, 4:7.2728285789489746, ...
    176    32        6   4   0   0                    32     0:1.6899958848953247, 1:6.6758389472961426, 2:2.8515520095825195, 3:-8.4288434982299805, 4:4.8112945556640625, ...
    177    32        6   4   0   0                    32     0:-2.080768346786499, 1:3.3861720561981201, 2:7.8378620147705078, 3:-3.8789706230163574, 4:1.0375427007675171, ...
    178    32        6   4   0   0                    32     0:9.7345819473266602, 1:-4.5726804733276367, 2:-8.0283412933349609, 3:6.5862846374511719, 4:4.1335105895996094, ...
    179    32        6   4   0   0                    32     0:0.4552028477191925, 1:-0.58265292644500732, 2:3.1211004257202148, 3:1.1915770769119263, 4:3.7407829761505127, ...
    180    32        6   4   0   0                    32     0:1.5322799682617188, 1:1.1753189563751221, 2:-2.5766096115112305, 3:5.7128620147705078, 4:-4.9440312385559082, ...
    181    32        6   4   0   0                    32     0:5.7162528038024902, 1:1.7989577054977417, 2:-9.8712959289550781, 3:5.4503259658813477, 4:4.049767017364502, ...
    182    32        6   4   0   0                    32     0:5.467620849609375, 1:8.2993173599243164, 2:-6.2172179222106934, 3:8.4473495483398438, 4:3.9124929904937744, ...
    183    32        6   4   0   0                    32     0:1.9925512075424194, 1:0.12660616636276245, 2:-2.9917349815368652, 3:8.2586202621459961, 4:-3.2045953273773193, ...
    184    32        6   4   0   0                    32     0:8.0953264236450195, 1:2.9503293037414551, 2:-4.5391874313354492, 3:-6.4561500549316406, 4:-4.1146655082702637, ...
    185    32        6   4   0   0                    32     0:1.6721007823944092, 1:-2.1975953578948975, 2:-2.8973672389984131, 3:-9.0950164794921875, 4:-5.6418256759643555, ...
    186    32        6   4   0   0                    32     0:1.2251135110855103, 1:-5.0751166343688965, 2:-1.5290416479110718, 3:5.8714132308959961, 4:-9.3644304275512695, ...
    187    32        6   4   0   0                    32     0:5.2376723289489746, 1:5.6301131248474121, 2:-4.4848518371582031, 3:-5.915064811706543, 4:-9.6648740768432617, ...
    188    32        6   4   0   0                    32     0:-1.1176950931549072, 1:5.0005683898925781, 2:0.633220374584198, 3:0.75565874576568604, 4:-4.4380097389221191, ...
    189    32        6   4   0   0                    32     0:3.1610996723175049, 1:-9.8388175964355469, 2:8.8634967803955078, 3:-5.257110595703125, 4:-7.8477163314819336, ...
    190    32        6   4   0   0                    32     0:-1.3803218603134155, 1:-3.9101493358612061, 2:-6.0380897521972656, 3:-8.6861581802368164, 4:7.7423863410949707, ...
    191    32        6   4   0   0                    32     0:-9.8062620162963867, 1:7.1591019630432129, 2:4.6231470108032227, 3:8.9351205825805664, 4:5.6323094367980957, ...
  Row group 1: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=2754
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=5 (vector_size=32) num_elements=1024
    num_vectors=32 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      32        6   2   18  4294871265           0     
    1      32        6   2   18  4294867583           0     
    2      32        6   2   18  4294867616           0     
    3      32        6   2   18  4294882325           0     
    4      32        6   2   18  4294872839           0     
    5      32        6   2   18  4294873934           0     
    6      32        6   2   18  4294877022           0     
    7      32        6   2   18  4294871338           0     
    8      32        6   2   18  4294869331           0     
    9      32        6   2   18  4294868762           0     
    10     32        6   2   18  4294878646           0     
    11     32        6   2   18  4294867686           0     
    12     32        6   2   18  4294874507           0     
    13     32        6   2   18  4294868480           0     
    14     32        6   2   18  4294868220           0     
    15     32        6   2   18  4294873766           0     
    16     32        6   2   18  4294874531           0     
    17     32        6   2   18  4294877239           0     
    18     32        6   2   18  4294873026           0     
    19     32        6   2   18  4294868369           0     
    20     32        6   2   18  4294868197           0     
    21     32        6   2   18  4294867811           0     
    22     32        6   2   18  4294867362           0     
    23     32        6   2   18  4294868027           0     
    24     32        6   2   18  4294868758           0     
    25     32        6   2   18  4294867759           0     
    26     32        6   2   18  4294876098           0     
    27     32        6   2   18  4294871071           0     
    28     32        6   2   18  4294875247           0     
    29     32        6   2   18  4294867511           0     
    30     32        6   2   18  4294883872           0     
    31     32        6   2   18  4294868597           0     
  Row group 2: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=450
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=5 (vector_size=32) num_elements=1024
    num_vectors=32 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      32        10  8   0   777                  0     
    1      32        10  8   0   777                  0     
    2      32        10  8   0   777                  0     
    3      32        10  8   0   777                  0     
    4      32        10  8   0   777                  0     
    5      32        10  8   0   777                  0     
    6      32        10  8   0   777                  0     
    7      32        10  8   0   777                  0     
    8      32        10  8   0   777                  0     
    9      32        10  8   0   777                  0     
    10     32        10  8   0   777                  0     
    11     32        10  8   0   777                  0     
    12     32        10  8   0   777                  0     
    13     32        10  8   0   777                  0     
    14     32        10  8   0   777                  0     
    15     32        10  8   0   777                  0     
    16     32        10  8   0   777                  0     
    17     32        10  8   0   777                  0     
    18     32        10  8   0   777                  0     
    19     32        10  8   0   777                  0     
    20     32        10  8   0   777                  0     
    21     32        10  8   0   777                  0     
    22     32        10  8   0   777                  0     
    23     32        10  8   0   777                  0     
    24     32        10  8   0   777                  0     
    25     32        10  8   0   777                  0     
    26     32        10  8   0   777                  0     
    27     32        10  8   0   777                  0     
    28     32        10  8   0   777                  0     
    29     32        10  8   0   777                  0     
    30     32        10  8   0   777                  0     
    31     32        10  8   0   777                  0     
  Row group 3: rows=808 encodings=[ RLE ALP ] compression=uncompressed null_count=8 compressed_bytes=1498
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=5 (vector_size=32) num_elements=800
    num_vectors=25 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      32        6   4   11  4294966356           0     
    1      32        6   4   11  4294966297           0     
    2      32        6   4   11  4294966322           0     
    3      32        6   4   11  4294966327           0     
    4      32        6   4   11  4294966308           0     
    5      32        6   4   11  4294966336           0     
    6      32        6   4   11  4294966368           0     
    7      32        6   4   11  4294966387           0     
    8      32        6   4   11  4294966439           0     
    9      32        6   4   11  4294966363           0     
    10     32        6   4   11  4294966373           0     
    11     32        6   4   11  4294966379           0     
    12     32        6   4   11  4294966388           0     
    13     32        6   4   11  4294966314           0     
    14     32        6   4   11  4294966507           0     
    15     32        6   4   11  4294966352           0     
    16     32        6   4   11  4294966320           0     
    17     32        6   4   11  4294966383           0     
    18     32        6   4   11  4294966300           0     
    19     32        6   4   11  4294966311           0     
    20     32        6   4   11  4294966306           0     
    21     32        6   4   11  4294966363           0     
    22     32        6   4   11  4294966366           0     
    23     32        6   4   11  4294966299           0     
    24     32        6   4   11  4294966400           0     

Column 'double_alp_32' (DOUBLE)
  Row group 0: rows=6144 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=25800
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=5 (vector_size=32) num_elements=6144
    num_vectors=192 total_exceptions=1546
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      32        14  12  11  18446744073709550703 0     
    1      32        14  12  11  18446744073709550636 0     
    2      32        14  12  11  18446744073709550629 0     
    3      32        14  12  11  18446744073709550630 0     
    4      32        14  12  11  18446744073709550656 0     
    5      32        14  12  11  18446744073709550822 0     
    6      32        14  12  11  18446744073709550711 0     
    7      32        14  12  11  18446744073709550805 0     
    8      32        14  12  11  18446744073709550617 0     
    9      32        14  12  11  18446744073709550738 0     
    10     32        14  12  11  18446744073709550759 0     
    11     32        14  12  11  18446744073709550617 0     
    12     32        14  12  11  18446744073709550768 0     
    13     32        14  12  11  18446744073709550632 0     
    14     32        14  12  11  18446744073709550633 0     
    15     32        14  12  11  18446744073709550770 0     
    16     32        14  12  11  18446744073709550635 0     
    17     32        14  12  11  18446744073709550620 0     
    18     32        14  12  11  18446744073709550732 0     
    19     32        14  12  11  18446744073709550709 0     
    20     32        14  12  11  18446744073709550638 0     
    21     32        14  12  11  18446744073709550627 0     
    22     32        14  12  11  18446744073709550730 0     
    23     32        14  12  11  18446744073709550652 0     
    24     32        14  12  11  18446744073709550724 0     
    25     32        14  12  11  18446744073709550644 0     
    26     32        14  12  11  18446744073709550654 0     
    27     32        14  12  11  18446744073709550673 0     
    28     32        14  12  11  18446744073709550662 0     
    29     32        14  12  11  18446744073709550656 0     
    30     32        14  12  11  18446744073709550625 0     
    31     32        14  12  11  18446744073709550616 0     
    32     32        14  12  11  18446744073709550690 1      0:nan
    33     32        14  12  11  18446744073709550696 0     
    34     32        14  12  11  18446744073709550658 0     
    35     32        14  12  11  18446744073709550662 0     
    36     32        14  12  11  18446744073709550623 0     
    37     32        14  12  11  18446744073709550640 0     
    38     32        14  12  11  18446744073709550649 0     
    39     32        14  12  11  18446744073709550619 0     
    40     32        14  12  11  18446744073709550616 0     
    41     32        14  12  11  18446744073709550625 0     
    42     32        14  12  11  18446744073709550620 0     
    43     32        14  12  11  18446744073709550704 0     
    44     32        14  12  11  18446744073709550772 0     
    45     32        14  12  11  18446744073709550630 0     
    46     32        14  12  11  18446744073709550626 1      28:nan
    47     32        14  12  11  18446744073709550666 0     
    48     32        14  12  11  18446744073709550690 0     
    49     32        14  12  11  18446744073709550640 0     
    50     32        14  12  11  18446744073709550633 0     
    51     32        14  12  11  18446744073709550670 0     
    52     32        14  12  11  18446744073709550622 0     
    53     32        14  12  11  18446744073709550697 0     
    54     32        14  12  11  18446744073709550619 0     
    55     32        14  12  11  18446744073709550642 0     
    56     32        14  12  11  18446744073709550626 0     
    57     32        14  12  11  18446744073709550676 0     
    58     32        14  12  11  18446744073709550627 0     
    59     32        14  12  11  18446744073709550662 0     
    60     32        14  12  11  18446744073709550654 0     
    61     32        14  12  11  18446744073709550631 0     
    62     32        14  12  11  18446744073709550618 4      16:inf, 17:-inf, 18:-0, 19:4.9406564584124654e-324
    63     32        14  12  11  18446744073709550626 1      31:nan
    64     32        14  12  11  18446744073709550669 0     
    65     32        14  12  11  18446744073709550618 0     
    66     32        14  12  11  18446744073709550652 0     
    67     32        14  12  11  18446744073709550622 0     
    68     32        14  12  11  18446744073709550632 0     
    69     32        14  12  11  18446744073709550652 0     
    70     32        14  12  11  18446744073709550637 0     
    71     32        14  12  11  18446744073709550636 0     
    72     32        14  12  11  18446744073709550699 0     
    73     32        14  12  11  18446744073709550821 0     
    74     32        14  12  11  18446744073709550626 0     
    75     32        14  12  11  18446744073709550617 0     
    76     32        14  12  11  18446744073709550624 0     
    77     32        14  12  11  18446744073709550622 0     
    78     32        14  12  11  18446744073709550650 1      4:3.1415926535897931
    79     32        14  12  11  18446744073709550767 0     
    80     32        14  12  11  18446744073709550617 0     
    81     32        14  12  11  18446744073709550629 0     
    82     32        14  12  11  18446744073709550748 0     
    83     32        14  12  11  18446744073709550734 0     
    84     32        14  12  11  18446744073709550744 0     
    85     32        14  12  11  18446744073709550701 0     
    86     32        14  12  11  18446744073709550634 0     
    87     32        14  12  11  18446744073709550717 0     
    88     32        14  12  11  18446744073709550627 0     
    89     32        14  12  11  18446744073709550636 0     
    90     32        14  12  11  18446744073709550617 0     
    91     32        14  12  11  18446744073709550625 0     
    92     32        14  12  11  18446744073709550665 0     
    93     32        14  12  11  18446744073709550878 0     
    94     32        14  12  11  18446744073709550651 0     
    95     32        14  12  11  18446744073709550673 0     
    96     32        14  12  11  18446744073709550670 1      28:44974934523.343002
    97     32        14  12  11  18446744073709550729 0     
    98     32        14  12  11  18446744073709550627 0     
    99     32        14  12  11  18446744073709550710 0     
    100    32        14  12  11  18446744073709550658 0     
    101    32        14  12  11  18446744073709550698 0     
    102    32        14  12  11  18446744073709550707 0     
    103    32        14  12  11  18446744073709550680 0     
    104    32        14  12  11  18446744073709550632 0     
    105    32        14  12  11  18446744073709550658 0     
    106    32        14  12  11  18446744073709550753 0     
    107    32        14  12  11  18446744073709550734 0     
    108    32        14  12  11  18446744073709550654 0     
    109    32        14  12  11  18446744073709550818 0     
    110    32        14  12  11  18446744073709550634 0     
    111    32        14  12  11  18446744073709550727 0     
    112    32        14  12  11  18446744073709550747 0     
    113    32        14  12  11  18446744073709550653 0     
    114    32        14  12  11  18446744073709550634 0     
    115    32        14  12  11  18446744073709550665 1      31:-1243432432.3432
    116    32        14  12  11  18446744073709550803 0     
    117    32        14  12  11  18446744073709550778 0     
    118    32        14  12  11  18446744073709550636 0     
    119    32        14  12  11  18446744073709550643 0     
    120    32        14  12  11  18446744073709550637 0     
    121    32        14  12  11  18446744073709550647 0     
    122    32        14  12  11  18446744073709550623 0     
    123    32        14  12  11  18446744073709550655 0     
    124    32        14  12  11  18446744073709550875 0     
    125    32        14  12  11  18446744073709550746 0     
    126    32        14  12  11  18446744073709550656 0     
    127    32        14  12  11  18446744073709550616 0     
    128    32        14  12  11  18446744073709550757 16     0:-5.6894026020883821, 2:-5.7471123414096521, 4:5.2631058917995048, 6:3.0632557599260757, 8:7.4240896660071236, ...
    129    32        14  12  11  18446744073709550880 16     0:8.3615310165433918, 2:-7.4509208403525999, 4:-4.1556354486025482, 6:6.5207809345366901, 8:6.0981354522486946, ...
    130    32        14  12  11  18446744073709550883 16     0:-4.0016177565494946, 2:1.9761659612096527, 4:8.0578997873910296, 6:7.5452351656382159, 8:1.8644314134978135, ...
    131    32        14  12  11  18446744073709550794 16     0:-8.7062622521571491, 2:1.4354470416709053, 4:3.8890091633305257, 6:-3.6610683282734504, 8:-0.71133532824648515, ...
    132    32        14  12  11  18446744073709550708 16     0:-4.6208211430056672, 2:-8.5813557849872311, 4:-9.941579321146051, 6:-0.55013293847550604, 8:8.1476033946762261, ...
    133    32        14  12  11  18446744073709550997 16     0:0.2533545960602801, 2:-9.1122445962695, 4:-2.0596992584046814, 6:-4.3087539817807592, 8:-7.7232320987702971, ...
    134    32        14  12  11  18446744073709551035 16     0:4.4278690443430024, 2:2.7280275284446809, 4:-4.8478556577229304, 6:-9.1888252642959145, 8:3.7317983148228273, ...
    135    32        14  12  11  18446744073709550688 16     0:-7.6852479162007246, 2:7.4739719701666463, 4:2.7575418619624026, 6:8.0490660748490193, 8:6.5803545809650981, ...
    136    32        14  12  11  18446744073709551294 16     0:7.2348498055074062, 2:-1.0716095772092904, 4:-2.315207571730109, 6:7.1512467947328613, 8:5.1870204923517775, ...
    137    32        14  12  11  18446744073709550690 16     0:-1.8074220521761097, 2:-7.974801732640632, 4:2.1155849324871756, 6:6.834467273971967, 8:1.1937688569912508, ...
    138    32        14  12  11  18446744073709550683 16     0:9.118376566890614, 2:7.7680734846461874, 4:9.8971594199675277, 6:-8.2359658322110167, 8:9.2227097535826132, ...
    139    32        14  12  11  18446744073709550679 16     0:0.89655311572229834, 2:1.6093520595004884, 4:9.9942761479839533, 6:2.5246863726085111, 8:-5.8538199798720996, ...
    140    32        14  12  11  18446744073709551010 16     0:4.91720075314237, 2:-7.5035836009805905, 4:3.6151179289175683, 6:7.5418116779382434, 8:9.3921545424686848, ...
    141    32        14  12  11  18446744073709550731 16     0:2.0423396622180889, 2:6.1317867346737938, 4:-5.9905097657978379, 6:-8.8105687167995406, 8:-1.2170036882014579, ...
    142    32        14  12  11  18446744073709550616 16     0:-4.4248025522874324, 2:0.57156218779601531, 4:-9.8227343764463715, 6:-5.9869796689701227, 8:6.5693860547367873, ...
    143    32        14  12  11  18446744073709550660 16     0:-3.0235893916984216, 2:2.6417965307412583, 4:8.9537604738820384, 6:-7.9811759900529164, 8:-4.0086864686154566, ...
    144    32        14  12  11  18446744073709550775 16     0:9.5796223926324124, 2:-5.7074385015131295, 4:2.9563489203160698, 6:-6.2431429413942592, 8:0.061678992210847383, ...
    145    32        14  12  11  18446744073709550792 16     0:2.5911538387824695, 2:-4.5690591258260795, 4:-3.6482640430217295, 6:-6.2192095071071076, 8:-9.0629618159354823, ...
    146    32        14  12  11  18446744073709550790 16     0:-2.4536389886526688, 2:3.5028012979965584, 4:3.7403854407184878, 6:1.2925810948657523, 8:6.8849740579384928, ...
    147    32        14  12  11  18446744073709550825 16     0:-0.48064543664115833, 2:-5.8223455347540902, 4:5.4156123212012801, 6:-8.952899598503107, 8:-6.2795400024970638, ...
    148    32        14  12  11  18446744073709550632 16     0:-8.2931732158632254, 2:-2.6442803347343258, 4:6.4661886545740632, 6:0.31723801876425428, 8:-8.0026636353340344, ...
    149    32        14  12  11  18446744073709550648 16     0:5.458429671205824, 2:-7.3696346789538119, 4:-7.4889956654183116, 6:-8.4723011729449613, 8:6.1431108293243692, ...
    150    32        14  12  11  18446744073709550848 16     0:-0.84008481683608083, 2:-6.9534442089590929, 4:-8.6861029132294689, 6:8.7475688579875754, 8:-0.3184585478003521, ...
    151    32        14  12  11  18446744073709550620 16     0:-7.0607459066610909, 2:0.54530355991387669, 4:-2.2366858324668328, 6:2.8563783069799209, 8:-3.0961558930116695, ...
    152    32        14  12  11  18446744073709550825 16     0:-4.5059238112489295, 2:5.217086960594008, 4:0.93154285823395355, 6:-0.82804099455095814, 8:-6.6850043946836397, ...
    153    32        14  12  11  18446744073709550701 16     0:-6.4780904790686398, 2:2.4468653891885506, 4:-6.1978471138785123, 6:4.6424521356476234, 8:8.8740317586578481, ...
    154    32        14  12  11  18446744073709550744 16     0:8.52388143249315, 2:6.0950624860295877, 4:-5.5584825992302189, 6:-6.4422376112934669, 8:4.5772287599494854, ...
    155    32        14  12  11  18446744073709550889 16     0:2.4407912062346981, 2:-4.9799722992235687, 4:1.4768251244168451, 6:3.1326213638093514, 8:8.0447280418146345, ...
    156    32        14  12  11  18446744073709550655 16     0:-1.3979425730507333, 2:8.9291301691148313, 4:-1.9811647902589369, 6:5.6073099550004502, 8:7.7777484966271349, ...
    157    32        14  12  11  18446744073709550894 16     0:0.31318799197485259, 2:0.78189115255742125, 4:-4.1994161005948092, 6:-9.2485782274463677, 8:0.93401039078769621, ...
    158    32        14  12  11  18446744073709550625 16     0:-3.9413819387106641, 2:6.3605348967262305, 4:6.3355894119144125, 6:-7.4928704268223889, 8:8.0388039086804, ...
    159    32        14  12  11  18446744073709550724 16     0:4.2884833767645052, 2:1.2018339557526869, 4:0.27708918219772949, 6:-6.5582153829331951, 8:-1.0237270643332752, ...
    160    32        14  12  0   0                    32     0:0.98619550441899628, 1:-3.7603195733564965, 2:-0.34999150139969903, 3:0.13345287723017574, 4:-2.2552545378626987, ...
    161    32        14  12  0   0                    32     0:0.030309225771123494, 1:-8.5821684831907916, 2:-3.7427368143085946, 3:8.7059419910650426, 4:7.0136051698203472, ...
    162    32        14  12  0   0                    32     0:2.0220540312628255, 1:9.8072356875118452, 2:-3.4949218142877667, 3:8.8254490414462943, 4:8.2946221923083936, ...
    163    32        14  12  0   0                    32     0:1.0675802903645892, 1:2.8326382686728713, 2:4.0758461738708913, 3:-2.5348037203540308, 4:1.2731994420797244, ...
    164    32        14  12  0   0                    32     0:3.2998903374048272, 1:-0.039192097718393493, 2:4.8564995546281331, 3:-3.4591070495844689, 4:7.8011404866940603, ...
    165    32        14  12  0   0                    32     0:-3.3393025819608448, 1:7.6992861267109021, 2:-2.3343151863427347, 3:-0.12998027809437485, 4:-4.3339046885598895, ...
    166    32        14  12  0   0                    32     0:1.9769081168059244, 1:-5.9780254400246156, 2:1.8046532073106891, 3:-1.8473428184975349, 4:-0.60948918547399256, ...
    167    32        14  12  0   0                    32     0:5.7271546356045411, 1:2.6443319643230301, 2:-2.5295964611953825, 3:-4.5700249378307065, 4:-5.3643282505631404, ...
    168    32        14  12  0   0                    32     0:4.6482773086323785, 1:7.6332496986298608, 2:-7.5700921134951669, 3:2.6927851808921965, 4:1.6428762027311383, ...
    169    32        14  12  0   0                    32     0:0.24569519186426803, 1:-7.7142846015922162, 2:5.296019433959664, 3:3.5779544845953337, 4:5.459734467809632, ...
    170    32        14  12  0   0                    32     0:-4.3823605780407142, 1:-5.8408728185879406, 2:-9.1602915196354804, 3:-0.4147982323665611, 4:-6.3655341491596547, ...
    171    32        14  12  0   0                    32     0:-9.0268466642665715, 1:1.6203017675618803, 2:-1.4785804936358937, 3:0.96064713589713691, 4:0.42146377163920556, ...
    172    32        14  12  0   0                    32     0:4.486888097169988, 1:4.9150676024475111, 2:1.1585489622686085, 3:1.6933618163548947, 4:-7.3269883464269521, ...
    173    32        14  12  0   0                    32     0:-1.6951805537861009, 1:7.76928231063851, 2:6.4865378208616598, 3:2.6007976921151266, 4:7.1624078463715479, ...
    174    32        14  12  0   0                    32     0:-8.39555504120524, 1:-3.7560725740420544, 2:-9.685141643360172, 3:-9.657004335828212, 4:8.3320660505646522, ...
    175    32        14  12  0   0                    32     0:0.080075327275126451, 1:8.9840139404560819, 2:6.6566380693333427, 3:-2.75137352442934, 4:7.2728284712765916, ...
    176    32        14  12  0   0                    32     0:1.6899958306629714, 1:6.6758390542706803, 2:2.8515520751337164, 3:-8.428843366348616, 4:4.8112944261319512, ...
    177    32        14  12  0   0                    32     0:-2.0807682910219616, 1:3.3861721345082563, 2:7.8378619712430408, 3:-3.8789706074727457, 4:1.0375427318974562, ...
    178    32        14  12  0   0                    32     0:9.734582118059782, 1:-4.5726806337250148, 2:-8.0283414335793957, 3:6.5862847794058643, 4:4.1335106375739894, ...
    179    32        14  12  0   0                    32     0:0.45520285235329805, 1:-0.58265292789138612, 2:3.1211004068220105, 3:1.1915770708237261, 4:3.7407829122765968, ...
    180    32        14  12  0   0                    32     0:1.5322800256643609, 1:1.1753189143255649, 2:-2.5766095632162855, 3:5.7128620387194733, 4:-4.9440310924567834, ...
    181    32        14  12  0   0                    32     0:5.7162528403017054, 1:1.7989576463980339, 2:-9.871295818742043, 3:5.4503257361534025, 4:4.0497669426751131, ...
    182    32        14  12  0   0                    32     0:5.4676209982698705, 1:8.2993173231910582, 2:-6.2172180059909845, 3:8.4473497899298078, 4:3.9124930425244209, ...
    183    32        14  12  0   0                    32     0:1.9925512603817586, 1:0.12660616955186832, 2:-2.9917349399110904, 3:8.2586201293275927, 4:-3.2045952822937815, ...
    184    32        14  12  0   0                    32     0:8.0953267620034204, 1:2.9503292765057521, 2:-4.5391876634495887, 3:-6.4561500280262383, 4:-4.1146652777476245, ...
    185    32        14  12  0   0                    32     0:1.6721008306574325, 1:-2.1975952707390158, 2:-2.8973671535649537, 3:-9.0950162201076132, 4:-5.6418258913608375, ...
    186    32        14  12  0   0                    32     0:1.2251135674135649, 1:-5.0751167678352642, 2:-1.5290416971839027, 3:5.8714131917039269, 4:-9.3644304282047273, ...
    187    32        14  12  0   0                    32     0:5.2376723141578196, 1:5.6301129440991726, 2:-4.4848518145311438, 3:-5.9150648522037743, 4:-9.6648737977605546, ...
    188    32        14  12  0   0                    32     0:-1.1176951131509882, 1:5.0005681968987803, 2:0.63322039979124778, 3:0.75565874425611801, 4:-4.4380096874285506, ...
    189    32        14  12  0   0                    32     0:3.1610996562355953, 1:-9.8388178747476562, 2:8.86349644297872, 3:-5.2571106103962943, 4:-7.8477163080531094, ...
    190    32        14  12  0   0                    32     0:-1.3803218971563247, 1:-3.9101493632402851, 2:-6.038089650969348, 3:-8.6861577202510869, 4:7.7423864445777308, ...
    191    32        14  12  0   0                    32     0:-9.806262317234884, 1:7.1591018251743872, 2:4.6231469233923228, 3:8.9351207743550294, 4:5.6323095784117587, ...
  Row group 1: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=2882
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=5 (vector_size=32) num_elements=1024
    num_vectors=32 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      32        16  12  18  18446744073709455585 0     
    1      32        16  12  18  18446744073709451903 0     
    2      32        16  12  18  18446744073709451936 0     
    3      32        16  12  18  18446744073709466645 0     
    4      32        16  12  18  18446744073709457159 0     
    5      32        16  12  18  18446744073709458254 0     
    6      32        16  12  18  18446744073709461342 0     
    7      32        16  12  18  18446744073709455658 0     
    8      32        16  12  18  18446744073709453651 0     
    9      32        16  12  18  18446744073709453082 0     
    10     32        16  12  18  18446744073709462966 0     
    11     32        16  12  18  18446744073709452006 0     
    12     32        16  12  18  18446744073709458827 0     
    13     32        16  12  18  18446744073709452800 0     
    14     32        16  12  18  18446744073709452540 0     
    15     32        16  12  18  18446744073709458086 0     
    16     32        16  12  18  18446744073709458851 0     
    17     32        16  12  18  18446744073709461559 0     
    18     32        16  12  18  18446744073709457346 0     
    19     32        16  12  18  18446744073709452689 0     
    20     32        16  12  18  18446744073709452517 0     
    21     32        16  12  18  18446744073709452131 0     
    22     32        16  12  18  18446744073709451682 0     
    23     32        16  12  18  18446744073709452347 0     
    24     32        16  12  18  18446744073709453078 0     
    25     32        16  12  18  18446744073709452079 0     
    26     32        16  12  18  18446744073709460418 0     
    27     32        16  12  18  18446744073709455391 0     
    28     32        16  12  18  18446744073709459567 0     
    29     32        16  12  18  18446744073709451831 0     
    30     32        16  12  18  18446744073709468192 0     
    31     32        16  12  18  18446744073709452917 0     
  Row group 2: rows=1024 encodings=[ RLE ALP ] compression=uncompressed null_count=0 compressed_bytes=578
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=5 (vector_size=32) num_elements=1024
    num_vectors=32 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      32        16  14  0   777                  0     
    1      32        16  14  0   777                  0     
    2      32        16  14  0   777                  0     
    3      32        16  14  0   777                  0     
    4      32        16  14  0   777                  0     
    5      32        16  14  0   777                  0     
    6      32        16  14  0   777                  0     
    7      32        16  14  0   777                  0     
    8      32        16  14  0   777                  0     
    9      32        16  14  0   777                  0     
    10     32        16  14  0   777                  0     
    11     32        16  14  0   777                  0     
    12     32        16  14  0   777                  0     
    13     32        16  14  0   777                  0     
    14     32        16  14  0   777                  0     
    15     32        16  14  0   777                  0     
    16     32        16  14  0   777                  0     
    17     32        16  14  0   777                  0     
    18     32        16  14  0   777                  0     
    19     32        16  14  0   777                  0     
    20     32        16  14  0   777                  0     
    21     32        16  14  0   777                  0     
    22     32        16  14  0   777                  0     
    23     32        16  14  0   777                  0     
    24     32        16  14  0   777                  0     
    25     32        16  14  0   777                  0     
    26     32        16  14  0   777                  0     
    27     32        16  14  0   777                  0     
    28     32        16  14  0   777                  0     
    29     32        16  14  0   777                  0     
    30     32        16  14  0   777                  0     
    31     32        16  14  0   777                  0     
  Row group 3: rows=808 encodings=[ RLE ALP ] compression=uncompressed null_count=8 compressed_bytes=1598
    ALP header: compression_mode=0 integer_encoding=0 log_vector_size=5 (vector_size=32) num_elements=800
    num_vectors=25 total_exceptions=0
    vector elems     exp fac bw  frame_of_ref         n_exc  first exceptions (pos:value)
    0      32        14  12  11  18446744073709550676 0     
    1      32        14  12  11  18446744073709550617 0     
    2      32        14  12  11  18446744073709550642 0     
    3      32        14  12  11  18446744073709550647 0     
    4      32        14  12  11  18446744073709550628 0     
    5      32        14  12  11  18446744073709550656 0     
    6      32        14  12  11  18446744073709550688 0     
    7      32        14  12  11  18446744073709550707 0     
    8      32        14  12  11  18446744073709550759 0     
    9      32        14  12  11  18446744073709550683 0     
    10     32        14  12  11  18446744073709550693 0     
    11     32        14  12  11  18446744073709550699 0     
    12     32        14  12  11  18446744073709550708 0     
    13     32        14  12  11  18446744073709550634 0     
    14     32        14  12  11  18446744073709550827 0     
    15     32        14  12  11  18446744073709550672 0     
    16     32        14  12  11  18446744073709550640 0     
    17     32        14  12  11  18446744073709550703 0     
    18     32        14  12  11  18446744073709550620 0     
    19     32        14  12  11  18446744073709550631 0     
    20     32        14  12  11  18446744073709550626 0     
    21     32        14  12  11  18446744073709550683 0     
    22     32        14  12  11  18446744073709550686 0     
    23     32        14  12  11  18446744073709550619 0     
    24     32        14  12  11  18446744073709550720 0     

Round-trip verification (bit-exact, including NaN/-0.0):
  float_plain      OK
  double_plain     OK
  float_alp_1024   OK
  double_alp_1024  OK
  float_alp_4096   OK
  double_alp_4096  OK
  float_alp_32     OK
  double_alp_32    OK

All expectations from the issue comment matched.

Co-authored-by: Dhirhan Kanesalingam <dhirhan17@gmail.com>

…racters

Also ensure that no line exceeds 90 characters

This reverts commit e85658b42b5373ef7e54295b100d1f083d55dd8d.

Aligns with Arrow buffer conventions (Buffer::data() returns uint8_t*). This eliminates reinterpret_casts at parquet encoder/decoder call sites. Also updates kAlpVectorSize comment to reflect that arbitrary power-of-2 vector sizes are supported (1024 is just the default, not a limitation).

…e TODO

…tion

…lers

CreateSamplingPreset, EncodeWithPreset, Encode, and GetMaxCompressedSize now return Status / Result instead of aborting on invalid input. Callers in parquet/encoder.cc and the test suites updated; three EXPECT_DEATH tests converted to ASSERT_RAISES(Invalid, ...). Also in this commit: - Strip Snowflake attribution comments from encoding_alp_benchmark.cc - Pause timing around SetData in BM_AlpDecodingDouble so only Decode is measured - Slice data to output size in AlpSamplerTest.PresetGenerationDecimalData (the IsBitwiseEqual migration left this site with a 1024-vs-10000 size mismatch)

Replace ~250 lines of hand-rolled CSV parsing in encoding_alp_benchmark.cc with arrow::csv::TableReader, addressing reviewer feedback. Two helpers handle the three file shapes used by the benchmark: by-name lookup for header-bearing files, and by-index lookup (with optional header skip) for positional access used by the pipe-delimited and headerless datasets. Gate add_parquet_benchmark(encoding_alp_benchmark) on ARROW_CSV in src/parquet/CMakeLists.txt and emit a status message when skipped.

The reviewer suggested initializing `kStoredSize` from member sizes (`sizeof(exponent_) + sizeof(factor_) + sizeof(num_exceptions_)`) rather than from type names. The earlier attempt didn't compile because static data member initializers are evaluated in declaration order — the private members were declared below the public `kStoredSize`, so the names weren't visible yet. Moved the private data members to the top of each class so the public `kStoredSize` initializer can use `sizeof(member_)` directly. Dropped the out-of-class drift-guard `static_assert`, redundant once the member names are in the initializer.

sfc-gh-pgaur and others added 30 commits December 8, 2025 23:47

Add alp code

0d442fd

Co-authored-by: Dhirhan Kanesalingam <dhirhan17@gmail.com>

Integrate ALP with arrow

06d1e19

Add alp benchmark

a98c594

Add datasets for alp benchmarking

c297f97

Update cmake file

ab928e8

Move hpp files to h

6a95a59

Update flow digram and layout digram to use ASCII and not unicode cha…

865e46a

…racters

Rename cpp files to cc

cb6d0b6

Update documentation to align with arrow's doxygen style

496e23b

Adapt methods and variable names to arrow style

8803b52

Also ensure that no line exceeds 90 characters

Update the tests to adhere to arrow style code

31e94ec

Update callers

46c0ecc

Fuse FOR and decode loop

a70b08f

Reduce memory allocation in the decompress call

ccbb1dd

Attempt at making decoding faster with SIMD

6a01df2

Revert "Attempt at making decoding faster with SIMD"

4ced783

This reverts commit e85658b42b5373ef7e54295b100d1f083d55dd8d.

Move cpp files to cc

4fac73c

Move data file to parquet-testing submodule

1cb0852

Update path to the data file

8d307a6

Adapt files names to arrow convention

0908342

File rename

e56c877

Obtain compressed size and number of elements from page header

cfa00ba

Fix namespace depth

a1d11ee

Better pack the compression block header

719468b

Rename class

69b4e07

Rearrage field for vector metadata for better packing

193a808

Add spec files

11aaab3

Add more tests

c7e7569

Move number of elements metadata info to uber header

acbc8ba

Keep version as 1

6b3e2ed

sfc-gh-pgaur and others added 25 commits June 8, 2026 05:18

Replace trailing return types with explicit return types

8f64e08

Cite ALP paper §3.1.2 for combination tie-break rule

363d7dd

Pin AlpMode underlying type to uint8_t for serialization safety

342d69a

Address reviewer nits: doc tweaks, sizeof(member_), incremental-decod…

0e30304

…e TODO

Convert AlpSampler uint64_t to int64_t

ac751bb

Remove apacheGH-48701 reference from incremental-decode TODO

04e4e45

Document actual crash/abort behavior in AlpCodec encode-path docs

205e600

Use bit_util::CeilDiv for vector-count computations in AlpCodec

fe5fc46

Replace memcmp with IsBitwiseEqual helper in alp_test.cc

0944b89

Type-parameterize alp_test integration tests and fix TruncatedData

562aeaa

Type-parameterize AlpEncodingAdHoc tests in encoding_test.cc

03236af

Widen RandomData test range to exercise ALP exception fallback path

89435ce

Remove uncompiled generate_alp_parquet and generate_reference_blobs

4cb0f9a

Add incremental-encode TODO and snake_case rename in AlpEncoder

4d92a98

Rename EncodeAlp parameter combinations to preset

50d5364

Use bit_util::IsPowerOf2 and BytesForBits instead of raw bit manipula…

9e4c30a

…tion

Remove remaining 'non-templated' references in ALP comments

9057c3b

Remove GetBitPackedSize wrapper, inline bit_util::BytesForBits at cal…

12668f3

…lers

Code review changes

658aa56

[WIP] test driver for creating ALP encoded files

7ad79b7

example

d873373

alamb force-pushed the alamb/example_encoding_writer branch from 7cb4f48 to d873373 Compare August 3, 2026 21:59

github-actions Bot removed the Component: Documentation label Aug 3, 2026

Update for synthetic files

e41c4c5

alamb mentioned this pull request Aug 4, 2026

Add single ALP test file (216KB, covers corner cases) apache/parquet-testing#119

Open

Add some nan variety and a large FOR value

195ebd5

Navigation Menu

Uh oh!

[WIP] CLI program to write ALP encode example parquet files - #49154

[WIP] CLI program to write ALP encode example parquet files#49154
alamb wants to merge 116 commits into
apache:mainfrom
alamb:alamb/example_encoding_writer

alamb commented Feb 5, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

alamb commented Feb 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

alamb commented Feb 5, 2026 •

edited

Loading