22 Pull requests merged by 9 people

• Build: Bump com.google.cloud:libraries-bom from 26.47.0 to 26.48.0

  #11271 merged Oct 7, 2024

• AWS: Make sure overridden configurations are applied

  #11274 merged Oct 7, 2024

• API, Core: Add default value APIs and Avro implementation

  #9502 merged Oct 4, 2024

• Build: Forbid implicit case fall-through without a comment and enable couple more recommendable error-prone checks

  #11251 merged Oct 4, 2024

• Build: Update baseline-java 5.69.0

  #11252 merged Oct 4, 2024

• Build: Bump org.xerial:sqlite-jdbc from 3.46.1.0 to 3.46.1.3

  #11231 merged Oct 3, 2024

• Build: Bump org.eclipse.microprofile.openapi:microprofile-openapi-api from 3.1.1 to 3.1.2

  #11182 merged Oct 3, 2024

• Build: Bump mkdocs-material from 9.5.34 to 9.5.38

  #11233 merged Oct 3, 2024

• Puffin: Document stats ndv value representation

  #10793 merged Oct 3, 2024

• AWS: Set better defaults for S3 retry behaviour

  #11052 merged Oct 1, 2024

• Core: Deprecate legacy ways for loading position deletes

  #11242 merged Oct 1, 2024

• ThreadPools introduce newExitingWorkerPool and newFixedThreadPool for clearer semantics

  #11073 merged Oct 1, 2024

• Build: Bump nessie from 0.97.1 to 0.99.0

  #11224 merged Oct 1, 2024

• Core: Add DataFileSet / DeleteFileSet

  #11195 merged Oct 1, 2024

• Core: Support combining position deletes during writes

  #11222 merged Oct 1, 2024

• REST: Handle Requests with Page Sizes Exceeding Available Number of Namespaces /Tables/Views

  #11143 merged Sep 30, 2024

• Core: Improve error handling when parsing view representations

  #11236 merged Sep 30, 2024

• Build: Bump io.delta:delta-spark_2.12 from 3.2.0 to 3.2.1

  #11225 merged Sep 30, 2024

• Build: Bump junit-platform from 1.10.3 to 1.11.1

  #11227 merged Sep 30, 2024

• Build: Bump io.delta:delta-standalone_2.12 from 3.2.0 to 3.2.1

  #11228 merged Sep 30, 2024

• Build: Bump software.amazon.awssdk:bom from 2.28.5 to 2.28.11

  #11229 merged Sep 30, 2024

• Build: Bump guava from 33.3.0-jre to 33.3.1-jre

  #11230 merged Sep 30, 2024

24 Pull requests opened by 13 people

• Puffin: Add delete-vector-v1 blob type

  #11238 opened Sep 30, 2024

• Spec v3: Add deletion vectors to the table spec

  #11240 opened Sep 30, 2024

• Fflink: Add table.exec.iceberg.use-v2-sink option

  #11244 opened Oct 1, 2024

• Arrow: Fix indexing in Parquet dictionary encoded values readers

  #11247 opened Oct 2, 2024

• Flink: FlinkSink & IcebergSink desynchronized tests alignment

  #11249 opened Oct 2, 2024

• Core: Rename DeleteFileHolder to PendingDeleteFile / Optimize duplicate data/delete file detection

  #11254 opened Oct 4, 2024

• Demonstrate bug for issue #11253

  #11256 opened Oct 4, 2024

• Initial Support for Spark 4.0 preview2

  #11257 opened Oct 4, 2024

• More accurate estimate on parquet row groups size

  #11258 opened Oct 4, 2024

• [AWS] S3FileIO - Add Cross-Region Bucket Access

  #11259 opened Oct 5, 2024

• Spec: Add cross-region bucket access property to config

  #11260 opened Oct 5, 2024

• Api, Spark: Make StrictMetricsEvaluator not fail on nested column predicates

  #11261 opened Oct 5, 2024

• [WIP] Bump junit from 5.10.1 to 5.11.1

  #11262 opened Oct 5, 2024

• Build: Bump junit from 5.10.1 to 5.11.2

  #11263 opened Oct 6, 2024

• Build: Bump parquet from 1.13.1 to 1.14.3

  #11264 opened Oct 6, 2024

• Build: Bump org.testcontainers:testcontainers from 1.20.1 to 1.20.2

  #11265 opened Oct 6, 2024

• Build: Bump junit-platform from 1.11.1 to 1.11.2

  #11266 opened Oct 6, 2024

• Build: Bump com.azure:azure-sdk-bom from 1.2.25 to 1.2.28

  #11267 opened Oct 6, 2024

• Build: Bump software.amazon.awssdk:bom from 2.28.11 to 2.28.16

  #11268 opened Oct 6, 2024

• Build: Bump io.netty:netty-buffer from 4.1.113.Final to 4.1.114.Final

  #11269 opened Oct 6, 2024

• Build: Bump com.google.errorprone:error_prone_annotations from 2.31.0 to 2.33.0

  #11270 opened Oct 6, 2024

• Build: Bump mkdocs-material from 9.5.38 to 9.5.39

  #11272 opened Oct 6, 2024

• Spark: Synchronously merge new position deletes with old deletes

  #11273 opened Oct 7, 2024

• Added support for evolving the partition of the table

  #11275 opened Oct 7, 2024

82 Issues closed by 6 people

• Support Hudi `DeltaStreamer` compatible feature

  #8724 closed Oct 7, 2024

• Null support in Apache Flink

  #8720 closed Oct 7, 2024

• Upsert support for keyless Apache Flink tables

  #8719 closed Oct 7, 2024

• Support deletion in Apache Flink

  #8718 closed Oct 7, 2024

• Optimize metadata tables?

  #8714 closed Oct 7, 2024

• S3 compression Issue with Iceberg

  #8713 closed Oct 7, 2024

• Spec: Add `141: spec_id` and `142: schema_id` to the spec

  #8712 closed Oct 7, 2024

• spark read much volume of data from one source when storage partition join implemented

  #8710 closed Oct 7, 2024

• De-Duping Rows While Compacting

  #8702 closed Oct 7, 2024

• Various fields in Manifest & ManifestList not written in accordance to the Spec

  #8699 closed Oct 7, 2024

• TestIcebergSourceFailover fails when running with JDK17

  #8680 closed Oct 7, 2024

• Flakiness in TestMetadataTableReadableMetrics#testPrimitiveColumns()

  #8679 closed Oct 7, 2024

• Support Zorder for data writes (not just rewrites)

  #8674 closed Oct 6, 2024

• Could there be duplicate values in the result returned by the findOrphanFiles method?

  #8670 closed Oct 6, 2024

• How does iceberg solve the problem of small files? Is there any good solution?

  #8663 closed Oct 6, 2024

• Document Azure and GCP integration

  #8662 closed Oct 6, 2024

• Cannot specify custom delete handler when using a DeleteFiles in a Transaction

  #8642 closed Oct 6, 2024

• Build a util to read and write partition stats file for a table on a single node.

  #8456 closed Oct 5, 2024

• Introduce PartitionEntry class to represent stats per partition

  #8455 closed Oct 5, 2024

• Flaky test/env TestFileRewriteCoordinator

  #8441 closed Oct 5, 2024

• Logic about Hive version checking in MetastoreLock

  #8440 closed Oct 5, 2024

• Clarity on serialization format of schema.name-mapping.default in Iceberg metadata

  #8437 closed Oct 5, 2024

• Can we do Client side Encryption with Iceberg format?

  #8431 closed Oct 5, 2024

• Iceberg containing Parquet v2 files cannot be read unless read.parquet.vectorization.enabled is set to false

  #8430 closed Oct 5, 2024

• ICEBERG_CANNOT_OPEN_SPLIT: Error opening Iceberg split s3

  #8427 closed Oct 5, 2024

• spark-procedures migrating tables can pose fatal problems

  #8425 closed Oct 5, 2024

• [Feature] Fast forward branch to a specific snapshot id

  #8424 closed Oct 5, 2024

• appendManifest API is not thread safe

  #8420 closed Oct 5, 2024

• Unable to write to iceberg table using spark

  #8419 closed Oct 5, 2024

• Flink Iceberg

  #8417 closed Oct 5, 2024

• Does expireSnapshotId delete older snapshots data files?

  #8410 closed Oct 5, 2024

• HDFS BlockMissingException when trying to read Hive data using Iceberg jars with erasure coding enabled

  #8399 closed Oct 5, 2024

• SPJ joins in the outer join component of MERGE queries

  #8387 closed Oct 5, 2024

• Apache Iceberg - Update one record in the table doubles the number of files in the whole table

  #8378 closed Oct 5, 2024

• Cannot set a custom location for path based tables

  #8377 closed Oct 5, 2024

• Docs: document the detail impact of the configuration 'compatibility.snapshot-id-inheritance.enabled'

  #8375 closed Oct 5, 2024

• If you don't restore from checkpoint, how does flink consume from the last snapshot increment? Like kafka.

  #8348 closed Oct 5, 2024

• Docs: Improve branch/tagging branch fast-forward (branch always on HEAD) semantics

  #8638 closed Oct 4, 2024

• spark read error with Failed to open file

  #8635 closed Oct 4, 2024

• Large Iceberg Parquet file writes are (sometimes?) truncated

  #8620 closed Oct 4, 2024

• Dropping a previous Iceberg sort order field causes org.apache.iceberg.exceptions.ValidationException

  #8614 closed Oct 4, 2024

• pyiceberg 0.5.0 cli __init__() takes at least 1 positional argument (0 given)

  #8606 closed Oct 4, 2024

• Debug sporadic structured streaming failures

  #8603 closed Oct 4, 2024

• Ambiguiety around `list`, `map` and `struct` null counts

  #8598 closed Oct 4, 2024

• Write format arrow

  #8580 closed Oct 4, 2024

• Snapshot Expiration Behavior Inconsistency with TIMESTAMP AS OF and VERSION AS OF

  #8565 closed Oct 4, 2024

• ConnectionUrl property for CatalogProperties

  #8557 closed Oct 4, 2024

• CASCADE WITH Drop Namespace Gives exception

  #8529 closed Oct 4, 2024

• Rest catalog server doesn't return table configuration as expected.

  #8526 closed Oct 4, 2024

• ALTER TABLE ... DROP COLUMN allows dropping the last column of a table

  #8522 closed Oct 4, 2024

• Discrepancy between table configuration default value and Spark documentation

  #8516 closed Oct 4, 2024

• Iceberg table support specified column comments by flinksql create

  #8511 closed Oct 4, 2024

• spark sql delete or merge can support run in batch?

  #8509 closed Oct 4, 2024

• Build incremental update for a stats file based on incremental scan.

  #8460 closed Oct 4, 2024

• Implement Synchronous partition stats writing during write operation (controlled by table property).

  #8458 closed Oct 4, 2024

• Export to Long Term Storage and Re Loading

  #8339 closed Oct 4, 2024

• spark write orc error: Java heap space

  #8318 closed Oct 4, 2024

• Add the document for Spark properties

  #8314 closed Oct 4, 2024

• Creating an existing database with spark sql command "Create database if exists" throws exception

  #8298 closed Oct 4, 2024

• Supporting `double` type for `truncate` partitioning

  #8275 closed Oct 4, 2024

• [FeatureRequest] Statistics: Average column width for dynamically-sized types

  #8274 closed Oct 4, 2024

• DataTableScan may not include Unpartitioned data in the results

  #8269 closed Oct 4, 2024

• Support rebase one branch onto other branch

  #8268 closed Oct 4, 2024

• Provide `jsonschema` for the Metadata

  #8266 closed Oct 4, 2024

• Default table properties not respected when using Spark DataFrame API

  #8265 closed Oct 4, 2024

• Docs: document the compareWithFileList parameter

  #8155 closed Oct 4, 2024

• iceberg materialized views

  #8143 closed Oct 4, 2024

• Spark: Data cannot be written to iceberg using the spark v1 interface

  #8124 closed Oct 4, 2024

• Compatibility between Flink connector and Iceberg table

  #8115 closed Oct 4, 2024

• Use timezone of the object inspector while constructing primitive Java objects for timestamp with local time zone

  #8112 closed Oct 4, 2024

• Reset data file's storage location after change partition

  #8110 closed Oct 4, 2024

• Delete/Update fails for tables with more than 1000 columns

  #6368 closed Oct 4, 2024

• Iceberg support ranger to make access data more safety

  #3619 closed Oct 4, 2024

• Flink CDC job getting failed due to G1 old gc and large checkpointing time

  #2900 closed Oct 4, 2024

• UUID write requires different record in Parquet and ORC/Avro

  #1881 closed Oct 4, 2024

• Add view support for Hive catalog

  #8698 closed Oct 2, 2024

• Why call deleteKey for Insert and Update After in Flink BaseDeltaTaskWriter?

  #11081 closed Oct 2, 2024

• Flink: Maintenance - ExpireSnapshots

  #10304 closed Oct 1, 2024

• Flink: Maintenance - TableMaintenanceBuilder

  #10307 closed Oct 1, 2024

• Can sparksql ddl define primary key now?

  #8508 closed Oct 1, 2024

• While decrypting iceberg table data using aws encyption sdk getting unsupported version error

  #8497 closed Oct 1, 2024

• unify streaming and batch, combining FLink and iceberg.In case In pipeline, Is kafka necessary?

  #8468 closed Oct 1, 2024

10 Issues opened by 9 people

• Validation Error in ConfigResponse Model with RestCatalog in PyIceberg using Nessie REST API

  #11255 opened Oct 4, 2024

• write.metadata.metrics.max-inferred-column-defaults doesn't respect nested columns

  #11253 opened Oct 3, 2024

• Inexplainable behavior for SQLCatalog with Postgres and MinIO

  #11250 opened Oct 3, 2024

• Spark: MERGE INTO does not push down the predicate of the WHEN NOT MATCHED BY SOURCE … THEN DELETE clause

  #11248 opened Oct 2, 2024

• Flink: Maintenance - Add support for more kinds of scheduling

  #11246 opened Oct 1, 2024

• Improve Memory Use in SparkScanBuilder

  #11245 opened Oct 1, 2024

• Snapshot chain getting broken - data incorrectly removed

  #11243 opened Oct 1, 2024

• [Deduplication]primary key working differently when running in same session vs running a new session

  #11241 opened Oct 1, 2024

• BaseDeleteLoader may ignore delete records for binary columns

  #11239 opened Sep 30, 2024

• Downloads link to Flink 1.20 runtime for Iceberg 1.6.1 leads to 404

  #11237 opened Sep 30, 2024

115 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Flink: Tests alignment for the Flink Sink v2-based implemenation (IcebergSink)

  #11219 commented on Oct 2, 2024 • 22 new comments

• Always update table metadata when `refresh` is called

  #11194 commented on Oct 5, 2024 • 18 new comments

• Materialized View Spec

  #11041 commented on Oct 4, 2024 • 16 new comments

• Spark: Add RewriteTablePath action interface

  #10920 commented on Oct 4, 2024 • 15 new comments

• Spec: Add v3 types and type promotion

  #10955 commented on Oct 4, 2024 • 13 new comments

• Spec: Support geo type

  #10981 commented on Oct 1, 2024 • 10 new comments

• API: Add RemoveUnusedSpecs in Table

  #10755 commented on Oct 2, 2024 • 9 new comments

• Flink: Maintenance - TableManager ExpireSnapshots

  #11144 commented on Oct 1, 2024 • 9 new comments

• Core: Add internal Avro reader

  #11108 commented on Oct 5, 2024 • 9 new comments

• OpenAPI: Standardize credentials in loadTable/loadView responses

  #10722 commented on Oct 2, 2024 • 3 new comments

• API, Core: Add scan planning api request and response models

  #11180 commented on Oct 2, 2024 • 3 new comments

• Use Snapshot's statistics file in SparkScan

  #11040 commented on Oct 1, 2024 • 3 new comments

• WIP: Initial Support for Spark 4.0

  #10622 commented on Sep 30, 2024 • 2 new comments

• AWS: Introduce opt-in S3LocationProvider which is optimized for S3 performance

  #11112 commented on Oct 4, 2024 • 2 new comments

• update PartitionSpec with snapshot'schema

  #11196 commented on Oct 5, 2024 • 2 new comments

• Core: Update TableMetadataParser to close streams

  #11220 commented on Oct 5, 2024 • 2 new comments

• Core: Add reference snapshot ID/timestamps to AllEntriesTable and AllManifestsTable

  #9335 commented on Oct 1, 2024 • 1 new comment

• Core: fix NPE with HadoopFileIO because FileIOParser doesn't serialize Hadoop configuration

  #10926 commented on Oct 7, 2024 • 1 new comment

• Remove redundant error propagation check.

  #9143 commented on Oct 6, 2024 • 0 new comments

• Added test about CDC creation failure after expiring all the snapshots

  #9141 commented on Oct 6, 2024 • 0 new comments

• Core: Add manifest file filtering when filtering partitions.

  #9128 commented on Oct 6, 2024 • 0 new comments

• Simplify switch case in GenericAvroReader's primitive method

  #9095 commented on Oct 6, 2024 • 0 new comments

• Spark: Add serialzable isolation test for concurrent MERGE INTOs

  #9050 commented on Oct 1, 2024 • 0 new comments

• Core: Implement equals/hashCode method for RESTResponse

  #9049 commented on Oct 1, 2024 • 0 new comments

• Support tencent COS fileIO

  #9048 commented on Oct 1, 2024 • 0 new comments

• Use SupportsPrefixOperations for Remove OrphanFile Procedure

  #7914 commented on Oct 4, 2024 • 0 new comments

• Core: Fix retry behavior for Jdbc Client

  #7561 commented on Oct 4, 2024 • 0 new comments

• API: Add ParquetUtils.getSplitOffsets that takes an InputFile

  #7267 commented on Oct 4, 2024 • 0 new comments

• Decouple modules Hive 2 and 3 Versions and make Hive 3 as default

  #9113 commented on Oct 6, 2024 • 0 new comments

• Generate iceberg metadata file based on _spark_metadata

  #9270 commented on Oct 7, 2024 • 0 new comments

• [Core][Spark] Improve DeleteOrphanFiles action to return additional details of deleted orphan files

  #7127 commented on Oct 4, 2024 • 0 new comments

• java.lang.ClassNotFoundException: Failed to find data source: iceberg. Issue when we are using Java Custom Catalog

  #9275 commented on Oct 7, 2024 • 0 new comments

• Querying metadata tables for a branch or tag

  #9279 commented on Oct 7, 2024 • 0 new comments

• Create Branches / TAGS between 2 snapshots

  #9281 commented on Oct 7, 2024 • 0 new comments

• Hive: Unwrap RuntimeException for Hive InvalidOperationException

  #9289 commented on Oct 7, 2024 • 0 new comments

• API,Core: Support Conditional Commits

  #6513 commented on Oct 4, 2024 • 0 new comments

• Core: Rollback compaction on conflicts

  #5888 commented on Oct 4, 2024 • 0 new comments

• How to avoid partition key sorting when inserting data into a partitioned Iceberg table?

  #10181 commented on Oct 7, 2024 • 0 new comments

• PoC: Add Variant type support in Iceberg

  #11201 commented on Oct 3, 2024 • 0 new comments

• Config for deciding whether to use Iceberg Time type

  #11174 commented on Oct 7, 2024 • 0 new comments

• Core: Fix UnicodeUtil#truncateStringMax returns malformed string.

  #11161 commented on Oct 5, 2024 • 0 new comments

• Core: Switch usage to DataFileSet / DeleteFileSet

  #11158 commented on Oct 2, 2024 • 0 new comments

• Spark 3.5: Fix NotSerializableException when migrating partitioned Spark tables

  #11157 commented on Oct 6, 2024 • 0 new comments

• Build: Bump org.apache.datasketches:datasketches-java from 6.0.0 to 6.1.0

  #11137 commented on Sep 30, 2024 • 0 new comments

• Core: Optimize MergingSnapshotProducer to use referenced manifests to determine if manifest needs to be rewritten

  #11131 commented on Sep 30, 2024 • 0 new comments

• Build: Bump org.apache.hadoop.thirdparty:hadoop-shaded-guava from 1.2.0 to 1.3.0

  #11061 commented on Oct 1, 2024 • 0 new comments

• Build: Bump net.snowflake:snowflake-jdbc from 3.18.0 to 3.19.0

  #11057 commented on Oct 1, 2024 • 0 new comments

• Arrow: add support for null vectors

  #10953 commented on Oct 2, 2024 • 0 new comments

• Deprecate ContentCache.invalidateAll

  #10494 commented on Oct 6, 2024 • 0 new comments

• Iceberg/Comet integration POC

  #9841 commented on Oct 5, 2024 • 0 new comments

• [AWS] S3FileIO - Add Cross-Region Bucket Access

  #9804 commented on Oct 5, 2024 • 0 new comments

• Add support for CreateScan and GetScanTasks in RESTCatalog

  #9252 commented on Oct 7, 2024 • 0 new comments

• Rest Catalog: Add RESTful data operations

  #9237 commented on Oct 7, 2024 • 0 new comments

• Spark SystemFunctions are not pushed down during JOIN

  #9233 commented on Oct 7, 2024 • 0 new comments

• Spark: Use Awaitility instead of Thread.sleep

  #9224 commented on Oct 7, 2024 • 0 new comments

• Spark: IN clause on system function is not pushed down

  #9192 commented on Oct 6, 2024 • 0 new comments

• Core: Suppress exceptions in case of dropTableData

  #9184 commented on Oct 6, 2024 • 0 new comments

• Parquet: Add a table property to control the Parquet row-group size of position delete files

  #9177 commented on Oct 6, 2024 • 0 new comments

• Time Travel / Snapshot Performance

  #9112 commented on Oct 6, 2024 • 0 new comments

• Implement incremental update using commit stats (SnapshotSummary)

  #8461 commented on Oct 6, 2024 • 0 new comments

• Partition stats task tracker

  #8450 commented on Oct 5, 2024 • 0 new comments

• Kafka Connect: route to table using topic name

  #11163 commented on Oct 4, 2024 • 0 new comments

• REST Catalog does not validate "to" identifier on rename table

  #11154 commented on Oct 4, 2024 • 0 new comments

• Docs: Fix MkDocs ASF nav links

  #8965 commented on Oct 4, 2024 • 0 new comments

• DeleteOrphanFiles or ExpireSnapshots outofmemory

  #3703 commented on Oct 4, 2024 • 0 new comments

• Data Deletion Issue with MERGE INTO ... WHEN MATCHED THEN DELETE statement in Iceberg 1.3 with Spark 3.4.1

  #8126 commented on Oct 4, 2024 • 0 new comments

• Does JDBC connector uses any retry mechanism?

  #7173 commented on Oct 4, 2024 • 0 new comments

• Support Parquet v2 Spark vectorized read

  #7162 commented on Oct 4, 2024 • 0 new comments

• Create empty snapshot for metadata operations

  #7075 commented on Oct 4, 2024 • 0 new comments

• Support Page Skipping in Iceberg Parquet Reader

  #193 commented on Oct 4, 2024 • 0 new comments

• Max number of columns

  #9220 commented on Oct 3, 2024 • 0 new comments

• Disaster Recovery Options for AWS Athena/Iceberg Integration

  #6619 commented on Oct 3, 2024 • 0 new comments

• Add User Interface to Iceberg based lakehouse

  #10980 commented on Oct 3, 2024 • 0 new comments

• hive iceberg

  #9094 commented on Oct 3, 2024 • 0 new comments

• Metrics for Manifest file caching

  #9093 commented on Oct 3, 2024 • 0 new comments

• It sometimes throws exception java.lang.AssertionError: assertion failed after upgrade to Iceberg 1.3.1 Spark 3.4.1

  #9092 commented on Oct 3, 2024 • 0 new comments

• [Parquet] When reading struct-type data without an id in iceberg-parquet, it returns null values.

  #11214 commented on Oct 2, 2024 • 0 new comments

• Extend check-nullability parameter scope to allow writing optional list elements and map values to required elements and values

  #9091 commented on Oct 2, 2024 • 0 new comments

• Failed to create namespace using spark sql based on iceberg hadoop catalog (rest catalog)

  #9072 commented on Oct 2, 2024 • 0 new comments

• Iceberg: Partition-Level Tagging Support

  #9060 commented on Oct 2, 2024 • 0 new comments

• Error generating Go code from rest-catalog-open-api.yaml

  #9070 commented on Oct 2, 2024 • 0 new comments

• Iceberg data file Not Found but have an entry in table.files catalog

  #8338 commented on Oct 1, 2024 • 0 new comments

• Unable to query iceberg table , getting unable to open manifest file "org.apache.avro.InvalidAvroMagicException: Not an Avro data file"

  #11070 commented on Oct 1, 2024 • 0 new comments

• Variant Data Type Support

  #10392 commented on Oct 1, 2024 • 0 new comments

• how to update nested column value with spark

  #10557 commented on Oct 1, 2024 • 0 new comments

• org.apache.iceberg.hive.RuntimeMetaException: Failed to connect to Hive Metastore at

  #9030 commented on Oct 1, 2024 • 0 new comments

• Can databricks volume be implemented on Iceberg?

  #9249 commented on Oct 7, 2024 • 0 new comments

• DeltaLakeToIcebergMigration Performance

  #9246 commented on Oct 7, 2024 • 0 new comments

• Unable to create Iceberg table with HiveCatalog=> org.apache.iceberg.hive.RuntimeMetaException: Failed to connect to Hive Metastore

  #9244 commented on Oct 7, 2024 • 0 new comments

• StreamingMonitorFunction ignores the "streaming-strategy" and the "start-snapshot-timestamp" when set

  #9235 commented on Oct 7, 2024 • 0 new comments

• Spark SystemFunctions are not pushed down during MERGE

  #9232 commented on Oct 7, 2024 • 0 new comments

• Flink SQL encountered an exception while reading the iceberg table

  #9228 commented on Oct 7, 2024 • 0 new comments

• Flink: Emit watermarks for the new timestamp_ns and timestamptz_ns types

  #9137 commented on Oct 7, 2024 • 0 new comments

• How many concurrent operations can be supported at most when multiple Spark tasks write to iceberg same table?

  #9218 commented on Oct 6, 2024 • 0 new comments

• SparkCopyOnWriteScan and RowLevelCommandDynamicPruning do not support V2 filtering

  #9215 commented on Oct 6, 2024 • 0 new comments

• RewritePositionDeleteFiles cannot work with equality delete file?

  #9209 commented on Oct 6, 2024 • 0 new comments

• How to connect apache iceberg to minio

  #9205 commented on Oct 6, 2024 • 0 new comments

• Flink Rewrite Files Action OOM

  #9193 commented on Oct 6, 2024 • 0 new comments

• Spark: IN clause on system function is not pushed down

  #9191 commented on Oct 6, 2024 • 0 new comments

• Flink throw an exception while reading table data through icebergsource

  #9188 commented on Oct 6, 2024 • 0 new comments

• Inconsistent query results after partition key change

  #9186 commented on Oct 6, 2024 • 0 new comments

• Proxy support unavailable for iceberg spark client

  #9174 commented on Oct 6, 2024 • 0 new comments

• metadata json conflict when streaming

  #9171 commented on Oct 6, 2024 • 0 new comments

• Allow for - in Glue Catalog DB/Table names

  #9169 commented on Oct 6, 2024 • 0 new comments

• flink programs sometimes fail to write to icebergTable. The.avro file in metadata cannot be found

  #9168 commented on Oct 6, 2024 • 0 new comments

• encountered a problem while making multiple bucket maybe a bug

  #9167 commented on Oct 6, 2024 • 0 new comments

• Cannot delete files cleanly with CatalogUtil::dropTableData

  #9164 commented on Oct 6, 2024 • 0 new comments

• Considering adjust the default row-group size of Parquet position delete file

  #9149 commented on Oct 6, 2024 • 0 new comments

• Unclosed input streams when writing with high throughput

  #9148 commented on Oct 6, 2024 • 0 new comments

• BaseLockManager.scheduler doesn't shutdown when closing

  #9142 commented on Oct 6, 2024 • 0 new comments

• The snapshots_id is not found in the table.snapshots

  #9140 commented on Oct 6, 2024 • 0 new comments

• With spark and hive thrift server, inserts to iceberg table in one connection are not seen in another

  #9135 commented on Oct 6, 2024 • 0 new comments

• The query result of `col > x` may be incorrect when there are NaN values in the column `col`

  #9130 commented on Oct 6, 2024 • 0 new comments

• `GlueTableOperations` retries on Access Denied exceptions from S3, and does not support configuration of exception retry logic

  #9124 commented on Oct 6, 2024 • 0 new comments

• TBLPROPERTIES('history.expire.max-snapshot-age-ms') doesn't work

  #9123 commented on Oct 6, 2024 • 0 new comments