Skip to content

Cannot parse missing long: current-snapshot-id #1164

@kevinjqliu

Description

@kevinjqliu

Apache Iceberg version

None

Please describe the bug 🐞

From slack,

Hi! We’ve noticed that after creating an empty table in the Glue catalog with PyIceberg, initially there are no snapshots. Then if we run a glue job with a merge statement to upsert some CDC records in this table, the job fails with an error Error Category: UNCLASSIFIED_ERROR; IllegalArgumentException: Cannot parse missing long: current-snapshot-id. A workaround that resolved this was to insert and delete a dummy row after creating the table, but that doesn’t seem right. Is this a Glue / Spark bug or did we miss something?

Error Category: UNCLASSIFIED_ERROR; IllegalArgumentException: Cannot parse missing long: current-snapshot-id

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions