Skip to content

bug: it is possible to reach GraphFramesUnreachableException #765

@SemyonSinchenko

Description

@SemyonSinchenko

Describe the bug
If Graph has Long-like ID type and at the same time contains NULLs for src, dst or id the GraphFramesUnreachableExcpetion will be raised from this method

To Reproduce

Steps to reproduce the behavior:

  1. ...
  2. ...
  3. ...

Expected behavior

NULLs are not supported of course and it is a case of malformed graph. But exception should be meaningful.

System [please complete the following information]:

  • OS: e.g. [Ubuntu 18.04]
  • Python Version (if applied): [e.g. Python 3.8]
  • Spark / PySpark version: [e.g. PySpark 3.5.1]
  • GraphFrames version: [e.g. graphframes-0.9.0]

Component

  • Scala Core Internal
  • Scala API
  • Spark Connect Plugin
  • PySpark Classic
  • PySpark Connect

Additional context

Are you planning on creating a PR?

  • I'm willing to make a pull-request

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions