Skip to content

Dynamic Spark code Fails validate #40

Description

@alecuba16

When I create a pipeline in CDAP studio / data fusion and add a dynamic spark transformation with spark scala code inside. A simple

def transform(df: DataFrame) : DataFrame = {
  df
}

Fails the validation.

The validation error is:

Errors
org.apache.spark.api.java.function.Function

What is the problem?

thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions