Skip to content
This repository was archived by the owner on Jan 27, 2020. It is now read-only.
This repository was archived by the owner on Jan 27, 2020. It is now read-only.

Implement Spark Transformation Type #2

@utzwestermann

Description

@utzwestermann

We should build a Schedoscope-RDD that allows one to directly specify Spark pipelines outgoing from the dependencies of a view in the transformVia clause. Since all views are Hive table partitions, this should be doable using SQL-RDDs. More problematic is bringing the final RDD into the partition of the view itself.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions