Skip to content

calc error #10

@WF1a

Description

@WF1a

https://spoddutur.github.io/spark-notes/distribution_of_executors_cores_and_memory_for_spark_application

So, if we request 20GB per executor, AM will actually get 20GB + memoryOverhead = 20 + 7% of 20GB = ~23GB memory for us.

20GB + memoryOverhead = 20 + 7% of 20GB = ~22GB

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions