GitHub - hudeqi/spark1.6.1-shuffleOptimization: optimize the shuffle memory allocation algorithm(FA) and use the new algorithm(AABS)【spark shuffle内存分配优化算法】

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
ExecutionMemoryPool.scala		ExecutionMemoryPool.scala
README.txt		README.txt
Spillable.scala		Spillable.scala
TaskMemoryManager.java		TaskMemoryManager.java
UnifiedMemoryManager.scala		UnifiedMemoryManager.scala

Repository files navigation

Replace the above files with the corresponding files in the spark1.6.1 source code and recompile them.

optimize the shuffle memory allocation algorithm(FA) and use the new algorithm(AABS)【spark shuffle内存分配优化算法】

No releases published