atoolbox

Simple functions for spark

installation

$ pip install atoolbox

Available functions:

• join_dataframes

• toJson

• add_numeric_fields

---

Examples:

• join_dataframes

joined_df = tbs.join_dataframes(df_list, on="id", how="left")

• toJson

df = tbs.toJson(dfa) # a file is written by default at file:////tmp/out

• add_numeric_fields

df = tbs.add_numeric_fields(dfc,"id")