python_generic_purpose_snippets

Archive of Python code snippets for generic tasks during data engineering / analytics processes. File naming following format:

Code archive to be linked with Sarah's Notion Python Code Vault Code in github => further details + link to Github Gist in Notion

How to use: (Notion search => check if highlighted code is what I'm looking for =>) Git link => fork and use :)

Name		Name	Last commit message	Last commit date
Latest commit History 53 Commits
1_dataflow_apache_beam		1_dataflow_apache_beam
3_recommender_system_examples		3_recommender_system_examples
1_argparse_basics-commandline-from-python-example.py		1_argparse_basics-commandline-from-python-example.py
1_composer_script.py		1_composer_script.py
1_extract_save_list_of_dict_as_newline_delimited_json_or_parquet.py		1_extract_save_list_of_dict_as_newline_delimited_json_or_parquet.py
1_ingestion_Beam_pipeline_from_gcs_bq.py		1_ingestion_Beam_pipeline_from_gcs_bq.py
1_ingestion_csv-line-to-dict-for-BQ-ingestion.py		1_ingestion_csv-line-to-dict-for-BQ-ingestion.py
1_ingestion_read-nested-json-file-into-list.py		1_ingestion_read-nested-json-file-into-list.py
1_ingestion_removing-data-from-dict-by-keys-and-empty-struct-to-none.py		1_ingestion_removing-data-from-dict-by-keys-and-empty-struct-to-none.py
2_BQ_aggregate_streaming_data_to_minutes.sql		2_BQ_aggregate_streaming_data_to_minutes.sql
2_StandardSQL_for_BigQuery.sql		2_StandardSQL_for_BigQuery.sql
2_feature_engineer_NLP.py		2_feature_engineer_NLP.py
3_classification_with_BQML.sql		3_classification_with_BQML.sql
3_spam_classifier_NLP.ipynb		3_spam_classifier_NLP.ipynb
3_theory_NLP.ipynb		3_theory_NLP.ipynb
README.md		README.md
theory_NLP.ipynb		theory_NLP.ipynb

Provide feedback