v1.0.1

What's Changed

• fix: Conditionally import required hook by @adamantike in #99

Full Changelog: v1.0.0...v1.0.1

v1.0.0

v1.0.0 of airflow-dbt-python is finally here 🎉

I feel very confident in the API we have established, and even if there is still work to do, I want to start building on this API instead of dealing with old inconsistencies.

Due to the size of this release, I encourage folks who haven't had a chance to test the pre-release versions available for at least 3 weeks, to do so now before upgrading. As always, we thank any bug reports which can be opened as a GitHub issue.

Changes

• airflow-dbt-python operators no longer handle temporary directories.
  • airflow-dbt-python operators should be about defining what to execute, not how.
  • airflow-dbt-python hooks are the ones that should worry about setting up directories.
  • This significantly reduces the complexity in operators.
• Refactored the dbt remote interface (previously dbt backends).
  • The interface has been simplified to two methods: upload and download.
  • Now utilizes a more specific URL class for all URL-like arguments.
  • All dbt remotes are now hooks too, which means they can use Airflow Connections.
• Implemented a new DbtRemoteGitHook to utilize git repositories as remotes.
• tar file is a new supported archive format for dbt projects.
• Moved dbt configurations to the utilities module.
  • dbt configurations are a wrapper to dbt. They exist purely because dbt doesn't have a formalized API outside the CLI.
  • Once dbt as a library moves along (see dbt-core as a library dbt-labs/dbt-core#6356), we may drop all of these configurations.
• Much better understanding of how dbt logs things (as in, we now don't log things multiple times).
• Support for Python 3.11.
• Updated documentation.
• Update CI versions.
• Clear up test state to allow tests to be run more than once.

Breaking changes

• Dropped support for Airflow major version 1.
  • It required too much work to maintain, and AWS MWAA has offered Airflow >= 2.x for a while now.
• New hook and operator interfaces are incompatible with <=1.0.0 versions.
  • Developers extending airflow-dbt-python should be aware of these changes and review the documentation.

v1.0.0b2

What's Changed

• feat: Provide env_vars to update environment variables by @tomasfarias in #95

Full Changelog: v1.0.0b1...v1.0.0b2

v1.0.0b1

What's Changed

• Do not read artifact files that don't exist, but log a warning instead.
• Add tests for a git-remote DAG.
• Add tests for DAG used in README.
• Update README and documentation.
• Update CI versions.
• Clear up test state to allow tests to be run more than once.

Full Changelog: v1.0.0b0...v1.0.0b1

v1.0.0b0

v1.0.0b0

Changes:

• airflow-dbt-python operators no longer handle temporary directories.
  • airflow-dbt-python operators should be about defining what to execute, not how.
  • airflow-dbt-python hooks are the ones that should worry about setting up directories.
  • This significantly reduces the complexity in operators.
• Refactored the dbt remote interface (previously dbt backends).
  • The interface has been simplified to two methods: upload and download.
  • Now utilizes a more specific URL class for all URL-like arguments.
  • All dbt remotes are now hooks too, which means they can use Airflow Connections.
• Implemented a new DbtRemoteGitHook to utilize git repositories as remotes.
• tar file is a new supported archive format for dbt projects.
• Moved dbt configurations to the utilities module.
  • dbt configurations are a wrapper to dbt. They exist purely because dbt doesn't have a formalized API outside the CLI.
  • Once dbt as a library moves along (see dbt-core as a library dbt-labs/dbt-core#6356), we may drop all of these configurations.
• Much better understanding of how dbt logs things (as in, we now don't log things multiple times).
• Support for Python 3.11.
• Updated documentation.

Breaking changes:

• Dropped support for Airflow major version 1.
  • It required too much work to maintain, and AWS MWAA has offered Airflow >= 2.x for a while now.

v0.15.3

Bug Fixes

• Conditional import for different dbt exceptions #92 (Tomás Farías Santana)
• Ignore types of dbt exceptions #92 (Tomás Farías Santana)

Chores

• Patch version bump #92 (Tomás Farías Santana)

v0.15.2

Bug Fixes

• Tagged release CD should wait for CI check (Tomás Farías Santana)
• Avoid heavy imports in operator constructor #86 (Michael Manganiello)

Chores

• Skip badge update on PR (Tomás Farías Santana)
• Bump patch version (GitHub Action)

v0.15.1 Release

What's Changed

• fix: Avoid heavy top-level imports in operators by @adamantike in #85

This results in great speed-ups when populating a DagBag and can avoid having to set higher import timeouts.

Under the hood

• chore(cicd): Alter testing strategy in GitHub Actions by @tomasfarias in #78
• fix(docs): Fix install docs for apache-airflow providers by @tomasfarias in #81
• feat(test): Add DAG that uses Airflow connection to tests by @tomasfarias in #82
• feat: CI/CD updates by @tomasfarias in #83
• chore: Update flake8 pre-commit URL to point to GitHub repository by @adamantike in #84

New Contributors

• @adamantike made their first contribution in #84

Full Changelog: v0.15.0...v0.15.1

v0.15.0

Features

• Update poetry to v1.2.0 #76 (GitHub Action)
• Initialize dbt logging when running task #77 (GitHub Action)

Bug Fixes

• Update scope for fixtures depending on dbt_project_file #77 (GitHub Action)
• Update logging tests to account for new setup #77 (GitHub Action)
• test: dbt deps should change logs #77 (GitHub Action)

Tests

• Add test for saving logs to different log-path #77 (GitHub Action)

Chores

• Development dependency bumps #77 (GitHub Action)
• Bump minor version (GitHub Action)

Commits

• be94236: "dbt" instead of "dby" in the install statement (Daniel Pineda Jaramillo) #69

v0.14.5

Bug Fixes

• Correct casting of run-operation args to str #66 (GitHub Action)