Skip to content

Enhanced GitHub Actions Workflows and Metrics Integration#1

Open
thaddiusatme wants to merge 29 commits intomainfrom
feature/github-workflows
Open

Enhanced GitHub Actions Workflows and Metrics Integration#1
thaddiusatme wants to merge 29 commits intomainfrom
feature/github-workflows

Conversation

@thaddiusatme
Copy link
Owner

Enhanced GitHub Actions Workflows

This PR improves our CI/CD pipeline with comprehensive workflow updates and metrics integration.

Changes

CI Pipeline Improvements

  • Added Prometheus service container for metrics testing
  • Split tests into unit, integration, and load tests
  • Enhanced code quality checks:
    • Black for code formatting
    • isort for import sorting
    • flake8 for linting
    • mypy for type checking
  • Improved coverage reporting and aggregation

Release Process Enhancements

  • Added documentation building with mkdocs
  • Automated documentation deployment to GitHub Pages
  • Enhanced artifact handling
  • Improved PyPI publishing process

Metrics Integration

  • Added comprehensive metrics tracking
  • Integrated Prometheus metrics server
  • Added real-time monitoring capabilities
  • Enhanced test coverage for metrics

Documentation

  • Updated changelog with version 1.0.1
  • Improved documentation for metrics and monitoring
  • Added workflow documentation

Testing

  • All CI checks pass
  • Metrics tests are successful
  • Documentation builds correctly

Reviewer Notes

Please check:

  1. CI workflow configuration
  2. Release process changes
  3. Metrics integration
  4. Documentation accuracy

thaddiusatme and others added 29 commits December 13, 2024 03:03
Added:
- Feed validator with support for RSS, Atom, and JSON feeds
- Comprehensive validation test suite
- Integration with feed processor
- Feed format normalization

Changed:
- Enhanced processor to validate feeds before queueing
- Updated requirements.txt with feedparser dependency

Tested:
- All feed formats
- Invalid feed handling
- Date normalization
- Add webhook management functionality
- Implement CLI interface
- Add validation improvements
- Update tests and documentation
- Add CI workflow
- Added Prometheus service container for metrics testing
- Integrated load testing in CI pipeline
- Added automatic documentation building and deployment
- Improved code quality checks
- Implemented Prometheus metrics
- Added load testing configuration
- Updated API and processor components
- Added Docker compose for monitoring
- Remove older Python versions
- Update checkout action to v4
- Simplify test matrix to only use Python 3.12
- Run lint checks before tests
- Improve dependency installation
- Add spacy model installation
- Split tests into unit and integration
- Fix dependency installation
- Improve test coverage reporting
- Add step to run tests in root directory
- Add step to run performance tests
- Maintain coverage reporting
- Change to >=0.17.1 for Python 3.12 compatibility
- Remove duplicate prometheus-client entry
- Remove src layout configuration
- Update Python version requirement to 3.12
- Fix package discovery
- Add build dependencies installation step
- Simplify setup.py configuration
- Use requirements.txt for dependencies
- Update types-prometheus-client to compatible version
- Ensure Python 3.12 is used consistently in CI
- Fix Python command paths
- Remove types-prometheus-client to fix dependency issues
- Set Python version as environment variable
- Ensure consistent Python 3.12 usage across workflows
- Move dependencies from requirements files to setup.py
- Add proper extras_require for dev and test dependencies
- Update CI/CD workflows to use pip's editable install mode
- Streamline test execution process
- Add automatic code formatting with black when needed
- Simplify test execution process
- Add proper git checkout configuration
- Fix detached HEAD state issue
- Improve error handling in black formatting step
- Add write permissions for repository contents
- Use GITHUB_TOKEN for authentication
- Fix git push command to target correct branch
- Add explicit installation of formatting tools
- Add automatic import sorting with isort
- Configure isort to run with black compatibility
- Remove unused imports
- Fix line length issues
- Fix undefined names in tests
- Simplify validator implementation
…ror_handling.py

- Take newer version of imports and features
- Improve code organization and readability
- Remove duplicate imports
- Remove unused imports
- Fix undefined names
- Add missing threading import
- Fix test parameters
- Fix imports organization
- Add assertion for retry count
- Remove duplicate test cases
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant