Rust_read Directory of Files

[DeviPriya-Kolla]

Description:
This issue focuses on developing a Rust function to read and process an entire directory of TBE files, sequentially loading and parsing each file. This batch-processing capability will enable users to efficiently aggregate metadata, handle errors, and generate summary reports across multiple TBE files in the directory.

Developer Notes:

• Implement a function that iterates through all files in a specified directory, filtering for TBE files based on file extensions or header validation.
• Use Rust’s Path and PathBuf types from the std::path module to manage file paths and ensure that only valid TBE files are processed.

Acceptance Criteria:

• Functionality to read all TBE files in a directory
• metadata aggregation
• skip each non-TBE files and log a warning
• provide logging or progress updates
• an option to return summary metadata in a JSON or visual format