dev #38

Merged

jakeISAC merged 22 commits from dev into main 2026-03-20 14:19:14 +01:00

Conversation 0 Commits 22 Files changed 23 +526 -259

jakeISAC commented 2026-03-20 14:19:05 +01:00

Owner

Copy link

Merging release 1.2 as stable

Merging release 1.2 as stable

jakeISAC added 22 commits 2026-03-20 14:19:05 +01:00

Added path_preprocessor module and enhanced path handling: ... 41cf9f8025

- Implemented `generate_absolute_path` for resolving symbolic paths (`~`, `.`) and validating existence.
- Added unit tests for `path_preprocessor` to cover various symbol scenarios.
- Refactored `copy` and scheduling logic to integrate path preprocessing.
- Made `CompletelyFairScheduler` configurable with `max_group_size`.
- Introduced `SchedulerConfig` to centralize scheduler configuration handling.
- Updated CLI to support `max_group_size`, `max_number_of_open_files`, and improved path validation.

Refactored imports, formatting, and default CLI argument descriptions for improved clarity and consistency. 4972ed50f2

Bump version to 1.1.7 and update edition to 2024 in Cargo.toml and Cargo.lock. ea9fa04e6a

Bump version to 1.2.0, update CLI argument descriptions, and improve documentation consistency across Args struct. 0c1a89b539

Simplify elapsed time reporting with HumanDuration and refactor success message formatting in copy function. 215e5e8225

Refine elapsed time reporting in copy function with conditional formatting for minutes or seconds. 6b09f30007

Refine elapsed time reporting in copy function with conditional formatting for minutes or seconds. d6b65dc354

Add detailed logging to generate_absolute_path for improved debugging: ... 88a162d91f

- Added debug, trace, and warning logs for key operations, including symbolic path parsing, `..` resolution, and path existence checks.
- Enhanced error handling with warnings for skipped path segments.

Integrate flexi_logger for enhanced logging flexibility and add optional CLI --log-file argument. 455e8a22e9

Fix logger initialization to resolve --log-file path using generate_absolute_path. 6ed2423e3e

Add detailed logging across file operations and scheduler initialization: ... f3d7f6667b

- Introduced `SchedulerConfig::new` with debug logging for better configuration handling.
- Enhanced logging in directory and file analysis functions for clarity on operations and error handling.
- Added info/debug logs to `extract_end_paths` and `create_end_paths` for improved traceability of path processing.
- Integrated logging in `copy` function for tracking group processing, file transfers, and byte counts.
- Refined error and debug messages throughout file operations logic.

Refine logging in copy function by relocating debug log for worker thread initialization to improve clarity. b219ebd5cf

Update README.md 7f13ea29fb

Update README.md 3fbd25ef16

Update README.md 1720f6d6a5

Update README.md 7d67c0c650

Update README.md 540ea33c48

Rename modules and files for consistency and clarity: ... 8904f6eeec

- Standardize file and module naming (`file_struct` → `file_data`, `directory_structure` → `dir_structure_analysis`, etc.).
- Adjust imports across all affected modules and tests.
- Reduce maximum K-means iterations (`MAX_K_MEANS_ITER`) to improve performance.
- Add a TODO for fine-tuning cluster handling in K-means scheduler.
- Update test paths and parameters to reflect module changes.

Optimize K-means clustering and Completely Fair Scheduler: ... 0b49f0f839

- Refactor K-means logic to improve convergence handling and avoid unnecessary centroid updates.
- Introduce dynamic chunk sizing with `MINIMUM_CHUNK_SIZE` to optimize parallelism in K-means and CFS.
- Simplify `CompletelyFairScheduler` configuration and ensure group size defaults appropriately.
- Update test paths for consistency with modified directory structure.

Bump version to 1.2.2 in Cargo.toml and Cargo.lock 635f122011

Remove env_logger dependency and prune unused packages from Cargo.lock. c741b7c902

Refactor CompletelyFairScheduler: ... 0bccb313e5

- Rename `group_size` to `amount_of_groups` for clarity.
- Enhance logging for group size settings.
- Update logic to improve usability and error messaging for inefficient configurations.

jakeISAC merged commit 26a5ba68cc into main 2026-03-20 14:19:14 +01:00

jakeISAC referenced this pull request from a commit 2026-03-20 14:19:16 +01:00

Merge pull request 'dev' (#38) from dev into main

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

No items

No labels

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

jakeISAC/bifrost!38

No description provided.