Changelog

0.7.0

This version improves the platform’s data management and analysis capabilities with configurable storage providers that support multiple read-write or read-only locations. New workflow “chord” support executes task groups followed by automated callback tasks, while workflow templates enable unique parameter customization and direct template-to-workflow association.

For forensic analysis, OpenRelik now integrates DuckDB to provide SQL support for querying file based databases (e.g. SQLite). The update also introduces a Model Context Protocol (MCP) server to integrate OpenRelik tools directly into automated AI workflows. Additionally, the system improves observability through OpenTelemetry instrumentation, uses chunked file hashing for large datasets, and migrates file chat streaming to Server-Sent Events. More workers have been created that extends the capabilities of the platform.

Highlights

Configurable storage providers with support for multiple read-write or read-only locations.
Workflow ‘chord’ support to execute task groups followed by callback tasks.
Workflow templates with unique parameter customization and template-to-workflow association.
MCP server for integration into automated workflows.
SQL analysis support using DuckDB for querying and schema retrieval of database files, with web UI support.
Migrated file chat streaming from WebSockets to Server-Sent Events (SSE).
Folder list pagination and optimized database queries.
OpenTelemetry instrumentation for FastAPI and Celery task tracing.
Support for soft-deletion of empty folders based on retention periods.
File hashing updated to use chunked reading, preventing memory issues with large files.
Dark theme updated to a slate-based palette.
Settings page to configure features for the web UI.

0.6.0

Server

This release includes updates to folder sharing, group management features in the admin CLI and API, improved documentation and type hints, dependency updates, file chat functionality, database connection handling in admin.py, optimized delete operations, task log file handling, a workflow name generation endpoint, and various bug fixes and performance improvements.

Highlights:

Added group management endpoints and commands to the admin CLI and API.
Updated folder sharing endpoint and related functionality.
Improved documentation and type hints.
Added file chat functionality.
Optimized delete and purge operations.
Added task log file handling (renamed from task_logs to task_files).
Added a workflow name generation endpoint.
Updated various dependencies, including h11 and setuptools.
Fixed a database connection issue in admin.py.
Added folder list endpoint.
Improved chunked file upload reliability and error handling.
Added task report feature.
Added Google OAuth token authentication support.

This release includes improvements to file handling, UI updates, and new features like a task list dropdown and file chat component. Text file type detection is improved. Workflow name generation and folder icons have been added. Task reporting and search functionality are also included.

Highlights:

Improved text file type detection.
Fixed minor typos.
RangeChart X-axis labels are now auto-formatted.
Added file chat component and improved file content display.
New task list dropdown implemented.
Workflow name generation and folder icons added.
Task report card implemented.
UI improvements and search feature added.
Improved file upload handling and configuration loading.
Improved error handling in the UI.

0.5.0

Server

Added a health check endpoint for service monitoring.
Implemented a CLI command to create and manage user API keys.
Added an importer to ingest files from Google Cloud Storage.
Updated several dependencies, including python-jose and cryptography.
Improved Workflow API documentation.
Fixed an authorization bug in the workflow API.
Refactored LLM summarization and added related unit tests.

This release includes UI/UX improvements, API refinements, and dependency updates. AI summary prompt display was added, and file summary cards were visually improved. Cloud disk functionality was removed. Workflow tree UI and controls were also enhanced. The file size limit for GenAI processing was adjusted.

Highlights:

Added AI summary prompt display and improved visuals.
Adjusted file summary card appearance and functionality.
Removed cloud disk functionality.
Improved workflow tree UI and controls.
Updated various dependencies, including Vite.
Adjusted file size limit for GenAI processing.
Refined API endpoints for consistency.

2024.12.12

This release improves Celery metrics with queue length and dynamic labels, optimizes folder API responses with a compact schema, updates the python-multipart dependency, and adds a Prometheus metrics exporter for Celery. It also introduces a new metrics dashboard for monitoring tasks, including detailed metrics like completion time, failure rate, and resource usage. The dashboard features auto-refresh and dynamic resolution.

Server

Added queue length and dynamic labels to Celery metrics.
Implemented a compact schema for folder API responses, reducing size.
Integrated a Prometheus exporter to collect Celery metrics.

Added a new dashboard for visualizing task-related metrics.
Implemented auto-refresh and dynamic resolution for the metrics dashboard.
Improved task monitoring with metrics for completion time, failure rate, and resource usage.

2024.11.27

This release introduces role-based access control, folder sharing, improved file handling, and administrative tools. It also includes database improvements, extended JWT expiration, and optimizations for file listings. Several bug fixes and refactoring efforts improve stability and maintainability. Chunked file uploads and refresh token support are also added.

Server

Implemented role-based access control (RBAC) for granular resource management.
Added folder sharing and group management features.
Optimized file listing responses for folders to reduce data transfer.
Extended JWT access token expiration time.
Added an admin command to fix file and folder ownership.
Improved database initialization robustness.

Improved task configuration display and file details view.
Enhanced file display in task results and workflow tree.
Implemented folder sharing with access control.
Added chunked, resumable file uploads.
Improved CSRF token handling and login redirects.
Added refresh token support.