Skip to content

Removal of Deprecated Modules, Dependency Clean‑up, and Turbodbc Deprecation (RTDIP SDK v0.14.4)#987

Open
Amber-Rigg wants to merge 10 commits intodevelopfrom
feature/cleanup
Open

Removal of Deprecated Modules, Dependency Clean‑up, and Turbodbc Deprecation (RTDIP SDK v0.14.4)#987
Amber-Rigg wants to merge 10 commits intodevelopfrom
feature/cleanup

Conversation

@Amber-Rigg
Copy link
Copy Markdown
Contributor

PR Submission: Removal of Deprecated Modules, Dependency Clean‑up, and Turbodbc Deprecation (RTDIP SDK v0.14.4)

Summary

This PR introduces major clean‑up changes to the RTDIP SDK as part of the v0.14.4 release.
It removes deprecated modules, reduces unused dependencies, deprecates turbodbc support, and updates relevant documentation to reflect the streamlined architecture.

These changes realign the SDK with its primary focus: time‑series data ingestion and querying.


What’s Changed

1. Removal of Data Quality Module

The entire rtdip_sdk.pipelines.data_quality module has been removed.

This includes:

  • Monitoring Components:
    CheckValueRanges, FlatlineDetection, IdentifyMissingDataInterval, IdentifyMissingDataPattern, MovingAverage, GreatExpectationsDataQuality
  • Data Manipulation Components:
    DimensionalityReduction, DuplicateDetection, FlatlineFilter, GaussianSmoothing, IntervalFiltering, KSigmaAnomalyDetection, MissingValueImputation, OutOfRangeValueFilter
  • Normalisation Components:
    NormalizationZScore, NormalizationMean, NormalizationMinMax, Denormalization
  • Base Interfaces:
    InputValidator, DataManipulationBaseInterface, MonitoringBaseInterface

Reason: These features fall outside the SDK’s core purpose and are better implemented using dedicated external frameworks.


2. Removal of Forecasting Module

The full rtdip_sdk.pipelines.forecasting module has been removed, including:

  • ARIMA & AutoARIMA predictions
  • Machine learning forecasting models
  • MachineLearningInterface

Reason: Forecasting is more suitably handled with libraries such as Statsmodels, Prophet, or Scikit‑learn.


3. Removal of Related Tests

The following test suites have been removed:

  • 23 × data quality tests
  • 6 × forecasting tests
  • 1 × logging integration test (test_log_collection.py)

4. Dependency Clean‑up

Removed the following now-unused dependencies:

  • statsmodels
  • pmdarima
  • great-expectations
  • scikit-learn

Outcome: Reduced package footprint and simplified the dependency tree.


5. Turbodbc Deprecation

Turbodbc support is now deprecated.

  • The connector remains for backward compatibility.
  • Users who require turbodbc must install it manually:
pip install "turbodbc"

…and logging functionality to streamline the test suite.

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
…ion options and alternatives

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
…cs.yml

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
…ne navigation and improve clarity.

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
…ncy and improved accessibility.

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
…ings

- Changed image sources in various documentation files to point to raw GitHub URLs for consistent access.
- Updated deprecation warnings in the common API setup and connector initialization files to reflect the removal of turbodbc support.
- Enhanced documentation clarity regarding the RTDIP SDK and its components, including the ingestion framework and Excel connector.

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
…tency and accessibility

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
@Amber-Rigg Amber-Rigg requested a review from cching95 April 1, 2026 13:47
@Amber-Rigg Amber-Rigg self-assigned this Apr 1, 2026
@Amber-Rigg Amber-Rigg removed the request for review from cching95 April 1, 2026 13:47
…bc connector

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
…ter clarity and error handling

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
…larity

Signed-off-by: Amber-Rigg <amber.l.rigg25@gmail.com>
@sonarqubecloud
Copy link
Copy Markdown

sonarqubecloud bot commented Apr 1, 2026

Quality Gate Failed Quality Gate failed

Failed conditions
28.6% Coverage on New Code (required ≥ 80%)

See analysis details on SonarQube Cloud

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant