Skip to content

Potential Issues Found During Setup and Testing #71

Description

@calvinbasumatary-cpu

1. Python Compatibility Problems

The README mentions Python 3.9, but the project does not prevent installation on newer Python versions.

When using Python 3.14:

  • psycopg2-binary==2.9.9 fails to install
  • numpy==1.26.3 fails to build
  • Installation fails without a clear explanation

Suggestion

Add a startup/version check or update dependency constraints to explicitly support newer Python versions.


2. Unnecessary PostgreSQL Dependency

The project appears to use SQLite by default, but installation still requires psycopg2-binary.

This caused installation failures even when PostgreSQL was not being used.

Suggestion

Make PostgreSQL dependencies optional or only install them when PostgreSQL is selected.


3. Duplicate / Highly Correlated BTC Signals

During testing, the bot generated multiple actionable BTC signals with nearly identical values across consecutive 5-minute windows:

  • Same direction (UP)
  • Similar model probability (~55%)
  • Similar edge (~4.6%–5.7%)
  • Same suggested trade size

This may result in multiple highly correlated positions being opened simultaneously.

Suggestion

Consider limiting exposure across overlapping windows or adding a correlation filter.


4. Possible Market Window Timestamp Issue

The API response for BTC 5-minute markets showed timestamps that appear inconsistent with a 5-minute market duration.

Example:

  • window_start and window_end suggest a much longer duration than expected.
  • Could be a timezone conversion issue or parsing issue from Polymarket data.

Suggestion

Verify timestamp handling and UTC conversions for BTC market windows.


5. Calibration Concerns

After initial testing:

  • Accuracy: ~40%
  • Brier Score: ~0.279

This suggests probabilities may not be well calibrated.

Suggestion

Review probability calibration and consider post-processing methods such as Platt Scaling or Isotonic Regression.


Environment

  • Windows 11
  • Python 3.14 (installation issues)
  • Python 3.9 (successful installation)
  • Latest repository version
  • Backend and frontend running successfully after switching to Python 3.9

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions