Skip to content

source/influxdb3: change to use new InfluxDB3Source #608

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

tim-quix
Copy link
Collaborator

@tim-quix tim-quix commented Apr 23, 2025

Updated to use new (pending) InfluxDB3Source.

@tim-quix tim-quix changed the title update to use new Quix Streams InfluxDB3Source Update InfluxDB3 source template to use new InfluxDB3Source Apr 23, 2025
@tim-quix tim-quix changed the title Update InfluxDB3 source template to use new InfluxDB3Source source/influxdb3: change to use new InfluxDB3Source Apr 23, 2025
@tim-quix tim-quix marked this pull request as ready for review April 30, 2025 02:36
@tomas-quix
Copy link
Collaborator

[2025-05-26 13:52:04,905] [ERROR] [influxdb3_tsbs_downsampled_1h_cpu] [9] : ERROR: Failed while connecting to client: Flight returned internal error, with message: Cannot retrieve database: External error: database not found: tsbs_downsampled_1h. gRPC client debug context: UNKNOWN:Error received from peer ipv4:10.0.60.144:80 {grpc_message:"Cannot retrieve database: External error: database not found: tsbs_downsampled_1h", grpc_status:13, created_time:"2025-05-26T13:52:04.905285772+00:00"}. Client context: IOError: Server never sent a data message. Detail: Internal
[2025-05-26 13:52:04,905] [ERROR] [influxdb3_tsbs_downsampled_1h_cpu] [9] : Error in source
Traceback (most recent call last):
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/base/manager.py", line 110, in run
self.source.start()
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/base/source.py", line 286, in start
self._init_client()
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/base/source.py", line 114, in _init_client
self._on_client_connect_failure(e)
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/base/source.py", line 25, in _default_on_client_connect_failure
raise exception
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/base/source.py", line 111, in _init_client
self.setup()
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/community/influxdb3/influxdb3.py", line 172, in setup
self._client.query(
File "/usr/local/lib/python3.12/site-packages/influxdb_client_3/init.py", line 277, in query
return self._query_api.query(query=query, language=language, mode=mode, database=database, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/influxdb_client_3/query/query_api.py", line 172, in query
raise e
File "/usr/local/lib/python3.12/site-packages/influxdb_client_3/query/query_api.py", line 168, in query
flight_reader = self._do_get(ticket, _options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/influxdb_client_3/query/query_api.py", line 248, in _do_get
return self._flight_client.do_get(ticket, options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "pyarrow/_flight.pyx", line 1708, in pyarrow._flight.FlightClient.do_get
File "pyarrow/_flight.pyx", line 55, in pyarrow._flight.check_flight_status
pyarrow._flight.FlightInternalError: Flight returned internal error, with message: Cannot retrieve database: External error: database not found: tsbs_downsampled_1h. gRPC client debug context: UNKNOWN:Error received from peer ipv4:10.0.60.144:80 {grpc_message:"Cannot retrieve database: External error: database not found: tsbs_downsampled_1h", grpc_status:13, created_time:"2025-05-26T13:52:04.905285772+00:00"}. Client context: IOError: Server never sent a data message. Detail: Internal
pyarrow._flight.FlightInternalError: Flight returned internal error, with message: Cannot retrieve database: External error: database not found: tsbs_downsampled_1h. gRPC client debug context: UNKNOWN:Error received from peer ipv4:10.0.60.144:80 {grpc_message:"Cannot retrieve database: External error: database not found: tsbs_downsampled_1h", grpc_status:13, created_time:"2025-05-26T13:52:04.905285772+00:00"}. Client context: IOError: Server never sent a data message. Detail: Internal

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/app/main.py", line 80, in
app.run()
File "/usr/local/lib/python3.12/site-packages/quixstreams/app.py", line 752, in run
self._run()
File "/usr/local/lib/python3.12/site-packages/quixstreams/app.py", line 788, in _run
with exit_stack:
File "/usr/local/lib/python3.12/contextlib.py", line 610, in exit
raise exc_details[1]
File "/usr/local/lib/python3.12/contextlib.py", line 595, in exit
if cb(*exc_details):
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/base/manager.py", line 339, in exit
self.stop_sources()
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/base/manager.py", line 308, in stop_sources
self.raise_for_error()
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/base/manager.py", line 318, in raise_for_error
process.raise_for_error()
File "/usr/local/lib/python3.12/site-packages/quixstreams/sources/base/manager.py", line 224, in raise_for_error
raise SourceException(self) from self._exceptions[-1]
quixstreams.sources.base.exceptions.SourceException: influxdb3_tsbs_downsampled_1h_cpu with PID 9 failed

@tim-quix
Copy link
Collaborator Author

tim-quix commented Jun 2, 2025

per your comment @tomas-quix , your stack trace seems to be saying the DB name is incorrect (or the DB does not exist).

I tested it again as a sanity check with my latest TSBS deployment and it is working 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants