Accessing Task Instance Logs from callback hooks

[brunopastor]

I need to access task instance logs from an on_failure_callback function. I understand that due to ORM's Session that's not possible since the session doesn't persist between task execution and callback hooks.

I tried the following without luck, getting the following output for logs_data:

task_logs_reader = TaskLogReader()
logs_data, _ = task_logs_reader.read_log_chunks(task_instance, task_instance.try_number, {})

Could not read served logs: Parent instance is not bound to a Session; lazy load operation of attribute 'trigger' cannot proceed (Background on this error at: https://sqlalche.me/e/14/bhk3)

Is there any way to access task instance logs on on_failure_callback?

[potiuk]

You can use REST API.

[potiuk]

https://airflow.apache.org/docs/apache-airflow/stable/stable-rest-api-ref.html#operation/get_log

[brunopastor]

Thank you very much! I can confirm it works!

[gulbvdvoort]

@brunopastor Can you show how you do implemented it?