Athena webrtc streamer #34226
Athena webrtc streamer #34226
Conversation
Recording.2024-12-12.215222.mp4 |
Recording.2024-12-12.220040.mp4 |
|
This PR has had no activity for 9 days. It will be automatically closed in 2 days if there is no activity. |
|
Cool! How well does this work over cell? Ultimately, I'd like to replace snapshot in connect with a live stream. |
It works reliably well. I created my own TURN server using coturn so it relays through that when using mobile data. You obviously need a decent cell connection for live streaming. Even with a bad connection it will still send some frames. WebRTC is robust to connection interruptions but since its using athena, if the websocket connection times out, it will set the end_event and reset everything. |
|
@adeebshihadeh The video I posted was using a turn server over mobile hotspot, not the local network. |
|
are we able to implement this for connect? this would a great addition or does it add too much server traffic? |
|
It could put a strain on the servers bandwidth if there was hundreds of simultanious streams. But this could be easily managed. Konik connect has already added support for it for free if you want it. |
I am sorry, whats Konik connect? is that a connect fork? How do I use it? Do I also need a different openpilot branch? |
|
Yea its a connect fork and requires a fork of openpilot. Setup info in the discord https://discord.com/invite/vXG2eq5KSZ |
|
This PR has had no activity for 9 days. It will be automatically closed in 2 days if there is no activity. |
|
Gonna mark this as "ignore stale" @incognitojam up to you if you wanna review and get something merged or you wanna just keep the draft around until we have time to write it ourselves |
|
this is awesome! |
|
Also you can implement OpenXR into the frontend for VR support. You can send the commands from the quest controllers over a datachannel. This is how you can do comma body/humanoid teleop with minimal code. |
Recording.2025-04-27.101830.mp4 |
|
Do you have a new discord link. Old link is expired for setup. |
Not expecting a merge, just showing this working demo of how webrtc could be used with connect in the future. I provided the react component frontend code too which has a lot of bloat, but it works.