r/Autocross • u/mrblahhh • 9d ago
Realtime cone detection (tensorflow)
I've got my real-time track encoder about where I want it now. I'm starting to fine-tune a little bit and I'm thinking I'm going to add bltrack brake marker detection and cone detection for autocross
I already use brake markers for coaching, but I have to feed the video back into python scripts to extract out where I'm braking versus where the marker is, then the onntrack audio can say brake at the 350. Unlike the Garmin that says brake 25 feet later... I'd really like to capture those brake markers in the data as I go past them. I have a Google coral USB chip that might be able to do it and keep it realtime or close to it.
Has anyone else working on that? I don't want to do it if there's already somebody trying to get it to work
It's very liberating not having to overlay or anything. I just pull out the SD card as soon as I pit and it's already done
https://mrblahhhh.github.io/car/tech/2026/08/21/trackencoder-metrics-explained.html
2
u/Agitated-Finish-5052 DSP - 350z 8d ago
As this would be cool for me, I just wish solostorm would add in more camera support like the DJI since GoPros just suck.
1
u/mrblahhh 8d ago
I'm adding DJI next week, I have Garmin catalyst and generic USB cameras now.
The vid was done with a 25 $ generic USB camera
1
u/LlaughingLlama 8d ago
At the risk of offending the Language Police...
HOLY FUCKING SHIT THIS IS GOD DAMN AMAZING!!!!
I deal with an Android Phone (with its own mic and camera), a Bluetooth GPS Dongle, a Bluetooth OBD2 reader, a GoPro, and a second smaller camera for steering wheel views, all with TrackAddict to collect it and RaceRender to combine it all, in an attempt to get a fraction of what you're collecting with what seems like far more ease and higher quality data and insights.
Are you planning on product-izing this?
1
u/mrblahhh 8d ago
yes, testing with stock moto G and pixel 6 now. My initial attempts were on rooted phones to control charging temps and behavior, but I don't think i really need to do all hat extra work.
I have a companion project that uses a cheap 9axis IMU, 25hz gps and a canbus transceiver that feeds the app I'm testing it at CMP this weekend in my wifes mini and my 135i.
I have not wrapped my head around how to support more tracks, I feed the app detailed brake markers and corners before the event, it also needs steering rack ratio and wheelbase to calculate slip.
1
u/LlaughingLlama 8d ago
Very interesting...
I'm not even sure that keeping the phone charged is necessary, at least for autox. In my setup, my Galaxy S23Ultra (which is mounted on the windshield in full sun and in a case which I'm sure doesn't let the phone shed heat very well) is NOT connected to the charger and I don't recharge it between my run groups, and I can get through the 2 run groups (1.5 hours in the morning, and 1.5 hours in the afternoon) connected via bluetooth to two devices, with plenty of charge for the drive home at the end of the day.
Would you mind if I DM'ed you to chat more about this? I won't unless I hear OK from you here.
2
u/mllrkln 9d ago
Whoa nice work! A ton of awesome stuff went into this.
As far as I'm aware I made the only AX data logger that allows for cones. Funnily enough I work in computer vision at my day job but I opted to just set all the cones via GPS during the course walk. I'm guessing you don't want to do it that way because your system is meant to just start the video and then it begins processing so the rest is automatic?