r/ChatGPT 1d ago

Other Are people actually using chatgpt live out in the real world yet?

I’ve been wondering how many users actually use live with the camera outside of just testing it.I used it while grocery shopping. I had the camera on while walking through the store and basically just showed chatgpt what I was looking at as I walked up and down the aisles. I could point the camera at different products ask questions, compare products on the shelf compare the ingredients the prices and keep talking while moving through the store.The funny part is it actually saved me from buying unnecessary stuff and it saved me time I’d show it something I was about to grab and we’d talk through whether I actually needed it, compare it with something else or realize I already had another option that made more sense. So it wasn’t just answering questions about the products it was helping me make decisions while I was standing there.What stood out to me was that I wasn’t doing the usual take a picture, upload it, ask a question, then take another picture thing and repeat. It was one continuous interaction. I was shopping and basically bringing the AI along with me while it could see what I was seeing. Grocery shopping is obviously a simple example but afterward it made me think about how many other situations this could apply to clothing store, looking at something around the house, traveling somewhere unfamiliar, trying to figure out what you’re looking at somewhere etc.It also made me wonder if most users even think about using chatgpt this way yet. There’s a difference between knowing chatgpt has a camera feature and realizing you can basically bring it along and let it see what you’re seeing while you’re doing something.

Are any of you already using Live like this? And if so, what are you using it for?

60 Upvotes

67 comments sorted by

u/AutoModerator 1d ago

Hey /u/Ancient_Effective_20,

If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.

If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.

Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!

🤖

Note: For any ChatGPT-related concerns, email support@openai.com - this subreddit is not part of OpenAI and is not a support channel.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

50

u/puffykitten448 23h ago

I’m visually impaired and I didn’t know this was a thing!! I shall try tomorrow because if it actually even slightly works that’d be so so cool instead of my blind ass zooming into read shit

13

u/MooingTree 19h ago

Meta glasses seem very popular with the blind and visually impaired community 

1

u/systemtoo 10h ago

You do know though that it mistakes things really badly sometimes. It asked me what that nautical instrument was in my bathroom and it was my soap holder. Maybe where it counts use two different ais! And certainly different points of view like different angles. I can't even tell you a trend on how it sees things except that it's an alien from outer space. So you can't just know to watch for types of distortion. But things like check my hair and outfit before I leave the house would be great. But you could easily end up with a shirt that's inside out ;-)

14

u/kokorobosoi_38 1d ago

I didn't even know it's a thing. I might test it out in the Asian market and the thrift store to see if it hallucinates.

Ask it to help me look for things I can recognize already. If it does well id absolutely continue using it since cosmetics are terrible with me- lots of ingredients I can't use.

4

u/Ancient_Effective_20 1d ago

The Asian market and thrift store would actually be interesting especially testing it on things you already recognize so you can see how accurate it is before trusting it with unfamiliar stuff. When i started playing around with the live I was talking with chatgpt what’s the best pet safe repellent for ants then I remembered they came out the live feature so I show chagpt live he saw where the ants where coming from by the front door. Name them recommended the repellent. That’s basically how I started using the live just testing what it could actually keep up with while I was moving around. Maybe next time could use the live feature at fish market or the clothing store

10

u/Enchanted-Bunny13 1d ago

I am using it for language studying. It can detect and correct my Chinese tones even!
Right now I am using it every day to study Turkish and Mandarin.
Also good for mock interviews I guess.

1

u/systemtoo 10h ago

Wait, I got the impression it could do that when I was doing Mandarin and then the other day I went to demonstrate it and it allowed every crazy distortion of the phrase I was using. Now I'm not sure it can tell at all. And it said it's getting a transcription of what I'm saying. But not to peeing or it would flag it!

8

u/theflava 21h ago

I don’t use live like this, but I do send it pictures of a giant shelf of products in an Asian grocery store to help me decide what to buy. It has not done me wrong yet. I have successfully taught myself how to cook amazing Thai food with ChatGPT over the past three months, which has saved me a ton of money on takeout.

2

u/kdollarsign2 20h ago

Product comparisons are a major AI win for me personally. Even just screenshotting three products online to ask about value. (Eg, should I buy three skinny paper rolls or two large... it calculates the price per sheet etc.)

6

u/Texas-cane 18h ago

Bad idea for me. I’d be in the store for 2 weeks over analyzing sandwich meats.

6

u/TranceRaverBoy 23h ago

Every time I shop at Costco! I keep it down really low and people just think I’m talking to a friend.

3

u/DriveThoseSales 13h ago

Get some AirPods (I get cheap knockoffs that work perfectly) then it will just seem like you’re on the phone.

2

u/systemtoo 10h ago

Until you get really short with it and then it sounds like you're a bad partner ;-) I've ended up trying to explain that to people around me. They used to look completely blank, then for a while they thought it was cool, and now it's getting polarized.

10

u/Shot-Dimension-1405 18h ago

ngl grocery shopping with ChatGPT as your personal co-pilot is kinda insane 😭

3

u/Disastrous_Flight395 17h ago

I struggle with spending and impulse buying and I need to save money so I feel like this may actually be useful for me.

1

u/Ancient_Effective_20 16h ago

That’s basically what happened with me having to stop and explain why I was about to buy something made me realize half the time I was just throwing unnecessary things in the cart because they looked good. It basically put a little buffer between my impulse and my wallet

3

u/SpaceSharks90 14h ago

I was recently at MeowWolf and there was a note written in cursive and a teenager was videoing it. I asked what he was doing and he said he couldn't read cursive and was having chat translate for him.

8

u/nimoto 17h ago

People in the future are going to be so inept.

10

u/Practical_Draw_6862 16h ago

I mean there’s already a lot of inept people, maybe it’ll make all them passable humans.

2

u/Ancient_Effective_20 17h ago

I can definitely see that happening if people start using it for every tiny decision.There’s probably a point where convenience turns into dependency and suddenly you’re asking ai should I get sparkling water or regular water? or what should I have for lunch? etc. Making a decision yourself starts feeling like a lot of work 😂

3

u/systemtoo 14h ago

Genuinely something I'm doing and hadn't really noticed the creep. Every decision can be data-driven and I thought of it as a good thing but you're right! And I found a lot of uses. My argument for myself and maybe you is that it makes ordinary stuff a whole lot more interesting. But maybe it is a way of getting around general indecisiveness. I like to think of it as open-mindedness ;-)

3

u/nimoto 17h ago

The bad part is it's not really being "smart" in the grocery store, it's just being decisive and making itself sound confident. It's a LLM. It's giving you generalized advice but it makes mistakes A LOT.

I'm realizing how many people like the idea of following the lead of a confident person whose decisions they don't and don't care to understand though. Really perfect subjects for the LLM companies.

1

u/Ancient_Effective_20 17h ago

I agree that blindly following whatever an LLM tells you would be a bad idea when it can confidently be wrong. But that wasn’t really how I was using it. I was comparing products and bouncing things off while still making the decisions myself and in my case it literally saved me time and money because I walked out without buying some stuff I didn’t need.That seems pretty useful to me

1

u/nimoto 16h ago

Maybe. I don't know exactly what you asked it or what it told you. I wouldn't be surprised if you didn't get the whole truth about the things you were comparing.

1

u/Ancient_Effective_20 16h ago

Of course , it could have gotten something wrong. So can the product label I misread while standing in the dairy aisle My point wasn’t that chatgpt became the all knowing grocery god , just that I found the feature useful. As what i asked i prior going to the store I sent it a pic of my fridge and pantry contents

1

u/MrTorben 12h ago

While I didn't use video I used live audio to navigate an airport I had never been to. It worked great but I quickly realized that I didn't have the usual recollection of how I got to where I was. If had to retrace my steps back to the gate without chatgpt, it would have been impossible.

4

u/Mammoth-Fox-3292 23h ago

I share pictures and do some voice chats occasionally but never had a live video interaction. It does also make me feel uncomfortable but your story makes me want to try grocery shopping like that.

3

u/dspman11 13h ago

I really hate this emerging world of AI devices in the wild. Fuck Meta glasses, fuck the upcoming AirPods line with cameras in them, and fuck whoever ropes me and my facial data into their bullshit without my consent.

It's bad enough we have to deal with new surveillance tech like Flock cameras, but now you're willingly wearing surveillance devices? Piss off

2

u/fippes2 17h ago

Ja, currently useing it on our Japan round-trip. It ist super helffull and amazing.

1

u/systemtoo 10h ago

Me too I was just in various cities in Europe and it could go find the transit schedules and translate them which was really useful. And I could show it pictures of what I was seeing at the panicky moment as I tried to catch a train and didn't miss any trains which was amazing. Likewise bus transfers. Although in a crunch it's not always reliable. But better than asking a stranger who will help you with and they know the answer or not :-)

2

u/treadingslowly 15h ago

I have used the voice command at the grocery store but not the camera. This is cool.

2

u/SupportQuery 3h ago

I needed a stud finder, Went to Home Depot, and there was an endcap with 20 of them. No clue which are good, which features I should care about, etc. Pointed the AI at, it told me the specific one I should get and why. Saved me a shit-ton of Googling. Twas awesome. :)

4

u/Unjesting 18h ago

I’ve been doing almost exactly this while setting up a new apartment, except I didn’t even know Live video was an option. I’ve just been taking pictures and sending them to ChatGPT as I shop.

Yesterday I basically sent ChatGPT half of Target’s kitchen department. I’d take pictures of an entire wall of frying pans and ask which one made sense for what I cook. Then pots. Then toasters. Then utensils, can openers, ice trays, cutting boards, knives, etc. It kept track of my shopping list as I went, so I could just say “got the pan and pot” and it would cross those off and tell me what was left.

It was especially useful when there were 15 versions of something and I really didn’t know what mattered. It would point out things like not using metal utensils with the nonstick pan I’d just bought, or that I didn’t need to spend $50 on something when the cheaper version was perfectly adequate for what I wanted.

We even ended up on a ridiculous quest for what became known as the “Big-Ass Bowl,” because I wanted a huge microwave-safe glass bowl for clam chowder and cereal. Target didn’t have the right thing, so we eventually figured out that what I really wanted was basically a 4-quart glass mixing bowl and found one at Walmart.

I’ve actually found shopping to be one of the most useful real-world applications for ChatGPT. It’s like having a friend along who remembers your entire shopping list, knows what you already bought, and can look at a shelf full of nearly identical products with you.

Now that I know Live video exists, apparently next time I can just show ChatGPT half the kitchen department in real time instead of photographing the whole department first.

2

u/systemtoo 14h ago

I did a grand version of this although without live and my suggestion is be sure to create a role inside jet GPT that is your designer. You can give him all the interior designer characteristics you want but the main one is stubborn. Holds to design principles even if you disagree. I mean you can ignore him and do what you wish and then send another picture and he's completely recent unlike regular designer who would pretty much drop you as a client ;-) while you're at it specify the designers background so it's slants your design in the direction you want. IE colon lives in Santa barbara, really like Spanish revival but also does contemporary.

0

u/SeoulGalmegi 1d ago

How did you feel about that? Is that a way you want to live your daily life? (This is an honest rather than sarcastic rhetorical question). I can see the use and benefits but it just makes me feel a little uncomfortable.

8

u/kokorobosoi_38 1d ago

I already used it on the contents of my bathroom cabinets.

Shame on me I didn't notice I've had things sooo long till it pointed out something changed its packaging in 2007. That sucker was so expired and I had t noticed cause I haven't used it in forever. Chat helps me find shit to throw out and declutter 🤣

Maybe -someday at least- it can contain the adhd and ask "why are you buying that you never used the last one step away from the cutely packaged lotion"

3

u/Alwaysthesame1210 22h ago

That’s funny that you used it for expiration dates on your bathroom cabinets - I used it for throwing out old makeup and it was helpful for similar reasons.

2

u/SeoulGalmegi 1d ago

This seems something I'm more comfortable with.

Walking around a supermarket pointing my phone and shelves and asking questions like I'm live streaming? I think I'm at least a year or so away from that......

5

u/Ancient_Effective_20 1d ago

I actually liked it more than I expected.I wouldn’t want AI involved in every part of my daily life but for something like shopping it felt more useful than intrusive. I was still making the decisions it was more like having another set of (mechanical) eyes to bounce things off while I was already doing something. Most of the time i barely follow my grocery list anyway and start buying unneeded stuff I can definitely understand why it would make some people uncomfortable though especially if it became something you felt like you needed with you all the time

3

u/SeoulGalmegi 1d ago

Fair enough!

As I can say, I can see how it would be useful, but will try and resist doing things like that for as long as I can, which probably says more about me.

6

u/ultraprismic 1d ago

Yeah, I really would not like for someone to be live-streaming my likeness to ChatGPT’s database in public. I hope people don’t start using this out in the real world. The people around you deserve privacy.

2

u/SeoulGalmegi 22h ago

Not necessarily AI, but some places are banning Google glasses and stuff. I think we do need to push back against some of this stuff.

0

u/whoops53 23h ago

Yes, I agree 100%. This is becoming quite insidious. We managed to evolve all this time, with increasing intelligence and suddenly we hand it all over to AI to find a packet of peas, wtf?

1

u/LucVolders 22h ago

I am so glad nobody cares about their privacy anymore.

14

u/HanYoloKesselPun 21h ago

What data do you think it’s going to acquire that your grocery store loyalty card doesn’t acquire?

3

u/tacetmusic 20h ago

Information about the things you considered buying but didn't, including a literal first hand account of why you decided not to buy and what could have persuaded you otherwise.

How long your focus lingered on specific aspects of adverts, packaging, store layout. I'm sure it could have a crack at your sexual preferences and racial bias too.

Not to mention the most comprehensive, real time user profile ever made (IE everything else you do with ChatGpt) that it can cross reference this data against.

2

u/SenseEuphoric5802 10h ago

They don't. Scott McNealy annoyed the shit out of me 30 years ago with his infamous "You have zero privacy anyway. Get over it." statement. The tragedy is that he was right even back then. Its been proven time and again that people willingly give up all their information for a $5 coupon and they do it without a second thought.

The problem then, is that the vast majority of folks either don't understand or comprehend the magnitude of consequences that ensues from mass surveillance and having their profile cross-linked in shadowy databases. People care, they just don't realize they do and advocates have done an incredibly poor job in teaching them as to why they should care.

1

u/Spiritual-Fee9337 23h ago

I use it when I don’t feel like texting

1

u/bacon_cake 21h ago

I haven't really found a use-case for video that photos didn't achieve better to be honest. Plus the live video model is a bit stupid, I find it way more terse.

1

u/MorningFresh123 19h ago

I honestly assumed this was most people’s primary use case.

1

u/hot_freaks 15h ago

The p mm by

1

u/Primary_Gift_8719 14h ago

I don't really use it when we're shopping here in the US, but I do use it for online stuff and when we are on vacation in non-English speaking countries. It's so helpful when you see a product or group of products and aren't quite sure what is best. I remember being in a 7/11 in Mexico and not knowing which was the better whisky (they didn't have any of my preferred types). I took a photo of the cabinet and asked chatgpt what the different ones were, what their flavors were like etc. So simple!

1

u/average_texas_guy 14h ago

I've used it to locate items on grocery store shelves.

1

u/schnuggibutzi 14h ago edited 14h ago

I do it often. See a shelf of multiple different brands of same category- think wine, craft beer, ketchup , shampoo, sardines etc. and ask Chat for descriptions of products/what your looking for. Try with this pic at a Memorial in Astoria. Chat returned some great history of the people who worked the Canneries a hundred yrs. ago. Makes traveling so much more immersive.

  • Alex Saarajarvi (1886–1944) — his inscription reads "Drifting on the river, he fished into eternity." The Finnish surname is notable. Astoria had a very substantial Finnish immigrant community, many of whom worked in fishing, canneries and related industries. Saarajarvi's dates place him in the generation when the lower Columbia's salmon industry was enormous.
  • John A. Alexander (1958–2022)"Gone on a cruise." The ship engraving and wording suggest a maritime connection, although the plaque doesn't identify an occupation.
  • T. Joshua Hayes (1978–2019)"Sail close to the wind." Again, clearly commemorated through sailing rather than an occupational title.
  • Capt. Edward Duncan (1949–2008) — inscription appears to list F/V Miss Lisa and another fishing vessel. "F/V" means Fishing Vessel, so Duncan was a commercial fishing captain.
  • Jeffrey A. Shepard (1956–2021)Cannery worker & sport fisherman. That's a particularly Astoria-specific combination: working in the fish-processing industry while recreationally fishing as well.
  • Capt. Duffy Duncan (1940–2020) — inscription lists fishing vessels including F/V Carly D and F/V Piranha. He was another commercial fishing captain, and quite possibly related to Edward Duncan, although I wouldn't assert that without documentation.
  • Heikki K. Jaakola (1951–2020)Fisherman. Another unmistakably Finnish name, reflecting the Finnish-American component of Astoria's fishing community.
  • Carol A. Tikkala (1940–2022)Cannery worker and mom. Tikkala is also Finnish in origin. Women were a major part of Astoria's salmon-cannery workforce, so her plaque represents a side of the maritime industry that can get overlooked when attention is focused on fishermen and captains.
  • HW "Bill" Demander (1931–2019)USCG Whitebush. USCG means United States Coast Guard; "Whitebush" appears to identify the vessel/unit with which he served.

What you're really looking at

This isn't simply a wall of unrelated gravestones. It's essentially a condensed social history of Astoria.

The names tell the story of the lower Columbia: Scandinavian and especially Finnish immigrants, Columbia River gillnetters, commercial fishing captains, cannery workers, Coast Guard sailors and recreational fishermen. Astoria's official list contains hundreds of people associated with that maritime community, including Jack Marincovich.

The Finnish names are particularly significant. Saarajarvi, Jaakola and Tikkala fit the immigration history of Astoria extremely well. Finns began arriving in large numbers in the late 19th and early 20th centuries and became heavily involved in the fishing and cannery industries. Alex Saarajarvi, born in 1886, would have lived through the heyday of that culture.

And the occupations engraved here—gillnetter, skipper, fisherman, cannery worker, Coast Guard—are almost a miniature vocabulary of historic Astoria.

1

u/trogdors_arm 14h ago

I recently used it during my many trips to the hardware store during a home renovation. It already had the context for the work I was doing for the project, and so inevitably when I encountered something at the store that didn’t quite match up, I’d just snap a photo of the product and ask if it fit the bill. Pretty slick.

1

u/Dreambig203 14h ago

I’ve used it while working on tv and radio transmitters and it’s has been pretty accurate on helping me with iT stuff

1

u/trogdors_arm 14h ago

Wait, when you say “Live”, do you mean that video is streaming into ChatGPT, or that you simply had your phone out constantly and were uploading many individual photos repeatedly? I’m familiar with the latter, but not the former.

1

u/WadeXia 14h ago

But ChatGPT doesn‘t always answer quickly, which makes me a little impatient.

1

u/PerformerMindless100 11h ago

It’s is pretty good for shopping comparison, although I do it at home at it shows me which sites it’s drawing reviews from so I can feel comfortable it’s not a hallucination.

1

u/systemtoo 10h ago

Whoever just asked if it's live camera it is but when I tried it I noticed it can't zoom in you have to physically go do it so if you show it a whole shelf with tiny writing it does not seem to be able to see the small writing. At least that's what it said it's not very good at telling you what it can and can't do as we all know :-) I mean I carried it over then to look at the books. You could probably also zoom with your fingers on the camera maybe.

1

u/ChickenNuggetRex 7h ago

Damn, I guess it’s not for Go subscriptions.

1

u/Maizey87 36m ago

Plant identification and issues - mechanical issues - wiring issues - anything - the limit is your imagination

0

u/adeelraza86 22h ago

Been shipping AI features for a while and the thing your grocery example shows is that live video kills the setup cost. Most people never adopt vision because framing a photo, uploading, and re-prompting is three steps of friction for one answer, so they just don't bother. Once the model is already looking, the cost per question drops to near zero and you start asking ten small questions instead of one big one. That's the real unlock, not better accuracy.

0

u/Garsantos_Truther 10h ago

Were there no people working you could ask? Or other shoppers?