Follow

Apparently there was at some point a controversy about Samsung phones detecting when you take pictures of the moon and paste a high res moon picture to fake really good zoom

Turns out they used "AI" to do it, which of course tech journalists treat as not being the same thing

But like, an AI like that trained on a ton of moon photos is basically an over-engineered copy paste engine

@SigmaOne I think it was Huawei (at least someone linked me this article a while ago: https://in.mashable.com/tech/3114/are-the-moon-shots-from-the-huawei-p30-pro-fake)

I do like the test they describe, where they drew some extra stuff on a photo of the Moon, and took a photo of that picture, and the phone was like "nope, here's what the Moon actually looks like"

@Dee Nah that's an older one, where they did in fact fake moon pictures, later Samsung did the same thing but with AI that tends to detect the actual moon really well and avoid random stuff in front

@Dee @SigmaOne i suddenly have a whole new interest in film photography :oh_no:

@carcinopithecus @SigmaOne hey, if you use a ten year old digital camera, it probably won't have enough processing power to do moon substitutions either

@Dee @SigmaOne it just happens that this year is the 10-year anniversary of my buying this digitial camera...

@SigmaOne wait, but then it wouldn't be the picture you took, it would be a different picture of the moon, what the fuck? you could just pull a picture of the moon off the internet instead

@alienskyler Yeah, but they presumably learned from an earlier fiasco by Huawei and instead trained an AI on the moon from tons of angles so it can generate an accurately positioned high res moon

@SigmaOne I was trying to look it up and apparently a bunch of people said the moon pictures were fake but there is no proof?
if it is real I don't like it, it would be fine to use as photo editing software but it feels wrong to trick people into thinking it is a picture their camera took if it isn't really

@alienskyler I unfortunately lost the link but basically in the article I read they disassembled the camera app and found no downloading code or existing maps or pictures of the moon, but did find a third party AI module, and when Samsung was asked they just vaguely responded that they "Use dedicated AI to enhance the moon pictures", or something along those lines

And yeah it feels wrong, but like companies like this don't give a damn

@SigmaOne yeah I finally found that they aren't overlaying images but using an AI to enhance the image based on other images of the Moon, so they are doing something

@alienskyler Yeah, the thing is that an AI that can enhance sharpness and clarity like that essentially has to just be a glorified copy-paste engine, since it's dedicated to moon pictures and trained on probably millions of them

It just happens to be good at pattern matching the moon because AIs do tend to be great at that, unlike the old Huawei attempt which was just an overlay iirc

@SigmaOne wasn't Google at one of the I/O conferences bragging how they use AI to stitch together photos to make them better quality and saying that it's the same technology that NASA uses for photos

@SigmaOne inputmag.com/reviews/is-samsun apparently it's not "they literally just copy-pasted moon photos", just "they have enhancement algorithms that are optimized for the moon and a scene detector that detects moon photos"

@hierarchon The thing is, iirc Samsung stated they use AI, and someone found AI code in the camera app, and happening to know how AI works from having written a few neural net implementations, if you train it on enough moon pictures it's practically an over-advanced copy paster, just one that can detect the rest of the scene so it's not as blatant as Huawei's attempt a while back

@SigmaOne if we're going to pull out credentials, i have code in tensorflow and used to work on an ML system's training infrastructure professionally

overfitting is a problem but like... it's not something you can really say "oh, this is definitely copy-paste" just from looking at a few output images. especially since they have *other* scene detectors for things like birds and food where you obviously can't just overfit the thing

i think an interesting test would be to somehow add a nonexistent feature to the moon photo, like add a fake crater, and see what it does (like in the huawei test)

Sign in to participate in the conversation
toot.party

toot.party is a generic Mastodon instance open to queer people and allies. I try to make it as much a safe-space as I can, but then it's a collective effort.