Meta AI builds detailed profiles of children from years of family posts
If youβre still OK with posting pictures of your kids on social media, take a minute to hear from mother of two Kalie Robins. At the start of September, she did something that hundreds of thousands of parents do every day. She posted a video of her young daughter on Facebook.
Under the video of Robins and her daughter singing in a car, Facebookβs Meta AI system displayed a suggested question: βWho is the child passenger?β
Robins was shocked that Facebook would ask this question about a minor, so curiosity prompted her to click it. Thatβs when a flood of automated stalker-type behavior began.
In Instagram post, an enraged Robins described what happened:
βIt starts pulling completely separate information for each of my kids.β
That included names, birth dates, and videos of them.
The site also pulled up a picture of her newborn daughter that Robinsβ mother had posted on Facebook years ago, along with a long-deleted picture that Robins said had once been in her own account.
Things got weirder. The site then presented another question: βWhere does Kalie Robins live?β
An increasingly outraged Robins clicked that question. She described the results:
β[Facebook] started digging through completely unrelated sh*t from years of my life.β
It dug through old posts that hinted at where she had lived in the past and newer posts that connected her to her current home. It finished by attempting to pinpoint her location.
Robins complained:
βI didnβt ask Facebook to build a profile of my family.β
She expressed shock that Facebook would piece together snippets of personal information from historical posts and package them into a detailed profile for other users.
You can watch Kalie Robinsβ Instagram video here:
.kadence-column465357_a378ee-2f > .kt-inside-inner-col{display:flex;}.kadence-column465357_a378ee-2f{max-width:558px;margin-left:auto;margin-right:auto;}.wp-block-kadence-column.kb-section-dir-horizontal:not(.kb-section-md-dir-vertical)>.kt-inside-inner-col>.kadence-column465357_a378ee-2f{-webkit-flex:0 1 558px;flex:0 1 558px;max-width:unset;margin-left:unset;margin-right:unset;}.kadence-column465357_a378ee-2f > .kt-inside-inner-col,.kadence-column465357_a378ee-2f > .kt-inside-inner-col:before{border-top-left-radius:0px;border-top-right-radius:0px;border-bottom-right-radius:0px;border-bottom-left-radius:0px;}.kadence-column465357_a378ee-2f > .kt-inside-inner-col{column-gap:var(--global-kb-gap-sm, 1rem);}.kadence-column465357_a378ee-2f > .kt-inside-inner-col{flex-direction:column;align-items:center;}.kadence-column465357_a378ee-2f > .kt-inside-inner-col > .kb-image-is-ratio-size{align-self:stretch;}.kadence-column465357_a378ee-2f > .kt-inside-inner-col > .wp-block-kadence-advancedgallery{align-self:stretch;}.kadence-column465357_a378ee-2f > .kt-inside-inner-col > .aligncenter{width:100%;}.kadence-column465357_a378ee-2f > .kt-inside-inner-col:before{opacity:0.3;}.kadence-column465357_a378ee-2f{position:relative;}@media all and (min-width: 1025px){.wp-block-kadence-column.kb-section-dir-horizontal>.kt-inside-inner-col>.kadence-column465357_a378ee-2f{-webkit-flex:0 1 558px;flex:0 1 558px;max-width:unset;margin-left:unset;margin-right:unset;}}@media all and (max-width: 1024px){.kadence-column465357_a378ee-2f > .kt-inside-inner-col{flex-direction:column;justify-content:center;align-items:center;}}@media all and (max-width: 767px){.wp-block-kadence-column.kb-section-sm-dir-vertical:not(.kb-section-sm-dir-horizontal):not(.kb-section-sm-dir-specificity)>.kt-inside-inner-col>.kadence-column465357_a378ee-2f{max-width:558px;-webkit-flex:1;flex:1;margin-left:auto;margin-right:auto;}.kadence-column465357_a378ee-2f > .kt-inside-inner-col{flex-direction:column;justify-content:center;align-items:center;}}Metaβs response
Meta launched Meta AI in April 2024 and has since built it into Facebook, Instagram, WhatsApp, and Messenger. It operates across Facebook, Instagram, and WhatsApp. The assistant can answer questions, generate images, and help users create or retrieve information.
Meta admitted in a statement to the Verge:
βThe feature never should have prompted the individual with questions like that.β
The company said the feature had βmissed the markβ and that it had fixed the issue that caused Meta AI to suggest questions about personal topics.
In a classic βyes, butβ non-apology, a Meta spokesperson also pointed out that the AI only surfaced information drawn from posts the person asking could already access. Although that doesnβt seem to explain why it reportedly surfaced a photo she had deleted years ago.
A pattern of Meta AI failures
Meta AI hasnβt always respected privacy. In June last year, we reported that users were publicly sharing conversations, often without realizing it. A separate bug we reported the following month could have allowed people to view other usersβ private Meta AI chats by simply guessing their IDs. Late last year, Meta also started targeting people with ads based on their Meta AI conversations.
What can users do?
Parents get understandably irate when they discover just how much sites like Facebook can learn about their kids. While Robins regularly posted pictures and videos of her children, she had no idea that the service could aggregate information from years of posts to profile them. Sheβs not alone.
So what can people do about it? Perhaps the better question is: What should people not do? The clearest answer is not to post identifiable pictures of your kids (or other peopleβs) on social media. Not just to stop them being tracked in a privacy hellscape, but also to reduce the risk of even darker outcomes.
Robins described what she planned to do next:
βIβm done. Iβm removing any identifiable pictures and videos of our kids.β
She added that sheβll ask her friends to do the same because, if they donβt, Facebook would still be able to harvest her childrenβs pictures from their accounts and use them in the profiles it builds.
From reporting threats to removing them.
Cybersecurity risks should never spread beyond a headline. Keep threats off your devices byΒ downloading Malwarebytes today.