AI & Digital Identity
How your identity is built, used, and shared in the age of AI.
Lesson 3 of 6 · Estimated read: 13 minutes · Level: everyone
You have a version of yourself you’ve never met.
Industry sometimes calls it a digital twin: a modeled copy of you, assembled from purchases, clicks, locations, photos, and the behavior of people who resemble you. It makes predictions about your health, your finances, and your intentions. Companies act on it as though it were you. You’ve never seen it, and in most cases you can’t correct it.
The term borrows from engineering, where a digital twin is a simulation of a physical machine used to predict failures before they happen. Applied to a person, the ambition is the same: model the system well enough to anticipate what it does next.
This lesson is about how that profile gets built, why AI changed the economics of building it, and what you can actually do, including several rights most people don’t know they have.
In this lesson
- How AI builds identity profiles
- Facial recognition and biometric data
- Behavioral tracking and scoring
- Data aggregation and identity linking
- Deepfakes and synthetic identity risks
- Protecting your identity in an AI world
- Tools to reclaim your digital identity
1. How AI builds identity profiles
The basics
A profile isn’t a filing cabinet of facts about you. It’s mostly inferences: predictions generated by comparing your patterns to millions of other people’s.
The distinction matters. Your data is the raw input. The valuable product is what gets guessed from it: your likely income band, whether you’re about to move, whether you’re managing a health condition, how price-sensitive you are, whether you’re likely to respond to a certain political message.
Go deeper
- Modern systems represent you as a vector, a long list of numbers positioning you in a mathematical space, rather than as a list of attributes. Two people close together in that space get treated alike, whether or not anyone can articulate why.
- Inferences are often more sensitive than the source data. Nobody told a retailer they were pregnant; the retailer worked it out from shifts in purchasing. This was documented over a decade ago and the technique has only gotten better.
- Predictions get made about you using data from people who aren’t you. If your demographic neighbors behave a certain way, you inherit the assumption.
What most people don’t know
Deleting your data doesn’t remove you from a model that already learned from it.
This is the most important technical fact in the lesson. When you file a deletion request, a company removes records from databases. But if your data was used to train a model, your influence is baked into the model’s weights, diffused across billions of parameters, not stored in a row anyone can find and drop.
Removing it is an unsolved research problem called machine unlearning. Current approaches are approximate, expensive, or require retraining from scratch. In practice, companies delete the record and keep the model.
The strategic consequence is large and cuts against how most privacy advice is framed: prevention is worth far more than remediation. A deletion request is genuinely useful for stopping future flows and future sales. It is not a rewind button. Data you never gave up is in a different category from data you gave up and later asked to have deleted.
Do this today
Look at your own profile. Several companies will show you:
- Google: myadcenter.google.com shows the interests and categories inferred about you.
- Meta: Settings → Accounts Center → Your information and permissions → and look for ad preferences and “Activity off Meta.”
- Residents of California and a growing number of other states have a legal right to request inferences, not just collected data. Say the word explicitly in your request. Many companies disclose only raw data unless you ask.
2. Facial recognition and biometric data
The basics
Facial recognition doesn’t compare photographs. It converts a face into a faceprint, a mathematical template, and compares templates. Two very different operations get called the same thing:
- Verification (1:1): does this face match the one on file? Unlocking your phone.
- Identification (1:N): who is this? Searching a face against a database of millions.
The second is the one with civil liberties implications.
Go deeper
- Companies have built identification databases by scraping billions of images from social media and the open web, without consent. One such company has been fined by multiple European regulators and, following litigation in the U.S., agreed to restrictions on selling to private businesses.
- Public face-search engines exist. Anyone can upload a photo of you and find other places your face appears online.
- Accuracy is not uniform. Federal testing has repeatedly found higher false-match rates for some demographic groups, and there are documented cases of people wrongfully arrested after a facial recognition match, disproportionately Black Americans. This is the strongest argument that “accurate enough” isn’t the right standard for identification uses.
What most people don’t know
You can decline facial recognition at U.S. airport security, and most people don’t realize it’s optional.
At TSA checkpoints using facial comparison, you can say “I decline facial recognition” and request a standard manual ID check instead. You’re entitled to do this without penalty or losing your place in line. Signage disclosing the option is often small or absent.
Second thing worth knowing: biometrics can’t be revoked. A breached password gets changed in thirty seconds. A breached faceprint or fingerprint template is permanent. You cannot issue yourself a new face. This is why using biometrics for convenience (unlocking a phone, where the template stays on-device in secure hardware) is a very different risk than surrendering biometrics to a third-party database.
And a nuance that surprises people: you don’t have to be in a database to be findable. Photos of you that others uploaded and tagged, images of relatives who resemble you, and recognition techniques that work from the area around the eyes alone all contribute. Masks and sunglasses are far less protective than assumed.
Do this today
- Decline facial recognition at airport checkpoints if you’d rather not participate.
- Search for yourself on public face-search sites and use their opt-out forms. They exist, they’re required in some jurisdictions, and they work.
- Turn off face tagging and face grouping in your photo apps and social accounts.
- Know your state: Illinois, Texas, and Washington have specific biometric privacy laws. Illinois’ is the strongest. It lets individuals sue directly, and has produced settlements in the hundreds of millions of dollars against major tech companies. If you live there, your consent was legally required.
3. Behavioral tracking and scoring
The basics
Behavioral tracking has moved past what you click to how you move. Typing rhythm, mouse path, scroll speed, how long you hover before deciding, the angle you hold your phone, how you swipe.
These patterns are individually distinctive enough to function as identification, and they’re collected without any permission prompt.
Go deeper
- Banks and retailers use behavioral biometrics legitimately for fraud detection: if the typing cadence doesn’t match, flag the session. It genuinely stops account takeovers. It also means continuous authentication is continuous identification.
- Behavioral signals survive the countermeasures people trust. A VPN changes your IP. Incognito clears local history. Neither changes how you type.
What most people don’t know
You are scored by companies you’ve never heard of, and you can request several of those scores.
Beyond credit, a whole layer of consumer scoring operates in the background:
- Fraud and trust scores assigned to you by risk-assessment vendors that sit behind e-commerce checkouts, marketplaces, and ride-hailing apps. One major vendor built a consumer request portal after journalists revealed the scores existed. You can ask for yours.
- Retail return scores tracking your return and exchange behavior across chains. If you’ve ever been told you can’t make a return, this may be why, and a report exists.
- Tenant screening reports used by landlords, which are covered by federal fair-credit rules and have a documented history of misidentifying people with common names.
The pattern to notice: these function as consumer reports in effect. When they do, federal law gives you access and dispute rights, but only if you know the score exists to ask about it.
Do this today
- Request your fraud/trust report from Sift (they maintain a consumer request process).
- Request your return-activity report from The Retail Equation if you’ve had a return refused.
- Request tenant screening reports before you apply for housing, not after you’re denied.
- Turn off ad personalization at Google, Meta, Amazon, and Microsoft. It reduces what’s inferred and acted on.
4. Data aggregation and identity linking
The basics
Aggregation is the step that makes everything else work: identity resolution. Separately, your email, phone number, ad ID, IP address, loyalty card, and browser cookie are fragments. Linked, they’re one continuous record.
Companies specializing in this maintain graphs connecting all your identifiers, plus your household, plus your offline purchases.
Go deeper
- Loyalty programs are the bridge between what you buy in a store and what you see online. The phone number you give at checkout is often the join key.
- IP address links a household. Everyone on your home network gets associated, which is how ads follow your spouse after you shop.
- The industry migrated from cookies to identifiers built on your email address, which is more durable, not less.
What most people don’t know
A hashed email address is not anonymous.
This is the misconception that survives even among technical people. Hashing your email with SHA-256 produces a fixed string, described in industry materials as privacy-preserving. But hashing is deterministic: the same email always yields the same hash. So any company that already has your email can compute the hash and match you instantly. It isn’t encryption with a key nobody holds. It’s a stable pseudonym that everyone who knows your email can reproduce.
The practical implication is that your email address is the master key to your profile, and using one address everywhere is what makes the graph cohere. Email aliasing is therefore one of the highest-leverage privacy practices available, and one of the least used.
Related: “data clean rooms,” now common in advertising, restrict what queries can be run against combined datasets. They don’t anonymize the underlying data.
Do this today
- Start using email aliases. A unique address per service breaks the join key that links your activity across companies. Apple’s Hide My Email, services like SimpleLogin or Addy.io, and Gmail’s
+tagconvention (a weaker version) all do this. Aliases also tell you who leaked your address, when spam arrives at one only a single company had. - Give a junk phone number or decline loyalty programs at checkout. Ask whether the discount is available without it; frequently it is.
- California residents: the state’s Delete Act created a single mechanism, the Delete Request and Opt-out Platform (DROP), for requesting deletion from all registered data brokers at once, rather than filing hundreds of individual requests. Registered brokers are required to honor requests through it. Check the California Privacy Protection Agency’s site for current status and how to submit.
5. Deepfakes and synthetic identity risks
The basics
Two separate threats wear the same name.
Deepfakes of you: your likeness or voice replicated to deceive someone, usually your family, your employer, or your bank.
Synthetic identities: a fake person assembled partly from your real data, used to open accounts and take out credit.
Go deeper
- Voice cloning now needs only seconds of source audio. Your voicemail greeting is enough. The common attack is a distress call to a relative: your voice, urgent, asking for money.
- Corporate versions are operating at scale. In one widely reported 2024 case, a finance employee transferred roughly $25 million after a video call in which every other participant was synthetic.
- Detection is losing. Deepfake detectors degrade quickly against new generation methods, and the field is shifting toward provenance instead: cryptographic signing of authentic media at capture, as with the C2PA Content Credentials standard. The security lesson: don’t rely on your ability to spot a fake.
What most people don’t know
Children are the preferred raw material for synthetic identity fraud, and freezing their credit is free and almost nobody does it.
Synthetic identity fraud combines a real Social Security number with a fabricated name and date of birth. The ideal SSN belongs to someone with no credit history and no reason to check. That means children. Fraud can accumulate for fifteen years before a teenager applies for their first loan and discovers the mess.
Under federal law, you can freeze a minor child’s credit at all three bureaus for free. It takes about thirty minutes total, requires documentation of guardianship, and eliminates the entire attack. It is one of the highest-return privacy actions available to a parent, and it’s largely unknown.
Do this today
- Establish a family verification word. Something never sent over text or email, used to confirm identity during any urgent request involving money. Tell elderly relatives specifically. They’re the primary target of voice-cloning scams.
- Freeze your credit at Equifax, Experian, and TransUnion. Free, reversible, and the single strongest defense against identity fraud. Freeze your children’s too.
- Treat any urgent financial request as unverified until you call back on a number you already had.
- If intimate images of you are circulating or being threatened, StopNCII.org lets you generate hashes locally so participating platforms can block the images without you ever uploading them. For anyone under 18, use NCMEC’s Take It Down. Federal law now also requires covered platforms to remove such content on request within a short deadline.
6. Protecting your identity in an AI world
The basics
Three principles, in order of effectiveness: reduce what you produce, separate your identities so they can’t be linked, and verify before you act on anything urgent.
Go deeper
- Opt out of AI training where it’s offered. Several major platforms added toggles after backlash. Professional networks, social platforms, workplace tools, and creative software all have relevant settings, often on by default and buried. Check each account you care about.
- Be deliberate about what you type into AI chat tools. Consumer tiers may use conversations for training; business and enterprise tiers typically don’t. Sensitive personal, medical, and financial details deserve the same caution you’d apply to posting them.
- Prefer passkeys over passwords where available. They resist phishing, which is still how most account compromise begins.
What most people don’t know
Your relatives can expose your identity without your involvement — permanently.
Consumer DNA databases made this concrete. If a cousin uploads their genome to a genealogy service, you become findable through them, because relatedness is inferable. Law enforcement has used exactly this technique to identify people who never took a test. You cannot opt out of your relatives’ choices.
This became urgent when a major consumer genetics company entered bankruptcy proceedings in 2025, and genetic data, the most permanent identifier there is, became an asset in a corporate sale. Multiple state attorneys general publicly urged customers to delete their data.
The general lesson, and the reason this section closes the loop with Section 1: for irrevocable data, the only real control is upstream. You can change a password, rotate an email, reset an ad ID. You cannot change your genome, your face, or the fact that a model already trained on you. Spend your effort where it compounds.
Do this today
- Audit AI-training settings on your major accounts.
- If you’ve used a consumer DNA service, decide deliberately whether to keep the data there. If not, request deletion and destruction of your physical sample.
- Set up passkeys where offered.
- Adopt email aliases going forward, even if you don’t fix the past.
7. Tools to reclaim your digital identity
Ranked by protection gained per hour spent
- Freeze your credit (and your kids’): free, permanent, blocks the most damaging fraud
- Email aliases going forward: breaks the key that links your profile
- Turn off ad personalization across Google, Meta, Amazon, Microsoft
- Face-search opt-outs and photo face-tagging off
- Request your data and your inferences: you can’t manage what you can’t see
- Broker deletion: via California’s DROP if eligible, or a removal service
- A family verification word: costs nothing, defeats voice cloning
Tools worth knowing
- Permission Slip (from Consumer Reports): free, helps send data deletion requests to companies
- Removal services: Optery, EasyOptOuts, DeleteMe, Incogni. Paid, and they automate the tedium of broker opt-outs. Verify current coverage and pricing before subscribing
- Google’s “Results about you”: request removal of pages containing your personal contact information from Search results
- Have I Been Pwned: check which breaches contain your accounts
- StopNCII.org: hash-based blocking of intimate images
The honest limits
Broker removal is not one-time. Records repopulate from upstream sources, so it’s maintenance rather than a fix. That’s what the subscription services are actually selling.
Search removal hides a page from Google. The page remains.
And the limit that governs all of this: no tool removes you from a model already trained on your data. Every honest version of this lesson ends the same way: the leverage is in what you don’t hand over next.
Recap
- Profiles are built from inferences, which are often more sensitive than the underlying data.
- Deletion removes records, not model weights. Prevention beats remediation.
- Facial recognition compares mathematical templates; biometrics can’t be reissued if breached.
- You can decline facial recognition at U.S. airport checkpoints.
- Behavioral patterns identify you through VPNs and incognito mode.
- A hashed email is a stable pseudonym, not anonymity; your email is the master key.
- Children’s SSNs are the preferred input for synthetic identity fraud; freezing their credit is free.
- Relatives’ DNA uploads expose you, and genetic data is permanent.
Key terms
- Digital twin: a modeled copy of a person, built from collected and inferred data, used to predict behavior. Borrowed from engineering, where it means a simulation of a physical machine.
- Inference: a prediction about you derived from patterns, not something you disclosed.
- Machine unlearning: the unsolved problem of removing specific training data’s influence from a model.
- Faceprint / biometric template: the mathematical representation of a face or fingerprint.
- 1:1 verification vs. 1:N identification: confirming a claimed identity vs. searching for who someone is.
- Behavioral biometrics: identification from typing rhythm, mouse movement, and interaction patterns.
- Identity resolution: linking your separate identifiers into a single profile.
- Hashed email: a fixed transformation of your address; matchable by anyone who has the address.
- Synthetic identity fraud: a fabricated identity built around a real Social Security number.
- Provenance / Content Credentials: cryptographic signing of authentic media, the emerging alternative to deepfake detection.
Check your understanding
1. You submit a deletion request and the company confirms your data is deleted. Are you out of their AI model? No. Deletion removes database records. Data already used in training is diffused across the model’s weights, and removing that influence is an unsolved problem. Your request stops future use. It doesn’t reverse past training.
2. An ad company says it only uses hashed email addresses, never your real one. Are you anonymous? No. Hashing is deterministic, so anyone who already has your email can compute the same hash and match you. It’s a stable pseudonym, which is why unique aliases per service are so effective.
3. You get a call from your daughter’s number. It’s her voice, she’s distressed, she needs money urgently. What do you do? Hang up and call her back on the number you already have, or ask for the family verification word. Voice cloning needs only seconds of audio, and urgency is the tool that stops people from checking.
Next lesson: Connected Cities — public surveillance, smart infrastructure, and your privacy.