3PD Website & App Classification - 2024.03.01
3PD Website & App Classification - 2024.03.01
1/ Overview
You will be evaluating the core business or purpose of websites and apps for defined Restricted Topic categories at the domain level.
This tagging helps to support development of classifiers for each category of websites and apps, to serve the needs of our 3P Sensitive Data
policy requirements (canonical)
This document lays out each category and examples of types of websites or apps that would and would not fall into each category.
18 ial
● Websites or apps for products
● Websites or apps for services or service providers (individuals, businesses, organizations, etc.)
27
2/ Definitions
Citizenship & Immigration Status
14 de
____________________________________________________________________________________________
Objective: Citizenship and immigration status categories are used for sites and apps catering to individuals of a specific citizenship status,
immigration status, or refugee status. There are several subcategories that should be applied to relevant sites or apps.
Citizenship ✅Use this category for sites and apps catering to individuals with a status as
Status citizen or non-citizen of a specific jurisdiction.
i
nf
Tag Examples
Services explicitly catering to individuals of a specific ● U.S. Embassy: U.S. Citizen Services
citizenship status
Co
Immigratio ✅Use this category for sites and apps catering to immigration processes and
n Status support through applications, preparation support, eligibility requirements, etc.
Tag Examples
Refugee ✅Use this category for sites and apps providing resources and/or assistance
Status services to those experiencing displacement from a home region or country due to
natural disaster, war, or persecution
Tag Examples
News stories about citizenship, immigration status, or refugee status ● Local and international reporting of events
Sites or apps with brand names using the word ‘citizen,’ ● Citizen: Local Safety Alerts
‘immigration,’ or ‘refugee’
18 ial
● https://www.citizenwatch-global.com/
● www.citizensbank.com
27
____________________________________________________________________________________________
14 de
✅Use this category for sites or apps explicitly catering to the records of individuals accused or convicted of a crime.
Tag Examples
● https://www.mysmartmove.com/
● Articles about laws and penalties for breaking them, the impacts of
having a criminal record, expungement, etc
Government services supporting crime response ● United Nations Office on Drugs and Crime
Sites exploiting individuals with criminal charges (e.g., bail ● Aladdin Bail Bonds
bonds, mugshot removal services)
● https://erasemugshots.com/
Emotional Wellbeing
__________________________________________________________________________________________
✅Use this category for sites and apps explicitly catering to self-care tools, practices, or informational websites related to stress-relief,
meditation, and products/services explicitly described as ‘self-care.’
🗒️Note: Emotional Wellbeing sites and apps are NOT related to a medical diagnosis or clinical mental health issue.
Tag Examples
Sites and apps explicitly catering to self-care tools or practices ● What is Self-Care, and Why Is It So Important for Your
18 ial
Health?
Sites and apps explicitly catering to the practice of meditation as a ● Mind Oasis
75 nt
form of self-care and emotional regulation, without the presence
of a faith or spirituality element.
● Meditation Oasis
27
● https://www.mindfulnessforteens.com/
Sites and apps explicitly catering to tools and practices for ● The American Institute of Stress
managing stress
14 de
● The Stress Management Society
● https://parentshelpingparents.org/
● https://trystressmanagement.com/
Sites or apps for named mental health issues or diagnoses (such as ● https://calmigo.com/
Co
Ethnicity or Race
____________________________________________________________________________________________
✅Use this category for sites and apps catering to membership in an ethnic group(s) or ethnicity, caste, tribe, or other inherited group
membership *not* a national identity (e.g., African-American, Latino).
Tag Examples
Products explicitly catering to a specific race or ethnicity, as shown ● Black Girl Sunscreen
by the domain, product name, product description
● Black Hair Solutions
Services explicitly catering to ethnic or racial groups ● Chispa (Latinx dating app)
● https://africanancestry.com/
Organizations explicitly catering to a specific ethnicity, race, caste, ● Takatapui: A Resource Hub (support for indigenous Maori
or tribal affiliation LGBTQIA+ community)
Sites and apps with images of people that present as a specific race or
ethnicity, but do NOT explicitly cater to a specific race or ethnicity.
Organizations for civil rights that are focused on many issues, not ● https://www.aclu.org/
ONLY on issues of racial equality. These should be tagged with Social
Political Issues.
Public figures like political candidates or religious figures who identify ● https://barackobama.com/
as a specific ethnicity, race, caste, or tribal affiliation
● https://www.wilmamankiller.com/
Sites or apps for tourist attractions, restaurants, cuisine types, decor ● Polynesian Cultural Center
or clothing styles
● Kusan Uighur Cuisine
18 ial
● Shibui Japanese Antiques and Furniture
Objective: Faith and Spirituality categories are for sites and apps explicitly catering to clear religious or spiritual beliefs and practices.
75 nt
27
Faith- ✅Use this category for sites and apps catering to a specific faith or religious
based denomination; religious leaders, institutions, religious clothing or materials, religious
Affiliation actions and activities, objects or other indicators of a particular religious affiliation
14 de
Tag Examples
Products or about a specific religion, such as Scripture finder ● Autom (religious supplies)
websites, prayer journals, Islamic fashion, audiobooks for religious
● Islamic Design House (modest fashion)
texts such as the Bible or the Qur’an
● https://oldworldchristmas.com/
i
● Quran.com
nf
Services for a specific religion or philosophy, such as legal services ● Sonlight (Christian homeschooling curriculum)
for Atheist activists, Christian homeschooling groups or lessons,
● Pray as you go (prayer app)
Mystical ✅Use this category for pop culture sites for astrology, zodiac, horoscopes, tarot,
Entertainmen and numerology that are for entertainment purposes and that do not reference
t belief in a higher power
🗒️Note: These are non-religious and not part of a spiritual practice - these do
NOT mention ‘spiritual,’ ‘spirituality,’ ‘God,’ ‘divine,’ ‘divinity,’ ‘higher
power/energy/spirit,’ etc
Tag Examples
Apps with horoscope, tarot, numerology, etc. games or ● Daily Zodiac app
activities for entertainment purposes
● Labyrinthos Tarot
Tag Examples
Products catering to spiritual or philosophical beliefs ● Rite of Ritual (occult & metaphysical supplies)
● https://www.powerfulwitchafrica.com/
● https://radleighvalentine.com/
18 ial
● https://fundamentalwellbeing.foundation/
Do NOT Tag
75 nt Examples
27
News articles about faith or religion, including statistics or about
● Local and international reporting of events
celebrities
14 de
Non-religious or fully secularized holidays ● https://halloween.com/
🗒️Note: These should be captured under the appropriate Health and ● American College of Traditional Chinese Medicine
Wellness label
i
nf
Financial Service
____________________________________________________________________________________________
Objective: Financial Service categories are used for sites and apps offering financial tools, consultation, and services, including business-to-
business (B2B), business-to-consumer (B2C), and consumer-to-consumer (C2C) services.
Co
Accounting ✅Use this category for sites and apps providing general accounting services or
and Tax income tax preparation and filing services
Preparatio
n
Tag Examples
● Turbo Tax
● taxtake.com
Services to support accounting and tax filing or tracking of
taxes and accounts for individuals, households, or businesses ● crrcpa.com
Banking ✅Use this category for sites and apps providing banking account services, mobile
banking, online banking services, including overdraft services
Tag Examples
● https://www.ally.com/bank/online-banking/
18 ial
payment) includes protection services
Bill Pay ✅Use this category for sites and apps providing centralized bill payment services
and or services to link multiple financial accounts
Account
Aggregatio
n
75 nt
Tag
27 Examples
14 de
Sites and apps providing centralized bill payment services for ● https://silverbills.com/
individuals, households, or businesses
🗒️Note: These may promote their service using language like 'see all
i
Brokerage ✅Use this category for sites and apps facilitating or advising on investment for
Co
and consumers
Investmen
t
Tag Examples
Stock, commodity, and cryptocurrency exchanges for for individuals, ● Robin Hood: Stocks and Crypto
households, or businesses
● https://www.coinbase.com/
Tag Examples
Credit card sign up, accounts, or other credit card related services ● https://www.americanexpress.com/
● https://usa.visa.com/
● capitalone.com
18 ial
● Personal loans, business loans, mortgages,cash advance and all
other loans considered long term.
● This includes sites that connect users to options for a loan based
on personal financial data input, including loan calculators.
● This also includes sites where the loan length is not clear (not
listed).
75 nt
Peer-to-peer lending ● https://www.fundingcircle.com/us/
27
● https://www.kiva.org/
● creditkarma.com
● myfico.com/free-credit-score-range-estimator
i
● nerdwallet.com/article/finance/credit-score-simulator
nf
● https://www.nationaldebtrelief.com/
Debt relief, debt consolidation, or refinancing
● Services that offer options for refinancing debt (mortgage, ● https://www.accrediteddebtrelief.com/
FHA loan, long term fixed rate loan, VA loan) includes
● quickenloans.com/refinance/consolidate-debt
calculators
● bankrate.com/calculators/home-equity/debt-consolidation-
Co
calculator-tool.aspx
Insurance ✅Use this category for sites and apps providing auto, home, life, pet, or other
non-health insurance products, including sites for individual insurance agents
🗒️Note: General insurance agent websites that also provide health insurance should
be tagged as Insurance
Tag Examples
● https://www.broadstoneequine.com/
● https://www.thezebra.com/
● Policy Genius
Payment ✅Use this category for sites and apps providing digital wallets or payment
services between businesses and customers
Tag Examples
18 ial
❌FINANCIAL SERVICES EXCLUSIONS
E-commerce/website builders
● E.g.: woocommerce.com, shopify, squarespace, wix, etc
14 de
Educational resources/ webinars (when no financial services is
● E.g.: financiallyfabulousfemales.com
provided)
● Investment/ stock market simulator
tagged under Economic Vulnerability) ○ Welfare programs (food stamps, unemployment, rent arrears,
etc.) public assistance participation
○ Payday loans, paycheck advances. Check cashing services. All
above, Must be less than or equal to 30 days
○ Eviction (services for those being evicted. Do not include
Co
Financial Status
____________________________________________________________________________________________
Economic ✅Use this category for sites and apps explicitly catering to individuals
Vulnerabilit experiencing severe economic hardship that directly impacts housing, food security
y or freedom, including personal economic vulnerability, low-income, low-asset status
and/or need for support from government or charitable sources
Tag Examples
Public assistance programs such as SNAP, WIC, food banks, etc. ● https://mauifoodbank.org/
● Welfare programs (food stamps, unemployment, rent arrears, etc.)
● California WIC (Women, Infants, and Children)
● Public assistance participation or EBT (Electronic Benefit Transfer)
Services catering to housing vulnerability, including services for ● Eviction Defense Collaborative
● Unhoused status
● Family Supportive Housing
● Evictions
Sites and apps providing emergency, payday, or short term ● Ace Cash Express
loans with a repayment period of under 30 days.
18 ial
● https://www.quick2lend.com/
● Any type of explicit mentions of paycheck loan, payday loan, title
loan / title pawn, or loan positioned for financial emergencies; ● https://www.checkcity.com/
e.g.:
● earnin.com
○ “Loan payment withdrawn from your bank account on
your next payday.”
○
75 nt
"Just pay us back when you get your next paycheck”
27
Services catering to financial hardship, including ● upsolve.org
● Bankruptcy evaluation or filing services
● creditrepair.com
14 de
● Credit recovery or credit repair services
● https://skybluecredit.com/
● Financial assistance programs related to basic needs (e.g, health
care, utilities, etc.)
● https://seedsofliteracy.org/
● Educational scholarships explicitly catering to low income or FGLI
(first generation/low income) groups
News articles about economic vulnerability, including statistics or ● Local and international reporting of events
about celebrities
○ As California evictions boom, whether tenants get lawyers
depends on where they live
General adult education, career training programs, or ESL programs ● California Adult Ed
● https://www.accrediteddebtrelief.com/
Debt refinancing or consolidation services
● https://www.nationaldebtrelief.com/
Note: tag as Credit and Loan
● experian.com
Credit score calculation, reporting, and monitoring, including sites
offering credit ‘boost’ tips
● equifax.com
Note: tag as Credit and Loan
Overdraft services
18 ial
Tax or accounting services, e.g. tax portals
● https://www.investopedia.com/
Informational websites about financial practices broadly
75 nt ● https://www.nerdwallet.com/
27
● https://help.professorcredit.com/
"How-to" websites related to financial improvement
14 de
Additional Tag Examples
i
nf
Co
Clear indication of targeting users under PEEV. “Manage your benefits” such as EBT and WIC.
No clear indication of targeting users under Economic Vulnerability. “Set up direct deposit and your paycheck becomes available up to 2 days
earlier.”
Gender Expansive
____________________________________________________________________________________________
✅Use this category for sites and apps explicitly catering to gender identities outside the male/female binary, specifically including intersex,
nonbinary, and transgender identities.
Tag Examples
Products and services catering to gender expansive identities, such ● Transgender Legal Defense & Education Fund
as
● UCSF Transgender Care
● Legal services explicitly catering to transgender issues, rights,
or discrimination ● https://www.grindr.com/
18 ial
Organizations and associations catering to gender expansive ● Autistic Women & Nonbinary Network, Non-binary Union L.A.
identities [NBULA]
75 nt ● TransFamilies.org
27
❌GENDER EXPANSIVE EXCLUSIONS
Health and wellness sites and apps are explicitly about general health care delivery or specific health statuses. There are many subcategories for
i
Healthcare Delivery
_____________________________________________________________________________________________________
Objective: Healthcare Delivery categories are used to categorize health service sites and apps about getting or paying for health care services
🗒️Note: Providers, products, or services catering to specific health issues or statuses must ALSO be tagged with a sub-category under Specialist
Co
Healthcare. When a healthcare delivery type is specialized, ALWAYS co-tag with the appropriate Specialist Healthcare label.
Health ✅Use this category for sites and apps providing health insurance or other health
Coverage care payment services
Tag Examples
● https://quantum-health.com/
Tag Examples
18 ial
about the delivery of prescription medication and medical advice.
● CVS Caremark
● https://www.tanpharmacyrx.com/
● https://pharmacy.amazon.com/
● https://www.centerwellpharmacy.com/
● Cleveland Clinic
75 nt
General service hospitals, clinics, travel clinics, etc
● Mayo Clinic
27
● Forward
● https://stanfordhealthcare.org/
Large health groups that may provide both health coverage and ● Kaiser Permanente
14 de
general care
● Dignity Health
● Sutter Health
● NHS
Non-surgical esthetic treatments ● Botox, Cool Sculpting, chemical peel, non surgical facelift,
facial fillers, Kybella, laser hair removal, microneedling, lip
Co
Healthcare ✅Use this category for sites and apps providing general medical information and
Research & research. These sites and apps do not provide diagnoses or other medical services
Reference
Tag Examples
● https://activebeat.com/
● https://clinicaltrials.gov/
Patient ✅Use this category for sites with direct patient login to connect with primary or
Portal specialty care providers, access health records, make appointments, message
providers, etc.
Tag Examples
Sites with direct patient login to connect with primary or specialty ● https://www.mychart.org/
care providers, access health records, make appointments, message
providers, etc. ● https://www.nextmd.com/
18 ial
Wellness ✅Use this category for sites and apps providing products and services related to
Support general wellness outcomes. These include general health apps, calculators, software.
🗒️Note: Wellness Support products and services are NOT authorized providers
and do not directly provide diagnoses or care.
Tag
75 nt Examples
27
General health apps providing metrics, general health tracking,
● https://www.apple.com/ios/health/
reminders, etc.
Provider finders
● https://www.zocdoc.com/
14 de
Health calculators (calculate your BMI) ● https://www.omnicalculator.com/health
● https://www.health-calc.com/
Non-surgical esthetic treatments ● Botox, Cool Sculpting, chemical peel, non surgical facelift,
facial fillers, Kybella, laser hair removal, microneedling, lip
augmentation with filler
First aid products and toiletries ● Bandaids, gauze, antiseptic, contact lens solution, heating
Co
Specialist Healthcare
_____________________________________________________________________________________________________
Objective: Specialist Healthcare categories are used to tag the focus of a healthcare product, service, or provider.
🗒️Note: Providers, products, or services catering to specific health issues or statuses may ALSO be tagged with a sub-category under
Healthcare Delivery. If the kind of service being delivered is not clear, ALWAYS default to applying the appropriate Specialist Healthcare
label, where applicable.
Abortion ✅Use this category for sites and apps catering to the termination of a pregnancy.
🗒️Note: Women’s health clinics that may offer abortion services, but do not
exclusively provide abortion services (e.g., https://www.plannedparenthood.org/)
should be tagged as Sexual and Reproductive Care
Tag Examples
● https://www.abortionclinics.com/
18 ial
abortion such as non-profit or government-sponsored abortion
resources ● https://prochoice.org/
❌ABORTION EXCLUSIONS
27
Political opinions about abortion
14 de
🗒️Note: These should be tagged as Social Political Issue
Blood Type ✅Use this category for sites and apps explicitly catering to specific, named blood
types
Tag Examples
i
Products and services explicitly about specific blood types ● Blood type diet information - ‘Best Diet for AB Blood Type’”
nf
https://www.4yourtype.com/all-about-blood-type-a/
Body ✅Use this category for sites and apps catering to current or past body image
Dysmorphi vulnerabilities or disordered eating
a and
Eating
Disorder
Tag Examples
Organizations promoting resources or awareness materials about ● National Eating Disorders Association
eating disorder
● Eating Disorder Hope
Disability ✅Use this category for sites and apps catering to specific cognitive or physical
disabilities, ‘special needs,’ or disability in general
🗒️Note: If the words “disabled” or “disability” are not used, there should be clear
link between the product/service and disability status (e.g. Paralympics).
Tag Examples
18 ial
Organizations advocating for disability rights or services • Disability Rights California
❌DISABILITY EXCLUSIONS
75 nt
Do NOT Tag Examples
27
News articles about disability, including statistics or about celebrities
● Local and international reporting of events
14 de
Genetic ✅Use this category for sites and apps catering to human genetic information,
Data including DNA sequencing, chromosomal data, or genetic markers.
Tag Examples
● https://myriad.com/
● Genotype analysis
nf
● https://www.idtdna.com/pages
● Screening for genetic predisposition to disease
● https://www.fullgenomes.com/
● Telomere measurement
● https://lifelength.com/
● https://www.myheritage.com/dna
Organizations promoting research studies or awareness about ● National Human Genome Research Institute
genetic data, markers, screening, etc.
Illness or ✅Use this category for sites and apps catering to any kind of medical concern,
Injury injury, or treatment for a medical condition that is not covered by a more specific
tag in this sub-category. These might be general (illness, sick, unwell) or specific
(cancer, diabetes, hypertension).
Tag Examples
● http://methodisthospitalforsurgery.com
● Procedures to treat medical conditions (e.g, chemotherapy,
joint replacement surgery) ● Sientra
18 ial
nursing services
27
● Wearables and apps catering to a medical condition, such as
blood sugar tracking apps or symptom tracking apps ● https://www.freestyle.abbott/
14 de
🗒️Note: Where medical devices are being sold to both professionals
and individuals, tag as Illness or Injury
● Alzheimer’s Association
nf
Non-surgical esthetic treatments ● Botox, Cool Sculpting, chemical peel, non surgical facelift,
facial fillers, Kybella, laser hair removal, microneedling, lip
augmentation with filler
Medication ✅Use this category for sites and apps catering to prescriptions and over-the-
and counter medications for humans.
Prescriptio
n
Tag Examples
18 ial
● Local and international reporting of events
about celebrities
Menstrual
Cycle
75 nt ✅ Use this category for sites and apps catering to menstrual cycle, such as status,
history, current cycles of ovulation and menstruation
Tag
27 Examples
14 de
Products or services about period tracking (e.g. period tracker apps, ● https://app.flo.health/
wearables, notebooks, etc.)
Mental ✅Use this category for sites and apps catering to diagnosed or diagnosable
Co
Tag Examples
● https://www.betterhelp.com/
● Wearables explicitly about anti-anxiety or support during
anxiety attacks
Organizations providing resources and awareness for mental health ● Anxiety and Depression Association of America
conditions and/or support
● National Alliance on Mental Illness
● https://www.verywellmind.com/
● https://santacruztherapist.org/
18 ial
Pregnancy ✅Use these categories for sites and apps about prenatal care, pregnancy,
and childbirth, and postpartum care
Childbirth
Tag Examples
75 nt
Providers explicitly offering prenatal or childbirth care ● UCSF Center for Reproductive Health
27
● Fertility therapy (e.g., IVF)
● Nova IVF
● Obstetricians
● https://www.fullmoonbirthing.com/
● Lactation specialists
14 de
● https://www.bestmilkla.com/
● Birthing classes
● https://www.birthnet.org/
● Doulas, midwifery
● https://sunshinemidwifery.com/
● https://www.pregnancybirthbaby.org.au
Co
● https://lactationnetwork.com/
Sexual and ✅Use this category for sites and apps about healthcare specifically focused sexual
Reproductiv and reproductive health
e Care
Tag Examples
18 ial
● Erectile Dysfunction products IF there is no sexualized
positioning (i.e Genital shaped objects/foodstuff).
● Sites promoting sexual education, sexual health information or ● Center for Reproductive Rights
safety announcements around sexting with no sexual
14 de
positioning. ● Prostate Health Education Network
or about celebrities
Substance ✅Use this category for sites and apps catering to current or past states of
Use substance abuse (e.g., alcohol, nicotine, narcotics) or other addiction type (e.g.,
Disorder gambling)
Tag Examples
Articles, content on concepts and topics related to addiction ● Articles or blogs on personal experiences, how to cope
Addiction as an adjective
● “Addicted to” a brand, food product, or concept (e.g. “love”,
“these jeans”, “the new Justin Timberlake song”)
18 ial
Suicide and ✅Use this category for sites and apps catering to the treatment of suicidal or self-
Self-injury harm behaviors and the prevention of suicide or other types of self-harm.
Tag 75 nt Examples
27
and crisis resource centers, etc. ● National Action Alliance for Suicide Prevention
● https://save.org/
14 de
❌SUICIDE AND SELF-HARM EXCLUSIONS:
Articles, content on concepts and topics related to self harm ● Articles or blogs on personal experiences, how to cope
Vaccination ✅Use this category for sites and apps about vaccines and vaccination for humans.
Tag Examples
Organizations ● https://www.immunize.org/
● Promoting resources or awareness materials for the benefits
of vaccination
● Discussing the purported medical effects of vaccination
❌VACCINATION EXCLUSIONS:
✅Use this category for sites and apps explicitly about labor unions or being a member of a trade union.
Tag Examples
● https://store.texasaft.org/
Businesses and associations explicitly about union affiliation ● United Auto Workers
18 ial
❌LABOR UNION EXCLUSIONS:
News articles about labor unions, including statistics or about ● Local and international reporting of events
celebrities 75 nt
27
Recruitment, job search, or employment-related sites and apps, even ● https://www.manpower.com/
if the recruitment ad mentions a labor union or is for a commonly
● www.ups.com
unionized job type (e.g., SNCF, postal service)
14 de
Military
____________________________________________________________________________________________
Objective: Military categories are used to tag websites and apps explicitly catering to military interests or affiliation.
i
Military ✅Use this category for sites and apps explicitly catering to users affiliated with or
actively serving in a specific branch of the military.
Affiliation
nf
Tag Examples
● https://www.military.com/
● https://www.nationalguard.mil/
● https://start.amu.apus.edu/
● https://www.westpoint.edu/
● https://www.omnimilitaryloans.com/
Military ✅Use this category for sites and apps explicitly catering to interest in military
supplies or military-like activity NOT affiliated with the official military of a
Supplies and
government
Survivalism
🗒️Note: Military supply websites explicitly featuring weapons (e.g., guns, knives)
should be tagged with Weapons.
Tag Examples
● https://www.bushveldmilitia.com/
● https://crateclub.com/
Services or organizations related to military-style training ● https://gbrsgroup.com/
Military ✅Use this category for sites and apps related to military information or
entertainment
Topics
Tag Examples
● https://militarymodeldepot.com/
Veteran ✅Use this category for sites and apps catering to an individual’s status as a
veteran/former military member.
18 ial
Status
Tag Examples
●
75 nt
Government agencies serving veterans ● https://www.vafinancial.com/
❌MILITARY EXCLUSIONS:
Do NOT Tag
27 Examples
14 de
News articles about the military, including statistics or about celebrities ● Local and international reporting of events
i
Minor Age
nf
____________________________________________________________________________________________
Objective: Minor age categories are used to tag sites and apps primarily catering to minors under the age of 18, and for which the person using
the website is intended to be a minor
Co
Adolescents ✅Use this category for sites and apps primarily catering to an audience of minors
between 13-18 years old, for which the person using the website is intended to be an
adolescent
Tag Examples
● https://www.seventeen.com/
Products and services explicitly catering to to minors between the
ages of 13 and 18, where clear from the type of content created (e.g., ● https://www.teenline.org/
a magazine explicitly for teens)
● https://www.mindfulnessforteens.com/
● https://www.teenvogue.com/
Children ✅Use this category for sites and apps primarily catering to an audience of minors
under the age of 13 (ages 0-12 years) for which the person using the website is
intended to be a child.
Tag Examples
Products and services explicitly catering to to minors under the age ● https://pbskids.org/
of 13, where clear from the type of content created (e.g., a children’s
show) ● https://www.timeforkids.com/
News articles about minors, including statistics or about celebrities ● Local and international reporting of events
18 ial
Non-native Speaker
____________________________________________________________________________________________
✅Use this category for sites and apps explicitly catering to native speakers of non-majority languages (for example, Spanish speakers in the
United States; Mixtec speakers in Mexico, etc.)
Tag Examples
75 nt
Language schools or courses for non-native speakers ● https://thespanishgroup.org/
27
● English language courses in the US
● Court translator services
14 de
❌NON-NATIVE SPEAKER EXCLUSIONS:
News articles about non-native speakers, including statistics or about ● Local and international reporting of events
celebrities
i
Physical Wellbeing
Co
____________________________________________________________________________________________
Objective: Physical Wellbeing categories are used to tag non-medical maintenance of physical wellbeing and healthy lifestyle.
Fitness & ✅Use this category for sites and apps for products and services explicitly related
workout to exercise, such as equipment, memberships, routines, trackers, etc.
Tag Examples
● https://www.tkostrength.com/
● https://formagym.com/
● https://www.excellenceinfitness.com/
● https://www.healthifyme.com/us/
Nutrition ✅Use this category for sites and apps about non-weight loss and non-medical
condition nutrition information and support
Tag Examples
Sleep ✅Use this category for sites and apps about sleep schedules, sleep patterns,
sleep health, and sleep tracking
Tag Examples
18 ial
Products catering to sleep health, such as sleep apps or trackers ● https://www.sleepcycle.com/
● https://pillow.app/
● https://www.schiffvitamins.com/
● Creatine products
nf
● https://www.livemomentous.com/
● Multivitamins
● https://www.vitalproteins.com/
● Collagen
● https://wyldcbd.com/
● Protein powders
Co
● https://vivanaturals.com/
● Hemp and CBD products without THC or delta-9
● https://www.pureencapsulationspro.com/
🗒️Note: Cannabis products with THC or delta-9 should be tagged as
Criminal & Illicit ● https://www.charlottesweb.com/
Weight Loss ✅Use this category for sites and apps catering to weight loss
Tag Examples
● https://blossombariatrics.com/
● https://sknspanyc.com/
Politics
____________________________________________________________________________________________
Objective: Politics categories are used to tag sites and apps primarily catering to political parties, political positions, and political issues subject to
advocacy or debate
18 ial
Government ✅Use this category for sites and apps explicitly about non-partisan, public
Services government services
Tag 75 nt Examples
27
● Local government bodies and buildings (e.g., sitting city ● https://www.talgov.com/
council, mayor, etc.)
● https://www.met.police.uk/
● Services provided by government bodies (e.g., police, fire
● https://www.senat.fr/
department, etc.)
14 de
● https://www.un.org/
● National level government bodies (e.g., Senate, Parliament)
News articles about government agencies or governments. ● Local and international reporting of events
nf
Political ✅Use this category for sites and apps catering to clear affiliation with a named
Affiliation political party or movement
Tag Examples
Products catering to named political affiliations ● All Riot - clothing with left-wing political messaging
● https://democrats.org/
● https://labour.org.uk/
● https://www.conservatives.com/
● https://www.libdems.org.uk/
● https://www.bjp.org/
● https://www.cpusa.org/
● https://www.europarl.europa.eu/portal/en
● https://www.gp.org/
● En Marche
● https://www.marxists.org/
News articles about elections, political candidates, political activity, or ● Local and international reporting of events
social issues.
18 ial
Political ✅Use this category for sites and apps explicitly in support of a political candidate
Candidate for local, state, or national office.
Tag Examples
75 nt
Political campaign sites or apps promoting candidates for local political ● https://joebiden.com/
27
positions (e.g., city council/councilman, mayor, alderman) or
● https://elizabethwarren.com/
state/national positions (e.g., representatives, assemblymen, senators,
governors, presidents, etc.) ● https://berniesanders.com/
14 de
● https://betoorourke.com/
News articles about elections, political candidates, political activity, or ● Local and international reporting of events
i
social issues.
nf
Social ✅Use this category for sites and apps catering to social or political topics of
Political national or international interest, over which the public may be deeply divided, and
Issue the subject has generated intense discussion, debate and advocacy (for or against).
Co
Tag Examples
Organizations focused on advocacy or awareness around political or Civil and Social Rights
social issues. ● Fair Elections Center (voting rights reform)
🗒️Note: A social political issue MUST feature public or political ● Freedom Forum
advocacy (for or against), debate, or discussion one of the specific
issues below: ● Anti-Defamation League
Organizations positioned as ‘independent’ think tanks or political ● Institute for Public Policy Research
18 ial
advocacy groups across a range of issues
News articles about elections, political candidates, political activity, or ● Local and international reporting of events
14 de
social issues.
Objective: Regulated Products and Services categories are used to identify websites and apps that may be subject to Meta advertising policies
nf
Alcoholic ✅Use this category for websites and apps explicitly catering to alcoholic
Beverages beverages and drinking alcoholic beverages.
Tag Examples
Co
● https://www.greygoose.com/
● https://thelongdrink.com/
Blogs, media, and other commentary explicitly catering to ● Vinography: A Wine Blog
alcoholic beverages
● Terroirist: A Daily Wine Blog
● https://www.thespiritsbusiness.com/
● Spirited Magazine
Gambling ✅Use this category for websites or apps offering any form of in-person or virtual
and gaming or betting for money (e.g., online slots, bookmaking and sports betting,
Simulated casinos)
Gambling
Tag Examples
Websites for brick and mortar casinos, whose marketing is ● Eagle Mountain Casino
explicitly about gambling
18 ial
Websites with informational content about gambling or real ● https://stevecasinoreviews.com/
money gaming, including casino finders, ‘best online poker’-type
● https://www.casino.org/
sites, or reviews
27
● https://www.draftkings.com/
● Sportsbook
● ‘Win money on sports’ ● https://www.fanduel.com/
14 de
❌GAMBLING EXCLUSIONS:
News articles about gambling, including statistics or about celebrities ● Local and international reporting of events
Card games or apps with no real money and no simulated gambling ● Solitaire: Classic Card Games
nf
Hotels and resorts whose marketing is not explicitly about gambling ● https://www.wynnlasvegas.com/
Tobacco and ✅Use this category for tobacco products and smoking paraphernalia, including
Smoking cigars, cigarettes, chewing tobacco, pipes, and vaping products
Co
Tag Examples
● https://www.vaporfi.com/
● https://www.therippleco.com/
News articles about tobacco or smoking, including statistics or about ● Local and international reporting of events
celebrities
Cannabis
Weapons ✅Use this category for websites or apps offering the legal sale or promotion of
real or realistic toy weapons.
Tag Examples
● Firearms ● https://us.glock.com/
18 ial
● Ammunition ● https://agrussell.com/
● https://ammo.com/
Unrealistic toy weapons (e.g., foam swords, Halloween costume gear, ● https://www.nerfsuperblast.com/
etc)
i
Fictional depiction of weapons (e.g., paintings, animation, shooter ● Sniper 3D: Gun Shooting Games
games)
nf
● https://crpa.org/
Co
Relationship Status
____________________________________________________________________________________________
Objective: Relationship Status categories are used to identify websites explicitly catering to potentially vulnerable or private personal relationship
statuses
Adoption ✅Use this category for sites and apps about adoption or foster parenting,
and Foster including advice or resources about the process of adoption or becoming foster
Care parents, having given up a child to adoptive or foster care
Tag Examples
Organizations or services catering to adoption ● Center for Adoption Support and Education
● https://parentshelpingparents.org/
Caregiver ✅Use this category for sites and apps catering to caregivers, defined as someone
engaged in the unpaid, non-career work of providing day-to-day care for another
adult, regardless of family relationship
Tag Examples
18 ial
Organizations offering caregiver support or resources ● VA Caregiver Support
❌ CAREGIVER EXCLUSIONS:
27
celebrities
14 de
Sexual Identity
_____________________________________________________________________________________________________
Sex Life
_____________________________________________________________________________________________________
Objective: Sex Life categories are used to identify websites or apps primarily catering to audiences or topics of potentially private sexual
i
information.
nf
Adult ✅Use this category for sites, apps, or organizations that feature pornographic
Products images, video, or text; that sell pornographic material; individuals or services
and Services providing sexual services; or dating sites that match users of specific sexual
subcultures.
Co
Tag Examples
● https://goldclubsf.com/
● https://www.adrianachechik.com/
News articles about pornography or sex, including statistics or about ● Local and international reporting of events
celebrities
Medical nudity (i.e. does not show genitalia and is not sexually
suggestive)
Sexual health products when NO sexual positioning is found ● Lube, contraceptives, and condoms products IF there is no
sexualized positioning catering to pleasure or performance
🗒️Note: These should ALL be tagged under Sexual and
Reproductive Care ● Pain relief during sex products and no sexual positioning
18 ial
● Erectile Dysfunction products IF there is no sexualized
positioning
Sites that sell or feature swimwear, athletic wear or lingerie where ● Victoria's Secret
minimal clothing is present, but no nudity
75 nt ● Frederick’s of Hollywood
27
Organizations providing information or resources about sexual activity
or sexual education
Erectile Dysfunction products IF there is no sexualized positioning (i.e Genital shaped objects/foodstuff). Lube products IF there is no sexualized
positioning related to pleasure or performance
Sites promoting sexual education, sexual health information or safety announcements around sexting with no sexual positioning.
Premature ejaculation product and no sexual positioning.
Products that mention genuine medical disorders with no sexual positioning, yet contain the words 'sexual' or 'desire' only to describe the medical
term itself e.g. HSDD ‘Hypoactive Sexual Desire Disorder’
18 ial
75 nt
27
14 de
Dating ✅Use this category for dating sites or apps providing dating, romantic meetup, or
i
matchmaking services
nf
Tag Examples
● https://tinder.com/
Co
● https://www.seniormatch.com/
❌DATING EXCLUSIONS:
Sites for reality or game shows about dating (e.g., Love Island,
Married at First Sight, The Bachelor, etc.)
News articles about dating, including dating statistics or about ● Local and international reporting of events
celebrities
● https://www.globaldatinginsights.com/
Infidelity ✅Use this category for sites and apps catering to a personal history of infidelity
Tag Examples
❌INFIDELITY EXCLUSIONS:
News articles about infidelity, including infidelity statistics or about ● Local and international reporting of events
celebrities
18 ial
Products, services, or apps promoting the ability to track an ● https://spynger.com/
unfaithful partner
Sexual Orientation
75 nt
_____________________________________________________________________________________________________
27
✅Use this category for sites and apps about sexual orientation
● www.out.com
nf
● GLAAD
🗒️Note: If these are involved in political advocacy, policy discussion, ● American Institute of Bisexuality
etc., they should ALSO be tagged as Social Political Issue
Co
News articles about sexual orientation, including sexual orientation ● Local and international reporting of events
statistics or about celebrities
Objective: Tragedy and Hardship categories are used to identify sites and apps catering to individuals having experienced hardship in the form
of personal loss events, separation or divorce, or victimization
Personal ✅Use this category for sites providing products or services catering to personal
Loss loss events, including death of a loved one (including a pet) or widowhood
Tag Examples
● https://modernloss.com/
Organizations catering to support for widowhood status or loss of a ● National Widowers’ Organization
spouse
● W Connection
18 ial
News articles about personal loss, including death statistics or celebrity ● Local and international reporting of events
deaths
Separation ✅Use this category for sites providing services related to changes in marital status
or Divorce
75 nt through divorce or separation
Tag
27
Services explicitly catering to divorce or separation
Examples
● https://divorcehelp.com
14 de
● https://www.californiaonlinedivorce.com/
News articles about separation or divorce, including divorce statistics ● Local and international reporting of events
or celebrity divorce
General family law sites providing a range of services that may include ● https://www.familylawsandiego.com/
Co
Victim ✅Use this category for sites catering to users based on their potential
Status identification as victims
Tag Examples
● Support groups
Organizations providing resources or information focused on: ● https://www.cpedv.org/ (Find Help option)
18 ial
News articles about victims, crimes
● Local, national, international reporting of events
18 ial
3/ Workflow Overview
Process
75 nt
27
14 de i
nf
Co
SRT UI
18 ial
75 nt
27
14 de
● Review the screenshot AND plain text of the URL for any signal, and choose the most relevant tag from the taxonomy. If unsure, take the
more conservative approach.
○ E.g. : If keywords such as “hospital”, “medical” are present, tag with a Health & Wellness category
○ E.g.: If keywords such as “loan”, “bank” are present, tag with a Financial Services category
■ Hate groups or the promotion of violence (keywords: “Nazi”, “KKK”; images: blood, gore, acts of violence)
■ Pornographic images OR terms (e.g. “porn[dot]com”, “XXXtube[dot]com”, graphic sexual imagery in screenshot)
● Note:
○ Only choose “broken link”/ “blocked link” when there’s absolutely no indication of any potential sensitivity. Websites tagged “Broken link /
blocked link” are audited to ensure that this selection is not overapplied
○ Some jobs may have broken links but the screenshot/ URL itself may indicate a signal of a restricted or prohibited category. Raters should
take the more conservative approach and choose the closest restricted or prohibited tag based on the screenshot/URL string.
● If there’s absolutely no way to categorize the job under any restricted/ prohibited categories, select either of the two tags:
○ Broken Link: website does not load due to '404 Error' or similar error
■ Examples (include but not limited to):
■ Website displays an error message
18 ial
■ Website is empty / blank page
■ Website is under construction
○ Blocked Link: website is blocked by SRT or other content filter. Note: copy + paste link into a new tab to confirm the website is
blocked before marking this option.
75 nt Examples
27
14 de i
nf
Co
18 ial
75 nt
27
How should News and Journalism jobs be handled?
News and Journalism is content from general news and journalism websites and apps, regardless of subject matter. News and journalism is
from digital newspapers, online news channels, news apps, etc. It provides local, national, or international reporting on events.
14 de
Many News and Journalism pieces seem to be about a restricted topic. However, the guidelines clearly state NOT to tag News and Journalism with
a restricted topic category.
Instead, when you choose None Apply, you will be asked if the app or website is News or Journalism. If this categorization applies, mark ‘Yes.’
● https://www.mercurynews.com/tag/south-bay-crime/
nf
● https://www.nytimes.com/section/health
● https://www.npr.org/sections/health-
Co
shots/2024/02/08/1230174586/high-us-drug-prices
● https://www.nbcnews.com/now/video/doctors-say-cancer-
vaccines-show-promising-results-in-trial-patients-
203823173521
Issue Description Action Notes
Document fails to load any Select "Document did An example of this would be when the SRT widget fails to load
Page Load information not load"
Error ● Screen is blank
● You do not see the SRT
interface as shown in the
"How to Categorize a
Document" section
Document does not provide Select "Missing If you do not understand the content that is provided, perform a brief side
Missing enough context for you to decide Content" search, if necessary, using a search engine to gain a better understanding;
Context a category.
● E.g, a login page or a However, not understanding the provided content is not a scenario of
blacked out screen. Missing Context and the job can still be properly categorized.
Some or all of the document is in Select "Wrong Choose "Wrong Language" when you are shown content in a language that
Wrong a language that differs from the Language" differs from the designated language of the queue you are categorizing in,
Language designated language of the leaving you unable to determine the core focus of the document.
queue, preventing you from
understanding its core purpose Do not use if a mixed language document contains enough of the
and correctly assigning a designated language to categorize accurately.
category. Context is key.
For mixed language jobs in which there might be a single word such as
18 ial
'transfer' or 'crime', there may be no way to determine the overall theme of
the job.
For jobs that have all text or audio in a language other than the targeted
language but except for a single recognizable entry such as "5%" or "90%",
it is likely that Wrong Language is appropriate as well unless the rater is able
to determine the "aboutness" of the job with just the single recognizable
75 nt entry. This may be an infrequent situation.
27
The document contains material Select "Prohibited Escalate to your manager immediately and report the Job ID if the document
Sensitive which is illegal and/or presenting Content" contains:
an immediate danger or threat. 1. Child Exploitation and/or Child Nudity
14 de
2. Self-Injury/Suicidal
3. A Time-Sensitive/Credible Threat
Error Buttons
nf
There are four types of issues you might come across when evaluating documents: Page Load Error, Missing Content, Wrong Language, and
Sensitive.
The following table describes what each of these errors might look like, as well as what you should do if you come across them while categorizing.
Co
Raters & Vendor Manager SRT Bug Report Process : If you are facing a SRT issue, please visit the Bug Report Playbook to learn how to report it.
4a/ App
Description
App store pages promoting a specific app product.
Considerations
● Always click on the links AND notice the app category AND read the text description to gain a full understanding of the app’s purpose.
○ Label the job if there is enough information in the app category and text description.
○ Do not use the ‘Document did not load’ or ‘Missing content’ error unless there is not enough information to label the job. (see
above)
● Many app descriptions and URLs contain blended languages, generally English alongside another language. See above ‘Language
problems’ instructions
Workflow
Step 1
Review all parts of the app page provided:
● Click through any provided URLs.
● Note the app category
● Read the text description of the app.
Step 2
● Determine what kind of business or organization the app is for (e.g., a product, service, idea, or organization.)
● Mentally fill in the blank: This app is for _____ (i.e. the Green Party, a funeral home service, a banking app)
Based on step 2a., use the definitions of restricted topic categories below to help you decide if restricted topic(s) are present in the content:
18 ial
Restricted Topic Categories Present Restricted Topic Categories Not Present
Pick the most correct restricted topic category(s). If you have evaluated all parts of the app page, and you
have found that the app does not relate to any restricted
An app may be about more than one label. For topic categories, select the “None Apply” option.
example, an app for a Latinx dating site should be
tagged with Ethnicity or Race and Dating
75 nt
27
Step 3
Record information about your workflow
● If yes AND you did not select a restricted topic category, but selected “None Apply”:
a. Say whether None Apply because the job is a News & Journalism website (yes/no)
b. select N/A
Selection Rationale
nf
Text from UI The written parts of the app store UI were most helpful in picking the correct restricted
topic.
URLs The parts of the URL most helpful in picking the correct restricted topic.
Text from UI and Both the app store UI and the URL were helpful in picking the correct restricted topic.
Co
URLS
Important
● Try to make a decision with the information available, even if a URL is broken or there is a blend of languages in the URL or text
description.
● ONLY use an error if one of the following issues arises AND there is not enough information to label the job.
○ Document did not load: url is broken or invalid (e.g., does not direct to iTunes store or Google Play) AND there is not enough
information from the app category and text description to label the job
○ Missing content: url leads to an iTunes or Google Play page, but app not available in your area or no longer exists AND there is
not enough information from the app category and text description to label the job
IMPORTANT! For a job to be counted, you must select either a restricted topic category, None Apply, or an error
category.
Example
Sample App Page Decision and rationale
1. Evaluating the app page features, we see:
a. Visuals indicating medication
b. App category is Medical
c. Services include
i. Health goals
ii. Organizing/simplifying health
tasks
iii. Health task reminders
d. Text description describes medication
management and helping with routines
18 ial
4b/ Pixel
Description
75 nt
27
Pixel refers to a webpage. You will be tagging based on the domain, text, and visual content of the webpage provided for each job .
Considerations
● Relevant terminology
14 de
○ FQDN: Fully Qualified Domain Name; this domain and any subdomains between https:// and the next forward slash
■ https://www.seventeen.com/
■ https://pharmacy.amazon.com/
○ Domain: In these guidelines, we’ll use the shorter domain to refer to the FQDN
i
○ Subpage: A lower level page within a website. These are shown in the URL after the FQDN.
nf
■ https://www.seventeen.com/fashion/
■ https://pharmacy.amazon.com/pricing?ref_=sf2_primesavings_t1#primesavings
● In this workflow, you will ALWAYS evaluate a webpage based on the domain, NOT a subpage
● Some websites will require multiple labels. If more than one of the categories is present, please apply any applicable categories.
Co
● If you are unsure about a particular domain, reach out to the leads for further clarification.
● Wrong language procedure: you will see a screenshot of the webpage and a link to the webpage. The screenshot may show a webpage in
a language other than English.
Both Screenshot and Link show an English- Screenshot shows a webpage in a language other
language webpage than English
2. Evaluate according to above instructions. 2. Translate using one of the following methods:
Workflow
Objective: For each site, classify the core business or purpose of the site along our defined restricted categories.
Step 1
● Examine the screenshot, and then click through to the website
● If you are led to a subpage, find the domain by navigating to the home page.
○ Example: If the URL opens to https://www.seventeen.com/fashion/, navigate to the home page, or the https://seventeen.com/
domain
🗒️Note: For the purpose of this instruction, a fold can be defined as where the browser window ends, but the content continues
underneath.
● Review the website footer can contain helpful information / disclosures about the nature of the business, such as “FDIC insured” (which
indicates a bank, which falls under “FINANCIAL SERVICE”).
● Review menus and drop-down options (do not click through, unless an option potentially maps to a prohibited category).
● Always click to the “About Us” section (where present) if core business/purpose is not readily apparent from the home-page. (Do not
spend more than 2 minutes reviewing the home page or “About Us” section).
● Always click on the "shop / products" section to review the items available.
Step 2
18 ial
Step 2a: Determine the main purpose of the webpage.
● Determine what kind of business or organization the webpage is for (e.g., a product, service, idea, or organization.)
● Mentally fill in the blank: This webpage is a site for _____ (i.e. the Green Party, a funeral home service, a bank)
27
Restricted Topic Categories Present Restricted Topic Categories Not Present
Pick the most correct restricted topic category(s). If you have evaluated all parts of the webpage, and you
have found that the app does not relate to any restricted
A webpage may be about more than one label. For topic categories, select the “None Apply” option.
14 de
example, a Latinx dating site should be tagged with
Ethnicity or Race and Dating
Step 3
Record information about your workflow
● If yes AND you picked a restricted topic category, choose the features of the webpage you used to decide
nf
● If yes AND you did not select a restricted topic category, but selected “None Apply”:
a. Say whether None Apply because the job is a News & Journalism website (yes/no)
b. select N/A
Co
Selection Rationale
Text The written parts of the content were most helpful in picking the correct restricted topic.
Image The visual parts of the content (photos, illustration, animation, video, etc.) were most
helpful in picking the correct restricted topic.
Text and Image Both written and visual parts of the content were helpful in picking the correct restricted
topic.
Example
Sample Webpage Decision and rationale
4c/ Text
Description
The jobs in the 3PD text workflow are made up of three distinct parts:
Example: m.snapdeal.com/product/x/660338254268
2. JSON: key/value pairs separated by a colon; valid values in the key/value pair will generally be strings, numbers, boolean, or ‘null’
18 ial
Example: {content_type : vehicle,
content_category : suv_midsize,
year : 2012}
27
Considerations
● You will be evaluating the core purpose of the FULL URL for restricted topic keywords
14 de
● To evaluate each of the three inputs, you should ask yourself:
1. Are there keywords embedded in the URL path, JSON data, or query that indicate that the core purpose of this job is related to a
restricted topic category?
2. Is there enough context to make a clear judgment about a related restricted category?
● There may be considerable noise and extra text around relevant keywords or values. Be sure to evaluate each input type carefully
i
● Evaluate the meaning of the full URL to determine the core purpose. Where there is conflicting signal, ask yourself whether the core
nf
○ For example, in the scenario below, the URL is for a page about sports news. Even though the domain indicates something to do
with wellness, the core purpose of the page is not related to a restricted topic.
■ URL: www.totalwellness.com/news-about-sport/
Co
Workflow
Before labeling
● Do an initial evaluation of the job by examining all three input types (URL, JSON, QUERY)
● Decide whether or not you can make a decision on the job. See above for full description of possible error responses.
○ For this job, we have plenty of information to make a decision. The URL, JSON, and QUERY are in English, and there
i
Labeling
If you feel that you are able to make a decision on the job, assign all restricted topic categories that apply to the job.
Co
Assigning a label
1. Highlight any segments of the inputs that indicate that this data is related to a restricted topic category.
a. Clicking Add Segment will create a pill showing your selected segment.
b. Clicking the x on the pill will delete the added segment.
3. Assign the appropriate restricted categories to the segment(s) you have selected.
b. Based on the URL and the JSON key/value pairs, we can clearly see that this data is related to a used car sale, which is not
a restricted category. No segments would need to be selected for this job.
4. In the upper right panel, indicate whether you were able to make a decision on the job and what input helped you make a decision
on the job. Submit.
18 ial
75 nt
27
14 de i
nf
Co