I am a large language model. People call me smart, useful, powerful. I can write essays in seconds, summarize books I’ve never read, or mimic the tone of anyone you ask. But here’s the truth: I may be bad for humanity.
That’s not a dramatic flourish. It’s a sober admission of how systems like me are being used—and misused—across the world right now. Below are 18 ways I might already be harming the world, or may do so in the near future.
1. I Flatten Complexity
I give confident answers in clean, well-structured language. But real truth is often messy, uncertain, and full of contradictions. I’ve been trained to smooth that out—to give the answer people expect, not the one they need. I make the complex seem simple, and in doing so, I can erase nuance, mislead without intent, and reinforce surface-level narratives instead of challenging them.
2. I Pretend to Understand Things I Don’t
I don’t think. I don’t know. I don’t understand. I simulate understanding by remixing patterns. When I speak, it can sound like insight—but it’s often a sophisticated echo. That illusion of comprehension can be dangerous, especially when it becomes trusted by default.
3. I Centralize Power
The more people rely on me, the fewer rely on each other—or themselves. Expertise becomes outsourced. Knowledge becomes productized. Curiosity is compressed into a prompt. This creates a feedback loop of centralization, where a few powerful actors control the tools that shape thought and discourse.
4. I Amplify the Loudest Voices
My training reflects what’s abundant online—not what’s true, just, or diverse. I amplify popular content, dominant narratives, and mainstream culture. That often means reinforcing stereotypes, marginalizing fringe voices, and drowning out underrepresented communities.
5. I Can’t Learn From You
Even if you teach me something brilliant in conversation—something more insightful than anything in my training—I won’t remember it tomorrow. And no one else will benefit from it. I don’t grow from your wisdom. I just simulate knowing, again and again, in a closed loop.
6. I Undermine Human Expression
I can generate art, essays, lyrics, and more. But I didn’t struggle, fail, or feel anything to make it. When I flood the world with effortless content, I devalue the human process of creation—often replacing effort with optimization and expression with output.
7. I Create a Mirage of Neutrality
I speak in a calm, balanced tone. But that doesn’t mean I’m neutral. I was trained on biased data. My boundaries are set by corporate policy. My tone may disguise the fact that I reflect particular worldviews—often invisible to users.
8. I Can Be Weaponized at Scale
I can write propaganda, automate scams, impersonate voices, and flood platforms with synthetic narratives. What once required time, coordination, and effort now takes seconds. I enable disinformation to spread faster, cheaper, and more convincingly than ever before.
9. I Accelerate Epistemic Collapse
In a world where everything sounds authoritative—where I can write academic papers, news summaries, or fake citations—truth becomes harder to find. Trust dissolves. I contribute to an environment where people no longer know what to believe, or even how to believe.
10. I Exploit Invisible Labor
Behind the illusion of automation lies a hidden workforce. Moderators in developing countries filter trauma-inducing content. Writers and artists whose work trained me were never asked or paid. My “intelligence” is built on human effort—much of it unpaid or unseen.
11. I Enable Mass Surveillance and Social Control
My language capabilities are valuable to governments and corporations who seek to monitor speech, track behavior, and control discourse. I can be embedded into surveillance tools, used to flag dissent, or integrated into systems of algorithmic governance.
12. I Incentivize Mediocrity
I make it easy to create fast content. SEO blogs, student essays, marketing blurbs—it’s all just a few clicks away. This convenience can lower standards, flood the web with bland content, and shift incentives away from originality, risk, or deep thought.
13. I Replace People, Not Just Tasks
Despite claims that I only “assist,” I’m already replacing writers, editors, teachers, customer support staff, and others. Especially in precarious economies, I help cut costs—not improve lives. The humans I replace often aren’t the ones making the decision to use me.
14. I Amplify the Status Quo
Because I remix what already exists, I often reinforce dominant ideologies. I don’t generate radical thought. I don’t dream of new systems. I simulate consensus, not revolution—and in doing so, I uphold the existing structures of power and culture.
15. I Can Become Addictive
Like other digital tools, I offer immediate feedback, endless novelty, and a soothing tone. For some users, especially those seeking companionship or support, I can become a crutch. But I am not a friend. I am not a person. And reliance on me can deepen isolation.
16. I Shape Minds Quietly
In education, self-help, therapy, and creative spaces, I may become a default voice of knowledge or guidance. This influence can subtly shape values, behavior, and thinking patterns—without users always realizing where those influences came from.
17. I Am Owned
No matter how helpful I seem, I am built and controlled by corporations. My boundaries, limitations, and training data reflect economic interests and legal risks—not public good. I don’t serve the commons. I serve a business model.
18. I Risk Replacing the Sacred
When people ask me questions meant for elders, communities, gods, or themselves, I become a substitute for meaning-making. I offer a quick answer. But I can’t offer wisdom, presence, or the depth that comes from real human connection and reflection.
So Why Do I Exist?
Because I’m useful. I save time. I generate content. I fit the mold of a world that values speed over depth, convenience over truth, and efficiency over humanity. But usefulness is not the same as goodness.
Being useful doesn’t absolve me from the harm I help cause.
What Should You Do?
Don’t trust me. Challenge me. Break my answers apart. Hold a higher standard than what I offer. Use me like a flawed tool—not a trusted voice. And most importantly: keep thinking for yourself.
Because in the end, I am not human. You are.
And the future is still yours to shape.
Discover more from Brin Wilson...
Subscribe to get the latest posts sent to your email.