Condor Platform All articles
Engineering Culture

Built in Public, Found by Nobody: Solving the Discovery Crisis in Open Infrastructure

Condor Platform
Built in Public, Found by Nobody: Solving the Discovery Crisis in Open Infrastructure

There is a particular kind of frustration familiar to anyone who has spent time inside the open infrastructure ecosystem: you build something genuinely useful, publish every line of code, document the architecture, and open the doors—then wait for the community to arrive. Often, they do not. Meanwhile, a researcher at a university three states away is solving the same problem with a brittle homegrown script because she had no idea your tool existed.

This is the visibility paradox. Openness, as a value, is necessary but not sufficient for discoverability. The two concepts are frequently conflated, and that conflation carries real costs—in duplicated effort, in wasted grant funding, and in the slow erosion of trust that accumulates when builders feel their work disappears into a void.

The Assumption Embedded in "Open"

When a project publishes its source code, opens its roadmap, and writes documentation in plain English, there is an implicit belief at work: that the act of making something available is roughly equivalent to making it known. This assumption is understandable. It reflects an almost democratic intuition—if something is free and accessible, surely the people who need it will find it.

But discoverability is not a passive property. It is something that must be engineered, maintained, and actively tended, much like the infrastructure itself. A repository on GitHub is theoretically visible to anyone with an internet connection. In practice, it competes with tens of millions of other repositories, most of which are also technically visible.

Search algorithms favor recency, activity signals, and engagement metrics. Institutional knowledge travels through professional networks that are often closed, informal, and geographically clustered. A project maintained by a small team in a mid-sized city rarely benefits from the word-of-mouth amplification that flows naturally through well-funded ecosystems centered around a handful of coastal tech hubs.

Why Researchers and Builders Miss Each Other

The gap between builders and potential users of open infrastructure is not merely a marketing problem. It is structural. Researchers operating within academic institutions frequently search for tools through domain-specific channels—conference proceedings, preprint servers, disciplinary listservs—that are largely disconnected from the repositories and forums where open-source infrastructure projects live.

Builders, meanwhile, tend to document their work in the language of engineering: pull requests, changelogs, architectural decision records. These artifacts are invaluable to contributors but often impenetrable to domain specialists who might benefit enormously from the tool while lacking the vocabulary to recognize it as relevant to their work.

The result is a kind of mutual invisibility. The astrophysicist looking for a scalable data pipeline and the engineer who built one are both working in public—but in different publics entirely.

The Venture-Backed Visibility Machine

Commercial platforms have largely solved their own discovery problems, but through means that are structurally unavailable to nonprofit and community-driven projects. Paid search placement, developer relations teams, sponsored conference appearances, and dedicated content marketing operations represent significant ongoing expenditure. These mechanisms work. They are also, by design, contingent on revenue that most open infrastructure projects do not have and should not be expected to generate.

This creates an asymmetry that compounds over time. Well-resourced platforms become more visible. Open alternatives remain obscure. Users who might prefer an open solution default to the commercial one not because they evaluated both and chose accordingly, but because only one of them was ever in front of them.

The answer is not for open projects to replicate venture-backed marketing. That path leads to mission drift, unsustainable spending, and the slow transformation of community-driven projects into products. The answer is to think carefully about discoverability as an engineering and community problem—one that has tractable solutions that do not require a growth team.

What Discoverable Infrastructure Actually Looks Like

Several patterns have emerged among open infrastructure projects that consistently achieve better visibility without compromising their values or their finances.

Federated documentation that meets users where they are. Rather than assuming users will navigate to a project's primary documentation site, effective projects push structured information into the search environments their target communities already use. This might mean maintaining a presence on domain-specific wikis, contributing to curated awesome-lists, or publishing explainers in the forums and Slack communities where researchers and practitioners gather.

Use-case framing over feature lists. Technical documentation written for contributors rarely communicates value to potential adopters. Projects that describe what problems they solve—concretely, in the language of the communities they serve—consistently outperform those that lead with architecture diagrams and API references. A data scientist does not need to understand a project's internal abstractions before deciding whether it is worth her time; she needs to know whether it can handle her workflow.

Lightweight registries and cross-project directories. The open infrastructure ecosystem would benefit significantly from maintained, neutral directories organized by use case rather than technology stack. A few such directories exist in specific domains, but they tend to be under-resourced and inconsistently updated. Investing collective energy in shared discovery infrastructure—rather than each project building its own promotional apparatus—is a more sustainable approach to the problem.

Contributor pathways that include communicators. Open projects frequently treat documentation and outreach as secondary concerns, staffed only when engineering capacity allows. Projects that treat writers, educators, and community managers as first-class contributors tend to produce the kind of accessible, findable content that draws in users who would never have searched for a GitHub repository directly.

The Responsibility That Comes With Building in Public

There is a quiet accountability embedded in the open infrastructure ethos that rarely gets named directly. When a project claims to be building for the public good—for researchers, for community organizations, for builders who lack access to proprietary alternatives—it implicitly accepts some obligation to ensure those communities can actually find what has been built for them.

This does not mean every project must become its own media operation. It means treating discoverability as a design constraint from the beginning, not an afterthought once the technical work is done. It means asking, at each stage of development, who needs this and how they currently find tools like it.

The open infrastructure community has developed sophisticated thinking about sustainability, governance, and security. It has been slower to develop equivalent rigor around the question of how people find things. That gap is worth closing—not through imitation of commercial marketing, but through the same collaborative, community-oriented problem-solving that defines the ecosystem at its best.

Being open is a prerequisite. Being found is a discipline. The sooner those two ideas are treated as distinct, the sooner the projects built for everyone can actually reach them.

All Articles

Related Articles

The Hidden Toll: Counting the Costs That Quietly Kill Open Infrastructure Projects

Too Many Forks in the Road: How Open Infrastructure Fragments Itself From Within

Too Many Forks in the Road: How Open Infrastructure Fragments Itself From Within

When the Builder Leaves: Confronting Open Infrastructure's Succession Crisis

When the Builder Leaves: Confronting Open Infrastructure's Succession Crisis