Jan 15th, 2021



The very best startups build network effects along with utility value.

My startup, on the face of it, is just a utility tool. It’s a Rotating Proxy Service. Programmers call the API with a URL and based on that, I fetch the contents of the URL using proxies and give it back to their crawlers — end of the story.

But as a company, that’s not the only value I accumulate or provide. We talk to every customer about their exact needs and see all the problems they face in the whole process of web crawling and web scraping. We are very, very interested in knowing all their issues, knowledge, and lack of it, questions, doubts, options, ideas, failures, and successes. We ask them directly, we infer them by looking at our data, and we look for them actively on the internet. People have many questions on sites like Quora, Reddit, Hacker News, and other forums about Web scraping.

Getting into scenes rather than working in isolation builds another subtle value, the value that emerges as a part of a network. It's not just utility value. Like Facebook, as more and more people join the system, the cost of Facebook increases for every single user. That’s a network effect.

That’s why even when marketing, we want to end up creating network effects in the long run. An ad, for example, works to get you a visit and even a customer, but it doesn’t accumulate any value. A blog post, for example, is slower to produce amount, but it will live forever and produces data network effects.

Quora is an example of data network effects gone wild. As more people ask, view, rate, and answer questions, the value of Quora increases for everyone. We want to be tied into that value growth.

The more we participate in communities like this, post our ideas and thoughts liberally and generously on our blog, on medium, Linkedin, Facebook, etc., the more people find value in interacting with us. It is not just signing up to our service and uses it. It is this collective value of the content we have produced, The understanding of the space and its problems that we have painstakingly accumulated by poking our nose into peripheral issues that we didn’t have to get in. Talking and participating in efforts and discussions that are pushing the boundaries of web scraping is felt and is a benefit to a lot of our existing and new customers. I imagine this whole thing that we do, as an organism, slowly but surely moving, having a life of its own and getting more valuable as it grows in size, in connections, in knowledge, in empathy to the problems and goodwill. All this adds up to the product experience. It is tough work — especially in the beginning when you see no results, but it is now working for us.

This overall network effect also produces a highly defensible company as a side effect. It is complicated to compete with a company like this because of this level of moat. The value doesn’t just rest in the features but also leans heavily in the network, both of data, search engine rankings, and even human connection and goodwill.

The author is the founder of Proxies API the rotating proxies service.

Share this article:

Get our articles in your inbox

Dont miss our best tips/tricks/tutorials about Web Scraping
Only great content, we don’t share your email with third parties.
Icon