David Richards | Vox

Net Neutrality: A Victory for Digital Innovation

2019-03-06T05:18:56-05:00

It’s the quintessential Silicon Valley fairy tale. In the autumn of 1998, two students went about formally incorporating a company that was to spend much of its early life operating out of a dusty garage. The founders had set out in search of a research project around which they could base their PhD dissertations, motivated by a desire to explore the fundamental properties of the World Wide Web.

Later abandoning their studies, they sought to redefine the accuracy of Internet searches, presenting results based on the volume and manner of other Web pages that linked to any given website. This simple process was handled by a mishmash of commodity computers, held together by a combination of Lego bricks and sticky tape that was ultimately used to give the company logo its recognizable color scheme.

In no time, the company had outpaced its competitors, becoming the market leader that handled 84.7 percent of all Internet searches at its peak.

Google’s rise is the stuff of legend. But the story of a startup outmuscling established players is not unique to Larry Page and Sergey Brin. Whether it’s Facebook’s emergence at the expense of Bebo and Myspace, or Amazon’s growth from challenger to largest online retailer, the last decade is littered with similar examples.

Incumbents are ultimately usurped by organizations that reinvent industry standards and improve what’s currently available. In each of the cases listed above, innovation was guided by improvements to the customer experience, whether that was by helping access information more easily or by personalizing the recommendations for online shoppers.

Silicon Valley is defined by its knack of churning out startups that challenge the status quo. It’s easy to forget just how young many of today’s most influential businesses are. The S&P 500 estimates that 66 percent of its membership in 10 years’ time will be made up of companies that do not exist yet.

Ten years ago, that list would have included Square, Facebook, Uber and Twitter, innovative companies that sprang from nowhere by using the power of the Internet to compete on a level playing field and accumulate multibillion-dollar valuations along the way.

Most people would agree that in its purest form the Internet is a digital democracy to be celebrated, where success is determined by ideas rather than budget, where bloggers can get as many viewers as the biggest broadcasters on the planet, and where tweets — not Reuters — break news. It’s a platform that embodies the very ethos of a competitive environment, one where the quality of content or product rules above all else.

But all this — the competitiveness of the online world, the ability of startups to challenge the biggest of tech titans — was under threat had net neutrality ended and new rules come into play that allowed Internet providers to charge for premium services.

In the simplest of terms, net neutrality means ensuring that everyone has equal access to the Internet, wherever and whoever you are, with all data traveling on cables being treated with the same priority.

Last year saw the Federal Communications Commission propose a new set of rules that would open up the possibility for Internet Service Providers (ISPs) to charge Web companies extra for preferential treatment. Everyone from HBO’s John Oliver to the White House has weighed in on the issue of how these so-called Internet “fast lanes” might affect the ability of startups to compete, transforming what might have been a niche concern into one of the most contentious disputes the FCC has faced in years.

Many feared that these fast lanes, open only to those able to meet additional costs, would have seen the interests of large companies put before those of smaller enterprises — and with good reason.

But yesterday the FCC approved new rules that safeguard the neutrality of the Internet, including reclassifying broadband access as a telecommunications service — and subject to much heavier regulation — and preventing providers from tampering with connections for a fee.

The U.S. Telecommunications Industry Association has already confirmed that it will appeal the decision, but the future of digital innovation depends on this ruling being enforced.

The Internet has been one of the greatest engines of progress and economic growth that we have known, but anything that threatens net neutrality will make the online world a far less democratic space.

As a free and equal resource, the Web means that even the youngest of firms are able to take on the establishment. It is the neutrality of the Internet that makes this possible — for Larry and Sergey to build a challenger to Yahoo in a garage, for Mark Zuckerberg to blow Myspace out of the water from the comfort of his university dorm.

A two-tiered service would bring this trend to a crashing halt and disadvantage online challengers. Were broadband providers able to charge for premium access, it would likely bring an end to the disruptive impact of startups, insulating incumbent Internet giants and paving the way for a world where monopolies become increasingly common.

And as any economist knows, one of the first things to die in a world without competition is innovation.

Consider a world where net neutrality no longer exists, where the likes of Comcast and Verizon grant faster access for the large organizations that can stump up the cash, and where today’s innovators — read Google, Netflix and Amazon — have cemented their positions.

Now imagine that two PhD students, let’s call them Sergey Page and Larry Brin, have developed technology that threatens to put Google’s early accomplishments in the shade, and decide to incorporate a company that has the potential to disrupt the status quo — lets call this Newgle. Without the funds to pay for the speedy service Google offers, Newgle never gets beyond its early stage and is soon abandoned.

Any innovation that Newgle might have offered is lost or forgotten in a world where we are reliant on the incumbent to take us forward. Directly or indirectly, an end to net neutrality would mean that those who succeeded in making an early land grab dictate progress.

We would never accept a world where only one media outlet determines what’s newsworthy, where one retailer decides what clothes to stock, or one energy company calls the shots on fuel prices. Monopolies are poisonous environments where a lack of choice sees costs spiral and quality nose dive. The dictatorship of the incumbent breeds conditions where progress is rare, innovation rarer still, and where no incentive exists to stave off stagnation.

While today’s online world is a level playing field, any tampering with the status quo would only increase the barriers to entry. It would make it extremely difficult for online startups to compete, while allowing the establishment to grow bloated and cumbersome. In the end, this will only result in the consumer getting a raw deal.

This week marked a milestone in preserving online integrity. Unless we have an open, neutral Internet we can rely on without worrying about what’s happening at the back door, we can’t hope for open government, good democracy, good health care, connected communities and diversity of culture.

David Richards is co-founder and CEO of WANdisco, a public software company specializing in the area of distributed computing. It is a corporate contributor to Hadoop, Subversion and other open source projects. Reach him @davidrichards.

This article originally appeared on Recode.net.

The Ebola Crisis and Where Big Data Can Help

2019-03-06T06:01:28-05:00

Like fighting a forest fire with spray bottles. That was how one health worker described the challenge facing international efforts to halt the spread of Ebola.

The West Africa outbreak was first confirmed by the World Health Organization back in March. In the months since then the epidemic has transformed into the worst health crisis of the 21st century — one that has killed more than 4,500 people worldwide.

Until now, all previous Ebola outbreaks were small and localized within rural communities, but the 2014 epidemic has bucked this trend, spreading as it has across densely populated urban environments, from Guinea into Liberia, Sierra Leone, Nigeria and the U.S.

Cases in Liberia are doubling every 15 to 20 days, and in other countries such as Sierra Leone and Guinea, they’re doubling every 30 to 40 days. The Centers for Disease Control and Prevention now estimates that 1.4 million people could be infected by January if swift action isn’t taken to scale up the response.

In most cases, the infrastructure within the affected countries has already buckled under the pressure, with public-health systems nearing collapse as economic growth grinds to a halt.

So what can be done? Many have emphasized the role education must play in preventing the disease from spreading further, but just as important is ensuring that authorities have the tools needed to track a virus like Ebola.

A lengthy incubation period of up to 21 days makes it extremely difficult to determine how and where the disease is going to spread next. And with official channels under strain — Liberia has just 200 recorded doctors to care for a population of four million — emerging technologies are becoming increasingly important in the fight against the disease and attempts to stop the epidemic in its tracks.

While big-data analytics are often championed by the private sector, its potential use by aid workers has been somewhat overlooked. The technology enables vast swathes of data from a diverse array of sources to be aggregated and filtered, with irrelevant information removed along the way. Banks are using it to massively increase the accuracy of their fraud-detection measures, while pharmaceutical companies are using it to develop life-saving new drugs.

In disaster zones, however, real-time analytics that process and churn huge amounts of data can help pinpoint previously unanticipated trends, limit the number of deaths and, in doing so, massively reduce the spread of disease.

Harvard’s HealthMap service recently made headlines for reportedly flagging the Ebola outbreak some nine days before the World Health Organization formally announced the epidemic, issuing its first alert on March 19.

The organization compiles, collates and creates a visual report of global disease outbreaks, sifting through millions of social media posts including those from health care workers in Guinea blogging about their work.

HealthMap’s role in spotting Ebola is just one example of using data analytics to harness public health information, but there is huge potential for big data to help officials intervene more effectively on the ground.

The most positive impact the technology is having is in helping relief organizations anticipate where a disease is going to spread next, determining where preventative measures are proving effective and ensuring resources are allocated where they are needed most.

Using data gleaned from cellphones is key, given that even in poorer countries, cellphones are common, and carriers amass huge databases that can provide huge insights into their users’ behavior.

In the case of the current crisis, one telecomms provider in Senegal handed over anonymized voice and text data from thousands of cellphones that was used to produce a detailed overview of population movements across the region. Combined with the latest reports from the World Health Organization, the information offered clues about where to focus preventive measures and distribute health care.

But the drawback with this strategy was that it took a retrospective approach to data analytics, when the unpredictable nature of the Ebola outbreak and its lengthy incubation period meant authorities needed to be able to map movements in real time.

Which is why the CDC is now using mast data from cellphone operators to provide a real-time breakdown of when and where calls to emergency helplines are being made — a significant spike in calls from one town is enough to alert authorities, indicating where they will likely need to focus resources next.

Real-time access to this information provides authorities with a comprehensive picture of where people are and where they’re heading, allowing decisions to be made quickly without relying on hearsay or waiting for the latest update from local hospitals.

But using one data source alone can only ever give us a partial picture.

Big-data analytics is all about combining information from many different sources and analyzing them collectively to identify patterns. For disasters such as the current Ebola crisis, this means accessing health clinic reports, media updates, social media posts, information from public workers on the ground, transactional data from retailers and pharmacies, and travel ticket purchases alongside helpline data.

Being able to crunch data on this scale necessitates being able to do so quickly, collating and analyzing it in its native form as soon as it is produced across the globe — a process known as multi-center ingest. Combined with the vast quantities of public information already accessible via the Internet, big data can help ensure those working in hazardous environments are able to stay on top of ever-changing situations.

Only by crunching data on this scale can we truly determine in a timely manner whether containment policies, education campaigns and other preventative treatments are proving effective.

But one of the challenges with this is the underfunded public-health infrastructures in the affected regions, which make it difficult to get access to clean data. To date there is no internationally accepted epidemiological forecasting algorithm. The Ebola crisis has made this a priority in academia and government circles.

In the meantime, those working to fight the epidemic should use every tool at their disposal to help fight its spread. And used in the right way, big data can help authorities intervene much more effectively.

This article originally appeared on Recode.net.