Redundancy Allowed Google to Function with Cheap and Failure-Prone Hard Drives

(p. 42) . . . as the web kept growing, Google added more machines–by the end of 1999, there were eighty machines involved in the crawl (out of a total of almost three thousand Google computers at that time)–and the likelihood that something would break increased dramatically. Especially since Google made a point of buying what its engineers referred to as “el cheapo” equipment. Instead of commercial units that carefully processed and checked information, Google would buy discounted consumer models without built-in processes to protect the integrity of data.
As a stopgap measure, the engineers had implemented a scheme where the indexing data was stored on different hard drives. If a machine went bad, everyone’s pager would start buzzing, even if it was the middle of the night, and they’d barrel into the office immediately to stop the crawl, copy the data, and change the configuration files. “This happened every few days, and it basically stopped everything and was very painful,” says Sanjay Ghemawat, one of the DEC research wizards who had joined Google.
. . .
(p. 43) The experience led to an ambitious revamp of the way the entire Google infrastructure dealt with files. “I always had wanted to build a file system, and it was pretty clear that this was something we were going to have to do,” says Ghemawat, who led the team. Though there had previously been systems that handled information distributed over multiple files, Google’s could handle bigger data loads and was more nimble at running full speed in the face of disk crashes– which it had to be because, with Google’s philosophy of buying supercheap components, failure was the norm. “The main idea was that we wanted the file system to automate dealing with failures, and to do that, the file system would keep multiple copies and it would make new copies when some copy failed,” says Ghemawat.

Source:
Levy, Steven. In the Plex: How Google Thinks, Works, and Shapes Our Lives. New York: Simon & Schuster, 2011.
(Note: ellipses added.)

“We Just Begged and Borrowed” for Equipment

(p. 32) Google was handling as many as 10,000 queries a day. At times it was consuming half of Stanford’s Internet capacity. Its appetite for equipment and bandwidth was voracious. “We just begged and borrowed,” says Page. “There were tons of computers around, and we managed to get some.” Page’s dorm room was essentially Google’s operations center, with a motley assortment of computers from various manufacturers stuffed into a homemade version of a server rack– a storage cabinet made of Legos. Larry and Sergey would hang around the loading dock to see who on campus was getting computers– companies like Intel and Sun gave lots of free machines to Stanford to curry favor with employees of the future– (p. 33) and then the pair would ask the recipients if they could share some of the bounty.
That still wasn’t enough. To store the millions of pages they had crawled, the pair had to buy their own high-capacity disk drives. Page, who had a talent for squeezing the most out of a buck, found a place that sold refurbished disks at prices so low– a tenth of the original cost– that something was clearly wrong with them. “I did the research and figured out that they were okay as long as you replaced the [disk] operating system,” he says. “We got 120 drives, about nine gigs each. So it was about a terabyte of space.” It was an approach that Google would later adopt in building infrastructure at low cost.
Larry and Sergey would be sitting by the monitor, watching the queries– at peak times, there would be a new one every second– and it would be clear that they’d need even more equipment. What next? they’d ask themselves. Maybe this is real.

Source:
Levy, Steven. In the Plex: How Google Thinks, Works, and Shapes Our Lives. New York: Simon & Schuster, 2011.
(Note: italics in original.)

Falling Computer Prices Cured the “Digital Divide”

(p. 304) The more evident the power of the internet as an uplifting force became, the more evident the divide between the digital haves and have-nots. One sociological study concluded that there were “two Americas” emerging. The citizens of one America were poor people who could not afford a computer, and of the other, wealthy individuals equipped with PCs who reaped all the benefits. During the 1990s, when technology boosters like me were promoting the advent of the internet, we were often asked: What are we going to do about the digital divide? My an-(p. 305)swer was simple: nothing. We didn’t have to do anything, because the natural history of a technology such as the internet was self-fulfilling. The have-nots were a temporary imbalance that would be cured (and more) by technological forces. There was so much profit to be made connecting up the rest of the world, and the unconnected were so eager to join, that they were already paying higher telecom rates (when they could get such service) than the haves. Furthermore, the costs of both computers and connectivity were dropping by the month. At that time most poor in America owned televisions and had monthly cable bills. Owning a computer and having internet access was no more expensive and would soon be cheaper than TV. In a decade, the necessary outlay would become just a $100 laptop. Within the lifetimes of all born in the last decade, computers of some sort (connectors, really) will cost $5.

Source:
Kelly, Kevin. What Technology Wants. New York: Viking Adult, 2010.

Children of Chinese Entrepreneurs Want to Work for Government

XieChaoboJoblessEngineeringStudent2013-07-23.jpg

“Engineering student Xie Chaobo has yet to land a job.” Source of caption and photo: online version of the WSJ article quoted and cited below.

(p. A1) BEIJING–Xie Chaobo figures he has the credentials to land a job at one of China’s big state-owned firms. He is a graduate student at Tsinghua University, one of China’s best. His field of study is environmental engineering, one of China’s priorities. And he is experimenting with new techniques for identifying water pollutants, which should make him a valuable catch.
But he has applied to 30 companies so far and scored just four interviews, none of which has led to a job.
Although Mr. Xie’s parents are entrepreneurs who have built companies that make glasses, shoes and now water pumps, he has no interest in working at a private startup. Chinese students “have been told since we were children to focus on stability instead of risk,” the 24-year-old engineering student says.
Over the past decade, the number of new graduates from Chinese universities has increased sixfold to more than six million a year, creating an epic glut that is depressing wages, (p. A10) leaving many recent college graduates without jobs and making students fearful about their future. Two-thirds of Chinese graduates say they want to work either in the government or big state-owned firms, which are seen as recession-proof, rather than at the private companies that have powered China’s remarkable economic climb, surveys indicate. Few college students today, according to the surveys, are ready to leave the safe shores of government work and “jump into the sea,” as the Chinese expression goes, to join startups or go into business for themselves, although many of their parents did just that in the 1990s.

For the full story, see:
MIKE RAMSEY and VALERIE BAUERLEIN. “Tesla Clashes With Car Dealers; Electric-Vehicle Maker Wants to Sell Directly to Consumers; Critics Say Plan Violates Franchise Laws.” The Wall Street Journal (Tues., June 18, 2013): B1-B2.

ChineseStudentAfterGraduationPlans2013-07-23.jpgSource of table: online version of the WSJ article quoted and cited above.

Laws to Protect Car Dealers, Keep Car Prices High

TeslaGalleryVirginia2013-07-23.jpg “Tesla ‘galleries’ such as this one in McLean, Va., can show but not sell cars.” Source of caption and photo: online version of the WSJ article quoted and cited below.

(p. B1) RALEIGH, N.C.–Elon Musk made a fortune disrupting the status quo in online shopping and renewable energy. Now he’s up against his toughest challenge yet: local car dealers.

Mr. Musk, the billionaire behind PayPal and now Tesla Motors Inc., wants to sell his $70,000 Tesla electric luxury vehicles directly to consumers, bypassing franchised automobile dealers. Dealers are flexing their considerable muscle in states including Texas and Virginia to stop him.
The latest battleground is North Carolina, where the Republican-controlled state Senate last month unanimously approved a measure that would block Tesla from selling online, its only sales outlet here. Tesla has staged whiz-bang test drives for legislators in front of the State House and hired one of the state’s most influential lobbyists to stave off a similar vote in the House before the legislative session ends in early July.
The focus of the power struggle between Mr. Musk and auto dealers is a thicket of state franchise laws, many of which go back to the auto industry’s earliest days when industry pioneer Henry Ford began turning to eager entrepreneurs to help sell his Model T.
Dealers say laws passed over the decades to prevent car makers from selling directly to consumers are justified because without them auto makers could use their economic clout to sell vehicles for less than their independent franchisees.

For the full story, see:
MIKE RAMSEY and VALERIE BAUERLEIN. “Tesla Clashes With Car Dealers; Electric-Vehicle Maker Wants to Sell Directly to Consumers; Critics Say Plan Violates Franchise Laws.” The Wall Street Journal (Tues., June 18, 2013): B1-B2.

Record Companies Refused to See Efficiency of Napster Distribution System

AppetiteForSelfDestructionBK2013-07-13.jpg

Source of book image: online version of the WSJ review quoted and cited below.

(p. A15) . . . the central character in “Appetite for Self-Destruction” is technological change.
. . .
Record labels scrambled to negotiate with Napster and develop a legal version of the service with multiple revenue streams. The attempts all failed. In Mr. Knopper’s telling, there were unreasonable demands on all sides. But he faults music executives for “cling[ing] to the old, suddenly inefficient model of making CDs and distributing them to record stores. . . . In this world, the labels controlled — and profited from — everything.” In the new world being ushered in by Napster, he writes, control was shifting “to a snot-nosed punk and his crazy uncle.”
The labels’ inability to reach an agreement with Napster destroyed “the last chance for the record industry as we know it to stave off certain ruin,” Mr. Knopper writes in a typically overheated passage. Had a deal been consummated, he suggests, a legal version of Napster might have generated revenues of $16 billion in 2002 and saved the industry. Whether or not the author’s estimate is accurate, his larger point remains: The music industry’s big mistake was trying to protect a business model that no longer worked. Litigation would not keep music consumers offline.

For the full review, see:
JEREMY PHILIPS. “BUSINESS BOOKSHELF; Spinning Out of Control; How the record industry missed out on a chance to compete in a new digital world.” The Wall Street Journal (Weds., February 11, 2009): A15.
(Note: first two ellipses added; third ellipsis in original.)

The book under review is:
Knopper, Steve. Appetite for Self-Destruction: The Spectacular Crash of the Record Industry in the Digital Age. New York: Free Press, 2009.

Project Entrepreneur Would Rather Change the World than Buy a Luxury Car

HoffmanReidGreylockPartners2013-06-28.jpg“Reid Hoffman at Greylock Partners foresees a tectonic shift coming in the Web, with data and its many uses as the new linchpin, replacing identity and relationships.” Source of caption and photo: online version of the NYT article quoted and cited below.

(p. 5) As an executive vice president, it was up to Mr. Hoffman to manage external relations. “He was the firefighter in chief at PayPal,” Mr. Thiel says. “Though that diminishes his role because there were many, many fires.”

Mr. Hoffman emerged as a connector and high-level strategist. He packed his schedule with meetings, charmed credit card companies and soothed the regulators.
PayPal survived, and when the company went public, in 2002, Mr. Hoffman and many of his colleagues became multimillionaires.
Mr. Thiel splurged on a Ferrari. Mr. Hoffman wanted to buy an Audi but instead invested his newfound riches in one of the first solar panel companies to come out of Silicon Valley, Nanosolar, and bought an Acura instead.
“I started to think about the value of money,” he says. “I thought if I only had $75,000, would I rather invest in a luxury car or make a play in changing the world?”
Nanosolar became a multibillion-dollar enterprise.

For the full story, see:
EVELYN M. RUSLI. “A King of Connections; How Reid Hoffman of LinkedIn Became Tech’s Go-To Guy.” The New York Times, SundayBusiness Section (Sun., November 6, 2011): 1 & 5.
(Note: ellipsis added.)
(Note: the online version of the article has the date November 5, 2011, and has the title “A King of Connections Is Tech’s Go-To Guy.”)

Walker Says Those Who Call Him “Patent Troll” Want His Property Without Paying

WalkerJayPatentDefender2013-06-28.jpg

Source of caption and photo: online version of the WSJ article quoted and cited below.

(p. B1) Jay Walker turned his idea for “name your own price” Internet auctions into a fortune by starting Priceline.com Inc. Now the entrepreneur is trying to cash in on his ideas by suing other companies.

Since it was founded in 1994 as a research lab, Walker Digital LLC has made much of its money by spinning out its inventions, like online travel agent Priceline and vending-machine firm Vendmore Systems LLC, as independent businesses.
. . .
Mr. Walker defends his newly aggressive tactics, which some critics compare to those of “patent trolls,” a derogatory term for firms that opportunistically enforce patents. Without the lawsuits, he said, his patents could expire while other companies exploit them. Patents have a 20-year lifespan.
“Not only are we not a troll, but the people who want to label me are often the same ones that want to use our property and not pay,” Mr. Walker said in an interview.

For the full story, see:
JOHN LETZING. “Founder of Priceline Spoiling for a Fight Over Tech Patents.” The Wall Street Journal (Mon., August 22, 2011): B1 & B10.
(Note: ellipsis added.)

Property Rights, Flexible Work Rules, Open Markets Are Keys to Economic Growth

BalanceBK2013-06-28.jpg

Source of book image: online version of the WSJ review quoted and cited below.

(p. A11) Messrs. Hubbard and Kane argue, as do others, that certain policies and core principles are the key: property rights, flexible work rules, open markets. For the authors, such matters explain economic growth entirely.

To those who would cite the primacy of technological breakthroughs, Messrs. Hubbard and Kane assert that inventions only spark growth if there are systems in place (such as intellectual-property rights) that enable inventions to flourish and their value to spread. “The wheel and the windmill were invented many times,” they write, “then forgotten, until finally one society had the institutional framework to implement them widely and pass them on permanently.” In short, “institutions explain innovation.”

For the full review, see:
Matthew Rees. “BOOKSHELF; How the Mighty Fall; The Roman empire eventually lost its economic vitality thanks to price controls, heavy taxes and state-sponsored debt relief.” The Wall Street Journal (Fri., June 21, 2013): A11.
(Note: ellipses added.)
(Note: the online version of the review has the date June 20, 2013.)

The book under review, is:
Hubbard, Glenn, and Tim Kane. Balance: The Economics of Great Powers from Ancient Rome to Modern America. New York: Simon & Schuster, 2013.

iPhone: “A Gleaming World of Innovation and Opportunity, of Capitalism Behaving Well”

SubwayIphoneUse2013-06-21.jpg “The theft of electronic devices like iPhones has fueled a rise in subway crime this year, the police say. In the past, New Yorkers were mugged, sometimes killed, for bomber jackets, Cazal glasses and Air Jordan sneakers.” Source of caption: print version of the NYT article quoted and cited below. Source of photo: online version of the NYT article quoted and cited below.

(p.24) The current spate of iPhone thefts feels, if anything, more poignant than disruptive. Apple products have always read as cooler than their rivals’ because their design suggests a gleaming world of innovation and opportunity, of capitalism behaving well — a world that seems ever diminishing, ever less accessible to the struggling and young.

Unlike the sneakers and glasses that caused such a fury in the ’80s and ’90s, iPhones didn’t originate in the celebrity system. They come with a democratic ethos (if not the analogous price tag); BlackBerrys are for suits, but even a child can work an iPhone. Wasn’t everyone supposed to have a shot?

For the full story, see:
GINIA BELLAFANTE. “BIG CITY; Easy to Use and Easy to Steal, a Status Object Inches Out of Reach.” The New York Times, First Section (Sun., October 30, 2011): 24.
(Note: the first paragraph quoted above is from the print version, rather than from the somewhat different online version. The second quoted paragraph is the same in both versions.)
(Note: the online version of the story has the date October 28, 2011, and has the slightly different title “BIG CITY; Easy to Use, or Steal, but Inching Out of Reach.”)