The History of Computing

The History of Computing

By Charles EdgeTechnologyHistory
Download on the App Store

The History of Computing episodes

  • Clifford Stoll and the Cuckoo’s Egg

    A honeypot is basically a computer made to look like a sweet, yummy bit of morsel that a hacker might find yummy mcyummersons. This is the story of one of the earliest on the Internet. Clifford Stoll has been a lot of things. He was a teacher and a ham operator and appears on shows. And an engineer at a radio station. And he was an astronomer. But he’s probably best known for being an accidental systems administrator at Lawrence Berkeley National Laboratory who setup a honeypot in 1986 and used that to catch a KGB hacker.

    It sounds like it could be a movie. And it was - on public television. Called “The KGB, the Computer, and Me.” And a book.

    Clifford Stoll was an astronomer who stayed on as a systems administrator when a grant he was working on as an astronomer ran out. Many in IT came to the industry accidentally. Especially in the 80s and 90s.

    Now accountants are meticulous. The monthly accounting report at the lab had never had any discrepancies. So when the lab had a 75 cent accounting error, his manager Dave Cleveland had Stoll go digging into the system to figure out what happened. And yet what he found was far more than the missing 75 cents.

    This was an error of time sharing systems. And the lab leased out compute time at $300 per hour. Everyone who had accessed the system had an account number to bill time to. Well, everyone except a user named hunter. They disabled the user and then got an email that one of their computers tried to break into a computer elsewhere.

    This is just a couple years after the movie War Games had been released. So of course this was something fun to dig your teeth into. Stoll combed through the logs and found the account that attempted to break into the computers in Maryland was a local professor named Joe Sventek, now at the University of Oregon. One who it was doubtful made the attempt because he was out town at the time.

    So Stoll set his computer to beep when someone logged in so he could set a trap for the person using the professors account. Every time someone connected a teletype session, or tty, Stoll checked the machine. Until Sventek connected and with that, he went to see the networking team who confirmed the connection wasn’t a local terminal but had come in through one of the 50 modems through a dial-up session.

    There wasn’t much in the form of caller ID. So Stoll had to connect a printer to each of the modems - that gave him the ability to print every command the user ran. A system had been compromised and this user was able to sudo, or elevate their privileges. UNIX System V had been released 3 years earlier and suddenly labs around the world were all running similar operating systems on their mainframes. Someone with a working knowledge of Unix internals could figure out how to do all kinds of things. Like add a program to routine housecleaning items that elevated their privileges.

    They could also get into the passwd file that at the time housed all the passwords and delete those that were encrypted, thus granting access without a password. And they even went so far as to come up with dictionary brute force attacks similar to a modern rainbow table to figure out passwords so they wouldn’t get locked out when the user whose password was deleted called in to reset it again.

    Being root allowed someone to delete the shell history and given that all the labs and universities were charging time, remove any record they’d been there from the call accounting systems. So Stoll wired a pager into the system so he could run up to the lab any time the hacker connected. Turns out the hacker was using the network to move laterally into other systems, including going from what was ARPANET at the time to military systems on Milnet. The hacker used default credentials for systems and leave accounts behind so he could get back in later.

    Jaeger means hunter in German and those were both accounts used. So maybe they were looking for a German. Tymenet and Pacbell got involved and once they got a warrant they were able to get the phone number of the person connecting to the system. Only problem is the warrant was just for California.

    Stoll scanned the packet delays and determined the hacker was coming in from overseas. The hacker had come in through Mitre Corporation. After Mitre disabled the connection the hacker slipped up and came in through International Telephone and Telegraph. Now they knew he was not in the US. In fact, he was in West Germany. At the time, Germany was still divided by the Berlin Wall and was a pretty mature spot for espionage. They confirmed the accounts were indicating they were dealing with a German.

    Once they had the call traced to Germany they needed to keep the hacker online for an hour to trace the actual phone number because the facilities there still used mechanical switching mechanisms to connect calls. So that’s where the honeypot comes into play. Stoll’s girlfriend came up with the idea to make up a bunch of fake government data and host it on the system. Boom. It worked, the hacker stayed on for over an hour and they traced the number.

    Along the way, this hippy-esque Cliff Stoll had worked with “the Man.” Looking through the logs, the hacker was accessing information about missile systems, military secrets, members of the CIA. There was so much on these systems. So Stoll called some of the people at the CIA. The FBI and NSA were also involved and before long, German authorities arrested the hacker.

    Markus Hess, whose handle was Urmel, was a German hacker who we now think broke into over 400 military computers in the 80s. It wasn’t just one person though. Dirk-Otto Brezinski, or DOB, Hans Hübner, or Pengo, and Karl Koch, or Pengo were also involved. And not only had they stolen secrets, but they’d sold them to The KGB using Peter Carl as a handler.

    Back in 1985, Koch was part of a small group of hackers who founded the Computer-Stammtisch in Hanover. That later became the Hanover chapter of the Chaos Computer Club. Hübner and Koch confessed, which gave them espionage amnesty - important in a place with so much of that going around in the 70s and 80s. He would be found burned by gasoline to death and while it was reported a suicide, that has very much been disputed - especially given that it happened shortly before the trials.

    DOB and Urmel received a couple years of probation for their part in the espionage, likely less of a sentence given that the investigations took time and the Berlin Wall came down the year they were sentenced.

    Hübner’s story and interrogation is covered in a book called Cyberpunk - which tells the same story from the side of the hackers. This includes passing into East Germany with magnetic tapes, working with handlers, sex, drugs, and hacker-esque rock and roll. I think I initially read the books a decade apart but would strongly recommend reading Part II of it either immediately before or after The Cukoo’s Egg.

    It’s interesting how a bunch of kids just having fun can become something far more. Similar stories were happening all over the world - another book called The Hacker Crackdown tells of many, many of these stories. Real cyberpunk stories told by one of the great cyberpunk authors. And it continues through to the modern era, except with much larger stakes than ever.

    Gorbachev may have worked to dismantle some of the more dangerous aspects of these security apparatuses, but Putin has certainly worked hard to build them up. Russian-sponsored and other state-sponsored rings of hackers continue to probe the Internet, delving into every little possible hole they can find. China hacks Google in 2009, Iran hits casinos, the US hits Iranian systems to disable centrifuges, and the list goes on. You see, these kids were stealing secrets - but after the Morris Worm brought the Internet to its knees in 1988, we started to realize how powerful the networks were becoming.

    But it all started with 75 cents. Because when it comes to security, there’s no amount or event too small to look into.

    12 min
  • Buying All The Things On Black Friday and Cyber Monday

    The Friday after Thanksgiving to the Monday afterwards is a bonanza of shopping in the United States, where capitalism runs wild with reckless abandon. It’s almost a symbol of a society whose identity is as intertwined with with rampant consumerism as it is with freedom and democracy. We are free to spend all our gold pieces.

    And once upon a time, we went back to work on Monday and looked for a raise or bonus to help replenish the coffers. But since fast internet connections started to show up in offices in the late 90s the commodification of holiday shopping, the very digitization of materialism.

    But how did it come to be? The term Black Friday goes back to a financial crisis in 1869 after Jay Gould and Jim Fisk tried to corner the market on Gold. That backfired and led to a Wall Street crash in September of that year. As the decades rolled by, Americans in the suburbs of urban centers had more and more disposable income and flocked to city centers the day after Thanksgiving. Finally, by 1961, the term showed up in Philadelphia where turmoil over the holiday shopping extravaganza inside.

    And so as economic downturns throughout the 60s and 70s gave way to the 1980s, the term spread slowly across the country until marketers, decided to use it to their advantage and run sales just on that day. Especially the big chains that were by now in cities where the term was common.

    And many retailers spent the rest of the year in the red and made back all of their money over the holidays - thus they got in the black. The term went from a negative to a positive.

    Stores opened earlier and earlier on Friday. Some even unlocking the doors at midnight after shoppers got a nice nap in following stuffing their faces with turkey the earlier in the day.

    As the Internet exploded in the 90s and buying products online picked up steam, marketers of online e-commerce platforms wanted in on the action. See, they considered brick and mortar to be mortal competition. Most of them should have been looking over their shoulder at Amazon rising, but that’s another episode.

    And so Cyber Monday was born in 2005 when the National Retail Federation launched the term to the world in a press release. And who wanted to be standing in line outside a retail store at midnight on Friday? Especially when the first Wii was released by Nintendo that year and was sold out everywhere early Friday morning. But come Cyber Monday it was all over the internet. Not only that, but one of Amazon’s top products that year was the iPod. And the DS Lite. And World of Warcraft. Oh and that was the same year Tickle Me Elmo was sold out everywhere. But available on the Internets. The online world closed the holiday out at just shy of half a billion dollars in sales. But they were just getting started.

    And I’ve always thought it was kitschy. And yet I joined in with the rest of them when I started getting all those emails. Because opt-in campaigns were exploding as e-tailers honed those skills at appealing to not wanting to be the worst parent in the world. And Cyber Monday grew year over year. Even as the Great Recession came and has since grown first to a billion dollar shopping day in 2010 and as brick and mortar companies jumped in on the action, $4 billion by 2017, $6 billion in 2018, and nearly $8 billion in 2019.

    As Covid-19 spread and people stayed home during the 2020 holiday shopping season, revenues from Cyber Monday grew 15% over the previous year, hitting $10.8 billion. But it came at the cost of brick and mortar sales, which fell nearly 24% over the same time a year prior. I guess it kinda’ did, but we’ll get to that in a bit.

    Seeing the success of the Cyber Monday marketers, American Express launched Small Business Saturday in 2010, hoping to lure shoppers into small businesses that accepted their cards. And who doesn’t love small businesses? Politicians flocked into malls in support, including President Obama in 2011. And by 2012, spending was over $5 billion on Small Business Saturday, and grew to just shy of $20 billion in 2020. To put that into perspective, Georgia, Zimbabwe, Afghanistan, Jamaica, Niger, Armenia, Haiti, Mongolia, and dozens of other countries have smaller GDPs than just one shopping day in the US.

    Brick and mortar stores are increasingly part of online shopping. Buy online, pick up curb-side. But that trend goes back to the early 2000s when Walmart was a bigger player on Cyber Monday than Amazon. That changed in 2008 and Walmart fought back with Cyber Week, stretching the field in 2009. Target said “us too” in 2010. And everyone in between hopped in. The sales start at least a week early and spread from online to retail in person with hundreds of emails flooding my inbox at this point. This year, Americans are expected to spend over $36 billion during the weekend from Black Friday to Cyber Monday. And the split between all the sales is pretty much indistinguishable. Who knows or to some degrees cares what bucket each gets placed in at this point.

    Something else was happening in the decades as Black Friday spread to consume the other days around the Thanksgiving holiday: intensifying globalization. Products flooding into the US from all over the world. Some cheap, some better than what is made locally. Some awesome. Some completely unnecessary. It’s a land of plenty. And yet, does it make us happy? My kid enjoyed playing with an empty toilet paper roll just as much as a Furby. And loved the original Xbox just as much as the Switch. I personally need less and to be honest want less as I get older. And yet I still find myself getting roped into spending too much on people at the holidays.

    Maybe we should create “experience Sunday” where instead of buying material goods, we facilitate free experiences for our loved ones. Because I’m pretty sure they’d rather have that than another ugly pair of holiday socks. Actually, that reminds me: I have some of those in my cart on Amazon so I should wrap this up as they can deliver it tonight if I hurry up.

    So this Thanksgiving I’m thankful that I and my family are healthy and happy. I’m thankful to be able to do things I love. I’m thankful for my friends. And I’m thankful to all of you for staying with us as we turn another page into the 2022 year. I hope you have a lovely holiday season and have plenty to be thankful for as well. Because you deserve it.

    10 min
  • An Abridged History of Free And Open Source Software

    In the previous episodes, we looked at the rise of patents and software and their impact on the nascent computer industry. But a copyright is a right. And that right can be given to others in whole or in part. We have all benefited from software where the right to copy was waved and it’s shaped the computing industry as much, if not more, than proprietary software.

    The term Free and Open Source Software (FOSS for short) is a blanket term to describe software that’s free and/or whose source code is distributed for varying degrees of tinkeration. It’s a movement and a choice. Programmers can commercialize our software. But we can also distribute it free of copy protections. And there are about as many licenses as there are opinions about what is unique, types of software, underlying components, etc. But given that many choose to commercialize their work products, how did a movement arise that specifically didn’t? The early computers were custom-built to perform various tasks. Then computers and software were bought as a bundle and organizations could edit the source code. But as operating systems and languages evolved and businesses wanted their own custom logic, a cottage industry for software started to emerge. We see this in every industry - as an innovation becomes more mainstream, the expectations and needs of customers progress at an accelerated rate.

    That evolution took about 20 years to happen following World War II and by 1969, the software industry had evolved to the point that IBM faced antitrust charges for bundling software with hardware. And after that, the world of software would never be the same.

    The knock-on effect was that in the 1970s, Bell Labs pushed away from MULTICS and developed Unix, which AT&T then gave away as compiled code to researchers. And so proprietary software was a growing industry, which AT&T began charging for commercial licenses as the bushy hair and sideburns of the 70s were traded for the yuppy culture of the 80s. In the meantime, software had become copyrightable due to the findings of CONTU and the codifying of the Copyright Act of 1976.

    Bill Gates sent his infamous “Open Letter to Hobbyists” in 1976 as well, defending the right to charge for software in an exploding hobbyist market. And then Apple v Franklin led to the ability to copyright compiled code in 1983. There was a growing divide between those who’d been accustomed to being able to copy software freely and edit source code and those who in an up-market sense just needed supported software that worked - and were willing to pay for it, seeing the benefits that automation was having on the capabilities to scale an organization.

    And yet there were plenty who considered copyright software immoral. One of the best remembered is Richard Stallman, or RMS for short. Steven Levy described Stallman as “The Last of the True Hackers” in his epic book “Hackers: Heroes of the Computer Revolution.” In the book, he describes the MIT Stallman joined where there weren’t passwords and we didn’t yet pay for software and then goes through the emergence of the LISP language and the divide that formed between Richard Greenblatt, who wanted to keep The Hacker Ethic alive and those who wanted to commercialize LISP. The Hacker Ethic was born from the young MIT students who freely shared information and ideas with one another and help push forward computing in an era they thought was purer in a way, as though it hadn’t yet been commercialized.

    The schism saw the death of the hacker culture and two projects came out of Stallman’s technical work: emacs, which is a text editor that is still included freely in most modern Unix variants and the GNU project. Here’s the thing, MIT was sitting on patents for things like core memory and thrived in part due to the commercialization or weaponization of the technology they were producing. The industry was maturing and since the days when kings granted patents, maturing technology would be commercialized using that system.

    And so Stallman’s nostalgia gave us the GNU project, born from an idea that the industry moved faster in the days when information was freely shared and that knowledge was meant to be set free. For example, he wanted the source code for a printer driver so he could fix it and was told it was protected by an NDAQ and so couldn’t have it. A couple of years later he announced GNU, a recursive acronym for GNU’s Not Unix. The next year he built a compiler called GCC and the next year released the GNU Manifesto, launching the Free Software Foundation, often considered the charter of the free and open source software movement.

    Over the next few years as he worked on GNU, he found emacs had a license, GCC had a license, and the rising tide of free software was all distributed with unique licenses. And so the GNU General Public License was born in 1989 - allowing organizations and individuals to copy, distribute, and modify software covered under the license but with a small change, that if someone modified the source, they had to release that with any binaries they distributed as well.

    The University of California, Berkley had benefited from a lot of research grants over the years and many of their works could be put into the public domain. They had brought Unix in from Bell Labs in the 70s and Sun cofounder and Java author Bill Joy worked under professor Fabry, who brought Unix in. After working on a Pascal compiler that Unix coauthor Ken Thompson left for Berkeley, Joy and others started working on what would become BSD, not exactly a clone of Unix but with interchangeable parts. They bolted on the OSI model to get networking and through the 80s as Joy left for Sun and DEC got ahold of that source code there were variants and derivatives like FreeBSD, NetBSD, Darwin, and others. The licensing was pretty permissive and simple to understand:

    Copyright (c) . All rights reserved. Redistribution and use in source and binary forms are permitted provided that the above copyright notice and this paragraph are duplicated in all such forms and that any documentation, advertising materials, and other materials related to such distribution and use acknowledge that the software was developed by the . The name of the may not be used to endorse or promote products derived from this software without specific prior written permission. THIS SOFTWARE IS PROVIDED ``AS IS AND WITHOUT ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, WITHOUT LIMITATION, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.

    By 1990 the Board of Regents at Berkley accepted a four clause BSD license that spawned a class of licenses. While it’s matured into other formats like a 0 clause license it’s one of my favorites as it is truest to the FOSS cause.

    And the 90s gave us the Apache License, from the Apache Group, loosely based on the BSD License and then in 2004 leaning away from that with the release of the Apache License 2 that was more compatible with the GPL license. Given the modding nature of Apache they didn’t require derivative works to also be open sourced but did require leaving the license in place for unmodified parts of the original work.

    GNU never really caught on as an OS in the mainstream, although a collection of tools did. The main reason the OS didn’t go far is probably because Linus Torvalds started releasing prototypes of his Linux operating system in 1991. Torvalds used The GNU General Public License v2, or GPLv2 to license his kernel, having been inspired by a talk given by Stallman. GPL 2 had been released in 1991 and something else was happening as we turned into the 1990s: the Internet. Suddenly the software projects being worked on weren’t just distributed on paper tape or floppy disks; they could be downloaded. The rise of Linux and Apache coincided and so many a web server and site ran that LAMP stack with MySQL and PHP added in there. All open source in varying flavors of what open source was at the time.

    And collaboration in the industry was at an all-time high. We got the rise of teams of developers who would edit and contribute to projects. One of these was a tool for another aspect of the Internet, email. It was called popclient, Here Eric S Raymond, or ESR for short, picked it up and renamed it to fetchmail, releasing it as an open source project.

    Raymond presented on his work at the Linux Congress in 1997, expanded that work into an essay and then the essay into “The Cathedral and the Bazaar” where bazaar is meant to be like an open market. That inspired many to open source their own works, including the Netscape team, which resulted in Mozilla and so Firefox - and another book called “Freeing the Source: The Story of Mozilla” from O’Reilly.

    By then, Tim O’Reilly was a huge proponent of this free or source code available type of software as it was known. And companies like VA Linux were growing fast. And many wanted to congeal around some common themes. So in 1998, Christine Peterson came up with the term “open source” in a meeting with Raymond, Todd Anderson, Larry Augustin, Sam Ockman, and Jon “Maddog” Hall, author of the first book I read on Linux. Free software it may or may not be but open source as a term quickly proliferated throughout the lands.

    By 1998 there was this funny little company called Tivo that was doing a public beta of a little box with a Linux kernel running on it that bootstrapped a pretty GUI to record TV shows on a hard drive on the box and play them back. You remember when we had to wait for a TV show, right? Or back when some super-fancy VCRs could record a show at a specific time to VHS (but mostly failed for one reason or another)? Well, Tivo meant to fix that. We did an episode on them a couple of years ago but we skipped the term Tivoization and the impact they had on GPL.

    As the 90s came to a close, VA Linux and Red Hat went through great IPOs, bringing about an era where open source could mean big business. And true to the cause, they shared enough stock with Linus Torvalds to make him a millionaire as well. And IBM pumped a billion dollars into open source, with Sun moving to open source openoffice.org. Now, what really happened there might be that by then Microsoft had become too big for anyone to effectively compete with and so they all tried to pivot around to find a niche, but it still benefited the world and open source in general.

    By Y2K there was a rapidly growing number of vendors out there putting Linux kernels onto embedded devices. TiVo happened to be one of the most visible. Some in the Linux community felt like they were being taken advantage of because suddenly you had a vendor making changes to the kernel but their changes only worked on their hardware and they blocked users from modifying the software. So The Free Software Foundation updated GPL, bundling in some other minor changes and we got the GNU General Public License (Version 3) in 2006.

    There was a lot more in GPL 3, given that so many organizations were involved in open source software by then. Here, the full license text and original copyright notice had to be included along with a statement of significant changes and making source code available with binaries. And commercial Unix variants struggled with SGI going bankrupt in 2006 and use of AIX and HP-UX

    Many of these open source projects flourished because of version control systems and the web. SourceForge was created by VA Software in 1999 and is a free service that can be used to host open source projects. Concurrent Versions System, or CVS had been written by Dick Grune back in 1986 and quickly became a popular way to have multiple developers work on projects, merging diffs of code repositories. That gave way to git in the hearts of many a programmer after Linus Torvalds wrote a new versioning system called git in 2005. GitHub came along in 2008 and was bought by Microsoft in 2018 for 2018.

    Seeing a need for people to ask questions about coding, Stack Overflow was created by Jeff Atwood and Joel Spolsky in 2008. Now, we could trade projects on one of the versioning tools, get help with projects or find smaller snippets of sample code on Stack Overflow, or even Google random things (and often find answers on Stack Overflow). And so social coding became a large part of many a programmers day. As did dependency management, given how many tools are used to compile a modern web app or app. I often wonder how much of the code in many of our favorite tools is actually original.

    Another thought is that in an industry dominated by white males, it’s no surprise that we often gloss over previous contributions. It was actually Grace Hopper’s A-2 compiler that was the first software that was released freely with source for all the world to adapt. Sure, you needed a UNIVAC to run it, and so it might fall into the mainframe era and with the emergence of minicomputers we got Digital Equipment’s DECUS for sharing software, leading in part to the PDP-inspired need for source that Stallman was so adamant about. General Motors developed SHARE Operating System for the IBM 701 and made it available through the IBM user group called SHARE. The ARPAnet was free if you could get to it. TeX from Donald Knuth was free. The BASIC distribution from Dartmouth was academic and yet Microsoft sold it for up to $100,000 a license (see Commodore ). So it’s no surprise that people avoided paying upstarts like Microsoft for their software or that it took until the late 70s to get copyright legislation and common law.

    But Hopper’s contributions were kinda’ like open source v1, the work from RMS to Linux was kinda’ like open source v2, and once the term was coined and we got the rise of a name and more social coding platforms from SourceForge to git, we moved into a third version of the FOSS movement. Today, some tools are free, some are open source, some are free as in beer (as you find in many a gist), some are proprietary. All are valid.

    Today there are also about as many licenses as there are programmers putting software out there. And here’s the thing, they’re all valid. You see, every creator has the right to restrict the ability to copy their software. After all, it’s their intellectual property. Anyone who chooses to charge for their software is well within their rights. Anyone choosing to eschew commercialization also has that right. And every derivative in between. I wouldn’t judge anyone based on any model those choose. Just as those who distribute proprietary software shouldn’t be judged for retaining their rights to do so.

    Why not just post things we want to make free? Patents, copyrights, and trademarks are all a part of intellectual property - but as developers of tools we also need to limit our liability as we’re probably not out there buying large errors and omissions insurance policies for every script or project we make freely available. Also, we might want to limit the abuse of our marks. For example, Linus Torvalds monitors the use of the Linux mark through the Linux Mark Institute. Apparently some William Dell Croce Jr tried to register the Linux trademark in 1995 and Torvalds had to sue to get it back. He provides use of the mark using a free and perpetual global sublicense. Given that his wife won the Finnish karate championship six times I wouldn’t be messing with his trademarks.

    Thank you to all the creators out there. Thank you for your contributions. And thank you for tuning in to this episode of the History of Computing Podcast. Have a great day.

    23 min
  • Perl, Larry Wall, and Camels

    Perl was started by Larry Wall in 1987. Unisys had just released the 2200 series and only a few years stopped using the name UNIVAC for any of their mainframes. They merged with Burroughs the year before to form Unisys. The 2200 was a continuation of the 36-bit UNIVAC 1107, which went all the way back to 1962. Wall was one of the 100,000 employees that helped bring in over 10 and a half billion in revenues, making Unisys the second largest computing company in the world at the time.

    They merged just in time for the mainframe market to start contracting.

    Wall had grown up in LA and Washington and went to grad school at the University of California at Berkeley. He went to the Jet Propulsion Laboratory after Grad School and then landed at System Development Corporation, which had spun out of the SAGE missile air defense system in 1955 and merged into Burroughs in 1986, becoming Unisys Defense Systems.

    The Cold War had been good to Burroughs after SDC built the timesharing components of the AN/FSQ-32 and the JOVIAL programming language. But changes were coming. Unix System V had been released in 1983 and by 1986 there was a rivalry with BSD, which had been spun out of UC - Berkeley where Wall went to school. And by then AT&T had built up the Unix System Development Laboratory, so Unix was no longer just a language for academics.

    Wall had some complicated text manipulation to program on these new Unix system and as many of us have run into, when we exceed a certain amount of code, awk becomes unwieldy - both from a sheer amount of impossible to read code and from a runtime perspective. Others were running into the same thing and so he got started on a new language he named Practical Extraction And Report Language, or Perl for short. Or maybe it stands for Pathologically Eclectic Rubbish Lister. Only Wall could know.

    The rise of personal computers gave way to the rise of newsgroups, and NNTP went to the IETF to become an Internet Draft in RFC 977. People were posting tools to this new medium and Wall posted his little Perl project to comp.sources.unix in 1988, quickly iterating to Perl 2 where he added the languages form of regular expressions. This is when Perl became one of the best programming languages for text processing and regular expressions available at the time.

    Another quick iteration came when more and more people were trying to write arbitrary data into objects with the rise of byte-oriented binary streams. This allowed us to not only read data from text streams, terminated by newline characters, but to read and write with any old characters we wanted to. And so the era of socket-based client-server technologies was upon us. And yet, Perl would become even more influential in the next wave of technology as it matured alongside the web.

    In the meantime, adoption was increasing and the only real resource to learn Perl was a the manual, or man, page. So Wall worked with Randal Schwartz to write Programming Perl for O’Reilly press in 1991. O’Reilly has always put animals on the front of their books and this one came with a Camel on it. And so it became known as “the pink camel” due to the fact that the art was pink and later the art was blue and so became just “the Camel book”. The book became the primary reference for Perl programmers and by then the web was on the rise. Yet perl was still more of a programming language for text manipulation. And yet most of what we did as programmers at the time was text manipulation.

    Linux came around in 1991 as well. Those working on these projects probably had no clue what kind of storm was coming with the web, written in 1990, Linux, written in 1991, php in 1994, and mysql written in 1995. It was an era of new languages to support new ways of programming. But this is about Perl - whose fate is somewhat intertwined.

    Perl 4 came in 1993. It was modular, so you could pull in external libraries of code. And so CPAN came along that year as well. It’s a repository of modules written in Perl and then dropped into a location on a file system that was set at the time perl was compiled, like /usr/lib/perl5. CPAN covers far more libraries than just perl, but there are now over a quarter million packages available, with mirrors on every continent except Antartica.

    That second edition coincided with the release of Perl 5 and was published in 1996. The changes to the language had slowed down for a bit, but Perl 5 saw the addition of packages, objects, references, and the authors added Tom Christiansen to help with the ever-growing camel book. Perl 5 also brought the extension system we think of today - somewhat based off the module system in Linux. That meant we could load the base perl into memory and call those extensions.

    Meanwhile, the web had been on the rise and one aspect of the power of the web was that while there were front-ends that were stateless, cookies had come along to maintain a user state. Given the variety of systems html was able to talk to mod_perl came along in 1996, from Gisle Was and others started working on ways to embed perl into pages.

    Ken Coar chaired a working group in 1997 to formalize the concept of the Common Gateway Interface. Here, we’d have a common way to call external programs from web servers. The era of web interactivity was upon us. Pages that were constructed on the fly could call scripts. And much of what was being done was text manipulation.

    One of the powerful aspects of Perl was that you didn’t have to compile. It was interpreted and yet dynamic. This meant a source control system could push changes to a site without uploading a new jar - as had to be done with a language like Java. And yet, object-oriented programming is weird in perl. We bless an object and then invoke them with arrow syntax, which is how Perl locates subroutines. That got fixed in Perl 6, but maybe 20 years too late to use a dot notation as is the case in Java and Python.

    Perl 5.6 was released in 2000 and the team rewrote the camel book from the ground up in the 3rd edition, adding Jon Orwant to the team. This is also when they began the design process for Perl 6. By then the web was huge and those mod_perl servlets or CGI scripts were, along with PHP and other ways of developing interactive sites, becoming common. And because of CGI, we didn’t have to give the web server daemons access to too many local resources and could swap languages in and out. There are more modern ways now, but nearly every site needed CGI enabled back then.

    Perl wasn’t just used in web programming. I’ve piped a lot of shell scripts out to perl over the years and used perl to do complicated regular expressions. Linux, Mac OS X, and other variants that followed Unix System V supported using perl in scripting and as an interpreter for stand-alone scripts. But I do that less and less these days as well.

    The rapid rise of the web mean that a lot of languages slowed in their development. There was too much going on, too much code being developed, too few developers to work on the open source or open standards for a project like Perl. Or is it that Python came along and represented a different approach with modules in python created to do much of what Perl had done before?

    Perl saw small slow changes. Python moved much more quickly. More modules came faster, and object-oriented programming techniques hadn’t been retrofitted into the language. As the 2010s came to a close, machine learning was on the rise and many more modules were being developed for Python than for Perl.

    Either way, the fourth edition of the Camel Book came in 2012, when Unicode and multi-threading was added to Perl. Now with Brian Foy as a co-author. And yet, Perl 6 sat in a “it’s coming so soon” or “it’s right around the corner” or “it’s imminent” for over a decade.

    Then 2019 saw Perl 6 finally released. It was renamed to Raku - given how big a change was involved. They’d opened up requests for comments all the way back in 2000. The aim was to remove what they considered historical warts, that the rest of us might call technical debt. Rather than a camel, they gave it a mascot called Camelia, the Raku Bug.

    Thing is, Perl had a solid 10% market share for languages around 20 years ago. It was a niche langue maybe, but that popularity has slowly fizzled out and appears to be on a short resurgence with the introduction of 6 - but one that might just be temporary.

    One aspect I’ve always loved about programming is the second we’re done with anything, we think of it as technical debt. Maybe the language or server matures. Maybe the business logic matures. Maybe it’s just our own skills. This means we’re always rebuilding little pieces of our code - constantly refining as we go. If we’re looking at Perl 6 today we have to look at whether we want to try and do something in Python 3 or another language - or try and just update Perl. If Perl isn’t being used in very many micro-services then given the compliance requirements to use each tool in our stack, it becomes somewhat costly to think of improving our craft with Perl rather than looking to use possibly more expensive solutions at runtime, but less expensive to maintain.

    I hope Perl 6 grows and thrives and is everything we wanted it to be back in the early 2000s. It helped so much in an era and we owe the team that built it and all those modules so much. I’ll certainly be watching adoption with fingers crossed that it doesn’t fade away. Especially since I still have a few perl-based lamda functions out there that I’d have to rewrite. And I’d like to keep using Perl for them!

    15 min
  • The Von Neumann Architecture

    John Von Neumann was born in Hungary at the tail end of the Astro-Hungarian Empire. The family was made a part of the nobility and as a young prodigy in Budapest, He learned languages and by 8 years old was doing calculus. By 17 he was writing papers on polynomials. He wrote his dissertation in 1925 he added to set theory with the axiom of foundation and the notion of class, or properties shared by members of a set. He worked on the minimax theorem in 1928, the proof of which established zero-sum games and started another discipline within math, game theory. By 1929 he published the axiom system that led to Von Neumann–Bernays–Gödel set theory.

    And by 1932 he’d developed foundational work on ergodic theory which would evolve into a branch of math that looks at the states of dynamical systems, where functions can describe a points time dependence in space. And so he of course penned a book on quantum mechanics the same year.

    Did we mention he was smart and given the way his brain worked it made sense that he would eventually gravitate into computing. He went to the best schools with other brilliant scholars who would go on to be called the Martians. They were all researching new areas that required more and more computing - then still done by hand or a combination of hand and mechanical calculators.

    The Martians included De Hevesy, who won a Nobel prize for Chemistry. Von Kármán got the National Medal of Science and a Franklin Award. Polanyl developed the theory of knowledge and the philosophy of science. Paul Erdős was a brilliant mathematician who published over 1,500 articles. Edward Teller is known as the father of the hydrogen bomb, working on nuclear energy throughout his life and lobbying for the Strategic Defense Initiative, or Star Wars.

    Dennis Gabor wrote Inventing the Future and won a Nobel Prize in Physics. Eugene Wigner also took home a Nobel Prize in Physics and a National Medal of Science. Leo Szilard took home an Albert Einstein award for his work on nuclear chain reactions and joined in the Manhattan Project as a patent holder for a nuclear reactor. Physicists and brilliant scientists. And here’s a key component to the explosion in science following World War II: many of them fled to the United States and other western powers because they were Jewish, to get away from the Nazis, or to avoid communists controlling science.

    And then there was Harsanyl, Halmos, Goldmark, Franz Alexander, Orowan, and John Kemeny who gave us BASIC. They all contributed to the world we live in today - but von Neumann sometimes hid how smart he was, preferring to not show just how much arithmetic computed through his head.

    He was married twice and loved fast cars, fine food, bad jokes, and was an engaging and enigmatic figure. He studied measure theory and broke dimension theory into algebraic operators. He studied topological groups, operator algebra, spectral theory, functional analysis and abstract Hilbert space. Geometry and Lattice theory. As with other great thinkers, some of his work has stood the test of time and some has had gaps filled with other theories. And then came the Manhattan project. Here, he helped develop explosive lenses - a key component to the nuclear bomb.

    Along the way he worked on economics and fluid mechanics. And of course, he theorized and worked out the engineering principals for really big explosions. He was a commissioner of the Atomic Energy Commission and at the height of the Cold War after working out game theory, developed the concept of mutually assured destruction - giving the world hydrogen bombs and ICBMs and reducing the missile gap. Hard to imagine but at the times the Soviets actually had a technical lead over the US, which was proven true when they launched Sputnik. As with the other Martians, he fought Communism and Fasciscm until his death - which won him a Medal of Freedom from then president Eisenhower.

    His friend Stanislaw Ulam developed the modern Markov Chain Monte Carlo method and Von Neumann got involved in computing to work out those calculations. This combined with where his research lay landed him as an early power user of ENIAC. He actually heard about the machine at a station while waiting for a train. He’d just gotten home from England and while we will never know if he knew of the work Turing was doing on Colossus at Bletchley Park, we do know that he offered Turing a job at the Institute for Advanced Study that he was running in Princeton before World War II and had read Turing’s papers, including “On Computable Numbers” and understood the basic concepts of stored programs - and breaking down the logic into zeros and ones.

    He discussed using ENIAC to compute over 333 calculations per second. He could do a lot in his head, but he wasn’t that good of a computer. His input was taken and when Eckert and Mauchly went from ENIAC to EDVAC, or the Electronic Discrete Variable Calculator, the findings were published in a paper called “First Draft of a Report on the EDVAC” - a foundational paper in computing for a number of reasons.

    One is that Mauchly and Eckert had an entrepreneurial spirit and felt that not only should their names have been on the paper but that it was probably premature and so they quickly filed a patent in 1945, even though some of what they told him that went into the paper helped to invalidate the patent later. They considered these trade secrets and didn’t share in von Neumann’s idea that information must be set free.

    In the paper lies an important contribution, Von Neumann broke down the parts of a modern computer. He set the information for how these would work free. He broke down the logical blocks of how a computer works into the modern era. How once we strip away the electromechanical computers that a fully digital machine works. Inputs go into a Central Processing Unit, which has an instruction register, a clock to keep operations and data flow in sync, and a counter - it does the math. It then uses quick-access memory, which we’d call Random Access Memory, or RAM today, to make processing data instructions faster. And it would use long-term memory for operations that didn’t need to be as highly available to the CPU. This should sound like a pretty familiar way to architect devices at this point.

    The result would be sent to an output device. Think of a modern Swift app for an iPhone - the whole of what the computer did could be moved into a single wafer once humanity worked out how first transistors and then multiple transistors on a single chip worked.

    Yet another outcome of the paper was to inspire Turing and others to work on computers after the war. Turing named his ACE or Automatic Computing Engine out of respect to Charles Babbage. That led to the addition of storage to computers. After all, punched tape was used for Colossus during the war and and punched cards and tape had been around for awhile. It’s ironic that we think of memory as ephemeral data storage and storage as more long-term storage. But that’s likely more to do with the order these scientific papers came out than anything - and homage to the impact each had.

    He’d write The Computer and the Brain, Mathematical Foundations of Quantum Mechanics, The Theory of Games and Economic Behavior, Continuous Geometry, and other books. He also studied DNA and cognition and weather systems, inferring we could predict the results of climate change and possibly even turn back global warming - which by 1950 when he was working on it was already acknowledged by scientists. As with many of the early researchers in nuclear physics, he died of cancer - invoking Pascal’s wager on his deathbed. He died in 1957 - just a few years too early to get a Nobel Prize in one of any number of fields.

    One of my favorite aspects of Von Neumann was that he was a lifelong lover of history. He was a hacker - bouncing around between subjects. And he believed in human freedom. So much so that this wealthy and charismatic pseudo-aristocrat would dedicate his life to the study of knowledge and public service. So thank you for the Von Neumann Architecture and breaking computing down into ways that it couldn’t be wholesale patented too early to gain wide adoption. And thank you for helping keep the mutually assured destruction from happening and for inspiring generations of scientists in so many fields. I’m stoked to be alive and not some pile of nuclear dust. And to be gainfully employed in computing. He had a considerable impact in both.

    13 min
  • Getting Fit With Fitbit

    Fitbit was founded in 2007, originally as Healthy Metrics Research, Inc, by James Park and Eric Friedman. They had a goal to bring fitness trackers to market. They didn’t invent the pedometer and in fact wanted to go far further. That prize goes to Abraham-Louis Perrelet of Switzerland in 1780 or possibly back to da Vinci. And there are stories of calculating the distance armies moved using various mechanisms that used automations based on steps or the spinning of wagon wheels.

    The era of wearables arguably began in 1953 when the transistor radio showed up and Akio Morita and Masaru Ibuka started Sony. People started to get accustomed to carrying around technology. 1961 and Claude Shannon and Edward Thorp build a small computer to time when balls would land in roulette. Which they put in a shoe. Meanwhile sensors that could detect motion and the other chips to essentially create a small computer in a watch-sized package were coming down in price.

    Apple had already released the Nike+iPod Sports Kit the year before, with a little sensor that went in my running shoes. And Fitbit capitalized on an exploding market for tracking fitness. Apple effectively proved the concept was ready for higher end customers. But remember that while the iPod was incredibly popular at the time, what about everyone else?

    Park and Friedman raised $400,000 on the idea in a pre-seed round and built a prototype. No, it wasn’t actually a wearable, it was a bunch of sensors in a wooden box. That enabled them to shop around for more investors to actually finish a marketable device. By 2008 they were ready to take the idea to TechCrunch 50 and Tim O’Reilly and other panelists from TechCrunch loved it. And they picked up a whopping 2,000 pre-release orders.

    Only problem is they weren’t exactly ready to take that kind of volume. So they toured suppliers around Asia for months and worked overtime in hotel rooms fixing design and architecture issues. And in 2009 they were finally ready and took 25,000 orders, shipping about one fifth of them.

    That device was called the Fitbit Tracker and took on a goal of 10,000 steps that became a popular goal in Japan in the 1960s. It’s a little money-clip sized device with just one button that shows the status towards that 10,000 step goal. And once synchronized we could not only see tons of information about how many calories we burned and other statistics but we could also see

    Those first orders were sold directly through the web site. The next batch would be much different, going through Best Buy. The margins selling directly were much better and so they needed to tune those production lines. They went to four stores, then ten times that, then 15 times that.

    They announced the Fitbit Ultra in 2011. Here we got a screen that showed a clock but also came with a stopwatch. That would evolve into the Fitbit One in 2012. Bluetooth now allowed us to sync with our phones. That original device would over time evolve to the Zip and then the Inspire Clip.

    They grew fast in those first few years and enjoyed a large swathe of the market initially, but any time one vendor proves a market others are quick to fast-follow. The Nike Fuelband came along in 2012. There were also dozens of cheap $15 knock-offs in stores like Fry’s. But those didn’t have nearly as awesome an experience.

    A simple experience was the Fitbit Flex, released in 2013. The Fitbit could now be worn on the wrist. It looked more like the original tracker but a little smaller so it could slide in and out of a wristband. It could vibrate so could wake us up and remind us to get up and move. And the Fitbit Force came out that year, which could scroll through information on the screen, like our current step count. But that got some bad press for the nickel used on the device so the Charge came out the next year, doing much of the same stuff. And here we see the price slowly going up from below a hundred dollars to $130 as new models with better accelerometers came along.

    In 2014 they released a mobile app for all the major mobile platforms that allowed us to track devices through Bluetooth and opened up a ton of options to show other people our information. Chuck Schumer was concerned about privacy but the options for fitness tracking were about to explode in the other direction, becoming even less private. That’s the same year the LG G Watch came out, sporting a Qualcomm Snapdragon chip. The ocean was getting redder and devices were becoming more like miniature computers that happened to do tracking as well. After Android Wear was released in 2014, now called Wear OS, the ocean was bound to get much, much redder.

    And yet, they continued to grow and thrive. They did an IPO, or Initial Public Offering, in 2015 on the back of selling over 21 million devices. They were ready to reach a larger market. Devices were now in stores like Walmart and Target, and they had badges. It was an era of gamification and they were one of the best in the market at that. Walk enough steps to have circumnavigated the sun? There’s a badge for that. Walk the distance of the Nile? There’s a badge for that. Do a round trip to the moon and back? Yup, there’s a badge for that as well.

    And we could add friends in the app. Now we could compete to see who got more steps on the day. And of course some people cheated. Once I was wearing a Fitbit on my wrist I got 60,000 steps one day as I painted the kitchen. So we sometimes didn’t even mean to cheat. And an ecosystem had sprung up around Fitbit. Like Fitstar, a personal training coach, which got acquired by Fitbit and rebranded as Fitbit Coach.

    2015 was also when the Apple Watch was released. The Apple Watch added many of the same features like badges and similar statistics. By then there were models of the Fitbit that could show who was calling our phone or display a text message we got. And that was certainly part of the Wear OS for of Android. But those other devices were more expensive and Fitbit was still able to own the less expensive part of the market and spend on R&D to still compete at the higher end.

    They were flush with cash by 2016 so while selling 22 million more devices, they bought Coin and Pebble that year, taking in technology developed through crowdfunding sources and helping mass market it. That’s the same year we got the Fitbit Alta, effectively merging the Charge and Alta and we got HR models of some devices, which stands for Heart Rate. Yup, they could now track that too.

    They bought Vector Watch SRL in 2017, the same year they released the Ionic smartwatch, based somewhat on the technology acquired from Pebble. But the stock took a nosedive, and the market capitalization was cut in half. They added weather to the Ionic and merged that tech with that from the Blaze, released the year before. Here, we see technology changing quickly - Pebble was merged with Blaze but Wear OS from Google and Watch OS from Apple were forcing changes all the faster. The apps on other platforms were a clear gap as were the sensors baked into so many different integrated circuit packages.

    But Fitbit could still compete. In 2018 they released a cheaper version of the smartwatch called the Versa. They also released an API that allowed for a considerable amount of third party development, as well as Fitbit OS 3. They also bought Twine Health in 2018

    Partnered with Adidas in 2018 for the ionic. Partnered with Blue Cross Blue Shield to reduce insurance rates

    2018 released the Charge 3 with oxygen saturation sensors and a 40% larger screen than the Charge 2. From there the products got even more difficult to keep track of, as they poked at every different corner of the market. The Inspire, Inspire HR, Versa 2, Versa Lite, Charge 4, Versa 3, Sense, Inspire 2, Luxe. I wasn’t sure if they were going to figure out the killer device or not when Fitbit was acquired by Google in 2021.

    And that’s where their story ends and the story of the ubiquitous ecosystem of Google begins. Maybe they continue with their own kernels or maybe they’re moving all of their devices to WearOS. Maybe Google figures out how to pull together all of their home automation and personal tracking devices into one compelling offer. Now they get to compete with Amazon who now has the Halo to help attack the bottom of the market. Or maybe Google leaves the Fitbit team alone to do what they do.

    Fitbit has sold over 100 million devices and sports well over 25 million active users. The Apple Watch surpassed that number and blew right past it. WearOS lives in a much more distributed environment where companies like Asus, Samsung, and LG sell products but it appears to have a similar installation base. And it’s a market still growing and likely looking for a leader, as it’s easy to imagine a day when most people have a smart watch.

    But the world has certainly changed since Mark Weiser was the Chief Technologist at the famed Xerox Palo Alto Research Center, or Xerox Parc in 1988 when he coined the term "ubiquitous computing.” Technology hadn’t entered every aspect of our lives at the time like it has now.

    The team at Fitbit didn’t invent wearables. George Atwood invented them in 1783. That was mostly pulleys and mechanics. Per V. Brüel first commercialized the piezoelectric accelerometer in 1943. It certainly took a long time to get packaged into an integrated circuit and from there it took plenty of time to end up on my belt loop. But from there it took less than a few years to go on my wrist and then once there were apps for all the things true innovation came way faster. Because it turns out that once we open up a bunch of APIs, we have no idea the amazing things people use with what then go from devices to platforms. But none of that would have happened had Fitbit not helped prove the market was ready for Weiser’s ubiquitous computing.

    And now we get to wrestle with the fallout while innovation is moving even faster. Because telemetry is the opposite of privacy. And if we forget to protect just one of those API endpoints, like not implementing rate throttling or messing up the permissions, or leaving a micro-service open to all the things, we can certainly end up telling the world all about things. Because the world is watching, whether we think we’re important enough to watch or not.

    17 min
  • Our Friend, The Commodore Amiga

    Jay Miner was born in 1932 in Arizona. He got his Bachelor of Science at the University of California at Berkeley and helped design calculators that used the fancy new MOS chips where he cut his teeth doing microprocessor design, which put him working on the MOS 6500 series chips.

    Atari decided to use those in the VCS gaming console and so he ended up going to work for Atari. Things were fine under Bushnell but once he was off to do Chuck E Cheese and Time-Warner was running Atari things started to change. There he worked on chip designs that would go into the Atari 400 and 800 computers, which were finally released in 1979. But by then, Miner was gone after he couldn’t get in step with the direction Atari was taking. So he floated around for a hot minute doing chip design for other companies until Larry Kaplan called.

    Kaplan had been at Atari and founded Activision in 1979. He had half a dozen games under his belt by then, but was ready for something different by 1982. He and Doug Neubauer saw the Nintendo NES was still using the MOS 6502 core, although now a Ricoh 2A03. They knew they could do better. Miner’s company didn’t want in on it, so they struck out on their own.

    Together they started a company called Hi-Toro, which they quickly renamed to Amiga. They originally wanted to build a new game console based on the Motorola 68000 chips, which were falling in price. They’d seen what Apple could do with the MOS 6502 chips and what Tandy did with the Z-80. These new chips were faster and had more options. Everyone knew Apple was working on the Lisa using the chips and they were slowly coming down in price.

    They pulled in $6 million in funding and started to build a game console, codenamed Lorraine. But to get cash flow, they worked on joysticks and various input devices for other gaming platforms. But development was expensive and they were burning through cash. So they went to Atari and signed a contract to give them exclusive access to the chips they were creating. And of course, then came the video game crash of 1983. Amazing timing.

    That created a shakeup around the industry. Jack Tramiel was out at Commodore, the company he founded originally to create calculators at the dawn of MOS chip technology. And Tramiel bought Atari from Time Warner. The console they were supposed to give Atari wasn’t done yet. Meanwhile Tramiel had cut most of the Atari team and was bringing in his trusted people from Commodore, so seeing they’d have to contend with a titan like Tramiel, the team at Amiga went looking for investors. That’s when Commodore bought Amiga to become their new technical team and next thing you know, Tramiel sues Commodore and that drags on from 1983 to 1987.

    Meanwhile, the nerds worked away. And by CES of 1984 they were able to show off the power of the graphics with a complex animation of a ball spinning and bouncing and shadows rendered on the ball. Even if the OS wasn’t quite done yet, there was a buzz. By 1985, they announced The Amiga from Commodore - what we now know as the Amiga 1000. The computer was prone to crash, they had very little marketing behind them, but they were getting sales into the high thousands per month.

    Not only was Amiga competing with the rest of the computer industry, but they were competing with the PET and VIC-20, which Commodore was still selling. So they finally killed off those lines and created a strategy where they would produce a high end machine and a low end machine. These would become the Amiga 2000 and 500. Then the Amiga 3000 and 500 Plus, and finally the 4000 and 1200 lines. The original chips evolved into the ECS then AGA chipsets but after selling nearly 5,000,000 machines, they just couldn’t keep up with missteps from Commodore after Irving Gould outside yet another CEO.

    But those Amiga machines. They were powerful and some of the first machines that could truly crunch the graphics and audio. And those higher end markets responded with tooling built specifically for the Amiga. Artists like Andy Warhol flocked to the platform. We got LightWave used on shows like Max Headroom. I can still remember that Money For Nothing video from Dire Straits. And who could forget Dev. The graphics might not have aged well but they were cutting edge at the time.

    When I toured colleges in that era, nearly every art department had a lab of Amigas doing amazing things. And while artists like Calvin Harris might have started out on an Amiga, many slowly moved to the Mac over the ensuing years. Commodore had emerged from a race to the bottom in price and bought themselves a few years in the wake of Jack Tramiel’s exit. But the platform wars were raging with Microsoft DOS and then Windows rising out of the ashes of the IBM PC and IBM-compatible clone makers were standardizing. Yet Amiga stuck with the Motorola chips, even as Apple was first in line to buy them from the assembly line.

    Amiga had designed many of their own chips and couldn’t compete with the clone makers at the lower end of the market or the Mac at the higher end. Nor the specialty systems running variants of Unix that were also on the rise. And while the platform had promised to sell a lot of games, the sales were a fourth or less of the other platforms and so game makers slowly stopped porting to the Amiga.

    They even tried to build early set-top machines, with the CDTV model, which they thought would help them merge the coming set-top television control and the game market using CD-based games. They saw MPEG coming but just couldn’t cash in on the market. We were entering into an era of computing where it was becoming clear that the platform that could attract the most software titles would be the most popular, despite the great chipsets.

    The operating system had started slow. Amiga had a preemptive multitasking kernel and the first version looked like a DOS windowing screen when it showed up iii 1985. Unlike the Mac or Windows 1 it had a blue background with oranges interspersed. It wasn’t awesome but it did the trick for a bit. But Workbench 2 was released for the Amiga 3000. They didn’t have a lot of APIs so developers were often having to write their own tools where other operating systems gave them APIs. It was far more object-oriented than many of its competitors at the time though, and even gave support for multiple languages and hypertext schemes and browsers. Workbench 3 came in 1992, along with the A4000. There were some spiffy updates but by then there were less and less people working on the project. And the tech debt piled up. Like a lack of memory protection in the Exec kernel meant any old task could crash the operating system.

    By then, Miner was long gone. He again clashed with management at the company he founded, which had been purchased. Without the technical geniuses around, as happens with many companies when the founders move on, they seemed almost listless. They famously only built features people asked for. Unlike Apple, who guided the industry. Miner passed away in 1994.

    Less than two years later, Commodore went bankrupt in 1996. The Amiga brand was bought and sold to a number of organizations but nothing more ever became of them. Having defeated Amiga, the Tramiel family sold off Atari in 1996 as well. The age of game consoles by American firms would be over until Microsoft released the Xbox in 2001. IBM had pivoted out of computers and the web, which had been created in 1989 was on the way in full force by then. The era of hacking computers together was officially over.

    14 min
  • All About Amdahl

    Gene Amdahl grew up in South Dakota and as with many during the early days of computing went into the Navy during World War II. He got his degree from South Dakota State in 1948 and went on to the University of Wisconsin-Madison for his PhD, where he got the bug for computers in 1952, joining the ranks of IBM that year.

    At IBM he worked on the iconic 704 and then the 7030 but found it too bureaucratic. And yet he came back to become the Chief Architect of the IBM S/360 project. They pushed the boundaries of what was possible with transistorized computing and along the way, Amdahl gave us Amdahl’s Law, which is an important aspect of parallel computing - how much latency tasks take when split across different CPUs. Think of it like the law of diminishing returns applied to processing. Contrast this with Fred Brook’s Brook’s Law - which says that adding incremental engineers don’t make projects happen faster by the same increment, or that it can cause a project to take even more time.

    As with Seymour Cray, Amdahl had ideas for supercomputers and left IBM again in 1970 when they didn’t want to pursue them - ironically just a few years after Thomas Watson Jr admitted that just 34 people at CDC had kicked IBM out of their leadership position in the market.

    First he needed to be able to build a computer, then move into supercomputers. Fully transistorized computing had somewhat cleared the playing field. So he developed the Amdahl 470V/6 - more reliable, more pluggable, and so cheaper than the IBM S/370. He also used virtual machine technology so customers could simulate a 370 and so run existing workloads cheaper. The first went to NASA and the second to the University of Michigan. During the rise of transistorized computing they just kept selling more and more machines.

    The company grew fast, taking nearly a quart of the market share. As we saw in the CDC episode, the IBM antitrust case was again giving a boon to other companies. Amdahl was able to leverage the fact that IBM software was getting unbundled with the hardware as a big growth hack. As with Cray at the time, Amdahl wanted to keep to one CPU per workload and developed chips and electronics with Fujitsu to enable doing so.

    By the end of the 70s they had grown to 6,000 employees on the back of a billion dollars in sales. And having built a bureaucratic organization like the one he just left, he left his namesake company much as Seymour Cray had left CDC after helping build it (and would later leave Cray to start yet another Cray). That would be Trilogy systems, which failed shortly after an IPO. I guess we can’t always bet on the name. Then Andor International. Then Commercial Data Servers, now a part of Xbridge systems.

    Meanwhile the 1980s weren’t kind to the company with his name on the masthead. The rise of Unix and first minicomputers then standard servers meant people were building all kinds of new devices. Amdahl started selling servers, given the new smaller and pluggable form factors. They sold storage. They sold software to make software, like IDEs. The rapid proliferation of networking and open standards let them sell networking products.

    Fujitsu ended up growing faster and when Gene Amdahl was gone, in the face of mounting competition with IBM, Amdahl tried to merge with Storage Technology Corporation, or StorageTek as it might be considered today. CDC had pushed some of its technology to StorageTek during their demise and StorageTek in the face of this new competition ended up filing Chapter 11 and getting picked up by Sun for just over $4 billion.

    But Amdahl was hemorrhaging money as we moved into the 90s. They sold off half the shares to Fujitsu, laid off over a third of their now 10,000 plus workforce, and by the year 2000 had been lapped by IBM on the high end market. They sold off their software division, and Fujitsu acquired the rest of the shares. Many of the customers then moved to the then-new IBM Z series servers that were coming out with 64 bit G3 and G4 chips. As opposed to the 31-bit chips Amdahl, now Fujitsu under the GlobalServer mainframe brand, sells.

    Amdahl came out of the blue, or Big Blue. On the back of Gene Amdahl’s name and a good strategy to attack that S/360 market, they took 8% of the mainframe market from IBM at one point. But they sold to big customers and eventually disappeared as the market shifted to smaller machines and a more standardized lineup of chips. They were able to last for awhile on the revenues they’d put together but ultimately without someone at the top with a vision for the future of the industry, they just couldn’t make it as a standalone company.

    The High Performance Computing server revenues steadily continue to rise at Fujitsu though - hitting $1.3 billion in 2020. In fact, in a sign of the times, the 20 million Euro PRIMEHPC FX700 that’s going to the Minho Advanced Computing Centre in Portugal is a petascale computer built on an ARM plus x86 architecture. My how the times have changed. But as components get smaller, more precise, faster, and more mass producible we see the same types of issues with companies being too large to pivot quickly from the PC to the post-PC era. Although at this point, it’s doubtful they’ll have a generations worth of runway from a patron like Fujitsu to be able to continue in business. Or maybe a patron who sees the benefits downmarket from the new technology that emerges from projects like this and takes on what amounts to nation-building to pivot a company like that. Only time will tell.

    9 min
  • The Dartmouth Time Sharing System and Time Sharing

    DTSS, or The Dartmouth Time Sharing System, began at Dartmouth College in 1963. That was the same year Project MAC started at MIT, which is where we got Multics, which inspired Unix. Both contributed in their own way to the rise of the Time Sharing movement, an era in computing when people logged into computers over teletype devices and ran computing tasks - treating the large mainframes of the era like a utility.

    The notion had been kicking around in 1959 but then John McCarthy at MIT started a project on an IBM 704 mainframe. And PLATO was doing something similar over at the University of Illinois, Champaign-Urbana. 1959 is also when John Kemeny and Thomas Kurtz at Dartmouth College bought Librascope General Purpose computer, then being made in partnership with the Royal Typewriter Company and Librascope - whichwould later be sold off to Lockheed Martin.

    Librascope had Stan Frankel - who had worked on both the Manhattan Project and the ENIAC. And he architected the LGP-30 in 1956, which ended up at Dartmouth. At this point, the computer looked like a desk with a built-in typewriter.

    Kurtz had four students that were trying to program in ALGOL 58. And they ended up writing a language called DOPE in the early 60s. But they wanted everyone on campus to have access to computing - and John McCarthy said why not try this new time sharing concept. So they went to the National Science Foundation and got funding for a new computer, which to the chagrin of the local IBM salesman, ended up being a GE-225.

    This baby was transistorized. It sported 10,0000 transistors and double that number of diodes. It could do floating-point arithmetic, used a 20-bit word, and came with 186,000 magnetic cores for memory. It was so space aged that one of the developers, Arnold Spielberg, would father one of the greatest film directors of all time. Likely straight out of those diodes.

    Dartmouth also picked up a front-end processor called a DATANET-30 from GE. This only had an 18-bit word size but could do 4k to 16k words and supported hooking up 128 terminals that could transfer data to and from the system at 3,000 bits a second using the Bell 103 modem. Security wasn’t a thing yet, so these things had direct memory access to the 225, which was a 235 by the time they received the computer.

    They got to work in 1963, installing the equipment and writing the code. The DATANET-30 received commands from the terminals and routed them to the mainframe. They scanned for commands 110 times per second from the terminals and ran them when the return key was pressed on a terminal. If the return key was a command they queued it up to run, taking into account routine tasks the computer might be doing in the background.

    Keep in mind, the actual CPU was only doing one task at a time, but it seemed like it was multi-tasking! Another aspect of democratizing computing across campus was to write a language that was more approachable than a language like Algol. And so they released BASIC in 1964, picking up where DOPE left off, and picking up a more marketable name.

    Here we saw a dozen undergraduates develop a language that was as approachable as the name implies. Some of the students went to Phoenix, where the GE computers were built. And the powers at GE saw the future.

    After seeing what Dartmouth had done, GE ended up packaging the DATANET-30 and GE-235 as one machine, which they marketed as the GE-265 the next year. And here we got the first commercially viable time-sharing system, which started a movement. One so successful that GE decided to get out of making computers and focus instead on selling access to time sharing systems. By 1968 they actually ended up shooting up to 40% of the market of the day.

    Dartmouth picked up a GE Mark II in 1966 and got to work on DTSS version 2. Here, they added some of the concepts coming out of the Multics project that was part of Project MAC at MIT and built on previous experiences. They added pipes and communication files to promote inter-process communications - thus getting closer to the multiple user conferencing like what was being done on PLATO with Notes.

    Things got more efficient and they could handle more and more concurrent sessions. This is when they went from just wanting to offer computing as a basic right on campus to opening up to schools in the area. Nearby Hanover High School started first and by 1967 they had over a dozen. Using further grants from NSF they added another dozen schools to what by then they were calling the Kiewit Network. Then added other smaller colleges and by 1971 supported a whopping 30,000 users. And by 73 supported leased line connections all the way to Ohio, Michigan, New York, and even Montreal.

    The system continued on in one form or another, allowing students to code in FORTRAN, COBOL, LISP, and yes… BASIC. It became less of a thing as Personal Computers started to show up here and there. But BASIC didn’t. Every computer needed a BASIC. But people still liked to connect on the system and share information. At least, until the project was finally shut down in 1999. Turns out we didn’t need time sharing once the Internet came along.

    Following the early work done by pioneers, companies like Tymshare and CompuServe were born. Tymshare came out of two of the GE team, Thomas O’Rourke and David Schmidt. They ran on SDS hardware and by 1970 had over 100 people, focused on time sharing with their Tymnet system and spreading into Europe by the mid-70s, selling time on their systems until the cost of personal computing caught up and they were acquired by McDonnell Douglas in 1984.

    CompuServe began on a PDP-10 and began similarly but by the time they were acquired by H&R Block had successfully pivoted into a dial-up online services company and over time focused on selling access to the Internet. And they survived through to an era when they migrated their own proprietary tooling to HTML in the late 90s - although they were eventually merged into AOL and are now a part of Verizon media. So the pivot bought them an extra decade or so.

    Time sharing and BASIC proliferated across the country and then the world from Dartmouth. Much of this - and a lot of personal stories from the people involved can be found in Dr Joy Rankin’s “A People’s History of Computing in the United States.” Published in 2018, it’s a fantastic read that digs in deep on the ways that many of these systems evolved. There are other works, but she does a phenomenal job tying events into one another.

    One consistent point across her book is around societal impact. These pioneers democratized access to computing. Many of those who built businesses around time sharing missed the rapidly falling price of chips and the ready access to personal computers that were coming. They also missed that BASIC would be monetized by companies like Microsoft. But they brought computing to high schools in the area, established blueprints for teaching that are used through to this day, and as Grace Hopper did a generation before - made us think of even more ways to make programming more accessible to a new generation with BASIC.

    One other author of note here is John Kemeny. His book “Man and the computer” is a must read. He didn’t have the knowledge of the upcoming personal computing - but far more prophetic than not around cloud operations as we get back to a time sharing-esque model of computing. And we do owe him, Kurtz, and everyone else involved a huge debt for their work. Many others pushed the boundaries of what was possible with computers. They pushed the boundaries of what was possible with accessibility. And now we have ubiquity.

    So when we see something complicated. Something that doesn’t seem all that approachable. Maybe we should just wonder if - by some stretch - we can make it a bit more BASIC. Like they did.

    13 min
  • eBay, Pez, and Immigration

    We talk about a lot of immigrants in this podcast. There’s the Hungarian mathemeticians and scientists that helped usher in the nuclear age and were pivotal in the early days of computing. There are the Germans who found a safe haven in the US following World War II. There are a number of Jewish immigrants who fled persecution, like Jack Tramiel - a Holocaust survivor who founded Commodore and later took the helm at Atari. An Wang immigrated from China to attend Harvard and stayed. And the list goes on and on. Georges Doriot, the father of venture capital came to the US from France in 1899, also to go to Harvard.

    We could even go back further and look at great thinkers like Nikolai Tesla who emigrated from the former Austrian empire. And then there’s the fact that many Americans, and most of the greats in computer science, are immigrants if we go a generation or four back.

    Pierre Omidyar’s parents were Iranian. They moved to Paris so his mom could get a doctorate in linguistics at the famous Sorbonne. While in Paris, his dad became a surgeon, and they had a son. They didn’t move to the US to flee oppression but found opportunity in the new land, with his dad becoming a urologist at Johns Hopkins.

    He learned to program in high school and got paid to do it at a whopping 6 bucks an hour. Omidyar would go on to Tufts, where he wrote shareware to manage memory on a Mac. And then the University of California, Berkeley before going to work on the MacDraw team at Apple.

    He started a pen-computing company, then a little e-commerce company called eShop, which Microsoft bought. And then he ended up at General Magic in 1994. We did a dedicated episode on them - but supporting developers at a day job let him have a little side hustle building these newish web page things.

    In 1995, his girlfriend, who would become his wife, wanted to auction off (and buy) Pez dispensers online. So Omidyar, who’d been experimenting with e-commerce since eShop, built a little auction site. He called it auction web. But that was a little boring. They lived in the Bay Area around San Francisco and so he changed it to electronic Bay, or eBay for short. The first sale was a broken laser printer he had laying around that he originally posted for a dollar and after a week, went for $14.83.

    The site was hosted out of his house and when people started using the site, he needed to upgrade the plan. It was gonna’ cost 8 times the original $30. So he started to charge a nominal fee to those running auctions. More people continued to sell things and he had to hire his first employee, Chris Agarpao.

    Within just a year they were doing millions of dollars of business. And this is when they hired Jeffrey Skoll to be the president of the company. By the end of 1997 they’d already done 2 million auctions and took $6.7 million in venture capital from Benchmark Capital. More people, more weird stuff. But no guns, drugs, booze, Nazi paraphernalia, or legal documents. And nothing that was against the law.

    They were growing fast and by 1998 brought in veteran executive Meg Whitman to be the CEO. She had been a VP of strategy at Disney, then the CEO of FTD, then a GM for Playskool before that. By then, eBay was making $4.7 million a year with 30 employees.

    Then came Beanie Babies. And excellent management. They perfected the online auction model, with new vendors coming into their space all the time, but never managing to unseat the giant.

    Over the years they made onboarding fast and secure. It took minutes to be able to sell and the sellers are the ones where the money is made with a transaction fee being charged per sale, in addition to a nominal percentage of the transaction. Executives flowed in from Disney, Pepsi, GM, and anywhere they were looking to expand.

    Under Whitman’s tenure they weathered the storm of the dot com bubble bursting, grew from 30 to 15,000 employees, took the company to an IPO, bought PayPal, bought StubHub, and scaled the company up to handle over $8 billion in revenue. The IPO made Omidyar a billionaire.

    John Donahoe replaced Whitman in 2008 when she decided to make a run at politics, working on Romney and then McCain’s campaigns. She then ran for the governor of California and lost. She came back to the corporate world taking on the CEO position at Hewlett-Packard.

    Under Donahoe they bought Skype, then sold it off. They bought part of Craigslist, then tried to develop a competing product. And finally sold off PayPal, which is now a public entity of its own right.

    Over the years since, revenues have gone up and down. Sometimes due to selling off companies like they did with PayPal and later with StubHub in 2019. They now sit at nearly $11 billion in revenues, over 13,000 employees, and are a mature business. There are still over 300,000 listings for Beanie Babies. And to the original inspiration over 50,000 listings for the word Pez.

    Omidyar has done well, growing his fortune to what Forbes estimated to be just over $13 billion dollars. Much of which he’s pledged to give away during his lifetime, having joined the Bill Gates and Warren Buffet giving pledge. So far, he’s given away well over a billion with a focus in education, governance, and citizen engagement. Oh and this will come as no surprise, helping fund consumer and mobile access to the Internet. Much of this giving is funneled through the Omidyar Network.

    The US just evacuated over 65,000 Afghans following the collapse of that government. Many an oppressive government runs off the educated, those who are sometimes capable of the most impactful dissent. Some of the best and most highly skilled of an entire society leaves a vacuum in regions that further causes a collapse. And yet finding a home in societies known for inclusion and opportunity, and being surrounded by inspiring stories of other immigrants who made a home and took advantage of opportunity. Or whose children could. Those melting pots in the history of science are when diversity of human and discipline combine to make society for everyone better. Even in the places they left behind. Anyone who’s been to Hungary or Poland or Germany - places where people once fled - can see it in the street every time people touch a mobile device and are allowed to be whomever they want to be.

    Thank you to the immigrants, past and future, for joining us to create a better world. I look forward to welcoming the next wave with open arms.

    10 min

About The History of Computing

From the publisher's feed

Computers touch all most every aspect of our lives today. We take the way they work for granted and the unsung heroes who built the technology, protocols, philosophies, and circuit boards, patched…