The Legend of von Neumann (1973) [pdf]

(gwern.net)

121 points | by suopspaces 3 hours ago

24 comments

  • breput 41 minutes ago
    My favorite von Neumann anecdote was a quote from Edward Teller: "von Neumann would carry on a conversation with my 3 year old son, and the two of them would talk as equals, and I sometimes wondered if he used the same principle when he talked to the rest of us."
  • srejk 2 hours ago
    When you look at it holistically, von Neumann was more influential in science and mathematics in the 20th century than either Einstein or Planck. He wasn't as obvious a symbol of the scientific revolution, but his contributions to SO MANY THINGS at a fundamental level makes him stand out to me.
    • JoeAltmaier 1 hour ago
      It's odd that even today, different disciplines are still silo'd. My son started a research cross-database search engine because different disciplies use different terms for nearly identical concepts. Even within medicine it's silo'd.

      Trouble with that startup was, the medical folks with money don't use computer tools. And the students in training have no money.

      • flipping_beacon 1 hour ago
        It's crazy that we talk about LLMs, AI/ML and what not but so many fields still don't use computation as much as we think they do simply because they cannot reliably keep up with the advancements happening almost everyday and people simply forgetting about backwards compatibility in their products
    • nkozyra 52 minutes ago
      He's definitely the one guy from the 20th century I can't really reconcile his capability and breadth, other than being an alien or a time traveller.
    • snapetom 2 hours ago
      Definitely my favorite physicist for the same reason you state. The notion that he just went around different fields and said “here’s how math can improve things,” invented some new approach, and moved on to another field to do it all over again just cracks me up.
      • harpersealtako 1 hour ago
        Nowadays we'd call that "engineer's disease". I wonder how many potential Von Neumanns were discouraged from branching out into other fields by jealous gatekeepers who assume that any interest in their field by "outsiders", especially technical people, is "epistemic trespassing".
        • cycomanic 5 minutes ago
          I have yet to meet a (academic) researcher that doesn't like to talk about their research topic if somebody comes and is genuinely interested. I mean most work on a topic that has maybe another 10-100 people in the world who are interested.

          The problem is that instead most people to come to them are either obvious crackpots, who think they have solved cancer (energy...) and contact the person because they are a biologist, physicist ... (on a completely unrelated topic usually). Or they come from a place of arrogance, i.e. "we do ... like this, our method is clearly superior you should adopt it", or even worse here buy our clearly superior method.

        • lalalandland 56 minutes ago
          For every von Neumann you probably have thousands if not millions of crack pots with ideas not worth wasting time on. So I understand the scepticism
          • hnfong 10 minutes ago
            If people are assigned a "gatekeeping" position, they should at least be expected to be able to tell great minds from crack pots. (As opposed to just blindly applying a statistical filter)

            Otherwise why not just replace them with a script (or these days, an AI)

        • chucksmash 45 minutes ago
          Seems to me it's less about gatekeepers and more whether what you bring to the table is useful to people in that field.

          If somebody truly believes they have a useful model then they don't discouraged by academic gatekeeping, they go and build Time Cube.

    • delichon 1 hour ago
      Shannon may be gaining on him.
      • cma 1 hour ago
        I vote for Wiener at this point
        • ricksunny 1 hour ago
          I'm more of a Vannevar acolyte myself.
  • dang 6 minutes ago
    Related. Others?

    The legend of John von Neumann (1973) - https://news.ycombinator.com/item?id=8212335 - Aug 2014 (65 comments)

    The Legend of John von Neumann - https://news.ycombinator.com/item?id=1427906 - June 2010 (4 comments)

    (Reposts are fine after a year or so; links to past threads are just to satisfy extra-curious readers)

  • SimplyUnknown 3 hours ago
    For a longer read, I can highly recommend the book "The Man from the Future" by Ananyo Bhattacharya. It's quite an easy read and extensively discusses the life and discoveries by John von Neumann in chronological order.
    • stevenwoo 2 hours ago
      I had to frequently pause my read to research a discovery in more depth to understand the significance of it and I got a chuckle when he marries his childhood sweetheart because she got no mention prior to that point in the book.
    • laserson 2 hours ago
      I read this last year and also recommend!
    • offbeatport 1 hour ago
      Books from before the age of AI will only become more precious over time. This is great.
    • zoltano 1 hour ago
      He's my favourite mathematician too. Loved The Man from the Future book. Can we get a frontier model named after him perhaps? "Johnny" would be a great codename imo
  • lwarfield 1 hour ago
    Von Nuemann is one of those names that when ever it comes up I sarcastically mentally note "John f***ing Neumann, AGAIN!". It's happened so many times in my studies that I think he might be the most important scientist to have ever lived.

    He's also the inspiration for one of favorite characters in fiction, Sherkaner Underhill from A Deepness In The Sky*. :)

  • chasd00 2 hours ago
    Not sure what just happened but like 10 comments just vanished. Anyway, here's a wiki link to "The Martians" which was a group of Hungarian scientists and Von Neuman was a member.

    https://en.wikipedia.org/wiki/The_Martians_(scientists)

    "The Martians" (Hungarian: "A marslakók") were a group of prominent scientists (mostly, but not exclusively, physicists and mathematicians) of Hungarian Jewish descent who emigrated from Europe to the United States in the early half of the 20th century.[1]

    Leo Szilard jokingly suggested that Hungary was a front for aliens from Mars."

    • rationalist 2 hours ago
      You might not have "show dead" enabled in your settings. There is an antisemitic comment that was flagged and is now "dead" with a bunch of replies - so you would have seen those, and then now not see them if you don't have "show dead" enabled.
  • sourdecor 2 hours ago
    My favorite dude. Imagine one of the world's smartest people almost continually killing himself because he can't stop reading while driving.
  • alkyon 1 hour ago
    Recently I enjoyed very much The MANIAC by Benjamin Labatut:

    https://en.wikipedia.org/wiki/The_MANIAC

    • dealmeidaleon 1 hour ago
      I liked the book, it uses an interesting storytelling mechanism of telling each chapter through the lens of a different historical character (his mom, his wife, friends, etc). But I think Labatut sacrificed voice and tone a little bit (there weren’t too many elements to differentiate between each narrator).
    • joenot443 1 hour ago
      I enjoyed this one a lot.

      For those who've read other books on von Neumann, do you think The MANIAC is a reasonable summary?

  • inasio 1 hour ago
    The end of life section is a bit whitewashed. Freeman Dyson had an article (struggling to find it) about how von Neumann was invited to give a Hilbert-style lecture on the 10 problems for the new computing age. All the big names at the time were there, but von Neumann was in such poor shape (dementia I assume), that it was decided to pretend it had never happened.

    edit: article is called Birds and Frogs, by Freeman Dyson https://wucj.lab.westlake.edu.cn/Others/Dyson_Birds_and_Frog...

    • BeetleB 1 hour ago
      He died from cancer - he was only in his 50's. Unlikely to be dementia.
  • rawmaterial 42 minutes ago
    To whoever speaks German or can stand auto subtitles:

    https://www.youtube.com/watch?v=OH2ZVSDYgK0

  • tbagman 1 hour ago
    This seems relevant to the current debate on the role of AI in mathematics:

    What made von Neumann great? Was it the extraordinary rapidity with which he could understand and think and the unusual memory that retained everything he had once thought through? No. These qualities, however impressive they might have been, are ephemeral; they will have no more effect on the mathematics and the mathematicians of the future than the prowess of an athlete of a hundred years ago has on the sport of today.

    • random3 1 hour ago
      How is this relevant?
      • iaad 23 minutes ago
        They're making a comparison to AI, because it has similar qualities (rapid understanding and "perfect" memory). Will AI also be ephemeral or having a lasting impact on mathematics like von Neumann.
  • ricksunny 1 hour ago
    Feels appropriate to mention here recent HN mentions about who deserves credit for 'von Neumann architecture"

    https://news.ycombinator.com/item?id=49870485

    • dandersch 1 hour ago
      Could the controversy behind it be the reason that the author ommitted it? It was established terminology by 1973, as far as I can tell.
      • ricksunny 34 minutes ago
        > It was established terminology by 1973, as far as I can tell

        That's a worthwhile observation. The 1973 article anyway doesn't go into depth about comparative computer architecture. It's also possible the term's currency in computer science circles hadn't yet crossed into Halmos' mathematics circles, but I wouldn't know.

    • adrian_b 33 minutes ago
      The conclusion is that von Neumann deserves the credit for the "von Neumann architecture", despite any contrary claims of Eckert or Mauchly.

      Herman Goldstine, who distributed the document and John von Neumann, who wrote it, are the reason for the explosive growth of the computer industry during the following decades.

      The paper written by von Neumann was an exemplary model of clarity and good logical thinking. Nothing ever written by Eckert or Mauchly was at a comparable level.

      Everyone who read that paper understood immediately how to design and build an electronic automatic computer, and a great number of teams in many countries all over the world did precisely this, so a decade later there already existed experimental electronic computers in many countries and also commercial electronic computers in the UK and in USA.

      Some of the details from the paper must have been learned by von Neumann from discussions with the ENIAC team, but others were obviously von Neumann's own ideas, e.g. the use for the main memory of an iconoscope tube with fast random access, i.e. a DRAM like today, instead of the slow serial delay lines chosen by Eckert and Mauchly for their following computers.

      Whatever von Neumann has learned from the ENIAC team, he obviously understood better than the people who taught him, allowing him to formulate general principles for the organization of an automatic computer.

      The publication of the von Neumann paper allowed the concurrent development of many computers in many places, and each of those projects found various improvements that were essential in making the electronic computers successful commercial products.

      If Eckert and Mauchly had succeeded to block any competitors, then the evolution of computers might have been delayed by up to 2 decades, until any patents would have expired, because Eckert and Mauchly have never done later any significant innovations and they would have never succeeded to develop better computers at the pace that happened due to the von Neumann paper.

      Moreover, Eckert and Mauchly had a history themselves of failing to mention their sources of inspiration, so they were not the people entitled to complain about someone "stealing" ideas from them.

      Before ENIAC, the first electronic computer in USA was the Atanasoff-Berry computer. That computer was a special-purpose computer, designed for solving systems of linear algebraic equations. However, ENIAC was a special-purpose computer too, unlike the relay-based computers that were older than it, like the Harvard Mark I computer, as even its name implies (Numerical Integrator and Computer).

      ENIAC was conceived as a replacement for the older mechanical "differential analyzers", which were used to solve ordinary differential equations, e.g. for computing artillery tables, so its architecture mimicked the architecture of the mechanical differential analyzers, and it was reconfigured for new problems in a similar manner with those, by rewiring.

      John Vincent Atanasoff had written in 1940 a very high-quality document about the design of his computer: “Computing Machine for the Solution of Large Systems of Linear Algebraic Equations”. It is unknown if anyone of the ENIAC team had read it, but it is known that one of them had visited the designers of the Atanasoff-Berry computer, inquiring about the electronic circuits used by them to implement arithmetic operations and data storage. Later, during the design of ENIAC and after that, they never mentioned any connection with the earlier electronic computer.

      • ricksunny 12 minutes ago
        Perhaps, and thanks for contributing that; and I'm not taking a position currently on this. But I've long been uncomfortable with the term 'random access' for random access memory (RAM) as it implies that the concept of 'randomness' is somehow a required and fundamental property of the memory technology described, when it's not. 'Arbitrary access' is a much more appropriately encapsulating description of the function of the memory at hand. Alas, the incumbency of terminology.
        • adrian_b 1 minute ago
          I agree with you.

          Nonetheless, the programs whose performance is limited by the speed of the main memory can be divided in programs whose performance is limited by the throughput of the memory interface and programs whose performance is limited by the latency of the memory accesses.

          The programs from the first class will have the same performance when using a serial memory or a RAM, if they are equally fast for sequential access, but for programs from the second class, it is important to have a RAM as the main memory.

          In order to measure the performance achievable by programs from the second class on a given computer, it is necessary to run a benchmark where the addresses of the memory accesses are generated by a good random-number generator.

          The reason is that modern CPUs have a variety of hardware prefetchers that attempt to predict the next memory address, so for meaningful results that reflect the true performance of the memory you need truly random addresses that are impossible to guess by the hardware.

  • Betelbuddy 2 hours ago
    "The duties of John von Neumann's assistant" - https://news.ycombinator.com/item?id=16411799
  • runlaszlorun 1 hour ago
    I don't know what ww4 will be fought with... But ww3 will be fought With mat4x4<f32> And 2.4 GHz
  • matltc 1 hour ago
    Authored by Paul Halmos. He wrote Finite-Dimensional Vector Spaces, which was assigned textbook for my Linear Algebra course. A humbling read for me, coming from calc 3 and thinking I was hot shit. Stripped me of any illusions of becoming a mathematician.
  • aazo11 1 hour ago
    Anyone interested in von Newmann should read The Maniac by Benjamin Labatut
  • bicepjai 1 hour ago
    I remember reading about how he was also a pioneer in using early supercomputers to predict weather patterns in meteorology. I never thought to combine supercomputers and weather before.
  • chk84us 2 hours ago
    Why does it start with page number 382?
    • ketanmaheshwari 1 hour ago
      The PDF is an excerpt from a journal issue: The American Mathematical Monthly, Vol. 80, No. 4 (April 1973), pp. 382–394.
    • LastTrain 1 hour ago
      It's an article in a journal
  • jan_m_savage 2 hours ago
    for a chance to experience his mind, I recommend his book: "The computer and the brain".
  • Betelbuddy 2 hours ago
    Hungarian high school science fair projects...
  • simianwords 1 hour ago
    OT: I found this style of writing extremely clear and readable. I wonder what is different about this author’s writing. There is zero pretension and just exists to impart information. But if that’s the case why do I hate the writing in Wikipedia?
    • gjm11 32 minutes ago
      Because Paul Halmos was an exceptionally good writer. (I greatly enjoyed his "automathography" called "I want to be a mathematician", though it will probably appeal significantly less to people who aren't mathematicians themselves. See also his article "How to write mathematics" at https://www.math.toronto.edu/mgsa/assets/teaching-seminar/ho....)

      The average Wikipedia contributor (even ignoring the possibility that they might be a robot) is not an exceptionally good writer, because very few people are exceptionally good writers, because that's what "exceptionally" means.

    • grougnax 1 hour ago
      [dead]
  • runlaszlorun 1 hour ago
    [flagged]
  • bluecheese452 2 hours ago
    [flagged]
    • leto_ii 2 hours ago
      Why make it about his ethnicity?
      • dilap 1 hour ago
        Why not? Von Neumann himself did, in a lighthearted way.

        > I told Banach about an expression Johnny had used with me in Princeton before stating some non-Jewish mathematician's result, "Die Goim haben den folgenden satz beweisen" (The goys have proved the following theorem). Banach, who was pure goy, thought it was one of the funniest sayings he had ever heard. He was enchanted by its implication that if the goys could do it, then Johnny and I ought to be able to do it better. Johnny did not invent this joke, but he liked it and we started using it.

        https://infoproc.blogspot.com/2021/12/adventures-of-mathemat...

      • archontes 2 hours ago
        https://en.wikipedia.org/wiki/The_Martians_(scientists)

        The Martians (of which von Neumann is usually the most regarded) were mostly Hungarian jews. It's a point on which some people have mused, so it's easy for the thought to point in that direction when von Neumann is brought up.

        • chasd00 2 hours ago
          from the wiki > Leo Szilard jokingly suggested that Hungary was a front for aliens from Mars.

          I had a girlfriend once who joked that Elon Musk was an alien and needs help developing the technology to get home.

          • archontes 2 hours ago
            By all means, let's let him.
          • gf000 2 hours ago
            I get your point, but..

            Please do NOT disrespect Leo Szilard and von Neumann by comparing their greatness to a lowly scammer

            • Betelbuddy 1 hour ago
              Compared to Elon, people of this thread are the Staff at the Institute for Advanced Studies...
            • chasd00 1 hour ago
              oh i wasn't comparing anyone to anyone else, only pointing out the humor.
      • freecodeio 2 hours ago
        "if x person is y, and x person has a specific trait, then me being also y means I have the that specific trait"

        In other words, if you don't have a dog, you're gay. (If you know the comic)

    • ckrapu 2 hours ago
      Interestingly, (and independent of the ethnic and cultural background he grew up in) the article said he was a Roman Catholic by the time he expired.
      • _diyar 2 hours ago
        If I remember correctly he converted on his death bed due to his read on Pascal’s wager.
    • gradus_ad 2 hours ago
      [flagged]
  • brcmthrowaway 1 hour ago
    He was good for the time, but Jane Street and Anthropic have hundreds of equivalent intellects working for them.
    • azan_ 1 hour ago
      Kudos for posting such a good inflammatory comment.