Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

9 thoughts on “Google’s Awake

  1. If I both understand and recall correctly (doubtful?), GPUs were developed for the high precision calculations required for graphics, while LLMs use low precision calculations, so GPUs were not actually the optimal architecture for LLMs and maybe not for other forms of AI. GOOG’s TPU architecture was developed more specifically for AI, in which GOOG was dominant back when AI was called “machine learning”, i.e. pre-LLMs. GOOG claims TPU are much more efficient than GPU, and perhaps there is a fundamental architectural reason. Of course, all that may have changed by now. I also recall recently reading that a Chinese company developed an even more efficient AI chip using the low-precision aspect of LLMs. My understating of all this may be wrong, one of Dr H’s more technically knowledgeable readers will hopefully set us straight.

    1. The AI game is a fast moving one with the rules, players and equipment changing rapidly. In one year what will be the ‘next’ chip that everyone needs. Impossible to say. What if Meta’s former AI chief Yann LeCun is right that AGI will need a new visual approach and not LLMs. And that’s only one of a hundred things that could change in a year.

      I’m still wondering how AI is going to get me, the consumer, to spend more money. The savings I’ve read about all seem to be based on productivity savings for business. I have friends who use Comet to search out items online and make purchases, but it’s not for anything they couldn’t find themselves.

  2. Gemini works pretty well, it’s right there in the Google Search window, and it is free to use (for now). Unless you have specific needs or uses, why fiddle around with anything else?

  3. The thing is the Phantom is curtailed to a very small user base, while that of an S-Class is much wider. Why drive a Phantom when an S-Class is more than enough? Hell, an E-Class would do if you ask China.

  4. Hardware always loses in the end excepting two scenarios: 1) a luxury moat (e.g. Apple), 2) a software moat (also Apple). Where there’s margin, there’s competition, and margins erode like beaches on the Outer Banks. Never forget that IBM once held the title of Biggest Market Cap, planet Earth division. Then they outsourced their software to some nerds from Redmond. Presumably that saved them some money. Improved margins. Definitely worth it.

    (I know Nvidia has software offerings. I just don’t know that it constitutes a “moat.” The vikings are coming. They promise to not be evil, nor to split infinitives.)

    1. I was so proud of that last sentence, but just thought of a better wording; thus, amended for your edification:

      They promise to neither be evil, nor split infinitives.

      Much better. Syntax matters folks. When it’s good, you can get away with incomplete sentences.

10th Anniversary Boutique

01/01/26