1

AI Needs So Much Electricity That Tech Companies Are Getting Into Energy Busines...

 4 weeks ago
source link: https://hardware.slashdot.org/story/24/04/22/1427219/ai-needs-so-much-electricity-that-tech-companies-are-getting-into-energy-business
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

AI Needs So Much Electricity That Tech Companies Are Getting Into Energy Businessbinspamdupenotthebestofftopicslownewsdaystalestupid freshfunnyinsightfulinterestingmaybe offtopicflamebaittrollredundantoverrated insightfulinterestinginformativefunnyunderrated descriptive typodupeerror

Sign up for the Slashdot newsletter! OR check out the new Slashdot job board to browse remote jobs or jobs in your area

Do you develop on GitHub? You can keep using GitHub but automatically sync your GitHub releases to SourceForge quickly and easily with this tool so your projects have a backup location, and get your project in front of SourceForge's nearly 20 million monthly users. It takes less than a minute. Get new users downloading your project releases today!
×
An anonymous reader shares a report: To accommodate tech companies' pivots to artificial intelligence, tech companies are increasingly investing in ways to power AI's immense electricity needs. Most recently, OpenAI CEO Sam Altman invested in Exowatt, a company using solar power to feed data centers, according to the Wall Street Journal. That's on the heals of OpenAI partner, Microsoft, working on getting approval for nuclear energy to help power its AI operations. Last year Amazon, which is a major investor in AI company Anthropic, said it invested in more than 100 renewable energy projects, making it the "world's largest corporate purchaser of renewable energy for the fourth year in a row."
  • I won't bother with sherwood.news. No need to read any further.

      • Re:

        A "news" company owned by Robinhood. So basically manipulating people to invest more by providing not-quite-impartial investment advice news.

        • Re:

          at least they are (lincoln) green
    • Re:

      /. editors had ONE job./s

      Guess no one cares about spelling anymore (original author or the editors.):-/

    • Re:

      Man if typos or grammatical mistakes caused you to not bother with a site you'd have closed your Slashdot account down back in the 90s.

      • Re:

        Typos and grammatical mistakes are fine when the general public does this. But it used to be part and parcel of the journalism trade to actually be careful with stories, including with the spelling and grammar, you couldn't be a good journalistic publisher and have bad spelling, even if the original authors didn't spell well you were expected to do the proper work of editing and fixing articles. Or at the very least be smart enough to insert "[sic]" where apropriate. But today, it's just slam the stories

  • These companies have a lot of cash right now, but likely won't get many returns investing it in more new tech. Might as well vertically integrate and invest in something that's otherwise an expense anyway.

  • Once AI starts going on an unfettered rampage, we can scorch the sky so there's no sunlight for them to power up.

    A perfect plan indeed.

    • Re:

      Most of them are actually relying on coal, gas and nuclear reactors. The selling of carbon credits to China for solar energy is a scam, it does not actually make your energy come from solar panels, otherwise the AI datacenters would be shutting down at night.

    • Re:

      Humans will make good power sources.

  • That's the real reason the only data center certification anyone cares about is actually just a financial audit.

    • Re:

      We wait for the patch^B^B^B^B^Bconcrete sarcophagus.
    • Re:

      Mod this up (FUNNY)
    • Re:

      The ultraviolet screen of ultraviolent death!

  • Time to move to China, where cheap coal power is plentiful.

    • Re:

      You don't need to move to China. The US DoE will help fund small, modular coal plants of the 100MW or so size that you would put accompanying a data center.
    • Re:

      please do.

  • The human brain runs on about 29 watts.

    Let's focus on hardware improvements rather than massive power generation increases.

    • Re:

      The high cost of AI isn't due to hardware it's due to the *large* in large language model. The LLMs achieve what they do with massive data sets. They don't work analogously to the human brain which uses only a tiny fraction of the training data (no human could ingest that amount of data)
      • Re:

        i think software improvements are more critical here. specially at scale, energy costs will for sure spur optimization of algorithms and toolchains. maybe even promote more resource-aware coding which hasn't been a priority for a long time, precisely because of hardware improvements and the fact that it tends to be cheaper and easier to throw more metal or energy at a problem than to figure out a more efficient system.

        • Re:

          I don't think there's any conflict between our statements. The electricity costs for LLMs are huge. Other AI techniques are much less computationally intensive. And there will be a lot of work trying to get more out of other AI/machine learning techniques. Current LLMs are only possible as a solution because hardware has gotten so fast. Efficiency improvements will certainly come.
        • Re:

          Really? History teaches us that software developers just wait for faster machines and more memory rather than optimize. It's even a religious mantra: thou shalt not prematurely optimize; and the corollary mantra: It is always premature. Just take a look at Microsoft Word - a basic word processor that barely fulfills basic needs, yet creeps along at a slow pace while consuming all resources.

    • Re:

      Today, I found a text file on my computer. It was a response to a ZDNet article back in 2016 or some such. My computer remembered every word I wrote; I'd forgotten I made the post at all.

      Today, I entered my time sheet at work for the different on-site appointments I made last week. I'd forgotten one of them already. My phone kept a GPS log that knew exactly where I was and was able to ensure completeness.

      The human brain is incredible in may ways...but computers do things human brains cannot...and unless we

    • Re:

      Task: Recite as many digits of pi as you can.

      Me: 3.14159. I know there are ways to get more.

      AI: Arbitrary number of digits subject only to some hard-coded constraint, as well as able to tell you about all the algorithms for approximating pi along with their strengths and weaknesses, then run the algorithms for you.

      Let's see 29 Watts do that.

    • Re:

      The average brain. Mine is being frugal on energy at the moment.

  • The exhortations to save trees by avoiding printing need to be updated: save coral reefs and polar bears by avoiding stupid doodles on Dall-E!
  • This seems like the ideal load for wind or solar. Just suspend processing when the power dries up and resume later
  • OK...cheap shot as I know Python is not the reason why AI projects use so much electricity, but Python and JavaScript are extremely wasteful languages....waste is fine for a quick script, but when you write major backends in either language and they require twice as many servers as a JVM, GO, or CLR alternative, perhaps we should consider how much of an ecological impact programming decisions have...especially since young people seem to have this "when all you have is a hammer, everything looks like a nail"
  • They're "getting into" power generation? That makes it sound like this is something brand new. I remember when Apple put in its first natural gas cogeneration plant to take its build infrastructure off the grid, back around 2002 or 2003, I think. Google has massive generators around a bunch of its buildings, presumably for the same reason. Big tech has been in the energy business quite literally for decades at this point.

  • It's a goddam opinion piece!/. can do better.


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK