In a press conference this week on New York City’s $12 billion budget gap, Mayor Zohran Mamdani zeroed in on the previous administration’s artificial intelligence chatbot as one of “a number of different things we’re going to pursue for savings.”

  • Dremor@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    3 hours ago

    A model being local doesn’t make it magically better than cloud based ones. Especially since your local hardware may not be as optimized as professional hardware.

    And I say that as a local AI user.

    The way to make it less harmful mainly comes from external factors :

    • The origin of the electricity (renewable)
    • Shift consumption to a time of low demand (or use a residential battery)
    • Use specific hardware for specific tasks (use less energy per token)