Welcome to our

Cyber Security News Aggregator

.

Cyber Tzar

provide a

cyber security risk management

platform; including automated penetration tests and risk assesments culminating in a "cyber risk score" out of 1,000, just like a credit score.

Quickpost: The Electric Energy Consumption Of LLMs – No GPU

published on 2024-10-08 00:00:00 UTC by Didier Stevens
Content:

A friend asked me if I had used a GPU for my tests described in blog post “Quickpost: The Electric Energy Consumption Of LLMs”. Because he had tried running an LLM on a machine without GPU, and it was too slow.

I did a quick test, just redoing previous test but without GPU (by setting environment variable CUDA_VISIBLE_DEVICES=-1).

Answering my query took 17 seconds, and required 1.13 Wh (again, for the whole PC).


Quickpost info

Article: Quickpost: The Electric Energy Consumption Of LLMs – No GPU - published 27 days ago.

https://blog.didierstevens.com/2024/10/08/quickpost-the-electric-energy-consumption-of-llms-no-gpu/   
Published: 2024 10 08 00:00:00
Received: 2024 10 30 18:38:15
Feed: Didier Stevens
Source: Didier Stevens
Category: Cyber Security
Topic: Cyber Security
Views: 0

Custom HTML Block

Click to Open Code Editor