(blog \'DidierStevens)
1k followers 6 articles/week
Quickpost: The Electric Energy Consumption Of LLMs – No GPU

A friend asked me if I had used a GPU for my tests described in blog post “Quickpost: The Electric Energy Consumption Of LLMs”. Because he had tried running an LLM on a machine without GPU, and it was too slow. I did a quick test, just redoing previous test but without GPU (by setting environment variable CUDA_VISIBLE_DEVICES=-1). Answering...

Tue Oct 8, 2024 06:00
Quickpost: The Electric Energy Consumption Of LLMs – No GPU

A friend asked me if I had used a GPU for my tests described in blog post “Quickpost: The Electric Energy Consumption Of LLMs”. Because he had tried running an LLM on a machine without GPU, and it was too slow. I did a quick test, just redoing previous test but without GPU (by setting environment variable CUDA_VISIBLE_DEVICES=-1). Answering...

Tue Oct 8, 2024 03:00
Quickpost: The Electric Energy Consumption Of LLMs

I’ve read claims that AI queries require a lot of energy. Today I heard another claim on the Nerdland Podcast (a popular science podcast here in Belgium): “letting ChatGPT write an email of 100 words requires 70 Wh” (if you’re interested, that’s said at 00:28:05 in this episode). I though to myself: that’s a lot of energy. 70 Wh is 252,000 Ws...

Mon Oct 7, 2024 01:15
Quickpost: The Electric Energy Consumption Of LLMs

I’ve read claims that AI queries require a lot of energy. Today I heard another claim on the Nerdland Podcast (a popular science podcast here in Belgium): “letting ChatGPT write an email of 100 words requires 70 Wh” (if you’re interested, that’s said at 00:28:05 in this episode). I though to myself: that’s a lot of energy. 70 Wh is 252,000 Ws...

Sun Oct 6, 2024 22:17
Overview of Content Published in September

Content: Here is an overview of content I published in September: SANS ISC Diary entries: Wireshark 4.4: Converting Display Filters to BPF Capture Filters Protected OOXML Text Documents Python & Notepad++ Password Cracking & Energy: More Dedails Wireshark 4.4’s IP Address Functions YARA 4.5.2 Release YARA-X’s Dump...

Wed Oct 2, 2024 07:39
Overview of Content Published in September

Content: Here is an overview of content I published in September: SANS ISC Diary entries: Wireshark 4.4: Converting Display Filters to BPF Capture Filters Protected OOXML Text Documents Python & Notepad++ Password Cracking & Energy: More Dedails Wireshark 4.4’s IP Address Functions YARA 4.5.2 Release YARA-X’s Dump...

Wed Oct 2, 2024 02:59

Build your own newsfeed

Ready to give it a go?
Start a 14-day trial, no credit card required.

Create account