Nvidia Tesla M10 - good for anything? : r/homelab - Reddit
Nov 16, 2023 · So they have a decent amount of vram. You could look and see how well that chip architecture does with ML/AI workloads. I recently bought an A6000 to run local LLMs (think chatgpt). If you want more resources on it, check out r/localllama
My results using a Tesla P40 : r/LocalLLaMA - Reddit
May 20, 2023 · Product Type: Data Center / Tesla Product Series: P-Series Product: Tesla P40 Operating System: Windows 11 CUDA Toolkit: Any Language: English (US) This should bring you to a single download of the 528.89 drivers with a release date of 2023.3.30. I ended up doing the CUDA toolkit separate as a just-in-case (knowing how finnicky llama can be)
Regarding NVIDIA TESLA M40 (24GB), is it the same as an RTX
Mar 7, 2023 · A new card like a 4090 or 4090 24GB is useful for things other than AI inference, which makes them a better value for the home gamer. The software for doing inference is getting a lot better, and fast. Now there are ways to run AI inference at 8-bit (int8) and 4-bit (int4).
Elon Musk Unveils Tesla AI5: 10x Power by 2025 : r/teslamotors
Jun 21, 2024 · Tesla Inc. is an energy + technology company originally from California and currently headquartered in Austin, Texas. Their mission is to accelerate the world's transition to sustainable energy. They produce vertically integrated electric vehicles, batteries, solar, and AI software and hardware solutions.
Tesla's AI Day - Event Megathread! : r/teslamotors - Reddit
Aug 19, 2021 · Tesla Inc. is an energy + technology company originally from California and currently headquartered in Austin, Texas. Their mission is to accelerate the world's transition to sustainable energy. They produce vertically integrated electric vehicles, batteries, solar, and AI software and hardware solutions.
Nvidia Tesla P40 performs amazingly well for llama.cpp GGUF!
Nov 20, 2023 · The Tesla P40 is much faster at GGUF than the P100 at GGUF. At a rate of 25-30t/s vs 15-20t/s running Q8 GGUF models. Possibly because it supports int8 and that is somehow used on it using its higher CUDA 6.1.
Tesla P40 24GB for possible local AI server build. : r/nvidia - Reddit
Mar 5, 2023 · Tesla P40 24GB for possible local AI server build. Question I’m looking for some advice about possibly using a Tesla P40 24GB in an older dual 2011 Xeon server with 128GB of ddr3 1866mhz ecc, 4x PCIE 3.0 16x lanes, 4GB decoding, to locally host a 8bit 6B parameter AI chatbot as a personal project.
Tesla AI Day 2022 : r/teslamotors - Reddit
Welcome to Tesla's AI Day 2022! This is Tesla's second event related to Tesla's long-term AI efforts. Event Times 5pm - 11pm PT // 8pm-2am ET // 12am-6am UTC Find your local time. Live Links YouTube Livestream Discord Live Chat (Discord.gg/Tesla) - AI Day Stage Live Comment Stream of this thread by Reddit-Stream AI Day 2021 - Related Links
Nvidia Tesla P4 vs P40 : r/LocalLLaMA - Reddit
I stumbled upon a X post from JosephJacks_ on SaaS based Mixtral API. Which compared openrouter.ai (which was briefly free), Mistral API itself, TogetherCompute, Abacus.ai, Finally landed at DeepInfra which is priced at 27 cents per million tokens. Same tests I've been running on the Tesla GPUs was 31 tokens/s on Deepinfra.
Layman's Explanation of Tesla AI Day : r/teslamotors - Reddit
Tesla effectively has 1M+ mobile Tesla AI chips available at its disposal to do this kind of training. Thinking about it in these terms, Tesla has by far the biggest AI supercomputer on the planet. OK, with that as background, let's get to how the Tesla NN actually works.