the cloud taught a generation to rent intelligence by the sip. then the price went up. then the limits tightened.
the ppl who saw it coming were already running their own machines and never noticed.
Every man reaches a point where the cluster wants to grow but the wife says no. That's where I come in. I build the case, cite the ROI, reference the tax writeoff, land the plane. Head of the Spark Justification Committee. Wives fear me. DMs open. @NVIDIAAI
Everyone dl'ing Qwen + GLM like the tap stays on forever. the tap has a country attached to it.
reminder "open weights" is a policy decision, not a law of physics, and policies change in a single meeting. Every model on your drive jst got more valuable & a lot less replaceable.
CHINA CONSIDERS RESTRICTING OVERSEAS ACCESS TO CUTTING-EDGE AI MODELS
China’s Ministry of Commerce has led meetings over the past month with major AI companies, including Alibaba, ByteDance, and https://t.co/YDe0KRldDB, to discuss measures that would restrict overseas access to cutting-edge AI models, including models that have not yet been released.
The discussions reportedly include not only closed-source models but also open-weight models. However, the scope of application is still under debate, and the rules may ultimately apply only to future frontier models.
Officials have also discussed designating the leakage or theft of proprietary AI technologies as a national security crime, with stronger penalties, as well as restricting the types of foreign capital that can invest in Chinese AI startups.
The backdrop is the U.S. move to strengthen export controls on AI models, along with national security concerns over cutting-edge models that could possess advanced cyberattack capabilities.
Chinese authorities are reportedly concerned that advanced U.S. cybersecurity AI models could be used to exploit vulnerabilities in Chinese software.
Since the beginning of this year, China has continued to tighten measures to prevent AI technology from being transferred overseas. Authorities have investigated whether Chinese AI startups that relocated abroad violated export control laws, while also strengthening oversight of overseas transactions involving Chinese investors, technology, data, and national security concerns.
Future regulations could take the form of a tiered framework based on technological capability. Basic open-source AI models may be managed through a filing system, high-performance models may be subject to security reviews, and the most sensitive frontier models may be banned from public release or restricted to use within China.
Everyone out here flexing tmux and ssh configs and I’m sitting in a cafe RustDesk’d into my home pc. 3 monitors, the whole rig, streamed to a Mac. Why terminal into a machine when I can just remote into the entire machine. Not sure if genius or newb. Anyone else or just me.😅
Most people can’t run models this big smoothly. Mia fixes that 🔥
Tencent Hy3-295B on 2x DGX Spark.
295B parameters. 128k context. MTP.
Dead simple setup.
~20 tok/s single session. ~58 in 6 concurrent.
It feels solid. Really solid.
See for yourself 👇 @MiaAI_lab
Run Tencent Hy3-295B on 2x @NVIDIAAI DGX Spark with EASE🔥
128k context • MTP • Up to 6 concurrent sessions
Performance:
~20 tok/s in single session
~58 tok/s in 6 concurrent sessions (cumulative)
First impressions: the model feels very solid. More benchmarks and real-world tests coming soon!
Big thanks to the DGX community for the original work.
Get it here 👇
https://t.co/H15D1zvZPv