Superpower Daily

Main Email Body: ---------- ### **In today’s email:** * **🏎️ Meet Sohu, the fastest AI chip of all time.** * 🔥** Google brings its Gemini AI to Gmail to help you write and summarize emails** * 🤯** ‘No Bot is Themselves Anymore:’ Character AI Users Report Sudden Personality Changes to Chatbots** * 🧰** 10 new AI-powered tools and resources. Make sure to check the online version for the full list of tools.** -------------------- [Sign Up](https://www.superpowerdaily.com/subscribe) **|** [Advertise](https://www.passionfroot.me/superpower) **| **[Affiliate](https://spchatgpt.com/affiliate) | [Read Online](https://www.superpowerdaily.com/p/341-high-performing-language-models-on-the-energy-of-a-lightbulb) -------------------- View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/bc376aa0-6b65-4149-94fc-a8c34537e5c6/Screenshot_2024-06-22_at_9.25.05_AM-removebg-preview.png?t=1719073519) Follow image link: (https://www.vpdae.com/redirect/w814a6u3sot6glerdcj6o9n5ezi) Caption: -------------------- View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/0bd15892-19c0-4833-ad47-2f78974b185a/divider.png) Caption: -------------------- View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/5af58b69-a03a-412f-b5cd-1b16c85b4158/ezgif.com-gif-maker__5_.gif) [Top News] Caption: ----------## [_Researchers power high-performing language models on the energy of a lightbulb by eliminating matrix multiplication._](https://arstechnica.com/information-technology/2024/06/researchers-upend-ai-status-quo-by-eliminating-matrix-multiplication-in-llms/) View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/4f06b1d7-d836-4970-93c7-8c88a9b68925/matmul-free-chart-640x603.jpg?t=1719379401) Caption: Researchers from the University of California Santa Cruz, UC Davis, LuxiTech, and Soochow University have developed a new method to run AI language models without matrix multiplication, potentially reducing power consumption and reliance on GPUs. Detailed in a recent preprint paper, their approach involves creating a custom language model using ternary values and a new computational mechanism called a MatMul-free Linear Gated Recurrent Unit (MLGRU). This redesign allows the models to operate efficiently on simpler hardware like FPGA chips, drastically cutting energy use compared to traditional models that rely heavily on GPUs. The researchers compared their MatMul-free model to a conventional Llama-2-style model across several benchmarks, demonstrating competitive performance with significantly lower power consumption and memory usage. Their optimized implementation showed up to a 61 percent reduction in memory consumption during training. Although the current models, with up to 2.7 billion parameters, are not as complex as state-of-the-art models like GPT-4, the study's findings suggest that scaling up the MatMul-free approach could yield similar or even superior performance levels with fewer resources. This innovation could have profound implications for the accessibility and sustainability of AI technology, particularly for deployment on resource-constrained hardware such as smartphones. The researchers believe that with further development and investment, their method could support the creation of large-scale, high-performance language models that are both energy-efficient and cost-effective. ——————————————————————————— ## _[Harness your data for holistic customer journeys](https://www.vpdae.com/redirect/w814a6u3sot6glerdcj6o9n5ezi)_ View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/fe477d69-3061-4032-a144-e0ec5050d14f/ultimate-checklist-better-digital-experiences-paved.png?t=1719072965) Follow image link: (https://www.vpdae.com/redirect/w814a6u3sot6glerdcj6o9n5ezi) Caption: The key to delivering better digital experiences? It’s a unified, end-to-end view of your customer journey—and your ability to turn data into actionable insights. Dig into [Amplitude](https://www.vpdae.com/redirect/w814a6u3sot6glerdcj6o9n5ezi)'s guide to delivering better digital experiences to learn how to: * Assess and build your data strategy. * Establish a single source of truth and democratize data. * Build a solid foundation for AI adoption. Get the Guide (https://www.vpdae.com/redirect/w814a6u3sot6glerdcj6o9n5ezi) ——————————————————————————— ## [_Meet Sohu, the fastest AI chip of all time._](https://www.etched.com/) View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/9d454750-f471-4121-9c2c-27d4e5501d9f/Screenshot_2024-06-25_at_10.30.48_PM.png?t=1719379861) Caption: Etched, a promising startup founded by Harvard dropouts Gavin Uberti and Chris Zhu, is developing a unique AI chip called Sohu, designed specifically for running transformer models. Unlike general-purpose GPUs, Sohu, an application-specific integrated circuit (ASIC) built using TSMC’s 4nm process, delivers superior inferencing performance while consuming less energy. Uberti claims that one Sohu server can replace 160 Nvidia H100 GPUs, making it a faster, cheaper, and more environmentally friendly option for businesses needing specialized AI chips. Etched's focus on transformers, a dominant model architecture in generative AI, sets it apart from competitors. Transformers are the backbone of many advanced AI models, including OpenAI’s video-generating Sora and Google’s text-generating Gemini. By eliminating unnecessary hardware and software components, Sohu achieves streamlined performance and efficiency. Etched's approach has attracted significant investment, with the company recently closing a $120 million Series A funding round, bringing their total funding to $125.36 million. Despite the competitive AI chip market and the potential for transformers to be surpassed by new models, Etched remains optimistic. The company plans to launch the Sohu Developer Cloud to allow customers to preview the chip’s capabilities, aiming to drive further sales. With unnamed customers already reserving millions in hardware, Etched hopes to carve out a significant niche in the AI chip industry. However, the challenges faced by previous AI chip startups highlight the uncertainties and high stakes in this rapidly evolving field. ——————————————————————————— ## [_OpenAI delays ChatGPT’s new Voice Mode_](https://techcrunch.com/2024/06/25/openai-delays-chatgpts-new-voice-mode/) View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/d6e6c6ac-d58f-4a0d-9d77-3c5d99e4c01c/openai-event-math.jpg?t=1719379051) Caption: In May, OpenAI showcased a highly realistic "advanced voice mode" for its ChatGPT platform, promising a rollout to paying users within weeks. However, the launch has been delayed due to ongoing issues. OpenAI announced on its Discord server that the release, initially planned for late June, is now postponed to July. They are focusing on enhancing the model’s content detection capabilities and preparing infrastructure to handle real-time responses at scale. The new Voice Mode might not be available to all ChatGPT Plus users until the fall, pending internal safety and reliability checks. This delay does not impact the rollout of other new features, such as video and screen sharing, demonstrated at OpenAI’s spring event. These features, including solving math problems from images and explaining device settings, are now accessible on both smartphone and desktop clients. OpenAI's Voice Mode, which can understand and convey emotions, sparked controversy due to the default "Sky" voice resembling actress Scarlett Johansson's. Johansson's legal team is investigating the voice's development after she declined OpenAI's licensing offers. OpenAI has since removed the voice, denying unauthorized use or employing a soundalike. ——————————————————————————— ### Other stuff * Microsoft’s [Mustafa Suleyman says he loves Sam Altman](https://techcrunch.com/2024/06/25/microsofts-mustafa-suleyman-says-he-loves-sam-altman-believes-hes-sincere-about-ai-safety/), believes he’s sincere about AI safety * ‘No Bot is Themselves Anymore:’ [Character AI Users Report Sudden Personality Changes to Chatbots](https://www.404media.co/character-ai-chatbot-changes-filters-roleplay/) * [Google brings its Gemini AI to Gmail](https://techcrunch.com/2024/06/25/google-brings-its-gemini-ai-to-gmail-via-a-sidebar-that-can-help-you-write-and-summarize-emails/) to help you write and summarize emails * Reddit’s upcoming changes attempt to [safeguard the platform against AI crawlers](https://techcrunch.com/2024/06/25/reddits-upcoming-changes-attempt-to-safeguard-the-platform-against-ai-crawlers/) * [Political deepfakes](https://www.ft.com/content/8d5bc867-c69d-44df-839f-d43c92785435) top list of malicious AI use, DeepMind finds * [Stability AI lands a lifeline](https://techcrunch.com/2024/06/25/stability-ai-lands-a-lifeline-from-sean-parker-greycroft/) from Sean Parker, Greycroft ——————————————————————————— Win 1 year free Superpower ChatGPT Pro🤑 (https://www.superpowerdaily.com/p/win-1-year-free-pro-subscription-to-superpower-chatgpt) ---------- ### All your ChatGPT images in one place 🎉 **You can now search for images, see their prompts, and download all images in one place.** View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/ff3f7e98-378b-4e08-8dbb-08bf3ba65415/Screenshot_2023-12-11_at_11.57.55_AM.png?t=1702529359) Caption: -------------------- Get the extension for FREE (https://spchatgpt.com/) ----------View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/0bd15892-19c0-4833-ad47-2f78974b185a/divider.png) Caption: ---------- View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/7b8cd414-f6ee-4d9b-9aba-acaf6e06ee96/ezgif.com-gif-maker__7_.gif) [Tools & LinkS] Caption: -------------------- [Govly](https://www.govly.com/) is the AI-powered intelligence and capture platform for public sector procurement. -------------------- View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/96d41f31-3cee-4a4a-a86c-863ff49faa6a/Screenshot_2024-06-25_at_10.17.01_PM.png?t=1719379027) Caption: -------------------- [ControlFlow](https://github.com/PrefectHQ/ControlFlow) is a Python framework for building agentic AI workflows. -------------------- View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/2ee29576-b20f-44c6-99e5-471a574d8c30/Screenshot_2024-06-25_at_9.34.21_PM.png?t=1719376465) Caption: -------------------- [Created by Humans](https://www.createdbyhumans.ai/) helps people license their creative work to AI models -------------------- View image: (https://techcrunch.com/wp-content/uploads/2024/06/CBH_PressImages_R3-03-1.png?w=1024) Caption: -------------------- [Dot by New Computer](https://new.computer/) - A living AI journal that talks back -------------------- View image: (https://ph-files.imgix.net/57aa1f48-7b73-4c9e-960f-73d50116f364.png?auto=compress&codec=mozjpeg&cs=strip&auto=format&fm=pjpg&w=1100&h=611&fit=max) Caption: -------------------- View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/31a679dd-a769-459c-9d49-f384839f1e32/ezgif.com-gif-maker__4_.gif) [See today's full list of tools] Follow image link: (https://www.superpowerdaily.com/p/341-high-performing-language-models-on-the-energy-of-a-lightbulb) Caption: There are 6 more tools we couldn’t fit into this email ➜ ——————————————————————————— -------------------- ### Unclassified 🌀 * [WFH Team](https://wfh.team/) - Work from anywhere in the world * [Add your link here ➜](https://www.passionfroot.me/superpower) View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/81444009-06bf-4bc8-803f-0059c3ac21c9/Screenshot_2024-06-22_at_9.34.21_AM.png?t=1719074069) Caption: ----------View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/1eaf32c4-1400-40e3-b86d-9dca4b351a09/divider.png) Caption: ---------- # Help share Superpower -------------------- **⚡️ Be the Highlight of Someone's Day - **Think a friend would enjoy this? Go ahead and forward it. They'll thank you for it! SHARE VIA EMAIL (mailto:?subject=Best AI newsletter you can find!&body=Hey,%0DI've been reading Superpower, and definitely think you’d like it as well. It has the most up-to-date AI-related news, resources, tools, tips, and more. It takes me 5 minutes to read it every morning, and there are always at least a few interesting links in there for me. They have over 230,000+ subscribers. Check it out here: https://superpowerdaily.com) ----------——————————————————————————— Hope you enjoyed today's newsletter ---------- Follow me on [Twitter](https://twitter.com/eeeziii) and [Linkedin](https://www.linkedin.com/in/saeedezzati/) for more AI news and resources. -------------------- Did you know you can add Superpower Daily to your RSS feed [https://rss.beehiiv.com/feeds/GcFiF2T4I5.xml](https://rss.beehiiv.com/feeds/GcFiF2T4I5.xml) ----------⚡️ Join over 200,000 people using the **Superpower ChatGPT** extension on **Chrome** and **Firefox**. Download Superpower ChatGPT for Free (https://spchatgpt.com/) OR Join our Affiliate Program 🤑 (https://spchatgpt.com/affiliate) ---------- View image: (https://media.beehiiv.com/cdn-cgi/image/fit=scale-down,format=auto,onerror=redirect,quality=80/uploads/asset/file/73ebcf4e-42c5-49b7-8847-2ea177cde8d5/giphy.gif) Follow image link: (https://www.buymeacoffee.com/ezii) Caption: ---------- ——— You are reading a plain text version of this post. For the best experience, copy and paste this link in your browser to view the post online: https://www.superpowerdaily.com/p/341-high-performing-language-models-on-the-energy-of-a-lightbulb _________________ ARPro Mail Assistance : ### Summary of Email: "High-performing language models on the energy of a lightbulb" **Critical Technical Details:** 1. **Sohu AI Chip:** - Developed by Etched, this ASIC is designed for transformer models. - Superior inferencing performance with less energy consumption. - Potential to replace 160 Nvidia H100 GPUs per Sohu server. - $120 million Series A funding secured. 2. **MatMul-free AI Models:** - Developed by researchers from UC Santa Cruz, UC Davis, LuxiTech, and Soochow University. - Eliminates matrix multiplication, reducing power consumption and GPU reliance. - Uses ternary values and MatMul-free Linear Gated Recurrent Unit (MLGRU). - Up to 61% reduction in memory consumption during training. - Potential for large-scale, high-performance models on simpler hardware like FPGA chips. 3. **Google Gemini AI:** - Integrated into Gmail for writing and summarizing emails. - Enhances email management efficiency. 4. **OpenAI Voice Mode Delay:** - Delayed to July, impacting the rollout to ChatGPT Plus users. - Focus on enhancing content detection and real-time response capabilities. **Immediate Actions Needed:** 1. **Evaluate Sohu AI Chip:** - Assess potential integration into current infrastructure. - Consider energy savings and performance benefits. 2. **Review MatMul-free AI Models:** - Explore feasibility for deployment on resource-constrained hardware. - Evaluate potential for operational efficiency improvements. 3. **Monitor Google Gemini AI:** - Assess impact on email management processes. - Plan for potential integration to improve operational efficiency. 4. **Prepare for OpenAI Voice Mode:** - Monitor updates and prepare infrastructure for potential integration. - Evaluate implications of delayed rollout on current operations. **Urgent Issues:** - No immediate urgent issues identified, but the delayed rollout of OpenAI’s Voice Mode may impact planned upgrades or integrations. ### Draft Response --- **Subject:** Re: High-performing language models on the energy of a lightbulb Dear Superpower Daily Team, Thank you for the detailed update in today's newsletter. The information provided is invaluable for our operational planning and efficiency improvements. 1. **Sohu AI Chip:** - We are keen to explore the integration of the Sohu AI chip into our infrastructure. The potential energy savings and performance enhancements are significant. We will initiate a feasibility study and reach out to Etched for further details. 2. **MatMul-free AI Models:** - The development of MatMul-free AI models is particularly intriguing. We will review the preprint paper and assess