Write to us
enquiry@myfinb.com

Samsung HBM-PIM brings AI computing capabilities inside high-performance memory

"Samsung announced that it has developed the industry’s first High Bandwidth Memory (HBM) integrated with artificial intelligence (AI) processing power — the HBM-PIM. The new processing-in-memory (PIM) architecture brings powerful AI computing capabilities inside high-performance memory, to accelerate large-scale processing in data centers, high performance computing (HPC) systems and AI-enabled mobile applications."

Samsung announced that it has developed the industry’s first High Bandwidth Memory (HBM) integrated with artificial intelligence (AI) processing power — the HBM-PIM. The new processing-in-memory (PIM) architecture brings powerful AI computing capabilities inside high-performance memory, to accelerate large-scale processing in data centers, high performance computing (HPC) systems and AI-enabled mobile applications.

Kwangil Park, senior vice president of Memory Product Planning at Samsung Electronics stated, “Our groundbreaking HBM-PIM is the industry’s first programmable PIM solution tailored for diverse AI-driven workloads such as HPC, training and inference. We plan to build upon this breakthrough by further collaborating with AI solution providers for even more advanced PIM-powered applications.”

Rick Stevens, Argonne’s Associate Laboratory Director for Computing, Environment and Life Sciences commented, “I’m delighted to see that Samsung is addressing the memory bandwidth/power challenges for HPC and AI computing.

HBM-PIM design has demonstrated impressive performance and power gains on important classes of AI applications, so we look forward to working together to evaluate its performance on additional problems of interest to Argonne National Laboratory.”

Most of today’s computing systems are based on the von Neumann architecture, which uses separate processor and memory units to carry out millions of intricate data processing tasks.

This sequential processing approach requires data to constantly move back and forth, resulting in a system-slowing bottleneck especially when handling ever-increasing volumes of data.

Instead, the HBM-PIM brings processing power directly to where the data is stored by placing a DRAM-optimized AI engine inside each memory bank — a storage sub-unit — enabling parallel processing and minimizing data movement.

When applied to Samsung’s existing HBM2 Aquabolt solution, the new architecture is able to deliver over twice the system performance while reducing energy consumption by more than 70%. The HBM-PIM also does not require any hardware or software changes, allowing faster integration into existing systems.

Samsung’s paper on the HBM-PIM has been selected for presentation at the renowned International Solid-State Circuits Virtual Conference (ISSCC) held through Feb. 22. Samsung’s HBM-PIM is now being tested inside AI accelerators by leading AI solution partners, with all validations expected to be completed within the first half of this year.

 

Source: HelpNetSecurity

Share:

Share on facebook
Facebook
Share on twitter
Twitter
Share on linkedin
LinkedIn
Share on telegram
Telegram
Share on whatsapp
WhatsApp
Share on email
Email

AI Blog – Latest news on Artificial Intelligence and its applications on the globe. 

Browse more

Related Posts

Board Directors Can Do More With AI

Corporate governance is an evolving area that changes with policy matters and economic reforms in a country. There is notably an increasing pressure on the board of directors and management to implement policies; while maintaining a healthy culture and good corporate governance responsibility across the organisation.

Read More »

New Way Forward to Formulate Strategic Plans

The Centre for AI Innovation (CEAI), the social innovation arm of MyFinB Group, has launched a series of capacity building programme to help diverse types of organisations with strategic planning, using AI. This was implemented in view of the volatility of the business environment that causes many organisations to adopt reactive strategies rather than proactive ones. However, reactive strategies or “fire-fighting” are typically only viable as a short-term solution, even though they may require spending significant resources and time to execute them.

Read More »

Professional Firms Get AI Boost for their Clients

InfoTrust, a Singapore-based, award-winning ICT company, is embarking on a journey to build internal competencies in AI to disrupt traditional professional services such as corporate reporting solutions. The primary goal is for InfoTrust to build a suite of AI solutions using predictive and prescriptive analytics, to boost its existing suite of solutions for the Singapore market as a start.

Read More »