{"id":1162418,"date":"2023-07-18T23:00:00","date_gmt":"2023-07-19T03:00:00","guid":{"rendered":"https:\/\/www.prime-wow.com\/?p=1162418"},"modified":"2023-07-18T23:00:00","modified_gmt":"2023-07-19T03:00:00","slug":"samsung-completes-initial-gddr7-development-first-parts-to-reach-up-to-32gbps-pin","status":"publish","type":"post","link":"https:\/\/www.prime-wow.com\/?p=1162418","title":{"rendered":"Samsung Completes Initial GDDR7 Development: First Parts to Reach Up to 32Gbps\/pin"},"content":{"rendered":"

\"\"<\/a><\/p>\n

\n

Samsung has announced this evening that they have completed development on their first generation of GDDR7 memory. The next iteration of the high bandwidth memory technology, which has been under industry-wide development, is expected to hit the market in 2024, with Samsung in prime position to be one of the first memory vendors out of the gate. With their first generation of GDDR7 parts slated to hit up to 32Gbps\/pin of bandwidth \u2013 33% more than their best GDDR6 parts today \u2013 the company is looking to deliver a sizable increase in GDDR memory bandwidth on the back of the technology\u2019s adoption of PAM-3 signaling.<\/p>\n


\n <\/p>\n

Samsung\u2019s announcement comes as we\u2019ve been seeing an increase in disclosures and announcements around the next iteration of the widely-used memory technology. While a finished specification for the memory has yet to be released by JEDEC, Samsung rival Micron has previously announced that it plans to introduce its own GDDR7 memory in 2024<\/a> \u2013 a similar timeline as to Samsung\u2019s current schedule. Meanwhile, EDA tool firm Cadence disclosed a significant amount of technical details earlier this year as part of announcing their GDDR7 verification tools, revealing that the memory would use PAM-3 signaling and reach data rates of up to 36Gbps\/pin<\/a>.<\/p>\n


\n <\/p>\n

With today\u2019s announcement, Samsung has become the first of the major memory manufacturers to publicly announce that they\u2019ve completed development of their first generation of GDDR7. And while the company tends to make these sorts of memory announcements relatively early in the bring-up process \u2013 well before memory is ready for commercial mass product \u2013 it\u2019s none the less an important milestone in the development of GDDR7, as it means that memory and device manufacturers can begin validation work against functional hardware. As for Samsung itself, the announcement gives the Korean conglomerate a very visible opportunity to reinforce their claim of leadership within the GDDR memory industry.<\/p>\n


\n <\/p>\n

Besides offering an update on the development process for GDDR7, Samsung\u2019s announcement also provides some high-level technical details about the company\u2019s first generation of GDDR7 \u2013 though \u201chigh-level\u201d is the operative word as this is not by any means a technical deep dive.<\/p>\n


\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n <\/p>\n
GPU Memory Math<\/td>\n


\n\t\t<\/tr>\n

<\/p>\n

\u00a0<\/td>\n

<\/p>\n

GDDR7<\/td>\n

<\/p>\n

GDDR6X<\/td>\n

<\/p>\n

GDDR6<\/td>\n


\n\t\t<\/tr>\n

<\/p>\n

B\/W Per Pin<\/td>\n

<\/p>\n

32 Gbps (Projected)<\/td>\n

<\/p>\n

24 Gbps (Shipping)<\/td>\n

<\/p>\n

24 Gbps (Sampling)<\/td>\n


\n\t\t<\/tr>\n

<\/p>\n

Chip Density<\/td>\n

<\/p>\n

2 GB (16 Gb)<\/td>\n

<\/p>\n

2 GB (16 Gb)<\/td>\n

<\/p>\n

2 GB (16 Gb)<\/td>\n


\n\t\t<\/tr>\n

<\/p>\n

Total B\/W (256-bit bus)<\/td>\n

<\/p>\n

1024 GB\/sec<\/td>\n

<\/p>\n

768 GB\/ssec<\/td>\n

<\/p>\n

768 GB\/ssec<\/td>\n


\n\t\t<\/tr>\n

<\/p>\n

DRAM Voltage<\/td>\n

<\/p>\n

?<\/td>\n

<\/p>\n

1.35 V<\/td>\n

<\/p>\n

1.35 V<\/td>\n


\n\t\t<\/tr>\n

<\/p>\n

Data Rate<\/td>\n

<\/p>\n

QDR<\/td>\n

<\/p>\n

QDR<\/td>\n

<\/p>\n

QDR<\/td>\n


\n\t\t<\/tr>\n

<\/p>\n

Signaling<\/td>\n

<\/p>\n

PAM-3<\/td>\n

<\/p>\n

PAM-4<\/td>\n

<\/p>\n

NRZ (Binary)<\/td>\n


\n\t\t<\/tr>\n

<\/p>\n

Packaging<\/td>\n

<\/p>\n

266 FBGA<\/td>\n

<\/p>\n

180 FBGA<\/td>\n

<\/p>\n

180 FBGA<\/td>\n


\n\t\t<\/tr>\n


\n\t<\/tbody>\n


\n<\/table>\n


\n <\/p>\n

According to Samsung\u2019s announcement, they\u2019re expecting to reach data rates as high as 32Gbps\/pin. That\u2019s 33% higher than the 24Gbps data rate the company\u2019s top GDDR6 products can hit today. Samsung and Cadence have both previously disclosed that they expect GDDR7 memory to eventually hit 36Gbps\/pin, though as with the development of GDDR6 \u2013 a full 50% faster than GDDR6 \u2013 this is likely going to take multiple generations of products.<\/p>\n


\n <\/p>\n

Interestingly, this is starting much closer to projected limits of GDDR7 than we\u2019ve seen in past generations of the memory technology. Whereas GDDR6 launched at 14Gbps and eventually scaled up to 24Gbps, Samsung wants to start at 32Gbps. At the same time, however, GDDR7 is going to be a smaller generational leap than we saw for GDDR6 or GDDR5; rather than doubling the signaling bandwidth of the memory technology over its predecessor, GDDR7 is only a 50% increase, owing to the switch from NRZ (2 state) signaling to PAM-3<\/a> (3 state) signaling.<\/p>\n


\n <\/p>\n

It\u2019s also worth noting that, at present, the fastest GDDR6 memory we see used video cards is only running at 20Gbps.Samsung\u2019s own 24Gbps GDDR6, though announced just over a year ago, is still only \u201csampling\u201d at this time. So the multitude of other GDDR6-using products notwithstanding, the effective jump in bandwidth for video cards in 2024\/2025 could be more significant, depending on just what speed grades are available at the time.<\/p>\n


\n <\/p>\n

As for capacity, Samsung\u2019s first GDDR7 chips are 16Gb, matching the existing density of today\u2019s top GDDR6(X) chips. So memory capacities on final products will not be significantly different from today\u2019s products, assuming identical memory bus widths. DRAM density growth as a whole has been slowing over the years due to scaling issues, and GDDR7 will not be immune to that.<\/p>\n


\n <\/p>\n

Samsung is also claiming that their GDDR7 technology offers a \u201c20%-improvement in power efficiency versus existing 24Gbps GDDR6 DRAM,\u201d though this is a broad claim where the devil is in the details. As power efficiency for DRAM is normally measured on a per-bit basis (picojoules-per-bit\/pJpb), then our interpretation is that this is the figure Samsung is referencing in that claim. But whether that measurement is being made at 24Gbps (iso-bandwidth) or 32Gbps remains unclear.<\/p>\n


\n <\/p>\n

Either way, the good news is that Samsung\u2019s GDDR7 is slated to deliver a tangible increase in energy efficiency. But at only a 20% improvement in energy efficiency for a memory technology that is delivering up to 33% more bandwidth, this means that the absolute power consumption of the memory is going up versus the previous generation<\/b>. Assuming Samsung\u2019s energy efficiency figures are for GDDR7@32Gbps versus GDDR6@24Gbps, then we\u2019d be looking at around a 7% increase in total energy consumption. Otherwise, if it\u2019s at iso-bandwidth, then the increase in power consumption at full bandwidth could be much higher, depending on just what Samsung\u2019s voltage\/frequency curve comes out to.<\/p>\n


\n <\/p>\n

Broadly speaking, this is the same outcome as we saw with the introduction of GDDR6(X), where despite the energy efficiency gains there, overall power consumption increased from one generation to the next, as energy efficiency gains are not keeping pace with bandwidth demands. Not to say that any of this is unexpected, but it means that good cooling will be even more critical for GDDR7 memory.<\/p>\n


\n <\/p>\n

But for clients with strict power\/cooling needs, Samsung is also announcing that they will be making a low-voltage version of their GDDR7 memory available. The company has not disclosed the nominal voltage of their GDDR7, or of its low-voltage counterpart, but we\u2019d expect to see Samsung using the same chips clocked lower in exchange for a lower operating voltage, similar to low-voltage GDDR6.<\/p>\n


\n <\/p>\n

\"\"<\/a><\/p>\n


\n <\/p>\n

Also missing from Samsung\u2019s disclosure is anything on the fab process they\u2019re using to produce the new memory. The company\u2019s most recent GDDR6 uses their D1z process, while a recent DDR5 memory announcement from Samsung<\/a> has them using their 12nm (D1b?) there. Even if we don\u2019t know the specific node in use, Samsung is almost certainly using a newer node for GDDR7. Which means that at least some of the 20% energy efficiency gains from GDDR7 are going to be a product of the newer node, rather than intrinsic efficiency improvements from GDDR7.<\/p>\n


\n <\/p>\n

Though Samsung certainly has been working on those, as well. While again quite light in details, the company notes that their GDDR7 memory employs \u201cIC architecture optimization\u201d to keep power and heat generation in check.<\/p>\n


\n <\/p>\n

Electronics production aside, the final major innovation with Samsung\u2019s GDDR7 will be decidedly physical: epoxy. Clearly mindful of the already high heat loads generated by existing GDDR memory clocked at its highest speeds, Samsung\u2019s press release notes that they\u2019re using a new epoxy molding compound (EMC) for GDDR7, which is designed to better transfer heat. All told, Samsung is claiming a 70% reduction in thermal resistance versus their GDDR6 memory, which should help ensure that a good cooler can still pull enough heat from the memory chips, despite the overall increase in heat generation.<\/p>\n


\n <\/p>\n

Wrapping things up, now that initial development on their GDDR7 memory has been completed, Samsung is moving on to verification testing with their partners. According to the company, they\u2019ll be working with key customers on verification this year; though at this point, the company isn\u2019t saying when they expect to kick off mass production of the new memory.<\/p>\n


\n <\/p>\n

Given the timing of Samsung\u2019s announcement (as well as Micron\u2019s), the initial market for GDDR7 seems to be AI and networking accelerators, rather than the video cards that GDDR7 gets its name from. With both AMD and NVIDIA barely a quarter of the way through their current architectural release cycles, neither company is likely be in a position to use GDDR7 in 2024 when it\u2019s ready. Instead, it\u2019s going to be the other users of GDDR memory such as networking products and high-performance accelerators that are likely to be first to use the technology.<\/p>\n


\n <\/p>\n

\n

Gallery: Samsung GDDR7 Chip Renders<\/a><\/p>\n
<\/a><\/a><\/a><\/div>\n<\/div>\n


\n
\n
\nSource: AnandTech – Samsung Completes Initial GDDR7 Development: First Parts to Reach Up to 32Gbps\/pin<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Samsung has announced this evening that they have completed development on their first generation of GDDR7 memory. The next iteration of the high bandwidth memory technology, which has been under industry-wide development, is expected to hit the market in 2024, … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":1162419,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[93,110],"tags":[94],"class_list":["post-1162418","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-anandtech","category-unfiltered-rss","tag-anandtech"],"_links":{"self":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1162418","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1162418"}],"version-history":[{"count":0,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1162418\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/media\/1162419"}],"wp:attachment":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1162418"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1162418"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1162418"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}