Building data centre infrastructure for flourishing Generative AI IN ASSOCIATION WITH:
DIGITAL REPORT 2024
IN ASSOCIATION WITH:
BUILDING DATA CENTRE INFRASTRUCTUR FOR FLOURISHIN GENERATIVE AI WRITTEN BY: TOM SWALLOW PRODUCED BY: LEWIS VAUGHAN
2
taigacloud.com
TAIGA CLOUD
RE NG
taigacloud.com
3
TAIGA CLOUD
Managing Director of Taiga Cloud (part of The Northern Data Group) Karl Havard showcases the company’s clean-energypowered CSP offering for generative AI businesses
A
ll of this talk about technology evolution – artificial intelligence (AI) looming and companies building much more advanced solutions to natural digital transitions in the world – makes you wonder how companies can build the most intricate systems at such a fast rate. The development and operation of highly intelligent AI is reliant on significantly larger amounts of data, and the areas to process and store said data have their own operational challenges and carbon footprints to manage. For Taiga Cloud, It’s all in a day’s work to ensure that the latest digital projects are supported in a sustainable way: powered by clean energy and with minimal impact to the environment. Europe’s largest provider of cleanenergy-powered machine learning (ML) and artificial intelligence (AI) capacity was born out of German based Northern Data Group. Recognising the ever-growing demand for high-performance compute technology, the company foresaw the need for much more computing capacity to support Generative AI development and other associated technical revolutions. Having joined Northern Data in March 2023, Karl Havard, now Managing Director 4
taigacloud.com
taigacloud.com
5
“ We will provide a high level of managed services and expertise to support our customers as the market matures” KARL HAVARD
MANAGING DIRECTOR, TAIGA CLOUD
for Taiga Cloud (formerly Northern Data’s Cloud Solutions business) shared Aroosh Thillainathan’s vision to support growing trends and leverage the best technologies of its partners. “One thing that struck me when initially engaging with Aroosh and Northern Data Group was the vision and the opportunity to build a brand new type of cloud business specifically for Gen AI. Such opportunities don’t come along that often; it’s a hugely exciting one, and it made the decision to join Northern Data Group very easy,” says Havard. Taiga Cloud is supported by its sister business Ardent Data Centers; a key strategic 6
taigacloud.com
partner from a data-centre perspective, which was also born out of Northern Data to manage its own specific business area. Although Taiga operates worldwide, its heart lies within Europe, it is a European company, and has the ability to offer its customers true EU compliance and sovereignty. “We do have global customers, but our heart is in Europe. We’re building the largest estate of the latest Nvidia hardware, and this expansion will continue right through 2024, and beyond. The A6000 and A100s we already have, have been in place for two years, all now being used. For those that don’t know, the A100 is what ChatGPT was trained on,” says Havard as he demonstrates
TAIGA CLOUD
KARL HAVARD TITLE: MANAGING DIRECTOR COMPANY: TAIGA CLOUD INDUSTRY: DATA CENTRE Following years of experience creating cloud-based enterprise solutions with global hyper-scalers, Karl joined Northern Data Group to form Taiga Cloud in March 2023. Inspired by the vision to create a purpose built Generative AI Cloud, inside of Europe; one which could democratise access to GenAI compute power and to do so in a compliant and sustainable way. Karl brings a breadth of insight, experience and industry knowledge having previously worked for Amazon Web Services as Head of the EMEA Go-to-market for the AWS & Accenture Business Group. Prior to this, he previously led GFT Group’s awardwinning Google Cloud Alliance, was a Managing Partner for a middle tier consultancy and he has also worked for Google. Now nearly 30 years in the IT industry, Karl previously earned his stripes (literally) having served 10 years as an Electronic & Communications Engineer in the British Army. When Karl is not working towards shaping the future of open access to clean powered ML and AI compute capacity, he can be found at home with his wife, four daughters, three dogs and two Harley Davidsons, or at the King Power Stadium supporting his beloved Leicester City.
Bulk Data Centers: Compute power for the GenAI revolution As Generative AI projects arise, Bulk Data Centers commits to providing sustainable compute power to deliver for the latest technology developers.
Rob Elder Chief Commercial Officer Bulk Data Centers
customer technology configurations. “The biggest challenge is speed and a lack of final understanding of the customer’s technology,” says Elder. Addressing these challenges, Bulk
In an era where technology evolves at a
invests in standardising data centre designs and
breakneck pace, Bulk Data Centers, a subsidiary
infrastructure, aiming to anticipate customer needs
of the Norwegian Bulk Infrastructure Group, is a
and streamline implementation processes.
pioneering force – notably in the development of sustainable data centres to support large IT
This proactive approach is essential in
loads, such as the load required by generative
accommodating GenAI and high-performance
artificial intelligence (GenAI). Since 2006, Bulk has
computing (HPC). Elder emphasises Bulk’s reliance
delivered the digital infrastructure required for
on industry conversations, customer dialogues,
the rapid adoption of more intelligent systems,
and insights from manufacturers and original
which ultimately produce an abundance of
equipment manufacturers (OEMs). This combination
data for information business growth.
of experience and flexibility allows Bulk to pivot towards emerging needs, ensuring their data
Rob Elder, Chief Commercial Officer at Bulk,
centres remain relevant and cutting-edge.
shared insights into the company’s strategies, challenges, and partnerships, particularly
One of Bulk’s significant strategies includes building
highlighting its collaboration with Taiga Cloud,
for the future while considering the constant
which is a long-term partnership generating
technological evolution. Elder remarks, “We build
opportunities for next-level technology.
for a minimum of 15 years. The investment in data centres is significant, and future-proofing
Bulk specialises in industrial real estate, fiber
the real estate and infrastructure is essential.”
networks, and data centre services, navigating the
This foresight is evident in Bulk’s commitment
complex, evolving IT equipment and unpredictable
to accommodating future technology shifts, like
Bulk Data Centers delivers ultra-flexible, highly connected, and massively scalable data center and colocation solutions backed by personalized service - specialising in providing sustainable destinations for AI, HPC and Hyperscale workloads. Part of Bulk Infrastructure, the company is headquartered in Oslo, Norway with locations and offices in Norway and Denmark.
the increasing density of IT equipment and the
Elder’s insights reveal a company deeply attuned
likely transition to more liquid cooling methods.
to the rapid pace of technological change,
Sustainability is another cornerstone of Bulk’s
but with scale and long-term growth in mind.
philosophy, especially evident in its choice of
This brings together large land and power
Norway as a data centre hub. Elder explains:
infrastructure combined with high-capacity international fiber networks, and a connectivity
"In Europe, established data centre markets are quite constrained. Norway offers access to 100% renewable energy, significantly reducing potential carbon emissions."
ecosystem that further unlocks the potential for companies like Taiga to attract customers and grow. Bulk Data Centers emerges as a provider of data solutions, but also a strategic partner in navigating the complex landscape of modern computing and AI now and into the future.
This focus on environmental responsibility aligns with the growing demand for
The partnership with Taiga Cloud underscores
sustainable data solutions.
Bulk’s capability to meet evolving demands while upholding sustainability and operational
The partnership with Taiga Cloud exemplifies Bulk’s
efficiency. This approach positions Bulk at the
collaborative and forward-thinking approach.
forefront of the data centre industry, ready to face
Elder describes this relationship as centred
the challenges and opportunities of the future.
on transparency and collaboration, aimed at meeting ambitious timeframes and technology
Get in touch and find out more about how Bulk Data
requirements. “Our strategy is about being open,
Centers can support your workload requirements.
transparent, and collaborative,” he asserts. Through this partnership, Bulk and Taiga Cloud address sustainability objectives, optimise systems for efficiency, and plan for future scalability.
Learn more
“ We will always, wherever we build or whoever we partner with on the data-centre front, use 100% carbonneutral energy” KARL HAVARD
MANAGING DIRECTOR, TAIGA CLOUD
the significance of Taiga’s current footprint across Northern Europe. “We invested an initial €400m in June 2023, and boosted this with a further €320m in early December 2023 to expand our GenAI estate. We will be close to 20,000 GPUs of the latest H100s in 2024, The H100 being the machine that everybody in the industry is trying to get their hands on. Our first installation will be live at the end of 2023.” Building the compute power that GenAI developers need While this is good news for the startups and AI-powered businesses in Europe, there’s
TAIGA CLOUD
Use more image captions as often as possible
a high level of demand for the GPUs that Taiga Cloud needs to support a growing number of GenAI clients. Luckily for the company, its Elite Partnership with NVIDIA, the manufacturer of this hardware; as well as other strategic alliances with Hewlett Packard Enterprises (HPE) and Giga Computing Technology, has helped ensure Taiga Cloud are the first to market to deliver this highly sought after technology in Europe. Not only has this already built a concrete position for Taiga, it has also enabled the business to offer a tailored set of services to its clients in order for them to get the most out of the capacity that they adopt.
“One of our key values and beliefs is that, by building this in Europe, and on such a large scale, we have a duty to all types of organisations who want to use this technology to bring their best ideas to life. This includes the startup community, enterprises, research industries and even educational institutions. We are not going to sell out to one customer, despite having the opportunities to do so.” says Havard. But, what exactly does this mean? He explains further: “We want to democratise access to this computer power, which means we’ll offer portions of our estate to various different organisations to allow them to train, tune and infer their large language taigacloud.com
11
TAIGA CLOUD
models and to offer them the ability to roll-on and roll-off the platform to suit their needs.” Not only will such a model enable access to more businesses as and when they require Taiga’s service, but also encourage higher utilisation to reduce the impact from an environmental perspective. If customers can “roll-on and roll-off” as and when they need, then no power goes to waste. “The easy thing for us to do would be to sign massive three-year deals that utilise all of our estate capacity, but the reality is others are doing this in the marketplace,” says Havard. “Fundamental to Taiga Clouds vision is to bring a fresh perspective and democratise access to this technology which
GIGA POD The Future of AI Computing A turnkey AI data center starts with the NVIDIA HGX H100 GPU in GIGABYTE servers and full racks, gathered in a GIGA POD
Contact Sales >
12
taigacloud.com
will make a long lasting and positive impact on society. We do not want to constrain or restrict access to the computing power that others are desperate to get their hands on, due to the supply being limited for the foreseeable future. So we’re very happy to enable our customers to take one-month or three-month rolling contracts, as well as longer ones that enable our customers innovation.” Taiga Cloud is very humble with its hot-commodity GPUs, which aids its engagement, specifically with startups, giving them the service they need on a flexible basis. A statement that defines it all comes from Havard who says the business’s existence is to help organisations of all kinds
NVIDIA GPUS: BUILDING FOR GENERATIVE AI Taiga Cloud provides access to more than 20,000 of NVIDIA’s latest GPUs from the H100 and A100 to the A6000. Leveraging peak computing power puts Taiga at the top of its game in Europe while also focusing on the future of Generative AI applications. H100 GPU The NVIDIA H100 GPUs, offered by Taiga Cloud, are to deliver an order-ofmagnitude performance leap for large-scale GenAI and HPC workloads.
A100 Cloud GPU To train AI models, the A100 offers immense computational power, which Taiga also combines with a flexible usage system. These solutions can be scaled to meet the growing number of GenAI applications. A6000 Cloud GPU This GPU offers double-speed processing, which is optimised for power efficiency and high-level desktop performance for forms of data application, such as complex 3D computer-aided design (CAD) and computer-aided engineering (CAE).
taigacloud.com
13
“ As well as the low PUEs of 1.2 or less, the clean energy aspects, and the location, Bulk also offers some really strong elements around tier-three capability” KARL HAVARD
MANAGING DIRECTOR, TAIGA CLOUD
to bring their best ideas to life. In mentioning this, he goes on to praise some of the great feats to have come from partnering with its services. “We’re really pleased that Poolside AI decided to work with us and use our GenAI Cloud. They have a great proposition, which is to unlock humanity’s potential by using GenAI to simplify software development. They’re creating a world where you don’t necessarily have to be a coder to actually build software,” Havard explains. “Soon you will be able to use Poolside to write prompts that will make software development more accessible. This is a great partnership as we
TAIGA CLOUD
WATCH NOW
share similar values, and we’re inviting more organisations like them to partner with us.” This is great indeed and also shows the commitment that Taiga Cloud is making to wider industries. As an AI development enabler, the company’s service can be linked to groundbreaking innovation and potential solutions. A sustainable approach at the heart of data-centre development The company doesn’t falter when it comes to sustainability. If anything, from discussing this with Havard, it seems as though the company has it figured out. With the target being net-zero emissions,
the company is actively sourcing 100% renewable energy for its operations, and when it comes to cooling, direct-to-chip will be the standard that Taiga is setting – not to mention getting creative with the positioning of its sites; on the edge of the Arctic Circle and many metres below sea-level. One of its data centres is located in a disused mine, which provides the perfect environment for natural cooling and also eliminates the concerns about space. From an energy perspective, though, Taiga sources its energy from renewable means, citing hydroelectric power as a key component of its Scandinavia-based operations. “We will always, wherever we build or whoever we partner with on the data-centre front, use 100% carbon-neutral energy to power and cool the sites,” Havard says. “As well as having these clean sources of energy, we also use it in the most efficient ways.” taigacloud.com
15
TAIGA CLOUD
“Our power usage effectiveness (PUE) numbers will always be 1.2 or lower” – the perfect score being one. “In fact, Boden in Sweden is 1.05 and Lefdal in Norway is 1.15.” He continues: “If you can get parity, it means all the energy is powering and cooling the IT equipment and nothing else. We will always want to be as efficient as we possibly can be and we’re evaluating all sorts of different powering and cooling technologies; we know we can do more.” Setting it in stone, the lifelong sustainability goal is clear for Taiga Cloud – reduce emissions to zero and only consume the energy that it needs. With support from the likes of NVIDIA, HPE and Giga Computing Technology, the team is capable of accessing the right equipment to help achieve this goal. Moreover, partnering with a provider like Bulk is a foundational move that supports the sustainable day-to-day running of its data centres. “As well as the low PUEs, the clean energy aspects, and the location, Bulk also offers some really strong elements around tierthree capability. Customers that have moved through their evolution of generative AI and moving to interference, will need absolute tier-three capability,” says Havard. “There are various elements to it, including very high-levels of security and resilience, as well as only allowing a maximum of 1.6 hours per annum downtime. So we absolutely need that type of partner. Bulk offers that.” Leveraging the partnership with Bulk also enables lower latency, achieving 10 milliseconds round trip time, or less, which some of our customers insist on. “Our growing estate is spread across our data centres and is configured in identical 16
taigacloud.com
“ Fundamental to Taiga Cloud’s vision is to bring a fresh perspective and democratise access to this technology” KARL HAVARD
MANAGING DIRECTOR, TAIGA CLOUD
islands, securely segmented for each of our different customers’ needs. We have built them to the highest spec, and to be clear the H100s are the SXM version, in islands of 2,032 GPUs, with BlueField DPU management and 3.2TB InfiniBand interconnectivity. Basically, super efficient to provide the desired outcomes, faster.” In the foreseeable future, Taiga’s partner network and devotion to new innovations in GenAI will see the company through its continuous development to provide startups and technology majors the computing power to deliver on their goals. The partner network the company is building will provide additional ML & AI
services and software to its customers and accelerate the achievement of their desired objectives. “The next 12 to 18 months are all about effective execution,” Havard explains. “As the H100s come in, we’ll be making sure they are deployed on time, clients are onboarded, and that they’re working at their absolute best. “On top of that, we will provide a high level of managed services and expertise to support our customers as the market matures.”
taigacloud.com
17
Taiga Cloud
The Lennox Building, 50 Richmond St, Saint Kevin’s, Dublin 2, D02 FK02 www.taigacloud.com
POWERED BY: