Intel Xeon 6 Processors and Gaudi 3 AI Accelerators With Ability to Handle Advanced AI Workloads Launched

Intel recently
unveiled
new
hardware
focused
at
improving
artificial
intelligence
(AI)
workflows.
The
company
introduced
the
Xeon
6
processor
with
new
Performance-cores
(P-cores)
and
Gaudi
3
AI
Accelerator
for
enterprise
customers
and
data
centres
on
Tuesday.
The
chipmaker
claims
that
the
new
hardware
will
offer
both
higher
throughput
and
better
cost
optimisation
to
enable
optimal
performance
per
watt
and
lower
total
cost
of
ownership.
These
devices
were
launched
to
enable
enterprises
to
handle
the
continuously
increasing
workload
demands
from
more
advanced
AI
models,
according
to
the
chipmaker.

Intel
Xeon
6
Processor
Launched

 The
chipmaker

says that
its
new
Intel
Xeon
6
is
equipped
with
Performance-cores.
These
processors
are
not
meant
for
retail
consumers
and
instead
will
power
data
centres
for
enterprises
to
help
them
run
cloud
servers.

Intel
claims
the
Xeon
6
processor
offers
twice
the
performance
of
its
predecessor
due
to
increased
core
count.
It
also
offers
double
the
memory
bandwidth
and
AI
acceleration
capabilities.

Since
it
is
hardware-based
acceleration,
it
can
run
support
very
large
language
models
(LLMs)
with
ease.
It
can
“meet
the
performance
demands
of
AI
from
edge
to
data
centre
and
cloud
environments,”
according
to
Intel.

Intel
Unveils Gaudi
3
AI
Accelerators

Gaudi
3
is
a
new-generation
AI
Accelerator
from
Intel.
These
are
specialised
hardware
chips
designed
to
help
machines
in
speeding
up
AI
tasks,
especially
those
related
to
deep
learning,
machine
learning,
and
neural
networks.
These
include
GPUs,
Application-Specific
Integrated
Circuits
(ASICs),
Field-Programmable
Gate
Arrays
(FPGAs),
and
Neural
Processing
Units
(NPUs).

The
Gaudi
3
AI
Accelerator
features
64
Tensor
processor
cores
and
eight
matrix
multiplication
engines
(MMEs)
which
are
designed
to
accelerate
deep
neural
network
computations.
It
sports
128GB
of
HBM2e
memory
for
training
and
inference,
and
24
200GB
Ethernet
ports
that
enable
scaling
up
the
servers.

Intel’s
new
AI
Accelerator
is
compatible
with
the
PyTorch
framework
and
advanced
Hugging
Face
transformer
and
diffuser
models.
The
company
has
already
tied
up
with
IBM
to
deploy
Gaudi
3
for
IBM
Clouds.
Dell
Technologies
is
also
using
the
infrastructure
for
its
data
centres.