Rocksolid Light

Welcome to Rocksolid Light

mail  files  register  newsreader  groups  login

Message-ID:  

And Bruce is effectively building BruceIX -- Alan Cox


devel / comp.arch / Re: How Does Tesla's Dojo Compare to IBM's NorthPole?

SubjectAuthor
* How Does Tesla's Dojo Compare to IBM's NorthPole?Todd Bezenek
`* Re: How Does Tesla's Dojo Compare to IBM's NorthPole?EricP
 `* Re: How Does Tesla's Dojo Compare to IBM's NorthPole?S.Takano
  `* Re: How Does Tesla's Dojo Compare to IBM's NorthPole?Quadibloc
   `- Re: How Does Tesla's Dojo Compare to IBM's NorthPole?S.Takano

1
How Does Tesla's Dojo Compare to IBM's NorthPole?

<68b187fe-7695-4bb6-89c6-adda9b5f241cn@googlegroups.com>

  copy mid

https://news.novabbs.org/devel/article-flat.php?id=33982&group=comp.arch#33982

  copy link   Newsgroups: comp.arch
X-Received: by 2002:a05:6214:162a:b0:63f:c14d:fac4 with SMTP id e10-20020a056214162a00b0063fc14dfac4mr304452qvw.2.1694527436348;
Tue, 12 Sep 2023 07:03:56 -0700 (PDT)
X-Received: by 2002:a05:6a00:1a16:b0:68e:2505:dbb3 with SMTP id
g22-20020a056a001a1600b0068e2505dbb3mr4771279pfv.2.1694527435988; Tue, 12 Sep
2023 07:03:55 -0700 (PDT)
Path: i2pn2.org!i2pn.org!news.nntp4.net!weretis.net!feeder8.news.weretis.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!news-out.google.com!nntp.google.com!postnews.google.com!google-groups.googlegroups.com!not-for-mail
Newsgroups: comp.arch
Date: Tue, 12 Sep 2023 07:03:55 -0700 (PDT)
Injection-Info: google-groups.googlegroups.com; posting-host=70.249.168.224; posting-account=Sjd8KQoAAABv1jR-UXcAegAgxKFK3KmU
NNTP-Posting-Host: 70.249.168.224
User-Agent: G2/1.0
MIME-Version: 1.0
Message-ID: <68b187fe-7695-4bb6-89c6-adda9b5f241cn@googlegroups.com>
Subject: How Does Tesla's Dojo Compare to IBM's NorthPole?
From: bezenek@gmail.com (Todd Bezenek)
Injection-Date: Tue, 12 Sep 2023 14:03:56 +0000
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
 by: Todd Bezenek - Tue, 12 Sep 2023 14:03 UTC

Here is the original funding announcement for NorthPole, which debuted a week ago at Hot Chips 2013. You can get four (4) processors in a 1U.. Price to be determined: https://news.clearancejobs.com/2019/08/16/ibm-research-wins-60m-for-artificial-intelligence-machine-learning-project-with-usaf-dod-daily-contracts/

Here is information about Tesla's Dojo when announced: https://electrek.co/2021/08/20/tesla-dojo-supercomputer-worlds-new-most-powerful-ai-training-machine/

And today (possible paywall): https://www.forbes.com/sites/stevendickens/2023/09/11/teslas-dojo-supercomputer-a-paradigm-shift-in-supercomputing/

Cheers!
Todd B
Fritter Inc

Re: How Does Tesla's Dojo Compare to IBM's NorthPole?

<5x%LM.37936$hx27.26637@fx18.iad>

  copy mid

https://news.novabbs.org/devel/article-flat.php?id=33985&group=comp.arch#33985

  copy link   Newsgroups: comp.arch
Path: i2pn2.org!i2pn.org!usenet.blueworldhosting.com!diablo1.usenet.blueworldhosting.com!peer01.iad!feed-me.highwinds-media.com!news.highwinds-media.com!fx18.iad.POSTED!not-for-mail
From: ThatWouldBeTelling@thevillage.com (EricP)
User-Agent: Thunderbird 2.0.0.24 (Windows/20100228)
MIME-Version: 1.0
Newsgroups: comp.arch
Subject: Re: How Does Tesla's Dojo Compare to IBM's NorthPole?
References: <68b187fe-7695-4bb6-89c6-adda9b5f241cn@googlegroups.com>
In-Reply-To: <68b187fe-7695-4bb6-89c6-adda9b5f241cn@googlegroups.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Lines: 38
Message-ID: <5x%LM.37936$hx27.26637@fx18.iad>
X-Complaints-To: abuse@UsenetServer.com
NNTP-Posting-Date: Tue, 12 Sep 2023 15:33:21 UTC
Date: Tue, 12 Sep 2023 11:33:04 -0400
X-Received-Bytes: 2573
 by: EricP - Tue, 12 Sep 2023 15:33 UTC

Todd Bezenek wrote:
> Here is the original funding announcement for NorthPole, which debuted a week ago at Hot Chips 2013. You can get four (4) processors in a 1U.. Price to be determined: https://news.clearancejobs.com/2019/08/16/ibm-research-wins-60m-for-artificial-intelligence-machine-learning-project-with-usaf-dod-daily-contracts/
>
> Here is information about Tesla's Dojo when announced: https://electrek.co/2021/08/20/tesla-dojo-supercomputer-worlds-new-most-powerful-ai-training-machine/
>
> And today (possible paywall): https://www.forbes.com/sites/stevendickens/2023/09/11/teslas-dojo-supercomputer-a-paradigm-shift-in-supercomputing/
>
> Cheers!
> Todd B
> Fritter Inc

Forbes is perhaps not the best source for technical info on Dojo D1.

Tesla's D1 chip is RISC-V optimized for Tesla's machine learning.

Inside Tesla’s Innovative And Homegrown “Dojo” AI Supercomputer, 2023-08-23
https://www.nextplatform.com/2022/08/23/inside-teslas-innovative-and-homegrown-dojo-ai-supercomputer/

"And what is most striking are the things that Tesla’s engineers
threw out as they focused on scale."

“We have de-emphasized several mechanisms that you find in typical CPUs,
like coherency, virtual memory, and global lookup directories just because
these mechanisms do not scale very well when we scale up to a very large
system. Instead, we have relied on a very fast and very distributed SRAM
storage throughout the mesh. And this is backed by an order of magnitude
higher speed of interconnect than what you find in a typical distributed
system.”

Basically, D1 looks like a custom, single purpose, embedded architecture,
ASIC chip design, running custom OS and software stacks.
It is never going to do anything other than run Tesla's ML.

That may break Tesla's dependency on Nvidia but I don't see
any technical "Paradigm Shift".

Re: How Does Tesla's Dojo Compare to IBM's NorthPole?

<0f937ee5-2ae5-4a7c-ae10-69d0870d88ban@googlegroups.com>

  copy mid

https://news.novabbs.org/devel/article-flat.php?id=34255&group=comp.arch#34255

  copy link   Newsgroups: comp.arch
X-Received: by 2002:a05:620a:8ecb:b0:76d:567a:42f0 with SMTP id rg11-20020a05620a8ecb00b0076d567a42f0mr11215qkn.3.1695335611478;
Thu, 21 Sep 2023 15:33:31 -0700 (PDT)
X-Received: by 2002:a9d:6a4f:0:b0:6b9:cc6b:275a with SMTP id
h15-20020a9d6a4f000000b006b9cc6b275amr2099585otn.3.1695335611107; Thu, 21 Sep
2023 15:33:31 -0700 (PDT)
Path: i2pn2.org!i2pn.org!usenet.blueworldhosting.com!diablo1.usenet.blueworldhosting.com!peer02.iad!feed-me.highwinds-media.com!news.highwinds-media.com!news-out.google.com!nntp.google.com!postnews.google.com!google-groups.googlegroups.com!not-for-mail
Newsgroups: comp.arch
Date: Thu, 21 Sep 2023 15:33:30 -0700 (PDT)
In-Reply-To: <5x%LM.37936$hx27.26637@fx18.iad>
Injection-Info: google-groups.googlegroups.com; posting-host=240d:1a:9b5:8e00:f4ad:a317:3995:b7e9;
posting-account=Op2IWwoAAABwzgDNGL1IwX0KKpjIpZjd
NNTP-Posting-Host: 240d:1a:9b5:8e00:f4ad:a317:3995:b7e9
References: <68b187fe-7695-4bb6-89c6-adda9b5f241cn@googlegroups.com> <5x%LM.37936$hx27.26637@fx18.iad>
User-Agent: G2/1.0
MIME-Version: 1.0
Message-ID: <0f937ee5-2ae5-4a7c-ae10-69d0870d88ban@googlegroups.com>
Subject: Re: How Does Tesla's Dojo Compare to IBM's NorthPole?
From: adaptiveprocessor@gmail.com (S.Takano)
Injection-Date: Thu, 21 Sep 2023 22:33:31 +0000
Content-Type: text/plain; charset="UTF-8"
X-Received-Bytes: 1289
 by: S.Takano - Thu, 21 Sep 2023 22:33 UTC

NorthPole: Array of (Vector Matrix Engine+SRAM)
Dojo: Array of Computer

-
s.takano

Re: How Does Tesla's Dojo Compare to IBM's NorthPole?

<e5b718cf-3d19-499c-9c6a-a2a2224865c6n@googlegroups.com>

  copy mid

https://news.novabbs.org/devel/article-flat.php?id=34272&group=comp.arch#34272

  copy link   Newsgroups: comp.arch
X-Received: by 2002:a37:ad01:0:b0:774:1c2f:ac40 with SMTP id f1-20020a37ad01000000b007741c2fac40mr3766qkm.13.1695410113655;
Fri, 22 Sep 2023 12:15:13 -0700 (PDT)
X-Received: by 2002:a05:6808:20a4:b0:3ad:f838:d02b with SMTP id
s36-20020a05680820a400b003adf838d02bmr286905oiw.0.1695410113446; Fri, 22 Sep
2023 12:15:13 -0700 (PDT)
Path: i2pn2.org!i2pn.org!weretis.net!feeder6.news.weretis.net!border-2.nntp.ord.giganews.com!nntp.giganews.com!news-out.google.com!nntp.google.com!postnews.google.com!google-groups.googlegroups.com!not-for-mail
Newsgroups: comp.arch
Date: Fri, 22 Sep 2023 12:15:13 -0700 (PDT)
In-Reply-To: <0f937ee5-2ae5-4a7c-ae10-69d0870d88ban@googlegroups.com>
Injection-Info: google-groups.googlegroups.com; posting-host=2001:56a:fa34:c000:5504:61a8:a415:bc83;
posting-account=1nOeKQkAAABD2jxp4Pzmx9Hx5g9miO8y
NNTP-Posting-Host: 2001:56a:fa34:c000:5504:61a8:a415:bc83
References: <68b187fe-7695-4bb6-89c6-adda9b5f241cn@googlegroups.com>
<5x%LM.37936$hx27.26637@fx18.iad> <0f937ee5-2ae5-4a7c-ae10-69d0870d88ban@googlegroups.com>
User-Agent: G2/1.0
MIME-Version: 1.0
Message-ID: <e5b718cf-3d19-499c-9c6a-a2a2224865c6n@googlegroups.com>
Subject: Re: How Does Tesla's Dojo Compare to IBM's NorthPole?
From: jsavard@ecn.ab.ca (Quadibloc)
Injection-Date: Fri, 22 Sep 2023 19:15:13 +0000
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Lines: 12
 by: Quadibloc - Fri, 22 Sep 2023 19:15 UTC

On Thursday, September 21, 2023 at 4:33:33 PM UTC-6, S.Takano wrote:
> NorthPole: Array of (Vector Matrix Engine+SRAM)
> Dojo: Array of Computer

When I saw this post, I immediately thought of Masashi (Max) Takano,
who is responsible for many of the arrangements of movie themes and
other music for the Yamaha Electone STAGEA organs which led to so
many impressive YouTube videos, like this one:

https://www.youtube.com/watch?v=Yp5HpjhKHKs

John Savard

Re: How Does Tesla's Dojo Compare to IBM's NorthPole?

<af2c4c23-d9bd-4ebb-9c48-ee3689d37a94n@googlegroups.com>

  copy mid

https://news.novabbs.org/devel/article-flat.php?id=34273&group=comp.arch#34273

  copy link   Newsgroups: comp.arch
X-Received: by 2002:a05:620a:208e:b0:76f:e36:28d0 with SMTP id e14-20020a05620a208e00b0076f0e3628d0mr5186qka.0.1695416425382;
Fri, 22 Sep 2023 14:00:25 -0700 (PDT)
X-Received: by 2002:a9d:7848:0:b0:6c0:bb8d:4d8b with SMTP id
c8-20020a9d7848000000b006c0bb8d4d8bmr230032otm.4.1695416425044; Fri, 22 Sep
2023 14:00:25 -0700 (PDT)
Path: i2pn2.org!i2pn.org!weretis.net!feeder8.news.weretis.net!proxad.net!feeder1-2.proxad.net!209.85.160.216.MISMATCH!news-out.google.com!nntp.google.com!postnews.google.com!google-groups.googlegroups.com!not-for-mail
Newsgroups: comp.arch
Date: Fri, 22 Sep 2023 14:00:24 -0700 (PDT)
In-Reply-To: <e5b718cf-3d19-499c-9c6a-a2a2224865c6n@googlegroups.com>
Injection-Info: google-groups.googlegroups.com; posting-host=240d:1a:9b5:8e00:f4ad:a317:3995:b7e9;
posting-account=Op2IWwoAAABwzgDNGL1IwX0KKpjIpZjd
NNTP-Posting-Host: 240d:1a:9b5:8e00:f4ad:a317:3995:b7e9
References: <68b187fe-7695-4bb6-89c6-adda9b5f241cn@googlegroups.com>
<5x%LM.37936$hx27.26637@fx18.iad> <0f937ee5-2ae5-4a7c-ae10-69d0870d88ban@googlegroups.com>
<e5b718cf-3d19-499c-9c6a-a2a2224865c6n@googlegroups.com>
User-Agent: G2/1.0
MIME-Version: 1.0
Message-ID: <af2c4c23-d9bd-4ebb-9c48-ee3689d37a94n@googlegroups.com>
Subject: Re: How Does Tesla's Dojo Compare to IBM's NorthPole?
From: adaptiveprocessor@gmail.com (S.Takano)
Injection-Date: Fri, 22 Sep 2023 21:00:25 +0000
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
 by: S.Takano - Fri, 22 Sep 2023 21:00 UTC

Last name, 高野(taka-no) is minor :),but I glad such the person is there.

-
s.takano

1
server_pubkey.txt

rocksolid light 0.9.81
clearnet tor