Rocksolid Light

Welcome to Rocksolid Light

mail  files  register  newsreader  groups  login

Message-ID:  

A fail-safe circuit will destroy others. -- Klipstein


computers / Rocksolid Nodes Help / Resources needed for rslight

SubjectAuthor
* Resources needed for rslightMarco Moock
+- Resources needed for rslightRetro Guy
`- Resources needed for rslightSyber Shock

1
Resources needed for rslight

<ulni77$32vim$1@dont-email.me>

  copy mid

https://news.novabbs.org/computers/article-flat.php?id=714&group=rocksolid.nodes.help#714

  copy link   Newsgroups: rocksolid.nodes.help
Path: i2pn2.org!i2pn.org!newsfeed.endofthelinebbs.com!news.hispagatos.org!eternal-september.org!feeder3.eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: mm+usenet-es@dorfdsl.de (Marco Moock)
Newsgroups: rocksolid.nodes.help
Subject: Resources needed for rslight
Date: Sun, 17 Dec 2023 20:29:42 +0100
Organization: A noiseless patient Spider
Lines: 15
Message-ID: <ulni77$32vim$1@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Injection-Date: Sun, 17 Dec 2023 19:29:43 -0000 (UTC)
Injection-Info: dont-email.me; posting-host="5be5112a2364bb6529bf96eadeeb3ab7";
logging-data="3243606"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/kiDzeY3i3okDmTukghrkJ"
Cancel-Lock: sha1:T44y9Ye7PFuuYTR5VAJjqP6EwZ4=
 by: Marco Moock - Sun, 17 Dec 2023 19:29 UTC

Hello!

Because GG stops providing peering and new Usenet discussions won't
appear on GG, I thought about hosting rslight.

What are the resources needed to run it for an entire hierarchy, like
de.* with discussions ranging in the past, maybe years?

What about the built-in nntp server?
Does it do the peering or do I need to run a separate INN/Diablo?

--
kind regards
Marco

Re: Resources needed for rslight

<eee9e9a337489ce364de4147e8a6ea3c$1@news.novabbs.org>

  copy mid

https://news.novabbs.org/computers/article-flat.php?id=715&group=rocksolid.nodes.help#715

  copy link   Newsgroups: rocksolid.nodes.help
Date: Sun, 17 Dec 2023 19:48:08 +0000
Message-ID: <eee9e9a337489ce364de4147e8a6ea3c$1@news.novabbs.org>
Organization: Rocksolid Light
From: retroguy@novabbs.org (Retro Guy)
Subject: Re: Resources needed for rslight
Newsgroups: rocksolid.nodes.help
X-Face: .&YR-G(w(DZ$$,}%k=]*5*!p'=(anr"IT`wZG'2VWdfl\r)l[42u7JH`n(JUQ*e5
*A|XCDf?&\X&uwkl38"CYX3O8m}C8E4p'%N$2#kSTVzx{Ly|DjLT\Vk7NE}NQ(VC$Yq]i:7
|z[.9iv^g>*8_BH0=hZt'[%)4kG|
References: <ulni77$32vim$1@dont-email.me>
MIME-Version: 1.0
User-Agent: Pan/0.155 (Kherson; fc5a80b8)
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
 by: Retro Guy - Sun, 17 Dec 2023 19:48 UTC

On Sun, 17 Dec 2023 20:29:42 +0100, Marco Moock wrote:

> Hello!
>
> Because GG stops providing peering and new Usenet discussions won't
> appear on GG, I thought about hosting rslight.
>
> What are the resources needed to run it for an entire hierarchy, like
> de.* with discussions ranging in the past, maybe years?
>
> What about the built-in nntp server?
> Does it do the peering or do I need to run a separate INN/Diablo?

Hi Marco,

Currently, for www.novabbs.com, there are 2,296,739 messages, and the
spool space used is 31G. Not too bad. Messages are in sqlite3 databases
(one per group), so no need to deal with millions of files.

I run and test on Debian Stable. Currently bookworm. The INSTALL file for
rslight shows what packages are needed, and Syber Shock, who also runs
rslight installs is a great source of finding out what I forget to put in
the INSTALL file, or instructions, etc. :)

The built in nntp server is actually the server that the website uses as
it's source for articles. The nntp server regularly polls an upstream
server (such as news.i2pn.org, or news.eternal-september.org, or whatever
you want to sync with). It (the local nntp server) sends local posts and
pulls remote posts via that upstream server.

Think of the built in nntp server as in place of something like leafnode.
No other nntp server is required, it is built in to rslight.

You can also connect your newsreader to the built in nntp server if you
wish. I do that here and it is how I will send this post.

The number of groups you choose to serve is up to you, but realize that
the more groups, the more resources required and the slower things can
get. NovaBBS seems to do fine with 4G of RAM and one CPU.

You can pull articles from your upstream server as far back as you wish,
you need to configure this in your overrides.conf . You choose how many
articles to go back when first connecting. Not dates, but articles (by
number).

If you choose to do this, you will have many more questions. Feel free to
ask as you go and we will try our best to help. Good luck!

Re: Resources needed for rslight

<20231217163817.412f9e83@dev>

  copy mid

https://news.novabbs.org/computers/article-flat.php?id=716&group=rocksolid.nodes.help#716

  copy link   Newsgroups: rocksolid.nodes.help
Path: i2pn2.org!i2pn.org!paganini.bofh.team!tor-network!not-for-mail
From: 3883@sugar.bug (Syber Shock)
Newsgroups: rocksolid.nodes.help
Subject: Re: Resources needed for rslight
Date: Sun, 17 Dec 2023 16:38:17 -0600
Organization: To protect and to server
Message-ID: <20231217163817.412f9e83@dev>
References: <ulni77$32vim$1@dont-email.me>
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Injection-Info: paganini.bofh.team; logging-data="381007"; posting-host="nN4xpfeu9bLgoeEVUCG9uw.user.paganini.bofh.team"; mail-complaints-to="usenet@bofh.team"; posting-account="9dIQLXBM7WM9KzA+yjdR4A";
Cancel-Lock: sha256:iy8d475kJZ5k7fCrBgAkJwS/0q/xMXMBnvL7fqsKxC8=
X-Notice: Filtered by postfilter v. 0.9.3
X-TOR-Router: sha256:MjYwNTo2NDAwOjMwOmVhNTI6NDI0NjpmYjgyOmYzNmM6OGVkZQ== --
 by: Syber Shock - Sun, 17 Dec 2023 22:38 UTC

On Sun, 17 Dec 2023 20:29:42 +0100
Marco Moock <mm+usenet-es@dorfdsl.de> wrote:

> Hello!
>
> Because GG stops providing peering and new Usenet discussions won't
> appear on GG, I thought about hosting rslight.

Someone got the memo. It's about time but better late than never.
> What are the resources needed to run it for an entire hierarchy, like
> de.* with discussions ranging in the past, maybe years?

If you snarf down all past history in some hierarchies, you can archive
them and just provide public access to a limited past date. You don't
have to make everything publicly available, and can just open up the
whole treasure trove for other sysops who want to run peers and
preserve the data. Almost no non-sysop users are going to preserve any
data, so making the whole trove available for them to waste bandwidth
and compute time is pointless.
> What about the built-in nntp server?
> Does it do the peering or do I need to run a separate INN/Diablo?

I have a few thoughts not directly related to rslight but to the
mechanics of dealing with so many sqlite databases or text files, and
with potential future spam and nut jobbery.

1. Set up your servers with a compression-based filesystem like ZFS or
BTRFS with snapshots and check-summing. This will be a big help in
conserving storage space since all stored data will be automatically
compressed.

2. Run a mirror peer on a totally separate machine as a backup, or at
least run a scheduled rsync mirror. If you don't, Wishidundat's law will
probably bite. When you do backup your data, you never need it. When
you don't, you needed it, and wishudundat.

3. Blacklist free email providers for signup, or at least require
applicants to write an explanation of why they are not a spammer or bot
before approving an account. I think proving ownership of a TLD by a
robots.txt comment or DNS TXT token is a good way to vet users. It also
provides you a get "don't blame me" card if some numskull does something
illegal with their account. Nobody can say you made it easy for idiots
to sign up.

That's my two cents to stave off storage and troll headaches. YMMV.


computers / Rocksolid Nodes Help / Resources needed for rslight

1
server_pubkey.txt

rocksolid light 0.9.81
clearnet tor