See 'rslight spam mods' and 'How does rslight work with spamassassin?' for
previous discussion.

I have tested on tradspool setup and all worked properly.

Posting via web interface. OK
Posting via newsreader. OK
Pulling from remote server. OK

I then switched to article-database setup.

Posting via web interface. OK
Posting via newsreader. OK
Pulling from remote server. OK

So it seems to work fine for me. (Of course it does, as previously
discussed, lol)

Try a new spool:

cd $spooldir; rm -rf * (be careful)

Let it run for a while to build it's spool and web interface. (A new setup
requires some time to settle). Then test again.

On Fri, 22 Dec 2023 05:54:01 -0700
Retro Guy <retroguy@novabbs.org> wrote:

<snip>
> Try a new spool:
>
> cd $spooldir; rm -rf * (be careful)
>
> Let it run for a while to build it's spool and web interface. (A new
> setup requires some time to settle). Then test again.

Was this testing done with the .php files you posted in the thread? I'm
ready to queue up and run some tests if that is the case.

--
General of the Baggy Jeans Mafia | https://neon.nightbulb.net/firefly

If your jeans don't have room for tools they
are not really jeans; they are denim leotards.

On Fri, 22 Dec 2023 14:33:06 -0600, Syber Shock wrote:

> On Fri, 22 Dec 2023 05:54:01 -0700
> Retro Guy <retroguy@novabbs.org> wrote:
>
> <snip>
>
>> Try a new spool:
>>
>> cd $spooldir; rm -rf * (be careful)
>>
>> Let it run for a while to build it's spool and web interface. (A new
>> setup requires some time to settle). Then test again.
>
> Was this testing done with the .php files you posted in the thread? I'm
> ready to queue up and run some tests if that is the case.

Yes. The files I posted. I posted two spoolnews.php, use the second one.

Gitlab is not up to date.

On Fri, 22 Dec 2023 13:36:17 -0700, Retro Guy wrote:

> On Fri, 22 Dec 2023 14:33:06 -0600, Syber Shock wrote:
>
>> On Fri, 22 Dec 2023 05:54:01 -0700
>> Retro Guy <retroguy@novabbs.org> wrote:
>>
>> <snip>
>>
>>> Try a new spool:
>>>
>>> cd $spooldir; rm -rf * (be careful)
>>>
>>> Let it run for a while to build it's spool and web interface. (A new
>>> setup requires some time to settle). Then test again.
>>
>> Was this testing done with the .php files you posted in the thread? I'm
>> ready to queue up and run some tests if that is the case.
>
> Yes. The files I posted. I posted two spoolnews.php, use the second one.
>
> Gitlab is not up to date.

I'm currently working on a mod to post using the logged in user's creds. I
know, that would be obvious, but I always avoided that for security
reasons.

Due to multiple requests, I'm adding the feature, but will have a checkbox
to enable/disable it for each user to decide.

I know that's offtopic for this thread, just letting you know what's going
on while you prepare to let me know that all my spam mods start wars and
destroy planets :)

On Fri, 22 Dec 2023 13:36:17 -0700
Retro Guy <retroguy@novabbs.org> wrote:

> On Fri, 22 Dec 2023 14:33:06 -0600, Syber Shock wrote:
>
> > On Fri, 22 Dec 2023 05:54:01 -0700
> > Retro Guy <retroguy@novabbs.org> wrote:
> >
> > <snip>
> >
> >> Try a new spool:
> >>
> >> cd $spooldir; rm -rf * (be careful)
> >>
> >> Let it run for a while to build it's spool and web interface. (A
> >> new setup requires some time to settle). Then test again.
> >
> > Was this testing done with the .php files you posted in the thread?
> > I'm ready to queue up and run some tests if that is the case.
>
> Yes. The files I posted. I posted two spoolnews.php, use the second
> one.
>
> Gitlab is not up to date.

What specifically is supposed to be happening with these updated spam
scripts? I re-installed again, and ran it again, and no spam is removed
by rslight.

I am able to post as blacklisted users: blacklist_from email@domain.url.

It has no effect even after reboot and restart of spamd daemon.

No incoming spam is blocked. No spam posted from local user account is
blocked.

The syslog has 205 positives for spam but none of the articles are
sequestered by rslight:

$ grep "spamd: result: Y" /var/log/syslog | tail -n 1
2023-12-22T19:03:24.704407-05:00 [...] spamd[14441]: spamd: result:
Y 103 -
MISSING_DATE,MISSING_HEADERS,NO_RECEIVED,NO_RELAYS,PP_MIME_FAKE_ASCII_TEXT,URIBL_BLOCKED,USER_IN_BLOCKLIST
scantime=0.3,size=3423,user=rslight,uid=1003,required_score=5.0,rhost=localhost,raddr=::1,rport=44842,mid=<qebpmipq3l8umj3oct1l67nakp1dvsp4v0@4ax.com>,autolearn=no
autolearn_force=no

relevant: mid=<qebpmipq3l8umj3oct1l67nakp1dvsp4v0@4ax.com>

That article is in my web portal and in the NNTP spool via telnet:

Connected to localhost.
Escape character is '^]'.
200 Rocksolid Light NNTP Server ready (no posting)
head <qebpmipq3l8umj3oct1l67nakp1dvsp4v0@4ax.com>
221 32 <qebpmipq3l8umj3oct1l67nakp1dvsp4v0@4ax.com> article retrieved -
header follows
[...]

It's the same for all the others. The spamc client is returning
positive for spam to rslight. It identified 205 spam articles but
they're all there in the web portal and NNTP socket. I have no idea what
happens after that point, only that none of the flagged messages are
removed.

On Fri, 22 Dec 2023 18:15:51 -0600, SugarBug wrote:

> On Fri, 22 Dec 2023 13:36:17 -0700
> Retro Guy <retroguy@novabbs.org> wrote:
>
>> On Fri, 22 Dec 2023 14:33:06 -0600, Syber Shock wrote:
>>
>>> On Fri, 22 Dec 2023 05:54:01 -0700
>>> Retro Guy <retroguy@novabbs.org> wrote:
>>>
>>> <snip>
>>>
>>>> Try a new spool:
>>>>
>>>> cd $spooldir; rm -rf * (be careful)
>>>>
>>>> Let it run for a while to build it's spool and web interface. (A
>>>> new setup requires some time to settle). Then test again.
>>>
>>> Was this testing done with the .php files you posted in the thread?
>>> I'm ready to queue up and run some tests if that is the case.
>>
>> Yes. The files I posted. I posted two spoolnews.php, use the second
>> one.
>>
>> Gitlab is not up to date.
>
> What specifically is supposed to be happening with these updated spam
> scripts? I re-installed again, and ran it again, and no spam is removed
> by rslight.
>
> I am able to post as blacklisted users: blacklist_from email@domain.url.
>
> It has no effect even after reboot and restart of spamd daemon.
>
> No incoming spam is blocked. No spam posted from local user account is
> blocked.

I'm going to create a mod that has a lot of logging and/or echoing so we
can see exactly what's going on.

Is it getting an exit code of '1' from spamc? Let's find out.

What are the values of a number of vars? Let's find out.

We're going to need to troubleshoot somehow. It's working exactly as
expected for me (of course).

It is supposed to filter local posts (web or nntp) and filter incoming from
peers. Apparently it's not doing any of that.

Also, I created an account on your site so I could try to post a spam, but
it seems the groups are saying they don't exist.

I'll be back on it Saturday.

On Fri, 22 Dec 2023 18:23:56 -0700
Retro Guy <retroguy@novabbs.org> wrote:

> On Fri, 22 Dec 2023 18:15:51 -0600, SugarBug wrote:
>
> > On Fri, 22 Dec 2023 13:36:17 -0700
> > Retro Guy <retroguy@novabbs.org> wrote:
> >
> >> On Fri, 22 Dec 2023 14:33:06 -0600, Syber Shock wrote:
> >>
> >>> On Fri, 22 Dec 2023 05:54:01 -0700
> >>> Retro Guy <retroguy@novabbs.org> wrote:
> >>>
> >>> <snip>
> >>>
> >>>> Try a new spool:
> >>>>
> >>>> cd $spooldir; rm -rf * (be careful)
> >>>>
> >>>> Let it run for a while to build it's spool and web interface. (A
> >>>> new setup requires some time to settle). Then test again.
> >>>
> >>> Was this testing done with the .php files you posted in the
> >>> thread? I'm ready to queue up and run some tests if that is the
> >>> case.
> >>
> >> Yes. The files I posted. I posted two spoolnews.php, use the second
> >> one.
> >>
> >> Gitlab is not up to date.
> >
> > What specifically is supposed to be happening with these updated
> > spam scripts? I re-installed again, and ran it again, and no spam
> > is removed by rslight.
> >
> > I am able to post as blacklisted users: blacklist_from
> > email@domain.url.
> >
> > It has no effect even after reboot and restart of spamd daemon.
> >
> > No incoming spam is blocked. No spam posted from local user account
> > is blocked.
>
> I'm going to create a mod that has a lot of logging and/or echoing so
> we can see exactly what's going on.
>
> Is it getting an exit code of '1' from spamc? Let's find out.
>
> What are the values of a number of vars? Let's find out.
>
> We're going to need to troubleshoot somehow. It's working exactly as
> expected for me (of course).
>
> It is supposed to filter local posts (web or nntp) and filter
> incoming from peers. Apparently it's not doing any of that.
>
> Also, I created an account on your site so I could try to post a
> spam, but it seems the groups are saying they don't exist.
>
> I'll be back on it Saturday.

I removed most of the newsgroups and added some spammy ones. Here is
what's available:

200 Rocksolid Light NNTP Server ready (no posting)
215 Newsgroups in form "group high low status"
rocksolid.spam 27 1 y
rocksolid.nodes 21 1 y
rocksolid.nodes.help 36 1 y
spam.test.filtered 0 0 y
spam.test.1 2 1 y
spam.test.2 0 0 y
spam.test.3 0 0 y
alt.atheism 101 1 y
sci.med.cardiology 53 1 y
alt.religion.roman-catholic 0 0 y
alt.religion.christian 52 1 y
alt.bible 22 1 y

Now that you have an account I am going to disable registration since
any goof can get in there and start spamming. Let me know if login
works.

Retro Guy wrote:

> SugarBug wrote:

>> On Fri, 22 Dec 2023 18:23:56 -0700
>> Retro Guy <retroguy@novabbs.org> wrote:

>>> On Fri, 22 Dec 2023 18:15:51 -0600, SugarBug wrote:
>>>
>>> > On Fri, 22 Dec 2023 13:36:17 -0700
>>> > Retro Guy <retroguy@novabbs.org> wrote:
>>> >
>>> >> On Fri, 22 Dec 2023 14:33:06 -0600, Syber Shock wrote:
>>> >>
>>> >>> On Fri, 22 Dec 2023 05:54:01 -0700
>>> >>> Retro Guy <retroguy@novabbs.org> wrote:
>>> >>>
>>> >>> <snip>
>>> >>>
>>> >>>> Try a new spool:
>>> >>>>
>>> >>>> cd $spooldir; rm -rf * (be careful)
>>> >>>>
>>> >>>> Let it run for a while to build it's spool and web interface. (A
>>> >>>> new setup requires some time to settle). Then test again.
>>> >>>
>>> >>> Was this testing done with the .php files you posted in the
>>> >>> thread? I'm ready to queue up and run some tests if that is the
>>> >>> case.
>>> >>
>>> >> Yes. The files I posted. I posted two spoolnews.php, use the second
>>> >> one.
>>> >>
>>> >> Gitlab is not up to date.
>>> >
>>> > What specifically is supposed to be happening with these updated
>>> > spam scripts? I re-installed again, and ran it again, and no spam
>>> > is removed by rslight.
>>> >
>>> > I am able to post as blacklisted users: blacklist_from
>>> > email@domain.url.
>>> >
>>> > It has no effect even after reboot and restart of spamd daemon.
>>> >
>>> > No incoming spam is blocked. No spam posted from local user account
>>> > is blocked.
>>>
>>> I'm going to create a mod that has a lot of logging and/or echoing so
>>> we can see exactly what's going on.
>>>
>>> Is it getting an exit code of '1' from spamc? Let's find out.
>>>
>>> What are the values of a number of vars? Let's find out.
>>>
>>> We're going to need to troubleshoot somehow. It's working exactly as
>>> expected for me (of course).
>>>
>>> It is supposed to filter local posts (web or nntp) and filter
>>> incoming from peers. Apparently it's not doing any of that.
>>>
>>> Also, I created an account on your site so I could try to post a
>>> spam, but it seems the groups are saying they don't exist.
>>>
>>> I'll be back on it Saturday.

>> I removed most of the newsgroups and added some spammy ones. Here is
>> what's available:

> <snip>

>> Now that you have an account I am going to disable registration since
>> any goof can get in there and start spamming. Let me know if login
>> works.

> Sounds good, thank you. I will mess with this in a bit.

> I wrote a TEST script for spamassassin, it is attached 'spamtest.php'
> You should be able to just paste a message in, click Check and see the result from spamassassin without doing all the rslight testing.

> The file goes here: $webdir/rocksolid/spamtest.php
> Then just access it through your browser.

> If we can get this to work smoothly (of course it works fine for me), then we can hopefully troubleshoot rslight spam checking.

I have found that connections to some spamd work, some do not. The test script should show that clearly if it is the case for you.

Also, since you're specifically testing for From: header, the test script may already have a fix for that, let's see.

I have now changed how I decide whether SPAM or HAM and the result code from spamc is NOT reliable. I have another way to check that appears to be working for me, but let's see your specific errors first before trying any more changes.

Please try the test script with your own testing, but also please try including GTUBE in one to see what happens:
https://spamassassin.apache.org/gtube/

--
Retro Guy

Retro Guy wrote:

> Retro Guy wrote:

>> SugarBug wrote:

>>> On Fri, 22 Dec 2023 18:23:56 -0700
>>> Retro Guy <retroguy@novabbs.org> wrote:

>>>> On Fri, 22 Dec 2023 18:15:51 -0600, SugarBug wrote:
>>>>
>>>> > On Fri, 22 Dec 2023 13:36:17 -0700
>>>> > Retro Guy <retroguy@novabbs.org> wrote:
>>>> >
>>>> >> On Fri, 22 Dec 2023 14:33:06 -0600, Syber Shock wrote:
>>>> >>
>>>> >>> On Fri, 22 Dec 2023 05:54:01 -0700
>>>> >>> Retro Guy <retroguy@novabbs.org> wrote:
>>>> >>>
>>>> >>> <snip>
>>>> >>>
>>>> >>>> Try a new spool:
>>>> >>>>
>>>> >>>> cd $spooldir; rm -rf * (be careful)
>>>> >>>>
>>>> >>>> Let it run for a while to build it's spool and web interface. (A
>>>> >>>> new setup requires some time to settle). Then test again.
>>>> >>>
>>>> >>> Was this testing done with the .php files you posted in the
>>>> >>> thread? I'm ready to queue up and run some tests if that is the
>>>> >>> case.
>>>> >>
>>>> >> Yes. The files I posted. I posted two spoolnews.php, use the second
>>>> >> one.
>>>> >>
>>>> >> Gitlab is not up to date.
>>>> >
>>>> > What specifically is supposed to be happening with these updated
>>>> > spam scripts? I re-installed again, and ran it again, and no spam
>>>> > is removed by rslight.
>>>> >
>>>> > I am able to post as blacklisted users: blacklist_from
>>>> > email@domain.url.
>>>> >
>>>> > It has no effect even after reboot and restart of spamd daemon.
>>>> >
>>>> > No incoming spam is blocked. No spam posted from local user account
>>>> > is blocked.
>>>>
>>>> I'm going to create a mod that has a lot of logging and/or echoing so
>>>> we can see exactly what's going on.

Note: The most recent scripts for the spamassassin changes are not on gitlab in the 'devel' branch:
https://gitlab.com/rslight-public/rocksolid-light/-/tree/devel?ref_type=heads

If you checkout 'devel', you'll have the latest files (which are newer than the ones sent through this group recently).

Let's get the 'spamtest.php' working first, of course.

--
Retro Guy

I wrote a bash script as a logging bridge between rslight and spamc.

See the attached file. Instructions are inside the script.

When I run it all the data appears correctly formatted. So other than
potential scoring errors it appears that spamd and rslight do
communicate.

I will be setting up the recommended tests on devel branch.

--
General of the Baggy Jeans Mafia | https://neon.nightbulb.net/firefly

If your jeans don't have room for tools they
are not really jeans; they are denim leotards.

On Sat, 23 Dec 2023 11:04:17 +0000
retro.guy@rocksolidbbs.com (Retro Guy) wrote:

> I have now changed how I decide whether SPAM or HAM and the result
> code from spamc is NOT reliable. I have another way to check that
> appears to be working for me, but let's see your specific errors
> first before trying any more changes.

Can you tell me the exact format of the data that rslight expects from
spamc? For example, does it want a score couplet: (4.7/5.0) or
something like that, or does it want the entire response with the
X-Spam headers? I need to know _exactly_ what rslight is parsing out of
the data that spamc returns to it. It will take me all day to figure
out what the PHP code is doing, but if I know the format and expected
tokens I can get cracking.

If I know the exact format that rslight is searching for, I can put a
tiny program between spamc and rslight and run a manual blacklist from
there with a config file for the tiny app. This would be guaranteed
to catch the blacklisted header datas and return a properly formatted
response. I would mock it up in bash for testing, and if all goes well
I could port it to FreePascal. In Pascal string and integer
handling and queued file access are wicked fast in compiled pascal
binaries, probably 50-100 times faster than bash for a case like this.

--
General of the Baggy Jeans Mafia | https://neon.nightbulb.net/firefly

If your jeans don't have room for tools they
are not really jeans; they are denim leotards.

On Sat, 23 Dec 2023 11:04:17 +0000
retro.guy@rocksolidbbs.com (Retro Guy) wrote:

> Please try the test script with your own testing, but also please try
> including GTUBE in one to see what happens:
> https://spamassassin.apache.org/gtube/

I created a group 'spam.test.filtered' and just post directly to that
group. The messages in there are test messages and they have not
actually been filtered or moved by the spam filters.

This is the result of sending a GTUBE message _before_ upgrading to
devel branch of rslight:

/var/log# grep spamd syslog
2023-12-23T11:12:17.232433-05:00 nixbox spamd[1241]: spamd: connection
from localhost [::1]:41444 to port 783, fd 5
2023-12-23T11:12:17.238372-05:00 nixbox spamd[1241]: spamd: setuid to
rslight succeeded 2023-12-23T11:12:17.254142-05:00 nixbox spamd[1241]:
spamd: processing message (unknown) for rslight:1003
2023-12-23T11:12:17.493160-05:00 nixbox spamd[1241]: spamd: identified
spam (1003.4/5.0) for rslight:1003 in 0.3 seconds, 318 bytes.
2023-12-23T11:12:17.493599-05:00 nixbox spamd[1241]: spamd: result: Y
1003 -
DKIM_ADSP_NXDOMAIN,GTUBE,MISSING_DATE,MISSING_HEADERS,NO_RECEIVED,NO_RELAYS
scantime=0.3,size=318,user=rslight,uid=1057,required_score=5.0,rhost=localhost,raddr=::1,rport=41444,mid=(unknown),autolearn=no
autolearn_force=no

The spamd daemon gives it a score of 1000 as it should but rslight
still accepts and publishes the article:

https://test.sybershock.com/rocksolid/thread.php?group=spam.test.filtered

200 Rocksolid Light NNTP Server ready (no posting)
group spam.test.filtered
211 9 1 9 spam.test.filtered
head 9
221 9 <20231223102238.5f606690@dev> article retrieved - header follows
Date: Sat, 23 Dec 2023 10:22:38 -0600
From: black@hole.url
Newsgroups: spam.test.filtered
Subject: GTUBE TEST 6

I will report after I install the devel branch and test.

--
General of the Baggy Jeans Mafia | https://neon.nightbulb.net/firefly

If your jeans don't have room for tools they
are not really jeans; they are denim leotards.

Syber Shock wrote:

> On Sat, 23 Dec 2023 11:04:17 +0000
> retro.guy@rocksolidbbs.com (Retro Guy) wrote:

>> I have now changed how I decide whether SPAM or HAM and the result
>> code from spamc is NOT reliable. I have another way to check that
>> appears to be working for me, but let's see your specific errors
>> first before trying any more changes.

> Can you tell me the exact format of the data that rslight expects from
> spamc? For example, does it want a score couplet: (4.7/5.0) or
> something like that, or does it want the entire response with the
> X-Spam headers? I need to know _exactly_ what rslight is parsing out of
> the data that spamc returns to it. It will take me all day to figure
> out what the PHP code is doing, but if I know the format and expected
> tokens I can get cracking.

rslight expects the exact console output from spamc, including crlf. The same output you get from the command line 'spamc -E < some.file'

rslight also expects the exit code from spamc, but this has been an issue so in the devel branch, if it receives an exit code of '0' (zero), it checks further into the actual output to determine if it is flagged as spam or not.

So really, just the raw console output and the exit code.

--
Retro Guy

On Sat, 23 Dec 2023 13:48:37 +0000
retro.guy@rocksolidbbs.com (Retro Guy) wrote:

> Retro Guy wrote:
>
> > Retro Guy wrote:
>
> >> SugarBug wrote:
>
> >>> On Fri, 22 Dec 2023 18:23:56 -0700
> >>> Retro Guy <retroguy@novabbs.org> wrote:
>
> >>>> On Fri, 22 Dec 2023 18:15:51 -0600, SugarBug wrote:
> >>>>
> >>>> > On Fri, 22 Dec 2023 13:36:17 -0700
> >>>> > Retro Guy <retroguy@novabbs.org> wrote:
> >>>> >
> >>>> >> On Fri, 22 Dec 2023 14:33:06 -0600, Syber Shock wrote:
> >>>> >>
> >>>> >>> On Fri, 22 Dec 2023 05:54:01 -0700
> >>>> >>> Retro Guy <retroguy@novabbs.org> wrote:
> >>>> >>>
> >>>> >>> <snip>
> >>>> >>>
> >>>> >>>> Try a new spool:
> >>>> >>>>
> >>>> >>>> cd $spooldir; rm -rf * (be careful)
> >>>> >>>>
> >>>> >>>> Let it run for a while to build it's spool and web
> >>>> >>>> interface. (A new setup requires some time to settle). Then
> >>>> >>>> test again.
> >>>> >>>
> >>>> >>> Was this testing done with the .php files you posted in the
> >>>> >>> thread? I'm ready to queue up and run some tests if that is
> >>>> >>> the case.
> >>>> >>
> >>>> >> Yes. The files I posted. I posted two spoolnews.php, use the
> >>>> >> second one.
> >>>> >>
> >>>> >> Gitlab is not up to date.
> >>>> >
> >>>> > What specifically is supposed to be happening with these
> >>>> > updated spam scripts? I re-installed again, and ran it again,
> >>>> > and no spam is removed by rslight.
> >>>> >
> >>>> > I am able to post as blacklisted users: blacklist_from
> >>>> > email@domain.url.
> >>>> >
> >>>> > It has no effect even after reboot and restart of spamd daemon.
> >>>> >
> >>>> > No incoming spam is blocked. No spam posted from local user
> >>>> > account is blocked.
> >>>>
> >>>> I'm going to create a mod that has a lot of logging and/or
> >>>> echoing so we can see exactly what's going on.
>
> Note: The most recent scripts for the spamassassin changes are not on
> gitlab in the 'devel' branch:
> https://gitlab.com/rslight-public/rocksolid-light/-/tree/devel?ref_type=heads
>
> If you checkout 'devel', you'll have the latest files (which are
> newer than the ones sent through this group recently).

I checked out 'devel' and installed fresh on a new subdomain. I set
overrides.inc.php to pull max 10 messages per run with max 100 first
request. Yet each run of the cron takes forever even though there are
only a half-dozen remote groups. And I mean it takes a long, long time.
After six cron runs there are no messages in the spool:

200 Rocksolid Light NNTP Server ready (no posting)
list
215 Newsgroups in form "group high low status"
rocksolid.spam 0 0 y
rocksolid.nodes 0 0 y
rocksolid.nodes.help 0 0 y
rocksolid.shared.test 0 0 y
spam 0 0 y
local.test 0 0 y
spam.test 0 0 y
sci.med.cardiology 0 0 y
alt.religion.christian.roman-catholic 0 0 y
alt.bible 0 0 y

I checked and there are no messages in spool/articles.

https://rslight.sybershock.com/rocksolid/index.php

I'm going to delete the install on that subdomain eventually so this
won't remain up long.

There is alot of spamd activity in syslog (1128 results) but I see
nothing happening with rslight moving spam to the spam group. No
messages are in the spool no matter how much I hammer the cron job.

> Let's get the 'spamtest.php' working first, of course.

I didn't find this file in the git checkout. I assume you will be
working on that later?

The holiday week is coming quick. Soon I'm going to disappear
indefinitely.

--
General of the Baggy Jeans Mafia | https://neon.nightbulb.net/firefly

If your jeans don't have room for tools they
are not really jeans; they are denim leotards.

Syber Shock wrote:

> On Sat, 23 Dec 2023 13:48:37 +0000
> retro.guy@rocksolidbbs.com (Retro Guy) wrote:

>> Retro Guy wrote:
>>
>> > Retro Guy wrote:
>>
>> >> SugarBug wrote:
>>
>> >>> On Fri, 22 Dec 2023 18:23:56 -0700
>> >>> Retro Guy <retroguy@novabbs.org> wrote:
>>
>> >>>> On Fri, 22 Dec 2023 18:15:51 -0600, SugarBug wrote:
>> >>>>
>> >>>> > On Fri, 22 Dec 2023 13:36:17 -0700
>> >>>> > Retro Guy <retroguy@novabbs.org> wrote:
>> >>>> >
>> >>>> >> On Fri, 22 Dec 2023 14:33:06 -0600, Syber Shock wrote:
>> >>>> >>
>> >>>> >>> On Fri, 22 Dec 2023 05:54:01 -0700
>> >>>> >>> Retro Guy <retroguy@novabbs.org> wrote:
>> >>>> >>>
>> >>>> >>> <snip>
>> >>>> >>>
>> >>>> >>>> Try a new spool:
>> >>>> >>>>
>> >>>> >>>> cd $spooldir; rm -rf * (be careful)
>> >>>> >>>>
>> >>>> >>>> Let it run for a while to build it's spool and web
>> >>>> >>>> interface. (A new setup requires some time to settle). Then
>> >>>> >>>> test again.
>> >>>> >>>
>> >>>> >>> Was this testing done with the .php files you posted in the
>> >>>> >>> thread? I'm ready to queue up and run some tests if that is
>> >>>> >>> the case.
>> >>>> >>
>> >>>> >> Yes. The files I posted. I posted two spoolnews.php, use the
>> >>>> >> second one.
>> >>>> >>
>> >>>> >> Gitlab is not up to date.
>> >>>> >
>> >>>> > What specifically is supposed to be happening with these
>> >>>> > updated spam scripts? I re-installed again, and ran it again,
>> >>>> > and no spam is removed by rslight.
>> >>>> >
>> >>>> > I am able to post as blacklisted users: blacklist_from
>> >>>> > email@domain.url.
>> >>>> >
>> >>>> > It has no effect even after reboot and restart of spamd daemon.
>> >>>> >
>> >>>> > No incoming spam is blocked. No spam posted from local user
>> >>>> > account is blocked.
>> >>>>
>> >>>> I'm going to create a mod that has a lot of logging and/or
>> >>>> echoing so we can see exactly what's going on.
>>
>> Note: The most recent scripts for the spamassassin changes are not on
>> gitlab in the 'devel' branch:
>> https://gitlab.com/rslight-public/rocksolid-light/-/tree/devel?ref_type=heads
>>
>> If you checkout 'devel', you'll have the latest files (which are
>> newer than the ones sent through this group recently).

> I checked out 'devel' and installed fresh on a new subdomain. I set
> overrides.inc.php to pull max 10 messages per run with max 100 first
> request. Yet each run of the cron takes forever even though there are
> only a half-dozen remote groups. And I mean it takes a long, long time.
> After six cron runs there are no messages in the spool:

> 200 Rocksolid Light NNTP Server ready (no posting)
> list
> 215 Newsgroups in form "group high low status"
> rocksolid.spam 0 0 y
> rocksolid.nodes 0 0 y
> rocksolid.nodes.help 0 0 y
> rocksolid.shared.test 0 0 y
> spam 0 0 y
> local.test 0 0 y
> spam.test 0 0 y
> sci.med.cardiology 0 0 y
> alt.religion.christian.roman-catholic 0 0 y
> alt.bible 0 0 y

> I checked and there are no messages in spool/articles.

If you were connecting to novabbs.org, it may have been while I was rebuilding the overview. i2pn2.org has some articles, but older ones will be lost also when I "fix" the inn server later tonight.

Otherwise, rocksolid.* can be pulled from one of my rslight servers, just let me know if you want to do that.

> There is a lot of spamd activity in syslog (1128 results) but I see
> nothing happening with rslight moving spam to the spam group. No
> messages are in the spool no matter how much I hammer the cron job.

Still haven't written the code to move it to the spam group. It should just reject it right now (which it does for me).

>> Let's get the 'spamtest.php' working first, of course.

> I didn't find this file in the git checkout. I assume you will be
> working on that later?

I attached that earlier today, here is again attached to this message :)

> The holiday week is coming quick. Soon I'm going to disappear
> indefinitely.

I hope you have a great holiday! :) Merry Christmas (if that's your thing :)

--
Retro Guy

On Sat, 23 Dec 2023 19:02:29 +0000
retro.guy@rocksolidbbs.com (Retro Guy) wrote:

> > I didn't find this file in the git checkout. I assume you will be
> > working on that later?
>
> I attached that earlier today, here is again attached to this message
> :)

How do I use spamtest.php? Where should I place spamtest.php and what
ownership/perms should I apply to it?

SugarBug wrote:

> On Sat, 23 Dec 2023 19:02:29 +0000
> retro.guy@rocksolidbbs.com (Retro Guy) wrote:

>> > I didn't find this file in the git checkout. I assume you will be
>> > working on that later?
>>
>> I attached that earlier today, here is again attached to this message
>> :)

> How do I use spamtest.php? Where should I place spamtest.php and what
> ownership/perms should I apply to it?

Put it in @webdir/rocksolid

Then just call it with a browser. It's all browser based, just paste in a
message and click, the see the spamassassin result.

--
Retro Guy

On Sun, 24 Dec 2023 02:42:11 +0000
retro.guy@rocksolidbbs.com (Retro Guy) wrote:

> SugarBug wrote:
>
> > On Sat, 23 Dec 2023 19:02:29 +0000
> > retro.guy@rocksolidbbs.com (Retro Guy) wrote:
>
> >> > I didn't find this file in the git checkout. I assume you will be
> >> > working on that later?
> >>
> >> I attached that earlier today, here is again attached to this
> >> message :)
>
> > How do I use spamtest.php? Where should I place spamtest.php and
> > what ownership/perms should I apply to it?
>
> Put it in @webdir/rocksolid
>
> Then just call it with a browser. It's all browser based, just paste
> in a message and click, the see the spamassassin result.

Now we're cooking with gas ...

--
1_|1_|4_|4_ 3883@sugar.bug
3_|8_|8_|3_ https://sybershock.com
7_|7_|6_|6_ news://alt.sources.crypto
4_|4_|7_|7_ #CipherTag #WaffleTag #Cryptologer

I'm now logging every message that passes through the spam function 'check_spam'.

If it's spam or not, it's logged. I just want to see that it makes it to the function.

This one was posted via the web interface (on www.novabbs.com):
Dec 24 20:37:51 Checked: mitchalsup@aol.com (MitchAlsup) comp.arch <a2e0c137e4b34a03e8acaeca5111a75b@news.novabbs.com>

This one posted via a newsreader (by me):
Dec 24 20:45:38 Checked: Retro Guy <retroguy@i2pn2.org> local.post

This one retrieved from 'remote_server' in spoolnews:
Dec 24 20:45:12 Checked: Nomen Nescio <nobody@dizum.com> alt.privacy.anon-server, news.admin.peering, <ca8d006398635abd6797fd9ff914061e@dizum.com>

At least now I can check if they actually make it to the function, which is seems they do.

I have had no problems when they actually are spam, I just haven't had spam since I added the logging. I'll mess with that later, but right now all messages go through 'check_spam'.

Btw, there is a toggle in overrides.inc.php to disable checking from 'remote_server' if you choose to. I put that their because I plan to disable that since my upstream server is already filtered. rslight will still check local posting (web and newsreader).

--
Retro Guy