Anonymous <poster@anon.com> wrote:
> yes i can see json :-)
> what about it ? what do you achieve with that code ?

I saw some discussions about people wanting some JSON access to rocksolid, so
this is another. As it was trivial to add JSON support to my read-only
web NNRP interface, I did it.

>I saw some discussions about people wanting some
>JSON access to rocksolid, so

I guess you refer to Retro Guy and myself discussing. The interface I introduced on one of my nodes is using json now to receive posts that are synced from other nodes (+ there is a json api already that comes with it).

> As it was trivial to add JSON support to my read
>only web NNRP interface, I did it.

yeah, i took a look at the link (also linked your site here, btw).

cheers

trw

--
Posted on def2

>-fix date for message import

this one turns out to be really tough. i think it was not meant to work that way (so, to have the original posting time).

i have this line here in the function post (functions.php), which sets the time for the article to be inserted:

$query->bindValue(':time', isset($post['time']) ? $post['time'] : time(), PDO::PARAM_INT);

so, if we don't have a time, we take the current time. this is how i read this line.
but for some reason even if the variable is set to the original time of the article, the current time is taken instead.
maybe it has to do the complicated callback construct that they use (which i don't fully understand).

:-(

trw

--
Posted on def2

had nothing to do with the callback function, i was simply setting the variable after it was used.

new status:

open:
-fix proper handling of attachments from imported messages
-code simplification and cleanup

closed:
-fix date for message import
-fix catalog link in the footer, catalog is off: i thought i had to change the templates, but it is just a switch in the config
-fix threading: fixed some issues in the import script
-mime encode subject if needed: thx to Retro Guys line

after i have fixed the part with the attachments, i will reimport all the messages one last time.

cheers

trw

--
Posted on def2

open:
-code simplification and cleanup

closed:
-fix proper handling of attachments from imported messages
-fix date for message import
-fix catalog link in the footer, catalog is off: i thought i had to change the templates, but it is just a switch in the config
-fix threading: fixed some issues in the import script
-mime encode subject if needed: thx to Retro Guys line

Retru, do you want to test this as well ? Do you want to roll out vichan, or wait a little longer (until all the bugs are hope fully squashed) ?

cheers

trw

--
Posted on def2

trw wrote:

> open:
> -code simplification and cleanup

> closed:
> -fix proper handling of attachments from imported messages
> -fix date for message import
> -fix catalog link in the footer, catalog is off: i thought i had to change the templates, but it is just a switch in the config
> -fix threading: fixed some issues in the import script
> -mime encode subject if needed: thx to Retro Guys line

It's really looking good! I haven't checked out imported messages with attachments yet, but it sounds like you have it working :)

> Retru, do you want to test this as well ? Do you want to roll out vichan, or wait a little longer (until all the bugs are hope fully squashed) ?

I would like to check it out, and eventually set one up as a node. I'm interested in seeing the nntp code (send/receive) and maybe also find some nice ideas for future stuff.

If it can be placed in a tarball or something, I'll try it out. I think it requires mysql, if I'm not mistaken.

Retro Guy

--
Posted on: Rocksolid Light
www.novabbs.com

>It's really looking good! I haven't checked out imported messages with attachments yet, but it sounds like you have it working :)

yes, it looks like it (you can check on def2.i2p/ts how it displays). of course all depends on getting the attachment first (so the rslight code). thats's why it's great news for me that you solved these darn inline attachments (like def3 makes).

>I would like to check it out, and eventually set one up as a node.

ok, i will upload an archive with the code (attached to this message).

>I'm interested in seeing the nntp code (send/receive) and maybe also find some nice ideas for future stuff.

well, you will see a lot of your own code :-).

the question for me is how soon you will roll out. if it is sooner, i will work on one last point first before the cleanup, which is the direct syncing between two vichan nodes, using the modified post.php. if you will wait a little longer, i will clean up the code first and than add that feature when needed.

>If it can be placed in a tarball or something, I'll >try it out. I think it requires mysql, if I'm not >mistaken.

yes, you need mysql and pdo to run vichan. if you go back to the original tinyIB code, there is an option to run with flat files. but the setup process of vichan was absolutely painless for me, so i did not really investigate further.

let me know if you need help to run the code, it is still very rough.
you will need to adapt sync.php and nntpchan.php to reflect your directories and news server settings.

cheers

trw

please find attached the latest code archive, the other one was missing a file. also the update concerning the attachments is included.

cheers

trw

Anonymous wrote:

> please find attached the latest code archive, the other one was missing a file. also the update concerning the attachments is included.

Thanks! I'll take a look at this in a couple of days. I'm quite curious to see how vichan is written.

Retro Guy

--
Posted on: Rocksolid Light
www.novabbs.com

Retro Guy wrote:

> Anonymous wrote:

>> please find attached the latest code archive, the other one was missing a file. also the update concerning the attachments is included.

> Thanks! I'll take a look at this in a couple of days. I'm quite curious to see how vichan is written.

I've downloaded and installed (on top of vichan-devel). I kept the dir structure from your zip and put it into the devel structure. Then installed (seems vichan requires php-mcrypt) but that's not listed in Requirements in the README).

Anyway, it installs easily, and I set the nntp server in config file. I then found sync.php and ran it as www-data user in the directory it's in (./debug). Not sure if I was supposed to run it, or move it elsewhere, or run it from another dir, but I ran it from there. It created the thread files in ./threads fine (nice).

What I don't know is how to I tie those to the boards in vichan? So, what did I do wrong, or what have I not done yet that I need to do? :)

Thanks,

Retro Guy

--
Posted on: Rocksolid Light
www.novabbs.com

>Then installed (seems vichan requires php-mcrypt) but that's not listed in Requirements in the README).

Strange, either I had that installed already, or there is something different between our installations. I don't recall having to do that.

>Anyway, it installs easily, and I set the nntp server in config file.

Good, that was the same for me, installation was easy.

>I then found sync.php and ran it as www-data user in the directory it's in (./debug). Not sure if I was supposed to run it, or move it elsewhere, or run it from another dir, but I ran it from there.

That's fine. It can run from anywhere, and you can run it from cli or call it from cron.
Did you put gpost.php in the webroot (next to post.php) ?

> It created the thread files in ./threads fine (nice).

There should also be a dir named "watermarks". If not, something went wrong.

>What I don't know is how to I tie those to the boards in vichan?

Each board needs to be set in its config file, and there you make the connection to the newsgroup.
Also in sync.php there is an array called "translation" which needs to be set (I will take that from the central config later).

> So, what did I do wrong, or what have I not done yet that I need to do? :)

I would suggest to start with one group only:
-set it in the central config
-set it in the board config
-set it in sync.php
and let run again.

What is the content of error.log and application.log ?

cheers

trw

Posted on def4

anon wrote:

>>I then found sync.php and ran it as www-data user in the directory it's in (./debug). Not sure if I was supposed to run it, or move it elsewhere, or run it from another dir, but I ran it from there.

> That's fine. It can run from anywhere, and you can run it from cli or call it from cron.
> Did you put gpost.php in the webroot (next to post.php) ?

Yes, I left the structure the same and copied the files into the distribution.

>> It created the thread files in ./threads fine (nice).

> There should also be a dir named "watermarks". If not, something went wrong.

It is there, and populated with files for each group.

>>What I don't know is how to I tie those to the boards in vichan?

> Each board needs to be set in its config file, and there you make the connection to the newsgroup.
> Also in sync.php there is an array called "translation" which needs to be set (I will take that from the central config later).

I see the translation array in gpost.php, but not in sync.php.

>> So, what did I do wrong, or what have I not done yet that I need to do? :)

> I would suggest to start with one group only:
> -set it in the central config
> -set it in the board config
> -set it in sync.php
> and let run again.

I've been trying this but I'm not sure how to 'set it'. I've tried several variations on adding it to the array in each, but nothing changes. sync.php builds stuff, but I don't see how it gets put into the db.

Can you list an example line to add/change for each file?

> What is the content of error.log and application.log ?

Nothing in error.log.

application.log looks ok:

no index found for group rocksolid.shared.test, building it
building index for group rocksolid.shared.test
update for group rocksolid.shared.testsolid.shared.testest
syncing message # 1 from group rocksolid.nodes

Obviously, I don't understand how it all ties together, but I'd like to get it working if possible.

Retro Guy

--
Posted on: Rocksolid Light
www.novabbs.com

>I see the translation array in gpost.php, but not in sync.php.

yes, sorry, this is what i meant.

>I've been trying this but I'm not sure how to 'set it'. I've
>tried several variations on adding it to the array in each,
>but nothing changes.

i will post a config example.

the way a synced article gets inserted in the db is that sync.php calls gpost.php and tells it to.
if you don't see any error message in application.log this should have worked already.

Posted on def4

this is the relevant part of the central config file (./inc/config.php):

$config['nntpchan'] = array();

// Enable NNTPChan integration
$config['nntpchan']['enabled'] = true;

// NNTP server
$config['nntpchan']['server'] = "192.168.1.1:1119";
$config['nntpchan']['name'] = "username";
$config['nntpchan']['password'] = "password";

// Global dispatch array. Add your boards to it to enable them. Please make
// sure that this setting is set in a global context.
$config['nntpchan']['dispatch'] = array(
'rocksolid.nodes' => 'n',
'rocksolid.nodes.help' => 'nh',
'rocksolid.nodes.announce' => 'na',
'rocksolid.shared.encryption' => 'ec',
'rocksolid.shared.entertainment' => 'et',
'rocksolid.shared.freenet' => 'f',
'rocksolid.shared.general' => 'g',
'rocksolid.shared.hacking' => 'ha',
'rocksolid.shared.helpdesk' => 'he',
'rocksolid.shared.i2p' => 'i',
'rocksolid.shared.linux' => 'l',
'rocksolid.shared.news' => 'ne',
'rocksolid.shared.offtopic' => 'b',
'rocksolid.programming' => 'code',
'rocksolid.shared.rocksolid' => 'r',
'rocksolid.shared.security' => 'opsec',
'rocksolid.social' => 'soc',
'rocksolid.shared.test' => 'ts',
'rocksolid.shared.tor' => 'to',
); // 'overchan.test' => 'test'

// Trusted peer - an IP address of your NNTPChan instance. This peer will have
// increased capabilities, eg.: will evade spamfilter.
$config['nntpchan']['trusted_peer'] = '127.0.0.1';

// Salt for message ID generation. Keep it long and secure.
$config['nntpchan']['salt'] = 'something_very_long_and_radom';

// A local message ID domain. Make sure to change it.
$config['nntpchan']['domain'] = 'yourdomain.org';

the server data of the nntp server ( $config['nntpchan']['server'], $config['nntpchan']['name'] and
$config['nntpchan']['password'])
is not actually important, since the posting works differently now (by dropping the message in the outspool), but i set them regardless.

Posted on def4

and this is the relevant part of the local config (so, for a board called "ts" this is ./ts/config.php):

$config['nntpchan'] = array();

// Enable NNTPChan integration
$config['nntpchan']['enabled'] = true;

// NNTP server
$config['nntpchan']['server'] = "localhost:10119";

// Trusted peer - an IP address of your NNTPChan instance. This peer will have
// increased capabilities, eg.: will evade spamfilter.
$config['nntpchan']['trusted_peer'] = '127.0.0.1';

// Salt for message ID generation. Keep it long and secure.
$config['nntpchan']['salt'] = 'something_long_and_random';

// A local message ID domain. Make sure to change it.
$config['nntpchan']['domain'] = 'yourdomain.org';

// An NNTPChan group name.
// Please set this setting in your board/config.php, not globally.
$config['nntpchan']['group'] = 'rocksolid.shared.test';
again, this one here ($config['nntpchan']['server']) does not do anything, but I set it regardless.

if you ran sync.php and it put out "syncing message yxz" and there is no error message, but the message is not visible, i would suspect that it was silently dropped because something was not defined.

let me know if that helped.

cheers

trw

Posted on def4

and the most likely reason why this did not work is that you need to adapt the server settings in the file sync.php to reflect yours, i think i forgot to mention before, sorry.
it is in line 398.

cheers

trw

--
Posted on def4

Interesting thread....
--
Posted on: novaBBS
www.novabbs.com

-fix date for message import
-fix proper handling of attachments from imported messages
-fix catalog link in the footer, catalog is off

-fix threading

-mime encode subject if needed

I use the method shown here:

$ cat test.php
<?php
echo "Subject: ".mb_encode_mimeheader(quoted_printable_decode($argv[1]))."rn";
?>

$ php ./test.php Unnecessary
Subject: Unnecessary
$ php ./test.php измена
Subject: =?UTF-8?B?0LjQt9C80LXQvdCw?=
$ php ./test.php "High измена"
Subject: High =?UTF-8?B?0LjQt9C80LXQvdCw?=

--
Posted on: rslight Debian test site
nyccgjh5cjapsf7frrhxqw73gb5hxj2ucau72ztn2oenxwetxr5q.b32.i2p

Retro Guy wrote:

> I use the method shown here:

> $ cat test.php
> <?php
> echo "Subject: ".mb_encode_mimeheader(quoted_printable_decode($argv[1]))."rn";
> ?>

> $ php ./test.php Unnecessary
> Subject: Unnecessary
> $ php ./test.php измена
> Subject: =?UTF-8?B?0LjQt9C80LXQvdCw?=
> $ php ./test.php "High измена"
> Subject: High =?UTF-8?B?0LjQt9C80LXQvdCw?=

The above message is on my test site, but not on def2...

Retro Guy

--
Posted on: Rocksolid Light
www.novabbs.com

Retro Guy wrote:

> Retro Guy wrote:

>> I use the method shown here:

>> $ cat test.php
>> <?php
>> echo "Subject: ".mb_encode_mimeheader(quoted_printable_decode($argv[1]))."rn";
>> ?>

>> $ php ./test.php Unnecessary
>> Subject: Unnecessary
>> $ php ./test.php измена
>> Subject: =?UTF-8?B?0LjQt9C80LXQvdCw?=
>> $ php ./test.php "High измена"
>> Subject: High =?UTF-8?B?0LjQt9C80LXQvdCw?=

> The above message is on my test site, but not on def2...

BTW, I have my test site using the same server and b32.i2p address as def2 uses for upstream. I wanted to duplicate as closely as possible. Also to note, the upstream server (i2p2n) is not local to me, so I'm not syncing with a server in the same location, i2pn2 is a remote leased server and my test server is a local to me vm.

--
Posted on: Rocksolid Light
www.novabbs.com

>The above message is on my test site, but not on def2...

yeah, saw that. it is on neither side of def2. seems linked to the group (although the group as such is displayed again on rslight, but not social).

Posted on def4

open:

-fix date for message import
-fix proper handling of attachments from imported messages

closed:
-fix catalog link in the footer, catalog is off: i thought i had to change the templates, but it is just a switch in the config
-fix threading: fixed some issues in the import script
-mime encode subject if needed: thx to Retro Guys line
Posted on def2.i2p