Mail Piler on Synology Docker

[klar574]

Hello, does anyone have a working guide on how to install Piler 1.4.7 on a Synology? I've already tried a few things; the containers start successfully, but when I access the website, I get the error: Error: SQLSTATE[HY000] [1046] no such database sphinx on database: sphinx. And I just can't get any further. Version 1.4.5 has been running without any problems so far. Regards

[jsuto]

The 1.4.5 docker image ships an older manticore release. Starting from 10.1.x manticore introduced an incompatibility that needs to be addressed. The fix is already on the master branch, but the docker image hasn't been created yet, because there's no new release yet. I need a little more time to release 1.4.8.

[jsuto]

The new image (1.4.8) is on its way, expect it EOD today.

[jsuto]

In response to your last message: starting the piler daemon is the last step of the bootstrapping. What processes are running in the piler container? What are the last 20-30 lines of /var/log/mail.log?

[klar574]

Hello jsuto,

I can't get version 1.4.8 to run properly and hope you can help me. I successfully installed Piler using the configuration attached. I can log in and configure Piler. However, no emails are arriving in the archive with this version. I'm just not getting any further. I think there's a permissions issue somewhere or something!? Greetings klar574
dockerfile.txt

`
version: "3.8"

services:
mysql:
image: mariadb:12.0.2
container_name: mysql-piler
restart: unless-stopped
environment:
- MYSQL_DATABASE=piler
- MYSQL_USER=piler
- MYSQL_PASSWORD=piler123
- MYSQL_ROOT_PASSWORD=RootPasswort123! # Sicheres Root-Passwort
command: --character-set-server=utf8mb4 --collation-server=utf8mb4_unicode_ci
volumes:
- /volume1/docker/piler/mysql:/var/lib/mysql
- /volume1/docker/piler/piler.cnf:/etc/mysql/conf.d/piler.cnf:ro
mem_limit: 512m

manticore:
image: manticoresearch/manticore:13.11.0
container_name: manticore-piler
restart: unless-stopped
volumes:
- /volume1/docker/piler/manticore.conf:/etc/manticoresearch/manticore.conf
- /volume1/docker/piler/manticore:/var/lib/manticore
mem_limit: 512m

memcached:
image: memcached
container_name: memcached
command: -m 64
restart: unless-stopped

piler:
image: sutoj/piler:1.4.8
container_name: piler
init: true
restart: unless-stopped
environment:
- MANTICORE_HOSTNAME=manticore
- MEMCACHED_HOSTNAME=memcached
- MYSQL_HOSTNAME=mysql
- MYSQL_DATABASE=piler
- MYSQL_USER=piler
- MYSQL_PASSWORD=piler123
- PILER_HOSTNAME=piler.xxxxxxxx.xxxxxxxx.me
- RT=1
ports:
- "25:25"
- "81:80" # bei Bedarf anpassen oder per Reverse Proxy einbinden
volumes:
- /volume1/docker/piler/etc:/etc/piler
- /volume1/docker/piler/store:/var/piler/store
healthcheck:
test: ["CMD", "curl", "-f", "http://localhost/"]
interval: 20s
timeout: 3s
retries: 3
mem_limit: 512m
depends_on:
- mysql
- memcached
- manticore
`

[jsuto]

For starters, check the logs for each service in the docker-compose stack, and verify that they are running fine. Then check the piler container /var/log/mail.log file, and look for lines for incoming emails.

[klar574]

Hi jsuto,

I found the problem. I had to adjust the permissions on the store on the Synology. After that, the emails started coming in again. I still have an old store directory with 32GB of data. Is there any way I can import it back?

[jsuto]

If the piler database related to the old store directory doesn't exist, then not really. There might be a tool out there that's able to recreate the meta data from the stored files, but I'm not aware of it.

[klar574]

I made a backup of the folders on the NAS, and now I have it running again to the point where the archive with emails is showing up in the status bar. However, no emails are displayed for the users or under the auditor. Is there still hope?

[jsuto]

To show the emails you need both the old index database and the piler mysql database. The stored files in /var/piler/store are not enough alone.

[klar574]

I restored the folders on the NA with the old data before re-rolling the stack via Portainer. So, all the old data should be there again in the folders etc., manticore, mysql, and store. Is there anything else I can do here, or do you think the emails are lost?

[jsuto]

Well, if you have everything then your emails are not lost. So try a search, hit the red button, and see what happens. Be sure to check the mail log in case of an error, piler syslogs every issue it encounters.