Error message in apache error.log

I’m getting a huge number of this error in the logs

Any Error Messages

none

(8)Exec format error: AH00088: exec of '/usr/sbin/sympl-web-logger' failed

Environment

  • Sympl Version [9.0/10.0]: 10
  • Sympl Testing Version? [Yes/No] yes
  • Debian Version [Buster/Stretch]: buster
  • Hardware Type? [Dedicated/Virtual/Pi] Pi
  • Hosted On? [name of hosting co] local network

The sympl-web-logger is piped the log lines from Apache, and then writes them to the relevant log, but it sounds like it’s not executable (or not there)?

If you run stat /usr/sbin/sympl-web-logger and dpkg -l sympl* what output do you get?

This is what I got:
$ stat /usr/sbin/sympl-web-logger
File: /usr/sbin/sympl-web-logger
Size: 1889384 Blocks: 3696 IO Block: 4096 regular file
Device: b302h/45826d Inode: 46448 Links: 1
Access: (0755/-rwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root)
Access: 2020-04-21 18:42:30.000000000 +0100
Modify: 2019-12-16 11:45:02.000000000 +0000
Change: 2020-04-21 18:43:21.012412828 +0100
Birth: -

and
dpkg -l sympl*
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend
|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)
||/ Name Version Architecture Description
++±================-=============-============-==================================================================
ii sympl-backup 10.0.190908.0 all Automatically backup your files
un sympl-common (no description available)
ii sympl-core 10.0.200420.0 all Easy, complete, and friendly server administration system
ii sympl-cron 10.0.190719.0 armhf Provide per-domain crontab support
ii sympl-dns 10.0.190621.0 all Automatic DNS record creation and uploading for Bytemark customers
ii sympl-firewall 10.0.190918.0 armhf Sympl firewall generator
ii sympl-ftp 10.0.190624.0 all Tools to manage FTP virtual hosting
ii sympl-mail 10.0.200418.0 all virtual hosting solution for email
ii sympl-monit 10.0.200326.0 all Service monitoring and restarting
ii sympl-mysql 10.0.190731.0 all MySQL metapackage for Sympl.
ii sympl-phpmyadmin 10.0.190621.0 all This package gives remote database access
ii sympl-updater 10.0.190621.0 all Automatic package upgrades
iF sympl-web 10.0.191216.0 all Tools to manage Apache virtual hosting in Sympl
ii sympl-webmail 10.0.200127.0 all Provide webmail access to a Sympl system using Roundcube

Note the iF on sympl-web

So I decided that maybe there was a misconfiguration somewhere, so I got out a fresh microSD card and installed Debian Buster and then Sympl testing from scratch.

Now I get the same from the first test, and now all is well with the second, including the line:
ii sympl-web 10.0.191216.0 all Tools to manage Apache virtual hosting in Sympl

Unfortunately, that has not fixed the problem. The error log is still full of lines that say
AH00106: piped log program ’ /usr/sbin/sympl-web-logger -l ssl_access.log /var/log/apache2/zz-mass-hosting.ssl_access.log’ failed unexpectedly
[Tue Apr 21 19:14:48.920948 2020] [core:error] [pid 2999] (8)Exec format error: AH00088: exec of ‘/usr/sbin/sympl-web-logger’ failed
[Tue Apr 21 19:14:48.925356 2020] [core:error] [pid 3001] (8)Exec format error: AH00088: exec of ‘/usr/sbin/sympl-web-logger’ failed

This is a virgin install of Sympl -testing, with only a couple of hostnames added under /srv/

By the way, the public/logs directories were created automatically, and ssl_access.log is being populated as I’d expect.
Of course, in raspberrpi.localdomain the public/logs/ssl_error.log is filled instead, with stuff like

[Tue Apr 21 19:07:29.793000 2020] [ssl:error] [pid 585] AH02217: ssl_stapling_init_cert: can’t retrieve issuer certificate! [subject: CN=raspberrypi.localdomain / issuer: CN=raspberrypi.localdomain / serial: 5E9F307C / notbefore: Apr 21 17:42:20 2020 GMT / notafter: Apr 21 17:42:20 2021 GMT]
[Tue Apr 21 19:07:29.793961 2020] [ssl:error] [pid 585] AH02604: Unable to configure certificate raspberrypi.localdomain:443:0 for stapling

I’ve investigated, and it looks sympl-web-logger (which is compiled Go) isn’t being built seperately for armhf systems, so it only affects Raspberry Pi’s.

Here’s a quick workaround to compile it for the Pi, at which point it should stop throwing errors and work normally.

sudo su -
apt -y install git golang
cd ~
git clone https://gitlab.mythic-beasts.com/sympl/sympl.git
cd sympl/web
go build sympl-web-logger.go
cp sympl-web-logger /usr/sbin/sympl-web-logger

Alternatively, you can run sudo a2dissite zz-mass-hosting*; service apache2 reload which will disable the default site and mass hosting configuration.

I’ll log an issue now and should be able to push updated packages in the next day or so.

That seems to have fixed it, thanks.

I suspect this should be a fairly quick fix - it looks like SSL Stapling is enabled for self-signed certs when it shouldn’t be, so I’ve logged an issue to investigate properly.

Both of these are now fixed in stable and testing, with updated logic for SSL Stapling (which resolves the log issue), and proper packages for armhf (which fixes the sympl-web-logger issue).

@hairydog: You should be able to run sympl update now to update the package for a more permanent fix.

Splendid! Many thanks.