Error while storing uploaded file

[ndne]

Hello,

I'm not sure if this is the right repository to ask.

I have an issue where I can't create a store (I tried shapefile and gpkg) using the rest API.
Doing it from the web interface works well.
The rest API to create a workspace works as expected but when uploading a shapefile, geoserver returns:

[…]
geoserver-1 | 27 Jan 09:16:12 DEBUG [geoserver.security] - ~~~~~~~~~~ antPath= /** methodList= [POST, DELETE, PUT]
geoserver-1 | 27 Jan 09:16:12 DEBUG [geoserver.security] - Candidate is: '/rest/workspaces/acme/datastores/roads/file.shp'; antPath is /**; matchedPath=true; matchedMethods=true
geoserver-1 | 27 Jan 09:16:12 DEBUG [geoserver.security] - returning ROLE_ADMINISTRATOR
geoserver-1 | 27 Jan 09:16:12 TRACE [geoserver.monitor] - Testing /rest/workspaces/acme/datastores/roads/file.shp for monitor filtering
geoserver-1 | 27 Jan 09:16:12 DEBUG [geoserver.ows] - Could not find a layer group named rest
geoserver-1 | 27 Jan 09:16:12 DEBUG [org.geoserver] - Thread 41 locking in mode WRITE
geoserver-1 | 27 Jan 09:16:12 DEBUG [org.geoserver] - Thread 41 got the lock in mode WRITE
geoserver-1 | 27 Jan 09:16:12 DEBUG [security.impl] - Filesystem sandbox: /mnt/
geoserver-1 | 27 Jan 09:16:12 ERROR [geoserver.rest] - Error while storing uploaded file:
geoserver-1 | org.geoserver.rest.RestException 500 INTERNAL_SERVER_ERROR: Error while storing uploaded file:
[…]
geoserver-1 | Caused by: java.lang.IllegalStateException: Could not create file.
geoserver-1 | at org.geoserver.platform.resource.Files$ResourceAdaptor.file(Files.java:185)
geoserver-1 | at org.geoserver.platform.resource.Files$ResourceAdaptor.out(Files.java:111)
geoserver-1 | at org.geoserver.rest.util.RESTUtils.handleBinUpload(RESTUtils.java:128)
geoserver-1 | at org.geoserver.rest.catalog.AbstractStoreUploadController.handleFileUpload(AbstractStoreUploadController.java:70)
geoserver-1 | ... 139 more

I checked the file permissions by connecting to the geoserver instance and it's good. I can do touch file inside the /mnt/geoserver_datadir/workspace/acme.

Upload was working fine with the branch 23. (nginx -> traefik)

My configuration is nginx on the front (https) which reverse proxy to caddy (http).

I deactivated https in the caddyfile by commenting the tls line and adding http in front of the FQDN variable.
http://{$FQDN} {
}

I don't know if it is related but I needed to add the csrf environment variable to the geoserver docker service because some pages from the web admin were returning 400 error code. https://docs.geoserver.org/latest/en/user/security/webadmin/csrf.html

[jeanmi151]

Hello @ndne ,
What command did you use to create to talk to geoserver rest API ?
the message " Could not find a layer group named rest" make me think you are not using a good parameter/endpoint to create your store

[ndne]

This is the snippet I'm using:

from geo.Geoserver import Geoserver
geo = Geoserver(url + "/geoserver", username=username, password=password)
geo.create_workspace(workspace=workspace)
geo.create_shp_datastore(path=pathfile, store_name="ds", workspace=workspace)

I just cloned a fresh repository of the branch 24 and the hereabove snippet works.
I tried again with a fresh clone of the branch 25 and the same error arises on create_shp_datastore.

By fresh install I mean removing all previous containers and volumes and modifying the bare minimum (for debuging purpose):

• fqdn in .envs-common
• disable https in the caddyfile

It might not be relevant but the ogc-data-api service does not start due to some missing env variables.

Should I stay on branch 24 ?

[jeanmi151]

Ah, you are using https://pypi.org/project/geoserver-rest/ ,
I tried it once, didn't work with geoserver (even without geOrchestra)

Maybe you could try https://github.com/georchestra/geo-utils that is using https://github.com/camptocamp/python-geoservercloud
this works, and I use it, I might be able to help you!

[ndne]

Yes I'm using the geoserver-rest python package and I also tried with curl requests from the geoserver documentation.

This is what I tried:

curl -v -u testadmin -XPOST -H "Content-type: text/xml" -d "acme" https://mydomain.fr/geoserver/rest/workspaces

curl -v -u testadmin -XPUT -H "Content-type: application/zip" --data-binary @/path/to/data.zip https://mydomain.fr/geoserver/rest/workspaces/acme/datastores/roads/file.shp

version	create workspace	upload shapefile
24	ok	ok
25	ok	500 Error while storing uploaded file:

geoserver-rest leads to the same results.

[jeanmi151]

In geOrchestra 25 geoserver implement now (by default) Filesystem sandbox see documentation https://docs.geoserver.org/stable/en/user/security/sandbox.html
maybe you try to store it outside this sandbox (/mnt)

could you try to disable it to test !

[ndne]

Adding GEOSERVER_FILESYSTEM_SANDBOX=/mnt/geoserver_datadir to the environment section of geoserver service in the docker-compose.yml file fixed the issue.
Thank you very much.

[jeanmi151]

Happy I could help you !
We did forget to add this env var in the docker compose !

Don't hesitate to make a pull request to add it into master (and with label backport-25.0)

we did it for the helm chart here https://github.com/georchestra/helm-charts/pull/198/changes#diff-9b1a72f49428742164f428388d592c1191ccfeb2c1cd111398b2893c08e2a651R188

[ndne]

I'll do a pull request.
(I've also noticed missing env var for ogc-api-records service.)