How to increase limit for request body size?

[liss-h]

Hi,
is there a way to increase the maximum accepted size of request bodies (= size in bytes of sparql query strings) in fuseki? I couldn't find anything online regarding that.

Usecase:
A third party application sends very large INSERT DATA queries and they get rejected by fuseki because they are too large. I know it does not make sense to send INSERT DATA queries that large because graph store protocol exists, but we don't control the third party application.

[afs]

To make sure we're talking about the same details: different versions of Jetty (if this is a Jetty based Fuseki) have different settings.

• Which version of Fuseki?
• How is the update requests sent? Content type application/sparql-update or as an HTML form?
• Just how large is "large"?
• What is the storage used?
• What error are you getting in the log file?

[liss-h]

Q: Which version of Fuseki?
A: 5.3.0

Q: How is the update requests sent? Content type application/sparql-update or as an HTML form?
A: HTML form

Q: Just how large is "large"?
A: up to 9MB

Q: What error are you getting in the log file?
A:

18:20:36 WARN  ServletApiRequest :: java.util.concurrent.CompletionException: java.lang.IllegalStateException: form too large > 1048576
18:20:36 WARN  Fuseki          :: [14] RC = 500 : 400: Unable to parse form content
org.eclipse.jetty.http.BadMessageException: 400: Unable to parse form content
	at org.eclipse.jetty.ee10.servlet.ServletApiRequest.extractContentParameters(ServletApiRequest.java:1004) ~[fuseki-server.jar:5.3.0]

[..]

[afs]

In Jetty12, it is only HTML forms that have size limits.

Workaround for Fuseki 5.3.0: One way to set this is to use a Java system property: (this is 20Mbytes):
-Dorg.eclipse.jetty.server.Request.maxFormContentSize=20971520

For the fuseki-server script:
export JVM_ARGS="--Xmx4G -Dorg.eclipse.jetty.server.Request.maxFormContentSize=20971520

If that is confirmed to work (I can't easily try it just at the moment), then this is a Fuseki bug to fix in 5.4.0.
Fuseki 5.2.0 has higher limits than 5.3.0 has.

Another way is to send large requests, while still using INSERT DATA, is to POST with content type application/sparql-update.

[liss-h]

That did not work, still getting (exactly) the same error message. So I think this is getting ignored somehow. The exact command I ran was:

JVM_ARGS="-Xmx4G -Dorg.eclipse.jetty.server.Request.maxFormContentSize=209715200" ./fuseki-server --mem ds

I'll try fuseki 5.2.0, maybe this will give some insight

[liss-h]

I'll try fuseki 5.2.0, maybe this will give some insight

That just works (without the JVM_ARGS).

Should I create an issue?

[afs]

I can recreate the situation.

Issue #3110

fuseki-server.jar 5.2.0 works because it is a different architecture (it's a webapp/war file and server packed as one jar).

5.3.0 is a not webapp.

I have tried a fix but Jetty is not picking up the increased HTML form size limit whether set using a system property or by API calls during server build.

[afs]

I'm afraid there isn't a workaround for 5.3.0. The Jetty system property setting will be overridden by Fuseki (it was setting the buffer size but only to 1Mbyte and this was fixed and overrides any settings).

[liss-h]

Ok, thanks for investigating. We'll just downgrade to 5.2.0 until this is fixed