"Connection to server lost" error when uploading/downloading large files #4678

logomancer · 2017-05-03T16:51:57Z

Steps to reproduce

Log in to Nextcloud instance.
Attempt to upload a large (>10MB) file.

Expected behaviour

File should be uploaded and stored in the directory of the user's file share.

Actual behaviour

Uploaded ceases abruptly with a "connection to server lost" error.

This error has also been seen when downloading large files to an Android device, and sporadically when listing files or using the News app.

Server configuration

Operating system: Debian jessie

Web server: nginx 1.13.0 (based on Docker image wonderfall/nginx-php)

Database: MariaDB 10.1.22+maria-1~jessie (based on Docker image mariadb)

PHP version: 7.1.4 (based on Docker image wonderfall/nginx-php)

Nextcloud version: 12.0.0 (but also seen on 11.2 and 11.3)

Redis version: 3.2.8 (based on Docker image redis:alpine)

Updated from an older Nextcloud/ownCloud or fresh install: Upgraded from older version, but verified present on clean install of 11.3.

Where did you install Nextcloud from: Docker container based on wonderfall/nextcloud:12.0

Signing status:

Signing status

No errors have been found.

List of activated apps:

App list

Enabled:
  - calendar: 1.5.2
  - contacts: 1.5.3
  - dav: 1.3.0
  - federatedfilesharing: 1.2.0
  - federation: 1.2.0
  - files: 1.7.2
  - files_markdown: 1.0.1
  - files_opds: 0.8.2
  - files_pdfviewer: 1.1.1
  - files_reader: 1.0.4
  - files_sharing: 1.4.0
  - files_texteditor: 2.4.1
  - files_trashbin: 1.2.0
  - files_versions: 1.5.0
  - files_videoplayer: 1.1.0
  - gallery: 17.0.0
  - logreader: 2.0.0
  - lookup_server_connector: 1.0.0
  - news: 10.2.0
  - nextcloud_announcements: 1.1
  - notifications: 2.0.0
  - provisioning_api: 1.2.0
  - serverinfo: 1.2.0
  - sharebymail: 1.2.0
  - survey_client: 1.0.0
  - tasks: 0.9.5
  - theming: 1.3.0
  - twofactor_backupcodes: 1.1.0
  - updatenotification: 1.2.0
  - workflowengine: 1.2.0
Disabled:
  - activity
  - admin_audit
  - audioplayer
  - comments
  - encryption
  - external
  - files_external
  - firstrunwizard
  - password_policy
  - systemtags
  - user_external
  - user_ldap

Nextcloud configuration:

Config report

{
    "system": {
        "datadirectory": "\/data",
        "apps_paths": [
            {
                "path": "\/nextcloud\/apps",
                "url": "\/apps",
                "writable": false
            },
            {
                "path": "\/apps2",
                "url": "\/apps2",
                "writable": true
            }
        ],
        "memcache.local": "\\OC\\Memcache\\APCu",
        "redis": {
            "host": "redis",
            "port": 6379
        },
        "instanceid": "ocadc83b19e7",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "localhost",
            "nebula.logomancy.net"
        ],
        "overwrite.cli.url": "https:\/\/nebula.logomancy.net",
        "dbtype": "mysql",
        "version": "12.0.0.16",
        "dbname": "nextcloud",
        "dbhost": "db",
        "dbport": "",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "logtimezone": "America\/New_York",
        "installed": true,
        "mail_from_address": "raven",
        "logdateformat": "Y-m-d H:i:s",
        "mail_smtpmode": "smtp",
        "appstoreenabled": true,
        "appstoreurl": "https:\/\/apps.nextcloud.com\/api\/v0",
        "appstore.experimental.enabled": true,
        "enabledPreviewProviders": [
            "OC\\Preview\\Image",
            "OC\\Preview\\MP3",
            "OC\\Preview\\TXT",
            "OC\\Preview\\MarkDown",
            "OC\\Preview\\Epub",
            "OC\\Preview\\PDF"
        ],
        "maintenance": false,
        "loglevel": 2,
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "memcache.distributed": "\\OC\\Memcache\\Redis",
        "mail_domain": "logomancy.net",
        "mail_smtpauth": 1,
        "mail_smtpauthtype": "PLAIN",
        "mail_smtphost": "surkesh.logomancy.net",
        "mail_smtpport": "587",
        "mail_smtpsecure": "tls",
        "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
        "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
        "theme": ""
    }
}

Are you using external storage, if yes which one: No

Are you using encryption: No

Are you using an external user-backend, if yes which one: No

Client configuration

Browser: Pale Moon 27.2.1 (also seen with Firefox 53.0)

Operating system: Manjaro Linux

Logs

Web server error log

No errors present in error log.

Nextcloud log (data/nextcloud.log)

Nextcloud log

{"reqId":"hx176ARwQ1Bhblp4CL5F","level":4,"time":"2017-05-03 11:48:20","remoteAddr":"172.19.0.1","user":"andrew","app":"webdav","method":"PUT","url":"\/remote.php\/webdav\/Documents\/Books\/RPG\/7th%20Sea\/NationsofTheah_Vol1_LowRes_DT_2017_04_14.pdf","message":"Exception: {\"Message\":\"HTTP\\\/1.1 400 expected filesize 17713100 got 3973120\",\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\BadRequest\",\"Code\":0,\"Trace\":\"#0 \\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/Directory.php(149): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #11)\\n#1 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1095): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('NationsofTheah_...', Resource id #11)\\n#2 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('Documents\\\/Books...', Resource id #11, NULL)\\n#3 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#4 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#5 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#6 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#7 \\\/nextcloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(63): Sabre\\\\DAV\\\\Server->exec()\\n#8 \\\/nextcloud\\\/remote.php(162): require_once('\\\/nextcloud\\\/apps...')\\n#9 {main}\",\"File\":\"\\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/File.php\",\"Line\":151,\"User\":\"andrew\"}","userAgent":"Mozilla\/5.0 (X11; Linux x86_64; rv:45.9) Gecko\/20100101 Goanna\/3.2 Firefox\/45.9 PaleMoon\/27.2.1","version":"12.0.0.16"}
{"reqId":"GjyDVppUULr0Xuq3eUIb","level":4,"time":"2017-05-03 11:50:49","remoteAddr":"172.19.0.1","user":"andrew","app":"webdav","method":"PUT","url":"\/remote.php\/webdav\/Documents\/Books\/RPG\/7th%20Sea\/NationsofTheah_Vol1_LowRes_DT_2017_04_14.pdf","message":"Exception: {\"Message\":\"HTTP\\\/1.1 400 expected filesize 17713100 got 3104768\",\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\BadRequest\",\"Code\":0,\"Trace\":\"#0 \\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/Directory.php(149): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #11)\\n#1 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1095): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('NationsofTheah_...', Resource id #11)\\n#2 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('Documents\\\/Books...', Resource id #11, NULL)\\n#3 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#4 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#5 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#6 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#7 \\\/nextcloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(63): Sabre\\\\DAV\\\\Server->exec()\\n#8 \\\/nextcloud\\\/remote.php(162): require_once('\\\/nextcloud\\\/apps...')\\n#9 {main}\",\"File\":\"\\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/File.php\",\"Line\":151,\"User\":\"andrew\"}","userAgent":"Mozilla\/5.0 (X11; Linux x86_64; rv:45.9) Gecko\/20100101 Goanna\/3.2 Firefox\/45.9 PaleMoon\/27.2.1","version":"12.0.0.16"}
{"reqId":"ZGcP4vsGV0MbQvdtSsFh","level":4,"time":"2017-05-03 12:17:36","remoteAddr":"172.19.0.1","user":"andrew","app":"webdav","method":"PUT","url":"\/remote.php\/webdav\/Documents\/Books\/RPG\/7th%20Sea\/NationsofTheah_Vol1_LowRes_DT_2017_04_14.pdf","message":"Exception: {\"Message\":\"HTTP\\\/1.1 400 expected filesize 17713100 got 15310848\",\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\BadRequest\",\"Code\":0,\"Trace\":\"#0 \\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/Directory.php(149): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #11)\\n#1 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1095): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Directory->createFile('NationsofTheah_...', Resource id #11)\\n#2 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(525): Sabre\\\\DAV\\\\Server->createFile('Documents\\\/Books...', Resource id #11, NULL)\\n#3 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#4 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#5 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#6 \\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#7 \\\/nextcloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(63): Sabre\\\\DAV\\\\Server->exec()\\n#8 \\\/nextcloud\\\/remote.php(162): require_once('\\\/nextcloud\\\/apps...')\\n#9 {main}\",\"File\":\"\\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/File.php\",\"Line\":151,\"User\":\"andrew\"}","userAgent":"Mozilla\/5.0 (X11; Linux x86_64; rv:45.9) Gecko\/20100101 Goanna\/3.2 Firefox\/45.9 PaleMoon\/27.2.1","version":"12.0.0.16"}
{"reqId":"3XJP3GQ2Pi4nuS9YtXUH","level":3,"time":"2017-05-03 12:20:08","remoteAddr":"172.19.0.1","user":"admin","app":"index","method":"GET","url":"\/apps\/files\/index.php\/apps\/gallery\/config?extramediatypes=1","message":"Exception: {\"Exception\":\"Exception\",\"Message\":\"The requested uri(\\\/apps\\\/files\\\/index.php\\\/apps\\\/gallery\\\/config) cannot be processed by the script '\\\/apps\\\/gallery\\\/config')\",\"Code\":0,\"Trace\":\"#0 \\\/nextcloud\\\/lib\\\/base.php(928): OC\\\\AppFramework\\\\Http\\\\Request->getRawPathInfo()\\n#1 \\\/nextcloud\\\/index.php(40): OC::handleRequest()\\n#2 {main}\",\"File\":\"\\\/nextcloud\\\/lib\\\/private\\\/AppFramework\\\/Http\\\/Request.php\",\"Line\":729}","userAgent":"Mozilla\/5.0 (X11; Linux x86_64; rv:45.9) Gecko\/20100101 Goanna\/3.2 Firefox\/45.9 PaleMoon\/27.2.1","version":"12.0.0.16"}

Browser log

No errors present in browser log.

The text was updated successfully, but these errors were encountered:

enoch85 · 2017-05-03T18:51:29Z

I'm absolutely no expert here, but it sounds more like a server configuration error than a Nextcloud error (especially since it was the same behavior on 11.X as well), but I might be wrong.

What is your upload max setting in PHP? Is this server behind a proxy?

logomancer · 2017-05-03T19:28:17Z

upload_max_filesize is 10 gigabytes. The container is behind Caddy being used as a reverse proxy with the following settings:

nebula.logomancy.net {
    proxy / localhost:[port redacted] {
        transparent
    }
    tls [email redacted]
}

enoch85 · 2017-05-04T04:32:32Z

Ok, I use a reverse proxy too, and before I figured out that I needed to bypass the proxy and upload directly to the backend I had similar issues as you - the uploads would just stop.

I use Nginx as a reverse proxy and I had to add a setting in my Nginx conf so that all the files that where uploaded was sent directly to my Apache backend, and in Apache I created a upload-tmp dir where all the files ended up.

That solved my issue anyway. Never touched Nebula (heard it's neat though) so I can't help you there, but start investigating your settings. That's what I would do to find out where it stops and why.

I wrote a blog post about increasing max size here: https://www.techandme.se/increase-max-file-size/

ariselseng · 2017-05-04T13:49:06Z

This would be fixed by making the web ui support chunked and resumeable upload. This is by far the most wanted feature by me and my colleagues.

enoch85 · 2017-05-04T18:33:07Z

@cowai Would be great, indeed.

logomancer · 2017-05-05T15:05:14Z

Nebula's just my name for the instance; I'm not actually using Nebula.

Investigating my settings, I don't see caddy doing any sort of buffering. There's buffering on php-fpm's end, but I tried turning that off and it didn't seem to have any effect.

jancborchardt · 2017-05-16T18:55:33Z

@cowai see the issue for chunking at #673 – any contribution is very welcome! :)

milleraa · 2017-06-11T13:14:19Z

same issue with nextcloud 12 and caddy. All was ok with same caddy config and v11

milleraa · 2017-06-11T15:01:28Z

I have upgraded caddy and problem has gone.

MorrisJobke · 2017-10-30T16:11:28Z

Let's focus on the chunked upload for now and for setup issues ask in the forums: https://help.nextcloud.com

enoch85 added the needs info label May 3, 2017

MorrisJobke closed this as completed Oct 30, 2017

This was referenced Jul 16, 2018

File Download CSP Error #10254

Closed

Tags are lost when uploading or downloading files #10282

Closed

nextcloud-bot mentioned this issue Jul 24, 2018

Lost connection to LDAP server. #10360

Closed

nextcloud-bot mentioned this issue Nov 2, 2018

On Android App: Upload failed: An error occured during connection to the server" #12219

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

"Connection to server lost" error when uploading/downloading large files #4678

"Connection to server lost" error when uploading/downloading large files #4678

logomancer commented May 3, 2017 •

edited

Loading

enoch85 commented May 3, 2017

logomancer commented May 3, 2017

enoch85 commented May 4, 2017

ariselseng commented May 4, 2017

enoch85 commented May 4, 2017

logomancer commented May 5, 2017

jancborchardt commented May 16, 2017

milleraa commented Jun 11, 2017 •

edited

Loading

milleraa commented Jun 11, 2017

MorrisJobke commented Oct 30, 2017

"Connection to server lost" error when uploading/downloading large files #4678

"Connection to server lost" error when uploading/downloading large files #4678

Comments

logomancer commented May 3, 2017 • edited Loading

Steps to reproduce

Expected behaviour

Actual behaviour

Server configuration

Client configuration

Logs

Web server error log

Nextcloud log (data/nextcloud.log)

Browser log

enoch85 commented May 3, 2017

logomancer commented May 3, 2017

enoch85 commented May 4, 2017

ariselseng commented May 4, 2017

enoch85 commented May 4, 2017

logomancer commented May 5, 2017

jancborchardt commented May 16, 2017

milleraa commented Jun 11, 2017 • edited Loading

milleraa commented Jun 11, 2017

MorrisJobke commented Oct 30, 2017

logomancer commented May 3, 2017 •

edited

Loading

milleraa commented Jun 11, 2017 •

edited

Loading